From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-9.0 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING, SPF_HELO_NONE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 43162C433E4 for ; Wed, 22 Jul 2020 08:10:21 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 07E1D20657 for ; Wed, 22 Jul 2020 08:10:20 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 07E1D20657 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=suse.de Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 782316B0003; Wed, 22 Jul 2020 04:10:20 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 735276B0005; Wed, 22 Jul 2020 04:10:20 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 64B5C6B0006; Wed, 22 Jul 2020 04:10:20 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0044.hostedemail.com [216.40.44.44]) by kanga.kvack.org (Postfix) with ESMTP id 4EAE46B0003 for ; Wed, 22 Jul 2020 04:10:20 -0400 (EDT) Received: from smtpin06.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay01.hostedemail.com (Postfix) with ESMTP id D7C811800E8C3 for ; Wed, 22 Jul 2020 08:10:19 +0000 (UTC) X-FDA: 77064989358.06.cars53_1c09b1b26f34 Received: from filter.hostedemail.com (10.5.16.251.rfc1918.com [10.5.16.251]) by smtpin06.hostedemail.com (Postfix) with ESMTP id 6F7DA1863D790 for ; Wed, 22 Jul 2020 08:09:02 +0000 (UTC) X-HE-Tag: cars53_1c09b1b26f34 X-Filterd-Recvd-Size: 5210 Received: from mx2.suse.de (mx2.suse.de [195.135.220.15]) by imf10.hostedemail.com (Postfix) with ESMTP for ; Wed, 22 Jul 2020 08:09:01 +0000 (UTC) X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.221.27]) by mx2.suse.de (Postfix) with ESMTP id E65E5AFEA; Wed, 22 Jul 2020 08:09:07 +0000 (UTC) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Wed, 22 Jul 2020 10:08:59 +0200 From: osalvador@suse.de To: =?UTF-8?Q?HORIGUCHI_NAOYA=28=E5=A0=80=E5=8F=A3=E3=80=80=E7=9B=B4?= =?UTF-8?Q?=E4=B9=9F=29?= Cc: akpm@linux-foundation.org, Michal Hocko , linux-mm@kvack.org, mike.kravetz@oracle.com, david@redhat.com, aneesh.kumar@linux.vnet.ibm.com, linux-kernel@vger.kernel.org, Oscar Salvador Subject: Re: [PATCH v4 12/15] mm,hwpoison: Rework soft offline for in-use pages In-Reply-To: References: <20200716123810.25292-1-osalvador@suse.de> <20200716123810.25292-13-osalvador@suse.de> User-Agent: Roundcube Webmail Message-ID: <3b2231bf69133bb7bb8936c74b4e9c9f@suse.de> X-Sender: osalvador@suse.de X-Rspamd-Queue-Id: 6F7DA1863D790 X-Spamd-Result: default: False [0.00 / 100.00] X-Rspamd-Server: rspam01 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 2020-07-20 10:27, osalvador@suse.de wrote: > On 2020-07-17 08:55, HORIGUCHI NAOYA wrote: >> I ran Quan Cai's test program (https://github.com/cailca/linux-mm) on >> a >> small (4GB memory) VM, and weiredly found that (1) the target >> hugepages >> are not always dissolved and (2) dissovled hugetpages are still >> counted >> in "HugePages_Total:". See below: >> >> $ ./random 1 >> - start: migrate_huge_offline >> - use NUMA nodes 0,1. >> - mmap and free 8388608 bytes hugepages on node 0 >> - mmap and free 8388608 bytes hugepages on node 1 >> madvise: Cannot allocate memory >> >> $ cat /proc/meminfo >> MemTotal: 4026772 kB >> MemFree: 976300 kB >> MemAvailable: 892840 kB >> Buffers: 20936 kB >> Cached: 99768 kB >> SwapCached: 5904 kB >> Active: 84332 kB >> Inactive: 116328 kB >> Active(anon): 27944 kB >> Inactive(anon): 68524 kB >> Active(file): 56388 kB >> Inactive(file): 47804 kB >> Unevictable: 7532 kB >> Mlocked: 0 kB >> SwapTotal: 2621436 kB >> SwapFree: 2609844 kB >> Dirty: 56 kB >> Writeback: 0 kB >> AnonPages: 81764 kB >> Mapped: 54348 kB >> Shmem: 8948 kB >> KReclaimable: 22744 kB >> Slab: 52056 kB >> SReclaimable: 22744 kB >> SUnreclaim: 29312 kB >> KernelStack: 3888 kB >> PageTables: 2804 kB >> NFS_Unstable: 0 kB >> Bounce: 0 kB >> WritebackTmp: 0 kB >> CommitLimit: 3260612 kB >> Committed_AS: 828196 kB >> VmallocTotal: 34359738367 kB >> VmallocUsed: 19260 kB >> VmallocChunk: 0 kB >> Percpu: 5120 kB >> HardwareCorrupted: 5368 kB >> AnonHugePages: 18432 kB >> ShmemHugePages: 0 kB >> ShmemPmdMapped: 0 kB >> FileHugePages: 0 kB >> FilePmdMapped: 0 kB >> CmaTotal: 0 kB >> CmaFree: 0 kB >> HugePages_Total: 1342 // still counted as hugetlb pages. >> HugePages_Free: 0 // all hugepage are still allocated >> (or leaked?) >> HugePages_Rsvd: 0 >> HugePages_Surp: 762 // some are counted in surplus. >> Hugepagesize: 2048 kB >> Hugetlb: 2748416 kB >> DirectMap4k: 112480 kB >> DirectMap2M: 4081664 kB >> >> >> $ page-types -b hwpoison >> flags page-count MB symbolic-flags >> long-symbolic-flags >> 0x0000000000080008 421 1 >> ___U_______________X_______________________ uptodate,hwpoison >> 0x00000000000a8018 1 0 >> ___UD__________H_G_X_______________________ >> uptodate,dirty,compound_head,huge,hwpoison >> 0x00000000000a801c 920 3 >> __RUD__________H_G_X_______________________ >> referenced,uptodate,dirty,compound_head,huge,hwpoison >> total 1342 5 >> >> This means that some hugepages are dissolved, but the others not, >> maybe which is not desirable. >> I'll dig this more later but just let me share at first. >> >> A few minor comment below ... > > > Uhm, weird. > > I will be taking a look today. After some digging up I __think__ I found the problem. I will try to fix it up and I will be running tests. I might reach out to you once I am done because I remember you had a test-suite that worked quite well, so you can give it a spin there. Thanks