From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.5 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 11E34C433EF for ; Mon, 9 Sep 2019 12:09:14 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id C48A72067B for ; Mon, 9 Sep 2019 12:09:13 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org C48A72067B Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=profihost.ag Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 7577B6B0006; Mon, 9 Sep 2019 08:09:13 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 72D806B0007; Mon, 9 Sep 2019 08:09:13 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 644226B0008; Mon, 9 Sep 2019 08:09:13 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0208.hostedemail.com [216.40.44.208]) by kanga.kvack.org (Postfix) with ESMTP id 438BC6B0006 for ; Mon, 9 Sep 2019 08:09:13 -0400 (EDT) Received: from smtpin06.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay01.hostedemail.com (Postfix) with SMTP id E9E84180AD801 for ; Mon, 9 Sep 2019 12:09:12 +0000 (UTC) X-FDA: 75915261744.06.front28_8a9214c177826 X-HE-Tag: front28_8a9214c177826 X-Filterd-Recvd-Size: 5189 Received: from cloud1-vm154.de-nserver.de (cloud1-vm154.de-nserver.de [178.250.10.56]) by imf21.hostedemail.com (Postfix) with ESMTP for ; Mon, 9 Sep 2019 12:09:11 +0000 (UTC) Received: (qmail 31435 invoked from network); 9 Sep 2019 14:09:09 +0200 X-Fcrdns: No Received: from phoffice.de-nserver.de (HELO [10.11.11.182]) (185.39.223.5) (smtp-auth username hostmaster@profihost.com, mechanism plain) by cloud1-vm154.de-nserver.de (qpsmtpd/0.92) with (ECDHE-RSA-AES256-GCM-SHA384 encrypted) ESMTPSA; Mon, 09 Sep 2019 14:09:09 +0200 Subject: Re: lot of MemAvailable but falling cache and raising PSI To: Vlastimil Babka , Michal Hocko Cc: "linux-mm@kvack.org" , l.roehrs@profihost.ag, cgroups@vger.kernel.org, Johannes Weiner References: <4b4ba042-3741-7b16-2292-198c569da2aa@profihost.ag> <20190905114022.GH3838@dhcp22.suse.cz> <7a3d23f2-b5fe-b4c0-41cd-e79070637bd9@profihost.ag> <20190909082732.GC27159@dhcp22.suse.cz> <1d9ee19a-98c9-cd78-1e5b-21d9d6e36792@profihost.ag> From: Stefan Priebe - Profihost AG Message-ID: <3ca34a49-6327-e6fd-2754-9b0700d87785@profihost.ag> Date: Mon, 9 Sep 2019 14:09:09 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: de-DE X-User-Auth: Auth by hostmaster@profihost.com through 185.39.223.5 Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Am 09.09.19 um 13:49 schrieb Vlastimil Babka: > On 9/9/19 10:54 AM, Stefan Priebe - Profihost AG wrote: >>> Do you have more snapshots of /proc/vmstat as suggested by Vlastimil = and >>> me earlier in this thread? Seeing the overall progress would tell us >>> much more than before and after. Or have I missed this data? >> >> I needed to wait until today to grab again such a situation but from >> what i know it is very clear that MemFree is low and than the kernel >> starts to drop the chaches. >> >> Attached you'll find two log files. >=20 > Thanks, what about my other requests/suggestions from earlier? Sorry i missed your email. > 1. How does /proc/pagetypeinfo look like? # cat /proc/pagetypeinfo Page block order: 9 Pages per block: 512 Free pages count per migrate type at order 0 1 2 3 4 5 6 7 8 9 10 Node 0, zone DMA, type Unmovable 1 0 0 1 2 1 1 0 1 0 0 Node 0, zone DMA, type Movable 0 0 0 0 0 0 0 0 0 1 3 Node 0, zone DMA, type Reclaimable 0 0 0 0 0 0 0 0 0 0 0 Node 0, zone DMA, type HighAtomic 0 0 0 0 0 0 0 0 0 0 0 Node 0, zone DMA, type Isolate 0 0 0 0 0 0 0 0 0 0 0 Node 0, zone DMA32, type Unmovable 1141 970 903 628 302 106 27 4 0 0 0 Node 0, zone DMA32, type Movable 274 269 368 396 342 265 214 178 113 12 13 Node 0, zone DMA32, type Reclaimable 81 57 134 114 60 50 25 4 2 0 0 Node 0, zone DMA32, type HighAtomic 0 0 0 0 0 0 0 0 0 0 0 Node 0, zone DMA32, type Isolate 0 0 0 0 0 0 0 0 0 0 0 Node 0, zone Normal, type Unmovable 39 36 13257 3474 1333 317 42 0 0 0 0 Node 0, zone Normal, type Movable 1087 9678 1104 4250 2391 1946 1768 691 141 0 0 Node 0, zone Normal, type Reclaimable 1 1782 1153 2455 1927 986 330 7 2 0 0 Node 0, zone Normal, type HighAtomic 1 1 2 2 2 0 1 1 1 0 0 Node 0, zone Normal, type Isolate 0 0 0 0 0 0 0 0 0 0 0 Number of blocks type Unmovable Movable Reclaimable HighAtomic Isolate Node 0, zone DMA 1 7 0 0 0 Node 0, zone DMA32 52 1461 15 0 0 Node 0, zone Normal 824 5448 383 1 0 > 2. Could you also try if the bad trend stops after you execute: > =C2=A0echo never > /sys/kernel/mm/transparent_hugepage/defrag > and report the result? it's pretty difficult to catch those moments. Is it OK so set the value now and monitor if it happens again? Just to let you know: I've now also some more servers where memfree show 10-20Gb but cache drops suddently and memory PSI raises. Greets, Stefan