From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-14.3 required=3.0 tests=BAYES_00,DKIMWL_WL_MED, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_IN_DEF_DKIM_WL autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id CB5CFC55179 for ; Thu, 22 Oct 2020 16:37:18 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 301392464E for ; Thu, 22 Oct 2020 16:37:17 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="cPEe7aFg" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 301392464E Authentication-Results: mail.kernel.org; dmarc=fail (p=reject dis=none) header.from=google.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 301906B006E; Thu, 22 Oct 2020 12:37:17 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 2B2316B0070; Thu, 22 Oct 2020 12:37:17 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 1A0BC6B0071; Thu, 22 Oct 2020 12:37:17 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0086.hostedemail.com [216.40.44.86]) by kanga.kvack.org (Postfix) with ESMTP id E25716B006E for ; Thu, 22 Oct 2020 12:37:16 -0400 (EDT) Received: from smtpin23.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay02.hostedemail.com (Postfix) with ESMTP id 70214362B for ; Thu, 22 Oct 2020 16:37:16 +0000 (UTC) X-FDA: 77400116472.23.birds60_1a1838a27252 Received: from filter.hostedemail.com (10.5.16.251.rfc1918.com [10.5.16.251]) by smtpin23.hostedemail.com (Postfix) with ESMTP id 52C9537606 for ; Thu, 22 Oct 2020 16:37:16 +0000 (UTC) X-HE-Tag: birds60_1a1838a27252 X-Filterd-Recvd-Size: 10127 Received: from mail-lf1-f65.google.com (mail-lf1-f65.google.com [209.85.167.65]) by imf05.hostedemail.com (Postfix) with ESMTP for ; Thu, 22 Oct 2020 16:37:15 +0000 (UTC) Received: by mail-lf1-f65.google.com with SMTP id 77so3066364lfl.2 for ; Thu, 22 Oct 2020 09:37:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=2bw94IOrTBJtNZ76znInkjeMeO4jMIt+uWCo9yV789A=; b=cPEe7aFgm7zkN530LlRn+RRK7ZyYWfmOUxlmi+jlfEDBROk+PYa6nxli3wMjrhOXwO bePDGQ6v+KlM9oq2elI2FfYRl3Rxf0NZkOtQJckKwt7cm9dXQ6ccJgu/91RXPd7V9v18 CESXDOlGe0nh3R95gAauw2eDHat7kTD3iOQNEy3vOp3tIXb0PGSaPxTXfmX5JQjj5SOJ NlXplZHHSr3snnAe9qgYXZHhU2Ayu6Z+UQuyk+Ki5dVCribu1Pn7BLRAGtZ2rabActSl 38z6qdwmfN7GlRbfHnSWMxIRBt7XXiHMbghrd6AINeU+OUmv1m65NxnnZkKbfY5aYNOn RSTw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=2bw94IOrTBJtNZ76znInkjeMeO4jMIt+uWCo9yV789A=; b=Ymop4J9FL0F0kRbjOFpXjdZkiU2Y9eUR8/faAWbI015mGhqxTdxVkQdFSVCRQYgy4Z 4Ue02qHwSXtUw/ziROKjsNrBnF4qsjdp2pKKr6jsm5fIkvMLNinyB+vO9DAHGXjGn70f EjJzt/6lrG/EVZWNabuT/hFDfozZBDL6w3v4MbyzNkaKLNashs+2MFRp3phq/pMuwzTM kQJ7oKgzUfxvWwu25ip+yC/WrL0qFbvwCgl94uWgbbxgP4RwX2/9tZo5d64fsgBiUMQk 2NG+LQBNM5QoKXNm+nMfzFWwQMh/x92Lo/ThGMbH3Xgqoq14oiJexHqfLGiYnGC4DSfs vPyw== X-Gm-Message-State: AOAM5303Nqcyx5BNAqYnlRJoHWjECufZNSzGwYj0oJtHNh3sis6HleBy fxlgTI73f7xnLX3lR8n09qlSdLq2ifxCzgiL5PBt8A== X-Google-Smtp-Source: ABdhPJwbaZMfDuvN1gaxtz/Irn8R6Ohl8MOEX8IdhJMssRX/hyw+vUigQ09Y02ENJhLqDtHSUzEvitRzt1X0Z7y+V+4= X-Received: by 2002:ac2:550d:: with SMTP id j13mr1081682lfk.475.1603384633857; Thu, 22 Oct 2020 09:37:13 -0700 (PDT) MIME-Version: 1.0 References: <87sga6vizp.fsf@suse.de> <20201022122858.8638-1-rpalethorpe@suse.com> In-Reply-To: <20201022122858.8638-1-rpalethorpe@suse.com> From: Shakeel Butt Date: Thu, 22 Oct 2020 09:37:02 -0700 Message-ID: Subject: Re: [PATCH v4] mm: memcg/slab: Stop reparented obj_cgroups from charging root To: Richard Palethorpe Cc: Linux MM , LKML , LTP List , Roman Gushchin , Johannes Weiner , Andrew Morton , Christoph Lameter , Michal Hocko , Tejun Heo , Vlastimil Babka Content-Type: text/plain; charset="UTF-8" X-Bogosity: Ham, tests=bogofilter, spamicity=0.000001, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Thu, Oct 22, 2020 at 5:29 AM Richard Palethorpe wrote: > > When use_hierarchy=1, SLAB objects which outlive their descendant > memcg are moved to their parent memcg where they may be uncharged > because charges are made recursively from leaf to root nodes. > > However when use_hierarchy=0, they are reparented directly to root and > charging is not made recursively. Therefor uncharging will result in a > counter underflow on the root memcg, but no other ancestors. > > To prevent this, we check whether we are about to uncharge the root > memcg and whether use_hierarchy=0. If this is the case then we skip > uncharging. The root memcg does not have its own objcg, so any objcg > which is uncharging to it must have been reparented. > > Note that on the default hierarchy (CGroupV2 now) root always has > use_hierarchy=1. So this only effects CGroupV1. > > The warning can be, unreliably, reproduced with the LTP test > madvise06 if the entire patch series > https://lore.kernel.org/linux-mm/20200623174037.3951353-1-guro@fb.com/ > is present. Although the listed commit in 'fixes' appears to introduce > the bug, I can not reproduce it with just that commit and bisecting > runs into other bugs. > > [ 12.029417] WARNING: CPU: 2 PID: 21 at mm/page_counter.c:57 page_counter_uncharge (mm/page_counter.c:57 mm/page_counter.c:50 mm/page_counter.c:156) > [ 12.029539] Modules linked in: > [ 12.029611] CPU: 2 PID: 21 Comm: ksoftirqd/2 Not tainted 5.9.0-rc7-22-default #76 > [ 12.029729] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.13.0-48-gd9c812d-rebuilt.opensuse.org 04/01/2014 > [ 12.029908] RIP: 0010:page_counter_uncharge (mm/page_counter.c:57 mm/page_counter.c:50 mm/page_counter.c:156) > [ 12.029991] Code: 0f c1 45 00 4c 29 e0 48 89 ef 48 89 c3 48 89 c6 e8 2a fe ff ff 48 85 db 78 10 48 8b 6d 28 48 85 ed 75 d8 5b 5d 41 5c 41 5d c3 <0f> 0b eb ec 90 e8 db 47 36 27 48 8b 17 48 39 d6 72 41 41 54 49 89 > [ 12.030258] RSP: 0018:ffffa5d8000efd08 EFLAGS: 00010086 > [ 12.030344] RAX: ffffffffffffffff RBX: ffffffffffffffff RCX: 0000000000000009 > [ 12.030455] RDX: 000000000000000b RSI: ffffffffffffffff RDI: ffff8ef8c7d2b248 > [ 12.030561] RBP: ffff8ef8c7d2b248 R08: ffff8ef8c78b19c8 R09: 0000000000000001 > [ 12.030672] R10: 0000000000000000 R11: ffff8ef8c780e0d0 R12: 0000000000000001 > [ 12.030784] R13: ffffffffffffffff R14: ffff8ef9478b19c8 R15: 0000000000000000 > [ 12.030895] FS: 0000000000000000(0000) GS:ffff8ef8fbc80000(0000) knlGS:0000000000000000 > [ 12.031017] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > [ 12.031104] CR2: 00007f72c0af93ec CR3: 000000005c40a000 CR4: 00000000000006e0 > [ 12.031209] Call Trace: > [ 12.031267] __memcg_kmem_uncharge (mm/memcontrol.c:3022) > [ 12.031470] drain_obj_stock (./include/linux/rcupdate.h:689 mm/memcontrol.c:3114) > [ 12.031594] refill_obj_stock (mm/memcontrol.c:3166) > [ 12.031733] ? rcu_do_batch (kernel/rcu/tree.c:2438) > [ 12.032075] memcg_slab_free_hook (./include/linux/mm.h:1294 ./include/linux/mm.h:1441 mm/slab.h:368 mm/slab.h:348) > [ 12.032339] kmem_cache_free (mm/slub.c:3107 mm/slub.c:3143 mm/slub.c:3158) > [ 12.032464] rcu_do_batch (kernel/rcu/tree.c:2438) > [ 12.032567] rcu_core (kernel/rcu/tree_plugin.h:2122 kernel/rcu/tree_plugin.h:2157 kernel/rcu/tree.c:2661) > [ 12.032664] __do_softirq (./arch/x86/include/asm/jump_label.h:25 ./include/linux/jump_label.h:200 ./include/trace/events/irq.h:142 kernel/softirq.c:299) > [ 12.032766] run_ksoftirqd (./arch/x86/include/asm/irqflags.h:54 ./arch/x86/include/asm/irqflags.h:94 kernel/softirq.c:653 kernel/softirq.c:644) > [ 12.032852] smpboot_thread_fn (kernel/smpboot.c:165) > [ 12.032940] ? smpboot_register_percpu_thread (kernel/smpboot.c:108) > [ 12.033059] kthread (kernel/kthread.c:292) > [ 12.033148] ? __kthread_bind_mask (kernel/kthread.c:245) > [ 12.033269] ret_from_fork (arch/x86/entry/entry_64.S:300) > [ 12.033357] ---[ end trace 961dbfc01c109d1f ]--- > > [ 9.841552] ------------[ cut here ]------------ > [ 9.841788] WARNING: CPU: 0 PID: 12 at mm/page_counter.c:57 page_counter_uncharge (mm/page_counter.c:57 mm/page_counter.c:50 mm/page_counter.c:156) > [ 9.841982] Modules linked in: > [ 9.842072] CPU: 0 PID: 12 Comm: kworker/0:1 Not tainted 5.9.0-rc7-22-default #77 > [ 9.842266] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.13.0-48-gd9c812d-rebuilt.opensuse.org 04/01/2014 > [ 9.842571] Workqueue: events drain_local_stock > [ 9.842750] RIP: 0010:page_counter_uncharge (mm/page_counter.c:57 mm/page_counter.c:50 mm/page_counter.c:156) > [ 9.842894] Code: 0f c1 45 00 4c 29 e0 48 89 ef 48 89 c3 48 89 c6 e8 2a fe ff ff 48 85 db 78 10 48 8b 6d 28 48 85 ed 75 d8 5b 5d 41 5c 41 5d c3 <0f> 0b eb ec 90 e8 4b f9 88 2a 48 8b 17 48 39 d6 72 41 41 54 49 89 > [ 9.843438] RSP: 0018:ffffb1c18006be28 EFLAGS: 00010086 > [ 9.843585] RAX: ffffffffffffffff RBX: ffffffffffffffff RCX: ffff94803bc2cae0 > [ 9.843806] RDX: 0000000000000001 RSI: ffffffffffffffff RDI: ffff948007d2b248 > [ 9.844026] RBP: ffff948007d2b248 R08: ffff948007c58eb0 R09: ffff948007da05ac > [ 9.844248] R10: 0000000000000018 R11: 0000000000000018 R12: 0000000000000001 > [ 9.844477] R13: ffffffffffffffff R14: 0000000000000000 R15: ffff94803bc2cac0 > [ 9.844696] FS: 0000000000000000(0000) GS:ffff94803bc00000(0000) knlGS:0000000000000000 > [ 9.844915] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > [ 9.845096] CR2: 00007f0579ee0384 CR3: 000000002cc0a000 CR4: 00000000000006f0 > [ 9.845319] Call Trace: > [ 9.845429] __memcg_kmem_uncharge (mm/memcontrol.c:3022) > [ 9.845582] drain_obj_stock (./include/linux/rcupdate.h:689 mm/memcontrol.c:3114) > [ 9.845684] drain_local_stock (mm/memcontrol.c:2255) > [ 9.845789] process_one_work (./arch/x86/include/asm/jump_label.h:25 ./include/linux/jump_label.h:200 ./include/trace/events/workqueue.h:108 kernel/workqueue.c:2274) > [ 9.845898] worker_thread (./include/linux/list.h:282 kernel/workqueue.c:2416) > [ 9.846034] ? process_one_work (kernel/workqueue.c:2358) > [ 9.846162] kthread (kernel/kthread.c:292) > [ 9.846271] ? __kthread_bind_mask (kernel/kthread.c:245) > [ 9.846420] ret_from_fork (arch/x86/entry/entry_64.S:300) > [ 9.846531] ---[ end trace 8b5647c1eba9d18a ]--- > > Reported-by: ltp@lists.linux.it > Signed-off-by: Richard Palethorpe > Acked-by: Roman Gushchin > Cc: Johannes Weiner > Cc: Andrew Morton > Cc: Shakeel Butt > Cc: Christoph Lameter > Cc: Michal Hocko > Cc: Tejun Heo > Cc: Vlastimil Babka > Fixes: bf4f059954dc ("mm: memcg/slab: obj_cgroup API") This looks fine to me but I would prefer Roman's approach of charging to root and for use_hierarchy=0, linking them to root. Since bf4f059954dc ("mm: memcg/slab: obj_cgroup API") is in 5.9, I think we can take this patch for 5.9 and 5.10 but keep Roman's cleanup for 5.11. What does everyone think?