From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.4 required=3.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,USER_IN_DEF_DKIM_WL autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 271F7C34031 for ; Tue, 18 Feb 2020 21:36:51 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id DBA682070B for ; Tue, 18 Feb 2020 21:36:50 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="CmAOW91X" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org DBA682070B Authentication-Results: mail.kernel.org; dmarc=fail (p=reject dis=none) header.from=google.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 8BB7E6B0006; Tue, 18 Feb 2020 16:36:50 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 8440A6B0007; Tue, 18 Feb 2020 16:36:50 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 7344E6B0008; Tue, 18 Feb 2020 16:36:50 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0008.hostedemail.com [216.40.44.8]) by kanga.kvack.org (Postfix) with ESMTP id 58F956B0006 for ; Tue, 18 Feb 2020 16:36:50 -0500 (EST) Received: from smtpin06.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay01.hostedemail.com (Postfix) with ESMTP id 230EA180AD820 for ; Tue, 18 Feb 2020 21:36:50 +0000 (UTC) X-FDA: 76504557780.06.frog82_75d289c656d1c X-HE-Tag: frog82_75d289c656d1c X-Filterd-Recvd-Size: 5673 Received: from mail-ot1-f65.google.com (mail-ot1-f65.google.com [209.85.210.65]) by imf11.hostedemail.com (Postfix) with ESMTP for ; Tue, 18 Feb 2020 21:36:49 +0000 (UTC) Received: by mail-ot1-f65.google.com with SMTP id j20so21074120otq.3 for ; Tue, 18 Feb 2020 13:36:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=FoArTrJylMnWlkqCFi8ZRwkMiw0N4sNay65yTiKUcw8=; b=CmAOW91XtqP4UUdWMtfykPWQ26luE5zu7mFfOZxd4Ds6vR66zhEAMV5frCjn5UgU0v JpPDq3+wp0VVZ03uRe+iI+f1VNP0koZHN1egietzjXTsXUX0/NS/5jantDolGjfRdW0E uYLefhkR0kQSKAd2/ACPTYX9SyswNyoRCJpQvp7/qHRKkAy2O6BBEkFZXguoT98teQEI L+ipnJfLXgOk/TRGLea0g+BM6gCwKRQf9EB5FH6mQ/B+o2jkRlwWY5xjWlr2cTNP2HNl 2xBoqTmAzlSF2o0p/nJHoJMVT/OE7CwXczBCr9JZ4KjqQ2OJqWoFMMjBGFx+HyiY8oGN xhhA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=FoArTrJylMnWlkqCFi8ZRwkMiw0N4sNay65yTiKUcw8=; b=BQEIS/PVB/X/ZPFyT6L2jO1kH4bZfCZWi1K4/HIb39g/j8RXEQRVl+EmjLPAsFf4Ce +mSOEaXRjlISBMqF0nrPdhVTCAMCmcvilHNYu+i+a/0x7gzB5U+0L2mlY1fak1kfg6ca uVbVOj2EVhnK/ykFlv84myaLBh5rxZMwzwFz5Ptet/UQhs6zz+FtH9hZWW44glHACfgp L1UBCV3x0hcxnmHOOsjVGinlh87/Dvwe8fk7QXVvlQSnoFRbx5Srm7AiBN38I8WMZHhp Bh8eJS2lQNxEIbDHpKD8czK1/hxmFyNsM/23r4vmSypDXc1uJgxmVpQtvp9ItrNGArU7 iqpQ== X-Gm-Message-State: APjAAAX2/sRoUEP+PKvD1Jaabfr1RhON5L5zlsDJZhoj87fnOgJ9qsJ1 P89TOGrYEMSudVtS3pjtNiNGkm+O0NnLmV7EFU2Swg== X-Google-Smtp-Source: APXvYqzLjYFmXv8z2hR60F3INRqj1Zd+4SOlEkiOGiPnShqVS/POOXRWyVy0dvfvD7ksUqf8gQ/4gQPxNLthT7DGhNg= X-Received: by 2002:a9d:518b:: with SMTP id y11mr16379822otg.349.1582061808428; Tue, 18 Feb 2020 13:36:48 -0800 (PST) MIME-Version: 1.0 References: <20200211213128.73302-1-almasrymina@google.com> <20200211151906.637d1703e4756066583b89da@linux-foundation.org> <1582035660.7365.90.camel@lca.pw> In-Reply-To: From: Mina Almasry Date: Tue, 18 Feb 2020 13:36:37 -0800 Message-ID: Subject: Re: [PATCH v12 1/9] hugetlb_cgroup: Add hugetlb_cgroup reservation counter To: Mike Kravetz Cc: Qian Cai , Andrew Morton , shuah , David Rientjes , Shakeel Butt , Greg Thelen , open list , linux-mm@kvack.org, linux-kselftest@vger.kernel.org, cgroups@vger.kernel.org Content-Type: text/plain; charset="UTF-8" X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Tue, Feb 18, 2020 at 11:25 AM Mina Almasry wrote: > > On Tue, Feb 18, 2020 at 11:14 AM Mike Kravetz wrote: > > > > On 2/18/20 10:35 AM, Mina Almasry wrote: > > > On Tue, Feb 18, 2020 at 6:21 AM Qian Cai wrote: > > >> > > >> On Tue, 2020-02-11 at 15:19 -0800, Andrew Morton wrote: > > >>> On Tue, 11 Feb 2020 13:31:20 -0800 Mina Almasry wrote: > > >>> > > >> [ 7933.806377][T14355] ------------[ cut here ]------------ > > >> [ 7933.806541][T14355] kernel BUG at mm/hugetlb.c:490! > > >> VM_BUG_ON(t - f <= 1); > > >> [ 7933.806562][T14355] Oops: Exception in kernel mode, sig: 5 [#1] > > > > > Hi Qian, > > > > > > Yes this VM_BUG_ON was added by a patch in the series ("hugetlb: > > > disable region_add file_region coalescing") so it's definitely related > > > to the series. I'm taking a look at why this VM_BUG_ON fires. Can you > > > confirm you reproduce this by running hugemmap06 from the ltp on a > > > powerpc machine? Can I maybe have your config? > > > > > > Thanks! > > > > Hi Mina, > > > > Looking at the region_chg code again, we do a > > > > resv->adds_in_progress += *out_regions_needed; > > > > and then potentially drop the lock to allocate the needed entries. Could > > anopther thread (only adding reservation for a single page) then come in > > and notice that there are not enough entries in the cache and hit the > > VM_BUG_ON()? > > Maybe. Also I'm thinking the code thinks actual_regions_needed >= > in_regions_needed, but that doesn't seem like a guarantee. I think > this call sequence with the same t->f range would violate that: > > region_chg (regions_needed=1) > region_chg (regions_needed=1) > region_add (fills in the range) > region_add (in_regions_needed = 1, actual_regions_needed = 0, so > assumptions in the code break). > > Luckily it seems the ltp readily reproduces this, so I'm working on > reproducing it. I should have a fix soon, at least if I can reproduce > it as well. I had a bit of trouble reproducing this but I got it just now. Makes sense I've never run into this even though others can readily reproduce it. I happen to run my kernels on a pretty beefy 36 core machine and in that setup things seem to execute fast and there is never a queue of pending file_region inserts into the resv_map. Once I limited qemu to only use 2 cores I ran into the issue right away. Looking into a fix now.