From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 17E6FC2B9F4 for ; Thu, 17 Jun 2021 15:02:11 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id F37F961406 for ; Thu, 17 Jun 2021 15:02:10 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232938AbhFQPEQ (ORCPT ); Thu, 17 Jun 2021 11:04:16 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:43620 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233117AbhFQPEL (ORCPT ); Thu, 17 Jun 2021 11:04:11 -0400 Received: from mail-lj1-x22d.google.com (mail-lj1-x22d.google.com [IPv6:2a00:1450:4864:20::22d]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id A2433C061574 for ; Thu, 17 Jun 2021 08:02:03 -0700 (PDT) Received: by mail-lj1-x22d.google.com with SMTP id z22so9432577ljh.8 for ; Thu, 17 Jun 2021 08:02:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux-foundation.org; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Gffjb4M/ANAqzeNlRTmLWG4NfOIBWBpaTeKu6FSOXY4=; b=e2pya7mjwKyFA8vanJytXcFh7uxmGZPAlpPiR4xcGsuhpU8OpojtLamxouDGkOAAMZ IwsLcVvossuqnXnFhoiFkeYFbsstgBxSGF9e3AJISi2nxNC5XwHJyzfUP8NkIXRymNUQ UxNen6DuR0XCy7bVfX0EYRyv6AW8cQOVq9as4= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Gffjb4M/ANAqzeNlRTmLWG4NfOIBWBpaTeKu6FSOXY4=; b=QVgmU6fcOnQaS7riiK55e4A+SqBMqau9zlZSOxC7ShpF92sm3kjmsPN4j2PUJP7OMP v3Q2aT39XTHE+CFHyb0i5eMCPvPgBmJ4/qRp9JDHz0Aoh/Ol6iYKInec5lgL6WDXmUdL w0n8F4xgv6Ed5BIlI7i7b2LkKgO4DJkjNZfYDfiwkVhI+7wm3xfUSxjhNFd6rbRWGYqE FvijGh4iRpBxRN8trbTuJzlIG+gWSJTPyOg9Wxr09XNYLkc3trkde14OMxuwGImLsoFv lZj30EzVhvtf+FbeYSGMl7tzyBrp4N9ZrzX5wJssf0hUuUFR0+4y/Voni9etnbqfFTtx 9nuA== X-Gm-Message-State: AOAM5306TY/okzujAD1tNdauFCif+V02pvte5JDLubzIjsT1ul/01OeW 2ZFvVlW5XtVwwkLmZLTRDxmXgM4bZqeKeLGtY0o= X-Google-Smtp-Source: ABdhPJyhAMRtph+1LpVrttalJCYQw0fsXr/zcPVmuXim3shStlqQ9TY9aOK08PgRrZU8Sjhctu9IKg== X-Received: by 2002:a2e:530e:: with SMTP id h14mr5110499ljb.454.1623942121706; Thu, 17 Jun 2021 08:02:01 -0700 (PDT) Received: from mail-lf1-f50.google.com (mail-lf1-f50.google.com. [209.85.167.50]) by smtp.gmail.com with ESMTPSA id w24sm682201ljw.68.2021.06.17.08.02.00 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 17 Jun 2021 08:02:00 -0700 (PDT) Received: by mail-lf1-f50.google.com with SMTP id f30so11094381lfj.1 for ; Thu, 17 Jun 2021 08:02:00 -0700 (PDT) X-Received: by 2002:a05:6512:3f82:: with SMTP id x2mr4241418lfa.421.1623942120465; Thu, 17 Jun 2021 08:02:00 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Linus Torvalds Date: Thu, 17 Jun 2021 08:01:44 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Linux 5.13-rc6 regression to 5.12.x: kernel OOM and panic during kernel boot in low memory Xen VM's (256MB assigned memory). To: Sander Eikelenboom , Rasmus Villemoes Cc: linux-kernel , "xen-devel@lists.xenproject.org" Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Jun 17, 2021 at 2:26 AM Sander Eikelenboom wrote: > > I just tried to upgrade and test the linux kernel going from the 5.12 kernel series to 5.13-rc6 on my homeserver with Xen, but ran in some trouble. > > Some VM's boot fine (with more than 256MB memory assigned), but the smaller (memory wise) PVH ones crash during kernel boot due to OOM. > Booting VM's with 5.12(.9) kernel still works fine, also when dom0 is running 5.13-rc6 (but it has more memory assigned, so that is not unexpected). Adding Rasmus to the cc, because this looks kind of like the async roofs population thing that caused some other oom issues too. Rasmus? Original report here: https://lore.kernel.org/lkml/ee8bf04c-6e55-1d9b-7bdb-25e6108e8e1e@eikelenboom.it/ I do find it odd that we'd be running out of memory so early.. Linus From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id DB886C2B9F4 for ; Thu, 17 Jun 2021 15:02:16 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 942166140F for ; Thu, 17 Jun 2021 15:02:16 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 942166140F Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=linux-foundation.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.144034.265189 (Exim 4.92) (envelope-from ) id 1lttWv-0003xd-QE; Thu, 17 Jun 2021 15:02:05 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 144034.265189; Thu, 17 Jun 2021 15:02:05 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1lttWv-0003xW-N6; Thu, 17 Jun 2021 15:02:05 +0000 Received: by outflank-mailman (input) for mailman id 144034; Thu, 17 Jun 2021 15:02:04 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1lttWu-0003xQ-GH for xen-devel@lists.xenproject.org; Thu, 17 Jun 2021 15:02:04 +0000 Received: from mail-lf1-x131.google.com (unknown [2a00:1450:4864:20::131]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id efa04bd8-6e8a-406b-904e-d58e041f691d; Thu, 17 Jun 2021 15:02:03 +0000 (UTC) Received: by mail-lf1-x131.google.com with SMTP id m21so11008458lfg.13 for ; Thu, 17 Jun 2021 08:02:03 -0700 (PDT) Received: from mail-lf1-f54.google.com (mail-lf1-f54.google.com. [209.85.167.54]) by smtp.gmail.com with ESMTPSA id bp29sm253627lfb.206.2021.06.17.08.02.01 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 17 Jun 2021 08:02:01 -0700 (PDT) Received: by mail-lf1-f54.google.com with SMTP id p7so10995478lfg.4 for ; Thu, 17 Jun 2021 08:02:01 -0700 (PDT) X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" X-Inumbo-ID: efa04bd8-6e8a-406b-904e-d58e041f691d DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux-foundation.org; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Gffjb4M/ANAqzeNlRTmLWG4NfOIBWBpaTeKu6FSOXY4=; b=e2pya7mjwKyFA8vanJytXcFh7uxmGZPAlpPiR4xcGsuhpU8OpojtLamxouDGkOAAMZ IwsLcVvossuqnXnFhoiFkeYFbsstgBxSGF9e3AJISi2nxNC5XwHJyzfUP8NkIXRymNUQ UxNen6DuR0XCy7bVfX0EYRyv6AW8cQOVq9as4= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Gffjb4M/ANAqzeNlRTmLWG4NfOIBWBpaTeKu6FSOXY4=; b=Aq7XB4rzu22gwE+Js0aH2YHRPjrKNIR4hBqlQ2YQB9zBgJMTw/lwH+p9qeCGzdAINf 3MblYddyxpcTDFcDP3OFX9Ij11IKwLFc0jPyKTtqum5xpwFAewVPGxw4ZQzdvSxDjgwM w+kIPs9lFnXPJFhS7Jv2zzSYgluxi4NpGAtXwsLNEgIWXw5gKOIFDhdgrkjfSA4/FDie M3EsePbLL4u9BzCNlE+B8qng+zfFYCPuA7mhZvEehmr9pYq//ACvN5EfRu5WKs1Rfra9 rZ7ccq6cWxHUEXf0MV8eAecSmkh9p5YSXcDrDRDDjRWzoKQRkWWTpbtqWwAHTk7sVvoH ER0g== X-Gm-Message-State: AOAM5306rzoP+Ajs9CAyDVgfQa7nl+AspfXmJuhr+ffk0R5qPR0WnbUk JIqeKyFYWh3moM22A62bWHVSYwnZhf2m463lwB0= X-Google-Smtp-Source: ABdhPJyLznj2Woaiag9v/7GAIgtCmjWedgZerHcjlR2OJu45By/QjxhUZcXR2ia64umDd3QJWqrotw== X-Received: by 2002:ac2:4909:: with SMTP id n9mr4220011lfi.177.1623942121866; Thu, 17 Jun 2021 08:02:01 -0700 (PDT) X-Received: by 2002:a05:6512:3f82:: with SMTP id x2mr4241418lfa.421.1623942120465; Thu, 17 Jun 2021 08:02:00 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Linus Torvalds Date: Thu, 17 Jun 2021 08:01:44 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Linux 5.13-rc6 regression to 5.12.x: kernel OOM and panic during kernel boot in low memory Xen VM's (256MB assigned memory). To: Sander Eikelenboom , Rasmus Villemoes Cc: linux-kernel , "xen-devel@lists.xenproject.org" Content-Type: text/plain; charset="UTF-8" On Thu, Jun 17, 2021 at 2:26 AM Sander Eikelenboom wrote: > > I just tried to upgrade and test the linux kernel going from the 5.12 kernel series to 5.13-rc6 on my homeserver with Xen, but ran in some trouble. > > Some VM's boot fine (with more than 256MB memory assigned), but the smaller (memory wise) PVH ones crash during kernel boot due to OOM. > Booting VM's with 5.12(.9) kernel still works fine, also when dom0 is running 5.13-rc6 (but it has more memory assigned, so that is not unexpected). Adding Rasmus to the cc, because this looks kind of like the async roofs population thing that caused some other oom issues too. Rasmus? Original report here: https://lore.kernel.org/lkml/ee8bf04c-6e55-1d9b-7bdb-25e6108e8e1e@eikelenboom.it/ I do find it odd that we'd be running out of memory so early.. Linus