From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS, USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7772FC31E40 for ; Mon, 12 Aug 2019 09:50:33 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 42DB620842 for ; Mon, 12 Aug 2019 09:50:33 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1565603433; bh=sbiaL+DHZtRdI6YR754ZOXvnLLEjOSonGtEULxBahw8=; h=Date:From:To:Cc:Subject:References:In-Reply-To:List-ID:From; b=Q5CR2e904YauMz5k/8WahVJ4Kn3ClzI7ZV4B9NnalpFrIFebQsNwjLo0PPP4pw3HL tfqix4XK8jpaNQnHxNOhdXrmVuGTyLjPRi8lmK3mbUgEiPsXcU80m1keAuUg3+/nCq /8xeS3jOo729oLJpq8Ui3Sn/B7F6r8mKWTIvVvAw= Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727640AbfHLJuc (ORCPT ); Mon, 12 Aug 2019 05:50:32 -0400 Received: from mx2.suse.de ([195.135.220.15]:46000 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1727471AbfHLJub (ORCPT ); Mon, 12 Aug 2019 05:50:31 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 9F9FEAECA; Mon, 12 Aug 2019 09:50:30 +0000 (UTC) Date: Mon, 12 Aug 2019 11:50:29 +0200 From: Michal Hocko To: Paul Menzel Cc: =?iso-8859-1?Q?J=F6rg_R=F6del?= , iommu@lists.linux-foundation.org, linux-pci@vger.kernel.org, "x86@kernel.org" , kexec@lists.infradead.org, Linux Kernel Mailing List , Donald Buczek Subject: Re: Crash kernel with 256 MB reserved memory runs into OOM condition Message-ID: <20190812095029.GE5117@dhcp22.suse.cz> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon 12-08-19 11:42:33, Paul Menzel wrote: > Dear Linux folks, > > > On a Dell PowerEdge R7425 with two AMD EPYC 7601 (total 128 threads) and > 1 TB RAM, the crash kernel with 256 MB of space reserved crashes. > > Please find the messages of the normal and the crash kernel attached. You will need more memory to reserve for the crash kernel because ... > [ 4.548703] Node 0 DMA free:484kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:568kB managed:484kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB > [ 4.573612] lowmem_reserve[]: 0 125 125 125 > [ 4.577799] Node 0 DMA32 free:1404kB min:1428kB low:1784kB high:2140kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:15720kB writepending:0kB present:261560kB managed:133752kB mlocked:0kB kernel_stack:2496kB pagetables:0kB bounce:0kB free_pcp:212kB local_pcp:212kB free_cma:0kB ... the memory is really depleted and nothing to be reclaimed (no anon. file pages) Look how tht free memory is below min watermark (node zone DMA has lowmem protection for GFP_KERNEL allocation). [...] > [ 4.923156] Out of memory and no killable processes... and there is no task existing to be killed so we go and panic. -- Michal Hocko SUSE Labs From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.5 required=3.0 tests=MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 5674CC433FF for ; Mon, 12 Aug 2019 09:50:35 +0000 (UTC) Received: from mail.linuxfoundation.org (mail.linuxfoundation.org [140.211.169.12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 354602087B for ; Mon, 12 Aug 2019 09:50:35 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 354602087B Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=iommu-bounces@lists.linux-foundation.org Received: from mail.linux-foundation.org (localhost [127.0.0.1]) by mail.linuxfoundation.org (Postfix) with ESMTP id 0E526C7D; Mon, 12 Aug 2019 09:50:35 +0000 (UTC) Received: from smtp1.linuxfoundation.org (smtp1.linux-foundation.org [172.17.192.35]) by mail.linuxfoundation.org (Postfix) with ESMTPS id E3626C7C for ; Mon, 12 Aug 2019 09:50:32 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6 Received: from mx1.suse.de (mx2.suse.de [195.135.220.15]) by smtp1.linuxfoundation.org (Postfix) with ESMTPS id 7297987D for ; Mon, 12 Aug 2019 09:50:32 +0000 (UTC) X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 9F9FEAECA; Mon, 12 Aug 2019 09:50:30 +0000 (UTC) Date: Mon, 12 Aug 2019 11:50:29 +0200 From: Michal Hocko To: Paul Menzel Subject: Re: Crash kernel with 256 MB reserved memory runs into OOM condition Message-ID: <20190812095029.GE5117@dhcp22.suse.cz> References: MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.10.1 (2018-07-13) Cc: linux-pci@vger.kernel.org, "x86@kernel.org" , kexec@lists.infradead.org, Linux Kernel Mailing List , iommu@lists.linux-foundation.org, Donald Buczek X-BeenThere: iommu@lists.linux-foundation.org X-Mailman-Version: 2.1.12 Precedence: list List-Id: Development issues for Linux IOMMU support List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: iommu-bounces@lists.linux-foundation.org Errors-To: iommu-bounces@lists.linux-foundation.org On Mon 12-08-19 11:42:33, Paul Menzel wrote: > Dear Linux folks, > > > On a Dell PowerEdge R7425 with two AMD EPYC 7601 (total 128 threads) and > 1 TB RAM, the crash kernel with 256 MB of space reserved crashes. > > Please find the messages of the normal and the crash kernel attached. You will need more memory to reserve for the crash kernel because ... > [ 4.548703] Node 0 DMA free:484kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:568kB managed:484kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB > [ 4.573612] lowmem_reserve[]: 0 125 125 125 > [ 4.577799] Node 0 DMA32 free:1404kB min:1428kB low:1784kB high:2140kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:15720kB writepending:0kB present:261560kB managed:133752kB mlocked:0kB kernel_stack:2496kB pagetables:0kB bounce:0kB free_pcp:212kB local_pcp:212kB free_cma:0kB ... the memory is really depleted and nothing to be reclaimed (no anon. file pages) Look how tht free memory is below min watermark (node zone DMA has lowmem protection for GFP_KERNEL allocation). [...] > [ 4.923156] Out of memory and no killable processes... and there is no task existing to be killed so we go and panic. -- Michal Hocko SUSE Labs _______________________________________________ iommu mailing list iommu@lists.linux-foundation.org https://lists.linuxfoundation.org/mailman/listinfo/iommu From mboxrd@z Thu Jan 1 00:00:00 1970 Return-path: Received: from mx2.suse.de ([195.135.220.15] helo=mx1.suse.de) by bombadil.infradead.org with esmtps (Exim 4.92 #3 (Red Hat Linux)) id 1hx6yG-0007WZ-F0 for kexec@lists.infradead.org; Mon, 12 Aug 2019 09:50:33 +0000 Date: Mon, 12 Aug 2019 11:50:29 +0200 From: Michal Hocko Subject: Re: Crash kernel with 256 MB reserved memory runs into OOM condition Message-ID: <20190812095029.GE5117@dhcp22.suse.cz> References: MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "kexec" Errors-To: kexec-bounces+dwmw2=infradead.org@lists.infradead.org To: Paul Menzel Cc: linux-pci@vger.kernel.org, =?iso-8859-1?Q?J=F6rg_R=F6del?= , "x86@kernel.org" , kexec@lists.infradead.org, Linux Kernel Mailing List , iommu@lists.linux-foundation.org, Donald Buczek On Mon 12-08-19 11:42:33, Paul Menzel wrote: > Dear Linux folks, > > > On a Dell PowerEdge R7425 with two AMD EPYC 7601 (total 128 threads) and > 1 TB RAM, the crash kernel with 256 MB of space reserved crashes. > > Please find the messages of the normal and the crash kernel attached. You will need more memory to reserve for the crash kernel because ... > [ 4.548703] Node 0 DMA free:484kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:568kB managed:484kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB > [ 4.573612] lowmem_reserve[]: 0 125 125 125 > [ 4.577799] Node 0 DMA32 free:1404kB min:1428kB low:1784kB high:2140kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:15720kB writepending:0kB present:261560kB managed:133752kB mlocked:0kB kernel_stack:2496kB pagetables:0kB bounce:0kB free_pcp:212kB local_pcp:212kB free_cma:0kB ... the memory is really depleted and nothing to be reclaimed (no anon. file pages) Look how tht free memory is below min watermark (node zone DMA has lowmem protection for GFP_KERNEL allocation). [...] > [ 4.923156] Out of memory and no killable processes... and there is no task existing to be killed so we go and panic. -- Michal Hocko SUSE Labs _______________________________________________ kexec mailing list kexec@lists.infradead.org http://lists.infradead.org/mailman/listinfo/kexec