From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.5 required=3.0 tests=MAILING_LIST_MULTI,SPF_PASS, USER_AGENT_MUTT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4B9BDC6778F for ; Thu, 26 Jul 2018 08:13:50 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 0FC0C20673 for ; Thu, 26 Jul 2018 08:13:50 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 0FC0C20673 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729023AbeGZJ32 (ORCPT ); Thu, 26 Jul 2018 05:29:28 -0400 Received: from mx2.suse.de ([195.135.220.15]:55570 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1726326AbeGZJ32 (ORCPT ); Thu, 26 Jul 2018 05:29:28 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 2B051AB99; Thu, 26 Jul 2018 08:13:45 +0000 (UTC) Date: Thu, 26 Jul 2018 10:13:43 +0200 From: Michal Hocko To: Georgi Nikolov Cc: David Rientjes , Tejun Heo , cgroups@vger.kernel.org, linux-kernel@vger.kernel.org Subject: Re: cgroups iptables-restor: vmalloc: allocation failure Message-ID: <20180726081343.GZ28386@dhcp22.suse.cz> References: MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.10.0 (2018-05-17) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org For more context this is a follow up for http://lkml.kernel.org/r/df6f501c-8546-1f55-40b1-7e3a8f54d872@icdsoft.com On Thu 26-07-18 09:53:20, Georgi Nikolov wrote: > Hello, > > Servers are with 64bit kernel and 32bit userland. > > here is the log: > > [  485.467359] iptables-restor: vmalloc: allocation failure, allocated > 2367488 of 3608576 bytes, mode:0x14010c0(GFP_KERNEL|__GFP_NORETRY), > nodemask=(null) > [  485.467871] iptables-restor cpuset=/ mems_allowed=0 > [  485.468089] CPU: 0 PID: 18093 Comm: iptables-restor Not tainted > 4.14.50 #1 > [  485.468399] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), > BIOS 1.10.2-1 04/01/2014 > [  485.468725]  0000000000000000 ffffffff81ed2b8b ffffffff8333a330 > bb5cfe6a5a821e59 > [  485.469114]  0000000000000000 ffffc90004aaba80 ffffffff811fa3ea > ffffc90004aaba90 > [  485.469422]  ffffffff825e11d0 014010c000000000 ffffffff825e11d0 > ffffc90004aaba18 > [  485.469735] Call Trace: > [  485.469941]  [] dump_stack+0x9a/0x10f > [  485.470159]  [] warn_alloc+0x18a/0x270 > [  485.470379]  [] __vmalloc_node_range+0x251/0x470 > [  485.470614]  [] ? __vmalloc_node_flags_caller+0x3e/0x70 > [  485.470881]  [] __vmalloc_node_flags_caller+0x3e/0x70 > [  485.471160]  [] ? xt_alloc_table_info+0x4e/0xa0 > [  485.471395]  [] kvmalloc_node+0x7a/0xd0 > [  485.471618]  [] xt_alloc_table_info+0x4e/0xa0 > [  485.471849]  [] ? > translate_compat_table.constprop.19+0x447/0x870 > [  485.472197]  [] > translate_compat_table.constprop.19+0x447/0x870 > [  485.472514]  [] ? > compat_do_replace.isra.10.constprop.18+0x197/0x370 > [  485.472833]  [] > compat_do_replace.isra.10.constprop.18+0x197/0x370 > [  485.473230]  [] compat_do_ipt_set_ctl+0x8b/0xb0 > [  485.473465]  [] compat_nf_setsockopt+0x6a/0xd0 > [  485.473701]  [] compat_ip_setsockopt+0x73/0xd0 > [  485.473936]  [] compat_raw_setsockopt+0x7c/0xd0 > [  485.474208]  [] ? handle_mm_fault+0xec/0x240 > [  485.474441]  [] compat_sock_common_setsockopt+0x32/0x80 > [  485.474689]  [] compat_sys_setsockopt+0x9a/0x2e0 > [  485.474926]  [] compat_sys_socketcall+0x415/0x570 > [  485.475197]  [] ? page_fault+0x5c/0x90 > [  485.475416]  [] ? retint_user+0x2b/0x2b > [  485.475638]  [] ? rap_compat_sys_socketcall+0x14/0x40 > [  485.475884]  [] ? do_fast_syscall_32+0xe1/0x2f0 > [  485.476170]  [] ? entry_SYSENTER_compat+0x93/0xa5 > [  485.476414] Mem-Info: > [  485.476579] active_anon:79884 inactive_anon:103007 isolated_anon:0 >                 active_file:54010 inactive_file:219014 isolated_file:0 >                 unevictable:1822 dirty:22 writeback:0 unstable:0 >                 slab_reclaimable:8637 slab_unreclaimable:25015 >                 mapped:16094 shmem:2271 pagetables:1481 bounce:0 >                 free:3459 free_pcp:180 free_cma:0 > [  485.477691] Node 0 active_anon:320376kB inactive_anon:412028kB > active_file:216040kB inactive_file:875844kB unevictable:7288kB > isolated(anon):0kB isolated(file):0kB mapped:64376kB dirty:88kB > writeback:0kB shmem:9084kB writeback_tmp:0kB unstable:0kB > all_unreclaimable? no > [  485.478457] Node 0 DMA free:7896kB min:44kB low:56kB high:68kB > active_anon:2324kB inactive_anon:0kB active_file:12kB > inactive_file:5228kB unevictable:0kB writepending:0kB present:15992kB > managed:15892kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB > free_pcp:0kB local_pcp:0kB free_cma:0kB > [  485.479233] lowmem_reserve[]: 0 1963 1963 1963 > [  485.479483] Node 0 DMA32 free:5364kB min:5644kB low:7652kB > high:9660kB active_anon:317672kB inactive_anon:412028kB > active_file:216028kB inactive_file:871340kB unevictable:7288kB > writepending:88kB present:2080624kB managed:2015900kB mlocked:7288kB > kernel_stack:5584kB pagetables:5924kB bounce:0kB free_pcp:1052kB > local_pcp:720kB free_cma:0kB > [  485.480425] lowmem_reserve[]: 0 0 0 0 > [  485.480612] Node 0 DMA: 38*4kB (UMEH) 54*8kB (MEH) 51*16kB (UMEH) > 35*32kB (UMEH) 16*64kB (MEH) 12*128kB (MH) 7*256kB (UMEH) 0*512kB > 1*1024kB (E) 0*2048kB 0*4096kB = 7896kB > [  485.481173] Node 0 DMA32: 12*4kB (MH) 16*8kB (H) 264*16kB (UH) 7*32kB > (H) 6*64kB (H) 1*128kB (H) 0*256kB 1*512kB (H) 0*1024kB 0*2048kB > 0*4096kB = 5648kB > [  485.481642] Node 0 hugepages_total=0 hugepages_free=0 > hugepages_surp=0 hugepages_size=1048576kB > [  485.481975] Node 0 hugepages_total=0 hugepages_free=0 > hugepages_surp=0 hugepages_size=2048kB > [  485.482309] 275972 total pagecache pages > [  485.482535] 0 pages in swap cache > [  485.482717] Swap cache stats: add 0, delete 0, find 0/0 > [  485.482937] Free swap  = 1976316kB > [  485.483118] Total swap = 1976316kB > [  485.483300] 524154 pages RAM > [  485.483492] 0 pages HighMem/MovableOnly > [  485.483711] 16206 pages reserved > [  485.483889] 0 pages hwpoisoned > > Regards, > > -- > Georgi Nikolov > > On 07/25/2018 10:42 PM, David Rientjes wrote: > > On Wed, 25 Jul 2018, Georgi Nikolov wrote: > > > >> Hello, > >> > >> I posted a kernel bug https://bugzilla.kernel.org/show_bug.cgi?id=200651 and > >> i hope this is the correct place to discuss this. > >> > > Could you post the full allocation failure from the kernel log? It's not > > possible to vmalloc any additional memory due to the memory pressure, so > > this is expected to fail but I'm curious as to the actual allocation that > > is triggering it. > -- Michal Hocko SUSE Labs