From: "Nikhil Sethi (निखिल सेठी)" <nikhil@sethi.ws>
To: Eric Dumazet <eric.dumazet@gmail.com>
Cc: Michael Guntsche <mike@it-loops.com>,
linux-kernel <linux-kernel@vger.kernel.org>,
netdev <netdev@vger.kernel.org>
Subject: Re: [2.6.35-rc1] page alloc failure order:1, mode:0x4020
Date: Mon, 8 Nov 2010 08:25:40 -0800 [thread overview]
Message-ID: <AANLkTi=F+KLSgyy=OG_504HUXnyburGAad25qy1BwLvE@mail.gmail.com> (raw)
In-Reply-To: <1283718304.3402.370.camel@edumazet-laptop>
Thanks Eric, for all the help.
I get very occasional errors with vanilla 2.6.36 kernel with your
patch. Error messages are slightly different, and very rare compared
to without your patch. 2.6.35.7 seems fine, and does not show this
error.
rsync: page allocation failure. order:1, mode:0x4020
Pid: 31479, comm: rsync Not tainted 2.6.36-rc1 #1
Call Trace:
[<c0246b2c>] ? __alloc_pages_nodemask+0x3f1/0x52e
[<c0261330>] ? __slab_alloc+0x40f/0x45a
[<c02617ca>] ? __kmalloc_track_caller+0x91/0x97
[<d09db01a>] ? ath_rxbuf_alloc+0x1a/0x78 [ath]
[<d09db01a>] ? ath_rxbuf_alloc+0x1a/0x78 [ath]
[<c033a8d0>] ? __alloc_skb+0x57/0x100
[<d09db01a>] ? ath_rxbuf_alloc+0x1a/0x78 [ath]
[<d0b01f2e>] ? ath_rx_tasklet+0x680/0xcfe [ath9k]
[<c02234ae>] ? __queue_work+0xe4/0x1a2
[<d0b00244>] ? ath9k_tasklet+0xd0/0x134 [ath9k]
[<c0219a43>] ? tasklet_action+0x5f/0x65
[<c0219cf4>] ? __do_softirq+0x60/0xc6
[<c0219d88>] ? do_softirq+0x2e/0x30
[<c0219e7b>] ? irq_exit+0x54/0x56
[<c02038e0>] ? do_IRQ+0x3a/0x72
[<c0202bc9>] ? common_interrupt+0x29/0x30
[<c02d89a0>] ? cfq_may_queue+0x0/0x92
[<c02d1567>] ? get_request+0x121/0x23e
[<c02d16a4>] ? get_request_wait+0x20/0xfd
[<c02d8f16>] ? cfq_merge+0x0/0x69
[<c02cfd40>] ? elv_merge+0x14b/0x170
[<c02d2375>] ? __make_request+0x71/0x364
[<c02d1fe2>] ? generic_make_request+0x14f/0x318
[<c0243fb1>] ? mempool_alloc+0x35/0xb9
[<c02d21e9>] ? submit_bio+0x3e/0x90
[<c0281c14>] ? bio_alloc_bioset+0x33/0x9e
[<c027e780>] ? submit_bh+0xbc/0xec
[<c027f4e2>] ? ll_rw_block+0x72/0x74
[<c027f504>] ? __breadahead+0x20/0x30
[<c02a3a8f>] ? __ext4_get_inode_loc+0x308/0x416
[<c02a8154>] ? ext4_iget+0x52/0x652
[<c02aa327>] ? ext4_lookup+0x65/0xbf
[<c026a6bb>] ? d_alloc_and_lookup+0x30/0x58
[<c026b84a>] ? do_lookup+0xc5/0xfe
[<c026c239>] ? link_path_walk+0x4d1/0x8d6
[<c026c722>] ? path_walk+0x48/0xa9
[<c026c7be>] ? do_path_lookup+0x3b/0x3f
[<c026d06d>] ? user_path_at+0x30/0x64
[<c0266446>] ? cp_new_stat64+0xee/0x100
[<c026664a>] ? vfs_fstatat+0x25/0x63
[<c02666c9>] ? vfs_lstat+0x13/0x15
[<c02666da>] ? sys_lstat64+0xf/0x23
[<c02141ed>] ? switched_to_idle+0x1a/0x43
[<c0393395>] ? syscall_call+0x7/0xb
[<c0390000>] ? quirk_ich7_lpc+0x46/0x4d
Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Normal per-cpu:
CPU 0: hi: 90, btch: 15 usd: 84
active_anon:14957 inactive_anon:15137 isolated_anon:0
active_file:11820 inactive_file:11640 isolated_file:0
unevictable:470 dirty:1378 writeback:0 unstable:0
free:975 slab_reclaimable:5606 slab_unreclaimable:2343
mapped:2786 shmem:72 pagetables:394 bounce:0
DMA free:1000kB min:124kB low:152kB high:184kB active_anon:2896kB
inactive_anon:3552kB active_file:2116kB inactive_file:1768kB
unevictable:348kB isolated(anon):0kB isolated(file):0kB
present:15864kB mlocked:348kB dirty:16kB writeback:0kB mapped:228kB
shmem:32kB slab_reclaimable:1136kB slab_unreclaimable:608kB
kernel_stack:144kB pagetables:52kB unstable:0kB bounce:0kB
writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no
lowmem_reserve[]: 0 238 238
Normal free:2900kB min:1908kB low:2384kB high:2860kB
active_anon:56932kB inactive_anon:56996kB active_file:45164kB
inactive_file:44792kB unevictable:1532kB isolated(anon):0kB
isolated(file):0kB present:243840kB mlocked:1532kB dirty:5496kB
writeback:0kB mapped:10916kB shmem:256kB slab_reclaimable:21288kB
slab_unreclaimable:8764kB kernel_stack:1056kB pagetables:1524kB
unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0
all_unreclaimable? no
lowmem_reserve[]: 0 0 0
DMA: 6*4kB 14*8kB 16*16kB 1*32kB 1*64kB 0*128kB 0*256kB 1*512kB
0*1024kB 0*2048kB 0*4096kB = 1000kB
Normal: 691*4kB 17*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB
0*1024kB 0*2048kB 0*4096kB = 2900kB
28310 total pagecache pages
4385 pages in swap cache
Swap cache stats: add 144387, delete 140002, find 98398/115667
Free swap = 889116kB
Total swap = 1023996kB
65535 pages RAM
1245 pages reserved
27369 pages shared
42219 pages non-shared
SLUB: Unable to allocate memory on node -1 (gfp=0x20)
cache: kmalloc-8192, object size: 8192, buffer size: 8192, default
order: 3, min order: 1
node 0: slabs: 133, objs: 529, free: 0
skbuff alloc of size 3872 failed
rsync: page allocation failure. order:1, mode:0x4020
Pid: 31479, comm: rsync Not tainted 2.6.36-rc1 #1
Call Trace:
[<c0246b2c>] ? __alloc_pages_nodemask+0x3f1/0x52e
[<c0261330>] ? __slab_alloc+0x40f/0x45a
[<c02617ca>] ? __kmalloc_track_caller+0x91/0x97
[<d09db01a>] ? ath_rxbuf_alloc+0x1a/0x78 [ath]
[<d09db01a>] ? ath_rxbuf_alloc+0x1a/0x78 [ath]
[<c033a8d0>] ? __alloc_skb+0x57/0x100
[<d09db01a>] ? ath_rxbuf_alloc+0x1a/0x78 [ath]
[<d0b01f2e>] ? ath_rx_tasklet+0x680/0xcfe [ath9k]
[<c02234ae>] ? __queue_work+0xe4/0x1a2
[<d0b00244>] ? ath9k_tasklet+0xd0/0x134 [ath9k]
[<c0219a43>] ? tasklet_action+0x5f/0x65
[<c0219cf4>] ? __do_softirq+0x60/0xc6
[<c0219d88>] ? do_softirq+0x2e/0x30
[<c0219e7b>] ? irq_exit+0x54/0x56
[<c02038e0>] ? do_IRQ+0x3a/0x72
[<c0202bc9>] ? common_interrupt+0x29/0x30
[<c02d89a0>] ? cfq_may_queue+0x0/0x92
[<c02d1567>] ? get_request+0x121/0x23e
[<c02d16a4>] ? get_request_wait+0x20/0xfd
[<c02d8f16>] ? cfq_merge+0x0/0x69
[<c02cfd40>] ? elv_merge+0x14b/0x170
[<c02d2375>] ? __make_request+0x71/0x364
[<c02d1fe2>] ? generic_make_request+0x14f/0x318
[<c0243fb1>] ? mempool_alloc+0x35/0xb9
[<c02d21e9>] ? submit_bio+0x3e/0x90
[<c0281c14>] ? bio_alloc_bioset+0x33/0x9e
[<c027e780>] ? submit_bh+0xbc/0xec
[<c027f4e2>] ? ll_rw_block+0x72/0x74
[<c027f504>] ? __breadahead+0x20/0x30
[<c02a3a8f>] ? __ext4_get_inode_loc+0x308/0x416
[<c02a8154>] ? ext4_iget+0x52/0x652
[<c02aa327>] ? ext4_lookup+0x65/0xbf
[<c026a6bb>] ? d_alloc_and_lookup+0x30/0x58
[<c026b84a>] ? do_lookup+0xc5/0xfe
[<c026c239>] ? link_path_walk+0x4d1/0x8d6
[<c026c722>] ? path_walk+0x48/0xa9
[<c026c7be>] ? do_path_lookup+0x3b/0x3f
[<c026d06d>] ? user_path_at+0x30/0x64
[<c0266446>] ? cp_new_stat64+0xee/0x100
[<c026664a>] ? vfs_fstatat+0x25/0x63
[<c02666c9>] ? vfs_lstat+0x13/0x15
[<c02666da>] ? sys_lstat64+0xf/0x23
[<c02141ed>] ? switched_to_idle+0x1a/0x43
[<c0393395>] ? syscall_call+0x7/0xb
[<c0390000>] ? quirk_ich7_lpc+0x46/0x4d
Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
Normal per-cpu:
CPU 0: hi: 90, btch: 15 usd: 84
active_anon:14957 inactive_anon:15137 isolated_anon:0
active_file:11820 inactive_file:11640 isolated_file:0
unevictable:470 dirty:1378 writeback:0 unstable:0
free:975 slab_reclaimable:5606 slab_unreclaimable:2343
mapped:2786 shmem:72 pagetables:394 bounce:0
DMA free:1000kB min:124kB low:152kB high:184kB active_anon:2896kB
inactive_anon:3552kB active_file:2116kB inactive_file:1768kB
unevictable:348kB isolated(anon):0kB isolated(file):0kB
present:15864kB mlocked:348kB dirty:16kB writeback:0kB mapped:228kB
shmem:32kB slab_reclaimable:1136kB slab_unreclaimable:608kB
kernel_stack:144kB pagetables:52kB unstable:0kB bounce:0kB
writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no
lowmem_reserve[]: 0 238 238
Normal free:2900kB min:1908kB low:2384kB high:2860kB
active_anon:56932kB inactive_anon:56996kB active_file:45164kB
inactive_file:44792kB unevictable:1532kB isolated(anon):0kB
isolated(file):0kB present:243840kB mlocked:1532kB dirty:5496kB
writeback:0kB mapped:10916kB shmem:256kB slab_reclaimable:21288kB
slab_unreclaimable:8764kB kernel_stack:1056kB pagetables:1524kB
unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0
all_unreclaimable? no
lowmem_reserve[]: 0 0 0
DMA: 6*4kB 14*8kB 16*16kB 1*32kB 1*64kB 0*128kB 0*256kB 1*512kB
0*1024kB 0*2048kB 0*4096kB = 1000kB
Normal: 691*4kB 17*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB
0*1024kB 0*2048kB 0*4096kB = 2900kB
28310 total pagecache pages
4385 pages in swap cache
Swap cache stats: add 144387, delete 140002, find 98398/115667
Free swap = 889116kB
Total swap = 1023996kB
65535 pages RAM
1245 pages reserved
27369 pages shared
42219 pages non-shared
SLUB: Unable to allocate memory on node -1 (gfp=0x20)
cache: kmalloc-8192, object size: 8192, buffer size: 8192, default
order: 3, min order: 1
node 0: slabs: 133, objs: 529, free: 0
skbuff alloc of size 3872 failed
2010/9/5 Eric Dumazet <eric.dumazet@gmail.com>
>
> Le dimanche 05 septembre 2010 à 08:51 -0700, Nikhil Sethi (निखिल सेठी) a
> écrit :
> > This came back. Here is the dmesg output. It might be the problem only
> > happens if I have wmm_enabled=1 in my hostapd.conf. That is the only
> > thing that I changed yesterday, and today I saw these messages in my
> > logs. I will try to conform this.
> >
> >
> > I am running 2.6.35.4 with this patch:
> >
> >
> > *** 225,234 ****
> > int error = 0, i;
> > u32 size;
> >
> > !
> > ! common->rx_bufsize = roundup(IEEE80211_MAX_MPDU_LEN +
> > ! ah->caps.rx_status_len,
> > ! min(common->cachelsz, (u16)64));
> >
> > ath9k_hw_set_rx_bufsize(ah, common->rx_bufsize -
> > ah->caps.rx_status_len);
> > --- 225,234 ----
> > int error = 0, i;
> > u32 size;
> >
> > ! size = roundup(IEEE80211_MAX_MPDU_LEN + ah->caps.rx_status_len,
> > ! min(common->cachelsz, (u16)64));
> > ! common->rx_bufsize = min_t(u32, size,
> > ! SKB_MAX_ORDER(NET_SKB_PAD +
> > common->cachelsz, 0));
> >
> > ath9k_hw_set_rx_bufsize(ah, common->rx_bufsize -
> > ah->caps.rx_status_len);
> >
> >
> > dmesg output:
> >
> >
> > skbuff alloc of size 3872 failed
> > ps: page allocation failure. order:1, mode:0x4020
> > Pid: 16022, comm: ps Tainted: G W 2.6.35.4 #1
> > Call Trace:
> > [<c0243bfe>] ? __alloc_pages_nodemask+0x3e6/0x513
> > [<c025be97>] ? slob_new_pages+0xc/0x23
>
> Unfortunately you use SLOB, and it seems to ask order-1 pages, while
> we want less than a page.
>
> Please try SLAB or SLUB
>
> > [<c025c0a1>] ? __kmalloc_node+0x39/0x72
> > [<c03338d8>] ? __alloc_skb+0x5c/0x105
> > [<d09fa01a>] ? ath_rxbuf_alloc+0x1a/0x78 [ath]
> > [<d0ab7109>] ? ath_rx_tasklet+0x2fb/0x808 [ath9k]
> > [<c030fd49>] ? scsi_next_command+0x27/0x34
> > [<d0ab53c5>] ? ath9k_tasklet+0xcc/0x107 [ath9k]
> > [<c02193c3>] ? tasklet_action+0x5f/0x65
> > [<c0219677>] ? __do_softirq+0x60/0xc6
> > [<c021970b>] ? do_softirq+0x2e/0x30
> > [<c02197fd>] ? irq_exit+0x53/0x55
> > [<c020392c>] ? do_IRQ+0x3a/0x72
> > [<c0202be9>] ? common_interrupt+0x29/0x30
> > [<c0247874>] ? __remove_mapping+0x4b/0x8d
> > [<c023ea9f>] ? try_to_release_page+0x20/0x30
> > [<c0247d36>] ? shrink_page_list+0x2b8/0x46c
> > [<c03158ea>] ? sd_prep_fn+0x1a5/0x92b
> > [<c024816b>] ? shrink_inactive_list+0x281/0x552
> > [<c02445d9>] ? determine_dirtyable_memory+0xc/0x12
> > [<c024462c>] ? get_dirty_limits+0x18/0x2b0
> > [<c032875e>] ? ata_bmdma_port_intr+0x21/0xcd
> > [<c0248683>] ? shrink_zone+0x247/0x38f
> > [<c021968c>] ? __do_softirq+0x75/0xc6
> > [<c0247114>] ? shrink_slab+0x13c/0x186
> > [<c0248f25>] ? try_to_free_pages+0x1ab/0x2be
> > [<c0248f25>] ? try_to_free_pages+0x1ab/0x2be
> > [<c0243acf>] ? __alloc_pages_nodemask+0x2b7/0x513
> > [<c025be97>] ? slob_new_pages+0xc/0x23
> > [<c025c038>] ? kmem_cache_alloc_node+0x23/0x53
> > [<c0264b20>] ? getname+0x19/0xae
> > [<c0266d00>] ? user_path_at+0x11/0x64
> > [<c0250949>] ? access_process_vm+0xe0/0x1e7
> > [<c0250a08>] ? access_process_vm+0x19f/0x1e7
> > [<c02603d2>] ? vfs_fstatat+0x25/0x63
> > [<c02604a9>] ? vfs_stat+0x10/0x12
> > [<c02604ba>] ? sys_stat64+0xf/0x23
> > [<c025e86b>] ? fput+0x88/0x191
> > [<c026ab3b>] ? dput+0x92/0xd4
> > [<c025e8ff>] ? fput+0x11c/0x191
> > [<c026ebec>] ? mntput_no_expire+0x13/0x60
> > [<c025c398>] ? filp_close+0x3b/0x54
> > [<c025c403>] ? sys_close+0x52/0x72
> > [<c038ad3d>] ? syscall_call+0x7/0xb
> > [<c0380000>] ? unix_dgram_sendmsg+0x258/0x3c1
> > Mem-Info:
>
>
>
next prev parent reply other threads:[~2010-11-08 16:26 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
2010-06-04 9:20 [2.6.35-rc1] page alloc failure order:1, mode:0x4020 Michael Guntsche
2010-06-04 12:53 ` Eric Dumazet
2010-06-04 16:16 ` Michael Guntsche
2010-06-06 9:56 ` Michael Guntsche
2010-06-06 10:42 ` Eric Dumazet
2010-08-25 20:25 ` Nikhil Sethi (निखिल सेठी)
2010-08-25 20:44 ` Eric Dumazet
2010-08-26 17:53 ` Nikhil Sethi (निखिल सेठी)
2010-09-05 15:57 ` Nikhil Sethi (निखिल सेठी)
[not found] ` <AANLkTi=jLwvU=EWR51Y=TQ5JYVp_DqeTx0Ocbt=NEC1-@mail.gmail.com>
2010-09-05 20:25 ` Eric Dumazet
2010-11-08 16:25 ` Nikhil Sethi (निखिल सेठी) [this message]
2010-11-08 17:10 ` Eric Dumazet
2010-11-08 17:22 ` Nikhil Sethi (निखिल सेठी)
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='AANLkTi=F+KLSgyy=OG_504HUXnyburGAad25qy1BwLvE@mail.gmail.com' \
--to=nikhil@sethi.ws \
--cc=eric.dumazet@gmail.com \
--cc=linux-kernel@vger.kernel.org \
--cc=mike@it-loops.com \
--cc=netdev@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).