* 2.6.28-rc7: oldish top core dumps (in its meminfo() function)
@ 2008-12-12 9:42 Andreas Mohr
2008-12-12 18:49 ` [REGRESSION] 2.6.28-rc8: " Andreas Mohr
0 siblings, 1 reply; 2+ messages in thread
From: Andreas Mohr @ 2008-12-12 9:42 UTC (permalink / raw)
To: linux-kernel
Hi,
just wanted to report that top (at least the one of an older procps 2.0.17,
as shipped by RHEL3) acted up on a system here.
It's somewhat likely that this problem occured after S2R resume only,
since I most likely have been running top before already
(I'm doing this all the time...).
No issues whatsoever on 2.6.27.7 which I've been running before
(until I upgraded to -rc7 last week and suspended
and then resumed it today).
...BUT it could perhaps be cosmic S2R corruption within this week,
who knows (although this system has been rock stable all the time before).
!!! NOTE: unusual environment - a full 4GB RAM on x86_32 (P4 2.4GHz) here !!!
Will try -rc8 next.
Oh, dito vmstat (but exactly at the same address in /lib/libproc.so.2.0.17):
procs memory swap io system
cpu
r b swpd free buff cache si so bi bo in cs us sy
wa id
Program received signal SIGSEGV, Segmentation fault.
0xb7f4e7b7 in meminfo () from /lib/libproc.so.2.0.17
(gdb) bt
#0 0xb7f4e7b7 in meminfo () from /lib/libproc.so.2.0.17
#1 0x08048d61 in ?? ()
#2 0xbfb86ad0 in ?? ()
#3 0xbfb86c84 in ?? ()
#4 0x080498dc in _IO_stdin_used ()
#5 0xbfb86a40 in ?? ()
#6 0x00000000 in ?? ()
gdb top:
10:26:08 up 6 days, 20:13, 14 users, load average: 3.78, 3.80, 2.65
124 processes: 115 sleeping, 9 running, 0 zombie, 0 stopped
CPU states: cpu user nice system irq softirq iowait idle
total 94.6% 0.0% 5.3% 0.0% 0.0% 0.0% 0.0%
cpu00 95.1% 0.0% 4.8% 0.0% 0.0% 0.0% 0.0%
cpu01 93.2% 0.0% 6.7% 0.0% 0.0% 0.0% 0.0%
Program received signal SIGSEGV, Segmentation fault.
0xb80c27b7 in meminfo () from /lib/libproc.so.2.0.17
(gdb) bt
#0 0xb80c27b7 in meminfo () from /lib/libproc.so.2.0.17
#1 0x0804d3b8 in ?? ()
#2 0xbfbfca10 in ?? ()
#3 0xb806c003 in __libc_ptyname2 () from /lib/tls/libc.so.6
#4 0x00000000 in ?? ()
(gdb) inf loc
No symbol table info available.
top[8063]: segfault at b7edb000 ip b7ed47b7 sp bfe0d380 error 4 in
libproc.so.2.0.17[b7ece000+9000]
# cat /proc/meminfo
MemTotal: 3854752 kB
MemFree: 2736664 kB
Buffers: 88324 kB
Cached: 391328 kB
SwapCached: 11724 kB
Active: 395092 kB
Inactive: 411004 kB
Active(anon): 171388 kB
Inactive(anon): 159460 kB
Active(file): 223704 kB
Inactive(file): 251544 kB
Unevictable: 2612 kB
Mlocked: 2612 kB
HighTotal: 2990024 kB
HighFree: 2290060 kB
LowTotal: 864728 kB
LowFree: 446604 kB
SwapTotal: 1465120 kB
SwapFree: 1426960 kB
Dirty: 1708 kB
Writeback: 0 kB
AnonPages: 321408 kB
Mapped: 43200 kB
Slab: 299256 kB
SReclaimable: 269684 kB
SUnreclaim: 29572 kB
PageTables: 2284 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 3392496 kB
Committed_AS: 506384 kB
VmallocTotal: 122880 kB
VmallocUsed: 2180 kB
VmallocChunk: 118452 kB
HugePages_Total: 0
HugePages_Free: 0
HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 4096 kB
DirectMap4k: 20472 kB
DirectMap4M: 888832 kB
# cat /proc/slabinfo
slabinfo - version: 2.1
# name <active_objs> <num_objs> <objsize> <objperslab> <pagesperslab> : tunables <limit> <batchcount> <sharedfactor> : slabdata <active_slabs> <num_slabs> <sharedavail>
smb_inode_cache 19 34 472 17 2 : tunables 0 0 0 : slabdata 2 2 0
cifs_request 7 7 16512 1 8 : tunables 0 0 0 : slabdata 7 7 0
cifs_inode_cache 39552 39632 488 16 2 : tunables 0 0 0 : slabdata 2477 2477 0
flow_cache 0 0 80 51 1 : tunables 0 0 0 : slabdata 0 0 0
mqueue_inode_cache 1 21 768 21 4 : tunables 0 0 0 : slabdata 1 1 0
romfs_inode_cache 0 0 456 17 2 : tunables 0 0 0 : slabdata 0 0 0
isofs_inode_cache 0 0 480 17 2 : tunables 0 0 0 : slabdata 0 0 0
hugetlbfs_inode_cache 1 18 448 18 2 : tunables 0 0 0 : slabdata 1 1 0
ext2_inode_cache 0 0 648 12 2 : tunables 0 0 0 : slabdata 0 0 0
journal_handle 340 340 24 170 1 : tunables 0 0 0 : slabdata 2 2 0
journal_head 172 657 56 73 1 : tunables 0 0 0 : slabdata 9 9 0
revoke_record 512 512 16 256 1 : tunables 0 0 0 : slabdata 2 2 0
ext3_inode_cache 319620 319620 640 12 2 : tunables 0 0 0 : slabdata 26635 26635 0
ext3_xattr 0 0 48 85 1 : tunables 0 0 0 : slabdata 0 0 0
dquot 0 0 256 16 1 : tunables 0 0 0 : slabdata 0 0 0
shmem_inode_cache 28 28 560 14 2 : tunables 0 0 0 : slabdata 2 2 0
UDP 202 204 640 12 2 : tunables 0 0 0 : slabdata 17 17 0
TCP 69 69 1408 23 8 : tunables 0 0 0 : slabdata 3 3 0
blkdev_queue 18 22 1464 22 8 : tunables 0 0 0 : slabdata 1 1 0
blkdev_requests 44 54 224 18 1 : tunables 0 0 0 : slabdata 3 3 0
biovec-256 10 10 3072 10 8 : tunables 0 0 0 : slabdata 1 1 0
biovec-128 42 42 1536 21 8 : tunables 0 0 0 : slabdata 2 2 0
biovec-64 49 63 768 21 4 : tunables 0 0 0 : slabdata 3 3 0
sock_inode_cache 257 272 512 16 2 : tunables 0 0 0 : slabdata 17 17 0
file_lock_cache 68 68 120 34 1 : tunables 0 0 0 : slabdata 2 2 0
Acpi-Operand 612 612 40 102 1 : tunables 0 0 0 : slabdata 6 6 0
Acpi-Namespace 847 850 24 170 1 : tunables 0 0 0 : slabdata 5 5 0
proc_inode_cache 635 663 472 17 2 : tunables 0 0 0 : slabdata 39 39 0
sigqueue 56 56 144 28 1 : tunables 0 0 0 : slabdata 2 2 0
radix_tree_node 13220 19604 296 13 1 : tunables 0 0 0 : slabdata 1508 1508 0
bdev_cache 13 24 640 12 2 : tunables 0 0 0 : slabdata 2 2 0
sysfs_dir_cache 5777 5780 48 85 1 : tunables 0 0 0 : slabdata 68 68 0
inode_cache 1080 1098 448 18 2 : tunables 0 0 0 : slabdata 61 61 0
dentry 159325 159348 144 28 1 : tunables 0 0 0 : slabdata 5691 5691 0
avc_node 78 146 56 73 1 : tunables 0 0 0 : slabdata 2 2 0
buffer_head 74206 116800 64 64 1 : tunables 0 0 0 : slabdata 1825 1825 0
vm_area_struct 4735 4876 88 46 1 : tunables 0 0 0 : slabdata 106 106 0
files_cache 113 147 384 21 2 : tunables 0 0 0 : slabdata 7 7 0
sighand_cache 141 161 1408 23 8 : tunables 0 0 0 : slabdata 7 7 0
task_struct 143 160 3120 10 8 : tunables 0 0 0 : slabdata 16 16 0
anon_vma 2169 2304 32 128 1 : tunables 0 0 0 : slabdata 18 18 0
idr_layer_cache 130 130 152 26 1 : tunables 0 0 0 : slabdata 5 5 0
kmalloc-4096 42 56 4096 8 8 : tunables 0 0 0 : slabdata 7 7 0
kmalloc-2048 308 368 2048 16 8 : tunables 0 0 0 : slabdata 23 23 0
kmalloc-1024 238 272 1024 16 4 : tunables 0 0 0 : slabdata 17 17 0
kmalloc-512 652 688 512 16 2 : tunables 0 0 0 : slabdata 43 43 0
kmalloc-256 2780 3120 256 16 1 : tunables 0 0 0 : slabdata 195 195 0
kmalloc-128 1062 1344 128 32 1 : tunables 0 0 0 : slabdata 42 42 0
kmalloc-64 369191 391872 64 64 1 : tunables 0 0 0 : slabdata 6123 6123 0
kmalloc-32 1109 1152 32 128 1 : tunables 0 0 0 : slabdata 9 9 0
kmalloc-16 4077 5376 16 256 1 : tunables 0 0 0 : slabdata 21 21 0
kmalloc-8 2039 2048 8 512 1 : tunables 0 0 0 : slabdata 4 4 0
kmalloc-192 124 126 192 21 1 : tunables 0 0 0 : slabdata 6 6 0
kmalloc-96 487 546 96 42 1 : tunables 0 0 0 : slabdata 13 13 0
# cat /proc/mtrr
reg00: base=0x000000000 ( 0MB), size= 2048MB, count=1: write-back
reg01: base=0x080000000 ( 2048MB), size= 1024MB, count=1: write-back
reg02: base=0x0c0000000 ( 3072MB), size= 512MB, count=1: write-back
reg03: base=0x0e0000000 ( 3584MB), size= 128MB, count=1: write-back
reg04: base=0x0e8000000 ( 3712MB), size= 64MB, count=1: write-back
reg05: base=0x0ec000000 ( 3776MB), size= 32MB, count=1: write-back
reg06: base=0x0feda0000 ( 4077MB), size= 128KB, count=1: write-back
reg07: base=0x0f0000000 ( 3840MB), size= 128MB, count=1:
write-combining
Thanks,
Andreas Mohr
^ permalink raw reply [flat|nested] 2+ messages in thread
* [REGRESSION] 2.6.28-rc8: oldish top core dumps (in its meminfo() function)
2008-12-12 9:42 2.6.28-rc7: oldish top core dumps (in its meminfo() function) Andreas Mohr
@ 2008-12-12 18:49 ` Andreas Mohr
0 siblings, 0 replies; 2+ messages in thread
From: Andreas Mohr @ 2008-12-12 18:49 UTC (permalink / raw)
To: linux-kernel
[f'up]
I just tried it on -rc8 and a (freshly rebooted) -rc7, both core
dumped, yet a 2.6.27.7 test does NOT do that.
Breakage may be older than -rc7, also might be caused by .config
changes (via make oldconfig), since a diff shows several changes.
This is a JFYI since I pretty much won't be able to debug this issue,
at least not now.
Oh, one important part, the crash in libproc.so happens at 0xb7f077b7:
0xb7f0770d <meminfo+413>: je 0xb7f07a61 <meminfo+1265>
0xb7f07713 <meminfo+419>: cld
0xb7f07714 <meminfo+420>: mov 0xffffffbc(%ebp),%esi
0xb7f07717 <meminfo+423>: mov $0xe,%ecx
0xb7f0771c <meminfo+428>: lea 0xfffff14e(%ebx),%edi
0xb7f07722 <meminfo+434>: repz cmpsb %es:(%edi),%ds:(%esi)
0xb7f07724 <meminfo+436>: je 0xb7f07a10 <meminfo+1184>
0xb7f0772a <meminfo+442>: cld
0xb7f0772b <meminfo+443>: mov 0xffffffbc(%ebp),%esi
0xb7f0772e <meminfo+446>: mov $0xa,%ecx
0xb7f07733 <meminfo+451>: lea 0xfffff15c(%ebx),%edi
0xb7f07739 <meminfo+457>: repz cmpsb %es:(%edi),%ds:(%esi)
0xb7f0773b <meminfo+459>: je 0xb7f079c5 <meminfo+1109>
0xb7f07741 <meminfo+465>: cld
0xb7f07742 <meminfo+466>: mov 0xffffffbc(%ebp),%esi
0xb7f07745 <meminfo+469>: mov $0x9,%ecx
0xb7f0774a <meminfo+474>: lea 0xfffff166(%ebx),%edi
0xb7f07750 <meminfo+480>: repz cmpsb %es:(%edi),%ds:(%esi)
0xb7f07752 <meminfo+482>: je 0xb7f0797a <meminfo+1034>
0xb7f07758 <meminfo+488>: cld
0xb7f07759 <meminfo+489>: mov 0xffffffbc(%ebp),%esi
0xb7f0775c <meminfo+492>: mov $0xb,%ecx
0xb7f07761 <meminfo+497>: lea 0xfffff16f(%ebx),%edi
0xb7f07767 <meminfo+503>: repz cmpsb %es:(%edi),%ds:(%esi)
0xb7f07769 <meminfo+505>: je 0xb7f0792f <meminfo+959>
0xb7f0776f <meminfo+511>: cld
0xb7f07770 <meminfo+512>: mov 0xffffffbc(%ebp),%esi
0xb7f07773 <meminfo+515>: mov $0xa,%ecx
0xb7f07778 <meminfo+520>: lea 0xfffff17a(%ebx),%edi
0xb7f0777e <meminfo+526>: repz cmpsb %es:(%edi),%ds:(%esi)
0xb7f07780 <meminfo+528>: je 0xb7f078e4 <meminfo+884>
0xb7f07786 <meminfo+534>: cld
0xb7f07787 <meminfo+535>: mov 0xffffffbc(%ebp),%esi
0xb7f0778a <meminfo+538>: mov $0xb,%ecx
0xb7f0778f <meminfo+543>: lea 0xfffff184(%ebx),%edi
0xb7f07795 <meminfo+549>: repz cmpsb %es:(%edi),%ds:(%esi)
0xb7f07797 <meminfo+551>: je 0xb7f07893 <meminfo+803>
0xb7f0779d <meminfo+557>: cld
0xb7f0779e <meminfo+558>: mov 0xffffffbc(%ebp),%esi
0xb7f077a1 <meminfo+561>: mov $0xa,%ecx
0xb7f077a6 <meminfo+566>: lea 0xfffff18f(%ebx),%edi
0xb7f077ac <meminfo+572>: repz cmpsb %es:(%edi),%ds:(%esi)
0xb7f077ae <meminfo+574>: je 0xb7f07842 <meminfo+722>
0xb7f077b4 <meminfo+580>: mov 0xffffffc4(%ebp),%ecx
0xb7f077b7 <meminfo+583>: movzbl (%ecx),%eax
0xb7f077ba <meminfo+586>: inc %ecx
0xb7f077bb <meminfo+587>: mov %ecx,0xffffffc4(%ebp)
0xb7f077be <meminfo+590>: cmp $0xa,%al
0xb7f077c0 <meminfo+592>: jne 0xb7f077b4 <meminfo+580>
0xb7f077c2 <meminfo+594>: lea 0x0(%esi),%esi
0xb7f077c9 <meminfo+601>: lea 0x0(%edi),%edi
0xb7f077d0 <meminfo+608>: mov 0xffffffc4(%ebp),%eax
0xb7f077d3 <meminfo+611>: cmpb $0x0,(%eax)
0xb7f077d6 <meminfo+614>: jne 0xb7f07610 <meminfo+160>
0xb7f077dc <meminfo+620>: mov 0x8(%ebp),%ecx
0xb7f077df <meminfo+623>: mov 0x88(%ecx),%eax
0xb7f077e5 <meminfo+629>: mov 0x8c(%ecx),%edx
0xb7f077eb <meminfo+635>: sub 0x98(%ecx),%eax
0xb7f077f1 <meminfo+641>: sbb 0x9c(%ecx),%edx
0xb7f077f7 <meminfo+647>: mov %eax,0x90(%ecx)
0xb7f077fd <meminfo+653>: mov (%ecx),%eax
0xb7f077ff <meminfo+655>: sub 0x30(%ecx),%eax
0xb7f07802 <meminfo+658>: mov %edx,0x94(%ecx)
0xb7f07808 <meminfo+664>: mov 0x4(%ecx),%edx
0xb7f0780b <meminfo+667>: sbb 0x34(%ecx),%edx
0xb7f0780e <meminfo+670>: mov %eax,0x18(%ecx)
0xb7f07811 <meminfo+673>: mov 0x8(%ecx),%eax
0xb7f07814 <meminfo+676>: sub 0x38(%ecx),%eax
0xb7f07817 <meminfo+679>: mov %edx,0x1c(%ecx)
0xb7f0781a <meminfo+682>: mov 0xc(%ecx),%edx
0xb7f0781d <meminfo+685>: sbb 0x3c(%ecx),%edx
0xb7f07820 <meminfo+688>: mov %eax,0x20(%ecx)
0xb7f07823 <meminfo+691>: mov 0x10(%ecx),%eax
0xb7f07826 <meminfo+694>: sub 0x40(%ecx),%eax
0xb7f07829 <meminfo+697>: mov %edx,0x24(%ecx)
0xb7f0782c <meminfo+700>: mov 0x14(%ecx),%edx
0xb7f0782f <meminfo+703>: sbb 0x44(%ecx),%edx
0xb7f07832 <meminfo+706>: mov %eax,0x28(%ecx)
0xb7f07835 <meminfo+709>: mov %edx,0x2c(%ecx)
0xb7f07838 <meminfo+712>: add $0x5c,%esp
0xb7f0783b <meminfo+715>: xor %eax,%eax
0xb7f0783d <meminfo+717>: pop %ebx
0xb7f0783e <meminfo+718>: pop %esi
0xb7f0783f <meminfo+719>: pop %edi
0xb7f07840 <meminfo+720>: pop %ebp
0xb7f07841 <meminfo+721>: ret
(gdb) inf reg
eax 0x0 0
ecx 0xb7f0e000 -1208950784
edx 0x1 1
ebx 0xb7f0a264 -1208966556
esp 0xbfc40220 0xbfc40220
ebp 0xbfc40288 0xbfc40288
esi 0xbfc40261 -1077673375
edi 0xb7f093f4 -1208970252
eip 0xb7f077b7 0xb7f077b7
eflags 0x210297 2163351
cs 0x73 115
ss 0x7b 123
ds 0x7b 123
es 0x7b 123
fs 0x0 0
gs 0x33 51
(gdb) x 0xb7f0e000
0xb7f0e000: Cannot access memory at address 0xb7f0e000
Thanks,
Andreas Mohr
^ permalink raw reply [flat|nested] 2+ messages in thread
end of thread, other threads:[~2008-12-12 18:49 UTC | newest]
Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2008-12-12 9:42 2.6.28-rc7: oldish top core dumps (in its meminfo() function) Andreas Mohr
2008-12-12 18:49 ` [REGRESSION] 2.6.28-rc8: " Andreas Mohr
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.