1.smbd crash 2.The daemon smbd crash and after restart the system is unstable. 3.daemon 4.Linux version 2.6.27.8.fc9.x86_64 (root@node1) (gcc version 4.3.0 20080428 (Red Hat 4.3.0-8) (GCC) ) #3 SMP Thu Dec 18 10:40:19 CET 2008 5.Mon Dec 22 13:49:01 CET 2008 BUG: soft lockup - CPU#5 stuck for 61s! [smbd:16614] Modules linked in: sha256_generic aes_x86_64 aes_generic cbc dm_crypt crypto_blkcipher nfs lockd nfs_acl ipmi_si ipmi_devintf ipmi_msghandler sunrpc bonding ipv6 xfs dm_mirror dm_log dm_multipath dm_mod kvm_amd kvm sr_mod cdrom raid0 ata_generic pata_amd cfi_cmdset_0002 pcspkr cfi_util ppdev sata_nv pata_acpi floppy libata button jedec_probe parport_pc cfi_probe gen_probe ck804xrom parport mtd qla2xxx chipreg scsi_transport_fc scsi_tgt map_funcs sg forcedeth i2c_nforce2 i2c_core shpchp 3w_9xxx sd_mod scsi_mod raid456 async_xor async_memcpy async_tx xor raid1 ext3 jbd mbcache uhci_hcd ohci_hcd ehci_hcd [last unloaded: e1000] CPU 5: Modules linked in: sha256_generic aes_x86_64 aes_generic cbc dm_crypt crypto_blkcipher nfs lockd nfs_acl ipmi_si ipmi_devintf ipmi_msghandler sunrpc bonding ipv6 xfs dm_mirror dm_log dm_multipath dm_mod kvm_amd kvm sr_mod cdrom raid0 ata_generic pata_amd cfi_cmdset_0002 pcspkr cfi_util ppdev sata_nv pata_acpi floppy libata button jedec_probe parport_pc cfi_probe gen_probe ck804xrom parport mtd qla2xxx chipreg scsi_transport_fc scsi_tgt map_funcs sg forcedeth i2c_nforce2 i2c_core shpchp 3w_9xxx sd_mod scsi_mod raid456 async_xor async_memcpy async_tx xor raid1 ext3 jbd mbcache uhci_hcd ohci_hcd ehci_hcd [last unloaded: e1000] Pid: 16614, comm: smbd Not tainted 2.6.27.8.fc9.x86_64 #3 RIP: 0010:[] [] mutex_lock+0x23/0x2e RSP: 0000:ffff88032f0c1e38 EFLAGS: 00000246 RAX: 0000000000000246 RBX: ffff88032f0c1e48 RCX: 0000000000000002 RDX: ffff88032e91ebc0 RSI: 0000000000000058 RDI: ffff88010b65d3f0 RBP: 0000000000000000 R08: ffff88032f0c0000 R09: 0000000000000000 R10: 0000150d29bc50cf R11: ffff8802dca56048 R12: 0000150d29bc50cf R13: ffff8802dca56048 R14: ffff88032f0c1e28 R15: 0000000000000000 FS: 00007f011676a7a0(0000) GS:ffff88022fa13200(0000) knlGS:00000000f7fd86c0 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: 0000000002642fc0 CR3: 000000032e91d000 CR4: 00000000000006e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Call Trace: [] ? mutex_lock+0x1d/0x2e [] ? inotify_destroy+0x83/0xda [] ? inotify_release+0x28/0xd7 [] ? __fput+0xc5/0x184 [] ? fput+0x15/0x17 [] ? filp_close+0x67/0x72 [] ? sys_close+0xad/0xf0 [] ? system_call_fastpath+0x16/0x1b 6. 7.Fedora 9 x86_64 7.1 samba-3.2.0-1.pre3.9.fc9.x86_64 7.2 7.3nfs 263072 2 - Live 0xffffffffa0364000 lockd 68384 1 nfs, Live 0xffffffffa0352000 nfs_acl 7296 1 nfs, Live 0xffffffffa0148000 ipmi_si 44428 0 - Live 0xffffffffa013c000 ipmi_devintf 13840 0 - Live 0xffffffffa0137000 ipmi_msghandler 35832 2 ipmi_si,ipmi_devintf, Live 0xffffffffa012d000 sunrpc 186472 13 nfs,lockd,nfs_acl, Live 0xffffffffa0323000 bonding 86696 0 - Live 0xffffffffa030c000 ipv6 270696 320 - Live 0xffffffffa02c8000 xfs 482864 3 - Live 0xffffffffa0251000 dm_mirror 21568 0 - Live 0xffffffffa024a000 dm_log 13892 1 dm_mirror, Live 0xffffffffa0245000 dm_multipath 19032 0 - Live 0xffffffffa023f000 dm_mod 57632 3 dm_mirror,dm_log,dm_multipath, Live 0xffffffffa022f000 kvm_amd 33932 0 - Live 0xffffffffa0225000 kvm 134960 1 kvm_amd, Live 0xffffffffa0203000 sr_mod 19764 0 - Live 0xffffffffa01fd000 cdrom 36520 1 sr_mod, Live 0xffffffffa01f3000 ata_generic 10180 0 - Live 0xffffffffa01ef000 pata_amd 17348 0 - Live 0xffffffffa01e9000 cfi_cmdset_0002 30528 1 - Live 0xffffffffa01e0000 raid0 10880 1 - Live 0xffffffffa01dc000 cfi_util 7424 1 cfi_cmdset_0002, Live 0xffffffffa012a000 jedec_probe 18496 0 - Live 0xffffffffa01d6000 cfi_probe 11136 0 - Live 0xffffffffa01d2000 ppdev 11912 0 - Live 0xffffffffa01ce000 sata_nv 28616 0 - Live 0xffffffffa01c4000 gen_probe 7488 2 jedec_probe,cfi_probe, Live 0xffffffffa01c1000 qla2xxx 183076 1 - Live 0xffffffffa0191000 pata_acpi 9280 0 - Live 0xffffffffa018b000 ck804xrom 8708 0 - Live 0xffffffffa0185000 mtd 18060 3 cfi_cmdset_0002,ck804xrom, Live 0xffffffffa017f000 libata 156032 4 ata_generic,pata_amd,sata_nv,pata_acpi, Live 0xffffffffa0157000 parport_pc 30360 0 - Live 0xffffffffa014e000 floppy 62568 0 - Live 0xffffffffa0119000 forcedeth 59152 0 - Live 0xffffffffa0109000 i2c_nforce2 10944 0 - Live 0xffffffffa0105000 chipreg 7172 3 jedec_probe,cfi_probe,ck804xrom, Live 0xffffffffa0102000 pcspkr 7104 0 - Live 0xffffffffa00fd000 parport 38944 2 ppdev,parport_pc, Live 0xffffffffa00f2000 scsi_transport_fc 46852 1 qla2xxx, Live 0xffffffffa00e5000 sg 36688 0 - Live 0xffffffffa00db000 i2c_core 25312 1 i2c_nforce2, Live 0xffffffffa00d3000 map_funcs 6208 1 ck804xrom, Live 0xffffffffa00d0000 scsi_tgt 16688 1 scsi_transport_fc, Live 0xffffffffa00ca000 button 11808 0 - Live 0xffffffffa00c6000 shpchp 34204 0 - Live 0xffffffffa00bc000 3w_9xxx 35412 7 - Live 0xffffffffa00b2000 sd_mod 30760 12 - Live 0xffffffffa00a9000 scsi_mod 148888 8 sr_mod,qla2xxx,libata,scsi_transport_fc,sg,scsi_tgt,3w_9xxx,sd_mod, Live 0xf fffffffa0083000 raid456 125984 0 - Live 0xffffffffa0063000 async_xor 7552 1 raid456, Live 0xffffffffa0060000 async_memcpy 6272 1 raid456, Live 0xffffffffa005d000 async_tx 11052 3 raid456,async_xor,async_memcpy, Live 0xffffffffa0059000 xor 9360 2 raid456,async_xor, Live 0xffffffffa0055000 raid1 25664 2 - Live 0xffffffffa004d000 ext3 126608 1 - Live 0xffffffffa002d000 jbd 51560 1 ext3, Live 0xffffffffa001f000 mbcache 11908 1 ext3, Live 0xffffffffa001b000 uhci_hcd 26464 0 - Live 0xffffffffa0013000 ohci_hcd 27292 0 - Live 0xffffffffa000b000 ehci_hcd 38156 0 - Live 0xffffffffa0000000 7.4 [root@node1]/backup>cat /proc/ioports 0000-8fff : PCI Bus #00 0000-001f : dma1 0020-0021 : pic1 0040-0043 : timer0 0050-0053 : timer1 0060-0060 : keyboard 0064-0064 : keyboard 0070-0071 : rtc0 0080-008f : dma page reg 00a0-00a1 : pic2 00c0-00df : dma2 00f0-00ff : fpu 0170-0177 : 0000:00:06.0 0170-0177 : pata_amd 01f0-01f7 : 0000:00:06.0 01f0-01f7 : pata_amd 02f8-02ff : serial 0376-0376 : 0000:00:06.0 0376-0376 : pata_amd 0378-037a : parport0 037b-037f : parport0 03c0-03df : vesafb 03f2-03f5 : floppy 03f6-03f6 : 0000:00:06.0 03f6-03f6 : pata_amd 03f7-03f7 : floppy DIR 03f8-03ff : serial 0400-045e : pnp 00:09 04d0-04d1 : pnp 00:09 0ca8-0ca8 : ipmi_si 0cac-0cac : ipmi_si 0cf8-0cff : PCI conf1 1000-101f : 0000:00:01.1 1400-140f : 0000:00:06.0 1400-140f : pata_amd 1410-141f : 0000:00:07.0 1410-141f : sata_nv 1420-142f : 0000:00:08.0 1420-142f : sata_nv 1430-1433 : 0000:00:07.0 1430-1433 : sata_nv 1434-1437 : 0000:00:07.0 1434-1437 : sata_nv 1438-143f : 0000:00:07.0 1438-143f : sata_nv 1440-1447 : 0000:00:07.0 1440-1447 : sata_nv 1448-144b : 0000:00:08.0 1448-144b : sata_nv 144c-144f : 0000:00:08.0 144c-144f : sata_nv 1450-1457 : 0000:00:08.0 1450-1457 : sata_nv 1458-145f : 0000:00:08.0 1458-145f : sata_nv 1460-1467 : 0000:00:0a.0 1460-1467 : forcedeth 2000-2fff : PCI Bus 0000:01 2000-207f : 0000:01:09.0 2080-20bf : 0000:01:06.0 3000-3fff : PCI Bus 0000:05 3000-30ff : 0000:05:00.0 8000-807f : pnp 00:08 8000-8003 : ACPI PM1a_EVT_BLK 8004-8005 : ACPI PM1a_CNT_BLK 8008-800b : ACPI PM_TMR 8010-8015 : ACPI CPU throttle 801c-801c : ACPI PM2_CNT_BLK 8020-8027 : ACPI GPE0_BLK 8080-80ff : pnp 00:08 8400-847f : pnp 00:08 8480-84ff : pnp 00:08 8800-887f : pnp 00:08 8880-88ff : pnp 00:08 9000-9fff : PCI Bus #80 9000-907f : pnp 00:09 9080-90ff : pnp 00:09 9200-927f : pnp 00:09 9280-92ff : pnp 00:09 9400-947f : pnp 00:09 9480-94ff : pnp 00:09 a000-afff : PCI Bus #00 a000-a03f : 0000:00:01.1 a000-a03f : pnp 00:08 a000-a03f : nForce2_smbus a040-a07f : 0000:00:01.1 a040-a07f : pnp 00:08 a040-a07f : nForce2_smbus b000-cfff : PCI Bus #80 b000-b00f : 0000:80:07.0 b000-b00f : sata_nv b010-b01f : 0000:80:08.0 b010-b01f : sata_nv b020-b023 : 0000:80:07.0 b020-b023 : sata_nv b024-b027 : 0000:80:07.0 b024-b027 : sata_nv b028-b02f : 0000:80:07.0 b028-b02f : sata_nv b030-b037 : 0000:80:07.0 b030-b037 : sata_nv b038-b03b : 0000:80:08.0 b038-b03b : sata_nv b03c-b03f : 0000:80:08.0 b03c-b03f : sata_nv b040-b047 : 0000:80:08.0 b040-b047 : sata_nv b048-b04f : 0000:80:08.0 b048-b04f : sata_nv b050-b057 : 0000:80:0a.0 b050-b057 : forcedeth c000-cfff : PCI Bus 0000:8b c000-c0ff : 0000:8b:00.0 c000-c0ff : 3w-9xxx d000-ffff : PCI Bus #00 [root@node1]/backup>cat /proc/iomem 00000000-0000ffff : reserved 00010000-000953ff : System RAM 00095400-0009ffff : reserved 000a0000-000bffff : PCI Bus #00 000ca000-000fffff : reserved 00100000-7ff7ffff : System RAM 00200000-004a9a84 : Kernel code 004a9a85-0062fc1f : Kernel data 00fe1000-0108b06b : Kernel bss 20000000-23ffffff : GART 7ff80000-7ff84fff : ACPI Tables 7ff85000-7fffffff : ACPI Non-volatile Storage 80000000-cfdfffff : System RAM cfe00000-cfffffff : reserved d0000000-dbffffff : PCI Bus #00 d0000000-d00fffff : PCI Bus 0000:05 d0000000-d003ffff : 0000:05:00.0 d4000000-d4000fff : 0000:00:02.0 d4000000-d4000fff : ohci_hcd d4001000-d40010ff : 0000:00:02.1 d4001000-d40010ff : ehci_hcd d4002000-d4002fff : 0000:00:07.0 d4002000-d4002fff : sata_nv d4003000-d4003fff : 0000:00:08.0 d4003000-d4003fff : sata_nv d4004000-d4004fff : 0000:00:0a.0 d4004000-d4004fff : forcedeth d4100000-d41fffff : PCI Bus 0000:01 d4100000-d411ffff : 0000:01:06.0 d4120000-d413ffff : 0000:01:06.0 d4140000-d417ffff : 0000:01:09.0 d4180000-d419ffff : 0000:01:06.0 d4200000-d42fffff : PCI Bus 0000:05 d4200000-d4203fff : 0000:05:00.0 d4200000-d4203fff : qla2xxx d8000000-dbffffff : PCI Bus 0000:01 d8000000-dbffffff : 0000:01:09.0 d8000000-d9ffffff : vesafb dc000000-dfffffff : PCI Bus #80 dc000000-dc000fff : 0000:80:07.0 dc000000-dc000fff : sata_nv dc001000-dc001fff : 0000:80:08.0 dc001000-dc001fff : sata_nv dc002000-dc002fff : 0000:80:0a.0 dc002000-dc002fff : forcedeth dc100000-dc1fffff : PCI Bus 0000:8b dc100000-dc100fff : 0000:8b:00.0 dc100000-dc100fff : 3w-9xxx dc120000-dc13ffff : 0000:8b:00.0 de000000-dfffffff : PCI Bus 0000:8b de000000-dfffffff : 0000:8b:00.0 de000000-dfffffff : 3w-9xxx e0000000-efffffff : reserved e0000000-e7ffffff : PCI Bus #00 e8000000-efffffff : PCI Bus #80 f0000000-ffffffff : PCI Bus #00 fec00000-fec0ffff : reserved fec00000-fec00fff : IOAPIC 0 fee00000-fee00fff : Local APIC fee00000-fee00fff : reserved fefff000-feffffff : pnp 00:00 fff80000-ffffffff : reserved 100000000-82fffffff : System RAM 830000000-fcffffffff : PCI Bus #00 7.5 7.6 [root@node1]/backup>cat /proc/scsi/scsi Attached devices: Host: scsi0 Channel: 00 Id: 00 Lun: 00 Vendor: AMCC Model: 9690SA-8I DISK Rev: 4.04 Type: Direct-Access ANSI SCSI revision: 05 Host: scsi0 Channel: 00 Id: 01 Lun: 00 Vendor: AMCC Model: 9690SA-8I DISK Rev: 4.04 Type: Direct-Access ANSI SCSI revision: 05 Host: scsi0 Channel: 00 Id: 02 Lun: 00 Vendor: AMCC Model: 9690SA-8I DISK Rev: 4.04 Type: Direct-Access ANSI SCSI revision: 05 Host: scsi5 Channel: 00 Id: 00 Lun: 00 Vendor: IFT Model: F12F-G2A2 Rev: 342R Type: Direct-Access ANSI SCSI revision: 03 Host: scsi7 Channel: 00 Id: 00 Lun: 00 Vendor: TEAC Model: DV-516GB Rev: HT13 Type: CD-ROM ANSI SCSI revision: 05 My server work with smbd, nmbd, nfs, mysqld, ntpd, vsftpd. I have tried to kill the pid smbd:16614, but the system don't execute my command kill -15 16614 or kill -9 16614. After I have restart the daemon smbd and nmbd but the process don't sutdown, the server give me at on dmesg much error BUG: soft lockup - CPU#5 stuck for 61s! [smbd:16614]. After the restart smbd daemon the system is unstable with other process. Thank you Diego Raschi Responsabile Risorse Informatiche Istituto Bancario Sammarinese S.p.A. via III Settembre 99 - 47891 Repubblica di San Marino Tel. 0549 872014 Fax. 0549 872050 draschi@ibs.sm www.ibs.sm https://ibs.sm/