* SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx?
@ 2003-12-06 2:32 Colin Coe
2003-12-06 2:42 ` William Lee Irwin III
0 siblings, 1 reply; 29+ messages in thread
From: Colin Coe @ 2003-12-06 2:32 UTC (permalink / raw)
To: linux-kernel
[-- Attachment #1: Type: text/plain, Size: 3857 bytes --]
Hi all
I believe there is a SMP problem with the Dell PowerEdge 4100/200 under
2.6.0-testxx kernels. I've looked through the archives but haven't found
anyone mention any problems similar to this.
The system has 640MB RAM (4x32MB and 4x128MB), dual Pentium Pro 200s and
is pure SCSI (AIC-7860 and AMI MegaRAID 428 controllers).
Under v2.4.23, 'cat /proc/interrupts' shows the following (with an uptime
of 10 minutes):
CPU0 CPU1
0: 28961 33597 IO-APIC-edge timer
1: 2 3 IO-APIC-edge keyboard
2: XT-PIC cascade
4: 38 11 IO-APIC-edge serial
5: 191 209 IO-APIC-level eth1
8: 1 IO-APIC-edge rtc
10: 1241 1238 IO-APIC-level aic7xxx
11: 299 315 IO-APIC-level eth0
12: 25 3 IO-APIC-edge PS/2 Mouse
14: IO-APIC-level cs46xx
15: 2756 2679 IO-APIC-level megaraid
NMI: 0
LOC: 62438 62440
ERR: 0
MIS: 0
This indicates to me that the processing load is being evenly distributed
accross the two processes. Under v2.6.0-testxx however, 'cat
/proc/interrupts' shows this:
[root@host root]# cat /proc/interrupts
CPU0 CPU1
0: 633122 30 IO-APIC-edge timer
1: 207 IO-APIC-edge i8042
2: XT-PIC cascade
4: 48 1 IO-APIC-edge serial
5: 449 1 IO-APIC-level eth1
10: 135 1 IO-APIC-level aic7xxx
11: 1447 1 IO-APIC-level eth0
12: 61 IO-APIC-edge i8042
14: IO-APIC-level CS46XX
15: 14982 1 IO-APIC-level megaraid
NMI: 0
LOC: 632444 632443
ERR: 0
MIS: 0
which indicates to me that only CPU0 is being used.
It is a RH9 based system with several packages updated so as to satisfy
the kernel's minimum requirements.
[root@host root]# lspci
00:00.0 Host bridge: Intel Corp. 440FX - 82441FX PMC [Natoma] (rev 02)
00:0d.0 PCI bridge: Digital Equipment Corporation DECchip 21052 (rev 02)
00:0f.0 Non-VGA unclassified device: Intel Corp. 82375EB (rev 15)
00:10.0 Ethernet controller: 3Com Corporation 3c905C-TX/TX-M [Tornado]
(rev 78)
00:11.0 VGA compatible controller: Matrox Graphics, Inc. MGA 2164W
[Millennium II]
00:13.0 Ethernet controller: 3Com Corporation 3c905B 100BaseTX [Cyclone]
(rev 30)
01:08.0 Multimedia audio controller: Cirrus Logic CS 4614/22/24
[CrystalClear SoundFusion Audio Accelerator] (rev 01)
01:0b.0 SCSI storage controller: Adaptec AIC-7860 (rev 01)
01:0d.0 Unknown mass storage controller: American Megatrends Inc. MegaRAID
428 Ultra RAID Controller (rev 03)
[root@host linux]# ./scripts/ver_linux
If some fields are empty or look unusual you may have an old version.
Compare to the current minimal requirements in Documentation/Changes.
Linux host.domain.com 2.6.0-test11 #3 SMP Sat Dec 6 09:49:19 WST 2003 i686
i686 i386 GNU/Linux
Gnu C 3.2.2
Gnu make 3.79.1
util-linux 2.11y
mount 2.11y
module-init-tools implemented (0.9.14)
e2fsprogs 1.32
PPP 2.4.1
Linux C Library 2.3.2
Dynamic linker (ldd) 2.3.2
Procps 3.1.13
Net-tools 1.60
Kbd 1.08
Sh-utils 4.5.3
Modules Loaded
[root@host linux]# ld -v
GNU ld version 2.13.90.0.18 20030206
I think I've provided the necessary info, but if I've missed anything
please advise and I'll provide what is required.
The .config for 2.6.0-test11 is attached.
Has anyone seen this or have any idea what may be going on?
TIA
CC
--
"Obnoxious frog..." Spike, 2071AD
[-- Attachment #2: config.txt --]
[-- Type: text/plain, Size: 4901 bytes --]
CONFIG_X86=y
CONFIG_MMU=y
CONFIG_UID16=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_EXPERIMENTAL=y
CONFIG_CLEAN_COMPILE=y
CONFIG_STANDALONE=y
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_SYSCTL=y
CONFIG_LOG_BUF_SHIFT=15
CONFIG_IKCONFIG=y
CONFIG_IKCONFIG_PROC=y
CONFIG_KALLSYMS=y
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_AS=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_MODULES=y
CONFIG_MODULE_UNLOAD=y
CONFIG_MODULE_FORCE_UNLOAD=y
CONFIG_OBSOLETE_MODPARM=y
CONFIG_MODVERSIONS=y
CONFIG_KMOD=y
CONFIG_X86_PC=y
CONFIG_M686=y
CONFIG_X86_CMPXCHG=y
CONFIG_X86_XADD=y
CONFIG_X86_L1_CACHE_SHIFT=5
CONFIG_RWSEM_XCHGADD_ALGORITHM=y
CONFIG_X86_PPRO_FENCE=y
CONFIG_X86_WP_WORKS_OK=y
CONFIG_X86_INVLPG=y
CONFIG_X86_BSWAP=y
CONFIG_X86_POPAD_OK=y
CONFIG_X86_GOOD_APIC=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
CONFIG_SMP=y
CONFIG_NR_CPUS=4
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y
CONFIG_X86_TSC=y
CONFIG_MICROCODE=m
CONFIG_X86_MSR=m
CONFIG_X86_CPUID=m
CONFIG_NOHIGHMEM=y
CONFIG_MTRR=y
CONFIG_HAVE_DEC_LOCK=y
CONFIG_ACPI_BOOT=y
CONFIG_PCI=y
CONFIG_PCI_GOANY=y
CONFIG_PCI_BIOS=y
CONFIG_PCI_DIRECT=y
CONFIG_PCI_LEGACY_PROC=y
CONFIG_PCI_NAMES=y
CONFIG_ISA=y
CONFIG_EISA=y
CONFIG_EISA_PCI_EISA=y
CONFIG_EISA_VIRTUAL_ROOT=y
CONFIG_EISA_NAMES=y
CONFIG_BINFMT_ELF=y
CONFIG_BINFMT_AOUT=y
CONFIG_BINFMT_MISC=y
CONFIG_PNP=y
CONFIG_ISAPNP=y
CONFIG_PNPBIOS=y
CONFIG_BLK_DEV_FD=y
CONFIG_BLK_DEV_INITRD=y
CONFIG_LBD=y
CONFIG_SCSI=y
CONFIG_SCSI_PROC_FS=y
CONFIG_BLK_DEV_SD=y
CONFIG_CHR_DEV_ST=y
CONFIG_BLK_DEV_SR=y
CONFIG_CHR_DEV_SG=y
CONFIG_SCSI_REPORT_LUNS=y
CONFIG_SCSI_AIC7XXX=y
CONFIG_AIC7XXX_CMDS_PER_DEVICE=32
CONFIG_AIC7XXX_RESET_DELAY_MS=15000
CONFIG_AIC7XXX_DEBUG_ENABLE=y
CONFIG_AIC7XXX_DEBUG_MASK=0
CONFIG_AIC7XXX_REG_PRETTY_PRINT=y
CONFIG_SCSI_MEGARAID=y
CONFIG_MD=y
CONFIG_BLK_DEV_DM=y
CONFIG_NET=y
CONFIG_PACKET=y
CONFIG_UNIX=y
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
CONFIG_INET_ECN=y
CONFIG_SYN_COOKIES=y
CONFIG_NETFILTER=y
CONFIG_IP_NF_CONNTRACK=y
CONFIG_IP_NF_FTP=y
CONFIG_IP_NF_IRC=y
CONFIG_IP_NF_TFTP=y
CONFIG_IP_NF_AMANDA=y
CONFIG_IP_NF_QUEUE=y
CONFIG_IP_NF_IPTABLES=y
CONFIG_IP_NF_MATCH_LIMIT=y
CONFIG_IP_NF_MATCH_IPRANGE=y
CONFIG_IP_NF_MATCH_MAC=y
CONFIG_IP_NF_MATCH_PKTTYPE=y
CONFIG_IP_NF_MATCH_MARK=y
CONFIG_IP_NF_MATCH_MULTIPORT=y
CONFIG_IP_NF_MATCH_TOS=y
CONFIG_IP_NF_MATCH_RECENT=y
CONFIG_IP_NF_MATCH_ECN=y
CONFIG_IP_NF_MATCH_DSCP=y
CONFIG_IP_NF_MATCH_AH_ESP=y
CONFIG_IP_NF_MATCH_LENGTH=y
CONFIG_IP_NF_MATCH_TTL=y
CONFIG_IP_NF_MATCH_TCPMSS=y
CONFIG_IP_NF_MATCH_HELPER=y
CONFIG_IP_NF_MATCH_STATE=y
CONFIG_IP_NF_MATCH_CONNTRACK=y
CONFIG_IP_NF_MATCH_OWNER=y
CONFIG_IP_NF_FILTER=y
CONFIG_IP_NF_TARGET_REJECT=y
CONFIG_IP_NF_NAT=y
CONFIG_IP_NF_NAT_NEEDED=y
CONFIG_IP_NF_TARGET_MASQUERADE=y
CONFIG_IP_NF_TARGET_REDIRECT=y
CONFIG_IP_NF_TARGET_NETMAP=y
CONFIG_IP_NF_TARGET_SAME=y
CONFIG_IP_NF_NAT_LOCAL=y
CONFIG_IP_NF_NAT_SNMP_BASIC=y
CONFIG_IP_NF_NAT_IRC=y
CONFIG_IP_NF_NAT_FTP=y
CONFIG_IP_NF_NAT_TFTP=y
CONFIG_IP_NF_NAT_AMANDA=y
CONFIG_IP_NF_MANGLE=y
CONFIG_IP_NF_TARGET_TOS=y
CONFIG_IP_NF_TARGET_ECN=y
CONFIG_IP_NF_TARGET_DSCP=y
CONFIG_IP_NF_TARGET_MARK=y
CONFIG_IP_NF_TARGET_CLASSIFY=y
CONFIG_IP_NF_TARGET_LOG=y
CONFIG_IP_NF_TARGET_ULOG=y
CONFIG_IP_NF_TARGET_TCPMSS=y
CONFIG_IP_NF_ARPTABLES=y
CONFIG_IP_NF_ARPFILTER=y
CONFIG_IP_NF_ARP_MANGLE=y
CONFIG_IPV6_SCTP__=y
CONFIG_NETDEVICES=y
CONFIG_DUMMY=y
CONFIG_NET_ETHERNET=y
CONFIG_NET_VENDOR_3COM=y
CONFIG_VORTEX=y
CONFIG_PPP=y
CONFIG_PPP_ASYNC=y
CONFIG_PPP_DEFLATE=y
CONFIG_PPP_BSDCOMP=y
CONFIG_INPUT=y
CONFIG_INPUT_MOUSEDEV=y
CONFIG_INPUT_MOUSEDEV_PSAUX=y
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768
CONFIG_GAMEPORT=y
CONFIG_SOUND_GAMEPORT=y
CONFIG_SERIO=y
CONFIG_SERIO_I8042=y
CONFIG_INPUT_KEYBOARD=y
CONFIG_KEYBOARD_ATKBD=y
CONFIG_INPUT_MOUSE=y
CONFIG_MOUSE_PS2=y
CONFIG_VT=y
CONFIG_VT_CONSOLE=y
CONFIG_HW_CONSOLE=y
CONFIG_SERIAL_NONSTANDARD=y
CONFIG_STALDRV=y
CONFIG_SERIAL_8250=y
CONFIG_SERIAL_8250_NR_UARTS=4
CONFIG_SERIAL_CORE=y
CONFIG_UNIX98_PTYS=y
CONFIG_UNIX98_PTY_COUNT=256
CONFIG_FB=y
CONFIG_VIDEO_SELECT=y
CONFIG_FB_MATROX=y
CONFIG_FB_MATROX_MILLENIUM=y
CONFIG_VGA_CONSOLE=y
CONFIG_DUMMY_CONSOLE=y
CONFIG_SOUND=y
CONFIG_SND=y
CONFIG_SND_SEQUENCER=y
CONFIG_SND_OSSEMUL=y
CONFIG_SND_MIXER_OSS=y
CONFIG_SND_PCM_OSS=y
CONFIG_SND_SEQUENCER_OSS=y
CONFIG_SND_CS46XX=y
CONFIG_SND_CS46XX_NEW_DSP=y
CONFIG_EXT2_FS=y
CONFIG_EXT3_FS=y
CONFIG_EXT3_FS_XATTR=y
CONFIG_JBD=y
CONFIG_FS_MBCACHE=y
CONFIG_ISO9660_FS=y
CONFIG_JOLIET=y
CONFIG_UDF_FS=y
CONFIG_FAT_FS=y
CONFIG_MSDOS_FS=y
CONFIG_VFAT_FS=y
CONFIG_PROC_FS=y
CONFIG_PROC_KCORE=y
CONFIG_DEVPTS_FS=y
CONFIG_TMPFS=y
CONFIG_RAMFS=y
CONFIG_SMB_FS=y
CONFIG_MSDOS_PARTITION=y
CONFIG_SMB_NLS=y
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="iso8859-1"
CONFIG_NLS_CODEPAGE_437=y
CONFIG_NLS_ISO8859_1=y
CONFIG_X86_EXTRA_IRQS=y
CONFIG_X86_FIND_SMP_CONFIG=y
CONFIG_X86_MPPARSE=y
CONFIG_ZLIB_INFLATE=y
CONFIG_ZLIB_DEFLATE=y
CONFIG_X86_SMP=y
CONFIG_X86_HT=y
CONFIG_X86_BIOS_REBOOT=y
CONFIG_X86_TRAMPOLINE=y
CONFIG_PC=y
^ permalink raw reply [flat|nested] 29+ messages in thread* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 2:32 SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? Colin Coe @ 2003-12-06 2:42 ` William Lee Irwin III 2003-12-06 2:48 ` William Lee Irwin III ` (2 more replies) 0 siblings, 3 replies; 29+ messages in thread From: William Lee Irwin III @ 2003-12-06 2:42 UTC (permalink / raw) To: Colin Coe; +Cc: linux-kernel On Sat, Dec 06, 2003 at 10:32:45AM +0800, Colin Coe wrote: > This indicates to me that the processing load is being evenly distributed > accross the two processes. Under v2.6.0-testxx however, 'cat > /proc/interrupts' shows this: > [root@host root]# cat /proc/interrupts > CPU0 CPU1 > 0: 633122 30 IO-APIC-edge timer > 1: 207 IO-APIC-edge i8042 > 2: XT-PIC cascade > 4: 48 1 IO-APIC-edge serial > 5: 449 1 IO-APIC-level eth1 > 10: 135 1 IO-APIC-level aic7xxx > 11: 1447 1 IO-APIC-level eth0 > 12: 61 IO-APIC-edge i8042 > 14: IO-APIC-level CS46XX > 15: 14982 1 IO-APIC-level megaraid 2.6 does balancing across packages, not logical cpus, so this will happen and it will be largely harmless, except for what appears to be some kind of bug where it's stealing the timer from logical cpu 1. -- wli ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 2:42 ` William Lee Irwin III @ 2003-12-06 2:48 ` William Lee Irwin III 2003-12-06 2:48 ` Nick Piggin 2003-12-06 14:40 ` IRQ balancing Sean Neakums 2 siblings, 0 replies; 29+ messages in thread From: William Lee Irwin III @ 2003-12-06 2:48 UTC (permalink / raw) To: Colin Coe, linux-kernel On Sat, Dec 06, 2003 at 10:32:45AM +0800, Colin Coe wrote: >> CPU0 CPU1 >> 0: 633122 30 IO-APIC-edge timer >> 1: 207 IO-APIC-edge i8042 >> 2: XT-PIC cascade >> 4: 48 1 IO-APIC-edge serial >> 5: 449 1 IO-APIC-level eth1 >> 10: 135 1 IO-APIC-level aic7xxx >> 11: 1447 1 IO-APIC-level eth0 >> 12: 61 IO-APIC-edge i8042 >> 14: IO-APIC-level CS46XX >> 15: 14982 1 IO-APIC-level megaraid On Fri, Dec 05, 2003 at 06:42:51PM -0800, William Lee Irwin III wrote: > 2.6 does balancing across packages, not logical cpus, so this will > happen and it will be largely harmless, except for what appears to > be some kind of bug where it's stealing the timer from logical cpu 1. Replied-to text trimming bogon, apparently. They're "LOC:" for local APIC timer interrupts. What's reported for irq 0 above is odd though. -- wli ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 2:42 ` William Lee Irwin III 2003-12-06 2:48 ` William Lee Irwin III @ 2003-12-06 2:48 ` Nick Piggin 2003-12-06 3:07 ` William Lee Irwin III 2003-12-06 14:40 ` IRQ balancing Sean Neakums 2 siblings, 1 reply; 29+ messages in thread From: Nick Piggin @ 2003-12-06 2:48 UTC (permalink / raw) To: William Lee Irwin III; +Cc: Colin Coe, linux-kernel William Lee Irwin III wrote: >On Sat, Dec 06, 2003 at 10:32:45AM +0800, Colin Coe wrote: > >>This indicates to me that the processing load is being evenly distributed >>accross the two processes. Under v2.6.0-testxx however, 'cat >>/proc/interrupts' shows this: >>[root@host root]# cat /proc/interrupts >> CPU0 CPU1 >> 0: 633122 30 IO-APIC-edge timer >> 1: 207 IO-APIC-edge i8042 >> 2: XT-PIC cascade >> 4: 48 1 IO-APIC-edge serial >> 5: 449 1 IO-APIC-level eth1 >> 10: 135 1 IO-APIC-level aic7xxx >> 11: 1447 1 IO-APIC-level eth0 >> 12: 61 IO-APIC-edge i8042 >> 14: IO-APIC-level CS46XX >> 15: 14982 1 IO-APIC-level megaraid >> > >2.6 does balancing across packages, not logical cpus, so this will >happen and it will be largely harmless, except for what appears to >be some kind of bug where it's stealing the timer from logical cpu 1. > > Although in this case Colin has 2 PPro 200s. Colin - process load should be evenly distributed between CPUs, and this is generally the most important thing. Big networking loads (most commonly) can put a lot of time into processing interrupts though. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 2:48 ` Nick Piggin @ 2003-12-06 3:07 ` William Lee Irwin III 2003-12-06 4:28 ` Stian Jordet 2003-12-06 7:02 ` Colin Coe 0 siblings, 2 replies; 29+ messages in thread From: William Lee Irwin III @ 2003-12-06 3:07 UTC (permalink / raw) To: Nick Piggin; +Cc: Colin Coe, linux-kernel On Sat, Dec 06, 2003 at 01:48:54PM +1100, Nick Piggin wrote: > Although in this case Colin has 2 PPro 200s. > Colin - process load should be evenly distributed between CPUs, and this > is generally the most important thing. Big networking loads (most commonly) > can put a lot of time into processing interrupts though. That is rather busted, then. Colin, could you try booting with noirqbalance on the kernel command line? -- wli ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 3:07 ` William Lee Irwin III @ 2003-12-06 4:28 ` Stian Jordet 2003-12-06 4:37 ` William Lee Irwin III 2003-12-06 7:02 ` Colin Coe 1 sibling, 1 reply; 29+ messages in thread From: Stian Jordet @ 2003-12-06 4:28 UTC (permalink / raw) To: William Lee Irwin III; +Cc: Nick Piggin, Colin Coe, linux-kernel lør, 06.12.2003 kl. 04.07 skrev William Lee Irwin III: > On Sat, Dec 06, 2003 at 01:48:54PM +1100, Nick Piggin wrote: > > Although in this case Colin has 2 PPro 200s. > > Colin - process load should be evenly distributed between CPUs, and this > > is generally the most important thing. Big networking loads (most commonly) > > can put a lot of time into processing interrupts though. > > That is rather busted, then. Uhm.. I was under the impression that this was expected behaviour? If not, I guess I'm having problems too? CPU0 CPU1 0: 91068534 45 IO-APIC-edge timer 1: 65293 1 IO-APIC-edge i8042 2: 0 0 XT-PIC cascade 3: 71 1 IO-APIC-edge serial 8: 325118 1 IO-APIC-edge rtc 9: 0 0 IO-APIC-level acpi 14: 245619 1 IO-APIC-edge ide0 15: 21 2 IO-APIC-edge ide1 17: 444526 0 IO-APIC-level aic7xxx, EMU10K1 18: 1112 0 IO-APIC-level aic7xxx, yenta 19: 6427306 1 IO-APIC-level saa7134[0], yenta, eth0, ide2 21: 34725 9049384 IO-APIC-level uhci_hcd, uhci_hcd, uhci_hcd NMI: 0 0 LOC: 91065099 91064973 ERR: 0 MIS: 2 This is with an uptime of almost 26 hours. Dual P3. USB uses lots of interrupts from both cpu's, but I'm running both the aic7xxx and eth0 quite hard at times... Best regards, Stian ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 4:28 ` Stian Jordet @ 2003-12-06 4:37 ` William Lee Irwin III 2003-12-06 4:48 ` Stian Jordet 2003-12-06 14:07 ` Adam Kropelin 0 siblings, 2 replies; 29+ messages in thread From: William Lee Irwin III @ 2003-12-06 4:37 UTC (permalink / raw) To: Stian Jordet; +Cc: Nick Piggin, Colin Coe, linux-kernel On Sat, Dec 06, 2003 at 05:28:38AM +0100, Stian Jordet wrote: > Uhm.. I was under the impression that this was expected behaviour? If > not, I guess I'm having problems too? > CPU0 CPU1 > 0: 91068534 45 IO-APIC-edge timer > 1: 65293 1 IO-APIC-edge i8042 > 2: 0 0 XT-PIC cascade > 3: 71 1 IO-APIC-edge serial > 8: 325118 1 IO-APIC-edge rtc > 9: 0 0 IO-APIC-level acpi > 14: 245619 1 IO-APIC-edge ide0 Yeah, it looks like it hit you too. Could you boot with noirqbalance on the kernel commandline and see if the problem goes away? -- wli ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 4:37 ` William Lee Irwin III @ 2003-12-06 4:48 ` Stian Jordet 2003-12-06 4:54 ` William Lee Irwin III 2003-12-06 14:07 ` Adam Kropelin 1 sibling, 1 reply; 29+ messages in thread From: Stian Jordet @ 2003-12-06 4:48 UTC (permalink / raw) To: William Lee Irwin III; +Cc: Nick Piggin, Colin Coe, linux-kernel lør, 06.12.2003 kl. 05.37 skrev William Lee Irwin III: > Yeah, it looks like it hit you too. > > Could you boot with noirqbalance on the kernel commandline and see if > the problem goes away? Wow, that actually fixed it :) CPU0 CPU1 0: 65636 63667 IO-APIC-edge timer 1: 150 136 IO-APIC-edge i8042 2: 0 0 XT-PIC cascade 3: 2 1 IO-APIC-edge serial 8: 3 1 IO-APIC-edge rtc 9: 0 0 IO-APIC-level acpi 14: 18 37 IO-APIC-edge ide0 15: 16 7 IO-APIC-edge ide1 17: 4830 4846 IO-APIC-level aic7xxx, EMU10K1 18: 218 210 IO-APIC-level aic7xxx, yenta 19: 3307 4259 IO-APIC-level saa7134[0], yenta, eth0, ide2 21: 41562 40666 IO-APIC-level uhci_hcd, uhci_hcd, uhci_hcd NMI: 0 0 LOC: 129121 129273 ERR: 0 MIS: 0 This is after about one minute uptime. Thanks :) Best regards, Stian ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 4:48 ` Stian Jordet @ 2003-12-06 4:54 ` William Lee Irwin III 2003-12-06 4:57 ` Stian Jordet ` (2 more replies) 0 siblings, 3 replies; 29+ messages in thread From: William Lee Irwin III @ 2003-12-06 4:54 UTC (permalink / raw) To: Stian Jordet; +Cc: Nick Piggin, Colin Coe, linux-kernel l?r, 06.12.2003 kl. 05.37 skrev William Lee Irwin III: >> Yeah, it looks like it hit you too. >> Could you boot with noirqbalance on the kernel commandline and see if >> the problem goes away? On Sat, Dec 06, 2003 at 05:48:46AM +0100, Stian Jordet wrote: > Wow, that actually fixed it :) > CPU0 CPU1 > 0: 65636 63667 IO-APIC-edge timer > 1: 150 136 IO-APIC-edge i8042 > 2: 0 0 XT-PIC cascade > 3: 2 1 IO-APIC-edge serial > 8: 3 1 IO-APIC-edge rtc > 9: 0 0 IO-APIC-level acpi > 14: 18 37 IO-APIC-edge ide0 Okay, irqbalance has gaffed (as predicted). Could you send in /proc/cpuinfo and /var/log/dmesg? -- wli ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 4:54 ` William Lee Irwin III @ 2003-12-06 4:57 ` Stian Jordet 2003-12-06 5:09 ` William Lee Irwin III 2003-12-06 7:11 ` Colin Coe 2003-12-08 15:45 ` bill davidsen 2 siblings, 1 reply; 29+ messages in thread From: Stian Jordet @ 2003-12-06 4:57 UTC (permalink / raw) To: William Lee Irwin III; +Cc: Nick Piggin, Colin Coe, linux-kernel [-- Attachment #1: Type: text/plain, Size: 224 bytes --] lør, 06.12.2003 kl. 05.54 skrev William Lee Irwin III: > Okay, irqbalance has gaffed (as predicted). Could you send in > /proc/cpuinfo and /var/log/dmesg? Here they are. Thanks for looking into this :) Best regards, Stian [-- Attachment #2: cpuinfo.txt --] [-- Type: text/plain, Size: 768 bytes --] processor : 0 vendor_id : GenuineIntel cpu family : 6 model : 8 model name : Pentium III (Coppermine) stepping : 10 cpu MHz : 1000.416 cache size : 256 KB fdiv_bug : no hlt_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes cpuid level : 2 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 mmx fxsr sse bogomips : 1957.88 processor : 1 vendor_id : GenuineIntel cpu family : 6 model : 8 model name : Pentium III (Coppermine) stepping : 10 cpu MHz : 1000.416 cache size : 256 KB fdiv_bug : no hlt_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes cpuid level : 2 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 mmx fxsr sse bogomips : 1994.75 [-- Attachment #3: dmesg.txt --] [-- Type: text/plain, Size: 20791 bytes --] Linux version 2.6.0-test11 (root@chevrolet) (gcc version 3.3.2 (Debian)) #3 SMP Thu Dec 4 16:51:17 CET 2003 BIOS-provided physical RAM map: BIOS-e820: 0000000000000000 - 000000000009f800 (usable) BIOS-e820: 000000000009f800 - 00000000000a0000 (reserved) BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved) BIOS-e820: 0000000000100000 - 000000001fffc000 (usable) BIOS-e820: 000000001fffc000 - 000000001ffff000 (ACPI data) BIOS-e820: 000000001ffff000 - 0000000020000000 (ACPI NVS) BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved) BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved) BIOS-e820: 00000000ffff0000 - 0000000100000000 (reserved) 511MB LOWMEM available. found SMP MP-table at 000f5500 hm, page 000f5000 reserved twice. hm, page 000f6000 reserved twice. hm, page 000f5000 reserved twice. hm, page 000f6000 reserved twice. On node 0 totalpages: 131068 DMA zone: 4096 pages, LIFO batch:1 Normal zone: 126972 pages, LIFO batch:16 HighMem zone: 0 pages, LIFO batch:1 DMI 2.3 present. ACPI: RSDP (v000 ASUS ) @ 0x000f6930 ACPI: RSDT (v001 ASUS CV266DLS 0x30303031 MSFT 0x31313031) @ 0x1fffc000 ACPI: FADT (v001 ASUS CV266DLS 0x30303031 MSFT 0x31313031) @ 0x1fffc100 ACPI: BOOT (v001 ASUS CV266DLS 0x30303031 MSFT 0x31313031) @ 0x1fffc040 ACPI: MADT (v001 ASUS CV266DLS 0x30303031 MSFT 0x31313031) @ 0x1fffc080 ACPI: DSDT (v001 ASUS CV266DLS 0x00001000 MSFT 0x0100000b) @ 0x00000000 ACPI: Local APIC address 0xfee00000 ACPI: LAPIC (acpi_id[0x00] lapic_id[0x03] enabled) Processor #3 6:8 APIC version 17 ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled) Processor #0 6:8 APIC version 17 ACPI: IOAPIC (id[0x02] address[0xfec00000] global_irq_base[0x0]) IOAPIC[0]: Assigned apic_id 2 IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, IRQ 0-23 ACPI: INT_SRC_OVR (bus[0] irq[0x0] global_irq[0x2] polarity[0x0] trigger[0x1]) ACPI: INT_SRC_OVR (bus[0] irq[0x9] global_irq[0x9] polarity[0x3] trigger[0x3]) Enabling APIC mode: Flat. Using 1 I/O APICs Using ACPI (MADT) for SMP configuration information Building zonelist for node : 0 Kernel command line: root=/dev/sda2 ro idebus=33 vga=0 noirqbalance ide_setup: idebus=33 Initializing CPU#0 PID hash table entries: 2048 (order 11: 16384 bytes) Detected 1000.416 MHz processor. Console: colour VGA+ 80x25 Memory: 512816k/524272k available (3543k kernel code, 10660k reserved, 1185k data, 208k init, 0k highmem) Calibrating delay loop... 1957.88 BogoMIPS Dentry cache hash table entries: 65536 (order: 6, 262144 bytes) Inode-cache hash table entries: 32768 (order: 5, 131072 bytes) Mount-cache hash table entries: 512 (order: 0, 4096 bytes) CPU: After generic identify, caps: 0383fbff 00000000 00000000 00000000 CPU: After vendor identify, caps: 0383fbff 00000000 00000000 00000000 CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 256K CPU: After all inits, caps: 0383fbff 00000000 00000000 00000040 Intel machine check architecture supported. Intel machine check reporting enabled on CPU#0. Enabling fast FPU save and restore... done. Enabling unmasked SIMD FPU exception support... done. Checking 'hlt' instruction... OK. POSIX conformance testing by UNIFIX CPU0: Intel Pentium III (Coppermine) stepping 0a per-CPU timeslice cutoff: 731.00 usecs. task migration cache decay timeout: 1 msecs. enabled ExtINT on CPU#0 ESR value before enabling vector: 00000000 ESR value after enabling vector: 00000000 Booting processor 1/0 eip 3000 Initializing CPU#1 masked ExtINT on CPU#1 ESR value before enabling vector: 00000000 ESR value after enabling vector: 00000000 Calibrating delay loop... 1994.75 BogoMIPS CPU: After generic identify, caps: 0383fbff 00000000 00000000 00000000 CPU: After vendor identify, caps: 0383fbff 00000000 00000000 00000000 CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 256K CPU: After all inits, caps: 0383fbff 00000000 00000000 00000040 Intel machine check architecture supported. Intel machine check reporting enabled on CPU#1. CPU1: Intel Pentium III (Coppermine) stepping 0a Total of 2 processors activated (3952.64 BogoMIPS). ENABLING IO-APIC IRQs init IO_APIC IRQs IO-APIC (apicid-pin) 2-0, 2-16, 2-17, 2-18, 2-19, 2-20, 2-21, 2-22, 2-23 not connected. ..TIMER: vector=0x31 pin1=2 pin2=-1 number of MP IRQ sources: 15. number of IO-APIC #2 registers: 24. testing the IO APIC....................... IO APIC #2...... .... register #00: 02000000 ....... : physical APIC id: 02 ....... : Delivery Type: 0 ....... : LTS : 0 .... register #01: 00178011 ....... : max redirection entries: 0017 ....... : PRQ implemented: 1 ....... : IO APIC version: 0011 .... register #02: 00000000 ....... : arbitration: 00 .... IRQ redirection table: NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect: 00 000 00 1 0 0 0 0 0 0 00 01 001 01 0 0 0 0 0 1 1 39 02 001 01 0 0 0 0 0 1 1 31 03 001 01 0 0 0 0 0 1 1 41 04 001 01 0 0 0 0 0 1 1 49 05 001 01 0 0 0 0 0 1 1 51 06 001 01 0 0 0 0 0 1 1 59 07 001 01 0 0 0 0 0 1 1 61 08 001 01 0 0 0 0 0 1 1 69 09 001 01 1 1 0 1 0 1 1 71 0a 001 01 0 0 0 0 0 1 1 79 0b 001 01 0 0 0 0 0 1 1 81 0c 001 01 0 0 0 0 0 1 1 89 0d 001 01 0 0 0 0 0 1 1 91 0e 001 01 0 0 0 0 0 1 1 99 0f 001 01 0 0 0 0 0 1 1 A1 10 000 00 1 0 0 0 0 0 0 00 11 000 00 1 0 0 0 0 0 0 00 12 000 00 1 0 0 0 0 0 0 00 13 000 00 1 0 0 0 0 0 0 00 14 000 00 1 0 0 0 0 0 0 00 15 000 00 1 0 0 0 0 0 0 00 16 000 00 1 0 0 0 0 0 0 00 17 000 00 1 0 0 0 0 0 0 00 IRQ to pin mappings: IRQ0 -> 0:2 IRQ1 -> 0:1 IRQ3 -> 0:3 IRQ4 -> 0:4 IRQ5 -> 0:5 IRQ6 -> 0:6 IRQ7 -> 0:7 IRQ8 -> 0:8 IRQ9 -> 0:9 IRQ10 -> 0:10 IRQ11 -> 0:11 IRQ12 -> 0:12 IRQ13 -> 0:13 IRQ14 -> 0:14 IRQ15 -> 0:15 .................................... done. Using local APIC timer interrupts. calibrating APIC timer ... ..... CPU clock speed is 999.0518 MHz. ..... host bus clock speed is 133.0269 MHz. checking TSC synchronization across 2 CPUs: passed. Starting migration thread for cpu 0 Bringing up 1 CPU 1 IS NOW UP! Starting migration thread for cpu 1 CPUS done 2 NET: Registered protocol family 16 PCI: PCI BIOS revision 2.10 entry at 0xf0d40, last bus=1 PCI: Using configuration type 1 mtrr: v2.0 (20020519) ACPI: Subsystem revision 20031002 IOAPIC[0]: Set PCI routing entry (2-9 -> 0x71 -> IRQ 9 Mode:1 Active:1) ACPI-0109: *** Error: No object was returned from [\_SB_.PCI0.PX40.IRDA._STA] (Node dff3f860), AE_NOT_EXIST ACPI: Interpreter enabled ACPI: Using IOAPIC for interrupt routing ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 *11 12 14 15) ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 *10 11 12 14 15) ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 9 10 11 *12 14 15) ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 *5 6 7 9 10 11 12 14 15) ACPI: PCI Root Bridge [PCI0] (00:00) PCI: Probing PCI hardware (bus 00) ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCI1._PRT] Linux Plug and Play Support v0.97 (c) Adam Belay PnPBIOS: Scanning system for PnP BIOS support... PnPBIOS: Found PnP BIOS installation structure at 0xc00fbd80 PnPBIOS: PnP BIOS version 1.0, entry 0xf0000:0xbdb0, dseg 0xf0000 pnp: 00:11: ioport range 0xe400-0xe47f has been reserved pnp: 00:11: ioport range 0xe800-0xe83f has been reserved PnPBIOS: 14 nodes reported by PnP BIOS; 14 recorded by driver SCSI subsystem initialized Linux Kernel Card Services options: [pci] [cardbus] [pm] drivers/usb/core/usb.c: registered new driver usbfs drivers/usb/core/usb.c: registered new driver hub IOAPIC[0]: Set PCI routing entry (2-17 -> 0xa9 -> IRQ 17 Mode:1 Active:1) 00:00:07[A] -> 2-17 -> IRQ 17 IOAPIC[0]: Set PCI routing entry (2-18 -> 0xb1 -> IRQ 18 Mode:1 Active:1) 00:00:07[B] -> 2-18 -> IRQ 18 IOAPIC[0]: Set PCI routing entry (2-19 -> 0xb9 -> IRQ 19 Mode:1 Active:1) 00:00:05[A] -> 2-19 -> IRQ 19 Pin 2-19 already programmed IOAPIC[0]: Set PCI routing entry (2-16 -> 0xc1 -> IRQ 16 Mode:1 Active:1) 00:00:0c[B] -> 2-16 -> IRQ 16 Pin 2-17 already programmed Pin 2-18 already programmed Pin 2-16 already programmed Pin 2-17 already programmed Pin 2-18 already programmed Pin 2-19 already programmed Pin 2-17 already programmed Pin 2-18 already programmed Pin 2-19 already programmed Pin 2-16 already programmed Pin 2-18 already programmed Pin 2-19 already programmed Pin 2-16 already programmed Pin 2-17 already programmed Pin 2-19 already programmed Pin 2-16 already programmed Pin 2-17 already programmed Pin 2-18 already programmed ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 11 IOAPIC[0]: Set PCI routing entry (2-11 -> 0xc9 -> IRQ 27 Mode:1 Active:1) 00:00:11[A] -> 2-11 -> IRQ 27 ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10 IOAPIC[0]: Set PCI routing entry (2-10 -> 0xd1 -> IRQ 26 Mode:1 Active:1) 00:00:11[B] -> 2-10 -> IRQ 26 ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 12 IOAPIC[0]: Set PCI routing entry (2-12 -> 0xd9 -> IRQ 28 Mode:1 Active:1) 00:00:11[C] -> 2-12 -> IRQ 28 ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 5 IOAPIC[0]: Set PCI routing entry (2-5 -> 0xe1 -> IRQ 21 Mode:1 Active:1) 00:00:11[D] -> 2-5 -> IRQ 21 Pin 2-16 already programmed Pin 2-17 already programmed PCI: Using ACPI for IRQ routing PCI: if you experience problems, try using option 'pci=noacpi' or even 'acpi=off' irda_init() NET: Registered protocol family 23 Bluetooth: Core ver 2.3 NET: Registered protocol family 31 Bluetooth: HCI device and connection manager initialized Bluetooth: HCI socket layer initialized radeonfb_pci_register BEGIN radeonfb: ref_clk=2700, ref_div=12, xclk=27000 defaults radeonfb: probed SDR SGRAM 131072k videoram radeon_get_moninfo: bios 4 scratch = 22000202 radeonfb: ATI Radeon 9700 ND SDR SGRAM 128 MB radeonfb: DVI port CRT monitor connected radeonfb: CRT port CRT monitor connected radeonfb_pci_register END SBF: Simple Boot Flag extension found and enabled. SBF: Setting boot flags 0x1 IA-32 Microcode Update Driver: v1.13 <tigran@veritas.com> ikconfig 0.7 with /proc/config* VFS: Disk quotas dquot_6.5.1 NTFS driver 2.1.5 [Flags: R/O]. udf: registering filesystem SGI XFS for Linux with ACLs, no debug enabled SGI XFS Quota Management subsystem ACPI: Power Button (FF) [PWRF] ACPI: Processor [CPU] (supports C1) ACPI: Processor [CPU1] (supports C1) pty: 256 Unix98 ptys configured Real Time Clock Driver v1.12 Non-volatile memory driver v1.2 Serial: 8250/16550 driver $Revision: 1.90 $ 8 ports, IRQ sharing disabled ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A parport0: PC-style at 0x378 (0x778) [PCSPP,TRISTATE] parport0: irq 7 detected parport0: cpp_daisy: aa5500ff(38) parport0: assign_addrs: aa5500ff(38) parport0: cpp_daisy: aa5500ff(38) parport0: assign_addrs: aa5500ff(38) Using anticipatory io scheduler Floppy drive(s): fd0 is 1.44M FDC 0 is a post-1991 82077 loop: loaded (max 8 devices) Intel(R) PRO/100 Network Driver - version 2.3.30-k1 Copyright (c) 2003 Intel Corporation e100: selftest OK. e100: eth0: Intel(R) PRO/100 Network Connection Hardware receive checksums enabled cpu cycle saver enabled PPP generic driver version 2.4.2 PPP Deflate Compression module registered PPP BSD Compression module registered Linux video capture interface: v1.00 saa7130/34: v4l2 driver version 0.2.9 loaded saa7134[0]: found at 0000:00:0c.0, rev: 1, irq: 19, latency: 32, mmio: 0xdc000000 saa7134[0]: subsystem: 153b:1143, board: Terratec Cinergy 600 TV [card=11,autodetected] saa7134[0]: board init: gpio is 50000 saa7134[0]: registered input device for IR saa7134[0]: i2c eeprom 00: 3b 15 43 11 ff ff ff ff ff ff ff ff ff ff ff ff saa7134[0]: i2c eeprom 10: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff saa7134[0]: i2c eeprom 20: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff saa7134[0]: i2c eeprom 30: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff request_module: failed /sbin/modprobe -- tuner. error = -16 saa7134[0]: registered device video0 [v4l2] saa7134[0]: registered device vbi0 saa7134[0]: registered device radio0 tuner: chip found @ 0xc0 tuner: type set to 5 (Philips PAL_BG (FI1216 and compatibles)) registering 0-0060 Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2 ide: Assuming 33MHz system bus speed for PIO modes VP_IDE: IDE controller at PCI slot 0000:00:11.1 VP_IDE: chipset revision 6 VP_IDE: not 100% native mode: will probe irqs later VP_IDE: VIA vt8233 (rev 00) IDE UDMA100 controller on pci0000:00:11.1 ide0: BM-DMA at 0xa000-0xa007, BIOS settings: hda:DMA, hdb:DMA ide1: BM-DMA at 0xa008-0xa00f, BIOS settings: hdc:pio, hdd:DMA hda: WDC WD1200JB-00CRA1, ATA DISK drive hdb: WDC WD1200JB-75CRA0, ATA DISK drive ide0 at 0x1f0-0x1f7,0x3f6 on irq 14 saa7134[0]/audio: audio carrier scan failed, using 5.500 MHz [default] hdd: IOMEGA ZIP 100 ATAPI Floppy, ATAPI FLOPPY drive ide1 at 0x170-0x177,0x376 on irq 15 hda: max request size: 128KiB hda: 234441648 sectors (120034 MB) w/8192KiB Cache, CHS=65535/16/63, UDMA(100) hda: hda1 hdb: max request size: 128KiB hdb: Host Protected Area detected. current capacity is 234375000 sectors (120000 MB) native capacity is 234441648 sectors (120034 MB) hdb: 234375000 sectors (120000 MB) w/8192KiB Cache, CHS=65535/16/63, UDMA(100) hdb: hdb1 ide-floppy driver 0.99.newide hdd: 98288kB, 196576 blocks, 512 sector size hdd: 98304kB, 96/64/32 CHS, 4096 kBps, 512 sector size, 2941 rpm hdd: hdd1 hdd2 hdd3 hdd4 scsi0 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.35 <Adaptec aic7899 Ultra160 SCSI adapter> aic7899: Ultra160 Wide Channel A, SCSI Id=7, 32/253 SCBs (scsi0:A:0): 160.000MB/s transfers (80.000MHz DT, offset 63, 16bit) Vendor: SEAGATE Model: ST318452LW Rev: 0004 Type: Direct-Access ANSI SCSI revision: 03 scsi0:A:0:0: Tagged Queuing enabled. Depth 253 scsi1 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.35 <Adaptec aic7899 Ultra160 SCSI adapter> aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/253 SCBs (scsi1:A:4): 20.000MB/s transfers (20.000MHz, offset 16) (scsi1:A:5): 20.000MB/s transfers (20.000MHz, offset 15) (scsi1:A:6): 7.812MB/s transfers (7.812MHz, offset 15) Vendor: PIONEER Model: DVD-ROM DVD-304F Rev: 1.03 Type: CD-ROM ANSI SCSI revision: 02 Vendor: YAMAHA Model: CRW-F1S Rev: 1.0g Type: CD-ROM ANSI SCSI revision: 02 Vendor: SEAGATE Model: DAT 04687-XXX Rev: 6610 Type: Sequential-Access ANSI SCSI revision: 02 st: Version 20030811, fixed bufsize 32768, s/g segs 256 Attached scsi tape st0 at scsi1, channel 0, id 6, lun 0 st0: try direct i/o: yes, max page reachable by HBA 1048575 SCSI device sda: 35843670 512-byte hdwr sectors (18352 MB) SCSI device sda: drive cache: write back sda: sda1 sda2 sda3 sda4 Attached scsi disk sda at scsi0, channel 0, id 0, lun 0 sr0: scsi3-mmc drive: 0x/0x cd/rw xa/form2 cdda tray Uniform CD-ROM driver Revision: 3.12 Attached scsi CD-ROM sr0 at scsi1, channel 0, id 4, lun 0 sr1: scsi3-mmc drive: 44x/44x writer cd/rw xa/form2 cdda tray Attached scsi CD-ROM sr1 at scsi1, channel 0, id 5, lun 0 Attached scsi generic sg0 at scsi0, channel 0, id 0, lun 0, type 0 Attached scsi generic sg1 at scsi1, channel 0, id 4, lun 0, type 5 Attached scsi generic sg2 at scsi1, channel 0, id 5, lun 0, type 5 Attached scsi generic sg3 at scsi1, channel 0, id 6, lun 0, type 1 PCI: Enabling device 0000:00:0f.0 (0000 -> 0002) Yenta: CardBus bridge found at 0000:00:0f.0 [14ef:0220] Yenta: ISA IRQ list 0000, PCI irq18 Socket status: 30000006 PCI: Enabling device 0000:00:0f.1 (0000 -> 0002) Yenta: CardBus bridge found at 0000:00:0f.1 [14ef:0220] Yenta: ISA IRQ list 0000, PCI irq19 Socket status: 30000810 drivers/usb/host/uhci-hcd.c: USB Universal Host Controller Interface driver v2.1 uhci_hcd 0000:00:11.2: UHCI Host Controller uhci_hcd 0000:00:11.2: irq 21, io base 00009800 uhci_hcd 0000:00:11.2: new USB bus registered, assigned bus number 1 hub 1-0:1.0: USB hub found hub 1-0:1.0: 2 ports detected uhci_hcd 0000:00:11.3: UHCI Host Controller uhci_hcd 0000:00:11.3: irq 21, io base 00009400 uhci_hcd 0000:00:11.3: new USB bus registered, assigned bus number 2 hub 2-0:1.0: USB hub found hub 2-0:1.0: 2 ports detected uhci_hcd 0000:00:11.4: UHCI Host Controller uhci_hcd 0000:00:11.4: irq 21, io base 00009000 uhci_hcd 0000:00:11.4: new USB bus registered, assigned bus number 3 hub 3-0:1.0: USB hub found hub 3-0:1.0: 2 ports detected drivers/usb/core/usb.c: registered new driver usblp drivers/usb/class/usblp.c: v0.13: USB Printer Device Class driver Initializing USB Mass Storage driver... drivers/usb/core/usb.c: registered new driver usb-storage USB Mass Storage support registered. drivers/usb/core/usb.c: registered new driver hiddev drivers/usb/core/usb.c: registered new driver hid drivers/usb/input/hid-core.c: v2.0:USB HID core driver drivers/usb/core/usb.c: registered new driver usbscanner drivers/usb/image/scanner.c: 0.4.15:USB Scanner Driver mice: PS/2 mouse device common for all mice input: PC Speaker gameport: pci0000:00:0e.1 speed 1704 kHz serio: i8042 AUX port at 0x60,0x64 irq 12 input: AT Translated Set 2 keyboard on isa0060/serio0 serio: i8042 KBD port at 0x60,0x64 irq 1 registering 1-002d registering 1-0049 registering 1-0048 NET: Registered protocol family 2 IP: routing cache hash table of 4096 buckets, 32Kbytes TCP: Hash tables configured (established 32768 bind 32768) ip_conntrack version 2.1 (4095 buckets, 32760 max) - 304 bytes per conntrack ip_tables: (C) 2000-2002 Netfilter core team hub 3-0:1.0: new USB device on port 2, assigned address 2 drivers/usb/class/usblp.c: usblp0: USB Bidirectional printer dev 2 if 0 alt 0 proto 2 vid 0x03F0 pid 0x3304 ipt_recent v0.3.1: Stephen Frost <sfrost@snowman.net>. http://snowman.net/projects/ipt_recent/ arp_tables: (C) 2002 David S. Miller NET: Registered protocol family 1 NET: Registered protocol family 17 IrCOMM protocol (Dag Brattli) Bluetooth: L2CAP ver 2.1 Bluetooth: L2CAP socket layer initialized Bluetooth: SCO (Voice Link) ver 0.3 Bluetooth: SCO socket layer initialized Bluetooth: RFCOMM ver 1.0 Bluetooth: RFCOMM socket layer initialized Bluetooth: RFCOMM TTY layer initialized Bluetooth: BNEP (Ethernet Emulation) ver 1.0 Bluetooth: BNEP filters: protocol multicast Software Suspend has malfunctioning SMP support. Disabled :( ACPI: (supports S0 S1 S4 S5) kjournald starting. Commit interval 5 seconds EXT3-fs: mounted filesystem with ordered data mode. VFS: Mounted root (ext3 filesystem) readonly. Freeing unused kernel memory: 208k freed hub 2-0:1.0: new USB device on port 1, assigned address 2 drivers/usb/image/scanner.c: USB scanner device (0x04b8/0x011d) now attached to usb/scanner0 hub 2-0:1.0: new USB device on port 2, assigned address 3 Adding 1052248k swap on /dev/sda4. Priority:-1 extents:1 EXT3 FS on sda2, internal journal hub 1-0:1.0: new USB device on port 1, assigned address 2 input: USB HID v1.10 Keyboard [Logitech USB Receiver] on usb-0000:00:11.2-1 input: USB HID v1.10 Mouse [Logitech USB Receiver] on usb-0000:00:11.2-1 hub 1-0:1.0: new USB device on port 2, assigned address 3 usb 1-2: USB disconnect, address 3 Bluetooth: HCI USB driver ver 2.4 drivers/usb/core/usb.c: registered new driver hci_usb Linux agpgart interface v0.100 (c) Dave Jones agpgart: Detected VIA Pro 266 chipset agpgart: Maximum main memory to use for agp memory: 439M agpgart: AGP aperture is 64M @ 0xf8000000 hub 1-0:1.0: new USB device on port 2, assigned address 4 XFS mounting filesystem sda3 Ending clean XFS mount for filesystem: sda3 kjournald starting. Commit interval 5 seconds EXT3-fs warning: maximal mount count reached, running e2fsck is recommended EXT3 FS on hda1, internal journal EXT3-fs: mounted filesystem with ordered data mode. kjournald starting. Commit interval 5 seconds EXT3-fs warning: maximal mount count reached, running e2fsck is recommended EXT3 FS on hdb1, internal journal EXT3-fs: mounted filesystem with ordered data mode. NTFS volume version 3.0. usb 1-2: device not accepting address 4, error -110 hub 1-0:1.0: new USB device on port 2, assigned address 5 hci_usb: probe of 1-2:1.1 failed with error -5 hci_usb: probe of 1-2:1.2 failed with error -5 e100: eth0 NIC Link is Up 100 Mbps Full duplex nfs warning: mount version older than kernel nfs warning: mount version older than kernel ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 4:57 ` Stian Jordet @ 2003-12-06 5:09 ` William Lee Irwin III 2003-12-06 5:14 ` Stian Jordet 0 siblings, 1 reply; 29+ messages in thread From: William Lee Irwin III @ 2003-12-06 5:09 UTC (permalink / raw) To: Stian Jordet; +Cc: Nick Piggin, Colin Coe, linux-kernel l?r, 06.12.2003 kl. 05.54 skrev William Lee Irwin III: >> Okay, irqbalance has gaffed (as predicted). Could you send in >> /proc/cpuinfo and /var/log/dmesg? On Sat, Dec 06, 2003 at 05:57:14AM +0100, Stian Jordet wrote: > Here they are. Thanks for looking into this :) This tells me you're not being mistaken for HT. It also suggests it's the policy not doing what you want it to. If your interrupt rate isn't high (according to what metric I have no idea; presumably it should depend on the expense of handling it, which is driver-dependent but about which the code has no knowledge), it won't rebalance the irq's. If you actually manage to get interrupt rates exceeding its thresholds, you should see interrupts migrated, but only dynamically and on-demand, not under light usage. There might still be something wrong with it, but we'd have to dig deeper. -- wli ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 5:09 ` William Lee Irwin III @ 2003-12-06 5:14 ` Stian Jordet 2003-12-06 5:40 ` William Lee Irwin III 0 siblings, 1 reply; 29+ messages in thread From: Stian Jordet @ 2003-12-06 5:14 UTC (permalink / raw) To: William Lee Irwin III; +Cc: Nick Piggin, Colin Coe, linux-kernel lør, 06.12.2003 kl. 06.09 skrev William Lee Irwin III: > l?r, 06.12.2003 kl. 05.54 skrev William Lee Irwin III: > >> Okay, irqbalance has gaffed (as predicted). Could you send in > >> /proc/cpuinfo and /var/log/dmesg? > > On Sat, Dec 06, 2003 at 05:57:14AM +0100, Stian Jordet wrote: > > Here they are. Thanks for looking into this :) > > This tells me you're not being mistaken for HT. > > It also suggests it's the policy not doing what you want it to. If your > interrupt rate isn't high (according to what metric I have no idea; > presumably it should depend on the expense of handling it, which is > driver-dependent but about which the code has no knowledge), it won't > rebalance the irq's. > > If you actually manage to get interrupt rates exceeding its thresholds, > you should see interrupts migrated, but only dynamically and on-demand, > not under light usage. I really don't know the definition of "light usage", but I'm beating the aic7xxx and eth0 quite hard at times, without any interrupts being migrated. Anyway, thanks :) This haven't been a problem for me so far, and I doubt it ever will :) Stian ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 5:14 ` Stian Jordet @ 2003-12-06 5:40 ` William Lee Irwin III 2003-12-08 15:57 ` bill davidsen 0 siblings, 1 reply; 29+ messages in thread From: William Lee Irwin III @ 2003-12-06 5:40 UTC (permalink / raw) To: Stian Jordet; +Cc: Nick Piggin, Colin Coe, linux-kernel l?r, 06.12.2003 kl. 06.09 skrev William Lee Irwin III: >> If you actually manage to get interrupt rates exceeding its thresholds, >> you should see interrupts migrated, but only dynamically and on-demand, >> not under light usage. On Sat, Dec 06, 2003 at 06:14:15AM +0100, Stian Jordet wrote: > I really don't know the definition of "light usage", but I'm beating the > aic7xxx and eth0 quite hard at times, without any interrupts being > migrated. Anyway, thanks :) This haven't been a problem for me so far, > and I doubt it ever will :) Okay, this should be fixed. The entire subarch organization is wrong for this anyway. It needs several axes to vary upon for the APIC-based subarches: (a) xAPIC (P-IV) vs. serial APIC (before P-IV) (b) logical vs. physical IPI's (c) logical vs. physical IO interrupts (d) flat logical vs. clustered hierarchical DFR (e) NMI wakeup vs. INIT wakeup (f) software vs. hardware interrupt load balancing (g) locality-dependent vs. locality-independent APIC destinations The real problem with all this is that it was arranged around minimal impact code changes instead of adequately describing hardware, and so it gives rise to numerous corner cases and is generally brittle. Of course, 2.6 is too frozen to do anything with it now, and ia32 will likely be largely legacy during the course of 2.7, so the damage will probably be permanent. What you've run into is essentially there being no distinction for (a) or (f) in mach-default, what normal Pee Cees use. There are several disturbing differences between the two cases which are for the moment carefully avoided but at the very least raise my eyebrows. For instance, both the physical broadcast destination and the size of the physical APIC ID space differ between the two cases. The difference you've been burned by is the fact that current revisions of xAPIC's have broken hardware interrupt load balancing, and so singleton fixed destinations are used with software interrupt balancing instead of lowest priority destinations with many cpus in them perfectly suitable for P-III's, which under your light usage pinned all interrupts on cpu 0. -- wli ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 5:40 ` William Lee Irwin III @ 2003-12-08 15:57 ` bill davidsen 2003-12-08 16:47 ` William Lee Irwin III 0 siblings, 1 reply; 29+ messages in thread From: bill davidsen @ 2003-12-08 15:57 UTC (permalink / raw) To: linux-kernel In article <20031206054031.GM8039@holomorphy.com>, William Lee Irwin III <wli@holomorphy.com> wrote: | The real problem with all this is that it was arranged around minimal | impact code changes instead of adequately describing hardware, and so | it gives rise to numerous corner cases and is generally brittle. Of | course, 2.6 is too frozen to do anything with it now, and ia32 will | likely be largely legacy during the course of 2.7, so the damage will | probably be permanent. I don't follow your thinking here, 2.6.0 is certainly frozen, but I see no reason this can't be fixed in 2.6 if someone cares to do so. The amount of code is small, and as long as the interrupt gets serviced by exactly one CPU I doubt the performance could get worse. I don't see ia32 going away, either, unless you see 2.7 in a more distant timeframe than I do. Looking at the power issue I predict significant ia32 in laptops, and due to cost issues in desktops and servers. Also, I suspect that Linux hackers have a much higher percentage of SMP ia32 machines than the general public, which encourages enhancements in that area. -- bill davidsen <davidsen@tmr.com> CTO, TMR Associates, Inc Doing interesting things with little computers since 1979. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-08 15:57 ` bill davidsen @ 2003-12-08 16:47 ` William Lee Irwin III 0 siblings, 0 replies; 29+ messages in thread From: William Lee Irwin III @ 2003-12-08 16:47 UTC (permalink / raw) To: bill davidsen; +Cc: linux-kernel On Mon, Dec 08, 2003 at 03:57:54PM +0000, bill davidsen wrote: > I don't follow your thinking here, 2.6.0 is certainly frozen, but I > see no reason this can't be fixed in 2.6 if someone cares to do so. The > amount of code is small, and as long as the interrupt gets serviced by > exactly one CPU I doubt the performance could get worse. > I don't see ia32 going away, either, unless you see 2.7 in a more > distant timeframe than I do. Looking at the power issue I predict > significant ia32 in laptops, and due to cost issues in desktops and > servers. Also, I suspect that Linux hackers have a much higher > percentage of SMP ia32 machines than the general public, which > encourages enhancements in that area. What I'm on about is that some interfaces internal to arch/i386/ for APIC management are ad hoc and the configuration boundaries and case analysis in the code don't match the configuration boundaries or cases of the hardware. The API has to change to accurately describe machines in order to accurately drive the machines. The worst offense for end users is probably the mismeasured physical APIC ID space on smaller (mach-default) xAPIC systems which should lose cpus with sufficiently sparse physical APIC ID's. The only current use of physical broadcast is for clustered hierarchical serial APIC RTE's. -- wli ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 4:54 ` William Lee Irwin III 2003-12-06 4:57 ` Stian Jordet @ 2003-12-06 7:11 ` Colin Coe 2003-12-08 15:45 ` bill davidsen 2 siblings, 0 replies; 29+ messages in thread From: Colin Coe @ 2003-12-06 7:11 UTC (permalink / raw) To: William Lee Irwin III; +Cc: Stian Jordet, Nick Piggin, Colin Coe, linux-kernel [-- Attachment #1: Type: text/plain, Size: 935 bytes --] /proc/cpuinfo and dmesg output is attached. Thanks! CC -- "Obnoxious frog..." Spike, 2071AD William Lee Irwin III said: > l?r, 06.12.2003 kl. 05.37 skrev William Lee Irwin III: >>> Yeah, it looks like it hit you too. >>> Could you boot with noirqbalance on the kernel commandline and see if >>> the problem goes away? > > On Sat, Dec 06, 2003 at 05:48:46AM +0100, Stian Jordet wrote: >> Wow, that actually fixed it :) >> CPU0 CPU1 >> 0: 65636 63667 IO-APIC-edge timer >> 1: 150 136 IO-APIC-edge i8042 >> 2: XT-PIC cascade >> 3: 2 1 IO-APIC-edge serial >> 8: 3 1 IO-APIC-edge rtc >> 9: IO-APIC-level acpi >> 14: 18 37 IO-APIC-edge ide0 > > Okay, irqbalance has gaffed (as predicted). Could you send in > /proc/cpuinfo and /var/log/dmesg? > > > -- wli > [-- Attachment #2: cpuinfo.txt --] [-- Type: text/plain, Size: 926 bytes --] processor : 0 vendor_id : GenuineIntel cpu family : 6 model : 1 model name : Pentium Pro stepping : 9 cpu MHz : 199.489 cache size : 512 KB fdiv_bug : no hlt_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes cpuid level : 2 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov bogomips : 390.14 processor : 1 vendor_id : GenuineIntel cpu family : 6 model : 1 model name : Pentium Pro stepping : 9 cpu MHz : 199.489 cache size : 512 KB fdiv_bug : no hlt_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes cpuid level : 2 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov bogomips : 397.31 [-- Attachment #3: dmesg.txt --] [-- Type: text/plain, Size: 11992 bytes --] Linux version 2.6.0-test11 (root@host.domain.com) (gcc version 3.2.2 20030222 (Red Hat Linux 3.2.2-5)) #3 SMP Sat Dec 6 09:49:19 WST 2003 BIOS-provided physical RAM map: BIOS-e820: 0000000000000000 - 000000000009fc00 (usable) BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved) BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved) BIOS-e820: 0000000000100000 - 0000000028000000 (usable) BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved) BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved) BIOS-e820: 00000000fff80000 - 0000000100000000 (reserved) 640MB LOWMEM available. found SMP MP-table at 000fdba0 hm, page 000fd000 reserved twice. hm, page 000fe000 reserved twice. hm, page 0009f000 reserved twice. hm, page 000a0000 reserved twice. On node 0 totalpages: 163840 DMA zone: 4096 pages, LIFO batch:1 Normal zone: 159744 pages, LIFO batch:16 HighMem zone: 0 pages, LIFO batch:1 DMI not present. ACPI: Unable to locate RSDP Intel MultiProcessor Specification v1.4 Virtual Wire compatibility mode. OEM ID: DELL Product ID: POWEREDGE APIC at: 0xFEE00000 Processor #3 6:1 APIC version 17 Processor #0 6:1 APIC version 17 I/O APIC #1 Version 17 at 0xFEC00000. Enabling APIC mode: Flat. Using 1 I/O APICs Processors: 2 Building zonelist for node : 0 Kernel command line: ro root=/dev/sdc1 noirqbalance Initializing CPU#0 PID hash table entries: 4096 (order 12: 32768 bytes) Detected 199.489 MHz processor. Console: colour VGA+ 80x25 Memory: 643948k/655360k available (2308k kernel code, 10636k reserved, 709k data, 456k init, 0k highmem) Calibrating delay loop... 390.14 BogoMIPS Dentry cache hash table entries: 131072 (order: 7, 524288 bytes) Inode-cache hash table entries: 65536 (order: 6, 262144 bytes) Mount-cache hash table entries: 512 (order: 0, 4096 bytes) checking if image is initramfs...it isn't (no cpio magic); looks like an initrd Freeing initrd memory: 82k freed CPU: After generic identify, caps: 0000fbff 00000000 00000000 00000000 CPU: After vendor identify, caps: 0000fbff 00000000 00000000 00000000 CPU: L1 I cache: 8K, L1 D cache: 8K CPU: L2 cache: 512K CPU: After all inits, caps: 0000f3ff 00000000 00000000 00000040 Checking 'hlt' instruction... OK. POSIX conformance testing by UNIFIX CPU0: Intel Pentium Pro stepping 09 per-CPU timeslice cutoff: 1460.32 usecs. task migration cache decay timeout: 2 msecs. enabled ExtINT on CPU#0 ESR value before enabling vector: 00000000 ESR value after enabling vector: 00000000 Booting processor 1/0 eip 2000 Initializing CPU#1 masked ExtINT on CPU#1 ESR value before enabling vector: 00000000 ESR value after enabling vector: 00000000 Calibrating delay loop... 397.31 BogoMIPS CPU: After generic identify, caps: 0000fbff 00000000 00000000 00000000 CPU: After vendor identify, caps: 0000fbff 00000000 00000000 00000000 CPU: L1 I cache: 8K, L1 D cache: 8K CPU: L2 cache: 512K CPU: After all inits, caps: 0000f3ff 00000000 00000000 00000040 CPU1: Intel Pentium Pro stepping 09 Total of 2 processors activated (787.45 BogoMIPS). ENABLING IO-APIC IRQs Setting 1 in the phys_id_present_map ...changing IO-APIC physical APIC ID to 1 ... ok. init IO_APIC IRQs IO-APIC (apicid-pin) 1-0 not connected. ..TIMER: vector=0x31 pin1=2 pin2=0 number of MP IRQ sources: 16. number of IO-APIC #1 registers: 16. testing the IO APIC....................... IO APIC #1...... .... register #00: 01000000 ....... : physical APIC id: 01 ....... : Delivery Type: 0 ....... : LTS : 0 .... register #01: 000F0011 ....... : max redirection entries: 000F ....... : PRQ implemented: 0 ....... : IO APIC version: 0011 .... register #02: 00000000 ....... : arbitration: 00 .... IRQ redirection table: NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect: 00 000 00 1 0 0 0 0 0 0 00 01 001 01 0 0 0 0 0 1 1 39 02 001 01 0 0 0 0 0 1 1 31 03 001 01 0 0 0 0 0 1 1 41 04 001 01 0 0 0 0 0 1 1 49 05 001 01 1 1 0 0 0 1 1 51 06 001 01 0 0 0 0 0 1 1 59 07 001 01 1 1 0 0 0 1 1 61 08 001 01 0 0 0 0 0 1 1 69 09 001 01 1 1 0 0 0 1 1 71 0a 001 01 1 1 0 0 0 1 1 79 0b 001 01 1 1 0 0 0 1 1 81 0c 001 01 0 0 0 0 0 1 1 89 0d 001 01 0 0 0 0 0 1 1 91 0e 001 01 1 1 0 0 0 1 1 99 0f 001 01 1 1 0 0 0 1 1 A1 IRQ to pin mappings: IRQ0 -> 0:2 IRQ1 -> 0:1 IRQ3 -> 0:3 IRQ4 -> 0:4 IRQ5 -> 0:5 IRQ6 -> 0:6 IRQ7 -> 0:7 IRQ8 -> 0:8 IRQ9 -> 0:9 IRQ10 -> 0:10 IRQ11 -> 0:11 IRQ12 -> 0:12 IRQ13 -> 0:13 IRQ14 -> 0:14 IRQ15 -> 0:15 .................................... done. Using local APIC timer interrupts. calibrating APIC timer ... ..... CPU clock speed is 199.0394 MHz. ..... host bus clock speed is 66.0464 MHz. checking TSC synchronization across 2 CPUs: passed. Starting migration thread for cpu 0 Bringing up 1 CPU 1 IS NOW UP! Starting migration thread for cpu 1 CPUS done 4 NET: Registered protocol family 16 EISA bus registered PCI: PCI BIOS revision 2.10 entry at 0xf814d, last bus=1 PCI: Using configuration type 1 mtrr: v2.0 (20020519) mtrr: your CPUs had inconsistent fixed MTRR settings mtrr: probably your BIOS does not setup all CPUs. mtrr: corrected configuration. Linux Plug and Play Support v0.97 (c) Adam Belay PnPBIOS: Scanning system for PnP BIOS support... PnPBIOS: Found PnP BIOS installation structure at 0xc00fdb70 PnPBIOS: PnP BIOS version 1.0, entry 0xf0000:0x4ce5, dseg 0xf0000 pnp: 00:0f: ioport range 0x400-0x407 has been reserved pnp: 00:0f: ioport range 0x40a-0x40c has been reserved pnp: 00:0f: ioport range 0x410-0x43f has been reserved pnp: 00:0f: ioport range 0x461-0x462 has been reserved pnp: 00:0f: ioport range 0x464-0x465 has been reserved pnp: 00:0f: ioport range 0x481-0x48b has been reserved pnp: 00:0f: ioport range 0x4c6-0x4c6 has been reserved PnPBIOS: 17 nodes reported by PnP BIOS; 17 recorded by driver SCSI subsystem initialized PCI: Probing PCI hardware PCI: Probing PCI hardware (bus 00) matroxfb: Matrox Millennium II (PCI) detected matroxfb: MTRR's turned on matroxfb: 640x480x8bpp (virtual: 640x65536) matroxfb: framebuffer at 0xFB000000, mapped to 0xe8805000, size 4194304 fb0: MATROX frame buffer device fb0: initializing hardware ikconfig 0.7 with /proc/config* udf: registering filesystem Limiting direct PCI/PCI transfers. isapnp: Scanning for PnP cards... isapnp: No Plug & Play device found pty: 256 Unix98 ptys configured Serial: 8250/16550 driver $Revision: 1.90 $ 8 ports, IRQ sharing disabled ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A Using anticipatory io scheduler Floppy drive(s): fd0 is 1.44M FDC 0 is a National Semiconductor PC87306 3c59x: Donald Becker and others. www.scyld.com/network/vortex.html 0000:00:10.0: 3Com PCI 3c905C Tornado at 0xf400. Vers LK1.1.19 0000:00:13.0: 3Com PCI 3c905B Cyclone 100baseTx at 0xf480. Vers LK1.1.19 PPP generic driver version 2.4.2 PPP Deflate Compression module registered PPP BSD Compression module registered scsi0 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.35 <Adaptec aic7860 Ultra SCSI adapter> aic7860: Ultra Single Channel A, SCSI Id=7, 3/253 SCBs (scsi0:A:5): 10.000MB/s transfers (10.000MHz, offset 15) (scsi0:A:6): 5.000MB/s transfers (5.000MHz, offset 15) Vendor: NEC Model: CD-ROM DRIVE:462 Rev: 1.14 Type: CD-ROM ANSI SCSI revision: 02 Vendor: DEC Model: DLT2000 Rev: 971E Type: Sequential-Access ANSI SCSI revision: 02 megaraid: v2.00.3 (Release Date: Wed Feb 19 08:51:30 EST 2003) megaraid: found 0x101e:0x9010:bus 1:slot 13:func 0 scsi1:Found MegaRAID controller at 0xd090, IRQ:15 megaraid: [U.75:1.44] detected 4 logical drives. megaraid: channel[0] is raid. megaraid: channel[1] is raid. scsi1 : LSI Logic MegaRAID U.75 254 commands 16 targs 5 chans 7 luns scsi1: scanning scsi channel 0 for logical drives. Vendor: MegaRAID Model: LD0 RAID1 8568R Rev: U.75 Type: Direct-Access ANSI SCSI revision: 02 Vendor: MegaRAID Model: LD1 RAID1 4088R Rev: U.75 Type: Direct-Access ANSI SCSI revision: 02 Vendor: MegaRAID Model: LD2 RAID0 4088R Rev: U.75 Type: Direct-Access ANSI SCSI revision: 02 Vendor: MegaRAID Model: LD3 RAID0 4088R Rev: U.75 Type: Direct-Access ANSI SCSI revision: 02 scsi1: scanning scsi channel 4 [P0] for physical devices. Vendor: DELL Model: 6UW BACKPLANE Rev: 7 Type: Processor ANSI SCSI revision: 02 scsi1: scanning scsi channel 5 [P1] for physical devices. st: Version 20030811, fixed bufsize 32768, s/g segs 256 Attached scsi tape st0 at scsi0, channel 0, id 6, lun 0 st0: try direct i/o: yes, max page reachable by HBA 1048575 SCSI device sda: 17547264 512-byte hdwr sectors (8984 MB) sda: asking for cache data failed sda: assuming drive cache: write through sda: sda1 Attached scsi disk sda at scsi1, channel 0, id 0, lun 0 SCSI device sdb: 8372224 512-byte hdwr sectors (4287 MB) sdb: asking for cache data failed sdb: assuming drive cache: write through sdb: sdb1 Attached scsi disk sdb at scsi1, channel 0, id 1, lun 0 SCSI device sdc: 8372224 512-byte hdwr sectors (4287 MB) sdc: asking for cache data failed sdc: assuming drive cache: write through sdc: sdc1 Attached scsi disk sdc at scsi1, channel 0, id 2, lun 0 SCSI device sdd: 8372224 512-byte hdwr sectors (4287 MB) sdd: asking for cache data failed sdd: assuming drive cache: write through sdd: unknown partition table Attached scsi disk sdd at scsi1, channel 0, id 3, lun 0 sr0: scsi-1 drive Uniform CD-ROM driver Revision: 3.12 Attached scsi CD-ROM sr0 at scsi0, channel 0, id 5, lun 0 Attached scsi generic sg0 at scsi0, channel 0, id 5, lun 0, type 5 Attached scsi generic sg1 at scsi0, channel 0, id 6, lun 0, type 1 Attached scsi generic sg2 at scsi1, channel 0, id 0, lun 0, type 0 Attached scsi generic sg3 at scsi1, channel 0, id 1, lun 0, type 0 Attached scsi generic sg4 at scsi1, channel 0, id 2, lun 0, type 0 Attached scsi generic sg5 at scsi1, channel 0, id 3, lun 0, type 0 Attached scsi generic sg6 at scsi1, channel 4, id 6, lun 0, type 3 mice: PS/2 mouse device common for all mice input: ImExPS/2 Generic Explorer Mouse on isa0060/serio1 serio: i8042 AUX port at 0x60,0x64 irq 12 input: AT Translated Set 2 keyboard on isa0060/serio0 serio: i8042 KBD port at 0x60,0x64 irq 1 device-mapper: 1.0.6-ioctl (2002-10-15) initialised: dm@uk.sistina.com EISA: Probing bus 0 at 0000:00:0f.0 EISA: Mainboard DEL0058 detected. EISA: Detected 0 cards. Advanced Linux Sound Architecture Driver Version 0.9.7 (Thu Sep 25 19:16:36 2003 UTC). request_module: failed /sbin/modprobe -- snd-card-0. error = -16 ALSA device list: #0: Sound Fusion CS46xx at 0xfcffc000/0xfce00000, irq 14 NET: Registered protocol family 2 IP: routing cache hash table of 8192 buckets, 64Kbytes TCP: Hash tables configured (established 262144 bind 65536) ip_conntrack version 2.1 (5120 buckets, 40960 max) - 304 bytes per conntrack ip_tables: (C) 2000-2002 Netfilter core team ipt_recent v0.3.1: Stephen Frost <sfrost@snowman.net>. http://snowman.net/projects/ipt_recent/ arp_tables: (C) 2002 David S. Miller NET: Registered protocol family 1 NET: Registered protocol family 17 kjournald starting. Commit interval 5 seconds EXT3-fs: mounted filesystem with ordered data mode. VFS: Mounted root (ext3 filesystem) readonly. Freeing unused kernel memory: 456k freed EXT3 FS on sdc1, internal journal kjournald starting. Commit interval 5 seconds EXT3 FS on sdb1, internal journal EXT3-fs: mounted filesystem with ordered data mode. kudzu: numerical sysctl 1 23 is obsolete. process `named' is using obsolete setsockopt SO_BSDCOMPAT ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 4:54 ` William Lee Irwin III 2003-12-06 4:57 ` Stian Jordet 2003-12-06 7:11 ` Colin Coe @ 2003-12-08 15:45 ` bill davidsen 2003-12-08 17:36 ` Zwane Mwaikambo 2 siblings, 1 reply; 29+ messages in thread From: bill davidsen @ 2003-12-08 15:45 UTC (permalink / raw) To: linux-kernel In article <20031206045409.GK8039@holomorphy.com>, William Lee Irwin III <wli@holomorphy.com> wrote: | l?r, 06.12.2003 kl. 05.37 skrev William Lee Irwin III: | >> Yeah, it looks like it hit you too. | >> Could you boot with noirqbalance on the kernel commandline and see if | >> the problem goes away? | | On Sat, Dec 06, 2003 at 05:48:46AM +0100, Stian Jordet wrote: | > Wow, that actually fixed it :) | > CPU0 CPU1 | > 0: 65636 63667 IO-APIC-edge timer | > 1: 150 136 IO-APIC-edge i8042 | > 2: 0 0 XT-PIC cascade | > 3: 2 1 IO-APIC-edge serial | > 8: 3 1 IO-APIC-edge rtc | > 9: 0 0 IO-APIC-level acpi | > 14: 18 37 IO-APIC-edge ide0 | | Okay, irqbalance has gaffed (as predicted). Could you send in | /proc/cpuinfo and /var/log/dmesg? I think the most confusing thing about this was the choice of "noirqbalance" as an option to mean "do balance irqs." I'm not sure that the default to put all irqs on a single CPU is optimal in any case, but the naming is particularly bad. On light irq load the cache probably gets reloaded before the next interrupt on modern CPUs, and under really heavy irq pressure I see posts showing some overflow to other CPUs, so it's the in-between cases which benefit. At least I hope, people did look at cache and ctx effects before putting irqs on a single CPU, given the people I assume they are right. -- bill davidsen <davidsen@tmr.com> CTO, TMR Associates, Inc Doing interesting things with little computers since 1979. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-08 15:45 ` bill davidsen @ 2003-12-08 17:36 ` Zwane Mwaikambo 0 siblings, 0 replies; 29+ messages in thread From: Zwane Mwaikambo @ 2003-12-08 17:36 UTC (permalink / raw) To: bill davidsen; +Cc: linux-kernel On Mon, 8 Dec 2003, bill davidsen wrote: > I think the most confusing thing about this was the choice of > "noirqbalance" as an option to mean "do balance irqs." I'm not sure that > the default to put all irqs on a single CPU is optimal in any case, but > the naming is particularly bad. Actually, noirqbalance means no in kernel irq balancer. ia32 SMP systems before P4 tend to RR interrupt handling via hardware by utilising an APIC bus arbitration scheme. P4 doesn't, one reason being the missing Arbitration ID register and the usage of a bus cycle to determine which processor should handle the interrupt depending on the status of the Task Priority Register on each local apic (processor). So in essence we should be using the TPR to do interrupt balancing decisions with P4/Xeon. So all noirqbalance will do is disable in kernel balancer. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 4:37 ` William Lee Irwin III 2003-12-06 4:48 ` Stian Jordet @ 2003-12-06 14:07 ` Adam Kropelin 1 sibling, 0 replies; 29+ messages in thread From: Adam Kropelin @ 2003-12-06 14:07 UTC (permalink / raw) To: William Lee Irwin III, Stian Jordet, Nick Piggin, Colin Coe, linux-kernel On Fri, Dec 05, 2003 at 08:37:57PM -0800, William Lee Irwin III wrote: > On Sat, Dec 06, 2003 at 05:28:38AM +0100, Stian Jordet wrote: > > Uhm.. I was under the impression that this was expected behaviour? If > > not, I guess I'm having problems too? > > CPU0 CPU1 > > 0: 91068534 45 IO-APIC-edge timer > > 1: 65293 1 IO-APIC-edge i8042 > > 2: 0 0 XT-PIC cascade > > 3: 71 1 IO-APIC-edge serial > > 8: 325118 1 IO-APIC-edge rtc > > 9: 0 0 IO-APIC-level acpi > > 14: 245619 1 IO-APIC-edge ide0 > > Yeah, it looks like it hit you too. > > Could you boot with noirqbalance on the kernel commandline and see if > the problem goes away? Sounds like you have things under control, but if you need another data point I can provide my info. Dual ppro200, same behaviors described in this thread. Booting with noirqbalance fixes it. --Adam ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 3:07 ` William Lee Irwin III 2003-12-06 4:28 ` Stian Jordet @ 2003-12-06 7:02 ` Colin Coe 2003-12-06 10:58 ` William Lee Irwin III 2003-12-06 20:08 ` Ethan Weinstein 1 sibling, 2 replies; 29+ messages in thread From: Colin Coe @ 2003-12-06 7:02 UTC (permalink / raw) To: William Lee Irwin III; +Cc: linux-kernel Sorry about the delay. Booted with noirqbalance. [root@host root]# cat /proc/interrupts CPU0 CPU1 0: 7411777 5971987 IO-APIC-edge timer 1: 7 4 IO-APIC-edge i8042 2: 0 0 XT-PIC cascade 4: 16 42 IO-APIC-edge serial 5: 4915 4820 IO-APIC-level eth1 10: 67 69 IO-APIC-level aic7xxx 11: 325 266 IO-APIC-level eth0 12: 47 109 IO-APIC-edge i8042 14: 0 0 IO-APIC-level CS46XX 15: 6398 6401 IO-APIC-level megaraid NMI: 0 0 LOC: 13383659 13383658 ERR: 0 MIS: 0 That looks a lot better... Thanks! -- "Obnoxious frog..." Spike, 2071AD William Lee Irwin III said: > On Sat, Dec 06, 2003 at 01:48:54PM +1100, Nick Piggin wrote: >> Although in this case Colin has 2 PPro 200s. >> Colin - process load should be evenly distributed between CPUs, and this >> is generally the most important thing. Big networking loads (most >> commonly) >> can put a lot of time into processing interrupts though. > > That is rather busted, then. > > Colin, could you try booting with noirqbalance on the kernel command > line? > > > -- wli > ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 7:02 ` Colin Coe @ 2003-12-06 10:58 ` William Lee Irwin III 2003-12-06 20:08 ` Ethan Weinstein 1 sibling, 0 replies; 29+ messages in thread From: William Lee Irwin III @ 2003-12-06 10:58 UTC (permalink / raw) To: Colin Coe; +Cc: linux-kernel On Sat, Dec 06, 2003 at 03:02:22PM +0800, Colin Coe wrote: > Sorry about the delay. > Booted with noirqbalance. This leads to a similar conclusion to Stian Jordet's case. It's not mistaking you for HT, it's the lack of an internal distinction between the cases that need and don't need irq balancing. -- wli ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-06 7:02 ` Colin Coe 2003-12-06 10:58 ` William Lee Irwin III @ 2003-12-06 20:08 ` Ethan Weinstein 1 sibling, 0 replies; 29+ messages in thread From: Ethan Weinstein @ 2003-12-06 20:08 UTC (permalink / raw) To: linux-kernel; +Cc: colin Colin Coe wrote: > Sorry about the delay. > > Booted with noirqbalance. > > [root@host root]# cat /proc/interrupts > CPU0 CPU1 > 0: 7411777 5971987 IO-APIC-edge timer > 1: 7 4 IO-APIC-edge i8042 > 2: 0 0 XT-PIC cascade > 4: 16 42 IO-APIC-edge serial > 5: 4915 4820 IO-APIC-level eth1 > 10: 67 69 IO-APIC-level aic7xxx > 11: 325 266 IO-APIC-level eth0 > 12: 47 109 IO-APIC-edge i8042 > 14: 0 0 IO-APIC-level CS46XX > 15: 6398 6401 IO-APIC-level megaraid > NMI: 0 0 > LOC: 13383659 13383658 > ERR: 0 > MIS: 0 > > That looks a lot better... > > Thanks! > > -- > "Obnoxious frog..." Spike, 2071AD > > William Lee Irwin III said: > >>On Sat, Dec 06, 2003 at 01:48:54PM +1100, Nick Piggin wrote: >> >>>Although in this case Colin has 2 PPro 200s. >>>Colin - process load should be evenly distributed between CPUs, and this >>>is generally the most important thing. Big networking loads (most >>>commonly) >>>can put a lot of time into processing interrupts though. >> >>That is rather busted, then. >> >>Colin, could you try booting with noirqbalance on the kernel command >>line? >> >> >>-- wli >> > I'll throw my hat in here as well. This is an old compaq proliant I have at the office- dual 400 PII, booted with "noirqbalance" 2.6.0-test11: CPU0 CPU1 0: 2580383 1920931 IO-APIC-edge timer 1: 6 3 IO-APIC-edge i8042 2: 0 0 XT-PIC cascade 5: 467 423 IO-APIC-level TLAN 8: 1 0 IO-APIC-edge rtc 9: 15 15 IO-APIC-level sym53c8xx 10: 17 17 IO-APIC-level sym53c8xx 11: 1602 1593 IO-APIC-level ida0 14: 8 2 IO-APIC-edge ide0 NMI: 0 0 LOC: 4501366 4501354 ERR: 0 MIS: 0 witout "noirqbalance" we interrupt on CPU0 solely. -E ^ permalink raw reply [flat|nested] 29+ messages in thread
* IRQ balancing 2003-12-06 2:42 ` William Lee Irwin III 2003-12-06 2:48 ` William Lee Irwin III 2003-12-06 2:48 ` Nick Piggin @ 2003-12-06 14:40 ` Sean Neakums 2003-12-06 14:48 ` Sean Neakums 2 siblings, 1 reply; 29+ messages in thread From: Sean Neakums @ 2003-12-06 14:40 UTC (permalink / raw) To: William Lee Irwin III; +Cc: Colin Coe, linux-kernel William Lee Irwin III <wli@holomorphy.com> writes: > On Sat, Dec 06, 2003 at 10:32:45AM +0800, Colin Coe wrote: >> This indicates to me that the processing load is being evenly distributed >> accross the two processes. Under v2.6.0-testxx however, 'cat >> /proc/interrupts' shows this: >> [root@host root]# cat /proc/interrupts >> CPU0 CPU1 >> 0: 633122 30 IO-APIC-edge timer >> 1: 207 IO-APIC-edge i8042 >> 2: XT-PIC cascade >> 4: 48 1 IO-APIC-edge serial >> 5: 449 1 IO-APIC-level eth1 >> 10: 135 1 IO-APIC-level aic7xxx >> 11: 1447 1 IO-APIC-level eth0 >> 12: 61 IO-APIC-edge i8042 >> 14: IO-APIC-level CS46XX >> 15: 14982 1 IO-APIC-level megaraid > > 2.6 does balancing across packages, not logical cpus, so this will > happen and it will be largely harmless, except for what appears to > be some kind of bug where it's stealing the timer from logical cpu 1. I noticed something similar way back when, and what I took away from the ensuing discussion (which may be complete poppycock) was: "IRQ balancing" means having individual IRQs run on the same CPU as much as possible, which (I assume) mitigates cacheline bouncing or something along those lines. It does not mean having each IRQ serviced equally by each CPU. The kernel's default policy is now to have all IRQs run on CPU0, with "noirqbalance"'s effect being to have the IRQs be serviced by CPUs in a round-robin fashion. noirqbalance is intended to be used when one is runing a userspace IRQ balancing policy daemon, such as the one written by Arjan Van de Ven (http://people.redhat.com/arjanv/irqbalance/). -- Not bad, for a human. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: IRQ balancing 2003-12-06 14:40 ` IRQ balancing Sean Neakums @ 2003-12-06 14:48 ` Sean Neakums 0 siblings, 0 replies; 29+ messages in thread From: Sean Neakums @ 2003-12-06 14:48 UTC (permalink / raw) To: William Lee Irwin III; +Cc: Colin Coe, linux-kernel Sean Neakums <sneakums@zork.net> writes: > I noticed something similar way back when, and what I took away from > the ensuing discussion (which may be complete poppycock) was: That is, what I took away from the discussion may be complete poppycock. -- Not bad, for a human. ^ permalink raw reply [flat|nested] 29+ messages in thread
[parent not found: <fa.jiqirm0.13gv2u@ifi.uio.no>]
[parent not found: <fa.f9f2gij.1kua0f@ifi.uio.no>]
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? [not found] ` <fa.f9f2gij.1kua0f@ifi.uio.no> @ 2003-12-06 17:38 ` William Park 0 siblings, 0 replies; 29+ messages in thread From: William Park @ 2003-12-06 17:38 UTC (permalink / raw) To: linux-kernel On Sat, Dec 06, 2003 at 10:59:01AM +0000, William Lee Irwin III wrote: > This leads to a similar conclusion to Stian Jordet's case. It's not > mistaking you for HT, it's the lack of an internal distinction between > the cases that need and don't need irq balancing. I have VP6 (Apollo Pro 133A, 82c694X/686B) dual-P3 (800MHz/133MHz). I'm currently using MPS 1.1, because USB doesn't work with MPS 1.4 (or, it does but only with 'noapic'). And, I can report the same finding as others. Before: ------- CPU0 CPU1 0: 79365 63 IO-APIC-edge timer 1: 215 1 IO-APIC-edge i8042 2: 0 0 XT-PIC cascade 4: 8654 0 IO-APIC-edge serial 8: 1 1 IO-APIC-edge rtc 12: 52 1 IO-APIC-edge i8042 14: 2155 0 IO-APIC-edge ide0 15: 2 0 IO-APIC-edge ide1 17: 0 0 IO-APIC-level eth0 NMI: 0 0 LOC: 79231 79266 ERR: 0 MIS: 0 After 'noirqbalance': --------------------- CPU0 CPU1 0: 15039 16025 IO-APIC-edge timer 1: 47 75 IO-APIC-edge i8042 2: 0 0 XT-PIC cascade 4: 21 43 IO-APIC-edge serial 8: 2 0 IO-APIC-edge rtc 12: 21 32 IO-APIC-edge i8042 14: 828 410 IO-APIC-edge ide0 15: 2 0 IO-APIC-edge ide1 17: 0 0 IO-APIC-level eth0 NMI: 0 0 LOC: 30865 30900 ERR: 0 MIS: 0 -- William Park, Open Geometry Consulting, <opengeometry@yahoo.ca> Linux solution for data management and processing. ^ permalink raw reply [flat|nested] 29+ messages in thread
[parent not found: <ZAwx-88m-3@gated-at.bofh.it>]
[parent not found: <ZAGd-8ma-5@gated-at.bofh.it>]
[parent not found: <ZAQ7-6X-13@gated-at.bofh.it>]
[parent not found: <ZAZB-pS-11@gated-at.bofh.it>]
[parent not found: <ZCoI-2oz-9@gated-at.bofh.it>]
[parent not found: <ZCyh-2Bv-1@gated-at.bofh.it>]
[parent not found: <ZCI5-2Pv-3@gated-at.bofh.it>]
[parent not found: <ZCIb-2Pv-11@gated-at.bofh.it>]
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? [not found] ` <ZCIb-2Pv-11@gated-at.bofh.it> @ 2003-12-08 16:42 ` Matthew Kanar 2003-12-08 17:21 ` William Lee Irwin III 2003-12-08 17:38 ` Zwane Mwaikambo 0 siblings, 2 replies; 29+ messages in thread From: Matthew Kanar @ 2003-12-08 16:42 UTC (permalink / raw) To: linux-kernel Here is one of my SMP systems (Dell-Dual P3), although noirqbalance doesn't seem to change things -- uname -nrvm: k12.kanar.net 2.6.0-test11 #2 SMP Wed Dec 3 18:50:36 EST 2003 i686 _Without_ noirqbalance - uptime: 10:31:51 up 4 days, 15:07, 10 users, load average: 0.00, 0.02, 0.00 /proc/interrupts: CPU0 CPU1 0: 27505 400084866 IO-APIC-edge timer 1: 1438 1 IO-APIC-edge i8042 2: 0 0 XT-PIC cascade 8: 1 0 IO-APIC-edge rtc 12: 1837 161 IO-APIC-edge i8042 14: 661467 822411 IO-APIC-edge ide0 15: 1 0 IO-APIC-edge ide1 16: 104949011 10 IO-APIC-level eth0 NMI: 0 0 LOC: 400153184 400153183 ERR: 0 MIS: 10 _With_ noirqbalance - uptime: 11:36:12 up 1:01, 4 users, load average: 0.00, 0.09, 0.28 /proc/interrupts: CPU0 CPU1 0: 16726 3707690 IO-APIC-edge timer 1: 3 8 IO-APIC-edge i8042 2: 0 0 XT-PIC cascade 8: 0 1 IO-APIC-edge rtc 12: 14 36 IO-APIC-edge i8042 14: 28140 659 IO-APIC-edge ide0 15: 1 0 IO-APIC-edge ide1 16: 12775 12 IO-APIC-level eth0 NMI: 0 0 LOC: 3724639 3724638 ERR: 0 MIS: 0 CPU0 timer: value 16726 hasn't changed since boot an hour ago. dmesg: Linux version 2.6.0-test11 (root@k12.kanar.net) (gcc version 3.2.2 20030222 (Red Hat Linux 3.2.2-5)) #2 SMP Wed Dec 3 18:50:36 EST 2003 BIOS-provided physical RAM map: BIOS-e820: 0000000000000000 - 00000000000a0000 (usable) BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved) BIOS-e820: 0000000000100000 - 000000001ff9e000 (usable) BIOS-e820: 000000001ff9e000 - 0000000020000000 (reserved) BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved) BIOS-e820: 00000000fee00000 - 00000000fee10000 (reserved) BIOS-e820: 00000000ffb00000 - 0000000100000000 (reserved) 0MB HIGHMEM available. 511MB LOWMEM available. found SMP MP-table at 000fe710 hm, page 000fe000 reserved twice. hm, page 000ff000 reserved twice. hm, page 000f0000 reserved twice. On node 0 totalpages: 130974 DMA zone: 4096 pages, LIFO batch:1 Normal zone: 126878 pages, LIFO batch:16 HighMem zone: 0 pages, LIFO batch:1 DMI 2.3 present. ACPI: RSDP (v000 DELL ) @ 0x000fd720 ACPI: RSDT (v001 DELL WS 420 0x00000008 ASL 0x00000061) @ 0x000fd734 ACPI: FADT (v001 DELL WS 420 0x00000008 ASL 0x00000061) @ 0x000fd760 ACPI: MADT (v001 DELL WS 420 0x00000008 ASL 0x00000061) @ 0x000fd7d4 ACPI: DSDT (v001 DELL dt_ex 0x00001000 MSFT 0x0100000b) @ 0x00000000 ACPI: Local APIC address 0xfee00000 ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled) Processor #0 6:8 APIC version 17 ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled) Processor #1 6:8 APIC version 17 ACPI: LAPIC_NMI (acpi_id[0x01] polarity[0x1] trigger[0x1] lint[0x1]) ACPI: LAPIC_NMI (acpi_id[0x02] polarity[0x1] trigger[0x1] lint[0x1]) Using ACPI for processor (LAPIC) configuration information Intel MultiProcessor Specification v1.4 Virtual Wire compatibility mode. OEM ID: DELL Product ID: WS 420 APIC at: 0xFEE00000 I/O APIC #2 Version 32 at 0xFEC00000. Enabling APIC mode: Flat. Using 1 I/O APICs Processors: 2 Building zonelist for node : 0 Kernel command line: ro root=/dev/hda2 noirqbalance Initializing CPU#0 PID hash table entries: 2048 (order 11: 16384 bytes) Detected 930.947 MHz processor. Console: colour VGA+ 80x25 Memory: 514112k/523896k available (2409k kernel code, 9044k reserved, 579k data, 352k init, 0k highmem) Calibrating delay loop... 1839.10 BogoMIPS Dentry cache hash table entries: 65536 (order: 6, 262144 bytes) Inode-cache hash table entries: 32768 (order: 5, 131072 bytes) Mount-cache hash table entries: 512 (order: 0, 4096 bytes) CPU: After generic identify, caps: 0383fbff 00000000 00000000 00000000 CPU: After vendor identify, caps: 0383fbff 00000000 00000000 00000000 CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 256K CPU: After all inits, caps: 0383fbff 00000000 00000000 00000040 Intel machine check architecture supported. Intel machine check reporting enabled on CPU#0. Enabling fast FPU save and restore... done. Enabling unmasked SIMD FPU exception support... done. Checking 'hlt' instruction... OK. POSIX conformance testing by UNIFIX CPU0: Intel Pentium III (Coppermine) stepping 06 per-CPU timeslice cutoff: 732.06 usecs. task migration cache decay timeout: 1 msecs. enabled ExtINT on CPU#0 ESR value before enabling vector: 00000040 ESR value after enabling vector: 00000000 Booting processor 1/1 eip 2000 Initializing CPU#1 masked ExtINT on CPU#1 ESR value before enabling vector: 00000000 ESR value after enabling vector: 00000000 Calibrating delay loop... 1859.58 BogoMIPS CPU: After generic identify, caps: 0383fbff 00000000 00000000 00000000 CPU: After vendor identify, caps: 0383fbff 00000000 00000000 00000000 CPU: L1 I cache: 16K, L1 D cache: 16K CPU: L2 cache: 256K CPU: After all inits, caps: 0383fbff 00000000 00000000 00000040 Intel machine check architecture supported. Intel machine check reporting enabled on CPU#1. CPU1: Intel Pentium III (Coppermine) stepping 06 Total of 2 processors activated (3698.68 BogoMIPS). ENABLING IO-APIC IRQs Setting 2 in the phys_id_present_map ...changing IO-APIC physical APIC ID to 2 ... ok. init IO_APIC IRQs IO-APIC (apicid-pin) 2-0, 2-13, 2-20, 2-21, 2-22, 2-23 not connected. ..TIMER: vector=0x31 pin1=2 pin2=0 number of MP IRQ sources: 44. number of IO-APIC #2 registers: 24. testing the IO APIC....................... IO APIC #2...... .... register #00: 02000000 ....... : physical APIC id: 02 ....... : Delivery Type: 0 ....... : LTS : 0 .... register #01: 00170020 ....... : max redirection entries: 0017 ....... : PRQ implemented: 0 ....... : IO APIC version: 0020 .... register #02: 00000000 ....... : arbitration: 00 .... IRQ redirection table: NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect: 00 000 00 1 0 0 0 0 0 0 00 01 001 01 0 0 0 0 0 1 1 39 02 001 01 0 0 0 0 0 1 1 31 03 001 01 0 0 0 0 0 1 1 41 04 001 01 0 0 0 0 0 1 1 49 05 001 01 0 0 0 0 0 1 1 51 06 001 01 0 0 0 0 0 1 1 59 07 001 01 0 0 0 0 0 1 1 61 08 001 01 0 0 0 0 0 1 1 69 09 001 01 0 0 0 0 0 1 1 71 0a 001 01 0 0 0 0 0 1 1 79 0b 001 01 0 0 0 0 0 1 1 81 0c 001 01 0 0 0 0 0 1 1 89 0d 000 00 1 0 0 0 0 0 0 00 0e 001 01 0 0 0 0 0 1 1 91 0f 001 01 0 0 0 0 0 1 1 99 10 001 01 1 1 0 1 0 1 1 A1 11 001 01 1 1 0 1 0 1 1 A9 12 001 01 1 1 0 1 0 1 1 B1 13 001 01 1 1 0 1 0 1 1 B9 14 000 00 1 0 0 0 0 0 0 00 15 000 00 1 0 0 0 0 0 0 00 16 000 00 1 0 0 0 0 0 0 00 17 000 00 1 0 0 0 0 0 0 00 IRQ to pin mappings: IRQ0 -> 0:2 IRQ1 -> 0:1 IRQ3 -> 0:3 IRQ4 -> 0:4 IRQ5 -> 0:5 IRQ6 -> 0:6 IRQ7 -> 0:7 IRQ8 -> 0:8 IRQ9 -> 0:9 IRQ10 -> 0:10 IRQ11 -> 0:11 IRQ12 -> 0:12 IRQ14 -> 0:14 IRQ15 -> 0:15 IRQ16 -> 0:16 IRQ17 -> 0:17 IRQ18 -> 0:18 IRQ19 -> 0:19 .................................... done. Using local APIC timer interrupts. calibrating APIC timer ... ..... CPU clock speed is 930.0810 MHz. ..... host bus clock speed is 132.0972 MHz. checking TSC synchronization across 2 CPUs: passed. Starting migration thread for cpu 0 Bringing up 1 CPU 1 IS NOW UP! Starting migration thread for cpu 1 CPUS done 8 NET: Registered protocol family 16 PCI: PCI BIOS revision 2.10 entry at 0xfc03e, last bus=3 PCI: Using configuration type 1 mtrr: v2.0 (20020519) Linux Plug and Play Support v0.97 (c) Adam Belay PCI: Probing PCI hardware PCI: Probing PCI hardware (bus 00) Transparent bridge - 0000:00:1e.0 PCI: Using IRQ router PIIX/ICH [8086/2410] at 0000:00:1f.0 PCI->APIC IRQ transform: (B0,I31,P3) -> 19 PCI->APIC IRQ transform: (B0,I31,P1) -> 17 PCI->APIC IRQ transform: (B1,I0,P0) -> 16 PCI->APIC IRQ transform: (B2,I4,P0) -> 16 PCI->APIC IRQ transform: (B2,I6,P0) -> 18 PCI->APIC IRQ transform: (B2,I11,P0) -> 19 apm: BIOS version 1.2 Flags 0x03 (Driver version 1.16ac) apm: disabled - APM is not SMP safe. VFS: Disk quotas dquot_6.5.1 SGI XFS for Linux with no debug enabled isapnp: Scanning for PnP cards... isapnp: No Plug & Play device found pty: 2048 Unix98 ptys configured Real Time Clock Driver v1.12 Using anticipatory io scheduler Floppy drive(s): fd0 is 1.44M FDC 0 is a National Semiconductor PC87306 RAMDISK driver initialized: 16 RAM disks of 4096K size 1024 blocksize divert: not allocating divert_blk for non-ethernet device lo Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2 ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx ICH: IDE controller at PCI slot 0000:00:1f.1 ICH: chipset revision 2 ICH: not 100% native mode: will probe irqs later ide0: BM-DMA at 0xffa0-0xffa7, BIOS settings: hda:DMA, hdb:pio ide1: BM-DMA at 0xffa8-0xffaf, BIOS settings: hdc:DMA, hdd:pio hda: WDC WD1200JB-75CRA0, ATA DISK drive ide0 at 0x1f0-0x1f7,0x3f6 on irq 14 hdc: LITEON DVD-ROM LTD163, ATAPI CD/DVD-ROM drive ide1 at 0x170-0x177,0x376 on irq 15 hda: max request size: 128KiB hda: Host Protected Area detected. current capacity is 234375000 sectors (120000 MB) native capacity is 234375120 sectors (120000 MB) hda: 234375000 sectors (120000 MB) w/8192KiB Cache, CHS=65535/16/63, UDMA(66) hda: hda1 hda2 hda3 mice: PS/2 mouse device common for all mice input: PS/2 Generic Mouse on isa0060/serio1 serio: i8042 AUX port at 0x60,0x64 irq 12 input: AT Translated Set 2 keyboard on isa0060/serio0 serio: i8042 KBD port at 0x60,0x64 irq 1 md: md driver 0.90.0 MAX_MD_DEVS=256, MD_SB_DISKS=27 NET: Registered protocol family 2 IP: routing cache hash table of 4096 buckets, 32Kbytes TCP: Hash tables configured (established 32768 bind 32768) NET: Registered protocol family 1 NET: Registered protocol family 17 NET: Registered protocol family 8 NET: Registered protocol family 20 md: Autodetecting RAID arrays. md: autorun ... md: ... autorun DONE. kjournald starting. Commit interval 5 seconds EXT3-fs: mounted filesystem with ordered data mode. VFS: Mounted root (ext3 filesystem) readonly. Freeing unused kernel memory: 352k freed drivers/usb/core/usb.c: registered new driver usbfs drivers/usb/core/usb.c: registered new driver hub drivers/usb/core/usb.c: registered new driver hid drivers/usb/input/hid-core.c: v2.0:USB HID core driver EXT3 FS on hda2, internal journal Adding 1044216k swap on /dev/hda3. Priority:-1 extents:1 kjournald starting. Commit interval 5 seconds EXT3 FS on hda1, internal journal EXT3-fs: mounted filesystem with ordered data mode. kudzu: numerical sysctl 1 23 is obsolete. parport0: PC-style at 0x378 (0x778) [PCSPP,TRISTATE,EPP] parport0: irq 7 detected parport0: cpp_daisy: aa5500ff(08) parport0: assign_addrs: aa5500ff(08) parport0: cpp_daisy: aa5500ff(08) parport0: assign_addrs: aa5500ff(08) 3c59x: Donald Becker and others. www.scyld.com/network/vortex.html 0000:02:04.0: 3Com PCI 3c905C Tornado at 0xec80. Vers LK1.1.19 divert: allocating divert_blk for eth0 /proc/cpuinfo: processor : 0 vendor_id : GenuineIntel cpu family : 6 model : 8 model name : Pentium III (Coppermine) stepping : 6 cpu MHz : 930.947 cache size : 256 KB fdiv_bug : no hlt_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes cpuid level : 2 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 mmx fxsr sse bogomips : 1839.10 processor : 1 vendor_id : GenuineIntel cpu family : 6 model : 8 model name : Pentium III (Coppermine) stepping : 6 cpu MHz : 930.947 cache size : 256 KB fdiv_bug : no hlt_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes cpuid level : 2 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 mmx fxsr sse bogomips : 1859.58 ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-08 16:42 ` Matthew Kanar @ 2003-12-08 17:21 ` William Lee Irwin III 2003-12-08 17:38 ` Zwane Mwaikambo 1 sibling, 0 replies; 29+ messages in thread From: William Lee Irwin III @ 2003-12-08 17:21 UTC (permalink / raw) To: Matthew Kanar; +Cc: linux-kernel On Mon, Dec 08, 2003 at 11:42:57AM -0500, Matthew Kanar wrote: > Here is one of my SMP systems (Dell-Dual P3), although noirqbalance > doesn't seem to change things -- > uname -nrvm: > k12.kanar.net 2.6.0-test11 #2 SMP Wed Dec 3 18:50:36 EST 2003 i686 > _Without_ noirqbalance - > uptime: > 10:31:51 up 4 days, 15:07, 10 users, load average: 0.00, 0.02, 0.00 ACPI may be doing something strange (as usual). It looks like you somehow got slammed into fixed delivery mode. -- wli ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? 2003-12-08 16:42 ` Matthew Kanar 2003-12-08 17:21 ` William Lee Irwin III @ 2003-12-08 17:38 ` Zwane Mwaikambo 1 sibling, 0 replies; 29+ messages in thread From: Zwane Mwaikambo @ 2003-12-08 17:38 UTC (permalink / raw) To: Matthew Kanar; +Cc: linux-kernel On Mon, 8 Dec 2003, Matthew Kanar wrote: > _Without_ noirqbalance - > > uptime: > 10:31:51 up 4 days, 15:07, 10 users, load average: 0.00, 0.02, 0.00 > > /proc/interrupts: > CPU0 CPU1 > 0: 27505 400084866 IO-APIC-edge timer > 1: 1438 1 IO-APIC-edge i8042 > 2: 0 0 XT-PIC cascade > 8: 1 0 IO-APIC-edge rtc > 12: 1837 161 IO-APIC-edge i8042 > 14: 661467 822411 IO-APIC-edge ide0 > 15: 1 0 IO-APIC-edge ide1 > 16: 104949011 10 IO-APIC-level eth0 > NMI: 0 0 > LOC: 400153184 400153183 > ERR: 0 > MIS: 10 > > > _With_ noirqbalance - > > uptime: > 11:36:12 up 1:01, 4 users, load average: 0.00, 0.09, 0.28 > > /proc/interrupts: > CPU0 CPU1 > 0: 16726 3707690 IO-APIC-edge timer > 1: 3 8 IO-APIC-edge i8042 > 2: 0 0 XT-PIC cascade > 8: 0 1 IO-APIC-edge rtc > 12: 14 36 IO-APIC-edge i8042 > 14: 28140 659 IO-APIC-edge ide0 > 15: 1 0 IO-APIC-edge ide1 > 16: 12775 12 IO-APIC-level eth0 > NMI: 0 0 > LOC: 3724639 3724638 > ERR: 0 > MIS: 0 Are you sure you're not running the userspace irq balancer (ps ax | grep irqbalance)? ^ permalink raw reply [flat|nested] 29+ messages in thread
[parent not found: <10wU2-1mR-11@gated-at.bofh.it>]
[parent not found: <10wU2-1mR-13@gated-at.bofh.it>]
[parent not found: <10wU2-1mR-15@gated-at.bofh.it>]
[parent not found: <10wU3-1mR-17@gated-at.bofh.it>]
[parent not found: <10wU3-1mR-19@gated-at.bofh.it>]
[parent not found: <10wU3-1mR-21@gated-at.bofh.it>]
[parent not found: <10wU3-1mR-23@gated-at.bofh.it>]
[parent not found: <10wU3-1mR-25@gated-at.bofh.it>]
[parent not found: <10wU2-1mR-9@gated-at.bofh.it>]
[parent not found: <10xGk-38t-15@gated-at.bofh.it>]
* Re: SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? [not found] ` <10xGk-38t-15@gated-at.bofh.it> @ 2003-12-08 19:24 ` Matthew Kanar 0 siblings, 0 replies; 29+ messages in thread From: Matthew Kanar @ 2003-12-08 19:24 UTC (permalink / raw) To: linux-kernel Zwane Mwaikambo wrote: > Are you sure you're not running the userspace irq balancer (ps ax | grep > irqbalance)? <blush> Well, userspace irqbalancer wasn't running, but it was started and then stopped during the system startup. My apologies. A few changes in the rcX.d directories and a few reboots later, I have found that this system exhibits similar behavior to that of others in this thread. /proc/interrupts without noirqbalance: CPU0 CPU1 0: 331404 14 IO-APIC-edge timer 1: 10 1 IO-APIC-edge i8042 2: 0 0 XT-PIC cascade 8: 0 1 IO-APIC-edge rtc 12: 49 1 IO-APIC-edge i8042 14: 5503 0 IO-APIC-edge ide0 15: 1 0 IO-APIC-edge ide1 16: 1004 1 IO-APIC-level eth0 NMI: 0 0 LOC: 331292 331291 ERR: 0 MIS: 0 /proc/interrupts with noirqbalance: CPU0 CPU1 0: 70723 137438 IO-APIC-edge timer 1: 2 9 IO-APIC-edge i8042 2: 0 0 XT-PIC cascade 8: 1 0 IO-APIC-edge rtc 12: 2 48 IO-APIC-edge i8042 14: 3222 1850 IO-APIC-edge ide0 15: 1 0 IO-APIC-edge ide1 16: 471 459 IO-APIC-level eth0 NMI: 0 0 LOC: 208023 208022 ERR: 0 MIS: 0 --Matt Kanar ^ permalink raw reply [flat|nested] 29+ messages in thread
end of thread, other threads:[~2003-12-08 19:25 UTC | newest]
Thread overview: 29+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2003-12-06 2:32 SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? Colin Coe
2003-12-06 2:42 ` William Lee Irwin III
2003-12-06 2:48 ` William Lee Irwin III
2003-12-06 2:48 ` Nick Piggin
2003-12-06 3:07 ` William Lee Irwin III
2003-12-06 4:28 ` Stian Jordet
2003-12-06 4:37 ` William Lee Irwin III
2003-12-06 4:48 ` Stian Jordet
2003-12-06 4:54 ` William Lee Irwin III
2003-12-06 4:57 ` Stian Jordet
2003-12-06 5:09 ` William Lee Irwin III
2003-12-06 5:14 ` Stian Jordet
2003-12-06 5:40 ` William Lee Irwin III
2003-12-08 15:57 ` bill davidsen
2003-12-08 16:47 ` William Lee Irwin III
2003-12-06 7:11 ` Colin Coe
2003-12-08 15:45 ` bill davidsen
2003-12-08 17:36 ` Zwane Mwaikambo
2003-12-06 14:07 ` Adam Kropelin
2003-12-06 7:02 ` Colin Coe
2003-12-06 10:58 ` William Lee Irwin III
2003-12-06 20:08 ` Ethan Weinstein
2003-12-06 14:40 ` IRQ balancing Sean Neakums
2003-12-06 14:48 ` Sean Neakums
[not found] <fa.jiqirm0.13gv2u@ifi.uio.no>
[not found] ` <fa.f9f2gij.1kua0f@ifi.uio.no>
2003-12-06 17:38 ` SMP broken on Dell PowerEdge 4100/200 under 2.6.0-testxx? William Park
[not found] <ZAwx-88m-3@gated-at.bofh.it>
[not found] ` <ZAGd-8ma-5@gated-at.bofh.it>
[not found] ` <ZAQ7-6X-13@gated-at.bofh.it>
[not found] ` <ZAZB-pS-11@gated-at.bofh.it>
[not found] ` <ZCoI-2oz-9@gated-at.bofh.it>
[not found] ` <ZCyh-2Bv-1@gated-at.bofh.it>
[not found] ` <ZCI5-2Pv-3@gated-at.bofh.it>
[not found] ` <ZCIb-2Pv-11@gated-at.bofh.it>
2003-12-08 16:42 ` Matthew Kanar
2003-12-08 17:21 ` William Lee Irwin III
2003-12-08 17:38 ` Zwane Mwaikambo
[not found] <10wU2-1mR-11@gated-at.bofh.it>
[not found] ` <10wU2-1mR-13@gated-at.bofh.it>
[not found] ` <10wU2-1mR-15@gated-at.bofh.it>
[not found] ` <10wU3-1mR-17@gated-at.bofh.it>
[not found] ` <10wU3-1mR-19@gated-at.bofh.it>
[not found] ` <10wU3-1mR-21@gated-at.bofh.it>
[not found] ` <10wU3-1mR-23@gated-at.bofh.it>
[not found] ` <10wU3-1mR-25@gated-at.bofh.it>
[not found] ` <10wU2-1mR-9@gated-at.bofh.it>
[not found] ` <10xGk-38t-15@gated-at.bofh.it>
2003-12-08 19:24 ` Matthew Kanar
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).