Ok, here are the outputs: 1.) the config diffs (I can not garantee any more that this is an orginal .config, because I now already tried some things to make it perhaps work..., however it's still CONFIG_NOHIGHMEM=y ?!): 2.) Output of lspci -v 3.) Output of lspci -vv I also included these files as an attachment >> P.S.: As I was using the newest CSets (1.1183) SMP was disabled in the >kernel configs, while >> I was booting on the Dual-Xeon machine. >yes, and that's how it's supposed to be: Domain kernels cannot use >multiple CPUs but Xen has support for SMP, and if you run multiple >domains, you can have each run on a different CPUs. Yes, Ian has explained that to me ;-) I just wanted to say that I did not try any tricks with the config files of the new CSets to make SMP "work" again... ;-) 1.): --- linux-2.6.7-xen0/.config 2004-08-09 22:41:11.000000000 +0200 +++ linux-2.6.7-xen-sparse/arch/xen/configs/xen0_defconfig 2004-08-09 21:43:46.000000000 +0200 @@ -62,6 +62,11 @@ CONFIG_MMU=y CONFIG_UID16=y CONFIG_GENERIC_ISA_DMA=y +# CONFIG_M386 is not set +# CONFIG_M486 is not set +# CONFIG_M586 is not set +# CONFIG_M586TSC is not set +# CONFIG_M586MMX is not set # CONFIG_M686 is not set # CONFIG_MPENTIUMII is not set # CONFIG_MPENTIUMIII is not set @@ -71,6 +76,9 @@ # CONFIG_MK7 is not set # CONFIG_MK8 is not set # CONFIG_MCRUSOE is not set +# CONFIG_MWINCHIPC6 is not set +# CONFIG_MWINCHIP2 is not set +# CONFIG_MWINCHIP3D is not set # CONFIG_MCYRIXIII is not set # CONFIG_MVIAC3_2 is not set # CONFIG_X86_GENERIC is not set @@ -97,6 +105,7 @@ # CONFIG_EDD is not set CONFIG_NOHIGHMEM=y # CONFIG_HIGHMEM4G is not set +# CONFIG_HIGHMEM64G is not set CONFIG_HAVE_DEC_LOCK=y # CONFIG_REGPARM is not set @@ -238,7 +247,7 @@ # CONFIG_CHR_DEV_ST is not set # CONFIG_CHR_DEV_OSST is not set # CONFIG_BLK_DEV_SR is not set -CONFIG_CHR_DEV_SG=y +# CONFIG_CHR_DEV_SG is not set # # Some SCSI devices (e.g. CD jukebox) support multiple LUNs @@ -261,16 +270,38 @@ # CONFIG_SCSI_ACARD is not set # CONFIG_SCSI_AHA152X is not set # CONFIG_SCSI_AHA1542 is not set -# CONFIG_SCSI_AACRAID is not set -# CONFIG_SCSI_AIC7XXX is not set +CONFIG_SCSI_AACRAID=y +CONFIG_SCSI_AIC7XXX=y +CONFIG_AIC7XXX_CMDS_PER_DEVICE=32 +CONFIG_AIC7XXX_RESET_DELAY_MS=15000 +# CONFIG_AIC7XXX_BUILD_FIRMWARE is not set +CONFIG_AIC7XXX_DEBUG_ENABLE=y +CONFIG_AIC7XXX_DEBUG_MASK=0 +CONFIG_AIC7XXX_REG_PRETTY_PRINT=y # CONFIG_SCSI_AIC7XXX_OLD is not set -# CONFIG_SCSI_AIC79XX is not set +CONFIG_SCSI_AIC79XX=y +CONFIG_AIC79XX_CMDS_PER_DEVICE=32 +CONFIG_AIC79XX_RESET_DELAY_MS=15000 +# CONFIG_AIC79XX_BUILD_FIRMWARE is not set +# CONFIG_AIC79XX_ENABLE_RD_STRM is not set +CONFIG_AIC79XX_DEBUG_ENABLE=y +CONFIG_AIC79XX_DEBUG_MASK=0 +CONFIG_AIC79XX_REG_PRETTY_PRINT=y # CONFIG_SCSI_DPT_I2O is not set # CONFIG_SCSI_ADVANSYS is not set # CONFIG_SCSI_IN2000 is not set -# CONFIG_SCSI_MEGARAID is not set -# CONFIG_SCSI_SATA is not set -# CONFIG_SCSI_BUSLOGIC is not set +CONFIG_SCSI_MEGARAID=y +CONFIG_SCSI_SATA=y +# CONFIG_SCSI_SATA_SVW is not set +CONFIG_SCSI_ATA_PIIX=y +CONFIG_SCSI_SATA_PROMISE=y +CONFIG_SCSI_SATA_SX4=y +CONFIG_SCSI_SATA_SIL=y +# CONFIG_SCSI_SATA_SIS is not set +# CONFIG_SCSI_SATA_VIA is not set +# CONFIG_SCSI_SATA_VITESSE is not set +CONFIG_SCSI_BUSLOGIC=y +# CONFIG_SCSI_OMIT_FLASHPOINT is not set # CONFIG_SCSI_CPQFCTS is not set # CONFIG_SCSI_DMX3191D is not set # CONFIG_SCSI_DTC3280 is not set 2.): 00:00.0 Host bridge: Intel Corp. E7501 Memory Controller Hub (rev 01) Flags: bus master, fast devsel, latency 0 Capabilities: [40] #09 [1105] 00:02.0 PCI bridge: Intel Corp. E7000 Series Hub Interface B PCI-to-PCI Bridge (rev 01) (prog-if 00 [Normal decode]) Flags: bus master, 66Mhz, fast devsel, latency 64 Bus: primary=00, secondary=05, subordinate=07, sec-latency=0 I/O behind bridge: 0000d000-0000dfff Memory behind bridge: fe800000-feafffff Prefetchable memory behind bridge: ff700000-ff9fffff Expansion ROM at 0000d000 [disabled] [size=4K] 00:03.0 PCI bridge: Intel Corp. E7000 Series Hub Interface C PCI-to-PCI Bridge (rev 01) (prog-if 00 [Normal decode]) Flags: bus master, 66Mhz, fast devsel, latency 64 Bus: primary=00, secondary=02, subordinate=04, sec-latency=0 I/O behind bridge: 0000b000-0000cfff Memory behind bridge: fc500000-fe7fffff Prefetchable memory behind bridge: ff400000-ff6fffff Expansion ROM at 0000b000 [disabled] [size=8K] 00:1d.0 USB Controller: Intel Corp. 82801CA/CAM USB (Hub #1) (rev 02) (prog-if 00 [UHCI]) Subsystem: Intel Corp.: Unknown device 2480 Flags: bus master, medium devsel, latency 0, IRQ 16 I/O ports at e800 [size=32] 00:1e.0 PCI bridge: Intel Corp. 82801BA/CA/DB/EB/ER Hub interface to PCI Bridge (rev 42) (prog-if 00 [Normal decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=00, secondary=01, subordinate=01, sec-latency=32 I/O behind bridge: 00009000-0000afff Memory behind bridge: fa400000-fc4fffff Prefetchable memory behind bridge: ff300000-ff3fffff 00:1f.0 ISA bridge: Intel Corp. 82801CA LPC Interface Controller (rev 02) Flags: bus master, medium devsel, latency 0 00:1f.1 IDE interface: Intel Corp. 82801CA Ultra ATA Storage Controller (rev 02) (prog-if 8a [Master SecP PriP]) Subsystem: Intel Corp.: Unknown device 2480 Flags: bus master, medium devsel, latency 0, IRQ 18 I/O ports at I/O ports at I/O ports at I/O ports at I/O ports at ffa0 [size=16] Memory at 40000000 (32-bit, non-prefetchable) [size=1K] 00:1f.3 SMBus: Intel Corp. 82801CA/CAM SMBus Controller (rev 02) Subsystem: Intel Corp.: Unknown device 2480 Flags: medium devsel, IRQ 17 I/O ports at 0540 [size=32] 01:01.0 Ethernet controller: Intel Corp. 82557/8/9 [Ethernet Pro 100] (rev 10) Subsystem: Intel Corp. EtherExpress PRO/100 S Server Adapter Flags: bus master, medium devsel, latency 64, IRQ 19 Memory at fc4fd000 (32-bit, non-prefetchable) I/O ports at a000 [size=64] Memory at fc4a0000 (32-bit, non-prefetchable) [size=128K] Capabilities: [dc] Power Management version 2 01:02.0 VGA compatible controller: ATI Technologies Inc Rage XL (rev 27) (prog-if 00 [VGA]) Subsystem: ATI Technologies Inc Rage XL Flags: bus master, stepping, medium devsel, latency 64, IRQ 18 Memory at fb000000 (32-bit, non-prefetchable) [size=fc4c0000] I/O ports at a800 [size=256] Memory at fc4ff000 (32-bit, non-prefetchable) [size=4K] Expansion ROM at 00020000 [disabled] Capabilities: [5c] Power Management version 2 01:03.0 Ethernet controller: Peppercon AG ROL/F-100 Fast Ethernet Adapter with ROL (rev 10) Subsystem: Realtek Semiconductor Co., Ltd.: Unknown device 8139 Flags: bus master, medium devsel, latency 64, IRQ 18 I/O ports at a400 [size=fc4e0000] Memory at fc4fec00 (32-bit, non-prefetchable) [size=256] Expansion ROM at 00010000 [disabled] Capabilities: [50] Power Management version 2 02:1c.0 PIC: Intel Corp. 82870P2 P64H2 I/OxAPIC (rev 04) (prog-if 20 [IO(X)-APIC]) Subsystem: Intel Corp. 82870P2 P64H2 I/OxAPIC Flags: bus master, 66Mhz, fast devsel, latency 0 Memory at fe7fe000 (32-bit, non-prefetchable) Capabilities: [50] PCI-X non-bridge device. 02:1d.0 PCI bridge: Intel Corp. 82870P2 P64H2 Hub PCI Bridge (rev 04) (prog-if 00 [Normal decode]) Flags: bus master, 66Mhz, fast devsel, latency 64 Bus: primary=02, secondary=04, subordinate=04, sec-latency=64 I/O behind bridge: 0000c000-0000cfff Memory behind bridge: fd600000-fe6fffff Prefetchable memory behind bridge: 00000000ff500000-00000000ff500000 Expansion ROM at 0000c000 [disabled] [size=4K] Capabilities: [50] PCI-X bridge device. 02:1e.0 PIC: Intel Corp. 82870P2 P64H2 I/OxAPIC (rev 04) (prog-if 20 [IO(X)-APIC]) Subsystem: Intel Corp. 82870P2 P64H2 I/OxAPIC Flags: bus master, 66Mhz, fast devsel, latency 0 Memory at fe7ff000 (32-bit, non-prefetchable) Capabilities: [50] PCI-X non-bridge device. 02:1f.0 PCI bridge: Intel Corp. 82870P2 P64H2 Hub PCI Bridge (rev 04) (prog-if 00 [Normal decode]) Flags: bus master, 66Mhz, fast devsel, latency 64 Bus: primary=02, secondary=03, subordinate=03, sec-latency=64 I/O behind bridge: 0000b000-0000bfff Memory behind bridge: fc500000-fd5fffff Prefetchable memory behind bridge: 00000000ff400000-00000000ff400000 Expansion ROM at 0000b000 [disabled] [size=4K] Capabilities: [50] PCI-X bridge device. 03:03.0 RAID bus controller: 3ware Inc 3ware 7000-series ATA-RAID (rev 01) Subsystem: 3ware Inc 3ware 7000-series ATA-RAID Flags: bus master, 66Mhz, medium devsel, latency 64, IRQ 72 I/O ports at b800 [size=fd5e0000] Memory at fd5ffc00 (32-bit, non-prefetchable) [size=16] Memory at fc800000 (32-bit, non-prefetchable) [size=8M] Expansion ROM at 00010000 [disabled] Capabilities: [40] Power Management version 1 04:03.0 RAID bus controller: 3ware Inc 3ware 7000-series ATA-RAID (rev 01) Subsystem: 3ware Inc 3ware 7000-series ATA-RAID Flags: bus master, medium devsel, latency 64, IRQ 96 I/O ports at c800 [size=fe6e0000] Memory at fe6ffc00 (32-bit, non-prefetchable) [size=16] Memory at fd800000 (32-bit, non-prefetchable) [size=8M] Expansion ROM at 00010000 [disabled] Capabilities: [40] Power Management version 1 05:1c.0 PIC: Intel Corp. 82870P2 P64H2 I/OxAPIC (rev 04) (prog-if 20 [IO(X)-APIC]) Subsystem: Intel Corp. 82870P2 P64H2 I/OxAPIC Flags: bus master, 66Mhz, fast devsel, latency 0 Memory at feafe000 (32-bit, non-prefetchable) Capabilities: [50] PCI-X non-bridge device. 05:1d.0 PCI bridge: Intel Corp. 82870P2 P64H2 Hub PCI Bridge (rev 04) (prog-if 00 [Normal decode]) Flags: bus master, 66Mhz, fast devsel, latency 64 Bus: primary=05, secondary=07, subordinate=07, sec-latency=64 I/O behind bridge: 0000d000-0000dfff Memory behind bridge: fe900000-fe9fffff Prefetchable memory behind bridge: 00000000ff800000-00000000ff800000 Expansion ROM at 0000d000 [disabled] [size=4K] Capabilities: [50] PCI-X bridge device. 05:1e.0 PIC: Intel Corp. 82870P2 P64H2 I/OxAPIC (rev 04) (prog-if 20 [IO(X)-APIC]) Subsystem: Intel Corp. 82870P2 P64H2 I/OxAPIC Flags: bus master, 66Mhz, fast devsel, latency 0 Memory at feaff000 (32-bit, non-prefetchable) Capabilities: [50] PCI-X non-bridge device. 05:1f.0 PCI bridge: Intel Corp. 82870P2 P64H2 Hub PCI Bridge (rev 04) (prog-if 00 [Normal decode]) Flags: bus master, 66Mhz, fast devsel, latency 64 Bus: primary=05, secondary=06, subordinate=06, sec-latency=64 Memory behind bridge: fe800000-fe8fffff Prefetchable memory behind bridge: 00000000ff700000-00000000ff700000 Capabilities: [50] PCI-X bridge device. 06:03.0 FireWire (IEEE 1394): NEC Corporation IEEE 1394 Host Controller (rev 01) (prog-if 10 [OHCI]) Subsystem: NEC Corporation: Unknown device 00ce Flags: bus master, medium devsel, latency 64, IRQ 24 Memory at fe8ff000 (32-bit, non-prefetchable) Capabilities: [60] Power Management version 2 07:01.0 Ethernet controller: Intel Corp. 82546EB Gigabit Ethernet Controller (Copper) (rev 01) Subsystem: Intel Corp. PRO/1000 MT Dual Port Server Adapter Flags: bus master, 66Mhz, medium devsel, latency 64, IRQ 48 Memory at fe9a0000 (64-bit, non-prefetchable) I/O ports at d400 [size=64] Capabilities: [dc] Power Management version 2 Capabilities: [e4] PCI-X non-bridge device. Capabilities: [f0] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable- 07:01.1 Ethernet controller: Intel Corp. 82546EB Gigabit Ethernet Controller (Copper) (rev 01) Subsystem: Intel Corp. PRO/1000 MT Dual Port Server Adapter Flags: bus master, 66Mhz, medium devsel, latency 64, IRQ 49 Memory at fe9e0000 (64-bit, non-prefetchable) I/O ports at d800 [size=64] Capabilities: [dc] Power Management version 2 Capabilities: [e4] PCI-X non-bridge device. Capabilities: [f0] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable- 3.): 00:00.0 Host bridge: Intel Corp. E7501 Memory Controller Hub (rev 01) Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- Status: Cap+ 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- SERR- TAbort- SERR- Reset- FastB2B- 00:03.0 PCI bridge: Intel Corp. E7000 Series Hub Interface C PCI-to-PCI Bridge (rev 01) (prog-if 00 [Normal decode]) Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- Status: Cap- 66Mhz+ UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- SERR- Reset- FastB2B- 00:1d.0 USB Controller: Intel Corp. 82801CA/CAM USB (Hub #1) (rev 02) (prog-if 00 [UHCI]) Subsystem: Intel Corp.: Unknown device 2480 Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- SERR- TAbort- SERR- Reset- FastB2B- 00:1f.0 ISA bridge: Intel Corp. 82801CA LPC Interface Controller (rev 02) Control: I/O+ Mem+ BusMaster+ SpecCycle+ MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- SERR- TAbort- SERR- Region 1: I/O ports at Region 2: I/O ports at Region 3: I/O ports at Region 4: I/O ports at ffa0 [size=16] Region 5: Memory at 40000000 (32-bit, non-prefetchable) [size=1K] 00:1f.3 SMBus: Intel Corp. 82801CA/CAM SMBus Controller (rev 02) Subsystem: Intel Corp.: Unknown device 2480 Control: I/O+ Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- Reset- FastB2B- Capabilities: [50] PCI-X bridge device. Secondary Status: 64bit+, 133MHz+, SCD-, USC-, SCO-, SRD- Freq=0 Status: Bus=2 Dev=29 Func=0 64bit+ 133MHz+ SCD- USC-, SCO-, SRD- : Upstream: Capacity=65535, Commitment Limit=65535 : Downstream: Capacity=65535, Commitment Limit=65535 02:1e.0 PIC: Intel Corp. 82870P2 P64H2 I/OxAPIC (rev 04) (prog-if 20 [IO(X)-APIC]) Subsystem: Intel Corp. 82870P2 P64H2 I/OxAPIC Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- SERR- TAbort- SERR- Reset- FastB2B- Capabilities: [50] PCI-X bridge device. Secondary Status: 64bit+, 133MHz+, SCD-, USC-, SCO-, SRD- Freq=0 Status: Bus=2 Dev=31 Func=0 64bit+ 133MHz+ SCD- USC-, SCO-, SRD- : Upstream: Capacity=65535, Commitment Limit=65535 : Downstream: Capacity=65535, Commitment Limit=65535 03:03.0 RAID bus controller: 3ware Inc 3ware 7000-series ATA-RAID (rev 01) Subsystem: 3ware Inc 3ware 7000-series ATA-RAID Control: I/O+ Mem+ BusMaster+ SpecCycle+ MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- Status: Cap+ 66Mhz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- Reset- FastB2B- Capabilities: [50] PCI-X bridge device. Secondary Status: 64bit+, 133MHz+, SCD-, USC-, SCO-, SRD- Freq=3 Status: Bus=5 Dev=29 Func=0 64bit+ 133MHz+ SCD- USC-, SCO-, SRD- : Upstream: Capacity=65535, Commitment Limit=65535 : Downstream: Capacity=65535, Commitment Limit=65535 05:1e.0 PIC: Intel Corp. 82870P2 P64H2 I/OxAPIC (rev 04) (prog-if 20 [IO(X)-APIC]) Subsystem: Intel Corp. 82870P2 P64H2 I/OxAPIC Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- SERR- TAbort- SERR- Reset- FastB2B- Capabilities: [50] PCI-X bridge device. Secondary Status: 64bit+, 133MHz+, SCD-, USC-, SCO-, SRD- Freq=0 Status: Bus=5 Dev=31 Func=0 64bit+ 133MHz+ SCD- USC-, SCO-, SRD- : Upstream: Capacity=65535, Commitment Limit=65535 : Downstream: Capacity=65535, Commitment Limit=65535 06:03.0 FireWire (IEEE 1394): NEC Corporation IEEE 1394 Host Controller (rev 01) (prog-if 10 [OHCI]) Subsystem: NEC Corporation: Unknown device 00ce Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- Status: Cap+ 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- SERR- TAbort- SERR- TAbort- SERR- On Mon, Aug 09, 2004 at 10:45:17PM +0200, Sven Kretzschmar wrote: >> >> I tried to make xen work on a dual-Xeon (1 Gig RAM, 2 3ware ATA-Raid >Controlers) >> with both 2.4.26 and 2.6.7 kernels, but had no success :-( >> >> I cloned the newest repository (CSet 1.1183) in an empty dir and only >did: >> >> 1.) make world >> 2.) make linux26 >> 3.) make install >> >> Then during boot of the 2.6 kernel I got the following message during >boot: >> >> fixmap and kmap areas overlap - this will crash >> pkstart: ff800000h pkend: ffc00000h fixstart fbeec000h >> ... >> kernel BUG at arch/xen/i386/mm/init.c:583! >> invalid operand: 0000 [#1] >> ... >> <0>Kernel panic: Attempted to kill the idel task! >> In idle task - not syncing > >That's very odd, because this code is only enable with CONFIG_HIGHMEM >and that's not enabled in 2.6 (and also broken for at least one reason). >I guess the build picked up an old .config or install/boot/config* file, >which is odd since you write that you cloned to an empty dir. Could >you please compare your .config file with the default config file we >provide at linux-2.6.7-xen-sparse/arch/xen/configs/xen0_defconfig >(i.e run diff -u linux-2.6.7-xen0/.config >linux-2.6.7-xen-sparse/arch/xen/configs/xen0_defconfig) > >> When booting with the 2.4 kernel I get the same errors as I got earlier >with >> trying to boot a 2.6. xen kernel on the same machine (with older CSets) >> - however I had to add the 3ware drivers to the 2.4 kernel config first, >it >> was not included by default - : > >Could you boot without Xen (native 2.4 or 2.6 kernel, with smp support) >and then send the output of lspci -v? > >> It seems that the Dual-Xeon machine with 3ware Raid-Controler is a very >challenging >> configuration for XenLinux, which discoveres some potential >bugs/problems ;-) >> Anybody else had problems booting the newer CSets on SMP machines ? > >Not really, most of our machines are SMP. None of them have 3ware >Raid-Controllers and I don't really think it matters wether it's an >SMP machine or not. > >> P.S.: As I was using the newest CSets (1.1183) SMP was disabled in the >kernel configs, while >> I was booting on the Dual-Xeon machine. > >yes, and that's how it's supposed to be: Domain kernels cannot use >multiple CPUs but Xen has support for SMP, and if you run multiple >domains, you can have each run on a different CPUs. > > christian