All of lore.kernel.org
 help / color / mirror / Atom feed
* PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
       [not found] <20101115233253.11935.35707.reportbug@zerohal>
@ 2010-11-23 11:51 ` Ian Campbell
  2010-11-23 12:44   ` Bug#603632: " Cris Daniluk
                     ` (3 more replies)
  0 siblings, 4 replies; 23+ messages in thread
From: Ian Campbell @ 2010-11-23 11:51 UTC (permalink / raw)
  To: Vincent CARON, 603632
  Cc: Cris Daniluk, xen-devel, Keir Fraser, Jeremy Fitzhardinge

[-- Attachment #1: Type: text/plain, Size: 10793 bytes --]

Thanks for the report Vincent.

I've added xen-devel to the CC as well as Cris Daniluk who previously
reported a very similar issue[0] also on an R410 -- Cris did you ever
get a resolution to your issue?

Vincent's full report is at:
http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=603632
I've also attached the boot log here of which the interesting part looks
to be:
        
        [    8.422639] xen: acpi sci 9
        [    8.434217] Console: colour VGA+ 80x25
        [    8.441350] console [hvc0] enabled, bootconsole disabled
        [    8.441350] console [hvc0] enabled, bootconsole disabled
        [    8.462694] Xen: using vcpuop timer interface
        [    8.471508] installing Xen timer for CPU 0
        [    8.479841] BUG: unable to handle kernel paging request at 0000000000005a08
        [    8.493868] IP: [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
        [    8.507041] PGD 0 
        [    8.511199] Thread overran stack, or stack corrupted
        [    8.521253] Oops: 0000 [#1] SMP 
        [    8.527838] last sysfs file: 
        [    8.533941] CPU 0 
        [    8.538100] Modules linked in:
        [    8.544342] Pid: 0, comm: swapper Not tainted 2.6.32-5-xen-amd64 #1 PowerEdge R410
        [    8.559594] RIP: e030:[<ffffffff810badce>]  [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
        [    8.577620] RSP: e02b:ffffffff81443c88  EFLAGS: 00010046
        [    8.588366] RAX: 0000000000000000 RBX: 0000000000005220 RCX: 0000000000005a00
        [    8.602752] RDX: 0000000000000000 RSI: 0000000000000002 RDI: 0000000000005220
        [    8.617139] RBP: 0000000000004020 R08: 0000000000000002 R09: ffff88003fc1c010
        [    8.631525] R10: ffffffff813c2700 R11: 00000000000186a0 R12: 0000000000005220
        [    8.645910] R13: 0000000000000002 R14: 0000000000000000 R15: ffff88000000da28
        [    8.660300] FS:  0000000000000000(0000) GS:ffff88000349b000(0000) knlGS:0000000000000000
        [    8.676591] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
        [    8.688203] CR2: 0000000000005a08 CR3: 0000000001001000 CR4: 0000000000002660
        [    8.702589] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
        [    8.716975] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
        [    8.731361] Process swapper (pid: 0, threadinfo ffffffff81442000, task ffffffff814771f0)
        [    8.747654] Stack:
        [    8.751813]  ffff88000000da00 00000010813c2765 00000000000212d0 00000000000186a0
        [    8.766199] <0> ffff88000000ac10 ffffffff8100e5b5 ffffffff8100ec72 00000000000186a0
        [    8.781625] <0> 00000000000186a0 0000000000000000 0000000000005a00 0000000000000000
        [    8.797572] Call Trace:
        [    8.802603]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
        [    8.815600]  [<ffffffff8100ec72>] ? check_events+0x12/0x20
        [    8.826695]  [<ffffffff810e759d>] ? new_slab+0x42/0x1ca
        [    8.837267]  [<ffffffff810e7915>] ? __slab_alloc+0x1f0/0x39b
        [    8.848707]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
        [    8.861704]  [<ffffffff810e85cb>] ? __kmalloc_node+0xe8/0x146
        [    8.873317]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
        [    8.886316]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
        [    8.899317]  [<ffffffff811f24df>] ? find_unbound_irq+0x67/0xae
        [    8.911103]  [<ffffffff811f259e>] ? bind_virq_to_irq+0x78/0x126
        [    8.923062]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
        [    8.936063]  [<ffffffff8100e8f6>] ? xen_timer_interrupt+0x0/0x18d
        [    8.948368]  [<ffffffff811f29f6>] ? bind_virq_to_irqhandler+0x19/0x4a
        [    8.961368]  [<ffffffff8100e884>] ? xen_setup_timer+0x55/0xaa
        [    8.972982]  [<ffffffff81509a5e>] ? xen_time_init+0xaf/0xb5
        [    8.984247]  [<ffffffff8150a491>] ? x86_late_time_init+0xa/0x10
        [    8.996206]  [<ffffffff81506c3d>] ? start_kernel+0x348/0x3e8
        [    9.007646]  [<ffffffff81508c7d>] ? xen_start_kernel+0x57c/0x581
        [    9.019777] Code: d8 c1 e8 13 83 e0 01 09 44 24 64 41 89 dc 44 23 25 28 01 43 00 44 89 e2 83 e2 10 89 54 24 5c 74 05 e8 16 03 25 00 48 8b 4c 24 50 <48> 83 79 08 00 0f 84 30 05 00 00 83 e3 0f 48 8b 44 24 50 41 bf 
        [    9.057561] RIP  [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
        [    9.070909]  RSP <ffffffff81443c88>
        [    9.078015] CR2: 0000000000005a08
        [    9.084780] ---[ end trace a7919e7f17c0a725 ]---
        [    9.094136] Kernel panic - not syncing: Attempted to kill the idle task!

It's worth noting that the Debian kernels are based on
e73f4955a821f850f5b88c32d12a81714523a95f (less the GPU fixes merged by
bcf16b6b4f34fb40a7aaf637947c7d3bce0be671, which the Debian kernel
maintainer chose to exclude).

The baseline is slightly old but Debian is now pretty deeply frozen so a
wholesale rebase is not possible, if either of you have run a more
recent kernel the result would be interesting to know.

The actual crashing RIP corresponds to mm/page_alloc.c:1975 which is in
__alloc_pages_nodemask:

        /*
         * Check the zones suitable for the gfp_mask contain at least one
         * valid zone. It's possible to have an empty zonelist as a result
         * of GFP_THISNODE and a memoryless node
         */
        if (unlikely(!zonelist->_zonerefs->zone))
                return NULL;

zonelist->_zonerefs is an array but looking at the disassembly and the
register dump zonelist itself appears to be 0x5a00 which seems unlikely
to be valid.

The zonelist ultimately comes from node which is always passed as 0 in
the outer most caller in this stack trace (find_unbound_irq calling
irq_to_desc_alloc_node).

I'm not sure but looking at the complete bootlog it looks as if the
system may only have node==1 i.e. no 0 node which could plausibly lead
to this sort of issue:
        [    0.000000] Bootmem setup node 1 0000000000000000-0000000040000000
        [    0.000000]   NODE_DATA [0000000000008000 - 000000000000ffff]
        [    0.000000]   bootmap [0000000000010000 -  0000000000017fff] pages 8
        [    0.000000] (8 early reservations) ==> bootmem [0000000000 - 0040000000]
        [    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
        [    0.000000]   #1 [0003446000 - 0003465000]   XEN PAGETABLES ==> [0003446000 - 0003465000]
        [    0.000000]   #2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
        [    0.000000]   #3 [0001000000 - 0001694994]    TEXT DATA BSS ==> [0001000000 - 0001694994]
        [    0.000000]   #4 [00016b5000 - 0003244e00]          RAMDISK ==> [00016b5000 - 0003244e00]
        [    0.000000]   #5 [0003245000 - 0003446000]   XEN START INFO ==> [0003245000 - 0003446000]
        [    0.000000]   #6 [0001695000 - 000169532d]              BRK ==> [0001695000 - 000169532d]
        [    0.000000]   #7 [0000100000 - 00002e0000]          PGTABLE ==> [0000100000 - 00002e0000]
        [    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
        [    0.000000] Zone PFN ranges:
        [    0.000000]   DMA      0x00000000 -> 0x00001000
        [    0.000000]   DMA32    0x00001000 -> 0x00100000
        [    0.000000]   Normal   0x00100000 -> 0x00100000
        [    0.000000] Movable zone start PFN for each node
        [    0.000000] early_node_map[2] active PFN ranges
        [    0.000000]     1: 0x00000000 -> 0x000000a0
        [    0.000000]     1: 0x00000100 -> 0x00040000
        [    0.000000] On node 1 totalpages: 262048
        [    0.000000]   DMA zone: 56 pages used for memmap
        [    0.000000]   DMA zone: 483 pages reserved
        [    0.000000]   DMA zone: 3461 pages, LIFO batch:0
        [    0.000000]   DMA32 zone: 3528 pages used for memmap
        [    0.000000]   DMA32 zone: 254520 pages, LIFO batch:31

Perhaps we should be passing numa_node_id() (e.g. current node) instead
of node 0? There doesn't seem to be another obvious alternative to
passing in an explicit node number to this callchain (some places cope
with -1 but not this path AFAICT).

It's also not obvious if dom0 should be seeing the tables which describe
the hosts nodes anyway or if we should be clobbering something. Given
that dom0 sees a pseudo-physical address map I'm not convinced seeing
the real SRAT is in any way beneficial. Perhaps we should simply be
clobbering NUMAness until actual PV understanding of NUMA is ready?

One thing I notice when googling R410 issues is that they apparently
have a "Cores per CPU" BIOS option which might be worth playing with,
since configuring a reduced number of cores might remove node 0 but not
node 1 (odd but not invalid?). Presumably it is also worth making sure
you have the latest BIOS etc.

It's very much an outside possibility but it is also worth trying the
packages at http://xenbits.xen.org/people/ianc/ which reinstates the
changesets from bcf16b6b4f34fb40a7aaf637947c7d3bce0be671

Ian.

[0]
http://lists.xensource.com/archives/html/xen-devel/2010-06/msg01140.html

On Tue, 2010-11-16 at 00:32 +0100, Vincent CARON wrote:
> Package: linux-image-2.6.32-5-xen-amd64
> Version: 2.6.32-27
> Severity: important
> 
> I just tried d-i 6beta1 and booted Squeeeze and its 2.6.32 kernel for
> the first time on my usual server hardware (Dell R410).
> 
> I opted for the xen-amd64 kernel, and it boots fine on bare metal. But
> as soon as I tried to boot it as dom0 over Xen hypervisor, it BUG's:
> 
> [    8.479841] BUG: unable to handle kernel paging request at
> 0000000000005a08^M
> [    8.493868] IP: [<ffffffff810badce>]
> __alloc_pages_nodemask+0x8f/0x5f5^M
> 
>   Then quickly oopses and panics. I tried various flags:
>   - upping dom0_mem from 256M to 1024M (I've been running Lenny/Xen 3.2
>     with 256M happily for several months on the same hw)
>   - using Xen 'nommu'
>   - using Linux nomodeset
> 
>   Then I followed instructions on a Xen wiki page to provide verbose
>   traces (although they do not look much more verbose than the regular
>   boot).
> 
>   I'm using an IPMI serial-over-lan console which appears as a regular
>   UART to Xen.
> 
>   I'm attaching a boot log to this report.
> 
> -- System Information:
> Debian Release: squeeze/sid
>   APT prefers testing
>   APT policy: (500, 'testing')
> Architecture: amd64 (x86_64)
> 
> Kernel: Linux 2.6.32-5-amd64 (SMP w/2 CPU cores)
> Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
> Shell: /bin/sh linked to /bin/bash
> 
> 
> 

-- 
Ian Campbell
Current Noise: Wolf - Seize The Night

If you will practice being fictional for a while, you will understand that
fictional characters are sometimes more real than people with bodies and
heartbeats.

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: squeeze-xen-r410.log --]
[-- Type: text/x-log; name="squeeze-xen-r410.log"; charset="UTF-8", Size: 33953 bytes --]

Booting command-list

root  (hd0,0)
 Filesystem type is ext2fs, partition type 0x83
kernel  /boot/xen-4.0-amd64.gz com2=57600,8n1,0x2f8,3 console=com2 dom0_mem=102
4M loglvl=all guest_loglvl=all sync_console console_to_ring lapic=debug apic_ve
rbosity=debug apic=debug iommu=off
   [Multiboot-elf, <0x100000:0x15d000:0x143000>, shtab=0x3a0078, entry=0x100000
]
module  /boot/vmlinuz-2.6.32-5-xen-amd64 root=/dev/sda1 console=hvc0 nomodeset 
earlyprintk=xen initcall_debug debug loglevel=10
   [Multiboot-module @ 0x3a1000, 0x25baa0 bytes]
module  /boot/initrd.img-2.6.32-5-xen-amd64
   [Multiboot-module @ 0x5fd000, 0x1b8fe00 bytes]

(XEN) Xen version 4.0.1 (Debian 4.0.1-1) (waldi@debian.org) (gcc version 4.4.5 20100824 (prerelease) (Debian 4.4.4-11) ) Fri Sep  3 15:38:12 UTC 2010
(XEN) Console output is synchronous.
(XEN) Bootloader: GNU GRUB 0.97
(XEN) Command line: com2=57600,8n1,0x2f8,3 console=com2 dom0_mem=1024M loglvl=all guest_loglvl=all sync_console console_to_ring lapic=debug apic_verbosity=debug apic=debug iommu=off
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: none; EDID transfer time: 0 seconds
(XEN)  EDID info not retrieved because no DDC retrieval method detected
(XEN) Disc information:
(XEN)  Found 1 MBR signatures
(XEN)  Found 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 00000000000a0000 (usable)
(XEN)  0000000000100000 - 00000000cf679000 (usable)
(XEN)  00000000cf679000 - 00000000cf68f000 (reserved)
(XEN)  00000000cf68f000 - 00000000cf6ce000 (ACPI data)
(XEN)  00000000cf6ce000 - 00000000d0000000 (reserved)
(XEN)  00000000e0000000 - 00000000f0000000 (reserved)
(XEN)  00000000fe000000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000000230000000 (usable)
(XEN) ACPI: RSDP 000F09E0, 0024 (r2 DELL  )
(XEN) ACPI: XSDT 000F0AE4, 009C (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: FACP CF6B3F9C, 00F4 (r3 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: DSDT CF68F000, 3B39 (r1 DELL   PE_SC3          1 INTL 20050624)
(XEN) ACPI: FACS CF6B6000, 0040
(XEN) ACPI: APIC CF6B3478, 015E (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SPCR CF6B35D8, 0050 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: HPET CF6B362C, 0038 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: DM__ CF6B3668, 01B0 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: MCFG CF6B38C4, 003C (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: WD__ CF6B3904, 0134 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SLIC CF6B3A3C, 0024 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: ERST CF692CBC, 0270 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: HEST CF692F2C, 03A8 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: BERT CF692B3C, 0030 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: EINJ CF692B6C, 0150 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SRAT CF6B3BC0, 0370 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: TCPA CF6B3F34, 0064 (r2 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SSDT CF6B7000, 2104 (r1  INTEL PPM RCM  80000001 INTL 20061109)
(XEN) System RAM: 8182MB (8378468kB)
(XEN) SRAT: PXM 1 -> APIC 16 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 0 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 18 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 2 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 20 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 4 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 22 -> Node 0
(XEN) SRAT: PXM 2 -> APIC 6 -> Node 1
(XEN) SRAT: Node 1 PXM 2 0-d0000000
(XEN) SRAT: Node 1 PXM 2 100000000-130000000
(XEN) SRAT: Node 0 PXM 1 130000000-230000000
(XEN) NUMA: Using 16 for the hash shift.
(XEN) Reserving non-aligned node boundary @ mfn 0x130000
(XEN) Domain heap initialised DMA width 30 bits
(XEN) found SMP MP-table at 000fe710
(XEN) DMI 2.6 present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x808
(XEN) ACPI: ACPI SLEEP INFO: pm1x_cnt[804,0], pm1x_evt[800,0]
(XEN) ACPI:                  wakeup_vec[cf6b600c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled)
(XEN) Processor #16 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled)
(XEN) Processor #0 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled)
(XEN) Processor #18 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled)
(XEN) Processor #2 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled)
(XEN) Processor #20 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled)
(XEN) Processor #4 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled)
(XEN) Processor #22 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled)
(XEN) Processor #6 7:10 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x28] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x29] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x2a] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x2b] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2c] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2d] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x2f] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled)
(XEN) ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
(XEN) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32])
(XEN) IOAPIC[1]: apic_id 1, version 32, address 0xfec80000, GSI 32-55
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode:  Flat.  Using 2 I/O APICs
(XEN) ACPI: HPET id: 0x8086a301 base: 0xfed00000
(XEN) PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
(XEN) PCI: MCFG area at e0000000 reserved in E820
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) mapped APIC to ffff82c3ffffe000 (fee00000)
(XEN) mapped IOAPIC to ffff82c3ffffd000 (fec00000)
(XEN) mapped IOAPIC to ffff82c3ffffc000 (fec80000)
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2261.080 MHz processor.
(XEN) Initing memory sharing.
(XEN) CPU0: VMX disabled by BIOS.
(XEN) VMX: failed to initialise.
(XEN) Intel machine check reporting enabled
(XEN) I/O virtualisation disabled
(XEN) Getting VERSION: 60015
(XEN) Getting VERSION: 60015
(XEN) Getting ID: 10000000
(XEN) Getting LVT0: 700
(XEN) Getting LVT1: 400
(XEN) enabled ExtINT on CPU#0
(XEN) masked ExtINT on CPU#1
(XEN) masked ExtINT on CPU#2
(XEN) masked ExtINT on CPU#3
(XEN) masked ExtINT on CPU#4
(XEN) masked ExtINT on CPU#5
(XEN) masked ExtINT on CPU#6
(XEN) masked ExtINT on CPU#7
(XEN) Total of 8 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) init IO_APIC IRQs
(XEN)  IO-APIC (apicid-pin) 0-0, 0-16, 0-17, 0-18, 0-19, 0-20, 0-21, 0-22, 0-23, 1-0, 1-1, 1-2, 1-3, 1-4, 1-5, 1-6, 1-7, 1-8, 1-9, 1-10, 1-11, 1-12, 1-13, 1-14, 1-15, 1-16, 1-17, 1-18, 1-19, 1-20, 1-21, 1-22, 1-23 not connected.
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) number of MP IRQ sources: 15.
(XEN) number of IO-APIC #0 registers: 24.
(XEN) number of IO-APIC #1 registers: 24.
(XEN) testing the IO APIC.......................
(XEN) IO APIC #0......
(XEN) .... register #00: 00000000
(XEN) .......    : physical APIC id: 00
(XEN) .......    : Delivery Type: 0
(XEN) .......    : LTS          : 0
(XEN) .... register #01: 00170020
(XEN) .......     : max redirection entries: 0017
(XEN) .......     : PRQ implemented: 0
(XEN) .......     : IO APIC version: 0020
(XEN) .... IRQ redirection table:
(XEN)  NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
(XEN)  00 000 00  1    0    0   0   0    0    0    00
(XEN)  01 001 01  0    0    0   0   0    1    1    28
(XEN)  02 001 01  0    0    0   0   0    1    1    F0
(XEN)  03 0FF 0F  0    0    0   0   0    1    1    F2
(XEN)  04 001 01  0    0    0   0   0    1    1    30
(XEN)  05 001 01  0    0    0   0   0    1    1    38
(XEN)  06 001 01  0    0    0   0   0    1    1    40
(XEN)  07 001 01  0    0    0   0   0    1    1    48
(XEN)  08 001 01  0    0    0   0   0    1    1    50
(XEN)  09 001 01  1    1    0   0   0    1    1    58
(XEN)  0a 001 01  0    0    0   0   0    1    1    60
(XEN)  0b 001 01  0    0    0   0   0    1    1    68
(XEN)  0c 001 01  0    0    0   0   0    1    1    70
(XEN)  0d 001 01  0    0    0   0   0    1    1    78
(XEN)  0e 001 01  0    0    0   0   0    1    1    88
(XEN)  0f 001 01  0    0    0   0   0    1    1    90
(XEN)  10 000 00  1    0    0   0   0    0    0    00
(XEN)  11 000 00  1    0    0   0   0    0    0    00
(XEN)  12 000 00  1    0    0   0   0    0    0    00
(XEN)  13 000 00  1    0    0   0   0    0    0    00
(XEN)  14 000 00  1    0    0   0   0    0    0    00
(XEN)  15 000 00  1    0    0   0   0    0    0    00
(XEN)  16 000 00  1    0    0   0   0    0    0    00
(XEN)  17 000 00  1    0    0   0   0    0    0    00
(XEN) IO APIC #1......
(XEN) .... register #00: 00000000
(XEN) .......    : physical APIC id: 00
(XEN) .......    : Delivery Type: 0
(XEN) .......    : LTS          : 0
(XEN) .... register #01: 00170020
(XEN) .......     : max redirection entries: 0017
(XEN) .......     : PRQ implemented: 0
(XEN) .......     : IO APIC version: 0020
(XEN) .... register #02: 00000000
(XEN) .......     : arbitration: 00
(XEN) .... register #03: 00000001
(XEN) .......     : Boot DT    : 1
(XEN) .... IRQ redirection table:
(XEN)  NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
(XEN)  00 000 00  1    0    0   0   0    0    0    00
(XEN)  01 000 00  1    0    0   0   0    0    0    00
(XEN)  02 000 00  1    0    0   0   0    0    0    00
(XEN)  03 000 00  1    0    0   0   0    0    0    00
(XEN)  04 000 00  1    0    0   0   0    0    0    00
(XEN)  05 000 00  1    0    0   0   0    0    0    00
(XEN)  06 000 00  1    0    0   0   0    0    0    00
(XEN)  07 000 00  1    0    0   0   0    0    0    00
(XEN)  08 000 00  1    0    0   0   0    0    0    00
(XEN)  09 000 00  1    0    0   0   0    0    0    00
(XEN)  0a 000 00  1    0    0   0   0    0    0    00
(XEN)  0b 000 00  1    0    0   0   0    0    0    00
(XEN)  0c 000 00  1    0    0   0   0    0    0    00
(XEN)  0d 000 00  1    0    0   0   0    0    0    00
(XEN)  0e 000 00  1    0    0   0   0    0    0    00
(XEN)  0f 000 00  1    0    0   0   0    0    0    00
(XEN)  10 000 00  1    0    0   0   0    0    0    00
(XEN)  11 000 00  1    0    0   0   0    0    0    00
(XEN)  12 000 00  1    0    0   0   0    0    0    00
(XEN)  13 000 00  1    0    0   0   0    0    0    00
(XEN)  14 000 00  1    0    0   0   0    0    0    00
(XEN)  15 000 00  1    0    0   0   0    0    0    00
(XEN)  16 000 00  1    0    0   0   0    0    0    00
(XEN)  17 000 00  1    0    0   0   0    0    0    00
(XEN) Using vector-based indexing
(XEN) IRQ to pin mappings:
(XEN) IRQ240 -> 0:2
(XEN) IRQ40 -> 0:1
(XEN) IRQ242 -> 0:3
(XEN) IRQ48 -> 0:4
(XEN) IRQ56 -> 0:5
(XEN) IRQ64 -> 0:6
(XEN) IRQ72 -> 0:7
(XEN) IRQ80 -> 0:8
(XEN) IRQ88 -> 0:9
(XEN) IRQ96 -> 0:10
(XEN) IRQ104 -> 0:11
(XEN) IRQ112 -> 0:12
(XEN) IRQ120 -> 0:13
(XEN) IRQ136 -> 0:14
(XEN) IRQ144 -> 0:15
(XEN) .................................... done.
(XEN) Using local APIC timer interrupts.
(XEN) calibrating APIC timer ...
(XEN) ..... CPU clock speed is 2260.9880 MHz.
(XEN) ..... host bus clock speed is 132.9992 MHz.
(XEN) ..... bus_scale = 0x00008834
(XEN) TSC is reliable, synchronization unnecessary
(XEN) Platform timer is 14.318MHz HPET
ÿ(XEN) Allocated console ring of 64 KiB.
(XEN) microcode.c:73:d32767 microcode: CPU1 resumed
(XEN) microcode.c:73:d32767 microcode: CPU4 resumed
(XEN) microcode.c:73:d32767 microcode: CPU3 resumed
(XEN) Brought up 8 CPUs
(XEN) microcode.c:73:d32767 microcode: CPU7 resumed
(XEN) microcode.c:73:d32767 microcode: CPU2 resumed
(XEN) microcode.c:73:d32767 microcode: CPU5 resumed
(XEN) microcode.c:73:d32767 microcode: CPU6 resumed
(XEN) Turbo Mode detected!
(XEN) HPET: 4 timers in total, 0 timers will be used for broadcast
(XEN) ACPI sleep modes: S3
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) *** LOADING DOMAIN 0 ***
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x16b5000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000224000000->0000000228000000 (245760 pages to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff81000000->ffffffff816b5000
(XEN)  Init. ramdisk: ffffffff816b5000->ffffffff83244e00
(XEN)  Phys-Mach map: ffffffff83245000->ffffffff83445000
(XEN)  Start info:    ffffffff83445000->ffffffff834454b4
(XEN)  Page tables:   ffffffff83446000->ffffffff83465000
(XEN)  Boot stack:    ffffffff83465000->ffffffff83466000
(XEN)  TOTAL:         ffffffff80000000->ffffffff83800000
(XEN)  ENTRY ADDRESS: ffffffff81506200
(XEN) Dom0 has maximum 8 VCPUs
(XEN) Scrubbing Free RAM: ....................................................................done.
(XEN) trace.c:89:d32767 calc_tinfo_first_offset: NR_CPUs 128, offset_in_bytes 258, t_info_first_offset 65
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) **********************************************
(XEN) ******* WARNING: CONSOLE OUTPUT IS SYNCHRONOUS
(XEN) ******* This option is intended to aid debugging of Xen by ensuring
(XEN) ******* that all output is synchronously delivered on the serial line.
(XEN) ******* However it can introduce SIGNIFICANT latencies and affect
(XEN) ******* timekeeping. It is NOT recommended for production use!
(XEN) **********************************************
(XEN) 3... 2... 1... 
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 176kB init memory.
mapping kernel into physical memory
Xen: setup ISA identity maps
about to get started...
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 2.6.32-5-xen-amd64 (Debian 2.6.32-27) (maks@debian.org) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 SMP Sat Oct 30 17:04:10 UTC 2010
[    0.000000] Command line: root=/dev/sda1 console=hvc0 nomodeset earlyprintk=xen initcall_debug debug loglevel=10
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] released 0 pages of unused memory
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  Xen: 0000000000000000 - 00000000000a0000 (usable)
[    0.000000]  Xen: 00000000000a0000 - 0000000000100000 (reserved)
[    0.000000]  Xen: 0000000000100000 - 0000000040000000 (usable)
[    0.000000]  Xen: 00000000cf679000 - 00000000cf68f000 (reserved)
[    0.000000]  Xen: 00000000cf68f000 - 00000000cf6ce000 (ACPI data)
[    0.000000]  Xen: 00000000cf6ce000 - 00000000d0000000 (reserved)
[    0.000000]  Xen: 00000000e0000000 - 00000000f0000000 (reserved)
[    0.000000]  Xen: 00000000fe000000 - 0000000100000000 (reserved)
[    0.000000] bootconsole [xenboot0] enabled
[    0.000000] DMI 2.6 present.
[    0.000000] last_pfn = 0x40000 max_arch_pfn = 0x400000000
[    0.000000] x86 PAT enabled: cpu 0, old 0x50100070406, new 0x7010600070106
[    0.000000] initial memory mapped : 0 - 20000000
[    0.000000] init_memory_mapping: 0000000000000000-0000000040000000
[    0.000000]  0000000000 - 0040000000 page 4k
[    0.000000] kernel direct mapping tables up to 40000000 @ 100000-302000
[    0.000000] RAMDISK: 016b5000 - 03244e00
[    0.000000] ACPI: RSDP 00000000000f09e0 00024 (v02 DELL  )
[    0.000000] ACPI: XSDT 00000000000f0ae4 0009C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: FACP 00000000cf6b3f9c 000F4 (v03 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: DSDT 00000000cf68f000 03B39 (v01 DELL   PE_SC3   00000001 INTL 20050624)
[    0.000000] ACPI: FACS 00000000cf6b6000 00040
[    0.000000] ACPI: APIC 00000000cf6b3478 0015E (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SPCR 00000000cf6b35d8 00050 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: HPET 00000000cf6b362c 00038 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: DM__ 00000000cf6b3668 001B0 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: MCFG 00000000cf6b38c4 0003C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: WD__ 00000000cf6b3904 00134 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SLIC 00000000cf6b3a3c 00024 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: ERST 00000000cf692cbc 00270 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: HEST 00000000cf692f2c 003A8 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: BERT 00000000cf692b3c 00030 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: EINJ 00000000cf692b6c 00150 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SRAT 00000000cf6b3bc0 00370 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: TCPA 00000000cf6b3f34 00064 (v02 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SSDT 00000000cf6b7000 02104 (v01  INTEL PPM RCM  80000001 INTL 20061109)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] SRAT: PXM 1 -> APIC 16 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 0 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 18 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 2 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 20 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 4 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 22 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 6 -> Node 1
[    0.000000] SRAT: Node 1 PXM 2 0-d0000000
[    0.000000] SRAT: Node 1 PXM 2 100000000-130000000
[    0.000000] SRAT: Node 0 PXM 1 130000000-230000000
[    0.000000] NUMA: Using 28 for the hash shift.
[    0.000000] Bootmem setup node 1 0000000000000000-0000000040000000
[    0.000000]   NODE_DATA [0000000000008000 - 000000000000ffff]
[    0.000000]   bootmap [0000000000010000 -  0000000000017fff] pages 8
[    0.000000] (8 early reservations) ==> bootmem [0000000000 - 0040000000]
[    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
[    0.000000]   #1 [0003446000 - 0003465000]   XEN PAGETABLES ==> [0003446000 - 0003465000]
[    0.000000]   #2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
[    0.000000]   #3 [0001000000 - 0001694994]    TEXT DATA BSS ==> [0001000000 - 0001694994]
[    0.000000]   #4 [00016b5000 - 0003244e00]          RAMDISK ==> [00016b5000 - 0003244e00]
[    0.000000]   #5 [0003245000 - 0003446000]   XEN START INFO ==> [0003245000 - 0003446000]
[    0.000000]   #6 [0001695000 - 000169532d]              BRK ==> [0001695000 - 000169532d]
[    0.000000]   #7 [0000100000 - 00002e0000]          PGTABLE ==> [0000100000 - 00002e0000]
[    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000000 -> 0x00001000
[    0.000000]   DMA32    0x00001000 -> 0x00100000
[    0.000000]   Normal   0x00100000 -> 0x00100000
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[2] active PFN ranges
[    0.000000]     1: 0x00000000 -> 0x000000a0
[    0.000000]     1: 0x00000100 -> 0x00040000
[    0.000000] On node 1 totalpages: 262048
[    0.000000]   DMA zone: 56 pages used for memmap
[    0.000000]   DMA zone: 483 pages reserved
[    0.000000]   DMA zone: 3461 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 3528 pages used for memmap
[    0.000000]   DMA32 zone: 254520 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x808
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x28] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x29] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x2a] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x2b] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2c] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2d] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x2f] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 0, address 0xfec00000, GSI 0-0
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32])
[    0.000000] IOAPIC[1]: apic_id 1, version 0, address 0xfec80000, GSI 32-32
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ERROR: Unable to locate IOAPIC for GSI 2
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ERROR: Unable to locate IOAPIC for GSI 9
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[    0.000000] SMP: Allowing 8 CPUs, 0 hotplug CPUs
[    0.000000] nr_irqs_gsi: 288
[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
[    0.000000] Allocating PCI resources starting at 40000000 (gap: 40000000:8f679000)
[    0.000000] Booting paravirtualized kernel on Xen
[    0.000000] Xen version: 4.0.1 (preserve-AD) (dom0)
[    0.000000] NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:8 nr_node_ids:2
[    0.000000] PERCPU: Embedded 30 pages/cpu @ffff88000349b000 s90328 r8192 d24360 u122880
[    0.000000] pcpu-alloc: s90328 r8192 d24360 u122880 alloc=30*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 [0] 4 [0] 5 [0] 6 [0] 7 
[    7.851572] trying to map vcpu_info 0 at ffff8800034a6020, mfn 2274a6, offset 32
[    7.866294] cpu 0 using vcpu_info at ffff8800034a6020
[    7.876346] trying to map vcpu_info 1 at ffff8800034c4020, mfn 2274c4, offset 32
[    7.891079] cpu 1 using vcpu_info at ffff8800034c4020
[    7.901132] trying to map vcpu_info 2 at ffff8800034e2020, mfn 2274e2, offset 32
[    7.915865] cpu 2 using vcpu_info at ffff8800034e2020
[    7.925918] trying to map vcpu_info 3 at ffff880003500020, mfn 227500, offset 32
[    7.940651] cpu 3 using vcpu_info at ffff880003500020
[    7.950704] trying to map vcpu_info 4 at ffff88000351e020, mfn 22751e, offset 32
[    7.965436] cpu 4 using vcpu_info at ffff88000351e020
[    7.975489] trying to map vcpu_info 5 at ffff88000353c020, mfn 22753c, offset 32
[    7.990223] cpu 5 using vcpu_info at ffff88000353c020
[    8.000275] trying to map vcpu_info 6 at ffff88000355a020, mfn 22755a, offset 32
[    8.015008] cpu 6 using vcpu_info at ffff88000355a020
[    8.025060] trying to map vcpu_info 7 at ffff880003578020, mfn 227578, offset 32
[    8.039794] cpu 7 using vcpu_info at ffff880003578020
[    8.049845] Xen: using vcpu_info placement
[    8.057996] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 257981
[    8.073939] Policy zone: DMA32
[    8.080005] Kernel command line: root=/dev/sda1 console=hvc0 nomodeset earlyprintk=xen initcall_debug debug loglevel=10
[    8.101540] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    8.113753] Initializing CPU#0
[    8.127981] DMA: Placing 64MB software IO TLB between ffff88000466f000 - ffff88000866f000
[    8.143963] DMA: software IO TLB at phys 0x466f000 - 0x866f000
[    8.155569] xen_swiotlb_fixup: buf=ffff88000466f000 size=67108864
[    8.186987] xen_swiotlb_fixup: buf=ffff8800086cf000 size=32768
[    8.202655] Memory: 927524k/1048576k available (3145k kernel code, 384k absent, 120668k reserved, 1902k data, 596k init)
[    8.224047] SLUB: Genslabs=14, HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=2
[    8.239288] Hierarchical RCU implementation.
[    8.247755] NR_IRQS:4352 nr_irqs:2304
[    8.255124] xen: --> irq=0
[    8.260406] xen: --> irq=1
[    8.265779] xen: --> irq=2
[    8.271151] xen: --> irq=3
[    8.276525] xen: --> irq=4
[    8.281897] xen: --> irq=5
[    8.287272] xen: --> irq=6
[    8.292643] xen: --> irq=7
[    8.298017] xen: --> irq=8
[    8.303389] xen: --> irq=9
[    8.308763] xen: --> irq=10
[    8.314308] xen: --> irq=11
[    8.319856] xen: --> irq=12
[    8.325402] xen: --> irq=13
[    8.330950] xen: --> irq=14
[    8.336494] xen: --> irq=15
[    8.342053] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    8.354692] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    8.367865] xen: sci override: source_irq=9 global_irq=9 trigger=c polarity=1
[    8.382077] xen: registering gsi 9 triggering 0 polarity 0
[    8.392998] xen_allocate_pirq: returning irq 9 for gsi 9
[    8.403569] xen: --> irq=9
(XEN) IOAPIC[0]: Set PCI routing entry (0-9 -> 0x58 -> IRQ 9 Mode:1 Active:0)
[    8.422639] xen: acpi sci 9
[    8.434217] Console: colour VGA+ 80x25
[    8.441350] console [hvc0] enabled, bootconsole disabled
[    8.441350] console [hvc0] enabled, bootconsole disabled
[    8.462694] Xen: using vcpuop timer interface
[    8.471508] installing Xen timer for CPU 0
[    8.479841] BUG: unable to handle kernel paging request at 0000000000005a08
[    8.493868] IP: [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
[    8.507041] PGD 0 
[    8.511199] Thread overran stack, or stack corrupted
[    8.521253] Oops: 0000 [#1] SMP 
[    8.527838] last sysfs file: 
[    8.533941] CPU 0 
[    8.538100] Modules linked in:
[    8.544342] Pid: 0, comm: swapper Not tainted 2.6.32-5-xen-amd64 #1 PowerEdge R410
[    8.559594] RIP: e030:[<ffffffff810badce>]  [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
[    8.577620] RSP: e02b:ffffffff81443c88  EFLAGS: 00010046
[    8.588366] RAX: 0000000000000000 RBX: 0000000000005220 RCX: 0000000000005a00
[    8.602752] RDX: 0000000000000000 RSI: 0000000000000002 RDI: 0000000000005220
[    8.617139] RBP: 0000000000004020 R08: 0000000000000002 R09: ffff88003fc1c010
[    8.631525] R10: ffffffff813c2700 R11: 00000000000186a0 R12: 0000000000005220
[    8.645910] R13: 0000000000000002 R14: 0000000000000000 R15: ffff88000000da28
[    8.660300] FS:  0000000000000000(0000) GS:ffff88000349b000(0000) knlGS:0000000000000000
[    8.676591] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[    8.688203] CR2: 0000000000005a08 CR3: 0000000001001000 CR4: 0000000000002660
[    8.702589] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[    8.716975] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[    8.731361] Process swapper (pid: 0, threadinfo ffffffff81442000, task ffffffff814771f0)
[    8.747654] Stack:
[    8.751813]  ffff88000000da00 00000010813c2765 00000000000212d0 00000000000186a0
[    8.766199] <0> ffff88000000ac10 ffffffff8100e5b5 ffffffff8100ec72 00000000000186a0
[    8.781625] <0> 00000000000186a0 0000000000000000 0000000000005a00 0000000000000000
[    8.797572] Call Trace:
[    8.802603]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
[    8.815600]  [<ffffffff8100ec72>] ? check_events+0x12/0x20
[    8.826695]  [<ffffffff810e759d>] ? new_slab+0x42/0x1ca
[    8.837267]  [<ffffffff810e7915>] ? __slab_alloc+0x1f0/0x39b
[    8.848707]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    8.861704]  [<ffffffff810e85cb>] ? __kmalloc_node+0xe8/0x146
[    8.873317]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    8.886316]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    8.899317]  [<ffffffff811f24df>] ? find_unbound_irq+0x67/0xae
[    8.911103]  [<ffffffff811f259e>] ? bind_virq_to_irq+0x78/0x126
[    8.923062]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
[    8.936063]  [<ffffffff8100e8f6>] ? xen_timer_interrupt+0x0/0x18d
[    8.948368]  [<ffffffff811f29f6>] ? bind_virq_to_irqhandler+0x19/0x4a
[    8.961368]  [<ffffffff8100e884>] ? xen_setup_timer+0x55/0xaa
[    8.972982]  [<ffffffff81509a5e>] ? xen_time_init+0xaf/0xb5
[    8.984247]  [<ffffffff8150a491>] ? x86_late_time_init+0xa/0x10
[    8.996206]  [<ffffffff81506c3d>] ? start_kernel+0x348/0x3e8
[    9.007646]  [<ffffffff81508c7d>] ? xen_start_kernel+0x57c/0x581
[    9.019777] Code: d8 c1 e8 13 83 e0 01 09 44 24 64 41 89 dc 44 23 25 28 01 43 00 44 89 e2 83 e2 10 89 54 24 5c 74 05 e8 16 03 25 00 48 8b 4c 24 50 <48> 83 79 08 00 0f 84 30 05 00 00 83 e3 0f 48 8b 44 24 50 41 bf 
[    9.057561] RIP  [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
[    9.070909]  RSP <ffffffff81443c88>
[    9.078015] CR2: 0000000000005a08
[    9.084780] ---[ end trace a7919e7f17c0a725 ]---
[    9.094136] Kernel panic - not syncing: Attempted to kill the idle task!
[    9.107655] Pid: 0, comm: swapper Tainted: G      D    2.6.32-5-xen-amd64 #1
[    9.121866] Call Trace:
[    9.126897]  [<ffffffff8130a45a>] ? panic+0x86/0x141
[    9.136948]  [<ffffffff8130a563>] ? printk+0x4e/0x5b
[    9.147004]  [<ffffffff81051f7b>] ? do_exit+0x72/0x6b5
[    9.157402]  [<ffffffff8100ec72>] ? check_events+0x12/0x20
[    9.168496]  [<ffffffff8130d1bd>] ? oops_end+0xaf/0xb4
[    9.178895]  [<ffffffff8103338c>] ? no_context+0x1e9/0x1f8
[    9.189987]  [<ffffffff81033541>] ? __bad_area_nosemaphore+0x1a6/0x1ca
[    9.203158]  [<ffffffff8130e541>] ? do_page_fault+0x2b/0x2fc
[    9.214598]  [<ffffffff8130c695>] ? page_fault+0x25/0x30
[    9.225345]  [<ffffffff810badce>] ? __alloc_pages_nodemask+0x8f/0x5f5
[    9.238344]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
[    9.251344]  [<ffffffff8100ec72>] ? check_events+0x12/0x20
[    9.262436]  [<ffffffff810e759d>] ? new_slab+0x42/0x1ca
[    9.273010]  [<ffffffff810e7915>] ? __slab_alloc+0x1f0/0x39b
[    9.284449]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    9.297450]  [<ffffffff810e85cb>] ? __kmalloc_node+0xe8/0x146
[    9.309061]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    9.322061]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    9.335061]  [<ffffffff811f24df>] ? find_unbound_irq+0x67/0xae
[    9.346847]  [<ffffffff811f259e>] ? bind_virq_to_irq+0x78/0x126
[    9.358807]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
[    9.371806]  [<ffffffff8100e8f6>] ? xen_timer_interrupt+0x0/0x18d
[    9.384112]  [<ffffffff811f29f6>] ? bind_virq_to_irqhandler+0x19/0x4a
[    9.397113]  [<ffffffff8100e884>] ? xen_setup_timer+0x55/0xaa
[    9.408725]  [<ffffffff81509a5e>] ? xen_time_init+0xaf/0xb5
[    9.419992]  [<ffffffff8150a491>] ? x86_late_time_init+0xa/0x10
[    9.431951]  [<ffffffff81506c3d>] ? start_kernel+0x348/0x3e8
[    9.443391]  [<ffffffff81508c7d>] ? xen_start_kernel+0x57c/0x581
(XEN) Domain 0 crashed: rebooting machine in 5 seconds.

[-- Attachment #3: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Bug#603632: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-11-23 11:51 ` PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410)) Ian Campbell
@ 2010-11-23 12:44   ` Cris Daniluk
  2010-11-23 18:24   ` Jeremy Fitzhardinge
                     ` (2 subsequent siblings)
  3 siblings, 0 replies; 23+ messages in thread
From: Cris Daniluk @ 2010-11-23 12:44 UTC (permalink / raw)
  To: Ian Campbell
  Cc: Vincent CARON, 603632, xen-devel, Jeremy Fitzhardinge, Keir Fraser

[-- Attachment #1: Type: text/plain, Size: 11878 bytes --]

I was unable to, and this does look similar indeed. I tried a variety of
pvops kernels and kernel configs and was unable to get past this. I never
found resolution and eventually fell back to 3.4.3 w/a xenlinux kernel. Much
less sexy but very stable on the same hardware.

I also had related but different problems on IBM 3650 M2s and IBM 3500s with
pvops kernels. It seems very prone to crashing at any APIC/ACPI bugs, of
which there seem to be quite a bit of in both Dell and IBM. I was toying
with the idea of downgrading BIOS's based on the success someone else on
xen-devel list reported with that, but I didn't have the time to see that
idea through.

On Tue, Nov 23, 2010 at 6:51 AM, Ian Campbell <ijc@hellion.org.uk> wrote:

> Thanks for the report Vincent.
>
> I've added xen-devel to the CC as well as Cris Daniluk who previously
> reported a very similar issue[0] also on an R410 -- Cris did you ever
> get a resolution to your issue?
>
> Vincent's full report is at:
> http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=603632
> I've also attached the boot log here of which the interesting part looks
> to be:
>
>        [    8.422639] xen: acpi sci 9
>        [    8.434217] Console: colour VGA+ 80x25
>        [    8.441350] console [hvc0] enabled, bootconsole disabled
>        [    8.441350] console [hvc0] enabled, bootconsole disabled
>        [    8.462694] Xen: using vcpuop timer interface
>        [    8.471508] installing Xen timer for CPU 0
>        [    8.479841] BUG: unable to handle kernel paging request at
> 0000000000005a08
>        [    8.493868] IP: [<ffffffff810badce>]
> __alloc_pages_nodemask+0x8f/0x5f5
>        [    8.507041] PGD 0
>        [    8.511199] Thread overran stack, or stack corrupted
>        [    8.521253] Oops: 0000 [#1] SMP
>        [    8.527838] last sysfs file:
>        [    8.533941] CPU 0
>        [    8.538100] Modules linked in:
>        [    8.544342] Pid: 0, comm: swapper Not tainted 2.6.32-5-xen-amd64
> #1 PowerEdge R410
>        [    8.559594] RIP: e030:[<ffffffff810badce>]  [<ffffffff810badce>]
> __alloc_pages_nodemask+0x8f/0x5f5
>        [    8.577620] RSP: e02b:ffffffff81443c88  EFLAGS: 00010046
>        [    8.588366] RAX: 0000000000000000 RBX: 0000000000005220 RCX:
> 0000000000005a00
>        [    8.602752] RDX: 0000000000000000 RSI: 0000000000000002 RDI:
> 0000000000005220
>        [    8.617139] RBP: 0000000000004020 R08: 0000000000000002 R09:
> ffff88003fc1c010
>        [    8.631525] R10: ffffffff813c2700 R11: 00000000000186a0 R12:
> 0000000000005220
>        [    8.645910] R13: 0000000000000002 R14: 0000000000000000 R15:
> ffff88000000da28
>        [    8.660300] FS:  0000000000000000(0000) GS:ffff88000349b000(0000)
> knlGS:0000000000000000
>        [    8.676591] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
>        [    8.688203] CR2: 0000000000005a08 CR3: 0000000001001000 CR4:
> 0000000000002660
>        [    8.702589] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
>        [    8.716975] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
>        [    8.731361] Process swapper (pid: 0, threadinfo ffffffff81442000,
> task ffffffff814771f0)
>        [    8.747654] Stack:
>        [    8.751813]  ffff88000000da00 00000010813c2765 00000000000212d0
> 00000000000186a0
>        [    8.766199] <0> ffff88000000ac10 ffffffff8100e5b5
> ffffffff8100ec72 00000000000186a0
>        [    8.781625] <0> 00000000000186a0 0000000000000000
> 0000000000005a00 0000000000000000
>        [    8.797572] Call Trace:
>        [    8.802603]  [<ffffffff8100e5b5>] ?
> xen_force_evtchn_callback+0x9/0xa
>        [    8.815600]  [<ffffffff8100ec72>] ? check_events+0x12/0x20
>        [    8.826695]  [<ffffffff810e759d>] ? new_slab+0x42/0x1ca
>        [    8.837267]  [<ffffffff810e7915>] ? __slab_alloc+0x1f0/0x39b
>        [    8.848707]  [<ffffffff812f87d8>] ?
> irq_to_desc_alloc_node+0x96/0x195
>        [    8.861704]  [<ffffffff810e85cb>] ? __kmalloc_node+0xe8/0x146
>        [    8.873317]  [<ffffffff812f87d8>] ?
> irq_to_desc_alloc_node+0x96/0x195
>        [    8.886316]  [<ffffffff812f87d8>] ?
> irq_to_desc_alloc_node+0x96/0x195
>        [    8.899317]  [<ffffffff811f24df>] ? find_unbound_irq+0x67/0xae
>        [    8.911103]  [<ffffffff811f259e>] ? bind_virq_to_irq+0x78/0x126
>        [    8.923062]  [<ffffffff8100e5b5>] ?
> xen_force_evtchn_callback+0x9/0xa
>        [    8.936063]  [<ffffffff8100e8f6>] ? xen_timer_interrupt+0x0/0x18d
>        [    8.948368]  [<ffffffff811f29f6>] ?
> bind_virq_to_irqhandler+0x19/0x4a
>        [    8.961368]  [<ffffffff8100e884>] ? xen_setup_timer+0x55/0xaa
>        [    8.972982]  [<ffffffff81509a5e>] ? xen_time_init+0xaf/0xb5
>        [    8.984247]  [<ffffffff8150a491>] ? x86_late_time_init+0xa/0x10
>        [    8.996206]  [<ffffffff81506c3d>] ? start_kernel+0x348/0x3e8
>        [    9.007646]  [<ffffffff81508c7d>] ? xen_start_kernel+0x57c/0x581
>        [    9.019777] Code: d8 c1 e8 13 83 e0 01 09 44 24 64 41 89 dc 44 23
> 25 28 01 43 00 44 89 e2 83 e2 10 89 54 24 5c 74 05 e8 16 03 25 00 48 8b 4c
> 24 50 <48> 83 79 08 00 0f 84 30 05 00 00 83 e3 0f 48 8b 44 24 50 41 bf
>        [    9.057561] RIP  [<ffffffff810badce>]
> __alloc_pages_nodemask+0x8f/0x5f5
>        [    9.070909]  RSP <ffffffff81443c88>
>        [    9.078015] CR2: 0000000000005a08
>        [    9.084780] ---[ end trace a7919e7f17c0a725 ]---
>        [    9.094136] Kernel panic - not syncing: Attempted to kill the
> idle task!
>
> It's worth noting that the Debian kernels are based on
> e73f4955a821f850f5b88c32d12a81714523a95f (less the GPU fixes merged by
> bcf16b6b4f34fb40a7aaf637947c7d3bce0be671, which the Debian kernel
> maintainer chose to exclude).
>
> The baseline is slightly old but Debian is now pretty deeply frozen so a
> wholesale rebase is not possible, if either of you have run a more
> recent kernel the result would be interesting to know.
>
> The actual crashing RIP corresponds to mm/page_alloc.c:1975 which is in
> __alloc_pages_nodemask:
>
>        /*
>         * Check the zones suitable for the gfp_mask contain at least one
>         * valid zone. It's possible to have an empty zonelist as a result
>         * of GFP_THISNODE and a memoryless node
>         */
>        if (unlikely(!zonelist->_zonerefs->zone))
>                return NULL;
>
> zonelist->_zonerefs is an array but looking at the disassembly and the
> register dump zonelist itself appears to be 0x5a00 which seems unlikely
> to be valid.
>
> The zonelist ultimately comes from node which is always passed as 0 in
> the outer most caller in this stack trace (find_unbound_irq calling
> irq_to_desc_alloc_node).
>
> I'm not sure but looking at the complete bootlog it looks as if the
> system may only have node==1 i.e. no 0 node which could plausibly lead
> to this sort of issue:
>        [    0.000000] Bootmem setup node 1
> 0000000000000000-0000000040000000
>        [    0.000000]   NODE_DATA [0000000000008000 - 000000000000ffff]
>        [    0.000000]   bootmap [0000000000010000 -  0000000000017fff]
> pages 8
>        [    0.000000] (8 early reservations) ==> bootmem [0000000000 -
> 0040000000]
>        [    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==>
> [0000000000 - 0000001000]
>        [    0.000000]   #1 [0003446000 - 0003465000]   XEN PAGETABLES ==>
> [0003446000 - 0003465000]
>        [    0.000000]   #2 [0000006000 - 0000008000]       TRAMPOLINE ==>
> [0000006000 - 0000008000]
>        [    0.000000]   #3 [0001000000 - 0001694994]    TEXT DATA BSS ==>
> [0001000000 - 0001694994]
>        [    0.000000]   #4 [00016b5000 - 0003244e00]          RAMDISK ==>
> [00016b5000 - 0003244e00]
>        [    0.000000]   #5 [0003245000 - 0003446000]   XEN START INFO ==>
> [0003245000 - 0003446000]
>        [    0.000000]   #6 [0001695000 - 000169532d]              BRK ==>
> [0001695000 - 000169532d]
>        [    0.000000]   #7 [0000100000 - 00002e0000]          PGTABLE ==>
> [0000100000 - 00002e0000]
>        [    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
>        [    0.000000] Zone PFN ranges:
>        [    0.000000]   DMA      0x00000000 -> 0x00001000
>        [    0.000000]   DMA32    0x00001000 -> 0x00100000
>        [    0.000000]   Normal   0x00100000 -> 0x00100000
>        [    0.000000] Movable zone start PFN for each node
>        [    0.000000] early_node_map[2] active PFN ranges
>        [    0.000000]     1: 0x00000000 -> 0x000000a0
>        [    0.000000]     1: 0x00000100 -> 0x00040000
>        [    0.000000] On node 1 totalpages: 262048
>        [    0.000000]   DMA zone: 56 pages used for memmap
>        [    0.000000]   DMA zone: 483 pages reserved
>        [    0.000000]   DMA zone: 3461 pages, LIFO batch:0
>        [    0.000000]   DMA32 zone: 3528 pages used for memmap
>        [    0.000000]   DMA32 zone: 254520 pages, LIFO batch:31
>
> Perhaps we should be passing numa_node_id() (e.g. current node) instead
> of node 0? There doesn't seem to be another obvious alternative to
> passing in an explicit node number to this callchain (some places cope
> with -1 but not this path AFAICT).
>
> It's also not obvious if dom0 should be seeing the tables which describe
> the hosts nodes anyway or if we should be clobbering something. Given
> that dom0 sees a pseudo-physical address map I'm not convinced seeing
> the real SRAT is in any way beneficial. Perhaps we should simply be
> clobbering NUMAness until actual PV understanding of NUMA is ready?
>
> One thing I notice when googling R410 issues is that they apparently
> have a "Cores per CPU" BIOS option which might be worth playing with,
> since configuring a reduced number of cores might remove node 0 but not
> node 1 (odd but not invalid?). Presumably it is also worth making sure
> you have the latest BIOS etc.
>
> It's very much an outside possibility but it is also worth trying the
> packages at http://xenbits.xen.org/people/ianc/ which reinstates the
> changesets from bcf16b6b4f34fb40a7aaf637947c7d3bce0be671
>
> Ian.
>
> [0]
> http://lists.xensource.com/archives/html/xen-devel/2010-06/msg01140.html
>
> On Tue, 2010-11-16 at 00:32 +0100, Vincent CARON wrote:
> > Package: linux-image-2.6.32-5-xen-amd64
> > Version: 2.6.32-27
> > Severity: important
> >
> > I just tried d-i 6beta1 and booted Squeeeze and its 2.6.32 kernel for
> > the first time on my usual server hardware (Dell R410).
> >
> > I opted for the xen-amd64 kernel, and it boots fine on bare metal. But
> > as soon as I tried to boot it as dom0 over Xen hypervisor, it BUG's:
> >
> > [    8.479841] BUG: unable to handle kernel paging request at
> > 0000000000005a08^M
> > [    8.493868] IP: [<ffffffff810badce>]
> > __alloc_pages_nodemask+0x8f/0x5f5^M
> >
> >   Then quickly oopses and panics. I tried various flags:
> >   - upping dom0_mem from 256M to 1024M (I've been running Lenny/Xen 3.2
> >     with 256M happily for several months on the same hw)
> >   - using Xen 'nommu'
> >   - using Linux nomodeset
> >
> >   Then I followed instructions on a Xen wiki page to provide verbose
> >   traces (although they do not look much more verbose than the regular
> >   boot).
> >
> >   I'm using an IPMI serial-over-lan console which appears as a regular
> >   UART to Xen.
> >
> >   I'm attaching a boot log to this report.
> >
> > -- System Information:
> > Debian Release: squeeze/sid
> >   APT prefers testing
> >   APT policy: (500, 'testing')
> > Architecture: amd64 (x86_64)
> >
> > Kernel: Linux 2.6.32-5-amd64 (SMP w/2 CPU cores)
> > Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
> > Shell: /bin/sh linked to /bin/bash
> >
> >
> >
>
> --
> Ian Campbell
> Current Noise: Wolf - Seize The Night
>
> If you will practice being fictional for a while, you will understand that
> fictional characters are sometimes more real than people with bodies and
> heartbeats.
>

[-- Attachment #2: Type: text/html, Size: 13509 bytes --]

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Re: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-11-23 11:51 ` PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410)) Ian Campbell
  2010-11-23 12:44   ` Bug#603632: " Cris Daniluk
@ 2010-11-23 18:24   ` Jeremy Fitzhardinge
  2010-11-25 12:51     ` Bug#603632: [Xen-devel] " Vincent Caron
  2010-11-23 18:52   ` Ian Campbell
  2010-11-25 13:29   ` Bug#603632: " Vincent Caron
  3 siblings, 1 reply; 23+ messages in thread
From: Jeremy Fitzhardinge @ 2010-11-23 18:24 UTC (permalink / raw)
  To: Ian Campbell; +Cc: Vincent CARON, xen-devel, Keir Fraser, Cris Daniluk, 603632

On 11/23/2010 03:51 AM, Ian Campbell wrote:
> I'm not sure but looking at the complete bootlog it looks as if the
> system may only have node==1 i.e. no 0 node which could plausibly lead
> to this sort of issue:
>         [    0.000000] Bootmem setup node 1 0000000000000000-0000000040000000
>         [    0.000000]   NODE_DATA [0000000000008000 - 000000000000ffff]
>         [    0.000000]   bootmap [0000000000010000 -  0000000000017fff] pages 8
>         [    0.000000] (8 early reservations) ==> bootmem [0000000000 - 0040000000]
>         [    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
>         [    0.000000]   #1 [0003446000 - 0003465000]   XEN PAGETABLES ==> [0003446000 - 0003465000]
>         [    0.000000]   #2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
>         [    0.000000]   #3 [0001000000 - 0001694994]    TEXT DATA BSS ==> [0001000000 - 0001694994]
>         [    0.000000]   #4 [00016b5000 - 0003244e00]          RAMDISK ==> [00016b5000 - 0003244e00]
>         [    0.000000]   #5 [0003245000 - 0003446000]   XEN START INFO ==> [0003245000 - 0003446000]
>         [    0.000000]   #6 [0001695000 - 000169532d]              BRK ==> [0001695000 - 000169532d]
>         [    0.000000]   #7 [0000100000 - 00002e0000]          PGTABLE ==> [0000100000 - 00002e0000]
>         [    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
>         [    0.000000] Zone PFN ranges:
>         [    0.000000]   DMA      0x00000000 -> 0x00001000
>         [    0.000000]   DMA32    0x00001000 -> 0x00100000
>         [    0.000000]   Normal   0x00100000 -> 0x00100000
>         [    0.000000] Movable zone start PFN for each node
>         [    0.000000] early_node_map[2] active PFN ranges
>         [    0.000000]     1: 0x00000000 -> 0x000000a0
>         [    0.000000]     1: 0x00000100 -> 0x00040000
>         [    0.000000] On node 1 totalpages: 262048
>         [    0.000000]   DMA zone: 56 pages used for memmap
>         [    0.000000]   DMA zone: 483 pages reserved
>         [    0.000000]   DMA zone: 3461 pages, LIFO batch:0
>         [    0.000000]   DMA32 zone: 3528 pages used for memmap
>         [    0.000000]   DMA32 zone: 254520 pages, LIFO batch:31
>
> Perhaps we should be passing numa_node_id() (e.g. current node) instead
> of node 0? There doesn't seem to be another obvious alternative to
> passing in an explicit node number to this callchain (some places cope
> with -1 but not this path AFAICT).

Does booting native get the same configuration?

> It's also not obvious if dom0 should be seeing the tables which describe
> the hosts nodes anyway or if we should be clobbering something. Given
> that dom0 sees a pseudo-physical address map I'm not convinced seeing
> the real SRAT is in any way beneficial. Perhaps we should simply be
> clobbering NUMAness until actual PV understanding of NUMA is ready?

Yes, the host SRAT is meaningless in the domain and we really should
ignore it.  I'm not sure what happens if you boot on a really NUMA system.

> One thing I notice when googling R410 issues is that they apparently
> have a "Cores per CPU" BIOS option which might be worth playing with,
> since configuring a reduced number of cores might remove node 0 but not
> node 1 (odd but not invalid?). Presumably it is also worth making sure
> you have the latest BIOS etc.

Also, what's the DIMM configuration?  Are the slots fully populated?


    J

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Re: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-11-23 11:51 ` PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410)) Ian Campbell
  2010-11-23 12:44   ` Bug#603632: " Cris Daniluk
  2010-11-23 18:24   ` Jeremy Fitzhardinge
@ 2010-11-23 18:52   ` Ian Campbell
  2010-11-23 22:12     ` Ian Campbell
  2010-11-25 13:29   ` Bug#603632: " Vincent Caron
  3 siblings, 1 reply; 23+ messages in thread
From: Ian Campbell @ 2010-11-23 18:52 UTC (permalink / raw)
  To: Vincent CARON
  Cc: Cris Daniluk, xen-devel, Keir Fraser, Jeremy Fitzhardinge, 603632

On Tue, 2010-11-23 at 11:51 +0000, Ian Campbell wrote:
> 
> Perhaps we should be passing numa_node_id() (e.g. current node)
> instead of node 0? 

I've just kicked off a build of the 2.6.32-27 Debian kernel with the
following additional patch, I will hopefully post the binaries tomorrow.
If you already have the capability to build a custom kernel in place you
might like to try it before then. 

Ian.

diff --git a/drivers/xen/events.c b/drivers/xen/events.c
index 7b29ae1..868b172 100644
--- a/drivers/xen/events.c
+++ b/drivers/xen/events.c
@@ -418,7 +418,7 @@ static int find_unbound_irq(void)
 	if (irq == start)
 		goto no_irqs;
 
-	desc = irq_to_desc_alloc_node(irq, 0);
+	desc = irq_to_desc_alloc_node(irq, numa_node_id());
 	if (WARN_ON(desc == NULL))
 		return -1;

^ permalink raw reply related	[flat|nested] 23+ messages in thread

* Re: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-11-23 18:52   ` Ian Campbell
@ 2010-11-23 22:12     ` Ian Campbell
  2010-11-23 22:18       ` Ian Campbell
  0 siblings, 1 reply; 23+ messages in thread
From: Ian Campbell @ 2010-11-23 22:12 UTC (permalink / raw)
  To: Vincent CARON
  Cc: Cris Daniluk, xen-devel, Keir Fraser, Jeremy Fitzhardinge, 603632

On Tue, 2010-11-23 at 18:52 +0000, Ian Campbell wrote: 
> On Tue, 2010-11-23 at 11:51 +0000, Ian Campbell wrote:
> > 
> > Perhaps we should be passing numa_node_id() (e.g. current node)
> > instead of node 0? 
> 
> I've just kicked off a build of the 2.6.32-27 Debian kernel with the
> following additional patch, I will hopefully post the binaries tomorrow.

Build was quicker than I thought... Vincent, Cris if you get a chance
please can you test the kernel from:
http://xenbits.xen.org/people/ianc/2.6.32-27+numa1/

Thanks,
Ian.

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Re: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-11-23 22:12     ` Ian Campbell
@ 2010-11-23 22:18       ` Ian Campbell
  2010-12-02 23:47         ` Bug#603632: [Xen-devel] " Vincent Caron
  0 siblings, 1 reply; 23+ messages in thread
From: Ian Campbell @ 2010-11-23 22:18 UTC (permalink / raw)
  To: Vincent CARON
  Cc: Cris Daniluk, xen-devel, Keir Fraser, Jeremy Fitzhardinge, 603632

On Tue, 2010-11-23 at 22:12 +0000, Ian Campbell wrote: 
> On Tue, 2010-11-23 at 18:52 +0000, Ian Campbell wrote: 
> > On Tue, 2010-11-23 at 11:51 +0000, Ian Campbell wrote:
> > > 
> > > Perhaps we should be passing numa_node_id() (e.g. current node)
> > > instead of node 0? 
> > 
> > I've just kicked off a build of the 2.6.32-27 Debian kernel with the
> > following additional patch, I will hopefully post the binaries tomorrow.
> 
> Build was quicker than I thought... Vincent, Cris if you get a chance
> please can you test the kernel from:
> http://xenbits.xen.org/people/ianc/2.6.32-27+numa1/

Also, please can you try adding "numa=noacpi" to your kernel command
line when running with the standard Debian kernel (not the one above).

Thanks!

Ian.

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Bug#603632: [Xen-devel] PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-11-23 18:24   ` Jeremy Fitzhardinge
@ 2010-11-25 12:51     ` Vincent Caron
  2010-11-25 15:01       ` Ian Campbell
  0 siblings, 1 reply; 23+ messages in thread
From: Vincent Caron @ 2010-11-25 12:51 UTC (permalink / raw)
  To: Jeremy Fitzhardinge
  Cc: Ian Campbell, Vincent CARON, 603632, Cris Daniluk, xen-devel,
	Keir Fraser

On Tue, 2010-11-23 at 10:24 -0800, Jeremy Fitzhardinge wrote:
> On 11/23/2010 03:51 AM, Ian Campbell wrote:
> > I'm not sure but looking at the complete bootlog it looks as if the
> > system may only have node==1 i.e. no 0 node which could plausibly lead
> > to this sort of issue:
> >         [    0.000000] Bootmem setup node 1 0000000000000000-0000000040000000
> >         [    0.000000]   NODE_DATA [0000000000008000 - 000000000000ffff]
> >         [    0.000000]   bootmap [0000000000010000 -  0000000000017fff] pages 8
> >         [    0.000000] (8 early reservations) ==> bootmem [0000000000 - 0040000000]
> >         [    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
> >         [    0.000000]   #1 [0003446000 - 0003465000]   XEN PAGETABLES ==> [0003446000 - 0003465000]
> >         [    0.000000]   #2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
> >         [    0.000000]   #3 [0001000000 - 0001694994]    TEXT DATA BSS ==> [0001000000 - 0001694994]
> >         [    0.000000]   #4 [00016b5000 - 0003244e00]          RAMDISK ==> [00016b5000 - 0003244e00]
> >         [    0.000000]   #5 [0003245000 - 0003446000]   XEN START INFO ==> [0003245000 - 0003446000]
> >         [    0.000000]   #6 [0001695000 - 000169532d]              BRK ==> [0001695000 - 000169532d]
> >         [    0.000000]   #7 [0000100000 - 00002e0000]          PGTABLE ==> [0000100000 - 00002e0000]
> >         [    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
> >         [    0.000000] Zone PFN ranges:
> >         [    0.000000]   DMA      0x00000000 -> 0x00001000
> >         [    0.000000]   DMA32    0x00001000 -> 0x00100000
> >         [    0.000000]   Normal   0x00100000 -> 0x00100000
> >         [    0.000000] Movable zone start PFN for each node
> >         [    0.000000] early_node_map[2] active PFN ranges
> >         [    0.000000]     1: 0x00000000 -> 0x000000a0
> >         [    0.000000]     1: 0x00000100 -> 0x00040000
> >         [    0.000000] On node 1 totalpages: 262048
> >         [    0.000000]   DMA zone: 56 pages used for memmap
> >         [    0.000000]   DMA zone: 483 pages reserved
> >         [    0.000000]   DMA zone: 3461 pages, LIFO batch:0
> >         [    0.000000]   DMA32 zone: 3528 pages used for memmap
> >         [    0.000000]   DMA32 zone: 254520 pages, LIFO batch:31
> >
> > Perhaps we should be passing numa_node_id() (e.g. current node) instead
> > of node 0? There doesn't seem to be another obvious alternative to
> > passing in an explicit node number to this callchain (some places cope
> > with -1 but not this path AFAICT).
> 
> Does booting native get the same configuration?

  Booting native with the same Xen-enabled kernel gives:

[    0.000000] Bootmem setup node 0 0000000130000000-0000000230000000
[    0.000000]   NODE_DATA [0000000130000000 - 0000000130007fff]
[    0.000000]   bootmap [0000000130008000 -  0000000130027fff] pages 20
[    0.000000] (8 early reservations) ==> bootmem [0130000000 -
0230000000]
[    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page
[    0.000000]   #1 [0000006000 - 0000008000]       TRAMPOLINE
[    0.000000]   #2 [0001000000 - 0001694994]    TEXT DATA BSS
[    0.000000]   #3 [0037656000 - 0037fefb18]          RAMDISK
[    0.000000]   #4 [000009ec00 - 0000100000]    BIOS reserved
[    0.000000]   #5 [0001695000 - 000169532d]              BRK
[    0.000000]   #6 [0000008000 - 000000c000]          PGTABLE
[    0.000000]   #7 [000000c000 - 0000011000]          PGTABLE
[    0.000000] Bootmem setup node 1 0000000000000000-0000000130000000
[    0.000000]   NODE_DATA [0000000000011000 - 0000000000018fff]
[    0.000000]   bootmap [0000000000019000 -  000000000003efff] pages 26
[    0.000000] (8 early reservations) ==> bootmem [0000000000 -
0130000000]
[    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==>
[0000000000 - 0000001000]
[    0.000000]   #1 [0000006000 - 0000008000]       TRAMPOLINE ==>
[0000006000 - 0000008000]
[    0.000000]   #2 [0001000000 - 0001694994]    TEXT DATA BSS ==>
[0001000000 - 0001694994]
[    0.000000]   #3 [0037656000 - 0037fefb18]          RAMDISK ==>
[0037656000 - 0037fefb18]
[    0.000000]   #4 [000009ec00 - 0000100000]    BIOS reserved ==>
[000009ec00 - 0000100000]
[    0.000000]   #5 [0001695000 - 000169532d]              BRK ==>
[0001695000 - 000169532d]
[    0.000000]   #6 [0000008000 - 000000c000]          PGTABLE ==>
[0000008000 - 000000c000]
[    0.000000]   #7 [000000c000 - 0000011000]          PGTABLE ==>
[000000c000 - 0000011000]
[    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
[    0.000000] [ffffea0004280000-ffffea00043fffff] potential offnode
page_structs
[    0.000000]  [ffffea0000000000-ffffea00043fffff] PMD ->
[ffff880001800000-ffff8800051fffff] on node 1
[    0.000000]  [ffffea0004400000-ffffea0007bfffff] PMD ->
[ffff880130200000-ffff8801339fffff] on node 0
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000000 -> 0x00001000
[    0.000000]   DMA32    0x00001000 -> 0x00100000
[    0.000000]   Normal   0x00100000 -> 0x00230000
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[4] active PFN ranges
[    0.000000]     1: 0x00000000 -> 0x000000a0
[    0.000000]     1: 0x00000100 -> 0x000cf679
[    0.000000]     1: 0x00100000 -> 0x00130000
[    0.000000]     0: 0x00130000 -> 0x00230000
[    0.000000] On node 0 totalpages: 1048576
[    0.000000]   Normal zone: 14336 pages used for memmap
[    0.000000]   Normal zone: 1034240 pages, LIFO batch:31
[    0.000000] On node 1 totalpages: 1046041
[    0.000000]   DMA zone: 56 pages used for memmap
[    0.000000]   DMA zone: 109 pages reserved
[    0.000000]   DMA zone: 3835 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 14280 pages used for memmap
[    0.000000]   DMA32 zone: 831153 pages, LIFO batch:31
[    0.000000]   Normal zone: 2688 pages used for memmap
[    0.000000]   Normal zone: 193920 pages, LIFO batch:31


> > It's also not obvious if dom0 should be seeing the tables which describe
> > the hosts nodes anyway or if we should be clobbering something. Given
> > that dom0 sees a pseudo-physical address map I'm not convinced seeing
> > the real SRAT is in any way beneficial. Perhaps we should simply be
> > clobbering NUMAness until actual PV understanding of NUMA is ready?
> 
> Yes, the host SRAT is meaningless in the domain and we really should
> ignore it.  I'm not sure what happens if you boot on a really NUMA system.
> 
> > One thing I notice when googling R410 issues is that they apparently
> > have a "Cores per CPU" BIOS option which might be worth playing with,
> > since configuring a reduced number of cores might remove node 0 but not
> > node 1 (odd but not invalid?). Presumably it is also worth making sure
> > you have the latest BIOS etc.
> 
> Also, what's the DIMM configuration?  Are the slots fully populated?

  8 slots, 4 populated; slots #0, #1, #4 and #5 populated with 2GiB
dimms (according to lshw, setup by Dell).

  I switched off hyperthreading in the BIOS settings (default is 'on'),
I had issues with Xen 3.2 on this topic (related to floating vcpus,
which I had to pin to fix random crashes). Also I don't think HT is
significant for my usage. I'm used to see strange bugs as soon as I
tweak Dell BIOSes, so I thought I'd mention that.

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Bug#603632: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-11-23 11:51 ` PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410)) Ian Campbell
                     ` (2 preceding siblings ...)
  2010-11-23 18:52   ` Ian Campbell
@ 2010-11-25 13:29   ` Vincent Caron
  2010-11-25 14:44     ` Ian Campbell
  3 siblings, 1 reply; 23+ messages in thread
From: Vincent Caron @ 2010-11-25 13:29 UTC (permalink / raw)
  To: Ian Campbell
  Cc: Vincent CARON, 603632, Cris Daniluk, xen-devel,
	Jeremy Fitzhardinge, Keir Fraser

On Tue, 2010-11-23 at 11:51 +0000, Ian Campbell wrote:
>
> One thing I notice when googling R410 issues is that they apparently
> have a "Cores per CPU" BIOS option which might be worth playing with,
> since configuring a reduced number of cores might remove node 0 but not
> node 1 (odd but not invalid?). Presumably it is also worth making sure
> you have the latest BIOS etc.

  Indeed, I tweaked one BIOS setting, I disabled hyperthreading.

  The R410 BIOS has a CPU menu with (among other options):

  - Logical Processor: this is 'HT', default is enabled, I have disabled
it.
  - Virtualization Technology: default is disabled. Kept disabled.
  - Number of Cores per Processor: default is 'All'. Options are
single/dual/all. Kept 'all' defalut.

  I just tried to boot Xen 4.0 hypervisor after reverting to the factory
default 'HT enabled' (aka Logical Processor: Yes), same bug.

  Then I swithed off HT again, and enabled 'Virtualization
Technology' (setting which I totally overlooked, but why is it disabled
as default ?). Same bug.


> It's very much an outside possibility but it is also worth trying the
> packages at http://xenbits.xen.org/people/ianc/ which reinstates the
> changesets from bcf16b6b4f34fb40a7aaf637947c7d3bce0be671

  OK, should I pick the one in
http://xenbits.xen.org/people/ianc/squeeze/ ? (I'm running Debian
Squeeze on this machine)

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Re: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-11-25 13:29   ` Bug#603632: " Vincent Caron
@ 2010-11-25 14:44     ` Ian Campbell
  2010-11-25 16:38       ` Bug#603632: " Vincent Caron
  0 siblings, 1 reply; 23+ messages in thread
From: Ian Campbell @ 2010-11-25 14:44 UTC (permalink / raw)
  To: Vincent Caron
  Cc: Jeremy Fitzhardinge, xen-devel, Keir Fraser, Vincent CARON,
	Daniluk, 603632, Cris

On Thu, 2010-11-25 at 14:29 +0100, Vincent Caron wrote:
> On Tue, 2010-11-23 at 11:51 +0000, Ian Campbell wrote:
> >
> > One thing I notice when googling R410 issues is that they apparently
> > have a "Cores per CPU" BIOS option which might be worth playing with,
> > since configuring a reduced number of cores might remove node 0 but not
> > node 1 (odd but not invalid?). Presumably it is also worth making sure
> > you have the latest BIOS etc.
> 
>   Indeed, I tweaked one BIOS setting, I disabled hyperthreading.
> 
>   The R410 BIOS has a CPU menu with (among other options):
> 
>   - Logical Processor: this is 'HT', default is enabled, I have disabled
> it.
>   - Virtualization Technology: default is disabled. Kept disabled.
>   - Number of Cores per Processor: default is 'All'. Options are
> single/dual/all. Kept 'all' defalut.
> 
>   I just tried to boot Xen 4.0 hypervisor after reverting to the factory
> default 'HT enabled' (aka Logical Processor: Yes), same bug.
> 
>   Then I swithed off HT again, and enabled 'Virtualization
> Technology' (setting which I totally overlooked, but why is it disabled
> as default ?). Same bug.

Oh well, thanks for trying it!

> > It's very much an outside possibility but it is also worth trying the
> > packages at http://xenbits.xen.org/people/ianc/ which reinstates the
> > changesets from bcf16b6b4f34fb40a7aaf637947c7d3bce0be671
> 
>   OK, should I pick the one in
> http://xenbits.xen.org/people/ianc/squeeze/ ? (I'm running Debian
> Squeeze on this machine)

Yes but that's a bit of a long shot (those packages only put back some
GPU related fixes.

It would be more useful to test the packages at
http://xenbits.xen.org/people/ianc/2.6.32-27+numa1/ 
first.

Ian.

-- 
Ian Campbell
Current Noise: Candlemass - The Well Of Souls (Live)

"Pok pok pok, P'kok!"
		-- Superchicken

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Re: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-11-25 12:51     ` Bug#603632: [Xen-devel] " Vincent Caron
@ 2010-11-25 15:01       ` Ian Campbell
  2010-11-25 15:49         ` Bug#603632: [Xen-devel] " Vincent Caron
  0 siblings, 1 reply; 23+ messages in thread
From: Ian Campbell @ 2010-11-25 15:01 UTC (permalink / raw)
  To: Vincent Caron
  Cc: Jeremy Fitzhardinge, xen-devel, Fraser, Vincent CARON,
	Cris Daniluk, 603632, Keir

On Thu, 2010-11-25 at 13:51 +0100, Vincent Caron wrote:
> On Tue, 2010-11-23 at 10:24 -0800, Jeremy Fitzhardinge wrote:
> > On 11/23/2010 03:51 AM, Ian Campbell wrote:
> > > I'm not sure but looking at the complete bootlog it looks as if the
> > > system may only have node==1 i.e. no 0 node which could plausibly lead
> > > to this sort of issue:
> > > [...]
> > > Perhaps we should be passing numa_node_id() (e.g. current node) instead
> > > of node 0? There doesn't seem to be another obvious alternative to
> > > passing in an explicit node number to this callchain (some places cope
> > > with -1 but not this path AFAICT).
> > 
> > Does booting native get the same configuration?
> 
>   Booting native with the same Xen-enabled kernel gives:
[...]

Which looks to be pretty much completely different (this was the exact
same system and BIOS settings as the original Xen log, right?).

The diff is below but it's so different as to be nearly unreadable.

I'm surprised at this but I've not been following NUMA on Xen. Does the
hypervisor deliberately munge the SRAT for PV guests in some way?

Ian.

--- /home/ianc/native.txt	2010-11-25 14:46:54.458656000 +0000
+++ /home/ianc/xen.txt	2010-11-25 14:46:31.745482000 +0000
@@ -1,51 +1,27 @@
-
-[    0.000000] Bootmem setup node 0 0000000130000000-0000000230000000
-[    0.000000]   NODE_DATA [0000000130000000 - 0000000130007fff]
-[    0.000000]   bootmap [0000000130008000 -  0000000130027fff] pages 20
-[    0.000000] (8 early reservations) ==> bootmem [0130000000 - 0230000000]
-[    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page
-[    0.000000]   #1 [0000006000 - 0000008000]       TRAMPOLINE
-[    0.000000]   #2 [0001000000 - 0001694994]    TEXT DATA BSS
-[    0.000000]   #3 [0037656000 - 0037fefb18]          RAMDISK
-[    0.000000]   #4 [000009ec00 - 0000100000]    BIOS reserved
-[    0.000000]   #5 [0001695000 - 000169532d]              BRK
-[    0.000000]   #6 [0000008000 - 000000c000]          PGTABLE
-[    0.000000]   #7 [000000c000 - 0000011000]          PGTABLE
-[    0.000000] Bootmem setup node 1 0000000000000000-0000000130000000
-[    0.000000]   NODE_DATA [0000000000011000 - 0000000000018fff]
-[    0.000000]   bootmap [0000000000019000 -  000000000003efff] pages 26
-[    0.000000] (8 early reservations) ==> bootmem [0000000000 - 0130000000]
+[    0.000000] Bootmem setup node 1 0000000000000000-0000000040000000
+[    0.000000]   NODE_DATA [0000000000008000 - 000000000000ffff]
+[    0.000000]   bootmap [0000000000010000 -  0000000000017fff] pages 8
+[    0.000000] (8 early reservations) ==> bootmem [0000000000 - 0040000000]
 [    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
-[    0.000000]   #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
-[    0.000000]   #2 [0001000000 - 0001694994]    TEXT DATA BSS ==> [0001000000 - 0001694994]
-[    0.000000]   #3 [0037656000 - 0037fefb18]          RAMDISK ==> [0037656000 - 0037fefb18]
-[    0.000000]   #4 [000009ec00 - 0000100000]    BIOS reserved ==> [000009ec00 - 0000100000]
-[    0.000000]   #5 [0001695000 - 000169532d]              BRK ==> [0001695000 - 000169532d]
-[    0.000000]   #6 [0000008000 - 000000c000]          PGTABLE ==> [0000008000 - 000000c000]
-[    0.000000]   #7 [000000c000 - 0000011000]          PGTABLE ==> [000000c000 - 0000011000]
+[    0.000000]   #1 [0003446000 - 0003465000]   XEN PAGETABLES ==> [0003446000 - 0003465000]
+[    0.000000]   #2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
+[    0.000000]   #3 [0001000000 - 0001694994]    TEXT DATA BSS ==> [0001000000 - 0001694994]
+[    0.000000]   #4 [00016b5000 - 0003244e00]          RAMDISK ==> [00016b5000 - 0003244e00]
+[    0.000000]   #5 [0003245000 - 0003446000]   XEN START INFO ==> [0003245000 - 0003446000]
+[    0.000000]   #6 [0001695000 - 000169532d]              BRK ==> [0001695000 - 000169532d]
+[    0.000000]   #7 [0000100000 - 00002e0000]          PGTABLE ==> [0000100000 - 00002e0000]
 [    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
-[    0.000000] [ffffea0004280000-ffffea00043fffff] potential offnode page_structs
-[    0.000000]  [ffffea0000000000-ffffea00043fffff] PMD -> [ffff880001800000-ffff8800051fffff] on node 1
-[    0.000000]  [ffffea0004400000-ffffea0007bfffff] PMD -> [ffff880130200000-ffff8801339fffff] on node 0
 [    0.000000] Zone PFN ranges:
 [    0.000000]   DMA      0x00000000 -> 0x00001000
 [    0.000000]   DMA32    0x00001000 -> 0x00100000
-[    0.000000]   Normal   0x00100000 -> 0x00230000
+[    0.000000]   Normal   0x00100000 -> 0x00100000
 [    0.000000] Movable zone start PFN for each node
-[    0.000000] early_node_map[4] active PFN ranges
+[    0.000000] early_node_map[2] active PFN ranges
 [    0.000000]     1: 0x00000000 -> 0x000000a0
-[    0.000000]     1: 0x00000100 -> 0x000cf679
-[    0.000000]     1: 0x00100000 -> 0x00130000
-[    0.000000]     0: 0x00130000 -> 0x00230000
-[    0.000000] On node 0 totalpages: 1048576
-[    0.000000]   Normal zone: 14336 pages used for memmap
-[    0.000000]   Normal zone: 1034240 pages, LIFO batch:31
-[    0.000000] On node 1 totalpages: 1046041
+[    0.000000]     1: 0x00000100 -> 0x00040000
+[    0.000000] On node 1 totalpages: 262048
 [    0.000000]   DMA zone: 56 pages used for memmap
-[    0.000000]   DMA zone: 109 pages reserved
-[    0.000000]   DMA zone: 3835 pages, LIFO batch:0
-[    0.000000]   DMA32 zone: 14280 pages used for memmap
-[    0.000000]   DMA32 zone: 831153 pages, LIFO batch:31
-[    0.000000]   Normal zone: 2688 pages used for memmap
-[    0.000000]   Normal zone: 193920 pages, LIFO batch:31
-
+[    0.000000]   DMA zone: 483 pages reserved
+[    0.000000]   DMA zone: 3461 pages, LIFO batch:0
+[    0.000000]   DMA32 zone: 3528 pages used for memmap
+[    0.000000]   DMA32 zone: 254520 pages, LIFO batch:31


-- 
Ian Campbell
Current Noise: Candlemass - At The Gallows End (Studio Outtake)

But it does move!
		-- Galileo Galilei

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Bug#603632: [Xen-devel] PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-11-25 15:01       ` Ian Campbell
@ 2010-11-25 15:49         ` Vincent Caron
  0 siblings, 0 replies; 23+ messages in thread
From: Vincent Caron @ 2010-11-25 15:49 UTC (permalink / raw)
  To: Ian Campbell
  Cc: Jeremy Fitzhardinge, Vincent CARON, 603632, Cris Daniluk,
	xen-devel, Keir Fraser

[-- Attachment #1: Type: text/plain, Size: 495 bytes --]

On Thu, 2010-11-25 at 15:01 +0000, Ian Campbell wrote:
> > 
> >   Booting native with the same Xen-enabled kernel gives:
> [...]
> 
> Which looks to be pretty much completely different (this was the exact
> same system and BIOS settings as the original Xen log, right?).
> 
> The diff is below but it's so different as to be nearly unreadable.

  I've just rebooted my Squeeze with and without the hypervisor with no
BIOS tweaking at all to be sure. Enclosed are the full logs for both
cases.



[-- Attachment #2: bootlog_native.txt --]
[-- Type: text/plain, Size: 54729 bytes --]

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 2.6.32-5-xen-amd64 (Debian 2.6.32-27) (maks@debian.org) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 SMP Sat Oct 30 17:04:10 UTC 2010
[    0.000000] Command line: root=/dev/sda1 
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  BIOS-e820: 0000000000000000 - 00000000000a0000 (usable)
[    0.000000]  BIOS-e820: 0000000000100000 - 00000000cf679000 (usable)
[    0.000000]  BIOS-e820: 00000000cf679000 - 00000000cf68f000 (reserved)
[    0.000000]  BIOS-e820: 00000000cf68f000 - 00000000cf6ce000 (ACPI data)
[    0.000000]  BIOS-e820: 00000000cf6ce000 - 00000000d0000000 (reserved)
[    0.000000]  BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
[    0.000000]  BIOS-e820: 00000000fe000000 - 0000000100000000 (reserved)
[    0.000000]  BIOS-e820: 0000000100000000 - 0000000230000000 (usable)
[    0.000000] DMI 2.6 present.
[    0.000000] last_pfn = 0x230000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-D3FFF write-protect
[    0.000000]   D4000-EBFFF uncachable
[    0.000000]   EC000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 0000000000 mask FF80000000 write-back
[    0.000000]   1 base 0080000000 mask FFC0000000 write-back
[    0.000000]   2 base 00C0000000 mask FFF0000000 write-back
[    0.000000]   3 base 0100000000 mask FF00000000 write-back
[    0.000000]   4 base 0200000000 mask FFE0000000 write-back
[    0.000000]   5 base 0220000000 mask FFF0000000 write-back
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
[    0.000000] e820 update range: 00000000d0000000 - 0000000100000000 (usable) ==> (reserved)
[    0.000000] last_pfn = 0xcf679 max_arch_pfn = 0x400000000
[    0.000000] initial memory mapped : 0 - 20000000
[    0.000000] init_memory_mapping: 0000000000000000-00000000cf679000
[    0.000000]  0000000000 - 00cf600000 page 2M
[    0.000000]  00cf600000 - 00cf679000 page 4k
[    0.000000] kernel direct mapping tables up to cf679000 @ 8000-e000
[    0.000000] init_memory_mapping: 0000000100000000-0000000230000000
[    0.000000]  0100000000 - 0230000000 page 2M
[    0.000000] kernel direct mapping tables up to 230000000 @ c000-16000
[    0.000000] RAMDISK: 37656000 - 37fefb18
[    0.000000] ACPI: RSDP 00000000000f09e0 00024 (v02 DELL  )
[    0.000000] ACPI: XSDT 00000000000f0ae4 0009C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: FACP 00000000cf6b3f9c 000F4 (v03 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: DSDT 00000000cf68f000 03B39 (v01 DELL   PE_SC3   00000001 INTL 20050624)
[    0.000000] ACPI: FACS 00000000cf6b6000 00040
[    0.000000] ACPI: APIC 00000000cf6b3478 0015E (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SPCR 00000000cf6b35d8 00050 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: HPET 00000000cf6b362c 00038 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: DMAR 00000000cf6b3668 001B0 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: MCFG 00000000cf6b38c4 0003C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: WD__ 00000000cf6b3904 00134 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SLIC 00000000cf6b3a3c 00024 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: ERST 00000000cf692cbc 00270 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: HEST 00000000cf692f2c 003A8 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: BERT 00000000cf692b3c 00030 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: EINJ 00000000cf692b6c 00150 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SRAT 00000000cf6b3bc0 00370 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: TCPA 00000000cf6b3f34 00064 (v02 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SSDT 00000000cf6b7000 02104 (v01  INTEL PPM RCM  80000001 INTL 20061109)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] SRAT: PXM 1 -> APIC 16 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 0 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 18 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 2 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 20 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 4 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 22 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 6 -> Node 1
[    0.000000] SRAT: Node 1 PXM 2 0-d0000000
[    0.000000] SRAT: Node 1 PXM 2 100000000-130000000
[    0.000000] SRAT: Node 0 PXM 1 130000000-230000000
[    0.000000] NUMA: Using 28 for the hash shift.
[    0.000000] Bootmem setup node 0 0000000130000000-0000000230000000
[    0.000000]   NODE_DATA [0000000130000000 - 0000000130007fff]
[    0.000000]   bootmap [0000000130008000 -  0000000130027fff] pages 20
[    0.000000] (8 early reservations) ==> bootmem [0130000000 - 0230000000]
[    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page
[    0.000000]   #1 [0000006000 - 0000008000]       TRAMPOLINE
[    0.000000]   #2 [0001000000 - 0001694994]    TEXT DATA BSS
[    0.000000]   #3 [0037656000 - 0037fefb18]          RAMDISK
[    0.000000]   #4 [000009ec00 - 0000100000]    BIOS reserved
[    0.000000]   #5 [0001695000 - 000169532d]              BRK
[    0.000000]   #6 [0000008000 - 000000c000]          PGTABLE
[    0.000000]   #7 [000000c000 - 0000011000]          PGTABLE
[    0.000000] Bootmem setup node 1 0000000000000000-0000000130000000
[    0.000000]   NODE_DATA [0000000000011000 - 0000000000018fff]
[    0.000000]   bootmap [0000000000019000 -  000000000003efff] pages 26
[    0.000000] (8 early reservations) ==> bootmem [0000000000 - 0130000000]
[    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
[    0.000000]   #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
[    0.000000]   #2 [0001000000 - 0001694994]    TEXT DATA BSS ==> [0001000000 - 0001694994]
[    0.000000]   #3 [0037656000 - 0037fefb18]          RAMDISK ==> [0037656000 - 0037fefb18]
[    0.000000]   #4 [000009ec00 - 0000100000]    BIOS reserved ==> [000009ec00 - 0000100000]
[    0.000000]   #5 [0001695000 - 000169532d]              BRK ==> [0001695000 - 000169532d]
[    0.000000]   #6 [0000008000 - 000000c000]          PGTABLE ==> [0000008000 - 000000c000]
[    0.000000]   #7 [000000c000 - 0000011000]          PGTABLE ==> [000000c000 - 0000011000]
[    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
[    0.000000] [ffffea0004280000-ffffea00043fffff] potential offnode page_structs
[    0.000000]  [ffffea0000000000-ffffea00043fffff] PMD -> [ffff880001800000-ffff8800051fffff] on node 1
[    0.000000]  [ffffea0004400000-ffffea0007bfffff] PMD -> [ffff880130200000-ffff8801339fffff] on node 0
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000000 -> 0x00001000
[    0.000000]   DMA32    0x00001000 -> 0x00100000
[    0.000000]   Normal   0x00100000 -> 0x00230000
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[4] active PFN ranges
[    0.000000]     1: 0x00000000 -> 0x000000a0
[    0.000000]     1: 0x00000100 -> 0x000cf679
[    0.000000]     1: 0x00100000 -> 0x00130000
[    0.000000]     0: 0x00130000 -> 0x00230000
[    0.000000] On node 0 totalpages: 1048576
[    0.000000]   Normal zone: 14336 pages used for memmap
[    0.000000]   Normal zone: 1034240 pages, LIFO batch:31
[    0.000000] On node 1 totalpages: 1046041
[    0.000000]   DMA zone: 56 pages used for memmap
[    0.000000]   DMA zone: 109 pages reserved
[    0.000000]   DMA zone: 3835 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 14280 pages used for memmap
[    0.000000]   DMA32 zone: 831153 pages, LIFO batch:31
[    0.000000]   Normal zone: 2688 pages used for memmap
[    0.000000]   Normal zone: 193920 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x808
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x28] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x29] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x2a] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x2b] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2c] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2d] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x2f] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec80000, GSI 32-55
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ2 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[    0.000000] SMP: Allowing 32 CPUs, 24 hotplug CPUs
[    0.000000] nr_irqs_gsi: 56
[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
[    0.000000] PM: Registered nosave memory: 00000000cf679000 - 00000000cf68f000
[    0.000000] PM: Registered nosave memory: 00000000cf68f000 - 00000000cf6ce000
[    0.000000] PM: Registered nosave memory: 00000000cf6ce000 - 00000000d0000000
[    0.000000] PM: Registered nosave memory: 00000000d0000000 - 00000000e0000000
[    0.000000] PM: Registered nosave memory: 00000000e0000000 - 00000000f0000000
[    0.000000] PM: Registered nosave memory: 00000000f0000000 - 00000000fe000000
[    0.000000] PM: Registered nosave memory: 00000000fe000000 - 0000000100000000
[    0.000000] Allocating PCI resources starting at d0000000 (gap: d0000000:10000000)
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:32 nr_node_ids:2
[    0.000000] PERCPU: Embedded 30 pages/cpu @ffff880005400000 s90328 r8192 d24360 u131072
[    0.000000] pcpu-alloc: s90328 r8192 d24360 u131072 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 00 02 04 06 08 10 12 14 16 18 20 22 24 26 28 30 
[    0.000000] pcpu-alloc: [1] 01 03 05 07 09 11 13 15 17 19 21 23 25 27 29 31 
[    0.000000] Built 2 zonelists in Node order, mobility grouping on.  Total pages: 2063148
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: root=/dev/sda1 
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] Initializing CPU#0
[    0.000000] Checking aperture...
[    0.000000] No AGP bridge found
[    0.000000] Calgary: detecting Calgary via BIOS EBDA area
[    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.000000] Memory: 8174768k/9175040k available (3145k kernel code, 796572k absent, 203700k reserved, 1902k data, 596k init)
[    0.000000] SLUB: Genslabs=14, HWalign=64, Order=0-3, MinObjects=0, CPUs=32, Nodes=2
[    0.000000] Hierarchical RCU implementation.
[    0.000000] NR_IRQS:4352 nr_irqs:1208
[    0.000000] Extended CMOS year: 2000
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] hpet clockevent registered
[    0.000000] HPET: 4 timers in total, 0 timers will be used for per-cpu timer
[    0.000000] Fast TSC calibration using PIT
[    0.004000] Detected 2261.215 MHz processor.
[    0.000010] Calibrating delay loop (skipped), value calculated using timer frequency.. 4522.43 BogoMIPS (lpj=9044860)
[    0.000156] Security Framework initialized
[    0.000224] SELinux:  Disabled at boot.
[    0.005809] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[    0.008002] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.008866] Mount-cache hash table entries: 256
[    0.009106] Initializing cgroup subsys ns
[    0.009172] Initializing cgroup subsys cpuacct
[    0.009242] Initializing cgroup subsys devices
[    0.009307] Initializing cgroup subsys freezer
[    0.009372] Initializing cgroup subsys net_cls
[    0.009456] CPU: Physical Processor ID: 1
[    0.009520] CPU: Processor Core ID: 0
[    0.009585] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.009693] CPU: L2 cache: 256K
[    0.009755] CPU: L3 cache: 8192K
[    0.009820] CPU 0/0x10 -> Node 0
[    0.009884] mce: CPU supports 9 MCE banks
[    0.009957] CPU0: Thermal monitoring enabled (TM1)
[    0.010024] CPU 0 MCA banks CMCI:2 CMCI:3 CMCI:5 CMCI:6 SHD:8
[    0.010350] using mwait in idle threads.
[    0.010414] Performance Events: Nehalem/Corei7 events, Intel PMU driver.
[    0.010571] ... version:                3
[    0.010635] ... bit width:              48
[    0.010698] ... generic registers:      4
[    0.010762] ... value mask:             0000ffffffffffff
[    0.010828] ... max period:             000000007fffffff
[    0.010895] ... fixed-purpose events:   3
[    0.010959] ... event mask:             000000070000000f
[    0.011848] ACPI: Core revision 20090903
[    0.017088] DMAR: Host address width 40
[    0.017153] DMAR: DRHD base: 0x000000fed90000 flags: 0x1
[    0.017226] IOMMU fed90000: ver 1:0 cap c90780106f0462 ecap f020f6
[    0.017295] DMAR: RMRR base: 0x000000cf7c8000 end: 0x000000cf7dffff
[    0.017364] DMAR: RMRR base: 0x000000cf7b1000 end: 0x000000cf7bffff
[    0.017433] DMAR: RMRR base: 0x000000cf7a1000 end: 0x000000cf7a1fff
[    0.017503] DMAR: RMRR base: 0x000000cf7a3000 end: 0x000000cf7a3fff
[    0.017572] DMAR: RMRR base: 0x000000cf7a5000 end: 0x000000cf7a5fff
[    0.017641] DMAR: RMRR base: 0x000000cf7a7000 end: 0x000000cf7a7fff
[    0.017711] DMAR: RMRR base: 0x000000cf7a9000 end: 0x000000cf7a9fff
[    0.017780] DMAR: RMRR base: 0x000000cf7c0000 end: 0x000000cf7c0fff
[    0.017849] DMAR: RMRR base: 0x000000cf7c2000 end: 0x000000cf7c2fff
[    0.017918] DMAR: ATSR flags: 0x0
[    0.017988] Setting APIC routing to physical flat
[    0.018496] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.058172] CPU0: Intel(R) Xeon(R) CPU           L5520  @ 2.27GHz stepping 05
[    0.164412] Booting processor 1 APIC 0x0 ip 0x6000
[    0.174705] Initializing CPU#1
[    0.252112] CPU: Physical Processor ID: 0
[    0.252113] CPU: Processor Core ID: 0
[    0.252116] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.252118] CPU: L2 cache: 256K
[    0.252120] CPU: L3 cache: 8192K
[    0.252123] CPU 1/0x0 -> Node 1
[    0.252137] CPU1: Thermal monitoring enabled (TM1)
[    0.252140] CPU 1 MCA banks CMCI:2 CMCI:3 CMCI:5 CMCI:6 SHD:8
[    0.252169] CPU1: Intel(R) Xeon(R) CPU           L5520  @ 2.27GHz stepping 05
[    0.252890] checking TSC synchronization [CPU#0 -> CPU#1]: passed.
[    0.273028] Booting processor 2 APIC 0x12 ip 0x6000
[    0.283695] Initializing CPU#2
[    0.363882] CPU: Physical Processor ID: 1
[    0.363883] CPU: Processor Core ID: 1
[    0.363885] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.363887] CPU: L2 cache: 256K
[    0.363888] CPU: L3 cache: 8192K
[    0.363890] CPU 2/0x12 -> Node 0
[    0.363900] CPU2: Thermal monitoring enabled (TM1)
[    0.363903] CPU 2 MCA banks CMCI:2 CMCI:3 CMCI:5 SHD:6 SHD:8
[    0.363930] CPU2: Intel(R) Xeon(R) CPU           L5520  @ 2.27GHz stepping 05
[    0.364654] checking TSC synchronization [CPU#0 -> CPU#2]: passed.
[    0.384828] Booting processor 3 APIC 0x2 ip 0x6000
[    0.395220] Initializing CPU#3
[    0.475655] CPU: Physical Processor ID: 0
[    0.475656] CPU: Processor Core ID: 1
[    0.475659] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.475661] CPU: L2 cache: 256K
[    0.475663] CPU: L3 cache: 8192K
[    0.475665] CPU 3/0x2 -> Node 1
[    0.475679] CPU3: Thermal monitoring enabled (TM1)
[    0.475683] CPU 3 MCA banks CMCI:2 CMCI:3 CMCI:5 SHD:6 SHD:8
[    0.475769] CPU3: Intel(R) Xeon(R) CPU           L5520  @ 2.27GHz stepping 05
[    0.476490] checking TSC synchronization [CPU#0 -> CPU#3]: passed.
[    0.496628] Booting processor 4 APIC 0x14 ip 0x6000
[    0.506958] Initializing CPU#4
[    0.587425] CPU: Physical Processor ID: 1
[    0.587426] CPU: Processor Core ID: 2
[    0.587428] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.587430] CPU: L2 cache: 256K
[    0.587431] CPU: L3 cache: 8192K
[    0.587433] CPU 4/0x14 -> Node 0
[    0.587443] CPU4: Thermal monitoring enabled (TM1)
[    0.587446] CPU 4 MCA banks CMCI:2 CMCI:3 CMCI:5 SHD:6 SHD:8
[    0.587528] CPU4: Intel(R) Xeon(R) CPU           L5520  @ 2.27GHz stepping 05
[    0.588249] checking TSC synchronization [CPU#0 -> CPU#4]: passed.
[    0.608417] Booting processor 5 APIC 0x4 ip 0x6000
[    0.618810] Initializing CPU#5
[    0.699198] CPU: Physical Processor ID: 0
[    0.699199] CPU: Processor Core ID: 2
[    0.699202] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.699204] CPU: L2 cache: 256K
[    0.699206] CPU: L3 cache: 8192K
[    0.699209] CPU 5/0x4 -> Node 1
[    0.699222] CPU5: Thermal monitoring enabled (TM1)
[    0.699226] CPU 5 MCA banks CMCI:2 CMCI:3 CMCI:5 SHD:6 SHD:8
[    0.699264] CPU5: Intel(R) Xeon(R) CPU           L5520  @ 2.27GHz stepping 05
[    0.699986] checking TSC synchronization [CPU#0 -> CPU#5]: passed.
[    0.720127] Booting processor 6 APIC 0x16 ip 0x6000
[    0.730458] Initializing CPU#6
[    0.810968] CPU: Physical Processor ID: 1
[    0.810969] CPU: Processor Core ID: 3
[    0.810971] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.810972] CPU: L2 cache: 256K
[    0.810973] CPU: L3 cache: 8192K
[    0.810976] CPU 6/0x16 -> Node 0
[    0.810986] CPU6: Thermal monitoring enabled (TM1)
[    0.810989] CPU 6 MCA banks CMCI:2 CMCI:3 CMCI:5 SHD:6 SHD:8
[    0.811037] CPU6: Intel(R) Xeon(R) CPU           L5520  @ 2.27GHz stepping 05
[    0.811761] checking TSC synchronization [CPU#0 -> CPU#6]: passed.
[    0.831933] Booting processor 7 APIC 0x6 ip 0x6000
[    0.842326] Initializing CPU#7
[    0.922741] CPU: Physical Processor ID: 0
[    0.922742] CPU: Processor Core ID: 3
[    0.922745] CPU: L1 I cache: 32K, L1 D cache: 32K
[    0.922747] CPU: L2 cache: 256K
[    0.922749] CPU: L3 cache: 8192K
[    0.922752] CPU 7/0x6 -> Node 1
[    0.922765] CPU7: Thermal monitoring enabled (TM1)
[    0.922769] CPU 7 MCA banks CMCI:2 CMCI:3 CMCI:5 SHD:6 SHD:8
[    0.922833] CPU7: Intel(R) Xeon(R) CPU           L5520  @ 2.27GHz stepping 05
[    0.923558] checking TSC synchronization [CPU#0 -> CPU#7]: passed.
[    0.943654] Brought up 8 CPUs
[    0.943718] Total of 8 processors activated (36175.34 BogoMIPS).
[    0.947304] CPU0 attaching sched-domain:
[    0.947308]  domain 0: span 0,2,4,6 level MC
[    0.947310]   groups: 0 2 4 6
[    0.947314]   domain 1: span 0-7 level NODE
[    0.947316]    groups: 0,2,4,6 (cpu_power = 4096) 1,3,5,7 (cpu_power = 4096)
[    0.947324] CPU1 attaching sched-domain:
[    0.947326]  domain 0: span 1,3,5,7 level MC
[    0.947327]   groups: 1 3 5 7
[    0.947331]   domain 1: span 0-7 level NODE
[    0.947332]    groups: 1,3,5,7 (cpu_power = 4096) 0,2,4,6 (cpu_power = 4096)
[    0.947338] CPU2 attaching sched-domain:
[    0.947340]  domain 0: span 0,2,4,6 level MC
[    0.947341]   groups: 2 4 6 0
[    0.947345]   domain 1: span 0-7 level NODE
[    0.947346]    groups: 0,2,4,6 (cpu_power = 4096) 1,3,5,7 (cpu_power = 4096)
[    0.947351] CPU3 attaching sched-domain:
[    0.947353]  domain 0: span 1,3,5,7 level MC
[    0.947355]   groups: 3 5 7 1
[    0.947358]   domain 1: span 0-7 level NODE
[    0.947360]    groups: 1,3,5,7 (cpu_power = 4096) 0,2,4,6 (cpu_power = 4096)
[    0.947365] CPU4 attaching sched-domain:
[    0.947367]  domain 0: span 0,2,4,6 level MC
[    0.947368]   groups: 4 6 0 2
[    0.947372]   domain 1: span 0-7 level NODE
[    0.947373]    groups: 0,2,4,6 (cpu_power = 4096) 1,3,5,7 (cpu_power = 4096)
[    0.947379] CPU5 attaching sched-domain:
[    0.947380]  domain 0: span 1,3,5,7 level MC
[    0.947382]   groups: 5 7 1 3
[    0.947385]   domain 1: span 0-7 level NODE
[    0.947387]    groups: 1,3,5,7 (cpu_power = 4096) 0,2,4,6 (cpu_power = 4096)
[    0.947392] CPU6 attaching sched-domain:
[    0.947394]  domain 0: span 0,2,4,6 level MC
[    0.947395]   groups: 6 0 2 4
[    0.947399]   domain 1: span 0-7 level NODE
[    0.947401]    groups: 0,2,4,6 (cpu_power = 4096) 1,3,5,7 (cpu_power = 4096)
[    0.947406] CPU7 attaching sched-domain:
[    0.947407]  domain 0: span 1,3,5,7 level MC
[    0.947409]   groups: 7 1 3 5
[    0.947412]   domain 1: span 0-7 level NODE
[    0.947414]    groups: 1,3,5,7 (cpu_power = 4096) 0,2,4,6 (cpu_power = 4096)
[    0.947894] devtmpfs: initialized
[    0.952262] regulator: core version 0.5
[    0.952387] NET: Registered protocol family 16
[    0.952535] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    0.952620] ACPI: bus type pci registered
[    0.952758] PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
[    0.952828] PCI: MCFG area at e0000000 reserved in E820
[    0.958063] PCI: Using MMCONFIG at e0000000 - efffffff
[    0.958137] PCI: Using configuration type 1 for base access
[    0.958794] bio: create slab <bio-0> at 0
[    0.959374] ACPI: EC: Look up EC in DSDT
[    0.961857] ACPI: BIOS _OSI(Linux) query ignored
[    0.962035] ACPI: Interpreter enabled
[    0.962099] ACPI: (supports S0 S4 S5)
[    0.962301] ACPI: Using IOAPIC for interrupt routing
[    0.966514] ACPI: No dock devices found.
[    0.966987] ACPI: PCI Root Bridge [PCI0] (0000:00)
[    0.967122] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    0.967192] pci 0000:00:00.0: PME# disabled
[    0.967313] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    0.967383] pci 0000:00:01.0: PME# disabled
[    0.967502] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    0.967570] pci 0000:00:03.0: PME# disabled
[    0.967691] pci 0000:00:07.0: PME# supported from D0 D3hot D3cold
[    0.967760] pci 0000:00:07.0: PME# disabled
[    0.967999] pci 0000:00:1a.0: reg 20 io port: [0xec40-0xec5f]
[    0.968061] pci 0000:00:1a.1: reg 20 io port: [0xec60-0xec7f]
[    0.968129] pci 0000:00:1a.7: reg 10 32bit mmio: [0xdf0ff800-0xdf0ffbff]
[    0.968178] pci 0000:00:1a.7: PME# supported from D0 D3hot D3cold
[    0.968249] pci 0000:00:1a.7: PME# disabled
[    0.968364] pci 0000:00:1d.0: reg 20 io port: [0xec80-0xec9f]
[    0.968426] pci 0000:00:1d.1: reg 20 io port: [0xeca0-0xecbf]
[    0.968488] pci 0000:00:1d.2: reg 20 io port: [0xecc0-0xecdf]
[    0.968549] pci 0000:00:1d.3: reg 20 io port: [0xece0-0xecff]
[    0.968614] pci 0000:00:1d.7: reg 10 32bit mmio: [0xdf0ffc00-0xdf0fffff]
[    0.968663] pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
[    0.968733] pci 0000:00:1d.7: PME# disabled
[    0.968907] pci 0000:00:1f.0: quirk: region 0800-087f claimed by ICH6 ACPI/GPIO/TCO
[    0.968993] pci 0000:00:1f.0: quirk: region 0880-08bf claimed by ICH6 GPIO
[    0.969064] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 1 PIO at 0c00 (mask 007f)
[    0.969150] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 2 PIO at 0ca0 (mask 000f)
[    0.969235] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 3 PIO at 00e0 (mask 000f)
[    0.969367] pci 0000:00:1f.2: reg 10 io port: [0xe8e0-0xe8e7]
[    0.969372] pci 0000:00:1f.2: reg 14 io port: [0xe8d0-0xe8d3]
[    0.969377] pci 0000:00:1f.2: reg 18 io port: [0xe8e8-0xe8ef]
[    0.969382] pci 0000:00:1f.2: reg 1c io port: [0xe8d4-0xe8d7]
[    0.969386] pci 0000:00:1f.2: reg 20 io port: [0xec00-0xec0f]
[    0.969391] pci 0000:00:1f.2: reg 24 io port: [0xec10-0xec1f]
[    0.969442] pci 0000:00:1f.5: reg 10 io port: [0xe8f0-0xe8f7]
[    0.969447] pci 0000:00:1f.5: reg 14 io port: [0xe8d8-0xe8db]
[    0.969452] pci 0000:00:1f.5: reg 18 io port: [0xe8f8-0xe8ff]
[    0.969456] pci 0000:00:1f.5: reg 1c io port: [0xe8dc-0xe8df]
[    0.969461] pci 0000:00:1f.5: reg 20 io port: [0xec20-0xec2f]
[    0.969466] pci 0000:00:1f.5: reg 24 io port: [0xec30-0xec3f]
[    0.969533] pci 0000:01:00.0: reg 10 64bit mmio: [0xda000000-0xdbffffff]
[    0.969580] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    0.969649] pci 0000:01:00.0: PME# disabled
[    0.969759] pci 0000:01:00.1: reg 10 64bit mmio: [0xdc000000-0xddffffff]
[    0.969805] pci 0000:01:00.1: PME# supported from D0 D3hot D3cold
[    0.969876] pci 0000:01:00.1: PME# disabled
[    0.969992] pci 0000:00:01.0: bridge 32bit mmio: [0xda000000-0xddffffff]
[    0.970043] pci 0000:03:00.0: reg 10 64bit mmio: [0xdf180000-0xdf1bffff]
[    0.970048] pci 0000:03:00.0: reg 18 io port: [0xfc00-0xfcff]
[    0.970057] pci 0000:03:00.0: reg 1c 64bit mmio: [0xdf1c0000-0xdf1fffff]
[    0.970066] pci 0000:03:00.0: reg 30 32bit mmio pref: [0xdf100000-0xdf107fff]
[    0.970092] pci 0000:03:00.0: supports D1
[    0.970109] pci 0000:03:00.0: disabling ASPM on pre-1.1 PCIe device.  You can enable it with 'pcie_aspm=force'
[    0.970212] pci 0000:00:07.0: bridge io port: [0xf000-0xffff]
[    0.970215] pci 0000:00:07.0: bridge 32bit mmio: [0xdf100000-0xdf1fffff]
[    0.970251] pci 0000:04:03.0: reg 10 32bit mmio pref: [0xd9800000-0xd9ffffff]
[    0.970257] pci 0000:04:03.0: reg 14 32bit mmio: [0xde7fc000-0xde7fffff]
[    0.970263] pci 0000:04:03.0: reg 18 32bit mmio: [0xde800000-0xdeffffff]
[    0.970282] pci 0000:04:03.0: reg 30 32bit mmio pref: [0x000000-0x00ffff]
[    0.970338] pci 0000:00:1e.0: transparent bridge
[    0.970407] pci 0000:00:1e.0: bridge 32bit mmio: [0xde000000-0xdeffffff]
[    0.970412] pci 0000:00:1e.0: bridge 64bit mmio pref: [0xd9800000-0xd9ffffff]
[    0.970428] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
[    0.970913] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX1._PRT]
[    0.971004] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX3._PRT]
[    0.971093] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX7._PRT]
[    0.971189] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.COMP._PRT]
[    0.973444] ACPI: PCI Interrupt Link [LK00] (IRQs 3 4 5 6 7 10 11 14 *15)
[    0.974083] ACPI: PCI Interrupt Link [LK01] (IRQs 3 4 5 6 7 10 11 *14 15)
[    0.974725] ACPI: PCI Interrupt Link [LK02] (IRQs 3 4 5 6 7 10 *11 14 15)
[    0.975361] ACPI: PCI Interrupt Link [LK03] (IRQs 3 4 5 6 7 *10 11 14 15)
[    0.975999] ACPI: PCI Interrupt Link [LK04] (IRQs 3 4 *5 6 7 10 11 14 15)
[    0.981664] ACPI: PCI Interrupt Link [LK05] (IRQs 3 4 5 *6 7 10 11 14 15)
[    0.982299] ACPI: PCI Interrupt Link [LK06] (IRQs 3 4 5 6 7 10 *11 14 15)
[    0.982937] ACPI: PCI Interrupt Link [LK07] (IRQs 3 4 5 6 7 10 11 *14 15)
[    0.983579] vgaarb: device added: PCI:0000:04:03.0,decodes=io+mem,owns=io+mem,locks=none
[    0.983664] vgaarb: loaded
[    0.983768] PCI: Using ACPI for IRQ routing
[    0.983975] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0
[    0.984255] hpet0: 4 comparators, 64-bit 14.318180 MHz counter
[    1.003556] Switching to clocksource tsc
[    1.005286] pnp: PnP ACPI init
[    1.005372] ACPI: bus type pnp registered
[    1.009630] pnp: PnP ACPI: found 12 devices
[    1.009698] ACPI: ACPI bus type pnp unregistered
[    1.009778] system 00:07: ioport range 0x800-0x87f has been reserved
[    1.009850] system 00:07: ioport range 0x880-0x8ff could not be reserved
[    1.009922] system 00:07: ioport range 0x900-0x91f has been reserved
[    1.009993] system 00:07: ioport range 0x920-0x923 has been reserved
[    1.010064] system 00:07: ioport range 0x924-0x924 has been reserved
[    1.010135] system 00:07: ioport range 0xc00-0xc7f has been reserved
[    1.010207] system 00:07: ioport range 0xca0-0xca7 has been reserved
[    1.010278] system 00:07: ioport range 0xca9-0xcab has been reserved
[    1.010349] system 00:07: ioport range 0xcad-0xcaf has been reserved
[    1.010423] system 00:08: ioport range 0xca8-0xca8 has been reserved
[    1.010495] system 00:08: ioport range 0xcac-0xcac has been reserved
[    1.010569] system 00:09: iomem range 0xe0000000-0xefffffff has been reserved
[    1.010645] system 00:0b: iomem range 0xfed90000-0xfed91fff has been reserved
[    1.015675] pci 0000:00:01.0: PCI bridge, secondary bus 0000:01
[    1.015746] pci 0000:00:01.0:   IO window: disabled
[    1.015816] pci 0000:00:01.0:   MEM window: 0xda000000-0xddffffff
[    1.015887] pci 0000:00:01.0:   PREFETCH window: disabled
[    1.015959] pci 0000:00:03.0: PCI bridge, secondary bus 0000:02
[    1.016029] pci 0000:00:03.0:   IO window: disabled
[    1.016099] pci 0000:00:03.0:   MEM window: disabled
[    1.016168] pci 0000:00:03.0:   PREFETCH window: disabled
[    1.016240] pci 0000:00:07.0: PCI bridge, secondary bus 0000:03
[    1.016311] pci 0000:00:07.0:   IO window: 0xf000-0xffff
[    1.016382] pci 0000:00:07.0:   MEM window: 0xdf100000-0xdf1fffff
[    1.016454] pci 0000:00:07.0:   PREFETCH window: disabled
[    1.016528] pci 0000:00:1e.0: PCI bridge, secondary bus 0000:04
[    1.016597] pci 0000:00:1e.0:   IO window: disabled
[    1.016668] pci 0000:00:1e.0:   MEM window: 0xde000000-0xdeffffff
[    1.016740] pci 0000:00:1e.0:   PREFETCH window: 0x000000d9800000-0x000000d9ffffff
[    1.016838]   alloc irq_desc for 53 on node -1
[    1.016840]   alloc kstat_irqs on node -1
[    1.016847] pci 0000:00:01.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53
[    1.016921] pci 0000:00:01.0: setting latency timer to 64
[    1.016929] pci 0000:00:03.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53
[    1.017001] pci 0000:00:03.0: setting latency timer to 64
[    1.017009] pci 0000:00:07.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53
[    1.017082] pci 0000:00:07.0: setting latency timer to 64
[    1.017089] pci 0000:00:1e.0: setting latency timer to 64
[    1.017093] pci_bus 0000:00: resource 0 io:  [0x00-0xffff]
[    1.017097] pci_bus 0000:00: resource 1 mem: [0x000000-0xffffffffffffffff]
[    1.017100] pci_bus 0000:01: resource 1 mem: [0xda000000-0xddffffff]
[    1.017103] pci_bus 0000:03: resource 0 io:  [0xf000-0xffff]
[    1.017105] pci_bus 0000:03: resource 1 mem: [0xdf100000-0xdf1fffff]
[    1.017109] pci_bus 0000:04: resource 1 mem: [0xde000000-0xdeffffff]
[    1.017111] pci_bus 0000:04: resource 2 pref mem [0xd9800000-0xd9ffffff]
[    1.017114] pci_bus 0000:04: resource 3 io:  [0x00-0xffff]
[    1.017117] pci_bus 0000:04: resource 4 mem: [0x000000-0xffffffffffffffff]
[    1.017157] NET: Registered protocol family 2
[    1.017529] IP route cache hash table entries: 262144 (order: 9, 2097152 bytes)
[    1.018906] TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
[    1.021075] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    1.021418] TCP: Hash tables configured (established 524288 bind 65536)
[    1.021489] TCP reno registered
[    1.021805] NET: Registered protocol family 1
[    1.035524] pci 0000:04:03.0: Boot video device
[    1.035569] Unpacking initramfs...
[    1.317820] Freeing initrd memory: 9830k freed
[    1.320076] DMAR: Device scope device [0000:00:1a.02] not found
[    1.320157] DMAR: Device scope device [0000:00:1a.02] not found
[    1.320234] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    1.320306] DMA: Placing 64MB software IO TLB between ffff8800055fe000 - ffff8800095fe000
[    1.320393] DMA: software IO TLB at phys 0x55fe000 - 0x95fe000
[    1.321257] audit: initializing netlink socket (disabled)
[    1.321335] type=2000 audit(1290699108.104:1): initialized
[    1.326308] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    1.328022] VFS: Disk quotas dquot_6.5.2
[    1.328149] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.328325] msgmni has been set to 15985
[    1.328709] alg: No test for stdrng (krng)
[    1.328825] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[    1.328912] io scheduler noop registered
[    1.328978] io scheduler anticipatory registered
[    1.329045] io scheduler deadline registered
[    1.329147] io scheduler cfq registered (default)
[    1.329334]   alloc irq_desc for 56 on node -1
[    1.329337]   alloc kstat_irqs on node -1
[    1.329347] pcieport 0000:00:01.0: irq 56 for MSI/MSI-X
[    1.329354] pcieport 0000:00:01.0: setting latency timer to 64
[    1.329463]   alloc irq_desc for 57 on node -1
[    1.329465]   alloc kstat_irqs on node -1
[    1.329472] pcieport 0000:00:03.0: irq 57 for MSI/MSI-X
[    1.329479] pcieport 0000:00:03.0: setting latency timer to 64
[    1.329587]   alloc irq_desc for 58 on node -1
[    1.329589]   alloc kstat_irqs on node -1
[    1.329596] pcieport 0000:00:07.0: irq 58 for MSI/MSI-X
[    1.329603] pcieport 0000:00:07.0: setting latency timer to 64
[    1.329974] aer 0000:00:01.0:pcie02: service driver aer loaded
[    1.330009] aer 0000:00:03.0:pcie02: service driver aer loaded
[    1.330043] aer 0000:00:07.0:pcie02: service driver aer loaded
[    1.331530] Linux agpgart interface v0.103
[    1.331635] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    1.331805] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    1.331976] serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    1.332295] 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    1.332497] 00:06: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    1.332748] input: Macintosh mouse button emulation as /devices/virtual/input/input0
[    1.332894] PNP: No PS/2 controller found. Probing ports directly.
[    1.335641] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.335714] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.335880] mice: PS/2 mouse device common for all mice
[    1.335987] rtc_cmos 00:04: RTC can wake from S4
[    1.336092] rtc_cmos 00:04: rtc core: registered rtc_cmos as rtc0
[    1.336186] rtc0: alarms up to one day, y3k, 242 bytes nvram, hpet irqs
[    1.336268] cpuidle: using governor ladder
[    1.336333] cpuidle: using governor menu
[    1.336402] No iBFT detected.
[    1.336875] TCP cubic registered
[    1.337065] NET: Registered protocol family 10
[    1.337841] lo: Disabled Privacy Extensions
[    1.338215] Mobile IPv6
[    1.338279] NET: Registered protocol family 17
[    1.338421] PM: Resume from disk failed.
[    1.338432] registered taskstats version 1
[    1.339079] rtc_cmos 00:04: setting system clock to 2010-11-25 15:31:48 UTC (1290699108)
[    1.339198] Initalizing network drop monitor service
[    1.339306] Freeing unused kernel memory: 596k freed
[    1.339518] Write protecting the kernel read-only data: 4324k
[    1.355149] udev[117]: starting version 163
[    1.364521] Broadcom NetXtreme II Gigabit Ethernet Driver bnx2 v2.0.2 (Aug 21, 2009)
[    1.364632]   alloc irq_desc for 36 on node -1
[    1.364634]   alloc kstat_irqs on node -1
[    1.364644] bnx2 0000:01:00.0: PCI INT A -> GSI 36 (level, low) -> IRQ 36
[    1.364720] bnx2 0000:01:00.0: setting latency timer to 64
[    1.364854] bnx2 0000:01:00.0: firmware: requesting bnx2/bnx2-mips-09-5.0.0.j3.fw
[    1.380845] SCSI subsystem initialized
[    1.385855] bnx2 0000:01:00.0: firmware: requesting bnx2/bnx2-rv2p-09-5.0.0.j3.fw
[    1.389203] eth0: Broadcom NetXtreme II BCM5716 1000Base-T (C0) PCI Express found at mem da000000, IRQ 36, node addr a4:ba:db:47:2a:de
[    1.389334]   alloc irq_desc for 48 on node -1
[    1.389337]   alloc kstat_irqs on node -1
[    1.389346] bnx2 0000:01:00.1: PCI INT B -> GSI 48 (level, low) -> IRQ 48
[    1.389423] bnx2 0000:01:00.1: setting latency timer to 64
[    1.389559] bnx2 0000:01:00.1: firmware: requesting bnx2/bnx2-mips-09-5.0.0.j3.fw
[    1.390809] usbcore: registered new interface driver usbfs
[    1.390899] usbcore: registered new interface driver hub
[    1.391050] usbcore: registered new device driver usb
[    1.392271] bnx2 0000:01:00.1: firmware: requesting bnx2/bnx2-rv2p-09-5.0.0.j3.fw
[    1.395671] eth1: Broadcom NetXtreme II BCM5716 1000Base-T (C0) PCI Express found at mem dc000000, IRQ 48, node addr a4:ba:db:47:2a:df
[    1.408572] libata version 3.00 loaded.
[    1.410154] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.410247]   alloc irq_desc for 19 on node -1
[    1.410249]   alloc kstat_irqs on node -1
[    1.410256] ehci_hcd 0000:00:1a.7: PCI INT C -> GSI 19 (level, low) -> IRQ 19
[    1.410356] ehci_hcd 0000:00:1a.7: setting latency timer to 64
[    1.410359] ehci_hcd 0000:00:1a.7: EHCI Host Controller
[    1.410450] ehci_hcd 0000:00:1a.7: new USB bus registered, assigned bus number 1
[    1.410566] ehci_hcd 0000:00:1a.7: debug port 1
[    1.414516] ehci_hcd 0000:00:1a.7: cache line size of 32 is not supported
[    1.414533] ehci_hcd 0000:00:1a.7: irq 19, io mem 0xdf0ff800
[    1.415604] megasas: 00.00.04.01 Thu July 24 11:41:51 PST 2008
[    1.415695] megasas: 0x1000:0x0060:0x1028:0x1f0b: bus 3:slot 0:func 0
[    1.415829]   alloc irq_desc for 38 on node -1
[    1.415831]   alloc kstat_irqs on node -1
[    1.415840] megaraid_sas 0000:03:00.0: PCI INT A -> GSI 38 (level, low) -> IRQ 38
[    1.415935] megaraid_sas 0000:03:00.0: setting latency timer to 64
[    1.416012] megasas: FW now in Ready state
[    1.426964] ehci_hcd 0000:00:1a.7: USB 2.0 started, EHCI 1.00
[    1.427061] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    1.427133] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.427219] usb usb1: Product: EHCI Host Controller
[    1.427286] usb usb1: Manufacturer: Linux 2.6.32-5-xen-amd64 ehci_hcd
[    1.427357] usb usb1: SerialNumber: 0000:00:1a.7
[    1.427502] usb usb1: configuration #1 chosen from 1 choice
[    1.427601] hub 1-0:1.0: USB hub found
[    1.427672] hub 1-0:1.0: 4 ports detected
[    1.427789] ata_piix 0000:00:1f.2: version 2.13
[    1.427801]   alloc irq_desc for 23 on node -1
[    1.427803]   alloc kstat_irqs on node -1
[    1.427810] ata_piix 0000:00:1f.2: PCI INT C -> GSI 23 (level, low) -> IRQ 23
[    1.427885] ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
[    1.455328] scsi0 : LSI SAS based MegaRAID driver
[    1.456421] scsi 0:0:0:0: Direct-Access     SEAGATE  ST3146356SS      HS10 PQ: 0 ANSI: 5
[    1.457359] scsi 0:0:1:0: Direct-Access     SEAGATE  ST3146356SS      HS10 PQ: 0 ANSI: 5
[    1.458290] scsi 0:0:2:0: Direct-Access     SEAGATE  ST3146356SS      HS10 PQ: 0 ANSI: 5
[    1.534417] scsi 0:0:32:0: Enclosure         DP       BACKPLANE        1.07 PQ: 0 ANSI: 5
[    1.545376] scsi 0:2:0:0: Direct-Access     DELL     PERC 6/i Adapter 1.22 PQ: 0 ANSI: 5
[    1.561796] sd 0:2:0:0: [sda] 285474816 512-byte logical blocks: (146 GB/136 GiB)
[    1.561972] sd 0:2:0:0: [sda] Write Protect is off
[    1.562041] sd 0:2:0:0: [sda] Mode Sense: 1f 00 10 08
[    1.562095] sd 0:2:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
[    1.562404]  sda: sda1 sda2 sda3
[    1.582689] ata_piix 0000:00:1f.2: setting latency timer to 64
[    1.582751] scsi1 : ata_piix
[    1.582889] scsi2 : ata_piix
[    1.582995] ata1: SATA max UDMA/133 cmd 0xe8e0 ctl 0xe8d0 bmdma 0xec00 irq 23
[    1.583071] ata2: SATA max UDMA/133 cmd 0xe8e8 ctl 0xe8d4 bmdma 0xec08 irq 23
[    1.583172]   alloc irq_desc for 21 on node -1
[    1.583175]   alloc kstat_irqs on node -1
[    1.583182] ehci_hcd 0000:00:1d.7: PCI INT A -> GSI 21 (level, low) -> IRQ 21
[    1.583283] ehci_hcd 0000:00:1d.7: setting latency timer to 64
[    1.583287] ehci_hcd 0000:00:1d.7: EHCI Host Controller
[    1.583365] ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 2
[    1.583480] ehci_hcd 0000:00:1d.7: debug port 1
[    1.587418] ehci_hcd 0000:00:1d.7: cache line size of 32 is not supported
[    1.587433] ehci_hcd 0000:00:1d.7: irq 21, io mem 0xdf0ffc00
[    1.589214] sd 0:2:0:0: [sda] Attached SCSI disk
[    1.602882] ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00
[    1.602968] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    1.603040] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.603126] usb usb2: Product: EHCI Host Controller
[    1.603194] usb usb2: Manufacturer: Linux 2.6.32-5-xen-amd64 ehci_hcd
[    1.603264] usb usb2: SerialNumber: 0000:00:1d.7
[    1.603399] usb usb2: configuration #1 chosen from 1 choice
[    1.603501] hub 2-0:1.0: USB hub found
[    1.603571] hub 2-0:1.0: 4 ports detected
[    1.603695]   alloc irq_desc for 22 on node -1
[    1.603698]   alloc kstat_irqs on node -1
[    1.603704] ata_piix 0000:00:1f.5: PCI INT D -> GSI 22 (level, low) -> IRQ 22
[    1.603779] ata_piix 0000:00:1f.5: MAP [ P0 -- P1 -- ]
[    1.611862] uhci_hcd: USB Universal Host Controller Interface driver
[    1.716515] ses 0:0:32:0: Attached Enclosure device
[    1.738381] usb 1-3: new high speed USB device using ehci_hcd and address 2
[    1.758354] ata_piix 0000:00:1f.5: setting latency timer to 64
[    1.758413] scsi3 : ata_piix
[    1.758543] scsi4 : ata_piix
[    1.758647] ata3: SATA max UDMA/133 cmd 0xe8f0 ctl 0xe8d8 bmdma 0xec20 irq 22
[    1.758721] ata4: SATA max UDMA/133 cmd 0xe8f8 ctl 0xe8dc bmdma 0xec28 irq 22
[    1.758836]   alloc irq_desc for 17 on node -1
[    1.758839]   alloc kstat_irqs on node -1
[    1.758847] uhci_hcd 0000:00:1a.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
[    1.758927] uhci_hcd 0000:00:1a.0: setting latency timer to 64
[    1.758931] uhci_hcd 0000:00:1a.0: UHCI Host Controller
[    1.759011] uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 3
[    1.759134] uhci_hcd 0000:00:1a.0: irq 17, io base 0x0000ec40
[    1.759243] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001
[    1.759315] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.759401] usb usb3: Product: UHCI Host Controller
[    1.759468] usb usb3: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    1.759539] usb usb3: SerialNumber: 0000:00:1a.0
[    1.759680] usb usb3: configuration #1 chosen from 1 choice
[    1.759781] hub 3-0:1.0: USB hub found
[    1.759853] hub 3-0:1.0: 2 ports detected
[    1.759968]   alloc irq_desc for 18 on node -1
[    1.759970]   alloc kstat_irqs on node -1
[    1.759976] uhci_hcd 0000:00:1a.1: PCI INT B -> GSI 18 (level, low) -> IRQ 18
[    1.760052] uhci_hcd 0000:00:1a.1: setting latency timer to 64
[    1.760056] uhci_hcd 0000:00:1a.1: UHCI Host Controller
[    1.760130] uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 4
[    1.760258] uhci_hcd 0000:00:1a.1: irq 18, io base 0x0000ec60
[    1.760357] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001
[    1.760429] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.760515] usb usb4: Product: UHCI Host Controller
[    1.760582] usb usb4: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    1.760652] usb usb4: SerialNumber: 0000:00:1a.1
[    1.760777] usb usb4: configuration #1 chosen from 1 choice
[    1.760874] hub 4-0:1.0: USB hub found
[    1.760943] hub 4-0:1.0: 2 ports detected
[    1.761051] uhci_hcd 0000:00:1d.0: PCI INT A -> GSI 21 (level, low) -> IRQ 21
[    1.761128] uhci_hcd 0000:00:1d.0: setting latency timer to 64
[    1.761131] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[    1.761204] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 5
[    1.761313] uhci_hcd 0000:00:1d.0: irq 21, io base 0x0000ec80
[    1.761411] usb usb5: New USB device found, idVendor=1d6b, idProduct=0001
[    1.761483] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.761569] usb usb5: Product: UHCI Host Controller
[    1.761636] usb usb5: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    1.761707] usb usb5: SerialNumber: 0000:00:1d.0
[    1.761831] usb usb5: configuration #1 chosen from 1 choice
[    1.761929] hub 5-0:1.0: USB hub found
[    1.761998] hub 5-0:1.0: 2 ports detected
[    1.762107]   alloc irq_desc for 20 on node -1
[    1.762109]   alloc kstat_irqs on node -1
[    1.762115] uhci_hcd 0000:00:1d.1: PCI INT B -> GSI 20 (level, low) -> IRQ 20
[    1.762191] uhci_hcd 0000:00:1d.1: setting latency timer to 64
[    1.762194] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[    1.762268] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 6
[    1.762382] uhci_hcd 0000:00:1d.1: irq 20, io base 0x0000eca0
[    1.762483] usb usb6: New USB device found, idVendor=1d6b, idProduct=0001
[    1.762555] usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.762647] usb usb6: Product: UHCI Host Controller
[    1.762714] usb usb6: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    1.762784] usb usb6: SerialNumber: 0000:00:1d.1
[    1.762911] usb usb6: configuration #1 chosen from 1 choice
[    1.763008] hub 6-0:1.0: USB hub found
[    1.763078] hub 6-0:1.0: 2 ports detected
[    1.763190] uhci_hcd 0000:00:1d.2: PCI INT C -> GSI 21 (level, low) -> IRQ 21
[    1.763266] uhci_hcd 0000:00:1d.2: setting latency timer to 64
[    1.763270] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[    1.763343] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 7
[    1.763452] uhci_hcd 0000:00:1d.2: irq 21, io base 0x0000ecc0
[    1.763553] usb usb7: New USB device found, idVendor=1d6b, idProduct=0001
[    1.763624] usb usb7: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.763710] usb usb7: Product: UHCI Host Controller
[    1.763778] usb usb7: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    1.763848] usb usb7: SerialNumber: 0000:00:1d.2
[    1.763972] usb usb7: configuration #1 chosen from 1 choice
[    1.764070] hub 7-0:1.0: USB hub found
[    1.764140] hub 7-0:1.0: 2 ports detected
[    1.764248] uhci_hcd 0000:00:1d.3: PCI INT D -> GSI 20 (level, low) -> IRQ 20
[    1.764325] uhci_hcd 0000:00:1d.3: setting latency timer to 64
[    1.764328] uhci_hcd 0000:00:1d.3: UHCI Host Controller
[    1.764415] uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 8
[    1.764524] uhci_hcd 0000:00:1d.3: irq 20, io base 0x0000ece0
[    1.764622] usb usb8: New USB device found, idVendor=1d6b, idProduct=0001
[    1.764694] usb usb8: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.764780] usb usb8: Product: UHCI Host Controller
[    1.764848] usb usb8: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    1.764918] usb usb8: SerialNumber: 0000:00:1d.3
[    1.765043] usb usb8: configuration #1 chosen from 1 choice
[    1.765139] hub 8-0:1.0: USB hub found
[    1.765209] hub 8-0:1.0: 2 ports detected
[    1.878474] usb 1-3: New USB device found, idVendor=0424, idProduct=2514
[    1.878547] usb 1-3: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    1.878688] usb 1-3: configuration #1 chosen from 1 choice
[    1.878875] hub 1-3:1.0: USB hub found
[    1.878969] hub 1-3:1.0: 4 ports detected
[    2.233442] usb 5-2: new full speed USB device using uhci_hcd and address 2
[    2.233486] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    2.257624] ata3.00: ATAPI: TSSTcorp DVD+/-RW TS-L633C, D250, max UDMA/100
[    2.257709] ata3.00: applying bridge limits
[    2.289586] ata3.00: configured for UDMA/100
[    2.460027] usb 5-2: New USB device found, idVendor=0624, idProduct=0248
[    2.460100] usb 5-2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    2.460172] usb 5-2: Product: USB Composite Device-0
[    2.460240] usb 5-2: Manufacturer: Avocent
[    2.460306] usb 5-2: SerialNumber: 20080519
[    2.460436] usb 5-2: configuration #1 chosen from 1 choice
[    2.480203] usbcore: registered new interface driver hiddev
[    2.484163] input: Avocent USB Composite Device-0 as /devices/pci0000:00/0000:00:1d.0/usb5/5-2/5-2:1.0/input/input1
[    2.484297] generic-usb 0003:0624:0248.0001: input,hidraw0: USB HID v1.00 Keyboard [Avocent USB Composite Device-0] on usb-0000:00:1d.0-2/input0
[    2.488108] input: Avocent USB Composite Device-0 as /devices/pci0000:00/0000:00:1d.0/usb5/5-2/5-2:1.1/input/input2
[    2.488258] generic-usb 0003:0624:0248.0002: input,hidraw1: USB HID v1.00 Mouse [Avocent USB Composite Device-0] on usb-0000:00:1d.0-2/input1
[    2.488370] usbcore: registered new interface driver usbhid
[    2.488440] usbhid: v2.6:USB HID core driver
[    2.608735] ata2.00: failed to resume link (SControl 0)
[    2.784401] ata4: failed to resume link (SControl 0)
[    2.795177] ata4: SATA link down (SStatus 4 SControl 0)
[    2.932121] ata1.01: failed to resume link (SControl 0)
[    2.942924] ata1.00: SATA link down (SStatus 0 SControl 300)
[    2.943004] ata1.01: SATA link down (SStatus 0 SControl 0)
[    3.634792] ata2.01: failed to resume link (SControl 0)
[    3.645569] ata2.00: SATA link down (SStatus 0 SControl 0)
[    3.645649] ata2.01: SATA link down (SStatus 0 SControl 0)
[    3.649026] scsi 3:0:0:0: CD-ROM            TSSTcorp DVD+-RW TS-L633C D250 PQ: 0 ANSI: 5
[    3.665183] sr0: scsi3-mmc drive: 24x/24x writer dvd-ram cd/rw xa/form2 cdda tray
[    3.665272] Uniform CD-ROM driver Revision: 3.20
[    3.665433] sr 3:0:0:0: Attached scsi CD-ROM sr0
[    3.668796] ses 0:0:32:0: Attached scsi generic sg0 type 13
[    3.668902] sd 0:2:0:0: Attached scsi generic sg1 type 0
[    3.669008] sr 3:0:0:0: Attached scsi generic sg2 type 5
[    3.826318] device-mapper: uevent: version 1.0.3
[    3.826533] device-mapper: ioctl: 4.15.0-ioctl (2009-04-01) initialised: dm-devel@redhat.com
[    3.831583] PM: Starting manual resume from disk
[    3.831666] PM: Resume from partition 8:2
[    3.831668] PM: Checking hibernation image.
[    3.831960] PM: Error -22 checking image file
[    3.831963] PM: Resume from disk failed.
[    3.848390] kjournald starting.  Commit interval 5 seconds
[    3.848395] EXT3-fs: mounted filesystem with ordered data mode.
[    4.445451] udev[402]: starting version 163
[    4.560445] input: PC Speaker as /devices/platform/pcspkr/input/input3
[    4.621710] Monitor-Mwait will be used to enter C-1 state
[    4.621747] Monitor-Mwait will be used to enter C-3 state
[    4.621833] processor LNXCPU:00: registered as cooling_device0
[    4.622176] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)
[    4.622531] processor LNXCPU:01: registered as cooling_device1
[    4.624173] processor LNXCPU:02: registered as cooling_device2
[    4.625570] processor LNXCPU:03: registered as cooling_device3
[    4.625708] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4
[    4.625833] ACPI: Power Button [PWRF]
[    4.626532] processor LNXCPU:04: registered as cooling_device4
[    4.627962] ACPI Error: SMBus or IPMI write requires Buffer of length 42, found length 20 (20090903/exfield-286)
[    4.627970] ACPI Error (psparse-0537): Method parse/execution failed [\_SB_.PMI0._GHL] (Node ffff88022fc0ec40), AE_AML_BUFFER_LIMIT
[    4.627994] ACPI Error (psparse-0537): Method parse/execution failed [\_SB_.PMI0._PMC] (Node ffff88022fc0ebc0), AE_AML_BUFFER_LIMIT
[    4.628018] ACPI Exception: AE_AML_BUFFER_LIMIT, Evaluating _PMC (20090903/power_meter-772)
[    4.632736] processor LNXCPU:05: registered as cooling_device5
[    4.633446] processor LNXCPU:06: registered as cooling_device6
[    4.634163] processor LNXCPU:07: registered as cooling_device7
[    4.850294] Error: Driver 'pcspkr' is already registered, aborting...
[    5.199095] Adding 979956k swap on /dev/sda2.  Priority:-1 extents:1 across:979956k 
[    5.264220] EXT3 FS on sda1, internal journal
[    5.343542] loop: module loaded
[    5.827455]   alloc irq_desc for 59 on node -1
[    5.827459]   alloc kstat_irqs on node -1
[    5.827468] bnx2 0000:01:00.0: irq 59 for MSI/MSI-X
[    5.827470]   alloc irq_desc for 60 on node -1
[    5.827472]   alloc kstat_irqs on node -1
[    5.827476] bnx2 0000:01:00.0: irq 60 for MSI/MSI-X
[    5.827478]   alloc irq_desc for 61 on node -1
[    5.827480]   alloc kstat_irqs on node -1
[    5.827484] bnx2 0000:01:00.0: irq 61 for MSI/MSI-X
[    5.827486]   alloc irq_desc for 62 on node -1
[    5.827488]   alloc kstat_irqs on node -1
[    5.827491] bnx2 0000:01:00.0: irq 62 for MSI/MSI-X
[    5.827493]   alloc irq_desc for 63 on node -1
[    5.827495]   alloc kstat_irqs on node -1
[    5.827499] bnx2 0000:01:00.0: irq 63 for MSI/MSI-X
[    5.827501]   alloc irq_desc for 64 on node -1
[    5.827503]   alloc kstat_irqs on node -1
[    5.827506] bnx2 0000:01:00.0: irq 64 for MSI/MSI-X
[    5.827508]   alloc irq_desc for 65 on node -1
[    5.827511]   alloc kstat_irqs on node -1
[    5.827514] bnx2 0000:01:00.0: irq 65 for MSI/MSI-X
[    5.827516]   alloc irq_desc for 66 on node -1
[    5.827520]   alloc kstat_irqs on node -1
[    5.827524] bnx2 0000:01:00.0: irq 66 for MSI/MSI-X
[    5.827526]   alloc irq_desc for 67 on node -1
[    5.827528]   alloc kstat_irqs on node -1
[    5.827531] bnx2 0000:01:00.0: irq 67 for MSI/MSI-X
[    5.880594] bnx2: eth0: using MSIX
[    5.881894] ADDRCONF(NETDEV_UP): eth0: link is not ready
[    9.022149] bnx2: eth0 NIC Copper Link is Up, 1000 Mbps full duplex
[    9.023524] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   19.744417] eth0: no IPv6 routers present

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #3: bootlog_xen.txt --]
[-- Type: text/plain; name="bootlog_xen.txt"; charset="UTF-8", Size: 21142 bytes --]

(XEN) Xen version 4.0.1 (Debian 4.0.1-1) (waldi@debian.org) (gcc version 4.4.5 20100824 (prerelease) (Debian 4.4.4-11) ) Fri Sep  3 15:38:12 UTC 2010
(XEN) Bootloader: GNU GRUB 0.97
(XEN) Command line: com2=57600,8n1,0x2f8,3 console=com2 dom0_mem=1024M
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: none; EDID transfer time: 0 seconds
(XEN)  EDID info not retrieved because no DDC retrieval method detected
(XEN) Disc information:
(XEN)  Found 1 MBR signatures
(XEN)  Found 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 00000000000a0000 (usable)
(XEN)  0000000000100000 - 00000000cf679000 (usable)
(XEN)  00000000cf679000 - 00000000cf68f000 (reserved)
(XEN)  00000000cf68f000 - 00000000cf6ce000 (ACPI data)
(XEN)  00000000cf6ce000 - 00000000d0000000 (reserved)
(XEN)  00000000e0000000 - 00000000f0000000 (reserved)
(XEN)  00000000fe000000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000000230000000 (usable)
(XEN) ACPI: RSDP 000F09E0, 0024 (r2 DELL  )
(XEN) ACPI: XSDT 000F0AE4, 009C (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: FACP CF6B3F9C, 00F4 (r3 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: DSDT CF68F000, 3B39 (r1 DELL   PE_SC3          1 INTL 20050624)
(XEN) ACPI: FACS CF6B6000, 0040
(XEN) ACPI: APIC CF6B3478, 015E (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SPCR CF6B35D8, 0050 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: HPET CF6B362C, 0038 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: DMAR CF6B3668, 01B0 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: MCFG CF6B38C4, 003C (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: WD__ CF6B3904, 0134 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SLIC CF6B3A3C, 0024 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: ERST CF692CBC, 0270 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: HEST CF692F2C, 03A8 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: BERT CF692B3C, 0030 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: EINJ CF692B6C, 0150 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SRAT CF6B3BC0, 0370 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: TCPA CF6B3F34, 0064 (r2 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SSDT CF6B7000, 2104 (r1  INTEL PPM RCM  80000001 INTL 20061109)
(XEN) System RAM: 8182MB (8378468kB)
(XEN) Reserving non-aligned node boundary @ mfn 0x130000
(XEN) Domain heap initialised DMA width 30 bits
(XEN) Processor #16 7:10 APIC version 21
(XEN) Processor #0 7:10 APIC version 21
(XEN) Processor #18 7:10 APIC version 21
(XEN) Processor #2 7:10 APIC version 21
(XEN) Processor #20 7:10 APIC version 21
(XEN) Processor #4 7:10 APIC version 21
(XEN) Processor #22 7:10 APIC version 21
(XEN) Processor #6 7:10 APIC version 21
(XEN) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
(XEN) IOAPIC[1]: apic_id 1, version 32, address 0xfec80000, GSI 32-55
(XEN) Enabling APIC mode:  Flat.  Using 2 I/O APICs
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2261.087 MHz processor.
(XEN) Initing memory sharing.
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Extended Page Tables (EPT)
(XEN)  - Virtual-Processor Identifiers (VPID)
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN) EPT supports 2MB super page.
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging detected.
(XEN) Intel VT-d Snoop Control supported.
(XEN) Intel VT-d DMA Passthrough not supported.
(XEN) Intel VT-d Queued Invalidation supported.
(XEN) Intel VT-d Interrupt Remapping not supported.
(XEN) I/O virtualisation enabled
(XEN)  - Dom0 mode: Relaxed
(XEN) Total of 8 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) TSC is reliable, synchronization unnecessary
(XEN) Platform timer is 14.318MHz HPET
ÿ(XEN) Allocated console ring of 16 KiB.
(XEN) Brought up 8 CPUs
(XEN) *** LOADING DOMAIN 0 ***
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x16b5000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000224000000->0000000228000000 (245760 pages to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff81000000->ffffffff816b5000
(XEN)  Init. ramdisk: ffffffff816b5000->ffffffff83244e00
(XEN)  Phys-Mach map: ffffffff83245000->ffffffff83445000
(XEN)  Start info:    ffffffff83445000->ffffffff834454b4
(XEN)  Page tables:   ffffffff83446000->ffffffff83465000
(XEN)  Boot stack:    ffffffff83465000->ffffffff83466000
(XEN)  TOTAL:         ffffffff80000000->ffffffff83800000
(XEN)  ENTRY ADDRESS: ffffffff81506200
(XEN) Dom0 has maximum 8 VCPUs
(XEN) Scrubbing Free RAM: ....................................................................done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: Errors and warnings
(XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 176kB init memory.
mapping kernel into physical memory
Xen: setup ISA identity maps
about to get started...
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 2.6.32-5-xen-amd64 (Debian 2.6.32-27) (maks@debian.org) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 SMP Sat Oct 30 17:04:10 UTC 2010
[    0.000000] Command line: root=/dev/sda1 console=hvc0 nomodeset
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] released 0 pages of unused memory
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  Xen: 0000000000000000 - 00000000000a0000 (usable)
[    0.000000]  Xen: 00000000000a0000 - 0000000000100000 (reserved)
[    0.000000]  Xen: 0000000000100000 - 0000000040000000 (usable)
[    0.000000]  Xen: 00000000cf679000 - 00000000cf68f000 (reserved)
[    0.000000]  Xen: 00000000cf68f000 - 00000000cf6ce000 (ACPI data)
[    0.000000]  Xen: 00000000cf6ce000 - 00000000d0000000 (reserved)
[    0.000000]  Xen: 00000000e0000000 - 00000000f0000000 (reserved)
[    0.000000]  Xen: 00000000fe000000 - 0000000100000000 (reserved)
[    0.000000] DMI 2.6 present.
[    0.000000] last_pfn = 0x40000 max_arch_pfn = 0x400000000
[    0.000000] x86 PAT enabled: cpu 0, old 0x50100070406, new 0x7010600070106
[    0.000000] init_memory_mapping: 0000000000000000-0000000040000000
[    0.000000] RAMDISK: 016b5000 - 03244e00
[    0.000000] ACPI: RSDP 00000000000f09e0 00024 (v02 DELL  )
[    0.000000] ACPI: XSDT 00000000000f0ae4 0009C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: FACP 00000000cf6b3f9c 000F4 (v03 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: DSDT 00000000cf68f000 03B39 (v01 DELL   PE_SC3   00000001 INTL 20050624)
[    0.000000] ACPI: FACS 00000000cf6b6000 00040
[    0.000000] ACPI: APIC 00000000cf6b3478 0015E (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SPCR 00000000cf6b35d8 00050 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: HPET 00000000cf6b362c 00038 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: XMAR 00000000cf6b3668 001B0 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: MCFG 00000000cf6b38c4 0003C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: WD__ 00000000cf6b3904 00134 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SLIC 00000000cf6b3a3c 00024 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: ERST 00000000cf692cbc 00270 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: HEST 00000000cf692f2c 003A8 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: BERT 00000000cf692b3c 00030 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: EINJ 00000000cf692b6c 00150 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SRAT 00000000cf6b3bc0 00370 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: TCPA 00000000cf6b3f34 00064 (v02 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SSDT 00000000cf6b7000 02104 (v01  INTEL PPM RCM  80000001 INTL 20061109)
[    0.000000] SRAT: PXM 1 -> APIC 16 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 0 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 18 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 2 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 20 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 4 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 22 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 6 -> Node 1
[    0.000000] SRAT: Node 1 PXM 2 0-d0000000
[    0.000000] SRAT: Node 1 PXM 2 100000000-130000000
[    0.000000] SRAT: Node 0 PXM 1 130000000-230000000
[    0.000000] Bootmem setup node 1 0000000000000000-0000000040000000
[    0.000000]   NODE_DATA [0000000000008000 - 000000000000ffff]
[    0.000000]   bootmap [0000000000010000 -  0000000000017fff] pages 8
[    0.000000] (8 early reservations) ==> bootmem [0000000000 - 0040000000]
[    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
[    0.000000]   #1 [0003446000 - 0003465000]   XEN PAGETABLES ==> [0003446000 - 0003465000]
[    0.000000]   #2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
[    0.000000]   #3 [0001000000 - 0001694994]    TEXT DATA BSS ==> [0001000000 - 0001694994]
[    0.000000]   #4 [00016b5000 - 0003244e00]          RAMDISK ==> [00016b5000 - 0003244e00]
[    0.000000]   #5 [0003245000 - 0003446000]   XEN START INFO ==> [0003245000 - 0003446000]
[    0.000000]   #6 [0001695000 - 000169532d]              BRK ==> [0001695000 - 000169532d]
[    0.000000]   #7 [0000100000 - 00002e0000]          PGTABLE ==> [0000100000 - 00002e0000]
[    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000000 -> 0x00001000
[    0.000000]   DMA32    0x00001000 -> 0x00100000
[    0.000000]   Normal   0x00100000 -> 0x00100000
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[2] active PFN ranges
[    0.000000]     1: 0x00000000 -> 0x000000a0
[    0.000000]     1: 0x00000100 -> 0x00040000
[    0.000000] ACPI: PM-Timer IO Port: 0x808
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x28] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x29] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x2a] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x2b] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2c] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2d] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x2f] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 0, address 0xfec00000, GSI 0-0
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32])
[    0.000000] IOAPIC[1]: apic_id 1, version 0, address 0xfec80000, GSI 32-32
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ERROR: Unable to locate IOAPIC for GSI 2
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ERROR: Unable to locate IOAPIC for GSI 9
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[    0.000000] SMP: Allowing 8 CPUs, 0 hotplug CPUs
[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
[    0.000000] Allocating PCI resources starting at 40000000 (gap: 40000000:8f679000)
[    0.000000] Booting paravirtualized kernel on Xen
[    0.000000] Xen version: 4.0.1 (preserve-AD) (dom0)
[    0.000000] NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:8 nr_node_ids:2
[    0.000000] PERCPU: Embedded 30 pages/cpu @ffff88000349b000 s90328 r8192 d24360 u122880
[    0.000000] pcpu-alloc: s90328 r8192 d24360 u122880 alloc=30*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 [0] 4 [0] 5 [0] 6 [0] 7 
[    3.107149] Xen: using vcpu_info placement
[    3.107154] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 257981
[    3.107156] Policy zone: DMA32
[    3.107158] Kernel command line: root=/dev/sda1 console=hvc0 nomodeset
[    3.107181] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    3.107480] Initializing CPU#0
[    3.115945] DMA: Placing 64MB software IO TLB between ffff88000466f000 - ffff88000866f000
[    3.115949] DMA: software IO TLB at phys 0x466f000 - 0x866f000
[    3.115952] xen_swiotlb_fixup: buf=ffff88000466f000 size=67108864
[    3.135221] xen_swiotlb_fixup: buf=ffff8800086cf000 size=32768
[    3.139591] Memory: 927524k/1048576k available (3145k kernel code, 384k absent, 120668k reserved, 1902k data, 596k init)
[    3.139632] SLUB: Genslabs=14, HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=2
[    3.139666] Hierarchical RCU implementation.
[    3.139675] NR_IRQS:4352 nr_irqs:2304
[    3.139869] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    3.139872] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    3.139874] xen: sci override: source_irq=9 global_irq=9 trigger=c polarity=1
[    3.139879] xen_allocate_pirq: returning irq 9 for gsi 9
[    3.139888] xen: acpi sci 9
[    3.145769] Console: colour VGA+ 80x25
[    3.146041] console [hvc0] enabled
[    3.146072] installing Xen timer for CPU 0
[    3.146088] BUG: unable to handle kernel paging request at 0000000000005a08
[    3.146094] IP: [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
[    3.146103] PGD 0 
[    3.146106] Thread overran stack, or stack corrupted
[    3.146110] Oops: 0000 [#1] SMP 
[    3.146114] last sysfs file: 
[    3.146116] CPU 0 
[    3.146119] Modules linked in:
[    3.146124] Pid: 0, comm: swapper Not tainted 2.6.32-5-xen-amd64 #1 PowerEdge R410
[    3.146128] RIP: e030:[<ffffffff810badce>]  [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
[    3.146135] RSP: e02b:ffffffff81443c88  EFLAGS: 00010046
[    3.146138] RAX: 0000000000000000 RBX: 0000000000005220 RCX: 0000000000005a00
[    3.146142] RDX: 0000000000000000 RSI: 0000000000000002 RDI: 0000000000005220
[    3.146146] RBP: 0000000000004020 R08: 0000000000000002 R09: ffff88003fc1c010
[    3.146150] R10: ffffffff813c2700 R11: 00000000000186a0 R12: 0000000000005220
[    3.146154] R13: 0000000000000002 R14: 0000000000000000 R15: ffff88000000da28
[    3.146162] FS:  0000000000000000(0000) GS:ffff88000349b000(0000) knlGS:0000000000000000
[    3.146166] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[    3.146170] CR2: 0000000000005a08 CR3: 0000000001001000 CR4: 0000000000002660
[    3.146174] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[    3.146178] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[    3.146183] Process swapper (pid: 0, threadinfo ffffffff81442000, task ffffffff814771f0)
[    3.146186] Stack:
[    3.146188]  ffff88000000da00 00000010813c2765 00000000000212d0 00000000000186a0
[    3.146195] <0> ffff88000000ac10 ffffffff8100e5b5 ffffffff8100ec72 00000000000186a0
[    3.146202] <0> 00000000000186a0 0000000000000000 0000000000005a00 0000000000000000
[    3.146210] Call Trace:
[    3.146218]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
[    3.146223]  [<ffffffff8100ec72>] ? check_events+0x12/0x20
[    3.146230]  [<ffffffff810e759d>] ? new_slab+0x42/0x1ca
[    3.146235]  [<ffffffff810e7915>] ? __slab_alloc+0x1f0/0x39b
[    3.146241]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    3.146246]  [<ffffffff810e85cb>] ? __kmalloc_node+0xe8/0x146
[    3.146251]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    3.146256]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    3.146262]  [<ffffffff811f24df>] ? find_unbound_irq+0x67/0xae
[    3.146267]  [<ffffffff811f259e>] ? bind_virq_to_irq+0x78/0x126
[    3.146272]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
[    3.146277]  [<ffffffff8100e8f6>] ? xen_timer_interrupt+0x0/0x18d
[    3.146282]  [<ffffffff811f29f6>] ? bind_virq_to_irqhandler+0x19/0x4a
[    3.146287]  [<ffffffff8100e884>] ? xen_setup_timer+0x55/0xaa
[    3.146293]  [<ffffffff81509a5e>] ? xen_time_init+0xaf/0xb5
[    3.146298]  [<ffffffff8150a491>] ? x86_late_time_init+0xa/0x10
[    3.146303]  [<ffffffff81506c3d>] ? start_kernel+0x348/0x3e8
[    3.146308]  [<ffffffff81508c7d>] ? xen_start_kernel+0x57c/0x581
[    3.146311] Code: d8 c1 e8 13 83 e0 01 09 44 24 64 41 89 dc 44 23 25 28 01 43 00 44 89 e2 83 e2 10 89 54 24 5c 74 05 e8 16 03 25 00 48 8b 4c 24 50 <48> 83 79 08 00 0f 84 30 05 00 00 83 e3 0f 48 8b 44 24 50 41 bf 
[    3.146366] RIP  [<ffffffff810badce>] __alloc_pages_nodemask+0x8f/0x5f5
[    3.146371]  RSP <ffffffff81443c88>
[    3.146374] CR2: 0000000000005a08
[    3.146382] ---[ end trace a7919e7f17c0a725 ]---
[    3.146386] Kernel panic - not syncing: Attempted to kill the idle task!
[    3.146390] Pid: 0, comm: swapper Tainted: G      D    2.6.32-5-xen-amd64 #1
[    3.146394] Call Trace:
[    3.146399]  [<ffffffff8130a45a>] ? panic+0x86/0x141
[    3.146403]  [<ffffffff8130a563>] ? printk+0x4e/0x5b
[    3.146410]  [<ffffffff81051f7b>] ? do_exit+0x72/0x6b5
[    3.146414]  [<ffffffff8100ec72>] ? check_events+0x12/0x20
[    3.146420]  [<ffffffff8130d1bd>] ? oops_end+0xaf/0xb4
[    3.146427]  [<ffffffff8103338c>] ? no_context+0x1e9/0x1f8
[    3.146432]  [<ffffffff81033541>] ? __bad_area_nosemaphore+0x1a6/0x1ca
[    3.146437]  [<ffffffff8130e541>] ? do_page_fault+0x2b/0x2fc
[    3.146441]  [<ffffffff8130c695>] ? page_fault+0x25/0x30
[    3.146447]  [<ffffffff810badce>] ? __alloc_pages_nodemask+0x8f/0x5f5
[    3.146452]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
[    3.146457]  [<ffffffff8100ec72>] ? check_events+0x12/0x20
[    3.146462]  [<ffffffff810e759d>] ? new_slab+0x42/0x1ca
[    3.146466]  [<ffffffff810e7915>] ? __slab_alloc+0x1f0/0x39b
[    3.146471]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    3.146476]  [<ffffffff810e85cb>] ? __kmalloc_node+0xe8/0x146
[    3.146480]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    3.146485]  [<ffffffff812f87d8>] ? irq_to_desc_alloc_node+0x96/0x195
[    3.146490]  [<ffffffff811f24df>] ? find_unbound_irq+0x67/0xae
[    3.146495]  [<ffffffff811f259e>] ? bind_virq_to_irq+0x78/0x126
[    3.146500]  [<ffffffff8100e5b5>] ? xen_force_evtchn_callback+0x9/0xa
[    3.146505]  [<ffffffff8100e8f6>] ? xen_timer_interrupt+0x0/0x18d
[    3.146509]  [<ffffffff811f29f6>] ? bind_virq_to_irqhandler+0x19/0x4a
[    3.146515]  [<ffffffff8100e884>] ? xen_setup_timer+0x55/0xaa
[    3.146519]  [<ffffffff81509a5e>] ? xen_time_init+0xaf/0xb5
[    3.146524]  [<ffffffff8150a491>] ? x86_late_time_init+0xa/0x10
[    3.146529]  [<ffffffff81506c3d>] ? start_kernel+0x348/0x3e8
[    3.146533]  [<ffffffff81508c7d>] ? xen_start_kernel+0x57c/0x581
(XEN) Domain 0 crashed: rebooting machine in 5 seconds.

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Bug#603632: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-11-25 14:44     ` Ian Campbell
@ 2010-11-25 16:38       ` Vincent Caron
  0 siblings, 0 replies; 23+ messages in thread
From: Vincent Caron @ 2010-11-25 16:38 UTC (permalink / raw)
  To: Ian Campbell
  Cc: Vincent CARON, 603632, Cris Daniluk, xen-devel,
	Jeremy Fitzhardinge, Keir Fraser

[-- Attachment #1: Type: text/plain, Size: 943 bytes --]

On Thu, 2010-11-25 at 14:44 +0000, Ian Campbell wrote:
>
> >   OK, should I pick the one in
> > http://xenbits.xen.org/people/ianc/squeeze/ ? (I'm running Debian
> > Squeeze on this machine)
> 
> Yes but that's a bit of a long shot (those packages only put back some
> GPU related fixes.
> 
> It would be more useful to test the packages at
> http://xenbits.xen.org/people/ianc/2.6.32-27+numa1/ 
> first.

  Sorry, you answered that already a few days ago. I had your
@hellion.org.uk email whitelisted, but not your @citrix.com (fixed !).

  I booted this 2.6.32-27+numa1 on my Dell R410 and had a different
crash. At least it crashed later, right after the kernel message
'xen_balloon: Initialising balloon driver with page order 0'. Actually
Linux just hangs with no information, it does not even answers to
sysreqs.

  Since the hypervisor was still up, I switched to its console and asked
for all diagnostics with '*'. Full log enclosed.


[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: bootlog_xen_2.6.32-27+numa1.txt --]
[-- Type: text/plain; name="bootlog_xen_2.6.32-27+numa1.txt"; charset="UTF-8", Size: 92563 bytes --]

(XEN) Xen version 4.0.1 (Debian 4.0.1-1) (waldi@debian.org) (gcc version 4.4.5 20100824 (prerelease) (Debian 4.4.4-11) ) Fri Sep  3 15:38:12 UTC 2010
(XEN) Bootloader: GNU GRUB 0.97
(XEN) Command line: com2=57600,8n1,0x2f8,3 console=com2 dom0_mem=1024M
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: none; EDID transfer time: 0 seconds
(XEN)  EDID info not retrieved because no DDC retrieval method detected
(XEN) Disc information:
(XEN)  Found 1 MBR signatures
(XEN)  Found 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 00000000000a0000 (usable)
(XEN)  0000000000100000 - 00000000cf679000 (usable)
(XEN)  00000000cf679000 - 00000000cf68f000 (reserved)
(XEN)  00000000cf68f000 - 00000000cf6ce000 (ACPI data)
(XEN)  00000000cf6ce000 - 00000000d0000000 (reserved)
(XEN)  00000000e0000000 - 00000000f0000000 (reserved)
(XEN)  00000000fe000000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000000230000000 (usable)
(XEN) ACPI: RSDP 000F09E0, 0024 (r2 DELL  )
(XEN) ACPI: XSDT 000F0AE4, 009C (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: FACP CF6B3F9C, 00F4 (r3 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: DSDT CF68F000, 3B39 (r1 DELL   PE_SC3          1 INTL 20050624)
(XEN) ACPI: FACS CF6B6000, 0040
(XEN) ACPI: APIC CF6B3478, 015E (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SPCR CF6B35D8, 0050 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: HPET CF6B362C, 0038 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: DMAR CF6B3668, 01B0 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: MCFG CF6B38C4, 003C (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: WD__ CF6B3904, 0134 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SLIC CF6B3A3C, 0024 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: ERST CF692CBC, 0270 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: HEST CF692F2C, 03A8 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: BERT CF692B3C, 0030 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: EINJ CF692B6C, 0150 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SRAT CF6B3BC0, 0370 (r1 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: TCPA CF6B3F34, 0064 (r2 DELL   PE_SC3          1 DELL        1)
(XEN) ACPI: SSDT CF6B7000, 2104 (r1  INTEL PPM RCM  80000001 INTL 20061109)
(XEN) System RAM: 8182MB (8378468kB)
(XEN) Reserving non-aligned node boundary @ mfn 0x130000
(XEN) Domain heap initialised DMA width 30 bits
(XEN) Processor #16 7:10 APIC version 21
(XEN) Processor #0 7:10 APIC version 21
(XEN) Processor #18 7:10 APIC version 21
(XEN) Processor #2 7:10 APIC version 21
(XEN) Processor #20 7:10 APIC version 21
(XEN) Processor #4 7:10 APIC version 21
(XEN) Processor #22 7:10 APIC version 21
(XEN) Processor #6 7:10 APIC version 21
(XEN) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
(XEN) IOAPIC[1]: apic_id 1, version 32, address 0xfec80000, GSI 32-55
(XEN) Enabling APIC mode:  Flat.  Using 2 I/O APICs
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2261.050 MHz processor.
(XEN) Initing memory sharing.
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Extended Page Tables (EPT)
(XEN)  - Virtual-Processor Identifiers (VPID)
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN) EPT supports 2MB super page.
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging detected.
(XEN) Intel VT-d Snoop Control supported.
(XEN) Intel VT-d DMA Passthrough not supported.
(XEN) Intel VT-d Queued Invalidation supported.
(XEN) Intel VT-d Interrupt Remapping not supported.
(XEN) I/O virtualisation enabled
(XEN)  - Dom0 mode: Relaxed
(XEN) Total of 8 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) TSC is reliable, synchronization unnecessary
(XEN) Platform timer is 14.318MHz HPET
ÿ(XEN) Allocated console ring of 16 KiB.
(XEN) Brought up 8 CPUs
(XEN) *** LOADING DOMAIN 0 ***
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x16b1000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000224000000->0000000228000000 (245760 pages to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff81000000->ffffffff816b1000
(XEN)  Init. ramdisk: ffffffff816b1000->ffffffff83238a00
(XEN)  Phys-Mach map: ffffffff83239000->ffffffff83439000
(XEN)  Start info:    ffffffff83439000->ffffffff834394b4
(XEN)  Page tables:   ffffffff8343a000->ffffffff83459000
(XEN)  Boot stack:    ffffffff83459000->ffffffff8345a000
(XEN)  TOTAL:         ffffffff80000000->ffffffff83800000
(XEN)  ENTRY ADDRESS: ffffffff81502200
(XEN) Dom0 has maximum 8 VCPUs
(XEN) Scrubbing Free RAM: ....................................................................done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: Errors and warnings
(XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 176kB init memory.
mapping kernel into physical memory
Xen: setup ISA identity maps
about to get started...
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 2.6.32-5-xen-amd64 (Debian 2.6.32-27+numa1) (Ian.Campbell@citrix.com) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 SMP Tue Nov 23 20:46:34 UTC 2010
[    0.000000] Command line: root=/dev/sda1 console=hvc0 nomodeset
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] released 0 pages of unused memory
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  Xen: 0000000000000000 - 00000000000a0000 (usable)
[    0.000000]  Xen: 00000000000a0000 - 0000000000100000 (reserved)
[    0.000000]  Xen: 0000000000100000 - 0000000040000000 (usable)
[    0.000000]  Xen: 00000000cf679000 - 00000000cf68f000 (reserved)
[    0.000000]  Xen: 00000000cf68f000 - 00000000cf6ce000 (ACPI data)
[    0.000000]  Xen: 00000000cf6ce000 - 00000000d0000000 (reserved)
[    0.000000]  Xen: 00000000e0000000 - 00000000f0000000 (reserved)
[    0.000000]  Xen: 00000000fe000000 - 0000000100000000 (reserved)
[    0.000000] DMI 2.6 present.
[    0.000000] last_pfn = 0x40000 max_arch_pfn = 0x400000000
[    0.000000] x86 PAT enabled: cpu 0, old 0x50100070406, new 0x7010600070106
[    0.000000] init_memory_mapping: 0000000000000000-0000000040000000
[    0.000000] RAMDISK: 016b1000 - 03238a00
[    0.000000] ACPI: RSDP 00000000000f09e0 00024 (v02 DELL  )
[    0.000000] ACPI: XSDT 00000000000f0ae4 0009C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: FACP 00000000cf6b3f9c 000F4 (v03 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: DSDT 00000000cf68f000 03B39 (v01 DELL   PE_SC3   00000001 INTL 20050624)
[    0.000000] ACPI: FACS 00000000cf6b6000 00040
[    0.000000] ACPI: APIC 00000000cf6b3478 0015E (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SPCR 00000000cf6b35d8 00050 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: HPET 00000000cf6b362c 00038 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: XMAR 00000000cf6b3668 001B0 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: MCFG 00000000cf6b38c4 0003C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: WD__ 00000000cf6b3904 00134 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SLIC 00000000cf6b3a3c 00024 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: ERST 00000000cf692cbc 00270 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: HEST 00000000cf692f2c 003A8 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: BERT 00000000cf692b3c 00030 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: EINJ 00000000cf692b6c 00150 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SRAT 00000000cf6b3bc0 00370 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: TCPA 00000000cf6b3f34 00064 (v02 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SSDT 00000000cf6b7000 02104 (v01  INTEL PPM RCM  80000001 INTL 20061109)
[    0.000000] SRAT: PXM 1 -> APIC 16 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 0 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 18 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 2 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 20 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 4 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 22 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 6 -> Node 1
[    0.000000] SRAT: Node 1 PXM 2 0-d0000000
[    0.000000] SRAT: Node 1 PXM 2 100000000-130000000
[    0.000000] SRAT: Node 0 PXM 1 130000000-230000000
[    0.000000] Bootmem setup node 1 0000000000000000-0000000040000000
[    0.000000]   NODE_DATA [0000000000008000 - 000000000000ffff]
[    0.000000]   bootmap [0000000000010000 -  0000000000017fff] pages 8
[    0.000000] (8 early reservations) ==> bootmem [0000000000 - 0040000000]
[    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
[    0.000000]   #1 [000343a000 - 0003459000]   XEN PAGETABLES ==> [000343a000 - 0003459000]
[    0.000000]   #2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
[    0.000000]   #3 [0001000000 - 0001690994]    TEXT DATA BSS ==> [0001000000 - 0001690994]
[    0.000000]   #4 [00016b1000 - 0003238a00]          RAMDISK ==> [00016b1000 - 0003238a00]
[    0.000000]   #5 [0003239000 - 000343a000]   XEN START INFO ==> [0003239000 - 000343a000]
[    0.000000]   #6 [0001691000 - 000169132d]              BRK ==> [0001691000 - 000169132d]
[    0.000000]   #7 [0000100000 - 00002e0000]          PGTABLE ==> [0000100000 - 00002e0000]
[    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000000 -> 0x00001000
[    0.000000]   DMA32    0x00001000 -> 0x00100000
[    0.000000]   Normal   0x00100000 -> 0x00100000
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[2] active PFN ranges
[    0.000000]     1: 0x00000000 -> 0x000000a0
[    0.000000]     1: 0x00000100 -> 0x00040000
[    0.000000] ACPI: PM-Timer IO Port: 0x808
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x28] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x29] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x2a] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x2b] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2c] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2d] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x2f] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 0, address 0xfec00000, GSI 0-0
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32])
[    0.000000] IOAPIC[1]: apic_id 1, version 0, address 0xfec80000, GSI 32-32
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ERROR: Unable to locate IOAPIC for GSI 2
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ERROR: Unable to locate IOAPIC for GSI 9
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[    0.000000] SMP: Allowing 8 CPUs, 0 hotplug CPUs
[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
[    0.000000] Allocating PCI resources starting at 40000000 (gap: 40000000:8f679000)
[    0.000000] Booting paravirtualized kernel on Xen
[    0.000000] Xen version: 4.0.1 (preserve-AD) (dom0)
[    0.000000] NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:8 nr_node_ids:2
[    0.000000] PERCPU: Embedded 30 pages/cpu @ffff88000348f000 s90328 r8192 d24360 u122880
[    0.000000] pcpu-alloc: s90328 r8192 d24360 u122880 alloc=30*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 [0] 4 [0] 5 [0] 6 [0] 7 
[    2.791662] Xen: using vcpu_info placement
[    2.791667] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 257981
[    2.791669] Policy zone: DMA32
[    2.791672] Kernel command line: root=/dev/sda1 console=hvc0 nomodeset
[    2.791694] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    2.791995] Initializing CPU#0
[    2.800454] DMA: Placing 64MB software IO TLB between ffff880004663000 - ffff880008663000
[    2.800458] DMA: software IO TLB at phys 0x4663000 - 0x8663000
[    2.800460] xen_swiotlb_fixup: buf=ffff880004663000 size=67108864
[    2.819716] xen_swiotlb_fixup: buf=ffff8800086c3000 size=32768
[    2.824084] Memory: 927572k/1048576k available (3145k kernel code, 384k absent, 120620k reserved, 1886k data, 596k init)
[    2.824125] SLUB: Genslabs=14, HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=2
[    2.824159] Hierarchical RCU implementation.
[    2.824168] NR_IRQS:4352 nr_irqs:2304
[    2.824363] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    2.824365] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    2.824368] xen: sci override: source_irq=9 global_irq=9 trigger=c polarity=1
[    2.824372] xen_allocate_pirq: returning irq 9 for gsi 9
[    2.824381] xen: acpi sci 9
[    2.830380] Console: colour VGA+ 80x25
[    2.830654] console [hvc0] enabled
[    2.830685] installing Xen timer for CPU 0
[    2.830716] Detected 2261.050 MHz processor.
[    2.830725] Calibrating delay loop (skipped), value calculated using timer frequency.. 4522.10 BogoMIPS (lpj=9044200)
[    2.830742] Security Framework initialized
[    2.830748] SELinux:  Disabled at boot.
[    2.830945] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    2.831305] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    2.831450] Mount-cache hash table entries: 256
[    2.831579] Initializing cgroup subsys ns
[    2.831584] Initializing cgroup subsys cpuacct
[    2.831589] Initializing cgroup subsys devices
[    2.831593] Initializing cgroup subsys freezer
[    2.831596] Initializing cgroup subsys net_cls
[    2.831631] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.831635] CPU: L2 cache: 256K
[    2.831637] CPU: L3 cache: 8192K
[    2.831642] CPU 0/0x0 -> Node 1
[    2.831646] CPU: Unsupported number of siblings 16
[    2.831651] mce: CPU supports 9 MCE banks
[    2.831675] Performance Events: unsupported p6 CPU model 26 no PMU driver, software events only.
[    2.831691] SMP alternatives: switching to UP code
[    2.855779] ACPI: Core revision 20090903
[    2.861874] installing Xen timer for CPU 1
[    2.861906] SMP alternatives: switching to SMP code
[    2.884981] Initializing CPU#1
[    2.885045] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.885048] CPU: L2 cache: 256K
[    2.885050] CPU: L3 cache: 8192K
[    2.885055] CPU 1/0x0 -> Node 1
[    2.885058] CPU: Unsupported number of siblings 16
[    2.885184] installing Xen timer for CPU 2
[    2.885252] Initializing CPU#2
[    2.885288] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.885290] CPU: L2 cache: 256K
[    2.885291] CPU: L3 cache: 8192K
[    2.885294] CPU 2/0x0 -> Node 1
[    2.885296] CPU: Unsupported number of siblings 16
[    2.885398] installing Xen timer for CPU 3
[    2.885465] Initializing CPU#3
[    2.885514] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.885517] CPU: L2 cache: 256K
[    2.885519] CPU: L3 cache: 8192K
[    2.885524] CPU 3/0x0 -> Node 1
[    2.885527] CPU: Unsupported number of siblings 16
[    2.885631] installing Xen timer for CPU 4
[    2.885695] Initializing CPU#4
[    2.885729] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.885731] CPU: L2 cache: 256K
[    2.885733] CPU: L3 cache: 8192K
[    2.885736] CPU 4/0x0 -> Node 1
[    2.885738] CPU: Unsupported number of siblings 16
[    2.885835] installing Xen timer for CPU 5
[    2.885902] Initializing CPU#5
[    2.885951] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.885954] CPU: L2 cache: 256K
[    2.885956] CPU: L3 cache: 8192K
[    2.885961] CPU 5/0x0 -> Node 1
[    2.885964] CPU: Unsupported number of siblings 16
[    2.886067] installing Xen timer for CPU 6
[    2.886137] Initializing CPU#6
[    2.886171] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.886173] CPU: L2 cache: 256K
[    2.886174] CPU: L3 cache: 8192K
[    2.886177] CPU 6/0x0 -> Node 1
[    2.886179] CPU: Unsupported number of siblings 16
[    2.886278] installing Xen timer for CPU 7
[    2.886350] Initializing CPU#7
[    2.886399] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.886402] CPU: L2 cache: 256K
[    2.886404] CPU: L3 cache: 8192K
[    2.886409] CPU 7/0x0 -> Node 1
[    2.886412] CPU: Unsupported number of siblings 16
[    2.886463] Brought up 8 CPUs
[    2.887292] devtmpfs: initialized
[    2.890473] Grant table initialized
[    2.890477] regulator: core version 0.5
[    2.890527] NET: Registered protocol family 16
[    2.890720] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    2.890726] ACPI: bus type pci registered
[    2.890801] PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
[    2.890806] PCI: MCFG area at e0000000 reserved in E820
[    2.929985] PCI: Using MMCONFIG at e0000000 - efffffff
[    2.929989] PCI: Using configuration type 1 for base access
[    2.930763] bio: create slab <bio-0> at 0
[    2.931635] ERROR: Unable to locate IOAPIC for GSI 9
[    2.935072] ACPI: BIOS _OSI(Linux) query ignored
[    2.935262] ACPI: Interpreter enabled
[    2.935266] ACPI: (supports S0 S4 S5)
[    2.935288] ACPI: Using IOAPIC for interrupt routing
[    2.940876] ACPI: No dock devices found.
[    2.941433] ACPI: PCI Root Bridge [PCI0] (0000:00)
[    2.941572] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    2.941579] pci 0000:00:00.0: PME# disabled
[    2.941715] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    2.941723] pci 0000:00:01.0: PME# disabled
[    2.941858] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    2.941865] pci 0000:00:03.0: PME# disabled
[    2.942005] pci 0000:00:07.0: PME# supported from D0 D3hot D3cold
[    2.942012] pci 0000:00:07.0: PME# disabled
[    2.942795] pci 0000:00:1a.7: PME# supported from D0 D3hot D3cold
[    2.942803] pci 0000:00:1a.7: PME# disabled
[    2.943492] pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
[    2.943500] pci 0000:00:1d.7: PME# disabled
[    2.943714] pci 0000:00:1f.0: quirk: region 0800-087f claimed by ICH6 ACPI/GPIO/TCO
[    2.943721] pci 0000:00:1f.0: quirk: region 0880-08bf claimed by ICH6 GPIO
[    2.943727] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 1 PIO at 0c00 (mask 007f)
[    2.943734] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 2 PIO at 0ca0 (mask 000f)
[    2.943740] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 3 PIO at 00e0 (mask 000f)
[    2.944269] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    2.944277] pci 0000:01:00.0: PME# disabled
[    2.944462] pci 0000:01:00.1: PME# supported from D0 D3hot D3cold
[    2.944470] pci 0000:01:00.1: PME# disabled
[    2.944846] pci 0000:03:00.0: disabling ASPM on pre-1.1 PCIe device.  You can enable it with 'pcie_aspm=force'
[    2.945133] pci 0000:00:1e.0: transparent bridge
[    2.950465] ACPI: PCI Interrupt Link [LK00] (IRQs 3 4 5 6 7 10 11 14 *15)
[    2.950611] ACPI: PCI Interrupt Link [LK01] (IRQs 3 4 5 6 7 10 11 *14 15)
[    2.950760] ACPI: PCI Interrupt Link [LK02] (IRQs 3 4 5 6 7 10 *11 14 15)
[    2.950904] ACPI: PCI Interrupt Link [LK03] (IRQs 3 4 5 6 7 *10 11 14 15)
[    2.951047] ACPI: PCI Interrupt Link [LK04] (IRQs 3 4 *5 6 7 10 11 14 15)
[    2.951190] ACPI: PCI Interrupt Link [LK05] (IRQs 3 4 5 *6 7 10 11 14 15)
[    2.951333] ACPI: PCI Interrupt Link [LK06] (IRQs 3 4 5 6 7 10 *11 14 15)
[    2.951476] ACPI: PCI Interrupt Link [LK07] (IRQs 3 4 5 6 7 10 11 *14 15)
[    2.951667] xen_balloon: Initialising balloon driver with page order 0.
[    2.951730](XEN) *** Serial input -> Xen (type 'CTRL-a' three times to switch input to DOM0)
(XEN) 'h' pressed -> showing installed handlers
(XEN)  key '%' (ascii '25') => trap to xendbg
(XEN)  key '*' (ascii '2a') => print all diagnostics
(XEN)  key '0' (ascii '30') => dump Dom0 registers
(XEN)  key 'C' (ascii '43') => trigger a crashdump
(XEN)  key 'H' (ascii '48') => dump heap info
(XEN)  key 'M' (ascii '4d') => dump MSI state
(XEN)  key 'N' (ascii '4e') => trigger an NMI
(XEN)  key 'Q' (ascii '51') => dump PCI devices
(XEN)  key 'R' (ascii '52') => reboot machine
(XEN)  key 'V' (ascii '56') => dump iommu info
(XEN)  key 'a' (ascii '61') => dump timer queues
(XEN)  key 'c' (ascii '63') => dump ACPI Cx structures
(XEN)  key 'd' (ascii '64') => dump registers
(XEN)  key 'e' (ascii '65') => dump evtchn info
(XEN)  key 'g' (ascii '67') => print grant table usage
(XEN)  key 'h' (ascii '68') => show this message
(XEN)  key 'i' (ascii '69') => dump interrupt bindings
(XEN)  key 'm' (ascii '6d') => memory info
(XEN)  key 'n' (ascii '6e') => NMI statistics
(XEN)  key 'q' (ascii '71') => dump domain (and guest debug) info
(XEN)  key 'r' (ascii '72') => dump run queues
(XEN)  key 's' (ascii '73') => dump softtsc stats
(XEN)  key 't' (ascii '74') => display multi-cpu clock info
(XEN)  key 'u' (ascii '75') => dump numa info
(XEN)  key 'v' (ascii '76') => dump Intel's VMCS
(XEN)  key 'z' (ascii '7a') => print ioapic info
(XEN) '*' pressed -> firing all diagnostic keyhandlers
(XEN) [d: dump registers]
(XEN) 'd' pressed -> dumping registers
(XEN) 
(XEN) *** Dumping CPU4 host state: ***
(XEN) ----[ Xen-4.0.1  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    4
(XEN) RIP:    e008:[<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010246   CONTEXT: hypervisor
(XEN) rax: 0000000000000000   rbx: 0000000000000080   rcx: 0000000000000000
(XEN) rdx: 0000000000000000   rsi: 000000000000000a   rdi: 0000000000000000
(XEN) rbp: ffff83022fd0ff28   rsp: ffff83022fd0fcd8   r8:  0000000000004000
(XEN) r9:  0000000000003fff   r10: ffff83022fcd4000   r11: 0000000000000400
(XEN) r12: ffff82c480375408   r13: ffff83022fd0fe58   r14: ffff82c480133ab0
(XEN) r15: ffff82c480380310   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 0000000225001000   cr2: 0000000000000000
(XEN) ds: 002b   es: 002b   fs: 0000   gs: 0000   ss: e010   cs: e008
(XEN) Xen stack trace from rsp=ffff83022fd0fcd8:
(XEN)    0000000000000080 ffff82c4801111f2 ffff82c4802275c0 0000000000000065
(XEN)    ffff82c480375408 ffff82c480110828 000000000000003a ffff82c4802276a0
(XEN)    000000000000002a ffff83022fd0fe58 ffff83022fd0fe58 ffff82c4801108e0
(XEN)    ffff82c480224c60 ffff82c480224cd8 0000000000000292 ffff82c480134f76
(XEN)    ffff83022fd0ff28 2a00000000000292 ffff82c4803802e8 ffff82c480224c60
(XEN)    ffff83022fd0fe58 0000000000000001 ffff83022fd0fe58 ffff82c48013453e
(XEN)    0000000000000003 ffff82c48025c9c0 0000000000000003 ffff82c48037a980
(XEN)    ffff83022fd80200 ffff82c480158522 0000000000000000 ffff830200000000
(XEN)    ffff83022fd0ff28 ffff83022fd0fe08 0000000000000000 ffff83022fd0ff28
(XEN)    ffff83022fd80234 ffff82c48025c100 0000000000000282 0000000000000282
(XEN)    ffff82c480264100 ffff83022fd0ff28 ffff82c48025cb00 ffff83022fd0ff28
(XEN)    ffff83022fd0fe18 ffff8300cf55e000 0000000000000003 ffff82c480151400
(XEN)    0000000000000003 ffff8300cf55e000 ffff83022fd0fe18 ffff83022fd0ff28
(XEN)    ffff82c48025cb00 ffff83022fd0ff28 0000000000000001 ffff83022fd3a9a8
(XEN)    ffff83022fd3af70 0000000000000001 00000000ffffffff ffff82c48037a980
(XEN)    0000000000000200 0000000000000001 0000000000008000 000000f200000000
(XEN)    ffff82c48014a9d2 000000000000e008 0000000000000286 ffff83022fd0ff08
(XEN)    000000000000e010 0000000000000003 ffff82c48014e0ce ffff8300cf55e000
(XEN)    ffff8300cc882000 00000000ffffffff 0000000000000000 0000000000000000
(XEN)    00000000ffffffff 0000000000000004 ffff88003fc38840 0000000000000004
(XEN) Xen call trace:
(XEN)    [<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c4801111f2>] dump_registers+0x52/0x110
(XEN)    [<ffff82c480110828>] run_all_keyhandlers+0x78/0xa0
(XEN)    [<ffff82c4801108e0>] handle_keypress+0x90/0xe0
(XEN)    [<ffff82c480134f76>] serial_rx_interrupt+0x66/0xe0
(XEN)    [<ffff82c48013453e>] ns16550_interrupt+0x6e/0xd0
(XEN)    [<ffff82c480158522>] do_IRQ+0x562/0x6b0
(XEN)    [<ffff82c480151400>] common_interrupt+0x20/0x30
(XEN)    [<ffff82c48014a9d2>] default_idle+0x42/0x50
(XEN)    [<ffff82c48014e0ce>] idle_loop+0x2e/0x90
(XEN)    
(XEN) *** Dumping CPU4 guest state: ***
(XEN) No guest context (CPU is idle).
(XEN) 
(XEN) *** Dumping CPU0 host state: ***
(XEN) ----[ Xen-4.0.1  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    0
(XEN) RIP:    e008:[<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
(XEN) rax: ffff82c480111140   rbx: ffff82c48037a980   rcx: 0000000000000001
(XEN) rdx: 0000000000000000   rsi: 0000000000000001   rdi: 0000000000000000
(XEN) rbp: 0000000000000000   rsp: ffff82c480367e18   r8:  0000005b48f11c4a
(XEN) r9:  0000000000000004   r10: ffff82c480397120   r11: 0000000000000001
(XEN) r12: ffff82c480367f28   r13: ffff82c480367e18   r14: ffff8300cf670000
(XEN) r15: 0000000000000003   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 0000000225001000   cr2: ffff8800015b1bd0
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: e010   cs: e008
(XEN) Xen stack trace from rsp=ffff82c480367e18:
(XEN)    ffff82c48037a980 ffff82c48016bbb2 ffff82c48025c9c0 ffff82c48016c2cf
(XEN)    0000000000000000 ffff82c480367f28 ffff82c48025cb00 ffff82c4801460ba
(XEN)    0000000000000003 ffff8300cf670000 ffff82c480367e18 ffff82c480367f28
(XEN)    ffff82c48025cb00 ffff82c480367f28 0000000000000001 ffff82c480397120
(XEN)    0000000000000004 0000005b48f11c4a 00000000ffffffff ffff82c48037a980
(XEN)    0000000000000000 0000000000000001 0000000000000000 000000fb00000000
(XEN)    ffff82c48014a9d2 000000000000e008 0000000000000286 ffff82c480367f08
(XEN)    000000000000e010 0000000000000003 ffff82c48014e0ce ffff8300cf670000
(XEN)    ffff8300cf2f2000 00000000ffffffff 0000000000000000 0000000000000000
(XEN)    00000000ffffffff 0000000000000000 ffff88003fc380c0 0000000000000000
(XEN)    0000000000000246 ffff88003fe02000 ffff88000349f1b0 0000000000000000
(XEN)    0000000000000000 ffffffff8100930a 0000000000000000 0000000000000000
(XEN)    0000000000000002 0000010000000000 ffffffff8100930a 000000000000e033
(XEN)    0000000000000246 ffff880003492e60 000000000000e02b 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    ffff8300cf670000
(XEN) Xen call trace:
(XEN)    [<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c48016bbb2>] __smp_call_function_interrupt+0x82/0x90
(XEN)    [<ffff82c48016c2cf>] smp_call_function_interrupt+0x4f/0x90
(XEN)    [<ffff82c4801460ba>] call_function_interrupt+0x2a/0x30
(XEN)    [<ffff82c48014a9d2>] default_idle+0x42/0x50
(XEN)    [<ffff82c48014e0ce>] idle_loop+0x2e/0x90
(XEN)    
(XEN) *** Dumping CPU0 guest state: ***
(XEN) No guest context (CPU is idle).
(XEN) 
(XEN) *** Dumping CPU1 host state: ***
(XEN) ----[ Xen-4.0.1  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    1
(XEN) RIP:    e008:[<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
(XEN) rax: ffff82c480111140   rbx: ffff82c48037a980   rcx: 0000000000000001
(XEN) rdx: 0000000000000080   rsi: 0000000000000000   rdi: 0000000000000000
(XEN) rbp: 0000000000000000   rsp: ffff83022fd2fe18   r8:  0000000000000001
(XEN) r9:  ffff83022fcdf710   r10: ffff83022fd3a768   r11: 0000000000000001
(XEN) r12: ffff83022fd2ff28   r13: ffff83022fd2fe18   r14: ffff8300cf2fc000
(XEN) r15: 0000000000000003   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 0000000225001000   cr2: 0000000000000000
(XEN) ds: 002b   es: 002b   fs: 0000   gs: 0000   ss: e010   cs: e008
(XEN) Xen stack trace from rsp=ffff83022fd2fe18:
(XEN)    ffff82c48037a980 ffff82c48016bbb2 ffff82c48025c9c0 ffff82c48016c2cf
(XEN)    0000000000000001 ffff83022fd2ff28 ffff82c48025cb00 ffff82c4801460ba
(XEN)    0000000000000003 ffff8300cf2fc000 ffff83022fd2fe18 ffff83022fd2ff28
(XEN)    ffff82c48025cb00 ffff83022fd2ff28 0000000000000001 ffff83022fd3a768
(XEN)    ffff83022fcdf710 0000000000000001 00000000ffffffff ffff82c48037a980
(XEN)    0000000000000080 0000000000000000 0000000000002000 000000fb00000000
(XEN)    ffff82c48014a9d2 000000000000e008 0000000000000286 ffff83022fd2ff08
(XEN)    000000000000e010 0000000000000003 ffff82c48014e0ce ffff8300cf2fc000
(XEN)    ffff8300cc886000 00000000ffffffff 0000000000000000 0000000000000000
(XEN)    00000000ffffffff 0000000000000002 ffff88003fc38480 0000000000000002
(XEN)    0000000000000246 0000000000000000 ffff8800034db1b0 0000000000000000
(XEN)    0000000000000000 ffffffff8100930a 0000000000000000 0000000000000002
(XEN)    0000000000000002 0000010000000000 ffffffff8100930a 000000000000e033
(XEN)    0000000000000246 ffff8800034cee60 000000000000e02b 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000001
(XEN)    ffff8300cf2fc000
(XEN) Xen call trace:
(XEN)    [<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c48016bbb2>] __smp_call_function_interrupt+0x82/0x90
(XEN)    [<ffff82c48016c2cf>] smp_call_function_interrupt+0x4f/0x90
(XEN)    [<ffff82c4801460ba>] call_function_interrupt+0x2a/0x30
(XEN)    [<ffff82c48014a9d2>] default_idle+0x42/0x50
(XEN)    [<ffff82c48014e0ce>] idle_loop+0x2e/0x90
(XEN)    
(XEN) *** Dumping CPU1 guest state: ***
(XEN) No guest context (CPU is idle).
(XEN) 
(XEN) *** Dumping CPU2 host state: ***
(XEN) ----[ Xen-4.0.1  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    2
(XEN) RIP:    e008:[<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
(XEN) rax: ffff82c480111140   rbx: ffff82c48037a980   rcx: 0000000000000001
(XEN) rdx: 0000000000000100   rsi: 0000000000000001   rdi: 0000000000000000
(XEN) rbp: 0000000000000000   rsp: ffff83022fd27e18   r8:  0000000000000001
(XEN) r9:  ffff83022fd3ae50   r10: ffff83022fd3a828   r11: 0000000000000001
(XEN) r12: ffff83022fd27f28   r13: ffff83022fd27e18   r14: ffff8300cf2fa000
(XEN) r15: 0000000000000003   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 0000000225001000   cr2: 0000000000000000
(XEN) ds: 002b   es: 002b   fs: 0000   gs: 0000   ss: e010   cs: e008
(XEN) Xen stack trace from rsp=ffff83022fd27e18:
(XEN)    ffff82c48037a980 ffff82c48016bbb2 ffff82c48025c9c0 ffff82c48016c2cf
(XEN)    0000000000000002 ffff83022fd27f28 ffff82c48025cb00 ffff82c4801460ba
(XEN)    0000000000000003 ffff8300cf2fa000 ffff83022fd27e18 ffff83022fd27f28
(XEN)    ffff82c48025cb00 ffff83022fd27f28 0000000000000001 ffff83022fd3a828
(XEN)    ffff83022fd3ae50 0000000000000001 00000000ffffffff ffff82c48037a980
(XEN)    0000000000000100 0000000000000001 0000000000004000 000000fb00000000
(XEN)    ffff82c48014a9d2 000000000000e008 0000000000000286 ffff83022fd27f08
(XEN)    000000000000e010 0000000000000003 ffff82c48014e0ce ffff8300cf2fa000
(XEN)    ffff8300cf66e000 00000000ffffffff 0000000000000000 0000000000000000
(XEN)    00000000ffffffff 0000000000000006 ffff88003fc38c00 0000000000000006
(XEN)    0000000000000246 0000000000000000 ffff8800035531b0 0000000000000000
(XEN)    0000000000000000 ffffffff8100930a 0000000000000000 0000000000000006
(XEN)    0000000000000002 0000010000000000 ffffffff8100930a 000000000000e033
(XEN)    0000000000000246 ffff880003546e60 000000000000e02b 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000002
(XEN)    ffff8300cf2fa000
(XEN) Xen call trace:
(XEN)    [<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c48016bbb2>] __smp_call_function_interrupt+0x82/0x90
(XEN)    [<ffff82c48016c2cf>] smp_call_function_interrupt+0x4f/0x90
(XEN)    [<ffff82c4801460ba>] call_function_interrupt+0x2a/0x30
(XEN)    [<ffff82c48014a9d2>] default_idle+0x42/0x50
(XEN)    [<ffff82c48014e0ce>] idle_loop+0x2e/0x90
(XEN)    
(XEN) *** Dumping CPU2 guest state: ***
(XEN) No guest context (CPU is idle).
(XEN) 
(XEN) *** Dumping CPU3 host state: ***
(XEN) ----[ Xen-4.0.1  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    3
(XEN) RIP:    e008:[<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
(XEN) rax: ffff82c480111140   rbx: ffff82c48037a980   rcx: 0000000000000001
(XEN) rdx: 0000000000000180   rsi: 0000000000000001   rdi: 0000000000000000
(XEN) rbp: 0000000000000000   rsp: ffff83022fd17e18   r8:  0000000000000001
(XEN) r9:  ffff83022fcdf560   r10: ffff83022fd3a8e8   r11: 0000000000000001
(XEN) r12: ffff83022fd17f28   r13: ffff83022fd17e18   r14: ffff8300cf2f8000
(XEN) r15: 0000000000000003   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 0000000225001000   cr2: 0000000000000000
(XEN) ds: 002b   es: 002b   fs: 0000   gs: 0000   ss: e010   cs: e008
(XEN) Xen stack trace from rsp=ffff83022fd17e18:
(XEN)    ffff82c48037a980 ffff82c48016bbb2 ffff82c48025c9c0 ffff82c48016c2cf
(XEN)    0000000000000003 ffff83022fd17f28 ffff82c48025cb00 ffff82c4801460ba
(XEN)    0000000000000003 ffff8300cf2f8000 ffff83022fd17e18 ffff83022fd17f28
(XEN)    ffff82c48025cb00 ffff83022fd17f28 0000000000000001 ffff83022fd3a8e8
(XEN)    ffff83022fcdf560 0000000000000001 00000000ffffffff ffff82c48037a980
(XEN)    0000000000000180 0000000000000001 0000000000006000 000000fb00000000
(XEN)    ffff82c48014a9d2 000000000000e008 0000000000000286 ffff83022fd17f08
(XEN)    000000000000e010 0000000000000003 ffff82c48014e0ce ffff8300cf2f8000
(XEN)    ffff8300cc884000 00000000ffffffff 0000000000000000 0000000000000000
(XEN)    00000000ffffffff 0000000000000003 ffff88003fc38660 0000000000000003
(XEN)    0000000000000246 0000000000000000 ffff8800034f91b0 0000000000000000
(XEN)    0000000000000000 ffffffff8100930a 0000000000000000 0000000000000003
(XEN)    0000000000000002 0000010000000000 ffffffff8100930a 000000000000e033
(XEN)    0000000000000246 ffff8800034ece60 000000000000e02b 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000003
(XEN)    ffff8300cf2f8000
(XEN) Xen call trace:
(XEN)    [<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c48016bbb2>] __smp_call_function_interrupt+0x82/0x90
(XEN)    [<ffff82c48016c2cf>] smp_call_function_interrupt+0x4f/0x90
(XEN)    [<ffff82c4801460ba>] call_function_interrupt+0x2a/0x30
(XEN)    [<ffff82c48014a9d2>] default_idle+0x42/0x50
(XEN)    [<ffff82c48014e0ce>] idle_loop+0x2e/0x90
(XEN)    
(XEN) *** Dumping CPU3 guest state: ***
(XEN) No guest context (CPU is idle).
(XEN) 
(XEN) *** Dumping CPU5 host state: ***
(XEN) ----[ Xen-4.0.1  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    5
(XEN) RIP:    e008:[<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
(XEN) rax: ffff82c480111140   rbx: ffff82c48037a980   rcx: 0000000000000001
(XEN) rdx: 0000000000000280   rsi: 0000000000000000   rdi: 0000000000000000
(XEN) rbp: 0000000000000000   rsp: ffff83022fcffe18   r8:  0000000000000001
(XEN) r9:  ffff83022fd3aee0   r10: ffff83022fd3aa68   r11: 0000000000000005
(XEN) r12: ffff83022fcfff28   r13: ffff83022fcffe18   r14: ffff8300cf55c000
(XEN) r15: 0000000000000003   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 0000000225001000   cr2: 0000000000000000
(XEN) ds: 002b   es: 002b   fs: 0000   gs: 0000   ss: e010   cs: e008
(XEN) Xen stack trace from rsp=ffff83022fcffe18:
(XEN)    ffff82c48037a980 ffff82c48016bbb2 ffff82c48025c9c0 ffff82c48016c2cf
(XEN)    0000000000000005 ffff83022fcfff28 ffff82c48025cb00 ffff82c4801460ba
(XEN)    0000000000000003 ffff8300cf55c000 ffff83022fcffe18 ffff83022fcfff28
(XEN)    ffff82c48025cb00 ffff83022fcfff28 0000000000000005 ffff83022fd3aa68
(XEN)    ffff83022fd3aee0 0000000000000001 00000000ffffffff ffff82c48037a980
(XEN)    0000000000000280 0000000000000000 000000000000a000 000000fb00000000
(XEN)    ffff82c48014a9d2 000000000000e008 0000000000000286 ffff83022fcfff08
(XEN)    000000000000e010 0000000000000003 ffff82c48014e0ce ffff8300cf55c000
(XEN)    ffff8300cc880000 00000000ffffffff 0000000000000000 0000000000000000
(XEN)    00000000ffffffff 0000000000000005 ffff88003fc38a20 0000000000000005
(XEN)    0000000000000246 0000000000000000 ffff8800035351b0 0000000000000000
(XEN)    0000000000000000 ffffffff8100930a 0000000000000000 0000000000000005
(XEN)    0000000000000002 0000010000000000 ffffffff8100930a 000000000000e033
(XEN)    0000000000000246 ffff880003528e60 000000000000e02b 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000005
(XEN)    ffff8300cf55c000
(XEN) Xen call trace:
(XEN)    [<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c48016bbb2>] __smp_call_function_interrupt+0x82/0x90
(XEN)    [<ffff82c48016c2cf>] smp_call_function_interrupt+0x4f/0x90
(XEN)    [<ffff82c4801460ba>] call_function_interrupt+0x2a/0x30
(XEN)    [<ffff82c48014a9d2>] default_idle+0x42/0x50
(XEN)    [<ffff82c48014e0ce>] idle_loop+0x2e/0x90
(XEN)    
(XEN) *** Dumping CPU5 guest state: ***
(XEN) No guest context (CPU is idle).
(XEN) 
(XEN) *** Dumping CPU6 host state: ***
(XEN) ----[ Xen-4.0.1  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    6
(XEN) RIP:    e008:[<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
(XEN) rax: ffff82c480111140   rbx: ffff82c48037a980   rcx: 0000000000000001
(XEN) rdx: 0000000000000300   rsi: 0000000000000001   rdi: 0000000000000000
(XEN) rbp: 0000000000000000   rsp: ffff83022fcf7e18   r8:  0000000000000001
(XEN) r9:  ffff83022fcdf5f0   r10: ffff83022fd3ab28   r11: 0000000000000001
(XEN) r12: ffff83022fcf7f28   r13: ffff83022fcf7e18   r14: ffff8300cf2f6000
(XEN) r15: 0000000000000003   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 0000000225001000   cr2: 0000000000000000
(XEN) ds: 002b   es: 002b   fs: 0000   gs: 0000   ss: e010   cs: e008
(XEN) Xen stack trace from rsp=ffff83022fcf7e18:
(XEN)    ffff82c48037a980 ffff82c48016bbb2 ffff82c48025c9c0 ffff82c48016c2cf
(XEN)    0000000000000006 ffff83022fcf7f28 ffff82c48025cb00 ffff82c4801460ba
(XEN)    0000000000000003 ffff8300cf2f6000 ffff83022fcf7e18 ffff83022fcf7f28
(XEN)    ffff82c48025cb00 ffff83022fcf7f28 0000000000000001 ffff83022fd3ab28
(XEN)    ffff83022fcdf5f0 0000000000000001 00000000ffffffff ffff82c48037a980
(XEN)    0000000000000300 0000000000000001 000000000000c000 000000fb00000000
(XEN)    ffff82c48014a9d2 000000000000e008 0000000000000286 ffff83022fcf7f08
(XEN)    000000000000e010 0000000000000003 ffff82c48014e0ce ffff8300cf2f6000
(XEN)    ffff8300cf2f0000 00000000ffffffff 0000000000000000 0000000000000000
(XEN)    00000000ffffffff 0000000000000001 ffff88003fc382a0 0000000000000001
(XEN)    0000000000000246 0000000000000000 ffff8800034bd1b0 0000000000000000
(XEN)    0000000000000000 ffffffff8100930a 0000000000000000 0000000000000001
(XEN)    0000000000000002 0000010000000000 ffffffff8100930a 000000000000e033
(XEN)    0000000000000246 ffff8800034b0e60 000000000000e02b 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000006
(XEN)    ffff8300cf2f6000
(XEN) Xen call trace:
(XEN)    [<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c48016bbb2>] __smp_call_function_interrupt+0x82/0x90
(XEN)    [<ffff82c48016c2cf>] smp_call_function_interrupt+0x4f/0x90
(XEN)    [<ffff82c4801460ba>] call_function_interrupt+0x2a/0x30
(XEN)    [<ffff82c48014a9d2>] default_idle+0x42/0x50
(XEN)    [<ffff82c48014e0ce>] idle_loop+0x2e/0x90
(XEN)    
(XEN) *** Dumping CPU6 guest state: ***
(XEN) No guest context (CPU is idle).
(XEN) 
(XEN) *** Dumping CPU7 host state: ***
(XEN) ----[ Xen-4.0.1  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    7
(XEN) RIP:    e008:[<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN) RFLAGS: 0000000000010002   CONTEXT: hypervisor
(XEN) rax: ffff82c480111140   rbx: ffff82c48037a980   rcx: 0000000000000001
(XEN) rdx: 0000000000000380   rsi: 0000000000000001   rdi: 0000000000000000
(XEN) rbp: 0000000000000000   rsp: ffff83022fce7ee8   r8:  0000000000000200
(XEN) r9:  ffffffff814e55f0   r10: 00ff88003fdf8000   r11: 00000000000186a0
(XEN) r12: 0000000000000007   r13: ffffffff814e55f0   r14: 0000000000000000
(XEN) r15: ffffffff8100f42f   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 0000000225001000   cr2: 0000000000005a08
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: 0000   cs: e008
(XEN) Xen stack trace from rsp=ffff83022fce7ee8:
(XEN)    ffff82c48037a980 ffff82c48016bbb2 ffff82c48025c9c0 ffff82c48016c2cf
(XEN)    ffff8300cf66c000 0000000000000000 ffff8800035712c0 ffff82c4801460ba
(XEN)    ffffffff8100f42f 0000000000000000 ffffffff814e55f0 0000000000000007
(XEN)    ffff8800035712c0 0000000000000000 00000000000186a0 00ff88003fdf8000
(XEN)    ffffffff814e55f0 0000000000000200 00000000000102c0 00000000000186a0
(XEN)    ffff880003561000 0000000000000001 0000000000000001 000000fb00000000
(XEN)    ffffffff810760de 000000000000e033 0000000000000202 ffff88003fe016e8
(XEN)    000000000000e02b 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000007 ffff8300cf66c000
(XEN) Xen call trace:
(XEN)    [<ffff82c480111141>] __dump_execstate+0x1/0x60
(XEN)    [<ffff82c48016bbb2>] __smp_call_function_interrupt+0x82/0x90
(XEN)    [<ffff82c48016c2cf>] smp_call_function_interrupt+0x4f/0x90
(XEN)    [<ffff82c4801460ba>] call_function_interrupt+0x2a/0x30
(XEN)    
(XEN) *** Dumping CPU7 guest state: ***
(XEN) ----[ Xen-4.0.1  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    7
(XEN) RIP:    e033:[<ffffffff810760de>]
(XEN) RFLAGS: 0000000000000202   EM: 0   CONTEXT: pv guest
(XEN) rax: 00000000000102c0   rbx: 0000000000000000   rcx: 00000000000186a0
(XEN) rdx: ffff880003561000   rsi: 0000000000000001   rdi: 0000000000000001
(XEN) rbp: ffff8800035712c0   rsp: ffff88003fe016e8   r8:  0000000000000200
(XEN) r9:  ffffffff814e55f0   r10: 00ff88003fdf8000   r11: 00000000000186a0
(XEN) r12: 0000000000000007   r13: ffffffff814e55f0   r14: 0000000000000000
(XEN) r15: ffffffff8100f42f   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 0000000225001000   cr2: 0000000000005a08
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: e02b   cs: e033
(XEN) Guest stack trace from rsp=ffff88003fe016e8:
(XEN)    00000000000186a0 0000000000000000 00000000fffffffe ffffffff81481430
(XEN)    ffffffff815e8be0 0000000000000000 0000000000000001 ffffffff810761a9
(XEN)    ffff8800035712f0 ffffffff8100b11d 0000000000000003 ffffffff8107616b
(XEN)    00ff88003fdf8000 ffffffff8100b174 ffff88003fdf8000 ffffffff8130e84b
(XEN)    ffffffff813c2129 ffff88003fdf8000 ffff88003fdf8000 ffff88003fdf8000
(XEN)    0000000000000000 ffffffff8130a48c 0000003000000008 ffff88003fe01888
(XEN)    ffff88003fe017b8 ffffffff8100e5b5 ffffffff8100ec72 0000000000000000
(XEN)    ffff88003fc02900 ffff88003fe01838 ffff88003fdf8000 ffffffff813c1c6d
(XEN)    0000000000000000 ffffffff8100e5b5 ffffffff8100ec72 00000000000186a0
(XEN)    ffff88003fdf8000 ffffffff813c1c6d ffffffff8130c25a ffff88003fe00210
(XEN)    ffffffff8130c2dc ffffffff81057ee2 ffff88003fe01838 ffff88003fe01838
(XEN)    ffffffff8100ec5f 0000000000000009 ffff88003fdf8000 ffff88003fdf8000
(XEN)    ffff88003fdf8000 ffffffff8147e3a0 ffff88003fdf8000 ffffffff81051f7b
(XEN)    ffffffff8100ec72 ffff88003fe01a18 ffff88003fe01898 ffff88003fe01898
(XEN)    ffff88003fdf8000 ffff88003fe01a18 0000000000000009 0000000000000001
(XEN)    ffff88003fdf8000 0000000000000000 0000000000000001 ffffffff8130d1cd
(XEN)    0000000000000009 0000000000005a08 ffff88003fe01a18 ffffffff8103338c
(XEN)    0000000000000001 ffff88000000ac18 ffffffff8166ba38 0000000000005a08
(XEN)    ffff88003fdf8000 ffff88003fe01a18 0000000000000000 0000000000030001
(XEN)    ffff88000000da28 ffffffff81033541 ffffffff811980db 0000000000200000
(XEN) 
(XEN) [0: dump Dom0 registers]
(XEN) '0' pressed -> dumping Dom0's registers
(XEN) *** Dumping Dom0 vcpu#0 state: ***
(XEN) RIP:    e033:[<ffffffff8100930a>]
(XEN) RFLAGS: 0000000000000246   EM: 1   CONTEXT: pv guest
(XEN) rax: 0000000000000000   rbx: 0000000000000000   rcx: ffffffff8100930a
(XEN) rdx: 0000000000000000   rsi: 0000000000000000   rdi: 0000000000000002
(XEN) rbp: ffff88003fc380c0   rsp: ffff880003492e60   r8:  0000000000000000
(XEN) r9:  ffff88000349f1b0   r10: ffff88003fe02000   r11: 0000000000000246
(XEN) r12: 0000000000000000   r13: 00000000ffffffff   r14: 0000000000000000
(XEN) r15: 0000000000000000   cr0: 0000000000000008   cr4: 0000000000002660
(XEN) cr3: 0000000225001000   cr2: 0000000000000000
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: e02b   cs: e033
(XEN) Guest stack trace from rsp=ffff880003492e60:
(XEN)    0000000000000246 0000000000000080 ffffffff8100f466 ffff8800035712c0
(XEN)    ffffffff8107621e ffffffff814610c8 ffff88003fc04800 ffff88003fc380c0
(XEN)    0000000000000000 00000000000008fd ffffffff8100f409 ffffffff814610c8
(XEN)    ffffffff8109566c ffff88000348f000 ffff88003fc04800 00000000000008fd
(XEN)    0000000000000000 0000000000012b10 0000000000000100 0000000000000000
(XEN)    ffffffff81096dcb 0000000000000000 00000000000008fd 0000000000000001
(XEN)    ffffffff811f1332 0000000000012b10 0000000000000140 0000000000000000
(XEN)    000000008106d1e5 ffffffffff57b000 ffff88000349a020 ffff88000349a028
(XEN)    ffffffff8143fe98 ffffffff8143fe98 0000000000000000 ffffffff815396a0
(XEN)    ffffffff8153b710 0000000000000000 ffffffff811f1980 0000000000000000
(XEN)    0000000000000001 6db6db6db6db6db7 ffffffff81012cfe ffffffff8143fe98
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 00cffb000000ffff 00affb000000ffff 00cff3000000ffff
(XEN)    00cffb000000ffff 00cff3000000ffff 00affb000000ffff 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) *** Dumping Dom0 vcpu#1 state: ***
(XEN) RIP:    e033:[<ffffffff8100930a>]
(XEN) RFLAGS: 0000000000000246   EM: 1   CONTEXT: pv guest
(XEN) rax: 0000000000000000   rbx: 0000000000000001   rcx: ffffffff8100930a
(XEN) rdx: 0000000000000000   rsi: 0000000000000001   rdi: 0000000000000002
(XEN) rbp: ffff88003fc382a0   rsp: ffff8800034b0e60   r8:  0000000000000000
(XEN) r9:  ffff8800034bd1b0   r10: 0000000000000000   r11: 0000000000000246
(XEN) r12: 0000000000000001   r13: 00000000ffffffff   r14: 0000000000000000
(XEN) r15: 0000000000000000   cr0: 000000008005003b   cr4: 0000000000002660
(XEN) cr3: 0000000225001000   cr2: 0000000000000000
(XEN) ds: 002b   es: 002b   fs: 0000   gs: 0000   ss: e02b   cs: e033
(XEN) Guest stack trace from rsp=ffff8800034b0e60:
(XEN)    0000000000000246 0000000000000080 ffffffff8100f466 ffff8800035712c0
(XEN)    ffffffff8107621e ffffffff814610c8 ffff88003fc05200 ffff88003fc382a0
(XEN)    0000000000000000 00000000000008f8 ffffffff8100f409 ffffffff814610c8
(XEN)    ffffffff8109566c ffff8800034ad000 ffff88003fc05200 00000000000008f8
(XEN)    0000000000000000 0000000000012b10 0000000000000100 0000000000000200
(XEN)    ffffffff81096dcb 0000000000000000 00000000000008f8 0000000000000001
(XEN)    ffffffff811f1332 0000000000012b10 0000000000000140 0000000000000000
(XEN)    000000008106d1e5 ffffffffff57b000 ffff8800034b8020 ffff8800034b8028
(XEN)    ffff88003fe11e48 ffff88003fe11e48 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 ffffffff811f1980 0000000000000000
(XEN)    0000000000000001 0000000000000000 ffffffff81012cfe ffff88003fe11e48
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 00cffb000000ffff 00affb000000ffff 00cff3000000ffff
(XEN)    00cffb000000ffff 00cff3000000ffff 00affb000000ffff 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) *** Dumping Dom0 vcpu#2 state: ***
(XEN) RIP:    e033:[<ffffffff8100930a>]
(XEN) RFLAGS: 0000000000000246   EM: 1   CONTEXT: pv guest
(XEN) rax: 0000000000000000   rbx: 0000000000000002   rcx: ffffffff8100930a
(XEN) rdx: 0000000000000000   rsi: 0000000000000002   rdi: 0000000000000002
(XEN) rbp: ffff88003fc38480   rsp: ffff8800034cee60   r8:  0000000000000000
(XEN) r9:  ffff8800034db1b0   r10: 0000000000000000   r11: 0000000000000246
(XEN) r12: 0000000000000002   r13: 00000000ffffffff   r14: 0000000000000000
(XEN) r15: 0000000000000000   cr0: 000000008005003b   cr4: 0000000000002660
(XEN) cr3: 0000000225001000   cr2: 0000000000000000
(XEN) ds: 002b   es: 002b   fs: 0000   gs: 0000   ss: e02b   cs: e033
(XEN) Guest stack trace from rsp=ffff8800034cee60:
(XEN)    0000000000000246 0000000000000080 ffffffff8100f466 ffff8800035712c0
(XEN)    ffffffff8107621e ffffffff814610c8 ffff88003fc05c00 ffff88003fc38480
(XEN)    0000000000000000 00000000000008f3 ffffffff8100f409 ffffffff814610c8
(XEN)    ffffffff8109566c ffff8800034cb000 ffff88003fc05c00 00000000000008f3
(XEN)    0000000000000000 0000000000012b10 0000000000000100 0000000000000400
(XEN)    ffffffff81096dcb 0000000000000000 00000000000008f3 0000000000000001
(XEN)    ffffffff811f1332 0000000000012b10 0000000000000140 0000000000000000
(XEN)    000000008106d1e5 ffffffffff57b000 ffff8800034d6020 ffff8800034d6028
(XEN)    ffff88003fe13e48 ffff88003fe13e48 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 ffffffff811f1980 0000000000000000
(XEN)    0000000000000001 0000000000000000 ffffffff81012cfe ffff88003fe13e48
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 00cffb000000ffff 00affb000000ffff 00cff3000000ffff
(XEN)    00cffb000000ffff 00cff3000000ffff 00affb000000ffff 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) *** Dumping Dom0 vcpu#3 state: ***
(XEN) RIP:    e033:[<ffffffff8100930a>]
(XEN) RFLAGS: 0000000000000246   EM: 1   CONTEXT: pv guest
(XEN) rax: 0000000000000000   rbx: 0000000000000003   rcx: ffffffff8100930a
(XEN) rdx: 0000000000000000   rsi: 0000000000000003   rdi: 0000000000000002
(XEN) rbp: ffff88003fc38660   rsp: ffff8800034ece60   r8:  0000000000000000
(XEN) r9:  ffff8800034f91b0   r10: 0000000000000000   r11: 0000000000000246
(XEN) r12: 0000000000000003   r13: 00000000ffffffff   r14: 0000000000000000
(XEN) r15: 0000000000000000   cr0: 000000008005003b   cr4: 0000000000002660
(XEN) cr3: 0000000225001000   cr2: 0000000000000000
(XEN) ds: 002b   es: 002b   fs: 0000   gs: 0000   ss: e02b   cs: e033
(XEN) Guest stack trace from rsp=ffff8800034ece60:
(XEN)    0000000000000246 0000000000000080 ffffffff8100f466 ffff8800035712c0
(XEN)    ffffffff8107621e ffffffff814610c8 ffff88003fc06600 ffff88003fc38660
(XEN)    0000000000000000 00000000000008ee ffffffff8100f409 ffffffff814610c8
(XEN)    ffffffff8109566c ffff8800034e9000 ffff88003fc06600 00000000000008ee
(XEN)    0000000000000000 0000000000012b10 0000000000000100 0000000000000600
(XEN)    ffffffff81096dcb 0000000000000000 00000000000008ee 0000000000000001
(XEN)    ffffffff811f1332 0000000000012b10 0000000000000140 0000000000000000
(XEN)    000000008106d1e5 ffffffffff57b000 ffff8800034f4020 ffff8800034f4028
(XEN)    ffff88003fe15e48 ffff88003fe15e48 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 ffffffff811f1980 0000000000000000
(XEN)    0000000000000001 0000000000000000 ffffffff81012cfe ffff88003fe15e48
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 00cffb000000ffff 00affb000000ffff 00cff3000000ffff
(XEN)    00cffb000000ffff 00cff3000000ffff 00affb000000ffff 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) *** Dumping Dom0 vcpu#4 state: ***
(XEN) RIP:    e033:[<ffffffff8100930a>]
(XEN) RFLAGS: 0000000000000246   EM: 1   CONTEXT: pv guest
(XEN) rax: 0000000000000000   rbx: 0000000000000004   rcx: ffffffff8100930a
(XEN) rdx: 0000000000000000   rsi: 0000000000000004   rdi: 0000000000000002
(XEN) rbp: ffff88003fc38840   rsp: ffff88000350ae60   r8:  0000000000000000
(XEN) r9:  ffff8800035171b0   r10: 0000000000000000   r11: 0000000000000246
(XEN) r12: 0000000000000004   r13: 00000000ffffffff   r14: 0000000000000000
(XEN) r15: 0000000000000000   cr0: 000000008005003b   cr4: 0000000000002660
(XEN) cr3: 0000000225001000   cr2: 0000000000000000
(XEN) ds: 002b   es: 002b   fs: 0000   gs: 0000   ss: e02b   cs: e033
(XEN) Guest stack trace from rsp=ffff88000350ae60:
(XEN)    0000000000000246 0000000000000080 ffffffff8100f466 ffff8800035712c0
(XEN)    ffffffff8107621e ffffffff814610c8 ffff88003fc07000 ffff88003fc38840
(XEN)    0000000000000000 00000000000008e9 ffffffff8100f409 ffffffff814610c8
(XEN)    ffffffff8109566c ffff880003507000 ffff88003fc07000 00000000000008e9
(XEN)    0000000000000000 0000000000012b10 0000000000000100 0000000000000800
(XEN)    ffffffff81096dcb 0000000000000000 00000000000008e9 0000000000000001
(XEN)    ffffffff811f1332 0000000000012b10 0000000000000140 0000000000000000
(XEN)    000000008106d1e5 ffffffffff57b000 ffff880003512020 ffff880003512028
(XEN)    ffff88003fe17e48 ffff88003fe17e48 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 ffffffff811f1980 0000000000000000
(XEN)    0000000000000001 0000000000000000 ffffffff81012cfe ffff88003fe17e48
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 00cffb000000ffff 00affb000000ffff 00cff3000000ffff
(XEN)    00cffb000000ffff 00cff3000000ffff 00affb000000ffff 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) *** Dumping Dom0 vcpu#5 state: ***
(XEN) RIP:    e033:[<ffffffff8100930a>]
(XEN) RFLAGS: 0000000000000246   EM: 1   CONTEXT: pv guest
(XEN) rax: 0000000000000000   rbx: 0000000000000005   rcx: ffffffff8100930a
(XEN) rdx: 0000000000000000   rsi: 0000000000000005   rdi: 0000000000000002
(XEN) rbp: ffff88003fc38a20   rsp: ffff880003528e60   r8:  0000000000000000
(XEN) r9:  ffff8800035351b0   r10: 0000000000000000   r11: 0000000000000246
(XEN) r12: 0000000000000005   r13: 00000000ffffffff   r14: 0000000000000000
(XEN) r15: 0000000000000000   cr0: 000000008005003b   cr4: 0000000000002660
(XEN) cr3: 0000000225001000   cr2: 0000000000000000
(XEN) ds: 002b   es: 002b   fs: 0000   gs: 0000   ss: e02b   cs: e033
(XEN) Guest stack trace from rsp=ffff880003528e60:
(XEN)    0000000000000246 0000000000000080 ffffffff8100f466 ffff8800035712c0
(XEN)    ffffffff8107621e ffffffff814610c8 ffff88003fc07a00 ffff88003fc38a20
(XEN)    0000000000000000 00000000000008e4 ffffffff8100f409 ffffffff814610c8
(XEN)    ffffffff8109566c ffff880003525000 ffff88003fc07a00 00000000000008e4
(XEN)    0000000000000000 0000000000012b10 0000000000000100 0000000000000a00
(XEN)    ffffffff81096dcb 0000000000000000 00000000000008e4 0000000000000001
(XEN)    ffffffff811f1332 0000000000012b10 0000000000000140 0000000000000000
(XEN)    000000008106d1e5 ffffffffff57b000 ffff880003530020 ffff880003530028
(XEN)    ffff88003fe21e48 ffff88003fe21e48 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 ffffffff811f1980 0000000000000000
(XEN)    0000000000000001 0000000000000000 ffffffff81012cfe ffff88003fe21e48
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 00cffb000000ffff 00affb000000ffff 00cff3000000ffff
(XEN)    00cffb000000ffff 00cff3000000ffff 00affb000000ffff 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) *** Dumping Dom0 vcpu#6 state: ***
(XEN) RIP:    e033:[<ffffffff8100930a>]
(XEN) RFLAGS: 0000000000000246   EM: 1   CONTEXT: pv guest
(XEN) rax: 0000000000000000   rbx: 0000000000000006   rcx: ffffffff8100930a
(XEN) rdx: 0000000000000000   rsi: 0000000000000006   rdi: 0000000000000002
(XEN) rbp: ffff88003fc38c00   rsp: ffff880003546e60   r8:  0000000000000000
(XEN) r9:  ffff8800035531b0   r10: 0000000000000000   r11: 0000000000000246
(XEN) r12: 0000000000000006   r13: 00000000ffffffff   r14: 0000000000000000
(XEN) r15: 0000000000000000   cr0: 000000008005003b   cr4: 0000000000002660
(XEN) cr3: 0000000225001000   cr2: 0000000000000000
(XEN) ds: 002b   es: 002b   fs: 0000   gs: 0000   ss: e02b   cs: e033
(XEN) Guest stack trace from rsp=ffff880003546e60:
(XEN)    0000000000000246 0000000000000080 ffffffff8100f466 ffff8800035712c0
(XEN)    ffffffff8107621e ffffffff814610c8 ffff88003fe80400 ffff88003fc38c00
(XEN)    0000000000000000 00000000000008df ffffffff8100f409 ffffffff814610c8
(XEN)    ffffffff8109566c ffff880003543000 ffff88003fe80400 00000000000008df
(XEN)    0000000000000000 0000000000012b10 0000000000000100 0000000000000c00
(XEN)    ffffffff81096dcb 0000000000000000 00000000000008df 0000000000000001
(XEN)    ffffffff811f1332 0000000000012b10 0000000000000140 0000000000000000
(XEN)    000000008106d1e5 ffffffffff57b000 ffff88000354e020 ffff88000354e028
(XEN)    ffff88003fe23e48 ffff88003fe23e48 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 ffffffff811f1980 0000000000000000
(XEN)    0000000000000001 0000000000000000 ffffffff81012cfe ffff88003fe23e48
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 00cffb000000ffff 00affb000000ffff 00cff3000000ffff
(XEN)    00cffb000000ffff 00cff3000000ffff 00affb000000ffff 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) *** Dumping Dom0 vcpu#7 state: ***
(XEN) ----[ Xen-4.0.1  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    7
(XEN) RIP:    e033:[<ffffffff810760de>]
(XEN) RFLAGS: 0000000000000202   EM: 0   CONTEXT: pv guest
(XEN) rax: 00000000000102c0   rbx: 0000000000000000   rcx: 00000000000186a0
(XEN) rdx: ffff880003561000   rsi: 0000000000000001   rdi: 0000000000000001
(XEN) rbp: ffff8800035712c0   rsp: ffff88003fe016e8   r8:  0000000000000200
(XEN) r9:  ffffffff814e55f0   r10: 00ff88003fdf8000   r11: 00000000000186a0
(XEN) r12: 0000000000000007   r13: ffffffff814e55f0   r14: 0000000000000000
(XEN) r15: ffffffff8100f42f   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 0000000225001000   cr2: 0000000000005a08
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: e02b   cs: e033
(XEN) Guest stack trace from rsp=ffff88003fe016e8:
(XEN)    00000000000186a0 0000000000000000 00000000fffffffe ffffffff81481430
(XEN)    ffffffff815e8be0 0000000000000000 0000000000000001 ffffffff810761a9
(XEN)    ffff8800035712f0 ffffffff8100b11d 0000000000000003 ffffffff8107616b
(XEN)    00ff88003fdf8000 ffffffff8100b174 ffff88003fdf8000 ffffffff8130e84b
(XEN)    ffffffff813c2129 ffff88003fdf8000 ffff88003fdf8000 ffff88003fdf8000
(XEN)    0000000000000000 ffffffff8130a48c 0000003000000008 ffff88003fe01888
(XEN)    ffff88003fe017b8 ffffffff8100e5b5 ffffffff8100ec72 0000000000000000
(XEN)    ffff88003fc02900 ffff88003fe01838 ffff88003fdf8000 ffffffff813c1c6d
(XEN)    0000000000000000 ffffffff8100e5b5 ffffffff8100ec72 00000000000186a0
(XEN)    ffff88003fdf8000 ffffffff813c1c6d ffffffff8130c25a ffff88003fe00210
(XEN)    ffffffff8130c2dc ffffffff81057ee2 ffff88003fe01838 ffff88003fe01838
(XEN)    ffffffff8100ec5f 0000000000000009 ffff88003fdf8000 ffff88003fdf8000
(XEN)    ffff88003fdf8000 ffffffff8147e3a0 ffff88003fdf8000 ffffffff81051f7b
(XEN)    ffffffff8100ec72 ffff88003fe01a18 ffff88003fe01898 ffff88003fe01898
(XEN)    ffff88003fdf8000 ffff88003fe01a18 0000000000000009 0000000000000001
(XEN)    ffff88003fdf8000 0000000000000000 0000000000000001 ffffffff8130d1cd
(XEN)    0000000000000009 0000000000005a08 ffff88003fe01a18 ffffffff8103338c
(XEN)    0000000000000001 ffff88000000ac18 ffffffff8166ba38 0000000000005a08
(XEN)    ffff88003fdf8000 ffff88003fe01a18 0000000000000000 0000000000030001
(XEN)    ffff88000000da28 ffffffff81033541 ffffffff811980db 0000000000200000
(XEN) [H: dump heap info]
(XEN) 'H' pressed -> dumping heap info (now-0x58:993A2107)
(XEN) heap[node=0][zone=0] -> 0 pages
(XEN) heap[node=0][zone=1] -> 0 pages
(XEN) heap[node=0][zone=2] -> 0 pages
(XEN) heap[node=0][zone=3] -> 0 pages
(XEN) heap[node=0][zone=4] -> 0 pages
(XEN) heap[node=0][zone=5] -> 0 pages
(XEN) heap[node=0][zone=6] -> 0 pages
(XEN) heap[node=0][zone=7] -> 0 pages
(XEN) heap[node=0][zone=8] -> 0 pages
(XEN) heap[node=0][zone=9] -> 0 pages
(XEN) heap[node=0][zone=10] -> 0 pages
(XEN) heap[node=0][zone=11] -> 0 pages
(XEN) heap[node=0][zone=12] -> 0 pages
(XEN) heap[node=0][zone=13] -> 0 pages
(XEN) heap[node=0][zone=14] -> 0 pages
(XEN) heap[node=0][zone=15] -> 0 pages
(XEN) heap[node=0][zone=16] -> 0 pages
(XEN) heap[node=0][zone=17] -> 0 pages
(XEN) heap[node=0][zone=18] -> 0 pages
(XEN) heap[node=0][zone=19] -> 0 pages
(XEN) heap[node=0][zone=20] -> 753663 pages
(XEN) heap[node=0][zone=21] -> 24855 pages
(XEN) heap[node=0][zone=22] -> 0 pages
(XEN) heap[node=0][zone=23] -> 0 pages
(XEN) heap[node=0][zone=24] -> 0 pages
(XEN) heap[node=0][zone=25] -> 0 pages
(XEN) heap[node=0][zone=26] -> 0 pages
(XEN) heap[node=0][zone=27] -> 0 pages
(XEN) heap[node=0][zone=28] -> 0 pages
(XEN) heap[node=0][zone=29] -> 0 pages
(XEN) heap[node=0][zone=30] -> 0 pages
(XEN) heap[node=0][zone=31] -> 0 pages
(XEN) heap[node=0][zone=32] -> 0 pages
(XEN) heap[node=0][zone=33] -> 0 pages
(XEN) heap[node=0][zone=34] -> 0 pages
(XEN) heap[node=0][zone=35] -> 0 pages
(XEN) heap[node=0][zone=36] -> 0 pages
(XEN) heap[node=0][zone=37] -> 0 pages
(XEN) heap[node=0][zone=38] -> 0 pages
(XEN) heap[node=0][zone=39] -> 0 pages
(XEN) heap[node=1][zone=0] -> 0 pages
(XEN) heap[node=1][zone=1] -> 0 pages
(XEN) heap[node=1][zone=2] -> 0 pages
(XEN) heap[node=1][zone=3] -> 0 pages
(XEN) heap[node=1][zone=4] -> 0 pages
(XEN) heap[node=1][zone=5] -> 0 pages
(XEN) heap[node=1][zone=6] -> 0 pages
(XEN) heap[node=1][zone=7] -> 0 pages
(XEN) heap[node=1][zone=8] -> 0 pages
(XEN) heap[node=1][zone=9] -> 0 pages
(XEN) heap[node=1][zone=10] -> 0 pages
(XEN) heap[node=1][zone=11] -> 0 pages
(XEN) heap[node=1][zone=12] -> 0 pages
(XEN) heap[node=1][zone=13] -> 0 pages
(XEN) heap[node=1][zone=14] -> 16120 pages
(XEN) heap[node=1][zone=15] -> 32768 pages
(XEN) heap[node=1][zone=16] -> 65536 pages
(XEN) heap[node=1][zone=17] -> 131072 pages
(XEN) heap[node=1][zone=18] -> 262144 pages
(XEN) heap[node=1][zone=19] -> 324704 pages
(XEN) heap[node=1][zone=20] -> 192487 pages
(XEN) heap[node=1][zone=21] -> 0 pages
(XEN) heap[node=1][zone=22] -> 0 pages
(XEN) heap[node=1][zone=23] -> 0 pages
(XEN) heap[node=1][zone=24] -> 0 pages
(XEN) heap[node=1][zone=25] -> 0 pages
(XEN) heap[node=1][zone=26] -> 0 pages
(XEN) heap[node=1][zone=27] -> 0 pages
(XEN) heap[node=1][zone=28] -> 0 pages
(XEN) heap[node=1][zone=29] -> 0 pages
(XEN) heap[node=1][zone=30] -> 0 pages
(XEN) heap[node=1][zone=31] -> 0 pages
(XEN) heap[node=1][zone=32] -> 0 pages
(XEN) heap[node=1][zone=33] -> 0 pages
(XEN) heap[node=1][zone=34] -> 0 pages
(XEN) heap[node=1][zone=35] -> 0 pages
(XEN) heap[node=1][zone=36] -> 0 pages
(XEN) heap[node=1][zone=37] -> 0 pages
(XEN) heap[node=1][zone=38] -> 0 pages
(XEN) heap[node=1][zone=39] -> 0 pages
(XEN) [M: dump MSI state]
(XEN) PCI-MSI interrupt information:
(XEN) [Q: dump PCI devices]
(XEN) ==== PCI devices ====
(XEN) ff:06.3 - dom 0   - MSIs < >
(XEN) ff:06.2 - dom 0   - MSIs < >
(XEN) ff:06.1 - dom 0   - MSIs < >
(XEN) ff:06.0 - dom 0   - MSIs < >
(XEN) ff:05.3 - dom 0   - MSIs < >
(XEN) ff:05.2 - dom 0   - MSIs < >
(XEN) ff:05.1 - dom 0   - MSIs < >
(XEN) ff:05.0 - dom 0   - MSIs < >
(XEN) ff:04.3 - dom 0   - MSIs < >
(XEN) ff:04.2 - dom 0   - MSIs < >
(XEN) ff:04.1 - dom 0   - MSIs < >
(XEN) ff:04.0 - dom 0   - MSIs < >
(XEN) ff:03.4 - dom 0   - MSIs < >
(XEN) ff:03.2 - dom 0   - MSIs < >
(XEN) ff:03.1 - dom 0   - MSIs < >
(XEN) ff:03.0 - dom 0   - MSIs < >
(XEN) ff:02.5 - dom 0   - MSIs < >
(XEN) ff:02.4 - dom 0   - MSIs < >
(XEN) ff:02.1 - dom 0   - MSIs < >
(XEN) ff:02.0 - dom 0   - MSIs < >
(XEN) ff:00.1 - dom 0   - MSIs < >
(XEN) ff:00.0 - dom 0   - MSIs < >
(XEN) fe:06.3 - dom 0   - MSIs < >
(XEN) fe:06.2 - dom 0   - MSIs < >
(XEN) fe:06.1 - dom 0   - MSIs < >
(XEN) fe:06.0 - dom 0   - MSIs < >
(XEN) fe:05.3 - dom 0   - MSIs < >
(XEN) fe:05.2 - dom 0   - MSIs < >
(XEN) fe:05.1 - dom 0   - MSIs < >
(XEN) fe:05.0 - dom 0   - MSIs < >
(XEN) fe:04.3 - dom 0   - MSIs < >
(XEN) fe:04.2 - dom 0   - MSIs < >
(XEN) fe:04.1 - dom 0   - MSIs < >
(XEN) fe:04.0 - dom 0   - MSIs < >
(XEN) fe:03.4 - dom 0   - MSIs < >
(XEN) fe:03.2 - dom 0   - MSIs < >
(XEN) fe:03.1 - dom 0   - MSIs < >
(XEN) fe:03.0 - dom 0   - MSIs < >
(XEN) fe:02.5 - dom 0   - MSIs < >
(XEN) fe:02.4 - dom 0   - MSIs < >
(XEN) fe:02.1 - dom 0   - MSIs < >
(XEN) fe:02.0 - dom 0   - MSIs < >
(XEN) fe:00.1 - dom 0   - MSIs < >
(XEN) fe:00.0 - dom 0   - MSIs < >
(XEN) 04:03.7 - dom 0   - MSIs < >
(XEN) 04:03.6 - dom 0   - MSIs < >
(XEN) 04:03.5 - dom 0   - MSIs < >
(XEN) 04:03.4 - dom 0   - MSIs < >
(XEN) 04:03.3 - dom 0   - MSIs < >
(XEN) 04:03.2 - dom 0   - MSIs < >
(XEN) 04:03.1 - dom 0   - MSIs < >
(XEN) 04:03.0 - dom 0   - MSIs < >
(XEN) 03:00.0 - dom 0   - MSIs < >
(XEN) 01:00.1 - dom 0   - MSIs < >
(XEN) 01:00.0 - dom 0   - MSIs < >
(XEN) 00:1f.5 - dom 0   - MSIs < >
(XEN) 00:1f.2 - dom 0   - MSIs < >
(XEN) 00:1f.0 - dom 0   - MSIs < >
(XEN) 00:1e.0 - dom 0   - MSIs < >
(XEN) 00:1d.7 - dom 0   - MSIs < >
(XEN) 00:1d.3 - dom 0   - MSIs < >
(XEN) 00:1d.2 - dom 0   - MSIs < >
(XEN) 00:1d.1 - dom 0   - MSIs < >
(XEN) 00:1d.0 - dom 0   - MSIs < >
(XEN) 00:1a.7 - dom 0   - MSIs < >
(XEN) 00:1a.1 - dom 0   - MSIs < >
(XEN) 00:1a.0 - dom 0   - MSIs < >
(XEN) 00:14.2 - dom 0   - MSIs < >
(XEN) 00:14.1 - dom 0   - MSIs < >
(XEN) 00:14.0 - dom 0   - MSIs < >
(XEN) 00:07.0 - dom 0   - MSIs < >
(XEN) 00:03.0 - dom 0   - MSIs < >
(XEN) 00:01.0 - dom 0   - MSIs < >
(XEN) 00:00.0 - dom 0   - MSIs < >
(XEN) [V: dump iommu info]
(XEN) 
(XEN) iommu 0: nr_pt_levels = 4.
(XEN)   Queued Invalidation: supported and enabled.
(XEN)   Interrupt Remapping: not supported.
(XEN) [a: dump timer queues]
(XEN) Dumping timer queues: NOW=0x00000058DA064B65
(XEN) CPU[00]   1 : ffff82c48037a900 ex=0x00000058DC42762D 0000000000000000 ffff82c4801175c0
(XEN)   2 : ffff82c480397120 ex=0x00000058F6B8CD39 0000000000000000 ffff82c480170330
(XEN)   3 : ffff82c48039a900 ex=0x0000005B48F11C4A 0000000000000000 ffff82c480197140
(XEN)   4 : ffff82c480397220 ex=0x00000068C6543D9E 0000000000000000 ffff82c4801700c0
(XEN)  L0 : ffff83022fd7d028 ex=0x00000058DAB62F21 0000000000000000 ffff82c480118ac0
(XEN) 
(XEN) CPU[01]  L0 : ffff83022fd3a768 ex=0x00000058DFBF87D0 0000000000000001 ffff82c480118ac0
(XEN) 
(XEN) CPU[02]  L0 : ffff83022fd3a828 ex=0x00000058E058D530 0000000000000002 ffff82c480118ac0
(XEN) 
(XEN) CPU[03]  L0 : ffff83022fd3a8e8 ex=0x00000058E18958D7 0000000000000003 ffff82c480118ac0
(XEN) 
(XEN) CPU[04]  L0 : ffff83022fd3a9a8 ex=0x00000058E2762962 0000000000000004 ffff82c480118ac0
(XEN) 
(XEN) CPU[05]  L0 : ffff83022fd3aa68 ex=0x00000058E3A720D6 0000000000000005 ffff82c480118ac0
(XEN) 
(XEN) CPU[06]  L0 : ffff83022fd3ab28 ex=0x00000058E509843B 0000000000000006 ffff82c480118ac0
(XEN) 
(XEN) CPU[07]   1 : ffff82c48026a0a0 ex=0x00000058810D145D 0000000000000000 ffff82c48011ad30
(XEN)  L0 : ffff83022fd3abe8 ex=0x000000587FDBE627 0000000000000007 ffff82c480118ac0
(XEN) 
(XEN) [c: dump ACPI Cx structures]
(XEN) 'c' pressed -> printing ACPI Cx structures
(XEN) [e: dump evtchn info]
(XEN) 'e' pressed -> dumping event-channel info
(XEN) Event channel information for domain 0:
(XEN) Polling vCPUs: {}
(XEN)     port [p/m]
(XEN)        1 [1/0]: s=5 n=0 v=0 x=0
(XEN)        2 [0/0]: s=6 n=0 x=0
(XEN)        3 [0/0]: s=6 n=0 x=0
(XEN)        4 [0/0]: s=5 n=0 v=1 x=0
(XEN)        5 [0/0]: s=6 n=0 x=0
(XEN)        6 [1/0]: s=5 n=1 v=0 x=0
(XEN)        7 [0/0]: s=6 n=1 x=0
(XEN)        8 [0/0]: s=6 n=1 x=0
(XEN)        9 [0/0]: s=5 n=1 v=1 x=0
(XEN)       10 [0/0]: s=6 n=1 x=0
(XEN)       11 [1/0]: s=5 n=2 v=0 x=0
(XEN)       12 [0/0]: s=6 n=2 x=0
(XEN)       13 [0/0]: s=6 n=2 x=0
(XEN)       14 [0/0]: s=5 n=2 v=1 x=0
(XEN)       15 [0/0]: s=6 n=2 x=0
(XEN)       16 [1/0]: s=5 n=3 v=0 x=0
(XEN)       17 [0/0]: s=6 n=3 x=0
(XEN)       18 [0/0]: s=6 n=3 x=0
(XEN)       19 [0/0]: s=5 n=3 v=1 x=0
(XEN)       20 [0/0]: s=6 n=3 x=0
(XEN)       21 [1/0]: s=5 n=4 v=0 x=0
(XEN)       22 [0/0]: s=6 n=4 x=0
(XEN)       23 [0/0]: s=6 n=4 x=0
(XEN)       24 [0/0]: s=5 n=4 v=1 x=0
(XEN)       25 [0/0]: s=6 n=4 x=0
(XEN)       26 [1/0]: s=5 n=5 v=0 x=0
(XEN)       27 [0/0]: s=6 n=5 x=0
(XEN)       28 [0/0]: s=6 n=5 x=0
(XEN)       29 [0/0]: s=5 n=5 v=1 x=0
(XEN)       30 [0/0]: s=6 n=5 x=0
(XEN)       31 [1/0]: s=5 n=6 v=0 x=0
(XEN)       32 [0/0]: s=6 n=6 x=0
(XEN)       33 [0/0]: s=6 n=6 x=0
(XEN)       34 [0/0]: s=5 n=6 v=1 x=0
(XEN)       35 [0/0]: s=6 n=6 x=0
(XEN)       36 [1/0]: s=5 n=7 v=0 x=0
(XEN)       37 [0/0]: s=6 n=7 x=0
(XEN)       38 [0/0]: s=6 n=7 x=0
(XEN)       39 [0/0]: s=5 n=7 v=1 x=0
(XEN)       40 [0/0]: s=6 n=7 x=0
(XEN)       41 [0/0]: s=2 n=0 d=0 x=0
(XEN)       42 [0/0]: s=4 n=0 p=9 x=0
(XEN)       43 [0/0]: s=5 n=0 v=9 x=0
(XEN) [g: print grant table usage]
(XEN) gnttab_usage_print_all [ key 'g' pressed
(XEN)       -------- active --------       -------- shared --------
(XEN) [ref] localdom mfn      pin          localdom gmfn     flags
(XEN) grant-table for remote domain:    0 ... no active grant table entries
(XEN) gnttab_usage_print_all ] done
(XEN) [i: dump interrupt bindings]
(XEN) Guest interrupt information:
(XEN)    IRQ:   0 affinity:ffffffff,ffffffff,ffffffff,ffffffff vec:f0 type=IO-APIC-edge    status=00000000 mapped, unbound
(XEN)    IRQ:   1 affinity:00000000,00000000,00000000,00000001 vec:30 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:   2 affinity:ffffffff,ffffffff,ffffffff,ffffffff vec:e2 type=XT-PIC          status=00000000 mapped, unbound
(XEN)    IRQ:   3 affinity:ffffffff,ffffffff,ffffffff,ffffffff vec:f2 type=IO-APIC-edge    status=00000000 mapped, unbound
(XEN)    IRQ:   4 affinity:00000000,00000000,00000000,000000ff vec:38 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:   5 affinity:00000000,00000000,00000000,00000001 vec:40 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:   6 affinity:00000000,00000000,00000000,00000001 vec:48 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:   7 affinity:00000000,00000000,00000000,00000001 vec:50 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:   8 affinity:00000000,00000000,00000000,000000ff vec:58 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:   9 affinity:00000000,00000000,00000000,00000001 vec:60 type=IO-APIC-level   status=00000010 in-flight=0 domain-list=0:  9(-S--),
(XEN)    IRQ:  10 affinity:00000000,00000000,00000000,00000001 vec:68 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  11 affinity:00000000,00000000,00000000,00000001 vec:70 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  12 affinity:00000000,00000000,00000000,00000001 vec:78 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  13 affinity:00000000,00000000,00000000,000000ff vec:88 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  14 affinity:00000000,00000000,00000000,00000001 vec:90 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  15 affinity:00000000,00000000,00000000,00000001 vec:98 type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  55 affinity:00000000,00000000,00000000,00000001 vec:28 type=DMA_MSI         status=00000000 mapped, unbound
(XEN) IO-APIC interrupt information:
(XEN)     IRQ  0 Vec240:
(XEN)       Apic 0x00, Pin  2: vector=240, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=edge, mask=0, dest_id:255
(XEN)     IRQ  1 Vec 48:
(XEN)       Apic 0x00, Pin  1: vector=48, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=edge, mask=0, dest_id:1
(XEN)     IRQ  3 Vec242:
(XEN)       Apic 0x00, Pin  3: vector=242, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=edge, mask=0, dest_id:255
(XEN)     IRQ  4 Vec 56:
(XEN)       Apic 0x00, Pin  4: vector=56, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=edge, mask=1, dest_id:255
(XEN)     IRQ  5 Vec 64:
(XEN)       Apic 0x00, Pin  5: vector=64, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=edge, mask=0, dest_id:1
(XEN)     IRQ  6 Vec 72:
(XEN)       Apic 0x00, Pin  6: vector=72, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=edge, mask=0, dest_id:1
(XEN)     IRQ  7 Vec 80:
(XEN)       Apic 0x00, Pin  7: vector=80, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=edge, mask=0, dest_id:1
(XEN)     IRQ  8 Vec 88:
(XEN)       Apic 0x00, Pin  8: vector=88, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=edge, mask=1, dest_id:255
(XEN)     IRQ  9 Vec 96:
(XEN)       Apic 0x00, Pin  9: vector=96, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=level, mask=0, dest_id:1
(XEN)     IRQ 10 Vec104:
(XEN)       Apic 0x00, Pin 10: vector=104, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=edge, mask=0, dest_id:1
(XEN)     IRQ 11 Vec112:
(XEN)       Apic 0x00, Pin 11: vector=112, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=edge, mask=0, dest_id:1
(XEN)     IRQ 12 Vec120:
(XEN)       Apic 0x00, Pin 12: vector=120, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=edge, mask=0, dest_id:1
(XEN)     IRQ 13 Vec136:
(XEN)       Apic 0x00, Pin 13: vector=136, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=edge, mask=1, dest_id:255
(XEN)     IRQ 14 Vec144:
(XEN)       Apic 0x00, Pin 14: vector=144, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=edge, mask=0, dest_id:1
(XEN)     IRQ 15 Vec152:
(XEN)       Apic 0x00, Pin 15: vector=152, delivery_mode=1, dest_mode=logical, delivery_status=0, polarity=0, irr=0, trigger=edge, mask=0, dest_id:1
(XEN) [m: memory info]
(XEN) Physical memory information:
(XEN)     Xen heap: 0kB free
(XEN)     heap[14]: 64480kB free
(XEN)     heap[15]: 131072kB free
(XEN)     heap[16]: 262144kB free
(XEN)     heap[17]: 524288kB free
(XEN)     DMA heap: 981984kB free
(XEN)     heap[18]: 1048576kB free
(XEN)     heap[19]: 1298816kB free
(XEN)     heap[20]: 3784600kB free
(XEN)     heap[21]: 99420kB free
(XEN)     Dom heap: 6231412kB free
(XEN) [n: NMI statistics]
(XEN) CPU	NMI
(XEN)   0	  0
(XEN)   1	  0
(XEN)   2	  0
(XEN)   3	  0
(XEN)   4	  0
(XEN)   5	  0
(XEN)   6	  0
(XEN)   7	  0
(XEN)   8	  0
(XEN)   9	  0
(XEN)  10	  0
(XEN)  11	  0
(XEN)  12	  0
(XEN)  13	  0
(XEN)  14	  0
(XEN)  15	  0
(XEN)  16	  0
(XEN)  17	  0
(XEN)  18	  0
(XEN)  19	  0
(XEN)  20	  0
(XEN)  21	  0
(XEN)  22	  0
(XEN)  23	  0
(XEN)  24	  0
(XEN)  25	  0
(XEN)  26	  0
(XEN)  27	  0
(XEN)  28	  0
(XEN)  29	  0
(XEN)  30	  0
(XEN)  31	  0
(XEN)  32	  0
(XEN)  33	  0
(XEN)  34	  0
(XEN)  35	  0
(XEN)  36	  0
(XEN)  37	  0
(XEN)  38	  0
(XEN)  39	  0
(XEN)  40	  0
(XEN)  41	  0
(XEN)  42	  0
(XEN)  43	  0
(XEN)  44	  0
(XEN)  45	  0
(XEN)  46	  0
(XEN)  47	  0
(XEN)  48	  0
(XEN)  49	  0
(XEN)  50	  0
(XEN)  51	  0
(XEN)  52	  0
(XEN)  53	  0
(XEN)  54	  0
(XEN)  55	  0
(XEN)  56	  0
(XEN)  57	  0
(XEN)  58	  0
(XEN)  59	  0
(XEN)  60	  0
(XEN)  61	  0
(XEN)  62	  0
(XEN)  63	  0
(XEN)  64	  0
(XEN)  65	  0
(XEN)  66	  0
(XEN)  67	  0
(XEN)  68	  0
(XEN)  69	  0
(XEN)  70	  0
(XEN)  71	  0
(XEN)  72	  0
(XEN)  73	  0
(XEN)  74	  0
(XEN)  75	  0
(XEN)  76	  0
(XEN)  77	  0
(XEN)  78	  0
(XEN)  79	  0
(XEN)  80	  0
(XEN)  81	  0
(XEN)  82	  0
(XEN)  83	  0
(XEN)  84	  0
(XEN)  85	  0
(XEN)  86	  0
(XEN)  87	  0
(XEN)  88	  0
(XEN)  89	  0
(XEN)  90	  0
(XEN)  91	  0
(XEN)  92	  0
(XEN)  93	  0
(XEN)  94	  0
(XEN)  95	  0
(XEN)  96	  0
(XEN)  97	  0
(XEN)  98	  0
(XEN)  99	  0
(XEN) 100	  0
(XEN) 101	  0
(XEN) 102	  0
(XEN) 103	  0
(XEN) 104	  0
(XEN) 105	  0
(XEN) 106	  0
(XEN) 107	  0
(XEN) 108	  0
(XEN) 109	  0
(XEN) 110	  0
(XEN) 111	  0
(XEN) 112	  0
(XEN) 113	  0
(XEN) 114	  0
(XEN) 115	  0
(XEN) 116	  0
(XEN) 117	  0
(XEN) 118	  0
(XEN) 119	  0
(XEN) 120	  0
(XEN) 121	  0
(XEN) 122	  0
(XEN) 123	  0
(XEN) 124	  0
(XEN) 125	  0
(XEN) 126	  0
(XEN) 127	  0
(XEN) dom0 vcpu0: NMI neither pending nor masked
(XEN) [q: dump domain (and guest debug) info]
(XEN) 'q' pressed -> dumping domain info (now=0x59:4A190F8F)
(XEN) General information for domain 0:
(XEN)     refcnt=3 dying=0 nr_pages=262144 xenheap_pages=5 dirty_cpus={7} max_pages=4294967295
(XEN)     handle=00000000-0000-0000-0000-000000000000 vm_assist=0000000d
(XEN) Rangesets belonging to domain 0:
(XEN)     I/O Ports  { 0-1f, 22-3f, 44-60, 62-9f, a2-2f7, 300-807, 80c-cfb, d00-ffff }
(XEN)     Interrupts { 0-310 }
(XEN)     I/O Memory { 0-febff, fec01-fec7f, fec81-fedff, fee01-ffffffffffffffff }
(XEN) Memory pages belonging to domain 0:
(XEN)     DomPage list too long to display
(XEN)     XenPage 000000000022fcac: caf=c000000000000002, taf=7400000000000002
(XEN)     XenPage 000000000022fcab: caf=c000000000000001, taf=7400000000000001
(XEN)     XenPage 000000000022fcaa: caf=c000000000000001, taf=7400000000000001
(XEN)     XenPage 000000000022fca9: caf=c000000000000001, taf=7400000000000001
(XEN)     XenPage 00000000000cf2fe: caf=c000000000000002, taf=7400000000000002
(XEN) VCPU information and callbacks for domain 0:
(XEN)     VCPU0: CPU0 [has=F] flags=2 poll=0 upcall_pend = 01, upcall_mask = 01 dirty_cpus={} cpu_affinity={0-127}
(XEN)     No periodic timer
(XEN)     VCPU1: CPU6 [has=F] flags=2 poll=0 upcall_pend = 01, upcall_mask = 01 dirty_cpus={} cpu_affinity={0-127}
(XEN)     No periodic timer
(XEN)     VCPU2: CPU1 [has=F] flags=2 poll=0 upcall_pend = 01, upcall_mask = 01 dirty_cpus={} cpu_affinity={0-127}
(XEN)     No periodic timer
(XEN)     VCPU3: CPU3 [has=F] flags=2 poll=0 upcall_pend = 01, upcall_mask = 01 dirty_cpus={} cpu_affinity={0-127}
(XEN)     No periodic timer
(XEN)     VCPU4: CPU4 [has=F] flags=2 poll=0 upcall_pend = 01, upcall_mask = 01 dirty_cpus={} cpu_affinity={0-127}
(XEN)     No periodic timer
(XEN)     VCPU5: CPU5 [has=F] flags=2 poll=0 upcall_pend = 01, upcall_mask = 01 dirty_cpus={} cpu_affinity={0-127}
(XEN)     No periodic timer
(XEN)     VCPU6: CPU2 [has=F] flags=2 poll=0 upcall_pend = 01, upcall_mask = 01 dirty_cpus={} cpu_affinity={0-127}
(XEN)     No periodic timer
(XEN)     VCPU7: CPU7 [has=T] flags=0 poll=0 upcall_pend = 01, upcall_mask = 00 dirty_cpus={7} cpu_affinity={0-127}
(XEN)     No periodic timer
(XEN) Notifying guest 0:0 (virq 1, port 4, stat 0/0/-1)
(XEN) Notifying guest 0:1 (virq 1, port 9, stat 0/0/-1)
(XEN) Notifying guest 0:2 (virq 1, port 14, stat 0/0/-1)
(XEN) Notifying guest 0:3 (virq 1, port 19, stat 0/0/-1)
(XEN) Notifying guest 0:4 (virq 1, port 24, stat 0/0/-1)
(XEN) Notifying guest 0:5 (virq 1, port 29, stat 0/0/-1)
(XEN) Notifying guest 0:6 (virq 1, port 34, stat 0/0/-1)
(XEN) Notifying guest 0:7 (virq 1, port 39, stat 0/0/-1)
(XEN) [r: dump run queues]
(XEN) Scheduler: SMP Credit Scheduler (credit)
(XEN) info:
(XEN) 	ncpus              = 8
(XEN) 	master             = 0
(XEN) 	credit             = 2400
(XEN) 	credit balance     = 0
(XEN) 	weight             = 0
(XEN) 	runq_sort          = 12534
(XEN) 	default-weight     = 256
(XEN) 	msecs per tick     = 10ms
(XEN) 	credits per msec   = 10
(XEN) 	ticks per tslice   = 3
(XEN) 	ticks per acct     = 3
(XEN) 	migration delay    = 0us
(XEN) idlers: 00000000,00000000,00000000,0000007f
(XEN) active vcpus:
(XEN) sched_smt_power_savings: disabled
(XEN) NOW=0x000000596632E7A3
(XEN) CPU[00]  sort=12534, sibling=00000000,00000000,00000000,00000001, core=00000000,00000000,00000000,00000055
(XEN) 	run: [32767.0] pri=-64 flags=0 cpu=0
(XEN) CPU[01]  sort=12534, sibling=00000000,00000000,00000000,00000002, core=00000000,00000000,00000000,000000aa
(XEN) 	run: [32767.1] pri=-64 flags=0 cpu=1
(XEN) CPU[02]  sort=12534, sibling=00000000,00000000,00000000,00000004, core=00000000,00000000,00000000,00000055
(XEN) 	run: [32767.2] pri=-64 flags=0 cpu=2
(XEN) CPU[03]  sort=12534, sibling=00000000,00000000,00000000,00000008, core=00000000,00000000,00000000,000000aa
(XEN) 	run: [32767.3] pri=-64 flags=0 cpu=3
(XEN) CPU[04]  sort=12534, sibling=00000000,00000000,00000000,00000010, core=00000000,00000000,00000000,00000055
(XEN) 	run: [32767.4] pri=-64 flags=0 cpu=4
(XEN) CPU[05]  sort=12534, sibling=00000000,00000000,00000000,00000020, core=00000000,00000000,00000000,000000aa
(XEN) 	run: [32767.5] pri=-64 flags=0 cpu=5
(XEN) CPU[06]  sort=12534, sibling=00000000,00000000,00000000,00000040, core=00000000,00000000,00000000,00000055
(XEN) 	run: [32767.6] pri=-64 flags=0 cpu=6
(XEN) CPU[07]  sort=12531, sibling=00000000,00000000,00000000,00000080, core=00000000,00000000,00000000,000000aa
(XEN) 	run: [0.7] pri=-1 flags=0 cpu=7 credit=0 [w=256]
(XEN) 	  1: [32767.7] pri=-64 flags=0 cpu=7
(XEN) [s: dump softtsc stats]
(XEN) TSC marked as reliable, warp = 0 (count=2)
(XEN) No domains have emulated TSC
(XEN) [t: display multi-cpu clock info]
(XEN) Synced stime skew: max=132428ns avg=132428ns samples=1 current=132428ns
(XEN) Synced cycles skew: max=723 avg=723 samples=1 current=723
(XEN) [u: dump numa info]
(XEN) 'u' pressed -> dumping numa info (now-0x59:7E5C3BC2)
(XEN) idx0 -> NODE0 start->1245184 size->1048576
(XEN) phys_to_nid(0000000130001000) -> 0 should be 0
(XEN) idx1 -> NODE1 start->0 size->1245184
(XEN) phys_to_nid(0000000000001000) -> 1 should be 1
(XEN) CPU0 -> NODE0
(XEN) CPU1 -> NODE1
(XEN) CPU2 -> NODE0
(XEN) CPU3 -> NODE1
(XEN) CPU4 -> NODE0
(XEN) CPU5 -> NODE1
(XEN) CPU6 -> NODE0
(XEN) CPU7 -> NODE1
(XEN) Memory location of each domain:
(XEN) Domain 0 (total: 262144):
(XEN)     Node 0: 245752
(XEN)     Node 1: 16392
(XEN) [v: dump Intel's VMCS]
(XEN) *********** VMCS Areas **************
(XEN) **************************************
(XEN) [z: print ioapic info]
(XEN) number of MP IRQ sources: 15.
(XEN) number of IO-APIC #0 registers: 24.
(XEN) number of IO-APIC #1 registers: 24.
(XEN) testing the IO APIC.......................
(XEN) IO APIC #0......
(XEN) .... register #00: 00000000
(XEN) .......    : physical APIC id: 00
(XEN) .......    : Delivery Type: 0
(XEN) .......    : LTS          : 0
(XEN) .... register #01: 00170020
(XEN) .......     : max redirection entries: 0017
(XEN) .......     : PRQ implemented: 0
(XEN) .......     : IO APIC version: 0020
(XEN) .... IRQ redirection table:
(XEN)  NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
(XEN)  00 000 00  1    0    0   0   0    0    0    00
(XEN)  01 001 01  0    0    0   0   0    1    1    30
(XEN)  02 0FF 0F  0    0    0   0   0    1    1    F0
(XEN)  03 0FF 0F  0    0    0   0   0    1    1    F2
(XEN)  04 0FF 0F  1    0    0   0   0    1    1    38
(XEN)  05 001 01  0    0    0   0   0    1    1    40
(XEN)  06 001 01  0    0    0   0   0    1    1    48
(XEN)  07 001 01  0    0    0   0   0    1    1    50
(XEN)  08 0FF 0F  1    0    0   0   0    1    1    58
(XEN)  09 001 01  0    1    0   0   0    1    1    60
(XEN)  0a 001 01  0    0    0   0   0    1    1    68
(XEN)  0b 001 01  0    0    0   0   0    1    1    70
(XEN)  0c 001 01  0    0    0   0   0    1    1    78
(XEN)  0d 0FF 0F  1    0    0   0   0    1    1    88
(XEN)  0e 001 01  0    0    0   0   0    1    1    90
(XEN)  0f 001 01  0    0    0   0   0    1    1    98
(XEN)  10 000 00  1    0    0   0   0    0    0    00
(XEN)  11 000 00  1    0    0   0   0    0    0    00
(XEN)  12 000 00  1    0    0   0   0    0    0    00
(XEN)  13 000 00  1    0    0   0   0    0    0    00
(XEN)  14 000 00  1    0    0   0   0    0    0    00
(XEN)  15 000 00  1    0    0   0   0    0    0    00
(XEN)  16 000 00  1    0    0   0   0    0    0    00
(XEN)  17 000 00  1    0    0   0   0    0    0    00
(XEN) IO APIC #1......
(XEN) .... register #00: 00000000
(XEN) .......    : physical APIC id: 00
(XEN) .......    : Delivery Type: 0
(XEN) .......    : LTS          : 0
(XEN) .... register #01: 00170020
(XEN) .......     : max redirection entries: 0017
(XEN) .......     : PRQ implemented: 0
(XEN) .......     : IO APIC version: 0020
(XEN) .... register #02: 00000000
(XEN) .......     : arbitration: 00
(XEN) .... register #03: 00000001
(XEN) .......     : Boot DT    : 1
(XEN) .... IRQ redirection table:
(XEN)  NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
(XEN)  00 000 00  1    0    0   0   0    0    0    00
(XEN)  01 000 00  1    0    0   0   0    0    0    00
(XEN)  02 000 00  1    0    0   0   0    0    0    00
(XEN)  03 000 00  1    0    0   0   0    0    0    00
(XEN)  04 000 00  1    0    0   0   0    0    0    00
(XEN)  05 000 00  1    0    0   0   0    0    0    00
(XEN)  06 000 00  1    0    0   0   0    0    0    00
(XEN)  07 000 00  1    0    0   0   0    0    0    00
(XEN)  08 000 00  1    0    0   0   0    0    0    00
(XEN)  09 000 00  1    0    0   0   0    0    0    00
(XEN)  0a 000 00  1    0    0   0   0    0    0    00
(XEN)  0b 000 00  1    0    0   0   0    0    0    00
(XEN)  0c 000 00  1    0    0   0   0    0    0    00
(XEN)  0d 000 00  1    0    0   0   0    0    0    00
(XEN)  0e 000 00  1    0    0   0   0    0    0    00
(XEN)  0f 000 00  1    0    0   0   0    0    0    00
(XEN)  10 000 00  1    0    0   0   0    0    0    00
(XEN)  11 000 00  1    0    0   0   0    0    0    00
(XEN)  12 000 00  1    0    0   0   0    0    0    00
(XEN)  13 000 00  1    0    0   0   0    0    0    00
(XEN)  14 000 00  1    0    0   0   0    0    0    00
(XEN)  15 000 00  1    0    0   0   0    0    0    00
(XEN)  16 000 00  1    0    0   0   0    0    0    00
(XEN)  17 000 00  1    0    0   0   0    0    0    00
(XEN) Using vector-based indexing
(XEN) IRQ to pin mappings:
(XEN) IRQ240 -> 0:2
(XEN) IRQ48 -> 0:1
(XEN) IRQ242 -> 0:3
(XEN) IRQ56 -> 0:4
(XEN) IRQ64 -> 0:5
(XEN) IRQ72 -> 0:6
(XEN) IRQ80 -> 0:7
(XEN) IRQ88 -> 0:8
(XEN) IRQ96 -> 0:9
(XEN) IRQ104 -> 0:10
(XEN) IRQ112 -> 0:11
(XEN) IRQ120 -> 0:12
(XEN) IRQ136 -> 0:13
(XEN) IRQ144 -> 0:14
(XEN) IRQ152 -> 0:15
(XEN) .................................... done.
[  385.234716] (XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
~. [terminated ipmitool]

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Bug#603632: [Xen-devel] PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-11-23 22:18       ` Ian Campbell
@ 2010-12-02 23:47         ` Vincent Caron
  2010-12-03  0:12           ` Jeremy Fitzhardinge
  2010-12-03  8:51           ` PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410)) Ian Campbell
  0 siblings, 2 replies; 23+ messages in thread
From: Vincent Caron @ 2010-12-02 23:47 UTC (permalink / raw)
  To: Ian Campbell
  Cc: Vincent CARON, Cris Daniluk, xen-devel, Keir Fraser,
	Jeremy Fitzhardinge, 603632

[-- Attachment #1: Type: text/plain, Size: 1325 bytes --]

On Tue, 2010-11-23 at 22:18 +0000, Ian Campbell wrote:
> On Tue, 2010-11-23 at 22:12 +0000, Ian Campbell wrote: 
> > On Tue, 2010-11-23 at 18:52 +0000, Ian Campbell wrote: 
> > > On Tue, 2010-11-23 at 11:51 +0000, Ian Campbell wrote:
> > > > 
> > > > Perhaps we should be passing numa_node_id() (e.g. current node)
> > > > instead of node 0? 
> > > 
> > > I've just kicked off a build of the 2.6.32-27 Debian kernel with the
> > > following additional patch, I will hopefully post the binaries tomorrow.
> > 
> > Build was quicker than I thought... Vincent, Cris if you get a chance
> > please can you test the kernel from:
> > http://xenbits.xen.org/people/ianc/2.6.32-27+numa1/
> 
> Also, please can you try adding "numa=noacpi" to your kernel command
> line when running with the standard Debian kernel (not the one above).
> 
> Thanks!

  It just happens that your kernel above (2.6.32-27+numa1) boots fine
under hypervisor _when_ passed 'numa=noacpi'. Yeah !

  I then tried again with Debian Squeeze's latest 2.6.32-28, which
crashes as -27 under hypervisor (and changelog show no xen or
numa-related thingies). Then I added 'numa=noacpi', and it boots fine
too. I got my 8 cores, networking, etc.

  Enclosed is the dmesg for the latter, Debian, kernel.

  Is the 'numa=noacpi' a "production acceptable" workaround ?


[-- Attachment #2: dell-r410-debian-2.6.32-28-numa-noacpi.txt --]
[-- Type: text/plain, Size: 54917 bytes --]

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 2.6.32-5-xen-amd64 (Debian 2.6.32-28) (ben@decadent.org.uk) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 SMP Thu Nov 25 20:08:32 UTC 2010
[    0.000000] Command line: root=/dev/sda1 console=hvc0 nomodeset numa=noacpi
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] released 0 pages of unused memory
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  Xen: 0000000000000000 - 00000000000a0000 (usable)
[    0.000000]  Xen: 00000000000a0000 - 0000000000100000 (reserved)
[    0.000000]  Xen: 0000000000100000 - 0000000040000000 (usable)
[    0.000000]  Xen: 00000000cf679000 - 00000000cf68f000 (reserved)
[    0.000000]  Xen: 00000000cf68f000 - 00000000cf6ce000 (ACPI data)
[    0.000000]  Xen: 00000000cf6ce000 - 00000000d0000000 (reserved)
[    0.000000]  Xen: 00000000e0000000 - 00000000f0000000 (reserved)
[    0.000000]  Xen: 00000000fe000000 - 0000000100000000 (reserved)
[    0.000000] DMI 2.6 present.
[    0.000000] last_pfn = 0x40000 max_arch_pfn = 0x400000000
[    0.000000] x86 PAT enabled: cpu 0, old 0x50100070406, new 0x7010600070106
[    0.000000] initial memory mapped : 0 - 20000000
[    0.000000] init_memory_mapping: 0000000000000000-0000000040000000
[    0.000000]  0000000000 - 0040000000 page 4k
[    0.000000] kernel direct mapping tables up to 40000000 @ 100000-302000
[    0.000000] RAMDISK: 016b5000 - 03266600
[    0.000000] ACPI: RSDP 00000000000f09e0 00024 (v02 DELL  )
[    0.000000] ACPI: XSDT 00000000000f0ae4 0009C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: FACP 00000000cf6b3f9c 000F4 (v03 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: DSDT 00000000cf68f000 03B39 (v01 DELL   PE_SC3   00000001 INTL 20050624)
[    0.000000] ACPI: FACS 00000000cf6b6000 00040
[    0.000000] ACPI: APIC 00000000cf6b3478 0015E (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SPCR 00000000cf6b35d8 00050 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: HPET 00000000cf6b362c 00038 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: XMAR 00000000cf6b3668 001B0 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: MCFG 00000000cf6b38c4 0003C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: WD__ 00000000cf6b3904 00134 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SLIC 00000000cf6b3a3c 00024 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: ERST 00000000cf692cbc 00270 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: HEST 00000000cf692f2c 003A8 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: BERT 00000000cf692b3c 00030 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: EINJ 00000000cf692b6c 00150 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SRAT 00000000cf6b3bc0 00370 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: TCPA 00000000cf6b3f34 00064 (v02 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SSDT 00000000cf6b7000 02104 (v01  INTEL PPM RCM  80000001 INTL 20061109)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at 0000000000000000-0000000040000000
[    0.000000] Bootmem setup node 0 0000000000000000-0000000040000000
[    0.000000]   NODE_DATA [0000000000008000 - 000000000000ffff]
[    0.000000]   bootmap [0000000000010000 -  0000000000017fff] pages 8
[    0.000000] (8 early reservations) ==> bootmem [0000000000 - 0040000000]
[    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
[    0.000000]   #1 [0003468000 - 0003487000]   XEN PAGETABLES ==> [0003468000 - 0003487000]
[    0.000000]   #2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
[    0.000000]   #3 [0001000000 - 0001694994]    TEXT DATA BSS ==> [0001000000 - 0001694994]
[    0.000000]   #4 [00016b5000 - 0003266600]          RAMDISK ==> [00016b5000 - 0003266600]
[    0.000000]   #5 [0003267000 - 0003468000]   XEN START INFO ==> [0003267000 - 0003468000]
[    0.000000]   #6 [0001695000 - 000169532d]              BRK ==> [0001695000 - 000169532d]
[    0.000000]   #7 [0000100000 - 00002e0000]          PGTABLE ==> [0000100000 - 00002e0000]
[    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000000 -> 0x00001000
[    0.000000]   DMA32    0x00001000 -> 0x00100000
[    0.000000]   Normal   0x00100000 -> 0x00100000
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[2] active PFN ranges
[    0.000000]     0: 0x00000000 -> 0x000000a0
[    0.000000]     0: 0x00000100 -> 0x00040000
[    0.000000] On node 0 totalpages: 262048
[    0.000000]   DMA zone: 56 pages used for memmap
[    0.000000]   DMA zone: 483 pages reserved
[    0.000000]   DMA zone: 3461 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 3528 pages used for memmap
[    0.000000]   DMA32 zone: 254520 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x808
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x28] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x29] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x2a] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x2b] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2c] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2d] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x2f] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 0, address 0xfec00000, GSI 0-0
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32])
[    0.000000] IOAPIC[1]: apic_id 1, version 0, address 0xfec80000, GSI 32-32
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ERROR: Unable to locate IOAPIC for GSI 2
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ERROR: Unable to locate IOAPIC for GSI 9
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[    0.000000] SMP: Allowing 8 CPUs, 0 hotplug CPUs
[    0.000000] nr_irqs_gsi: 288
[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
[    0.000000] Allocating PCI resources starting at 40000000 (gap: 40000000:8f679000)
[    0.000000] Booting paravirtualized kernel on Xen
[    0.000000] Xen version: 4.0.1 (preserve-AD) (dom0)
[    0.000000] NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:8 nr_node_ids:1
[    0.000000] PERCPU: Embedded 30 pages/cpu @ffff8800034bd000 s90328 r8192 d24360 u122880
[    0.000000] pcpu-alloc: s90328 r8192 d24360 u122880 alloc=30*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 [0] 4 [0] 5 [0] 6 [0] 7 
[    3.277684] trying to map vcpu_info 0 at ffff8800034c8020, mfn 2274c8, offset 32
[    3.277688] cpu 0 using vcpu_info at ffff8800034c8020
[    3.277690] trying to map vcpu_info 1 at ffff8800034e6020, mfn 2274e6, offset 32
[    3.277692] cpu 1 using vcpu_info at ffff8800034e6020
[    3.277694] trying to map vcpu_info 2 at ffff880003504020, mfn 227504, offset 32
[    3.277697] cpu 2 using vcpu_info at ffff880003504020
[    3.277699] trying to map vcpu_info 3 at ffff880003522020, mfn 227522, offset 32
[    3.277702] cpu 3 using vcpu_info at ffff880003522020
[    3.277703] trying to map vcpu_info 4 at ffff880003540020, mfn 227540, offset 32
[    3.277706] cpu 4 using vcpu_info at ffff880003540020
[    3.277708] trying to map vcpu_info 5 at ffff88000355e020, mfn 22755e, offset 32
[    3.277711] cpu 5 using vcpu_info at ffff88000355e020
[    3.277713] trying to map vcpu_info 6 at ffff88000357c020, mfn 22757c, offset 32
[    3.277715] cpu 6 using vcpu_info at ffff88000357c020
[    3.277717] trying to map vcpu_info 7 at ffff88000359a020, mfn 22759a, offset 32
[    3.277720] cpu 7 using vcpu_info at ffff88000359a020
[    3.277721] Xen: using vcpu_info placement
[    3.277726] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 257981
[    3.277728] Policy zone: DMA32
[    3.277731] Kernel command line: root=/dev/sda1 console=hvc0 nomodeset numa=noacpi
[    3.277762] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    3.278056] Initializing CPU#0
[    3.286519] DMA: Placing 64MB software IO TLB between ffff880004691000 - ffff880008691000
[    3.286523] DMA: software IO TLB at phys 0x4691000 - 0x8691000
[    3.286525] xen_swiotlb_fixup: buf=ffff880004691000 size=67108864
[    3.305742] xen_swiotlb_fixup: buf=ffff8800086f1000 size=32768
[    3.310070] Memory: 927388k/1048576k available (3144k kernel code, 384k absent, 120804k reserved, 1902k data, 596k init)
[    3.310107] SLUB: Genslabs=14, HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1
[    3.310141] Hierarchical RCU implementation.
[    3.310150] NR_IRQS:4352 nr_irqs:2304
[    3.310247] xen: --> irq=0
[    3.310255] xen: --> irq=1
[    3.310260] xen: --> irq=2
[    3.310266] xen: --> irq=3
[    3.310271] xen: --> irq=4
[    3.310276] xen: --> irq=5
[    3.310281] xen: --> irq=6
[    3.310286] xen: --> irq=7
[    3.310292] xen: --> irq=8
[    3.310297] xen: --> irq=9
[    3.310302] xen: --> irq=10
[    3.310307] xen: --> irq=11
[    3.310312] xen: --> irq=12
[    3.310318] xen: --> irq=13
[    3.310323] xen: --> irq=14
[    3.310328] xen: --> irq=15
[    3.310344] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    3.310347] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    3.310349] xen: sci override: source_irq=9 global_irq=9 trigger=c polarity=1
[    3.310352] xen: registering gsi 9 triggering 0 polarity 0
[    3.310354] xen_allocate_pirq: returning irq 9 for gsi 9
[    3.310355] xen: --> irq=9
[    3.310363] xen: acpi sci 9
[    3.316448] Console: colour VGA+ 80x25
[    3.316713] console [hvc0] enabled
[    3.316741] Xen: using vcpuop timer interface
[    3.316744] installing Xen timer for CPU 0
[    3.316754]   alloc irq_desc for 2303 on node 0
[    3.316758]   alloc kstat_irqs on node 0
[    3.316776] Detected 2261.056 MHz processor.
[    3.316784] Calibrating delay loop (skipped), value calculated using timer frequency.. 4522.11 BogoMIPS (lpj=9044224)
[    3.316801] Security Framework initialized
[    3.316807] SELinux:  Disabled at boot.
[    3.317002] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    3.317361] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    3.317507] Mount-cache hash table entries: 256
[    3.317638] Initializing cgroup subsys ns
[    3.317643] Initializing cgroup subsys cpuacct
[    3.317648] Initializing cgroup subsys devices
[    3.317651] Initializing cgroup subsys freezer
[    3.317655] Initializing cgroup subsys net_cls
[    3.317690] CPU: L1 I cache: 32K, L1 D cache: 32K
[    3.317694] CPU: L2 cache: 256K
[    3.317696] CPU: L3 cache: 8192K
[    3.317701] CPU 0/0x0 -> Node 0
[    3.317704] CPU: Unsupported number of siblings 16
[    3.317709] mce: CPU supports 9 MCE banks
[    3.317733] Performance Events: unsupported p6 CPU model 26 no PMU driver, software events only.
[    3.317749] SMP alternatives: switching to UP code
[    3.341788] ACPI: Core revision 20090903
[    3.347689]   alloc irq_desc for 2302 on node 0
[    3.347691]   alloc kstat_irqs on node 0
[    3.347697]   alloc irq_desc for 2301 on node 0
[    3.347699]   alloc kstat_irqs on node 0
[    3.347703]   alloc irq_desc for 2300 on node 0
[    3.347705]   alloc kstat_irqs on node 0
[    3.347708]   alloc irq_desc for 2299 on node 0
[    3.347710]   alloc kstat_irqs on node 0
[    3.347875] installing Xen timer for CPU 1
[    3.347880]   alloc irq_desc for 2298 on node 0
[    3.347882]   alloc kstat_irqs on node 0
[    3.347906] SMP alternatives: switching to SMP code
[    3.371035]   alloc irq_desc for 2297 on node 0
[    3.371037]   alloc kstat_irqs on node 0
[    3.371049]   alloc irq_desc for 2296 on node 0
[    3.371051]   alloc kstat_irqs on node 0
[    3.371055]   alloc irq_desc for 2295 on node 0
[    3.371057]   alloc kstat_irqs on node 0
[    3.371061]   alloc irq_desc for 2294 on node 0
[    3.371063]   alloc kstat_irqs on node 0
[    3.371081] Initializing CPU#1
[    3.371144] CPU: L1 I cache: 32K, L1 D cache: 32K
[    3.371148] CPU: L2 cache: 256K
[    3.371150] CPU: L3 cache: 8192K
[    3.371155] CPU 1/0x0 -> Node 0
[    3.371158] CPU: Unsupported number of siblings 16
[    3.371284] installing Xen timer for CPU 2
[    3.371296]   alloc irq_desc for 2293 on node 0
[    3.371298]   alloc kstat_irqs on node 0
[    3.371321]   alloc irq_desc for 2292 on node 0
[    3.371323]   alloc kstat_irqs on node 0
[    3.371328]   alloc irq_desc for 2291 on node 0
[    3.371329]   alloc kstat_irqs on node 0
[    3.371334]   alloc irq_desc for 2290 on node 0
[    3.371335]   alloc kstat_irqs on node 0
[    3.371339]   alloc irq_desc for 2289 on node 0
[    3.371341]   alloc kstat_irqs on node 0
[    3.371351] Initializing CPU#2
[    3.371387] CPU: L1 I cache: 32K, L1 D cache: 32K
[    3.371390] CPU: L2 cache: 256K
[    3.371391] CPU: L3 cache: 8192K
[    3.371394] CPU 2/0x0 -> Node 0
[    3.371396] CPU: Unsupported number of siblings 16
[    3.371498] installing Xen timer for CPU 3
[    3.371509]   alloc irq_desc for 2288 on node 0
[    3.371511]   alloc kstat_irqs on node 0
[    3.371532]   alloc irq_desc for 2287 on node 0
[    3.371534]   alloc kstat_irqs on node 0
[    3.371538]   alloc irq_desc for 2286 on node 0
[    3.371540]   alloc kstat_irqs on node 0
[    3.371544]   alloc irq_desc for 2285 on node 0
[    3.371546]   alloc kstat_irqs on node 0
[    3.371550]   alloc irq_desc for 2284 on node 0
[    3.371552]   alloc kstat_irqs on node 0
[    3.371564] Initializing CPU#3
[    3.371614] CPU: L1 I cache: 32K, L1 D cache: 32K
[    3.371617] CPU: L2 cache: 256K
[    3.371619] CPU: L3 cache: 8192K
[    3.371624] CPU 3/0x0 -> Node 0
[    3.371627] CPU: Unsupported number of siblings 16
[    3.371733] installing Xen timer for CPU 4
[    3.371745]   alloc irq_desc for 2283 on node 0
[    3.371747]   alloc kstat_irqs on node 0
[    3.371767]   alloc irq_desc for 2282 on node 0
[    3.371769]   alloc kstat_irqs on node 0
[    3.371774]   alloc irq_desc for 2281 on node 0
[    3.371776]   alloc kstat_irqs on node 0
[    3.371780]   alloc irq_desc for 2280 on node 0
[    3.371782]   alloc kstat_irqs on node 0
[    3.371786]   alloc irq_desc for 2279 on node 0
[    3.371789]   alloc kstat_irqs on node 0
[    3.371799] Initializing CPU#4
[    3.371833] CPU: L1 I cache: 32K, L1 D cache: 32K
[    3.371835] CPU: L2 cache: 256K
[    3.371837] CPU: L3 cache: 8192K
[    3.371840] CPU 4/0x0 -> Node 0
[    3.371842] CPU: Unsupported number of siblings 16
[    3.371939] installing Xen timer for CPU 5
[    3.371951]   alloc irq_desc for 2278 on node 0
[    3.371953]   alloc kstat_irqs on node 0
[    3.371973]   alloc irq_desc for 2277 on node 0
[    3.371975]   alloc kstat_irqs on node 0
[    3.371980]   alloc irq_desc for 2276 on node 0
[    3.371981]   alloc kstat_irqs on node 0
[    3.371986]   alloc irq_desc for 2275 on node 0
[    3.371988]   alloc kstat_irqs on node 0
[    3.371991]   alloc irq_desc for 2274 on node 0
[    3.371993]   alloc kstat_irqs on node 0
[    3.372006] Initializing CPU#5
[    3.372056] CPU: L1 I cache: 32K, L1 D cache: 32K
[    3.372059] CPU: L2 cache: 256K
[    3.372061] CPU: L3 cache: 8192K
[    3.372066] CPU 5/0x0 -> Node 0
[    3.372069] CPU: Unsupported number of siblings 16
[    3.372171] installing Xen timer for CPU 6
[    3.372186]   alloc irq_desc for 2273 on node 0
[    3.372188]   alloc kstat_irqs on node 0
[    3.372209]   alloc irq_desc for 2272 on node 0
[    3.372211]   alloc kstat_irqs on node 0
[    3.372216]   alloc irq_desc for 2271 on node 0
[    3.372217]   alloc kstat_irqs on node 0
[    3.372224]   alloc irq_desc for 2270 on node 0
[    3.372226]   alloc kstat_irqs on node 0
[    3.372230]   alloc irq_desc for 2269 on node 0
[    3.372232]   alloc kstat_irqs on node 0
[    3.372242] Initializing CPU#6
[    3.372276] CPU: L1 I cache: 32K, L1 D cache: 32K
[    3.372278] CPU: L2 cache: 256K
[    3.372279] CPU: L3 cache: 8192K
[    3.372282] CPU 6/0x0 -> Node 0
[    3.372284] CPU: Unsupported number of siblings 16
[    3.372383] installing Xen timer for CPU 7
[    3.372394]   alloc irq_desc for 2268 on node 0
[    3.372396]   alloc kstat_irqs on node 0
[    3.372416]   alloc irq_desc for 2267 on node 0
[    3.372418]   alloc kstat_irqs on node 0
[    3.372423]   alloc irq_desc for 2266 on node 0
[    3.372425]   alloc kstat_irqs on node 0
[    3.372429]   alloc irq_desc for 2265 on node 0
[    3.372431]   alloc kstat_irqs on node 0
[    3.372435]   alloc irq_desc for 2264 on node 0
[    3.372440]   alloc kstat_irqs on node 0
[    3.372453] Initializing CPU#7
[    3.372502] CPU: L1 I cache: 32K, L1 D cache: 32K
[    3.372506] CPU: L2 cache: 256K
[    3.372508] CPU: L3 cache: 8192K
[    3.372512] CPU 7/0x0 -> Node 0
[    3.372515] CPU: Unsupported number of siblings 16
[    3.372565] Brought up 8 CPUs
[    3.372608] CPU0 attaching sched-domain:
[    3.372611]  domain 0: span 0-7 level CPU
[    3.372614]   groups: 0 1 2 3 4 5 6 7
[    3.372625] CPU1 attaching sched-domain:
[    3.372627]  domain 0: span 0-7 level CPU
[    3.372629]   groups: 1 2 3 4 5 6 7 0
[    3.372639] CPU2 attaching sched-domain:
[    3.372641]  domain 0: span 0-7 level CPU
[    3.372643]   groups: 2 3 4 5 6 7 0 1
[    3.372653] CPU3 attaching sched-domain:
[    3.372655]  domain 0: span 0-7 level CPU
[    3.372658]   groups: 3 4 5 6 7 0 1 2
[    3.372668] CPU4 attaching sched-domain:
[    3.372670]  domain 0: span 0-7 level CPU
[    3.372672]   groups: 4 5 6 7 0 1 2 3
[    3.372682] CPU5 attaching sched-domain:
[    3.372684]  domain 0: span 0-7 level CPU
[    3.372686]   groups: 5 6 7 0 1 2 3 4
[    3.372696] CPU6 attaching sched-domain:
[    3.372698]  domain 0: span 0-7 level CPU
[    3.372700]   groups: 6 7 0 1 2 3 4 5
[    3.372710] CPU7 attaching sched-domain:
[    3.372712]  domain 0: span 0-7 level CPU
[    3.372715]   groups: 7 0 1 2 3 4 5 6
[    3.373258] devtmpfs: initialized
[    3.376237] Grant table initialized
[    3.376241] regulator: core version 0.5
[    3.376292] NET: Registered protocol family 16
[    3.376342]   alloc irq_desc for 2263 on node 0
[    3.376344]   alloc kstat_irqs on node 0
[    3.376488] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    3.376494] ACPI: bus type pci registered
[    3.376569] PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
[    3.376574] PCI: MCFG area at e0000000 reserved in E820
[    3.415823] PCI: Using MMCONFIG at e0000000 - efffffff
[    3.415827] PCI: Using configuration type 1 for base access
[    3.416629] bio: create slab <bio-0> at 0
[    3.417649] ERROR: Unable to locate IOAPIC for GSI 9
[    3.417676] ACPI: EC: Look up EC in DSDT
[    3.421102] ACPI: BIOS _OSI(Linux) query ignored
[    3.421295] ACPI: Interpreter enabled
[    3.421299] ACPI: (supports S0 S4 S5)
[    3.421321] ACPI: Using IOAPIC for interrupt routing
[    3.426909] ACPI: No dock devices found.
[    3.427463] ACPI: PCI Root Bridge [PCI0] (0000:00)
[    3.427603] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    3.427610] pci 0000:00:00.0: PME# disabled
[    3.427746] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    3.427753] pci 0000:00:01.0: PME# disabled
[    3.427889] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    3.427896] pci 0000:00:03.0: PME# disabled
[    3.428036] pci 0000:00:07.0: PME# supported from D0 D3hot D3cold
[    3.428043] pci 0000:00:07.0: PME# disabled
[    3.428456] pci 0000:00:1a.0: reg 20 io port: [0xec40-0xec5f]
[    3.428579] pci 0000:00:1a.1: reg 20 io port: [0xec60-0xec7f]
[    3.428726] pci 0000:00:1a.7: reg 10 32bit mmio: [0xdf0ff800-0xdf0ffbff]
[    3.428821] pci 0000:00:1a.7: PME# supported from D0 D3hot D3cold
[    3.428829] pci 0000:00:1a.7: PME# disabled
[    3.428925] pci 0000:00:1d.0: reg 20 io port: [0xec80-0xec9f]
[    3.429050] pci 0000:00:1d.1: reg 20 io port: [0xeca0-0xecbf]
[    3.429175] pci 0000:00:1d.2: reg 20 io port: [0xecc0-0xecdf]
[    3.429299] pci 0000:00:1d.3: reg 20 io port: [0xece0-0xecff]
[    3.429426] pci 0000:00:1d.7: reg 10 32bit mmio: [0xdf0ffc00-0xdf0fffff]
[    3.429521] pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
[    3.429529] pci 0000:00:1d.7: PME# disabled
[    3.429743] pci 0000:00:1f.0: quirk: region 0800-087f claimed by ICH6 ACPI/GPIO/TCO
[    3.429750] pci 0000:00:1f.0: quirk: region 0880-08bf claimed by ICH6 GPIO
[    3.429756] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 1 PIO at 0c00 (mask 007f)
[    3.429763] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 2 PIO at 0ca0 (mask 000f)
[    3.429769] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 3 PIO at 00e0 (mask 000f)
[    3.429865] pci 0000:00:1f.2: reg 10 io port: [0xe8e0-0xe8e7]
[    3.429875] pci 0000:00:1f.2: reg 14 io port: [0xe8d0-0xe8d3]
[    3.429884] pci 0000:00:1f.2: reg 18 io port: [0xe8e8-0xe8ef]
[    3.429893] pci 0000:00:1f.2: reg 1c io port: [0xe8d4-0xe8d7]
[    3.429902] pci 0000:00:1f.2: reg 20 io port: [0xec00-0xec0f]
[    3.429912] pci 0000:00:1f.2: reg 24 io port: [0xec10-0xec1f]
[    3.430021] pci 0000:00:1f.5: reg 10 io port: [0xe8f0-0xe8f7]
[    3.430030] pci 0000:00:1f.5: reg 14 io port: [0xe8d8-0xe8db]
[    3.430040] pci 0000:00:1f.5: reg 18 io port: [0xe8f8-0xe8ff]
[    3.430049] pci 0000:00:1f.5: reg 1c io port: [0xe8dc-0xe8df]
[    3.430058] pci 0000:00:1f.5: reg 20 io port: [0xec20-0xec2f]
[    3.430067] pci 0000:00:1f.5: reg 24 io port: [0xec30-0xec3f]
[    3.430203] pci 0000:01:00.0: reg 10 64bit mmio: [0xda000000-0xdbffffff]
[    3.430299] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    3.430306] pci 0000:01:00.0: PME# disabled
[    3.430396] pci 0000:01:00.1: reg 10 64bit mmio: [0xdc000000-0xddffffff]
[    3.430492] pci 0000:01:00.1: PME# supported from D0 D3hot D3cold
[    3.430499] pci 0000:01:00.1: PME# disabled
[    3.430622] pci 0000:00:01.0: bridge 32bit mmio: [0xda000000-0xddffffff]
[    3.430744] pci 0000:03:00.0: reg 10 64bit mmio: [0xdf180000-0xdf1bffff]
[    3.430754] pci 0000:03:00.0: reg 18 io port: [0xfc00-0xfcff]
[    3.430771] pci 0000:03:00.0: reg 1c 64bit mmio: [0xdf1c0000-0xdf1fffff]
[    3.430789] pci 0000:03:00.0: reg 30 32bit mmio pref: [0xdf100000-0xdf107fff]
[    3.430843] pci 0000:03:00.0: supports D1
[    3.430875] pci 0000:03:00.0: disabling ASPM on pre-1.1 PCIe device.  You can enable it with 'pcie_aspm=force'
[    3.430926] pci 0000:00:07.0: bridge io port: [0xf000-0xffff]
[    3.430932] pci 0000:00:07.0: bridge 32bit mmio: [0xdf100000-0xdf1fffff]
[    3.431000] pci 0000:04:03.0: reg 10 32bit mmio pref: [0xd9800000-0xd9ffffff]
[    3.431011] pci 0000:04:03.0: reg 14 32bit mmio: [0xde7fc000-0xde7fffff]
[    3.431021] pci 0000:04:03.0: reg 18 32bit mmio: [0xde800000-0xdeffffff]
[    3.431056] pci 0000:04:03.0: reg 30 32bit mmio pref: [0x000000-0x00ffff]
[    3.431162] pci 0000:00:1e.0: transparent bridge
[    3.431173] pci 0000:00:1e.0: bridge 32bit mmio: [0xde000000-0xdeffffff]
[    3.431182] pci 0000:00:1e.0: bridge 64bit mmio pref: [0xd9800000-0xd9ffffff]
[    3.431216] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
[    3.432043] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX1._PRT]
[    3.432188] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX3._PRT]
[    3.432332] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX7._PRT]
[    3.432487] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.COMP._PRT]
[    3.436500] ACPI: PCI Interrupt Link [LK00] (IRQs 3 4 5 6 7 10 11 14 *15)
[    3.436646] ACPI: PCI Interrupt Link [LK01] (IRQs 3 4 5 6 7 10 11 *14 15)
[    3.436793] ACPI: PCI Interrupt Link [LK02] (IRQs 3 4 5 6 7 10 *11 14 15)
[    3.436943] ACPI: PCI Interrupt Link [LK03] (IRQs 3 4 5 6 7 *10 11 14 15)
[    3.437086] ACPI: PCI Interrupt Link [LK04] (IRQs 3 4 *5 6 7 10 11 14 15)
[    3.437228] ACPI: PCI Interrupt Link [LK05] (IRQs 3 4 5 *6 7 10 11 14 15)
[    3.437370] ACPI: PCI Interrupt Link [LK06] (IRQs 3 4 5 6 7 10 *11 14 15)
[    3.437513] ACPI: PCI Interrupt Link [LK07] (IRQs 3 4 5 6 7 10 11 *14 15)
[    3.437604] sync cpu 0 get result 1 max_id 7
[    3.437613] sync cpu 1 get result 1 max_id 7
[    3.437621] sync cpu 2 get result 1 max_id 7
[    3.437631] sync cpu 3 get result 1 max_id 7
[    3.437642] sync cpu 4 get result 1 max_id 7
[    3.437650] sync cpu 5 get result 1 max_id 7
[    3.437658] sync cpu 6 get result 1 max_id 7
[    3.437666] sync cpu 7 get result 1 max_id 7
[    3.437673]   alloc irq_desc for 2262 on node 0
[    3.437675]   alloc kstat_irqs on node 0
[    3.437701] xen_balloon: Initialising balloon driver with page order 0.
[    3.437765] vgaarb: device added: PCI:0000:04:03.0,decodes=io+mem,owns=io+mem,locks=none
[    3.437770] vgaarb: loaded
[    3.437865] PCI: Using ACPI for IRQ routing
[    3.438103] Switching to clocksource xen
[    3.439852] pnp: PnP ACPI init
[    3.439868] ACPI: bus type pnp registered
[    3.440276] xen: registering gsi 13 triggering 1 polarity 0
[    3.440279] xen_allocate_pirq: returning irq 13 for gsi 13
[    3.440283] xen: --> irq=13
[    3.440443] xen: registering gsi 8 triggering 1 polarity 0
[    3.440445] xen_allocate_pirq: returning irq 8 for gsi 8
[    3.440448] xen: --> irq=8
[    3.440871] xen: registering gsi 4 triggering 1 polarity 0
[    3.440873] xen_allocate_pirq: returning irq 4 for gsi 4
[    3.440877] xen: --> irq=4
[    3.441370] xen: registering gsi 3 triggering 1 polarity 0
[    3.441373] xen_allocate_pirq: returning irq 3 for gsi 3
[    3.441376] xen: --> irq=3
[    3.441379] Already setup the GSI :3
[    3.444237] pnp: PnP ACPI: found 12 devices
[    3.444240] ACPI: ACPI bus type pnp unregistered
[    3.444255] system 00:07: ioport range 0x800-0x87f has been reserved
[    3.444260] system 00:07: ioport range 0x880-0x8ff could not be reserved
[    3.444264] system 00:07: ioport range 0x900-0x91f has been reserved
[    3.444268] system 00:07: ioport range 0x920-0x923 has been reserved
[    3.444272] system 00:07: ioport range 0x924-0x924 has been reserved
[    3.444277] system 00:07: ioport range 0xc00-0xc7f has been reserved
[    3.444281] system 00:07: ioport range 0xca0-0xca7 has been reserved
[    3.444285] system 00:07: ioport range 0xca9-0xcab has been reserved
[    3.444289] system 00:07: ioport range 0xcad-0xcaf has been reserved
[    3.444296] system 00:08: ioport range 0xca8-0xca8 has been reserved
[    3.444300] system 00:08: ioport range 0xcac-0xcac has been reserved
[    3.444307] system 00:09: iomem range 0xe0000000-0xefffffff has been reserved
[    3.444314] system 00:0b: iomem range 0xfed90000-0xfed91fff has been reserved
[    3.449075] PM-Timer failed consistency check  (0x0xffffff) - aborting.
[    3.449144] pci 0000:00:01.0: PCI bridge, secondary bus 0000:01
[    3.449148] pci 0000:00:01.0:   IO window: disabled
[    3.449156] pci 0000:00:01.0:   MEM window: 0xda000000-0xddffffff
[    3.449162] pci 0000:00:01.0:   PREFETCH window: disabled
[    3.449172] pci 0000:00:03.0: PCI bridge, secondary bus 0000:02
[    3.449176] pci 0000:00:03.0:   IO window: disabled
[    3.449183] pci 0000:00:03.0:   MEM window: disabled
[    3.449190] pci 0000:00:03.0:   PREFETCH window: disabled
[    3.449199] pci 0000:00:07.0: PCI bridge, secondary bus 0000:03
[    3.449205] pci 0000:00:07.0:   IO window: 0xf000-0xffff
[    3.449213] pci 0000:00:07.0:   MEM window: 0xdf100000-0xdf1fffff
[    3.449219] pci 0000:00:07.0:   PREFETCH window: disabled
[    3.449230] pci 0000:00:1e.0: PCI bridge, secondary bus 0000:04
[    3.449234] pci 0000:00:1e.0:   IO window: disabled
[    3.449242] pci 0000:00:1e.0:   MEM window: 0xde000000-0xdeffffff
[    3.449250] pci 0000:00:1e.0:   PREFETCH window: 0x000000d9800000-0x000000d9ffffff
[    3.449270] xen: registering gsi 53 triggering 0 polarity 1
[    3.449276]   alloc irq_desc for 53 on node 0
[    3.449278]   alloc kstat_irqs on node 0
[    3.449281] xen: --> irq=53
[    3.449288] pci 0000:00:01.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53
[    3.449296] pci 0000:00:01.0: setting latency timer to 64
[    3.449308] xen: registering gsi 53 triggering 0 polarity 1
[    3.449310] xen_allocate_pirq: returning irq 53 for gsi 53
[    3.449313] xen: --> irq=53
[    3.449315] Already setup the GSI :53
[    3.449318] pci 0000:00:03.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53
[    3.449325] pci 0000:00:03.0: setting latency timer to 64
[    3.449336] xen: registering gsi 53 triggering 0 polarity 1
[    3.449338] xen_allocate_pirq: returning irq 53 for gsi 53
[    3.449341] xen: --> irq=53
[    3.449343] Already setup the GSI :53
[    3.449346] pci 0000:00:07.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53
[    3.449353] pci 0000:00:07.0: setting latency timer to 64
[    3.449363] pci 0000:00:1e.0: setting latency timer to 64
[    3.449368] pci_bus 0000:00: resource 0 io:  [0x00-0xffff]
[    3.449370] pci_bus 0000:00: resource 1 mem: [0x000000-0xffffffffffffffff]
[    3.449373] pci_bus 0000:01: resource 1 mem: [0xda000000-0xddffffff]
[    3.449375] pci_bus 0000:03: resource 0 io:  [0xf000-0xffff]
[    3.449378] pci_bus 0000:03: resource 1 mem: [0xdf100000-0xdf1fffff]
[    3.449380] pci_bus 0000:04: resource 1 mem: [0xde000000-0xdeffffff]
[    3.449383] pci_bus 0000:04: resource 2 pref mem [0xd9800000-0xd9ffffff]
[    3.449385] pci_bus 0000:04: resource 3 io:  [0x00-0xffff]
[    3.449387] pci_bus 0000:04: resource 4 mem: [0x000000-0xffffffffffffffff]
[    3.449409] NET: Registered protocol family 2
[    3.449532] IP route cache hash table entries: 32768 (order: 6, 262144 bytes)
[    3.450067] TCP established hash table entries: 131072 (order: 9, 2097152 bytes)
[    3.450764] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.451022] TCP: Hash tables configured (established 131072 bind 65536)
[    3.451027] TCP reno registered
[    3.451112] NET: Registered protocol family 1
[    3.468368] pci 0000:04:03.0: Boot video device
[    3.468417] Unpacking initramfs...
[    3.495797] Freeing initrd memory: 28357k freed
[    3.502827] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    3.502837] DMA: Placing 64MB software IO TLB between ffff880004691000 - ffff880008691000
[    3.502843] DMA: software IO TLB at phys 0x4691000 - 0x8691000
[    3.503792] audit: initializing netlink socket (disabled)
[    3.503807] type=2000 audit(1291333438.456:1): initialized
[    3.508095] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    3.510158] VFS: Disk quotas dquot_6.5.2
[    3.510227] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    3.510333] msgmni has been set to 1866
[    3.510992] alg: No test for stdrng (krng)
[    3.511073] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[    3.511081] io scheduler noop registered
[    3.511084] io scheduler anticipatory registered
[    3.511089] io scheduler deadline registered
[    3.511128] io scheduler cfq registered (default)
[    3.511359]   alloc irq_desc for 2261 on node 0
[    3.511362]   alloc kstat_irqs on node 0
[    3.511408] pcieport 0000:00:01.0: setting latency timer to 64
[    3.511654]   alloc irq_desc for 2260 on node 0
[    3.511657]   alloc kstat_irqs on node 0
[    3.511690] pcieport 0000:00:03.0: setting latency timer to 64
[    3.511936]   alloc irq_desc for 2259 on node 0
[    3.511939]   alloc kstat_irqs on node 0
[    3.511971] pcieport 0000:00:07.0: setting latency timer to 64
[    3.512581] aer 0000:00:01.0:pcie02: service driver aer loaded
[    3.512655] aer 0000:00:03.0:pcie02: service driver aer loaded
[    3.512730] aer 0000:00:07.0:pcie02: service driver aer loaded
[    3.520683] registering netback
[    3.520755]   alloc irq_desc for 2258 on node 0
[    3.520758]   alloc kstat_irqs on node 0
[    3.522276]   alloc irq_desc for 2257 on node 0
[    3.522279]   alloc kstat_irqs on node 0
[    3.522713] hpet_acpi_add: no address or irqs in _CRS
[    3.522736] Linux agpgart interface v0.103
[    3.522783] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    3.522933] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    3.523289] 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    3.523559] input: Macintosh mouse button emulation as /devices/virtual/input/input0
[    3.523628] PNP: No PS/2 controller found. Probing ports directly.
[    3.526362] serio: i8042 KBD port at 0x60,0x64 irq 1
[    3.526375] serio: i8042 AUX port at 0x60,0x64 irq 12
[    3.526509] mice: PS/2 mouse device common for all mice
[    3.526567] rtc_cmos 00:04: RTC can wake from S4
[    3.526619] rtc_cmos 00:04: rtc core: registered rtc_cmos as rtc0
[    3.526660] rtc0: alarms up to one day, y3k, 242 bytes nvram
[    3.526677] cpuidle: using governor ladder
[    3.526681] cpuidle: using governor menu
[    3.526688] No iBFT detected.
[    3.527034] TCP cubic registered
[    3.527170] NET: Registered protocol family 10
[    3.527761] lo: Disabled Privacy Extensions
[    3.528062] Mobile IPv6
[    3.528066] NET: Registered protocol family 17
[    3.528156] PM: Resume from disk failed.
[    3.528168] registered taskstats version 1
[    3.529080] rtc_cmos 00:04: setting system clock to 2010-12-02 23:43:57 UTC (1291333437)
[    3.529114] Initalizing network drop monitor service
[    3.529205] Freeing unused kernel memory: 596k freed
[    3.529354] Write protecting the kernel read-only data: 4324k
[    3.569048] udev[127]: starting version 164
[    3.600712] Broadcom NetXtreme II Gigabit Ethernet Driver bnx2 v2.0.2 (Aug 21, 2009)
[    3.600749] xen: registering gsi 36 triggering 0 polarity 1
[    3.600768]   alloc irq_desc for 36 on node 0
[    3.600772]   alloc kstat_irqs on node 0
[    3.600778] xen: --> irq=36
[    3.600792] bnx2 0000:01:00.0: PCI INT A -> GSI 36 (level, low) -> IRQ 36
[    3.600808] bnx2 0000:01:00.0: setting latency timer to 64
[    3.601120] bnx2 0000:01:00.0: firmware: requesting bnx2/bnx2-mips-09-5.0.0.j3.fw
[    3.631027] SCSI subsystem initialized
[    3.642956] usbcore: registered new interface driver usbfs
[    3.642988] usbcore: registered new interface driver hub
[    3.643063] usbcore: registered new device driver usb
[    3.658686] libata version 3.00 loaded.
[    3.660038] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    3.660076] xen: registering gsi 19 triggering 0 polarity 1
[    3.660088]   alloc irq_desc for 19 on node 0
[    3.660091]   alloc kstat_irqs on node 0
[    3.660099] xen: --> irq=19
[    3.660110] ehci_hcd 0000:00:1a.7: PCI INT C -> GSI 19 (level, low) -> IRQ 19
[    3.660138] ehci_hcd 0000:00:1a.7: setting latency timer to 64
[    3.660144] ehci_hcd 0000:00:1a.7: EHCI Host Controller
[    3.660171] ehci_hcd 0000:00:1a.7: new USB bus registered, assigned bus number 1
[    3.660239] ehci_hcd 0000:00:1a.7: debug port 1
[    3.662315] megasas: 00.00.04.01 Thu July 24 11:41:51 PST 2008
[    3.662339] megasas: 0x1000:0x0060:0x1028:0x1f0b: bus 3:slot 0:func 0
[    3.662361] xen: registering gsi 38 triggering 0 polarity 1
[    3.662369]   alloc irq_desc for 38 on node 0
[    3.662372]   alloc kstat_irqs on node 0
[    3.662377] xen: --> irq=38
[    3.662385] megaraid_sas 0000:03:00.0: PCI INT A -> GSI 38 (level, low) -> IRQ 38
[    3.662397] megaraid_sas 0000:03:00.0: setting latency timer to 64
[    3.662490] megasas: FW now in Ready state
[    3.664149] ehci_hcd 0000:00:1a.7: cache line size of 32 is not supported
[    3.664185] ehci_hcd 0000:00:1a.7: irq 19, io mem 0xdf0ff800
[    3.667751] uhci_hcd: USB Universal Host Controller Interface driver
[    3.672800] bnx2 0000:01:00.0: firmware: requesting bnx2/bnx2-rv2p-09-5.0.0.j3.fw
[    3.679858] eth0: Broadcom NetXtreme II BCM5716 1000Base-T (C0) PCI Express found at mem da000000, IRQ 36, node addr a4:ba:db:47:2a:de
[    3.679900] xen: registering gsi 48 triggering 0 polarity 1
[    3.679912]   alloc irq_desc for 48 on node 0
[    3.679915]   alloc kstat_irqs on node 0
[    3.679920] xen: --> irq=48
[    3.679931] bnx2 0000:01:00.1: PCI INT B -> GSI 48 (level, low) -> IRQ 48
[    3.679945] bnx2 0000:01:00.1: setting latency timer to 64
[    3.679986] ehci_hcd 0000:00:1a.7: USB 2.0 started, EHCI 1.00
[    3.680023] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    3.680029] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.680034] usb usb1: Product: EHCI Host Controller
[    3.680039] usb usb1: Manufacturer: Linux 2.6.32-5-xen-amd64 ehci_hcd
[    3.680044] usb usb1: SerialNumber: 0000:00:1a.7
[    3.680132] usb usb1: configuration #1 chosen from 1 choice
[    3.680169] hub 1-0:1.0: USB hub found
[    3.680190] hub 1-0:1.0: 4 ports detected
[    3.680207] bnx2 0000:01:00.1: firmware: requesting bnx2/bnx2-mips-09-5.0.0.j3.fw
[    3.680284] ata_piix 0000:00:1f.2: version 2.13
[    3.680306] xen: registering gsi 23 triggering 0 polarity 1
[    3.680316]   alloc irq_desc for 23 on node 0
[    3.680319]   alloc kstat_irqs on node 0
[    3.680324] xen: --> irq=23
[    3.680332] ata_piix 0000:00:1f.2: PCI INT C -> GSI 23 (level, low) -> IRQ 23
[    3.680345] ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
[    3.686558] bnx2 0000:01:00.1: firmware: requesting bnx2/bnx2-rv2p-09-5.0.0.j3.fw
[    3.693761] eth1: Broadcom NetXtreme II BCM5716 1000Base-T (C0) PCI Express found at mem dc000000, IRQ 48, node addr a4:ba:db:47:2a:df
[    3.702878] scsi0 : LSI SAS based MegaRAID driver
[    3.703997] scsi 0:0:0:0: Direct-Access     SEAGATE  ST3146356SS      HS10 PQ: 0 ANSI: 5
[    3.704827] scsi 0:0:1:0: Direct-Access     SEAGATE  ST3146356SS      HS10 PQ: 0 ANSI: 5
[    3.706658] scsi 0:0:2:0: Direct-Access     SEAGATE  ST3146356SS      HS10 PQ: 0 ANSI: 5
[    3.783408] scsi 0:0:32:0: Enclosure         DP       BACKPLANE        1.07 PQ: 0 ANSI: 5
[    3.798138] scsi 0:2:0:0: Direct-Access     DELL     PERC 6/i Adapter 1.22 PQ: 0 ANSI: 5
[    3.819254] sd 0:2:0:0: [sda] 285474816 512-byte logical blocks: (146 GB/136 GiB)
[    3.819381] sd 0:2:0:0: [sda] Write Protect is off
[    3.819387] sd 0:2:0:0: [sda] Mode Sense: 1f 00 10 08
[    3.819461] sd 0:2:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
[    3.819770]  sda: sda1 sda2 sda3
[    3.831117] sd 0:2:0:0: [sda] Attached SCSI disk
[    3.838507] ata_piix 0000:00:1f.2: setting latency timer to 64
[    3.838640] scsi1 : ata_piix
[    3.838820] scsi2 : ata_piix
[    3.838893] ata1: SATA max UDMA/133 cmd 0xe8e0 ctl 0xe8d0 bmdma 0xec00 irq 23
[    3.838910] ata2: SATA max UDMA/133 cmd 0xe8e8 ctl 0xe8d4 bmdma 0xec08 irq 23
[    3.839004] xen: registering gsi 17 triggering 0 polarity 1
[    3.839017]   alloc irq_desc for 17 on node 0
[    3.839021]   alloc kstat_irqs on node 0
[    3.839026] xen: --> irq=17
[    3.839034] uhci_hcd 0000:00:1a.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
[    3.839051] uhci_hcd 0000:00:1a.0: setting latency timer to 64
[    3.839057] uhci_hcd 0000:00:1a.0: UHCI Host Controller
[    3.839075] uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 2
[    3.839135] uhci_hcd 0000:00:1a.0: irq 17, io base 0x0000ec40
[    3.839240] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001
[    3.839247] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.839253] usb usb2: Product: UHCI Host Controller
[    3.839258] usb usb2: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    3.839263] usb usb2: SerialNumber: 0000:00:1a.0
[    3.839388] usb usb2: configuration #1 chosen from 1 choice
[    3.839447] hub 2-0:1.0: USB hub found
[    3.839472] hub 2-0:1.0: 2 ports detected
[    3.839599] xen: registering gsi 21 triggering 0 polarity 1
[    3.839609]   alloc irq_desc for 21 on node 0
[    3.839612]   alloc kstat_irqs on node 0
[    3.839617] xen: --> irq=21
[    3.839626] ehci_hcd 0000:00:1d.7: PCI INT A -> GSI 21 (level, low) -> IRQ 21
[    3.839656] ehci_hcd 0000:00:1d.7: setting latency timer to 64
[    3.839662] ehci_hcd 0000:00:1d.7: EHCI Host Controller
[    3.839679] ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 3
[    3.839745] ehci_hcd 0000:00:1d.7: debug port 1
[    3.843642] ehci_hcd 0000:00:1d.7: cache line size of 32 is not supported
[    3.843668] ehci_hcd 0000:00:1d.7: irq 21, io mem 0xdf0ffc00
[    3.854464] ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00
[    3.854496] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[    3.854502] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.854508] usb usb3: Product: EHCI Host Controller
[    3.854513] usb usb3: Manufacturer: Linux 2.6.32-5-xen-amd64 ehci_hcd
[    3.854518] usb usb3: SerialNumber: 0000:00:1d.7
[    3.854608] usb usb3: configuration #1 chosen from 1 choice
[    3.854647] hub 3-0:1.0: USB hub found
[    3.854670] hub 3-0:1.0: 4 ports detected
[    3.854770] xen: registering gsi 22 triggering 0 polarity 1
[    3.854780]   alloc irq_desc for 22 on node 0
[    3.854783]   alloc kstat_irqs on node 0
[    3.854788] xen: --> irq=22
[    3.854796] ata_piix 0000:00:1f.5: PCI INT D -> GSI 22 (level, low) -> IRQ 22
[    3.854809] ata_piix 0000:00:1f.5: MAP [ P0 -- P1 -- ]
[    3.979371] ses 0:0:32:0: Attached Enclosure device
[    3.990470] usb 1-3: new high speed USB device using ehci_hcd and address 2
[    4.011016] ata_piix 0000:00:1f.5: setting latency timer to 64
[    4.011159] scsi3 : ata_piix
[    4.011274] scsi4 : ata_piix
[    4.011357] ata3: SATA max UDMA/133 cmd 0xe8f0 ctl 0xe8d8 bmdma 0xec20 irq 22
[    4.011368] ata4: SATA max UDMA/133 cmd 0xe8f8 ctl 0xe8dc bmdma 0xec28 irq 22
[    4.011413] xen: registering gsi 18 triggering 0 polarity 1
[    4.011424]   alloc irq_desc for 18 on node 0
[    4.011427]   alloc kstat_irqs on node 0
[    4.011432] xen: --> irq=18
[    4.011440] uhci_hcd 0000:00:1a.1: PCI INT B -> GSI 18 (level, low) -> IRQ 18
[    4.011457] uhci_hcd 0000:00:1a.1: setting latency timer to 64
[    4.011462] uhci_hcd 0000:00:1a.1: UHCI Host Controller
[    4.011479] uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 4
[    4.011539] uhci_hcd 0000:00:1a.1: irq 18, io base 0x0000ec60
[    4.011617] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001
[    4.011623] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    4.011629] usb usb4: Product: UHCI Host Controller
[    4.011634] usb usb4: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    4.011639] usb usb4: SerialNumber: 0000:00:1a.1
[    4.011732] usb usb4: configuration #1 chosen from 1 choice
[    4.011773] hub 4-0:1.0: USB hub found
[    4.011792] hub 4-0:1.0: 2 ports detected
[    4.011866] xen: registering gsi 21 triggering 0 polarity 1
[    4.011870] xen_allocate_pirq: returning irq 21 for gsi 21
[    4.011875] xen: --> irq=21
[    4.011878] Already setup the GSI :21
[    4.011884] uhci_hcd 0000:00:1d.0: PCI INT A -> GSI 21 (level, low) -> IRQ 21
[    4.011897] uhci_hcd 0000:00:1d.0: setting latency timer to 64
[    4.011903] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[    4.011915] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 5
[    4.011957] uhci_hcd 0000:00:1d.0: irq 21, io base 0x0000ec80
[    4.012031] usb usb5: New USB device found, idVendor=1d6b, idProduct=0001
[    4.012038] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    4.012044] usb usb5: Product: UHCI Host Controller
[    4.012048] usb usb5: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    4.012053] usb usb5: SerialNumber: 0000:00:1d.0
[    4.012136] usb usb5: configuration #1 chosen from 1 choice
[    4.012180] hub 5-0:1.0: USB hub found
[    4.012199] hub 5-0:1.0: 2 ports detected
[    4.012270] xen: registering gsi 20 triggering 0 polarity 1
[    4.012279]   alloc irq_desc for 20 on node 0
[    4.012282]   alloc kstat_irqs on node 0
[    4.012287] xen: --> irq=20
[    4.012294] uhci_hcd 0000:00:1d.1: PCI INT B -> GSI 20 (level, low) -> IRQ 20
[    4.012309] uhci_hcd 0000:00:1d.1: setting latency timer to 64
[    4.012315] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[    4.012328] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 6
[    4.012385] uhci_hcd 0000:00:1d.1: irq 20, io base 0x0000eca0
[    4.012457] usb usb6: New USB device found, idVendor=1d6b, idProduct=0001
[    4.012463] usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    4.012469] usb usb6: Product: UHCI Host Controller
[    4.012473] usb usb6: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    4.012479] usb usb6: SerialNumber: 0000:00:1d.1
[    4.012565] usb usb6: configuration #1 chosen from 1 choice
[    4.012605] hub 6-0:1.0: USB hub found
[    4.012648] hub 6-0:1.0: 2 ports detected
[    4.012721] xen: registering gsi 21 triggering 0 polarity 1
[    4.012725] xen_allocate_pirq: returning irq 21 for gsi 21
[    4.012729] xen: --> irq=21
[    4.012733] Already setup the GSI :21
[    4.012738] uhci_hcd 0000:00:1d.2: PCI INT C -> GSI 21 (level, low) -> IRQ 21
[    4.012755] uhci_hcd 0000:00:1d.2: setting latency timer to 64
[    4.012760] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[    4.012775] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 7
[    4.012818] uhci_hcd 0000:00:1d.2: irq 21, io base 0x0000ecc0
[    4.012888] usb usb7: New USB device found, idVendor=1d6b, idProduct=0001
[    4.012895] usb usb7: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    4.012900] usb usb7: Product: UHCI Host Controller
[    4.012905] usb usb7: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    4.012910] usb usb7: SerialNumber: 0000:00:1d.2
[    4.013006] usb usb7: configuration #1 chosen from 1 choice
[    4.013046] hub 7-0:1.0: USB hub found
[    4.013065] hub 7-0:1.0: 2 ports detected
[    4.013136] xen: registering gsi 20 triggering 0 polarity 1
[    4.013140] xen_allocate_pirq: returning irq 20 for gsi 20
[    4.013144] xen: --> irq=20
[    4.013148] Already setup the GSI :20
[    4.013153] uhci_hcd 0000:00:1d.3: PCI INT D -> GSI 20 (level, low) -> IRQ 20
[    4.013167] uhci_hcd 0000:00:1d.3: setting latency timer to 64
[    4.013173] uhci_hcd 0000:00:1d.3: UHCI Host Controller
[    4.013189] uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 8
[    4.013231] uhci_hcd 0000:00:1d.3: irq 20, io base 0x0000ece0
[    4.013305] usb usb8: New USB device found, idVendor=1d6b, idProduct=0001
[    4.013311] usb usb8: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    4.013317] usb usb8: Product: UHCI Host Controller
[    4.013322] usb usb8: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    4.013327] usb usb8: SerialNumber: 0000:00:1d.3
[    4.013435] usb usb8: configuration #1 chosen from 1 choice
[    4.013485] hub 8-0:1.0: USB hub found
[    4.013505] hub 8-0:1.0: 2 ports detected
[    4.122863] usb 1-3: New USB device found, idVendor=0424, idProduct=2514
[    4.122871] usb 1-3: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    4.122959] usb 1-3: configuration #1 chosen from 1 choice
[    4.123157] hub 1-3:1.0: USB hub found
[    4.123237] hub 1-3:1.0: 4 ports detected
[    4.474469] usb 5-2: new full speed USB device using uhci_hcd and address 2
[    4.486532] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    4.511743] ata3.00: ATAPI: TSSTcorp DVD+/-RW TS-L633C, D250, max UDMA/100
[    4.511764] ata3.00: applying bridge limits
[    4.542761] ata3.00: configured for UDMA/100
[    4.638049] usb 5-2: New USB device found, idVendor=0624, idProduct=0248
[    4.638056] usb 5-2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    4.638062] usb 5-2: Product: USB Composite Device-0
[    4.638067] usb 5-2: Manufacturer: Avocent
[    4.638071] usb 5-2: SerialNumber: 20080519
[    4.638158] usb 5-2: configuration #1 chosen from 1 choice
[    4.866467] ata2.00: failed to resume link (SControl 0)
[    5.038466] ata4: failed to resume link (SControl 0)
[    5.050053] ata4: SATA link down (SStatus 4 SControl 0)
[    5.186477] ata1.01: failed to resume link (SControl 0)
[    5.198088] ata1.00: SATA link down (SStatus 0 SControl 300)
[    5.198129] ata1.01: SATA link down (SStatus 0 SControl 0)
[    5.894469] ata2.01: failed to resume link (SControl 0)
[    5.906052] ata2.00: SATA link down (SStatus 0 SControl 0)
[    5.906092] ata2.01: SATA link down (SStatus 0 SControl 0)
[    5.910710] scsi 3:0:0:0: CD-ROM            TSSTcorp DVD+-RW TS-L633C D250 PQ: 0 ANSI: 5
[    5.927965] usbcore: registered new interface driver hiddev
[    5.933364] input: Avocent USB Composite Device-0 as /devices/pci0000:00/0000:00:1d.0/usb5/5-2/5-2:1.0/input/input1
[    5.933477] generic-usb 0003:0624:0248.0001: input,hidraw0: USB HID v1.00 Keyboard [Avocent USB Composite Device-0] on usb-0000:00:1d.0-2/input0
[    5.934988] sr0: scsi3-mmc drive: 24x/24x writer dvd-ram cd/rw xa/form2 cdda tray
[    5.934996] Uniform CD-ROM driver Revision: 3.20
[    5.935375] sr 3:0:0:0: Attached scsi CD-ROM sr0
[    5.937371] input: Avocent USB Composite Device-0 as /devices/pci0000:00/0000:00:1d.0/usb5/5-2/5-2:1.1/input/input2
[    5.937572] generic-usb 0003:0624:0248.0002: input,hidraw1: USB HID v1.00 Mouse [Avocent USB Composite Device-0] on usb-0000:00:1d.0-2/input1
[    5.937609] usbcore: registered new interface driver usbhid
[    5.937704] usbhid: v2.6:USB HID core driver
[    5.941330] ses 0:0:32:0: Attached scsi generic sg0 type 13
[    5.941534] sd 0:2:0:0: Attached scsi generic sg1 type 0
[    5.941745] sr 3:0:0:0: Attached scsi generic sg2 type 5
[    6.107798] device-mapper: uevent: version 1.0.3
[    6.108211] device-mapper: ioctl: 4.15.0-ioctl (2009-04-01) initialised: dm-devel@redhat.com
[    6.120615] PM: Starting manual resume from disk
[    6.120623] PM: Resume from partition 8:2
[    6.120625] PM: Checking hibernation image.
[    6.120966] PM: Error -22 checking image file
[    6.120968] PM: Resume from disk failed.
[    6.144276] kjournald starting.  Commit interval 5 seconds
[    6.144291] EXT3-fs: mounted filesystem with ordered data mode.
[    6.897173] udev[396]: starting version 164
[    7.111165] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)
[    7.117381] ACPI Error: SMBus or IPMI write requires Buffer of length 42, found length 20 (20090903/exfield-286)
[    7.117399] ACPI Error (psparse-0537): Method parse/execution failed [\_SB_.PMI0._GHL] (Node ffff88003fc1dc40), AE_AML_BUFFER_LIMIT
[    7.117438] ACPI Error (psparse-0537): Method parse/execution failed [\_SB_.PMI0._PMC] (Node ffff88003fc1dbc0), AE_AML_BUFFER_LIMIT
[    7.117480] ACPI Exception: AE_AML_BUFFER_LIMIT, Evaluating _PMC (20090903/power_meter-772)
[    7.120960] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3
[    7.120972] ACPI: Power Button [PWRF]
[    7.122113] input: PC Speaker as /devices/platform/pcspkr/input/input4
[    7.399396] Error: Driver 'pcspkr' is already registered, aborting...
[    7.797186] Adding 979956k swap on /dev/sda2.  Priority:-1 extents:1 across:979956k 
[    7.892524] EXT3 FS on sda1, internal journal
[    7.958451] loop: module loaded
[    8.420541]   alloc irq_desc for 2256 on node 0
[    8.420546]   alloc kstat_irqs on node 0
[    8.420625]   alloc irq_desc for 2255 on node 0
[    8.420628]   alloc kstat_irqs on node 0
[    8.420693]   alloc irq_desc for 2254 on node 0
[    8.420697]   alloc kstat_irqs on node 0
[    8.420762]   alloc irq_desc for 2253 on node 0
[    8.420764]   alloc kstat_irqs on node 0
[    8.420829]   alloc irq_desc for 2252 on node 0
[    8.420831]   alloc kstat_irqs on node 0
[    8.420896]   alloc irq_desc for 2251 on node 0
[    8.420902]   alloc kstat_irqs on node 0
[    8.420967]   alloc irq_desc for 2250 on node 0
[    8.420970]   alloc kstat_irqs on node 0
[    8.421035]   alloc irq_desc for 2249 on node 0
[    8.421038]   alloc kstat_irqs on node 0
[    8.421102]   alloc irq_desc for 2248 on node 0
[    8.421105]   alloc kstat_irqs on node 0
[    8.481345] bnx2: eth0: using MSIX
[    8.481700] ADDRCONF(NETDEV_UP): eth0: link is not ready
[    8.870382] Event-channel device installed.
[    9.082896]   alloc irq_desc for 2247 on node 0
[    9.082901]   alloc kstat_irqs on node 0
[    9.082969]   alloc irq_desc for 2246 on node 0
[    9.082972]   alloc kstat_irqs on node 0
[    9.083255] XENBUS: Unable to read cpu state
[    9.083382] XENBUS: Unable to read cpu state
[    9.083531] XENBUS: Unable to read cpu state
[    9.083643] XENBUS: Unable to read cpu state
[    9.083880] XENBUS: Unable to read cpu state
[    9.083997] XENBUS: Unable to read cpu state
[    9.084125] XENBUS: Unable to read cpu state
[    9.084246] XENBUS: Unable to read cpu state
[   10.841144] Bridge firewalling registered
[   11.711620] bnx2: eth0 NIC Copper Link is Up, 1000 Mbps full duplex
[   11.711883] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   22.606456] eth0: no IPv6 routers present

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Re: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-12-02 23:47         ` Bug#603632: [Xen-devel] " Vincent Caron
@ 2010-12-03  0:12           ` Jeremy Fitzhardinge
  2010-12-03  0:27             ` Bug#603632: [Xen-devel] " Vincent Caron
  2010-12-03  8:52             ` Ian Campbell
  2010-12-03  8:51           ` PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410)) Ian Campbell
  1 sibling, 2 replies; 23+ messages in thread
From: Jeremy Fitzhardinge @ 2010-12-03  0:12 UTC (permalink / raw)
  To: Vincent Caron
  Cc: xen-devel, Keir Fraser, Ian Campbell, Vincent CARON,
	Cris Daniluk, 603632

On 12/02/2010 03:47 PM, Vincent Caron wrote:
>   It just happens that your kernel above (2.6.32-27+numa1) boots fine
> under hypervisor _when_ passed 'numa=noacpi'. Yeah !
>
>   I then tried again with Debian Squeeze's latest 2.6.32-28, which
> crashes as -27 under hypervisor (and changelog show no xen or
> numa-related thingies). Then I added 'numa=noacpi', and it boots fine
> too. I got my 8 cores, networking, etc.
>
>   Enclosed is the dmesg for the latter, Debian, kernel.
>
>   Is the 'numa=noacpi' a "production acceptable" workaround ?

What about "numa=fake=1"?  I think that should force it to create a
single NUMA node.

IanC: it looks like passing a node id of "-1" is the correct way to say
"I don't care".

    J

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Bug#603632: [Xen-devel] PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-12-03  0:12           ` Jeremy Fitzhardinge
@ 2010-12-03  0:27             ` Vincent Caron
  2010-12-03  8:54               ` Ian Campbell
  2010-12-03  8:52             ` Ian Campbell
  1 sibling, 1 reply; 23+ messages in thread
From: Vincent Caron @ 2010-12-03  0:27 UTC (permalink / raw)
  To: Jeremy Fitzhardinge
  Cc: Ian Campbell, Vincent CARON, Cris Daniluk, xen-devel,
	Keir Fraser, 603632

[-- Attachment #1: Type: text/plain, Size: 1086 bytes --]

On Thu, 2010-12-02 at 16:12 -0800, Jeremy Fitzhardinge wrote:
> On 12/02/2010 03:47 PM, Vincent Caron wrote:
> >   It just happens that your kernel above (2.6.32-27+numa1) boots fine
> > under hypervisor _when_ passed 'numa=noacpi'. Yeah !
> >
> >   I then tried again with Debian Squeeze's latest 2.6.32-28, which
> > crashes as -27 under hypervisor (and changelog show no xen or
> > numa-related thingies). Then I added 'numa=noacpi', and it boots fine
> > too. I got my 8 cores, networking, etc.
> >
> >   Enclosed is the dmesg for the latter, Debian, kernel.
> >
> >   Is the 'numa=noacpi' a "production acceptable" workaround ?
> 
> What about "numa=fake=1"?  I think that should force it to create a
> single NUMA node.

  Debian AMD64 2.6.32-28 on hypervisor 4.0.1, option 'numa=fake=1',
boots fine too on my R410. Dmesg attached.

  PS: in both "numa=noacpi" and "numa=fake=1" cases where I can actually
run with a 4.0 hypervisor, I can't reboot. Dmesg ends with 'Restarting
system.' but the machine never reboots. OTOH reboots works while booting
native with the same kernel.


[-- Attachment #2: dell-r410-debian-2.6.32-28-numa-fake-1.txt --]
[-- Type: text/plain, Size: 55534 bytes --]

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 2.6.32-5-xen-amd64 (Debian 2.6.32-28) (ben@decadent.org.uk) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 SMP Thu Nov 25 20:08:32 UTC 2010
[    0.000000] Command line: root=/dev/sda1 console=hvc0 nomodeset numa=fake=1
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] released 0 pages of unused memory
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  Xen: 0000000000000000 - 00000000000a0000 (usable)
[    0.000000]  Xen: 00000000000a0000 - 0000000000100000 (reserved)
[    0.000000]  Xen: 0000000000100000 - 0000000040000000 (usable)
[    0.000000]  Xen: 00000000cf679000 - 00000000cf68f000 (reserved)
[    0.000000]  Xen: 00000000cf68f000 - 00000000cf6ce000 (ACPI data)
[    0.000000]  Xen: 00000000cf6ce000 - 00000000d0000000 (reserved)
[    0.000000]  Xen: 00000000e0000000 - 00000000f0000000 (reserved)
[    0.000000]  Xen: 00000000fe000000 - 0000000100000000 (reserved)
[    0.000000] DMI 2.6 present.
[    0.000000] last_pfn = 0x40000 max_arch_pfn = 0x400000000
[    0.000000] x86 PAT enabled: cpu 0, old 0x50100070406, new 0x7010600070106
[    0.000000] initial memory mapped : 0 - 20000000
[    0.000000] init_memory_mapping: 0000000000000000-0000000040000000
[    0.000000]  0000000000 - 0040000000 page 4k
[    0.000000] kernel direct mapping tables up to 40000000 @ 100000-302000
[    0.000000] RAMDISK: 016b5000 - 03266600
[    0.000000] ACPI: RSDP 00000000000f09e0 00024 (v02 DELL  )
[    0.000000] ACPI: XSDT 00000000000f0ae4 0009C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: FACP 00000000cf6b3f9c 000F4 (v03 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: DSDT 00000000cf68f000 03B39 (v01 DELL   PE_SC3   00000001 INTL 20050624)
[    0.000000] ACPI: FACS 00000000cf6b6000 00040
[    0.000000] ACPI: APIC 00000000cf6b3478 0015E (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SPCR 00000000cf6b35d8 00050 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: HPET 00000000cf6b362c 00038 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: XMAR 00000000cf6b3668 001B0 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: MCFG 00000000cf6b38c4 0003C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: WD__ 00000000cf6b3904 00134 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SLIC 00000000cf6b3a3c 00024 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: ERST 00000000cf692cbc 00270 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: HEST 00000000cf692f2c 003A8 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: BERT 00000000cf692b3c 00030 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: EINJ 00000000cf692b6c 00150 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SRAT 00000000cf6b3bc0 00370 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: TCPA 00000000cf6b3f34 00064 (v02 DELL   PE_SC3   00000001 DELL 00000001)
[    0.000000] ACPI: SSDT 00000000cf6b7000 02104 (v01  INTEL PPM RCM  80000001 INTL 20061109)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] SRAT: PXM 1 -> APIC 16 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 0 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 18 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 2 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 20 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 4 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 22 -> Node 0
[    0.000000] SRAT: PXM 2 -> APIC 6 -> Node 1
[    0.000000] SRAT: Node 1 PXM 2 0-d0000000
[    0.000000] SRAT: Node 1 PXM 2 100000000-130000000
[    0.000000] SRAT: Node 0 PXM 1 130000000-230000000
[    0.000000] Faking node 0 at 0000000000000000-0000000040000000 (1024MB)
[    0.000000] NUMA: Using 63 for the hash shift.
[    0.000000] Bootmem setup node 0 0000000000000000-0000000040000000
[    0.000000]   NODE_DATA [0000000000008000 - 000000000000ffff]
[    0.000000]   bootmap [0000000000010000 -  0000000000017fff] pages 8
[    0.000000] (8 early reservations) ==> bootmem [0000000000 - 0040000000]
[    0.000000]   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
[    0.000000]   #1 [0003468000 - 0003487000]   XEN PAGETABLES ==> [0003468000 - 0003487000]
[    0.000000]   #2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
[    0.000000]   #3 [0001000000 - 0001694994]    TEXT DATA BSS ==> [0001000000 - 0001694994]
[    0.000000]   #4 [00016b5000 - 0003266600]          RAMDISK ==> [00016b5000 - 0003266600]
[    0.000000]   #5 [0003267000 - 0003468000]   XEN START INFO ==> [0003267000 - 0003468000]
[    0.000000]   #6 [0001695000 - 000169532d]              BRK ==> [0001695000 - 000169532d]
[    0.000000]   #7 [0000100000 - 00002e0000]          PGTABLE ==> [0000100000 - 00002e0000]
[    0.000000] Faking PXM affinity for fake nodes on real topology.
[    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000000 -> 0x00001000
[    0.000000]   DMA32    0x00001000 -> 0x00100000
[    0.000000]   Normal   0x00100000 -> 0x00100000
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[2] active PFN ranges
[    0.000000]     0: 0x00000000 -> 0x000000a0
[    0.000000]     0: 0x00000100 -> 0x00040000
[    0.000000] On node 0 totalpages: 262048
[    0.000000]   DMA zone: 56 pages used for memmap
[    0.000000]   DMA zone: 483 pages reserved
[    0.000000]   DMA zone: 3461 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 3528 pages used for memmap
[    0.000000]   DMA32 zone: 254520 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x808
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x28] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x29] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x2a] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x2b] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2c] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2d] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x2f] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 0, address 0xfec00000, GSI 0-0
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32])
[    0.000000] IOAPIC[1]: apic_id 1, version 0, address 0xfec80000, GSI 32-32
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ERROR: Unable to locate IOAPIC for GSI 2
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ERROR: Unable to locate IOAPIC for GSI 9
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[    0.000000] SMP: Allowing 8 CPUs, 0 hotplug CPUs
[    0.000000] nr_irqs_gsi: 288
[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
[    0.000000] Allocating PCI resources starting at 40000000 (gap: 40000000:8f679000)
[    0.000000] Booting paravirtualized kernel on Xen
[    0.000000] Xen version: 4.0.1 (preserve-AD) (dom0)
[    0.000000] NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:8 nr_node_ids:1
[    0.000000] PERCPU: Embedded 30 pages/cpu @ffff8800034bd000 s90328 r8192 d24360 u122880
[    0.000000] pcpu-alloc: s90328 r8192 d24360 u122880 alloc=30*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 [0] 4 [0] 5 [0] 6 [0] 7 
[    2.814859] trying to map vcpu_info 0 at ffff8800034c8020, mfn 2274c8, offset 32
[    2.814863] cpu 0 using vcpu_info at ffff8800034c8020
[    2.814865] trying to map vcpu_info 1 at ffff8800034e6020, mfn 2274e6, offset 32
[    2.814868] cpu 1 using vcpu_info at ffff8800034e6020
[    2.814870] trying to map vcpu_info 2 at ffff880003504020, mfn 227504, offset 32
[    2.814872] cpu 2 using vcpu_info at ffff880003504020
[    2.814874] trying to map vcpu_info 3 at ffff880003522020, mfn 227522, offset 32
[    2.814877] cpu 3 using vcpu_info at ffff880003522020
[    2.814879] trying to map vcpu_info 4 at ffff880003540020, mfn 227540, offset 32
[    2.814882] cpu 4 using vcpu_info at ffff880003540020
[    2.814883] trying to map vcpu_info 5 at ffff88000355e020, mfn 22755e, offset 32
[    2.814886] cpu 5 using vcpu_info at ffff88000355e020
[    2.814888] trying to map vcpu_info 6 at ffff88000357c020, mfn 22757c, offset 32
[    2.814891] cpu 6 using vcpu_info at ffff88000357c020
[    2.814892] trying to map vcpu_info 7 at ffff88000359a020, mfn 22759a, offset 32
[    2.814895] cpu 7 using vcpu_info at ffff88000359a020
[    2.814896] Xen: using vcpu_info placement
[    2.814902] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 257981
[    2.814904] Policy zone: DMA32
[    2.814906] Kernel command line: root=/dev/sda1 console=hvc0 nomodeset numa=fake=1
[    2.814937] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    2.815236] Initializing CPU#0
[    2.823705] DMA: Placing 64MB software IO TLB between ffff880004691000 - ffff880008691000
[    2.823710] DMA: software IO TLB at phys 0x4691000 - 0x8691000
[    2.823712] xen_swiotlb_fixup: buf=ffff880004691000 size=67108864
[    2.842914] xen_swiotlb_fixup: buf=ffff8800086f1000 size=32768
[    2.847247] Memory: 927388k/1048576k available (3144k kernel code, 384k absent, 120804k reserved, 1902k data, 596k init)
[    2.847284] SLUB: Genslabs=14, HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1
[    2.847318] Hierarchical RCU implementation.
[    2.847328] NR_IRQS:4352 nr_irqs:2304
[    2.847425] xen: --> irq=0
[    2.847433] xen: --> irq=1
[    2.847438] xen: --> irq=2
[    2.847443] xen: --> irq=3
[    2.847449] xen: --> irq=4
[    2.847454] xen: --> irq=5
[    2.847459] xen: --> irq=6
[    2.847464] xen: --> irq=7
[    2.847469] xen: --> irq=8
[    2.847474] xen: --> irq=9
[    2.847480] xen: --> irq=10
[    2.847485] xen: --> irq=11
[    2.847490] xen: --> irq=12
[    2.847495] xen: --> irq=13
[    2.847500] xen: --> irq=14
[    2.847506] xen: --> irq=15
[    2.847521] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    2.847524] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    2.847526] xen: sci override: source_irq=9 global_irq=9 trigger=c polarity=1
[    2.847528] xen: registering gsi 9 triggering 0 polarity 0
[    2.847530] xen_allocate_pirq: returning irq 9 for gsi 9
[    2.847532] xen: --> irq=9
[    2.847539] xen: acpi sci 9
[    2.853466] Console: colour VGA+ 80x25
[    2.853736] console [hvc0] enabled
[    2.853764] Xen: using vcpuop timer interface
[    2.853767] installing Xen timer for CPU 0
[    2.853777]   alloc irq_desc for 2303 on node 0
[    2.853781]   alloc kstat_irqs on node 0
[    2.853798] Detected 2261.064 MHz processor.
[    2.853807] Calibrating delay loop (skipped), value calculated using timer frequency.. 4522.12 BogoMIPS (lpj=9044256)
[    2.853824] Security Framework initialized
[    2.853830] SELinux:  Disabled at boot.
[    2.854025] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    2.854383] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    2.854529] Mount-cache hash table entries: 256
[    2.854658] Initializing cgroup subsys ns
[    2.854663] Initializing cgroup subsys cpuacct
[    2.854668] Initializing cgroup subsys devices
[    2.854671] Initializing cgroup subsys freezer
[    2.854674] Initializing cgroup subsys net_cls
[    2.854710] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.854714] CPU: L2 cache: 256K
[    2.854716] CPU: L3 cache: 8192K
[    2.854721] CPU 0/0x0 -> Node 0
[    2.854724] CPU: Unsupported number of siblings 16
[    2.854729] mce: CPU supports 9 MCE banks
[    2.854753] Performance Events: unsupported p6 CPU model 26 no PMU driver, software events only.
[    2.854769] SMP alternatives: switching to UP code
[    2.878840] ACPI: Core revision 20090903
[    2.884748]   alloc irq_desc for 2302 on node 0
[    2.884751]   alloc kstat_irqs on node 0
[    2.884756]   alloc irq_desc for 2301 on node 0
[    2.884758]   alloc kstat_irqs on node 0
[    2.884762]   alloc irq_desc for 2300 on node 0
[    2.884764]   alloc kstat_irqs on node 0
[    2.884768]   alloc irq_desc for 2299 on node 0
[    2.884769]   alloc kstat_irqs on node 0
[    2.884935] installing Xen timer for CPU 1
[    2.884940]   alloc irq_desc for 2298 on node 0
[    2.884942]   alloc kstat_irqs on node 0
[    2.884966] SMP alternatives: switching to SMP code
[    2.908057]   alloc irq_desc for 2297 on node 0
[    2.908059]   alloc kstat_irqs on node 0
[    2.908071]   alloc irq_desc for 2296 on node 0
[    2.908073]   alloc kstat_irqs on node 0
[    2.908078]   alloc irq_desc for 2295 on node 0
[    2.908079]   alloc kstat_irqs on node 0
[    2.908083]   alloc irq_desc for 2294 on node 0
[    2.908085]   alloc kstat_irqs on node 0
[    2.908103] Initializing CPU#1
[    2.908167] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.908170] CPU: L2 cache: 256K
[    2.908172] CPU: L3 cache: 8192K
[    2.908177] CPU 1/0x0 -> Node 0
[    2.908180] CPU: Unsupported number of siblings 16
[    2.908306] installing Xen timer for CPU 2
[    2.908318]   alloc irq_desc for 2293 on node 0
[    2.908320]   alloc kstat_irqs on node 0
[    2.908343]   alloc irq_desc for 2292 on node 0
[    2.908345]   alloc kstat_irqs on node 0
[    2.908350]   alloc irq_desc for 2291 on node 0
[    2.908352]   alloc kstat_irqs on node 0
[    2.908356]   alloc irq_desc for 2290 on node 0
[    2.908358]   alloc kstat_irqs on node 0
[    2.908362]   alloc irq_desc for 2289 on node 0
[    2.908364]   alloc kstat_irqs on node 0
[    2.908374] Initializing CPU#2
[    2.908410] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.908412] CPU: L2 cache: 256K
[    2.908414] CPU: L3 cache: 8192K
[    2.908417] CPU 2/0x0 -> Node 0
[    2.908419] CPU: Unsupported number of siblings 16
[    2.908520] installing Xen timer for CPU 3
[    2.908532]   alloc irq_desc for 2288 on node 0
[    2.908533]   alloc kstat_irqs on node 0
[    2.908554]   alloc irq_desc for 2287 on node 0
[    2.908556]   alloc kstat_irqs on node 0
[    2.908561]   alloc irq_desc for 2286 on node 0
[    2.908562]   alloc kstat_irqs on node 0
[    2.908567]   alloc irq_desc for 2285 on node 0
[    2.908569]   alloc kstat_irqs on node 0
[    2.908573]   alloc irq_desc for 2284 on node 0
[    2.908574]   alloc kstat_irqs on node 0
[    2.908587] Initializing CPU#3
[    2.908636] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.908640] CPU: L2 cache: 256K
[    2.908642] CPU: L3 cache: 8192K
[    2.908647] CPU 3/0x0 -> Node 0
[    2.908649] CPU: Unsupported number of siblings 16
[    2.908754] installing Xen timer for CPU 4
[    2.908766]   alloc irq_desc for 2283 on node 0
[    2.908767]   alloc kstat_irqs on node 0
[    2.908788]   alloc irq_desc for 2282 on node 0
[    2.908790]   alloc kstat_irqs on node 0
[    2.908795]   alloc irq_desc for 2281 on node 0
[    2.908797]   alloc kstat_irqs on node 0
[    2.908801]   alloc irq_desc for 2280 on node 0
[    2.908803]   alloc kstat_irqs on node 0
[    2.908807]   alloc irq_desc for 2279 on node 0
[    2.908809]   alloc kstat_irqs on node 0
[    2.908818] Initializing CPU#4
[    2.908852] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.908854] CPU: L2 cache: 256K
[    2.908856] CPU: L3 cache: 8192K
[    2.908859] CPU 4/0x0 -> Node 0
[    2.908861] CPU: Unsupported number of siblings 16
[    2.908958] installing Xen timer for CPU 5
[    2.908970]   alloc irq_desc for 2278 on node 0
[    2.908972]   alloc kstat_irqs on node 0
[    2.908992]   alloc irq_desc for 2277 on node 0
[    2.908994]   alloc kstat_irqs on node 0
[    2.908999]   alloc irq_desc for 2276 on node 0
[    2.909000]   alloc kstat_irqs on node 0
[    2.909005]   alloc irq_desc for 2275 on node 0
[    2.909007]   alloc kstat_irqs on node 0
[    2.909010]   alloc irq_desc for 2274 on node 0
[    2.909012]   alloc kstat_irqs on node 0
[    2.909025] Initializing CPU#5
[    2.909074] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.909078] CPU: L2 cache: 256K
[    2.909080] CPU: L3 cache: 8192K
[    2.909084] CPU 5/0x0 -> Node 0
[    2.909087] CPU: Unsupported number of siblings 16
[    2.909189] installing Xen timer for CPU 6
[    2.909204]   alloc irq_desc for 2273 on node 0
[    2.909206]   alloc kstat_irqs on node 0
[    2.909226]   alloc irq_desc for 2272 on node 0
[    2.909228]   alloc kstat_irqs on node 0
[    2.909233]   alloc irq_desc for 2271 on node 0
[    2.909235]   alloc kstat_irqs on node 0
[    2.909242]   alloc irq_desc for 2270 on node 0
[    2.909244]   alloc kstat_irqs on node 0
[    2.909248]   alloc irq_desc for 2269 on node 0
[    2.909249]   alloc kstat_irqs on node 0
[    2.909259] Initializing CPU#6
[    2.909293] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.909295] CPU: L2 cache: 256K
[    2.909296] CPU: L3 cache: 8192K
[    2.909300] CPU 6/0x0 -> Node 0
[    2.909302] CPU: Unsupported number of siblings 16
[    2.909400] installing Xen timer for CPU 7
[    2.909411]   alloc irq_desc for 2268 on node 0
[    2.909413]   alloc kstat_irqs on node 0
[    2.909433]   alloc irq_desc for 2267 on node 0
[    2.909435]   alloc kstat_irqs on node 0
[    2.909440]   alloc irq_desc for 2266 on node 0
[    2.909442]   alloc kstat_irqs on node 0
[    2.909447]   alloc irq_desc for 2265 on node 0
[    2.909448]   alloc kstat_irqs on node 0
[    2.909452]   alloc irq_desc for 2264 on node 0
[    2.909457]   alloc kstat_irqs on node 0
[    2.909470] Initializing CPU#7
[    2.909519] CPU: L1 I cache: 32K, L1 D cache: 32K
[    2.909522] CPU: L2 cache: 256K
[    2.909524] CPU: L3 cache: 8192K
[    2.909529] CPU 7/0x0 -> Node 0
[    2.909532] CPU: Unsupported number of siblings 16
[    2.909583] Brought up 8 CPUs
[    2.909626] CPU0 attaching sched-domain:
[    2.909629]  domain 0: span 0-7 level CPU
[    2.909632]   groups: 0 1 2 3 4 5 6 7
[    2.909643] CPU1 attaching sched-domain:
[    2.909645]  domain 0: span 0-7 level CPU
[    2.909647]   groups: 1 2 3 4 5 6 7 0
[    2.909657] CPU2 attaching sched-domain:
[    2.909659]  domain 0: span 0-7 level CPU
[    2.909662]   groups: 2 3 4 5 6 7 0 1
[    2.909671] CPU3 attaching sched-domain:
[    2.909673]  domain 0: span 0-7 level CPU
[    2.909676]   groups: 3 4 5 6 7 0 1 2
[    2.909686] CPU4 attaching sched-domain:
[    2.909687]  domain 0: span 0-7 level CPU
[    2.909690]   groups: 4 5 6 7 0 1 2 3
[    2.909700] CPU5 attaching sched-domain:
[    2.909702]  domain 0: span 0-7 level CPU
[    2.909704]   groups: 5 6 7 0 1 2 3 4
[    2.909714] CPU6 attaching sched-domain:
[    2.909716]  domain 0: span 0-7 level CPU
[    2.909718]   groups: 6 7 0 1 2 3 4 5
[    2.909728] CPU7 attaching sched-domain:
[    2.909730]  domain 0: span 0-7 level CPU
[    2.909733]   groups: 7 0 1 2 3 4 5 6
[    2.910275] devtmpfs: initialized
[    2.913256] Grant table initialized
[    2.913263] regulator: core version 0.5
[    2.913315] NET: Registered protocol family 16
[    2.913364]   alloc irq_desc for 2263 on node 0
[    2.913366]   alloc kstat_irqs on node 0
[    2.913511] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    2.913517] ACPI: bus type pci registered
[    2.913592] PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
[    2.913597] PCI: MCFG area at e0000000 reserved in E820
[    2.952709] PCI: Using MMCONFIG at e0000000 - efffffff
[    2.952713] PCI: Using configuration type 1 for base access
[    2.953525] bio: create slab <bio-0> at 0
[    2.954568] ERROR: Unable to locate IOAPIC for GSI 9
[    2.954595] ACPI: EC: Look up EC in DSDT
[    2.958024] ACPI: BIOS _OSI(Linux) query ignored
[    2.958221] ACPI: Interpreter enabled
[    2.958225] ACPI: (supports S0 S4 S5)
[    2.958247] ACPI: Using IOAPIC for interrupt routing
[    2.963869] ACPI: No dock devices found.
[    2.964392] ACPI: PCI Root Bridge [PCI0] (0000:00)
[    2.964531] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    2.964539] pci 0000:00:00.0: PME# disabled
[    2.964675] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    2.964682] pci 0000:00:01.0: PME# disabled
[    2.964817] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    2.964824] pci 0000:00:03.0: PME# disabled
[    2.964964] pci 0000:00:07.0: PME# supported from D0 D3hot D3cold
[    2.964971] pci 0000:00:07.0: PME# disabled
[    2.965385] pci 0000:00:1a.0: reg 20 io port: [0xec40-0xec5f]
[    2.965505] pci 0000:00:1a.1: reg 20 io port: [0xec60-0xec7f]
[    2.965651] pci 0000:00:1a.7: reg 10 32bit mmio: [0xdf0ff800-0xdf0ffbff]
[    2.965747] pci 0000:00:1a.7: PME# supported from D0 D3hot D3cold
[    2.965755] pci 0000:00:1a.7: PME# disabled
[    2.965850] pci 0000:00:1d.0: reg 20 io port: [0xec80-0xec9f]
[    2.965976] pci 0000:00:1d.1: reg 20 io port: [0xeca0-0xecbf]
[    2.966101] pci 0000:00:1d.2: reg 20 io port: [0xecc0-0xecdf]
[    2.966226] pci 0000:00:1d.3: reg 20 io port: [0xece0-0xecff]
[    2.966353] pci 0000:00:1d.7: reg 10 32bit mmio: [0xdf0ffc00-0xdf0fffff]
[    2.966448] pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
[    2.966456] pci 0000:00:1d.7: PME# disabled
[    2.966671] pci 0000:00:1f.0: quirk: region 0800-087f claimed by ICH6 ACPI/GPIO/TCO
[    2.966678] pci 0000:00:1f.0: quirk: region 0880-08bf claimed by ICH6 GPIO
[    2.966684] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 1 PIO at 0c00 (mask 007f)
[    2.966691] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 2 PIO at 0ca0 (mask 000f)
[    2.966697] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 3 PIO at 00e0 (mask 000f)
[    2.966794] pci 0000:00:1f.2: reg 10 io port: [0xe8e0-0xe8e7]
[    2.966803] pci 0000:00:1f.2: reg 14 io port: [0xe8d0-0xe8d3]
[    2.966813] pci 0000:00:1f.2: reg 18 io port: [0xe8e8-0xe8ef]
[    2.966822] pci 0000:00:1f.2: reg 1c io port: [0xe8d4-0xe8d7]
[    2.966831] pci 0000:00:1f.2: reg 20 io port: [0xec00-0xec0f]
[    2.966840] pci 0000:00:1f.2: reg 24 io port: [0xec10-0xec1f]
[    2.966950] pci 0000:00:1f.5: reg 10 io port: [0xe8f0-0xe8f7]
[    2.966959] pci 0000:00:1f.5: reg 14 io port: [0xe8d8-0xe8db]
[    2.966968] pci 0000:00:1f.5: reg 18 io port: [0xe8f8-0xe8ff]
[    2.966977] pci 0000:00:1f.5: reg 1c io port: [0xe8dc-0xe8df]
[    2.966986] pci 0000:00:1f.5: reg 20 io port: [0xec20-0xec2f]
[    2.966995] pci 0000:00:1f.5: reg 24 io port: [0xec30-0xec3f]
[    2.967132] pci 0000:01:00.0: reg 10 64bit mmio: [0xda000000-0xdbffffff]
[    2.967228] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    2.967245] pci 0000:01:00.0: PME# disabled
[    2.967336] pci 0000:01:00.1: reg 10 64bit mmio: [0xdc000000-0xddffffff]
[    2.967431] pci 0000:01:00.1: PME# supported from D0 D3hot D3cold
[    2.967439] pci 0000:01:00.1: PME# disabled
[    2.967562] pci 0000:00:01.0: bridge 32bit mmio: [0xda000000-0xddffffff]
[    2.967684] pci 0000:03:00.0: reg 10 64bit mmio: [0xdf180000-0xdf1bffff]
[    2.967694] pci 0000:03:00.0: reg 18 io port: [0xfc00-0xfcff]
[    2.967711] pci 0000:03:00.0: reg 1c 64bit mmio: [0xdf1c0000-0xdf1fffff]
[    2.967729] pci 0000:03:00.0: reg 30 32bit mmio pref: [0xdf100000-0xdf107fff]
[    2.967783] pci 0000:03:00.0: supports D1
[    2.967815] pci 0000:03:00.0: disabling ASPM on pre-1.1 PCIe device.  You can enable it with 'pcie_aspm=force'
[    2.967866] pci 0000:00:07.0: bridge io port: [0xf000-0xffff]
[    2.967872] pci 0000:00:07.0: bridge 32bit mmio: [0xdf100000-0xdf1fffff]
[    2.967941] pci 0000:04:03.0: reg 10 32bit mmio pref: [0xd9800000-0xd9ffffff]
[    2.967951] pci 0000:04:03.0: reg 14 32bit mmio: [0xde7fc000-0xde7fffff]
[    2.967962] pci 0000:04:03.0: reg 18 32bit mmio: [0xde800000-0xdeffffff]
[    2.967996] pci 0000:04:03.0: reg 30 32bit mmio pref: [0x000000-0x00ffff]
[    2.968102] pci 0000:00:1e.0: transparent bridge
[    2.968113] pci 0000:00:1e.0: bridge 32bit mmio: [0xde000000-0xdeffffff]
[    2.968123] pci 0000:00:1e.0: bridge 64bit mmio pref: [0xd9800000-0xd9ffffff]
[    2.968156] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
[    2.968980] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX1._PRT]
[    2.969129] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX3._PRT]
[    2.969274] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX7._PRT]
[    2.969429] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.COMP._PRT]
[    2.973439] ACPI: PCI Interrupt Link [LK00] (IRQs 3 4 5 6 7 10 11 14 *15)
[    2.973596] ACPI: PCI Interrupt Link [LK01] (IRQs 3 4 5 6 7 10 11 *14 15)
[    2.973742] ACPI: PCI Interrupt Link [LK02] (IRQs 3 4 5 6 7 10 *11 14 15)
[    2.973890] ACPI: PCI Interrupt Link [LK03] (IRQs 3 4 5 6 7 *10 11 14 15)
[    2.974033] ACPI: PCI Interrupt Link [LK04] (IRQs 3 4 *5 6 7 10 11 14 15)
[    2.974176] ACPI: PCI Interrupt Link [LK05] (IRQs 3 4 5 *6 7 10 11 14 15)
[    2.974318] ACPI: PCI Interrupt Link [LK06] (IRQs 3 4 5 6 7 10 *11 14 15)
[    2.974460] ACPI: PCI Interrupt Link [LK07] (IRQs 3 4 5 6 7 10 11 *14 15)
[    2.974551] sync cpu 0 get result 1 max_id 7
[    2.974560] sync cpu 1 get result 1 max_id 7
[    2.974568] sync cpu 2 get result 1 max_id 7
[    2.974578] sync cpu 3 get result 1 max_id 7
[    2.974589] sync cpu 4 get result 1 max_id 7
[    2.974597] sync cpu 5 get result 1 max_id 7
[    2.974605] sync cpu 6 get result 1 max_id 7
[    2.974613] sync cpu 7 get result 1 max_id 7
[    2.974620]   alloc irq_desc for 2262 on node 0
[    2.974622]   alloc kstat_irqs on node 0
[    2.974648] xen_balloon: Initialising balloon driver with page order 0.
[    2.974712] vgaarb: device added: PCI:0000:04:03.0,decodes=io+mem,owns=io+mem,locks=none
[    2.974716] vgaarb: loaded
[    2.974812] PCI: Using ACPI for IRQ routing
[    2.975049] Switching to clocksource xen
[    2.977524] pnp: PnP ACPI init
[    2.977554] ACPI: bus type pnp registered
[    2.978155] xen: registering gsi 13 triggering 1 polarity 0
[    2.978159] xen_allocate_pirq: returning irq 13 for gsi 13
[    2.978165] xen: --> irq=13
[    2.978397] xen: registering gsi 8 triggering 1 polarity 0
[    2.978401] xen_allocate_pirq: returning irq 8 for gsi 8
[    2.978406] xen: --> irq=8
[    2.978908] xen: registering gsi 4 triggering 1 polarity 0
[    2.978911] xen_allocate_pirq: returning irq 4 for gsi 4
[    2.978917] xen: --> irq=4
[    2.979529] xen: registering gsi 3 triggering 1 polarity 0
[    2.979532] xen_allocate_pirq: returning irq 3 for gsi 3
[    2.979538] xen: --> irq=3
[    2.979541] Already setup the GSI :3
[    2.983157] pnp: PnP ACPI: found 12 devices
[    2.983162] ACPI: ACPI bus type pnp unregistered
[    2.983184] system 00:07: ioport range 0x800-0x87f has been reserved
[    2.983191] system 00:07: ioport range 0x880-0x8ff could not be reserved
[    2.983198] system 00:07: ioport range 0x900-0x91f has been reserved
[    2.983204] system 00:07: ioport range 0x920-0x923 has been reserved
[    2.983211] system 00:07: ioport range 0x924-0x924 has been reserved
[    2.983217] system 00:07: ioport range 0xc00-0xc7f has been reserved
[    2.983223] system 00:07: ioport range 0xca0-0xca7 has been reserved
[    2.983229] system 00:07: ioport range 0xca9-0xcab has been reserved
[    2.983236] system 00:07: ioport range 0xcad-0xcaf has been reserved
[    2.983246] system 00:08: ioport range 0xca8-0xca8 has been reserved
[    2.983252] system 00:08: ioport range 0xcac-0xcac has been reserved
[    2.983263] system 00:09: iomem range 0xe0000000-0xefffffff has been reserved
[    2.983274] system 00:0b: iomem range 0xfed90000-0xfed91fff has been reserved
[    2.990350] PM-Timer failed consistency check  (0x0xffffff) - aborting.
[    2.990450] pci 0000:00:01.0: PCI bridge, secondary bus 0000:01
[    2.990455] pci 0000:00:01.0:   IO window: disabled
[    2.990467] pci 0000:00:01.0:   MEM window: 0xda000000-0xddffffff
[    2.990476] pci 0000:00:01.0:   PREFETCH window: disabled
[    2.990490] pci 0000:00:03.0: PCI bridge, secondary bus 0000:02
[    2.990495] pci 0000:00:03.0:   IO window: disabled
[    2.990506] pci 0000:00:03.0:   MEM window: disabled
[    2.990515] pci 0000:00:03.0:   PREFETCH window: disabled
[    2.990529] pci 0000:00:07.0: PCI bridge, secondary bus 0000:03
[    2.990537] pci 0000:00:07.0:   IO window: 0xf000-0xffff
[    2.990548] pci 0000:00:07.0:   MEM window: 0xdf100000-0xdf1fffff
[    2.990558] pci 0000:00:07.0:   PREFETCH window: disabled
[    2.990574] pci 0000:00:1e.0: PCI bridge, secondary bus 0000:04
[    2.990579] pci 0000:00:1e.0:   IO window: disabled
[    2.990591] pci 0000:00:1e.0:   MEM window: 0xde000000-0xdeffffff
[    2.990601] pci 0000:00:1e.0:   PREFETCH window: 0x000000d9800000-0x000000d9ffffff
[    2.990631] xen: registering gsi 53 triggering 0 polarity 1
[    2.990644]   alloc irq_desc for 53 on node 0
[    2.990647]   alloc kstat_irqs on node 0
[    2.990653] xen: --> irq=53
[    2.990662] pci 0000:00:01.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53
[    2.990674] pci 0000:00:01.0: setting latency timer to 64
[    2.990690] xen: registering gsi 53 triggering 0 polarity 1
[    2.990693] xen_allocate_pirq: returning irq 53 for gsi 53
[    2.990698] xen: --> irq=53
[    2.990700] Already setup the GSI :53
[    2.990705] pci 0000:00:03.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53
[    2.990715] pci 0000:00:03.0: setting latency timer to 64
[    2.990732] xen: registering gsi 53 triggering 0 polarity 1
[    2.990735] xen_allocate_pirq: returning irq 53 for gsi 53
[    2.990739] xen: --> irq=53
[    2.990742] Already setup the GSI :53
[    2.990746] pci 0000:00:07.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53
[    2.990757] pci 0000:00:07.0: setting latency timer to 64
[    2.990771] pci 0000:00:1e.0: setting latency timer to 64
[    2.990778] pci_bus 0000:00: resource 0 io:  [0x00-0xffff]
[    2.990782] pci_bus 0000:00: resource 1 mem: [0x000000-0xffffffffffffffff]
[    2.990785] pci_bus 0000:01: resource 1 mem: [0xda000000-0xddffffff]
[    2.990789] pci_bus 0000:03: resource 0 io:  [0xf000-0xffff]
[    2.990793] pci_bus 0000:03: resource 1 mem: [0xdf100000-0xdf1fffff]
[    2.990797] pci_bus 0000:04: resource 1 mem: [0xde000000-0xdeffffff]
[    2.990800] pci_bus 0000:04: resource 2 pref mem [0xd9800000-0xd9ffffff]
[    2.990803] pci_bus 0000:04: resource 3 io:  [0x00-0xffff]
[    2.990807] pci_bus 0000:04: resource 4 mem: [0x000000-0xffffffffffffffff]
[    2.990844] NET: Registered protocol family 2
[    2.991035] IP route cache hash table entries: 32768 (order: 6, 262144 bytes)
[    2.991828] TCP established hash table entries: 131072 (order: 9, 2097152 bytes)
[    2.992548] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    2.992774] TCP: Hash tables configured (established 131072 bind 65536)
[    2.992781] TCP reno registered
[    2.992902] NET: Registered protocol family 1
[    3.009318] pci 0000:04:03.0: Boot video device
[    3.009373] Unpacking initramfs...
[    3.041411] Freeing initrd memory: 28357k freed
[    3.049766] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    3.049779] DMA: Placing 64MB software IO TLB between ffff880004691000 - ffff880008691000
[    3.049785] DMA: software IO TLB at phys 0x4691000 - 0x8691000
[    3.050877] audit: initializing netlink socket (disabled)
[    3.050896] type=2000 audit(1291335494.007:1): initialized
[    3.055602] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    3.057906] VFS: Disk quotas dquot_6.5.2
[    3.057979] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    3.058106] msgmni has been set to 1866
[    3.058814] alg: No test for stdrng (krng)
[    3.058889] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[    3.058897] io scheduler noop registered
[    3.058901] io scheduler anticipatory registered
[    3.058906] io scheduler deadline registered
[    3.058948] io scheduler cfq registered (default)
[    3.059202]   alloc irq_desc for 2261 on node 0
[    3.059205]   alloc kstat_irqs on node 0
[    3.059253] pcieport 0000:00:01.0: setting latency timer to 64
[    3.059519]   alloc irq_desc for 2260 on node 0
[    3.059522]   alloc kstat_irqs on node 0
[    3.059557] pcieport 0000:00:03.0: setting latency timer to 64
[    3.059829]   alloc irq_desc for 2259 on node 0
[    3.059832]   alloc kstat_irqs on node 0
[    3.059866] pcieport 0000:00:07.0: setting latency timer to 64
[    3.060475] aer 0000:00:01.0:pcie02: service driver aer loaded
[    3.060553] aer 0000:00:03.0:pcie02: service driver aer loaded
[    3.060629] aer 0000:00:07.0:pcie02: service driver aer loaded
[    3.070025] registering netback
[    3.070110]   alloc irq_desc for 2258 on node 0
[    3.070113]   alloc kstat_irqs on node 0
[    3.071784]   alloc irq_desc for 2257 on node 0
[    3.071788]   alloc kstat_irqs on node 0
[    3.072250] hpet_acpi_add: no address or irqs in _CRS
[    3.072276] Linux agpgart interface v0.103
[    3.072330] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    3.072487] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    3.072870] 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    3.073182] input: Macintosh mouse button emulation as /devices/virtual/input/input0
[    3.073259] PNP: No PS/2 controller found. Probing ports directly.
[    3.076045] serio: i8042 KBD port at 0x60,0x64 irq 1
[    3.076055] serio: i8042 AUX port at 0x60,0x64 irq 12
[    3.076170] mice: PS/2 mouse device common for all mice
[    3.076218] rtc_cmos 00:04: RTC can wake from S4
[    3.076260] rtc_cmos 00:04: rtc core: registered rtc_cmos as rtc0
[    3.076293] rtc0: alarms up to one day, y3k, 242 bytes nvram
[    3.076306] cpuidle: using governor ladder
[    3.076309] cpuidle: using governor menu
[    3.076314] No iBFT detected.
[    3.076576] TCP cubic registered
[    3.076675] NET: Registered protocol family 10
[    3.077112] lo: Disabled Privacy Extensions
[    3.077330] Mobile IPv6
[    3.077333] NET: Registered protocol family 17
[    3.077401] PM: Resume from disk failed.
[    3.077411] registered taskstats version 1
[    3.078136] rtc_cmos 00:04: setting system clock to 2010-12-03 00:18:14 UTC (1291335494)
[    3.078160] Initalizing network drop monitor service
[    3.078229] Freeing unused kernel memory: 596k freed
[    3.078352] Write protecting the kernel read-only data: 4324k
[    3.109734] udev[127]: starting version 164
[    3.126961] Broadcom NetXtreme II Gigabit Ethernet Driver bnx2 v2.0.2 (Aug 21, 2009)
[    3.126992] xen: registering gsi 36 triggering 0 polarity 1
[    3.127005]   alloc irq_desc for 36 on node 0
[    3.127007]   alloc kstat_irqs on node 0
[    3.127014] xen: --> irq=36
[    3.127027] bnx2 0000:01:00.0: PCI INT A -> GSI 36 (level, low) -> IRQ 36
[    3.127042] bnx2 0000:01:00.0: setting latency timer to 64
[    3.127292] bnx2 0000:01:00.0: firmware: requesting bnx2/bnx2-mips-09-5.0.0.j3.fw
[    3.153228] SCSI subsystem initialized
[    3.167013] usbcore: registered new interface driver usbfs
[    3.167051] usbcore: registered new interface driver hub
[    3.167116] usbcore: registered new device driver usb
[    3.184344] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    3.184392] xen: registering gsi 19 triggering 0 polarity 1
[    3.184408]   alloc irq_desc for 19 on node 0
[    3.184411]   alloc kstat_irqs on node 0
[    3.184420] xen: --> irq=19
[    3.184431] ehci_hcd 0000:00:1a.7: PCI INT C -> GSI 19 (level, low) -> IRQ 19
[    3.184463] ehci_hcd 0000:00:1a.7: setting latency timer to 64
[    3.184469] ehci_hcd 0000:00:1a.7: EHCI Host Controller
[    3.184497] ehci_hcd 0000:00:1a.7: new USB bus registered, assigned bus number 1
[    3.184570] ehci_hcd 0000:00:1a.7: debug port 1
[    3.184765] libata version 3.00 loaded.
[    3.185665] uhci_hcd: USB Universal Host Controller Interface driver
[    3.188478] ehci_hcd 0000:00:1a.7: cache line size of 32 is not supported
[    3.188513] ehci_hcd 0000:00:1a.7: irq 19, io mem 0xdf0ff800
[    3.190270] bnx2 0000:01:00.0: firmware: requesting bnx2/bnx2-rv2p-09-5.0.0.j3.fw
[    3.192676] megasas: 00.00.04.01 Thu July 24 11:41:51 PST 2008
[    3.192696] megasas: 0x1000:0x0060:0x1028:0x1f0b: bus 3:slot 0:func 0
[    3.192717] xen: registering gsi 38 triggering 0 polarity 1
[    3.192728]   alloc irq_desc for 38 on node 0
[    3.192730]   alloc kstat_irqs on node 0
[    3.192735] xen: --> irq=38
[    3.192744] megaraid_sas 0000:03:00.0: PCI INT A -> GSI 38 (level, low) -> IRQ 38
[    3.192753] megaraid_sas 0000:03:00.0: setting latency timer to 64
[    3.192841] megasas: FW now in Ready state
[    3.197414] eth0: Broadcom NetXtreme II BCM5716 1000Base-T (C0) PCI Express found at mem da000000, IRQ 36, node addr a4:ba:db:47:2a:de
[    3.197485] xen: registering gsi 48 triggering 0 polarity 1
[    3.197494]   alloc irq_desc for 48 on node 0
[    3.197497]   alloc kstat_irqs on node 0
[    3.197503] xen: --> irq=48
[    3.197512] bnx2 0000:01:00.1: PCI INT B -> GSI 48 (level, low) -> IRQ 48
[    3.197526] bnx2 0000:01:00.1: setting latency timer to 64
[    3.197783] bnx2 0000:01:00.1: firmware: requesting bnx2/bnx2-mips-09-5.0.0.j3.fw
[    3.201171] ehci_hcd 0000:00:1a.7: USB 2.0 started, EHCI 1.00
[    3.201206] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    3.201213] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.201219] usb usb1: Product: EHCI Host Controller
[    3.201223] usb usb1: Manufacturer: Linux 2.6.32-5-xen-amd64 ehci_hcd
[    3.201228] usb usb1: SerialNumber: 0000:00:1a.7
[    3.201331] usb usb1: configuration #1 chosen from 1 choice
[    3.201372] hub 1-0:1.0: USB hub found
[    3.201393] hub 1-0:1.0: 4 ports detected
[    3.201487] xen: registering gsi 17 triggering 0 polarity 1
[    3.201497]   alloc irq_desc for 17 on node 0
[    3.201501]   alloc kstat_irqs on node 0
[    3.201506] xen: --> irq=17
[    3.201517] uhci_hcd 0000:00:1a.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
[    3.201530] uhci_hcd 0000:00:1a.0: setting latency timer to 64
[    3.201535] uhci_hcd 0000:00:1a.0: UHCI Host Controller
[    3.201548] uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 2
[    3.201602] uhci_hcd 0000:00:1a.0: irq 17, io base 0x0000ec40
[    3.201668] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001
[    3.201672] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.201676] usb usb2: Product: UHCI Host Controller
[    3.201679] usb usb2: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    3.201683] usb usb2: SerialNumber: 0000:00:1a.0
[    3.201755] usb usb2: configuration #1 chosen from 1 choice
[    3.201782] hub 2-0:1.0: USB hub found
[    3.201797] hub 2-0:1.0: 2 ports detected
[    3.201937] ata_piix 0000:00:1f.2: version 2.13
[    3.201951] xen: registering gsi 23 triggering 0 polarity 1
[    3.201958]   alloc irq_desc for 23 on node 0
[    3.201960]   alloc kstat_irqs on node 0
[    3.201963] xen: --> irq=23
[    3.201968] ata_piix 0000:00:1f.2: PCI INT C -> GSI 23 (level, low) -> IRQ 23
[    3.201977] ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
[    3.203880] bnx2 0000:01:00.1: firmware: requesting bnx2/bnx2-rv2p-09-5.0.0.j3.fw
[    3.210109] eth1: Broadcom NetXtreme II BCM5716 1000Base-T (C0) PCI Express found at mem dc000000, IRQ 48, node addr a4:ba:db:47:2a:df
[    3.235524] scsi0 : LSI SAS based MegaRAID driver
[    3.236657] scsi 0:0:0:0: Direct-Access     SEAGATE  ST3146356SS      HS10 PQ: 0 ANSI: 5
[    3.237531] scsi 0:0:1:0: Direct-Access     SEAGATE  ST3146356SS      HS10 PQ: 0 ANSI: 5
[    3.238407] scsi 0:0:2:0: Direct-Access     SEAGATE  ST3146356SS      HS10 PQ: 0 ANSI: 5
[    3.315115] scsi 0:0:32:0: Enclosure         DP       BACKPLANE        1.07 PQ: 0 ANSI: 5
[    3.330022] scsi 0:2:0:0: Direct-Access     DELL     PERC 6/i Adapter 1.22 PQ: 0 ANSI: 5
[    3.352315] sd 0:2:0:0: [sda] 285474816 512-byte logical blocks: (146 GB/136 GiB)
[    3.352445] sd 0:2:0:0: [sda] Write Protect is off
[    3.352451] sd 0:2:0:0: [sda] Mode Sense: 1f 00 10 08
[    3.352525] sd 0:2:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
[    3.352839]  sda: sda1 sda2 sda3
[    3.356441] ata_piix 0000:00:1f.2: setting latency timer to 64
[    3.356540] scsi1 : ata_piix
[    3.356612] scsi2 : ata_piix
[    3.356672] ata1: SATA max UDMA/133 cmd 0xe8e0 ctl 0xe8d0 bmdma 0xec00 irq 23
[    3.356681] ata2: SATA max UDMA/133 cmd 0xe8e8 ctl 0xe8d4 bmdma 0xec08 irq 23
[    3.356735] xen: registering gsi 21 triggering 0 polarity 1
[    3.356746]   alloc irq_desc for 21 on node 0
[    3.356749]   alloc kstat_irqs on node 0
[    3.356754] xen: --> irq=21
[    3.356763] ehci_hcd 0000:00:1d.7: PCI INT A -> GSI 21 (level, low) -> IRQ 21
[    3.356789] ehci_hcd 0000:00:1d.7: setting latency timer to 64
[    3.356795] ehci_hcd 0000:00:1d.7: EHCI Host Controller
[    3.356814] ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 3
[    3.356881] ehci_hcd 0000:00:1d.7: debug port 1
[    3.360768] ehci_hcd 0000:00:1d.7: cache line size of 32 is not supported
[    3.360795] ehci_hcd 0000:00:1d.7: irq 21, io mem 0xdf0ffc00
[    3.363025] sd 0:2:0:0: [sda] Attached SCSI disk
[    3.377163] ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00
[    3.377194] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[    3.377200] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.377206] usb usb3: Product: EHCI Host Controller
[    3.377211] usb usb3: Manufacturer: Linux 2.6.32-5-xen-amd64 ehci_hcd
[    3.377216] usb usb3: SerialNumber: 0000:00:1d.7
[    3.377307] usb usb3: configuration #1 chosen from 1 choice
[    3.377348] hub 3-0:1.0: USB hub found
[    3.377372] hub 3-0:1.0: 4 ports detected
[    3.377469] xen: registering gsi 18 triggering 0 polarity 1
[    3.377479]   alloc irq_desc for 18 on node 0
[    3.377482]   alloc kstat_irqs on node 0
[    3.377487] xen: --> irq=18
[    3.377496] uhci_hcd 0000:00:1a.1: PCI INT B -> GSI 18 (level, low) -> IRQ 18
[    3.377511] uhci_hcd 0000:00:1a.1: setting latency timer to 64
[    3.377517] uhci_hcd 0000:00:1a.1: UHCI Host Controller
[    3.377533] uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 4
[    3.377579] uhci_hcd 0000:00:1a.1: irq 18, io base 0x0000ec60
[    3.377635] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001
[    3.377640] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.377644] usb usb4: Product: UHCI Host Controller
[    3.377647] usb usb4: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    3.377650] usb usb4: SerialNumber: 0000:00:1a.1
[    3.377719] usb usb4: configuration #1 chosen from 1 choice
[    3.377745] hub 4-0:1.0: USB hub found
[    3.377759] hub 4-0:1.0: 2 ports detected
[    3.377830] xen: registering gsi 22 triggering 0 polarity 1
[    3.377837]   alloc irq_desc for 22 on node 0
[    3.377839]   alloc kstat_irqs on node 0
[    3.377842] xen: --> irq=22
[    3.377848] ata_piix 0000:00:1f.5: PCI INT D -> GSI 22 (level, low) -> IRQ 22
[    3.377857] ata_piix 0000:00:1f.5: MAP [ P0 -- P1 -- ]
[    3.507553] ses 0:0:32:0: Attached Enclosure device
[    3.511415] usb 1-3: new high speed USB device using ehci_hcd and address 2
[    3.531445] ata_piix 0000:00:1f.5: setting latency timer to 64
[    3.531565] scsi3 : ata_piix
[    3.531667] scsi4 : ata_piix
[    3.531722] ata3: SATA max UDMA/133 cmd 0xe8f0 ctl 0xe8d8 bmdma 0xec20 irq 22
[    3.531731] ata4: SATA max UDMA/133 cmd 0xe8f8 ctl 0xe8dc bmdma 0xec28 irq 22
[    3.531779] xen: registering gsi 21 triggering 0 polarity 1
[    3.531784] xen_allocate_pirq: returning irq 21 for gsi 21
[    3.531789] xen: --> irq=21
[    3.531793] Already setup the GSI :21
[    3.531799] uhci_hcd 0000:00:1d.0: PCI INT A -> GSI 21 (level, low) -> IRQ 21
[    3.531813] uhci_hcd 0000:00:1d.0: setting latency timer to 64
[    3.531819] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[    3.531834] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 5
[    3.531878] uhci_hcd 0000:00:1d.0: irq 21, io base 0x0000ec80
[    3.531954] usb usb5: New USB device found, idVendor=1d6b, idProduct=0001
[    3.531960] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.531966] usb usb5: Product: UHCI Host Controller
[    3.531971] usb usb5: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    3.531976] usb usb5: SerialNumber: 0000:00:1d.0
[    3.532058] usb usb5: configuration #1 chosen from 1 choice
[    3.532095] hub 5-0:1.0: USB hub found
[    3.532114] hub 5-0:1.0: 2 ports detected
[    3.532182] xen: registering gsi 20 triggering 0 polarity 1
[    3.532191]   alloc irq_desc for 20 on node 0
[    3.532194]   alloc kstat_irqs on node 0
[    3.532199] xen: --> irq=20
[    3.532207] uhci_hcd 0000:00:1d.1: PCI INT B -> GSI 20 (level, low) -> IRQ 20
[    3.532221] uhci_hcd 0000:00:1d.1: setting latency timer to 64
[    3.532227] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[    3.532242] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 6
[    3.532300] uhci_hcd 0000:00:1d.1: irq 20, io base 0x0000eca0
[    3.532368] usb usb6: New USB device found, idVendor=1d6b, idProduct=0001
[    3.532374] usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.532380] usb usb6: Product: UHCI Host Controller
[    3.532385] usb usb6: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    3.532390] usb usb6: SerialNumber: 0000:00:1d.1
[    3.532479] usb usb6: configuration #1 chosen from 1 choice
[    3.532520] hub 6-0:1.0: USB hub found
[    3.532537] hub 6-0:1.0: 2 ports detected
[    3.532605] xen: registering gsi 21 triggering 0 polarity 1
[    3.532608] xen_allocate_pirq: returning irq 21 for gsi 21
[    3.532613] xen: --> irq=21
[    3.532616] Already setup the GSI :21
[    3.532621] uhci_hcd 0000:00:1d.2: PCI INT C -> GSI 21 (level, low) -> IRQ 21
[    3.532636] uhci_hcd 0000:00:1d.2: setting latency timer to 64
[    3.532641] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[    3.532654] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 7
[    3.532695] uhci_hcd 0000:00:1d.2: irq 21, io base 0x0000ecc0
[    3.532768] usb usb7: New USB device found, idVendor=1d6b, idProduct=0001
[    3.532775] usb usb7: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.532780] usb usb7: Product: UHCI Host Controller
[    3.532785] usb usb7: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    3.532790] usb usb7: SerialNumber: 0000:00:1d.2
[    3.532874] usb usb7: configuration #1 chosen from 1 choice
[    3.532912] hub 7-0:1.0: USB hub found
[    3.532931] hub 7-0:1.0: 2 ports detected
[    3.533001] xen: registering gsi 20 triggering 0 polarity 1
[    3.533005] xen_allocate_pirq: returning irq 20 for gsi 20
[    3.533015] xen: --> irq=20
[    3.533019] Already setup the GSI :20
[    3.533024] uhci_hcd 0000:00:1d.3: PCI INT D -> GSI 20 (level, low) -> IRQ 20
[    3.533038] uhci_hcd 0000:00:1d.3: setting latency timer to 64
[    3.533043] uhci_hcd 0000:00:1d.3: UHCI Host Controller
[    3.533056] uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 8
[    3.533097] uhci_hcd 0000:00:1d.3: irq 20, io base 0x0000ece0
[    3.533168] usb usb8: New USB device found, idVendor=1d6b, idProduct=0001
[    3.533175] usb usb8: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.533180] usb usb8: Product: UHCI Host Controller
[    3.533185] usb usb8: Manufacturer: Linux 2.6.32-5-xen-amd64 uhci_hcd
[    3.533190] usb usb8: SerialNumber: 0000:00:1d.3
[    3.533266] usb usb8: configuration #1 chosen from 1 choice
[    3.533308] hub 8-0:1.0: USB hub found
[    3.533325] hub 8-0:1.0: 2 ports detected
[    3.643812] usb 1-3: New USB device found, idVendor=0424, idProduct=2514
[    3.643820] usb 1-3: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    3.643907] usb 1-3: configuration #1 chosen from 1 choice
[    3.644565] hub 1-3:1.0: USB hub found
[    3.644692] hub 1-3:1.0: 4 ports detected
[    3.999410] usb 5-2: new full speed USB device using uhci_hcd and address 2
[    4.011474] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    4.035701] ata3.00: ATAPI: TSSTcorp DVD+/-RW TS-L633C, D250, max UDMA/100
[    4.035721] ata3.00: applying bridge limits
[    4.071707] ata3.00: configured for UDMA/100
[    4.162966] usb 5-2: New USB device found, idVendor=0624, idProduct=0248
[    4.162973] usb 5-2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    4.162979] usb 5-2: Product: USB Composite Device-0
[    4.162984] usb 5-2: Manufacturer: Avocent
[    4.162988] usb 5-2: SerialNumber: 20080519
[    4.163068] usb 5-2: configuration #1 chosen from 1 choice
[    4.383412] ata2.00: failed to resume link (SControl 0)
[    4.559410] ata4: failed to resume link (SControl 0)
[    4.570979] ata4: SATA link down (SStatus 4 SControl 0)
[    4.703420] ata1.01: failed to resume link (SControl 0)
[    4.715042] ata1.00: SATA link down (SStatus 0 SControl 300)
[    4.715081] ata1.01: SATA link down (SStatus 0 SControl 0)
[    5.411410] ata2.01: failed to resume link (SControl 0)
[    5.423007] ata2.00: SATA link down (SStatus 0 SControl 0)
[    5.423046] ata2.01: SATA link down (SStatus 0 SControl 0)
[    5.426395] scsi 3:0:0:0: CD-ROM            TSSTcorp DVD+-RW TS-L633C D250 PQ: 0 ANSI: 5
[    5.443725] usbcore: registered new interface driver hiddev
[    5.448293] input: Avocent USB Composite Device-0 as /devices/pci0000:00/0000:00:1d.0/usb5/5-2/5-2:1.0/input/input1
[    5.448415] generic-usb 0003:0624:0248.0001: input,hidraw0: USB HID v1.00 Keyboard [Avocent USB Composite Device-0] on usb-0000:00:1d.0-2/input0
[    5.450555] sr0: scsi3-mmc drive: 24x/24x writer dvd-ram cd/rw xa/form2 cdda tray
[    5.450564] Uniform CD-ROM driver Revision: 3.20
[    5.450821] sr 3:0:0:0: Attached scsi CD-ROM sr0
[    5.452305] input: Avocent USB Composite Device-0 as /devices/pci0000:00/0000:00:1d.0/usb5/5-2/5-2:1.1/input/input2
[    5.452547] generic-usb 0003:0624:0248.0002: input,hidraw1: USB HID v1.00 Mouse [Avocent USB Composite Device-0] on usb-0000:00:1d.0-2/input1
[    5.452592] usbcore: registered new interface driver usbhid
[    5.452800] usbhid: v2.6:USB HID core driver
[    5.456756] ses 0:0:32:0: Attached scsi generic sg0 type 13
[    5.456941] sd 0:2:0:0: Attached scsi generic sg1 type 0
[    5.457124] sr 3:0:0:0: Attached scsi generic sg2 type 5
[    5.652712] device-mapper: uevent: version 1.0.3
[    5.653131] device-mapper: ioctl: 4.15.0-ioctl (2009-04-01) initialised: dm-devel@redhat.com
[    5.677567] PM: Starting manual resume from disk
[    5.677574] PM: Resume from partition 8:2
[    5.677577] PM: Checking hibernation image.
[    5.677894] PM: Error -22 checking image file
[    5.677897] PM: Resume from disk failed.
[    5.700632] kjournald starting.  Commit interval 5 seconds
[    5.700643] EXT3-fs: mounted filesystem with ordered data mode.
[    6.477504] udev[404]: starting version 164
[    6.667767] ACPI Error: SMBus or IPMI write requires Buffer of length 42, found length 20 (20090903/exfield-286)
[    6.667795] ACPI Error (psparse-0537): Method parse/execution failed [\_SB_.PMI0._GHL] (Node ffff88003fc1dc40), AE_AML_BUFFER_LIMIT
[    6.667848] ACPI Error (psparse-0537): Method parse/execution failed [\_SB_.PMI0._PMC] (Node ffff88003fc1dbc0), AE_AML_BUFFER_LIMIT
[    6.667898] ACPI Exception: AE_AML_BUFFER_LIMIT, Evaluating _PMC (20090903/power_meter-772)
[    6.668409] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3
[    6.668423] ACPI: Power Button [PWRF]
[    6.906699] input: PC Speaker as /devices/platform/pcspkr/input/input4
[    6.907700] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)
[    7.008427] Error: Driver 'pcspkr' is already registered, aborting...
[    7.446627] Adding 979956k swap on /dev/sda2.  Priority:-1 extents:1 across:979956k 
[    7.550114] EXT3 FS on sda1, internal journal
[    7.627895] loop: module loaded
[    8.525410] Event-channel device installed.
[    8.696764]   alloc irq_desc for 2256 on node 0
[    8.696768]   alloc kstat_irqs on node 0
[    8.696823]   alloc irq_desc for 2255 on node 0
[    8.696826]   alloc kstat_irqs on node 0
[    8.697128] XENBUS: Unable to read cpu state
[    8.697308] XENBUS: Unable to read cpu state
[    8.697460] XENBUS: Unable to read cpu state
[    8.697594] XENBUS: Unable to read cpu state
[    8.697754] XENBUS: Unable to read cpu state
[    8.697874] XENBUS: Unable to read cpu state
[    8.697983] XENBUS: Unable to read cpu state
[    8.698105] XENBUS: Unable to read cpu state
[    9.004364]   alloc irq_desc for 2254 on node 0
[    9.004368]   alloc kstat_irqs on node 0
[    9.004446]   alloc irq_desc for 2253 on node 0
[    9.004449]   alloc kstat_irqs on node 0
[    9.004515]   alloc irq_desc for 2252 on node 0
[    9.004518]   alloc kstat_irqs on node 0
[    9.004584]   alloc irq_desc for 2251 on node 0
[    9.004587]   alloc kstat_irqs on node 0
[    9.004652]   alloc irq_desc for 2250 on node 0
[    9.004654]   alloc kstat_irqs on node 0
[    9.004720]   alloc irq_desc for 2249 on node 0
[    9.004723]   alloc kstat_irqs on node 0
[    9.004788]   alloc irq_desc for 2248 on node 0
[    9.004791]   alloc kstat_irqs on node 0
[    9.004856]   alloc irq_desc for 2247 on node 0
[    9.004859]   alloc kstat_irqs on node 0
[    9.004942]   alloc irq_desc for 2246 on node 0
[    9.004947]   alloc kstat_irqs on node 0
[    9.065993] bnx2: eth0: using MSIX
[    9.066323] ADDRCONF(NETDEV_UP): eth0: link is not ready
[   10.385640] Bridge firewalling registered
[   12.276719] bnx2: eth0 NIC Copper Link is Up, 1000 Mbps full duplex
[   12.276985] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   22.683402] eth0: no IPv6 routers present

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Re: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-12-02 23:47         ` Bug#603632: [Xen-devel] " Vincent Caron
  2010-12-03  0:12           ` Jeremy Fitzhardinge
@ 2010-12-03  8:51           ` Ian Campbell
  2010-12-03 10:30             ` Bug#603632: [Xen-devel] " Vincent Caron
  1 sibling, 1 reply; 23+ messages in thread
From: Ian Campbell @ 2010-12-03  8:51 UTC (permalink / raw)
  To: Vincent Caron
  Cc: Jeremy Fitzhardinge, xen-devel, Keir Fraser, Vincent CARON,
	Cris Daniluk, 603632

On Thu, 2010-12-02 at 23:47 +0000, Vincent Caron wrote:
> On Tue, 2010-11-23 at 22:18 +0000, Ian Campbell wrote:
> > On Tue, 2010-11-23 at 22:12 +0000, Ian Campbell wrote: 
> > > On Tue, 2010-11-23 at 18:52 +0000, Ian Campbell wrote: 
> > > > On Tue, 2010-11-23 at 11:51 +0000, Ian Campbell wrote:
> > > > > 
> > > > > Perhaps we should be passing numa_node_id() (e.g. current node)
> > > > > instead of node 0? 
> > > > 
> > > > I've just kicked off a build of the 2.6.32-27 Debian kernel with the
> > > > following additional patch, I will hopefully post the binaries tomorrow.
> > > 
> > > Build was quicker than I thought... Vincent, Cris if you get a chance
> > > please can you test the kernel from:
> > > http://xenbits.xen.org/people/ianc/2.6.32-27+numa1/
> > 
> > Also, please can you try adding "numa=noacpi" to your kernel command
> > line when running with the standard Debian kernel (not the one above).
> > 
> > Thanks!
> 
>   It just happens that your kernel above (2.6.32-27+numa1) boots fine
> under hypervisor _when_ passed 'numa=noacpi'. Yeah !
> 
>   I then tried again with Debian Squeeze's latest 2.6.32-28, which
> crashes as -27 under hypervisor (and changelog show no xen or
> numa-related thingies). Then I added 'numa=noacpi', and it boots fine
> too. I got my 8 cores, networking, etc.
> 
>   Enclosed is the dmesg for the latter, Debian, kernel.
> 
>   Is the 'numa=noacpi' a "production acceptable" workaround ?

Yes and in fact I think the actual fix is simply to have Xen fake out
the behaviour of numa=noacpi as below. I'll send this plus the other fix
out after I've given it a bit of proper testing.

Ian.

xen: disable ACPI NUMA for PV guests

Xen does not currently expose PV-NUMA information to PV
guests. Therefore disable NUMA for the time being.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
diff --git a/arch/x86/xen/enlighten.c b/arch/x86/xen/enlighten.c
index 02c710b..5c55e1b 100644
--- a/arch/x86/xen/enlighten.c
+++ b/arch/x86/xen/enlighten.c
@@ -1178,6 +1178,10 @@ asmlinkage void __init xen_start_kernel(void)
 
 	xen_smp_init();
 
+#ifdef CONFIG_ACPI_NUMA
+	acpi_numa = -1;
+#endif
+
 	pgd = (pgd_t *)xen_start_info->pt_base;
 
 	if (!xen_initial_domain())

^ permalink raw reply related	[flat|nested] 23+ messages in thread

* Re: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-12-03  0:12           ` Jeremy Fitzhardinge
  2010-12-03  0:27             ` Bug#603632: [Xen-devel] " Vincent Caron
@ 2010-12-03  8:52             ` Ian Campbell
  2010-12-03  9:20               ` Ian Campbell
  2010-12-03  9:49               ` Ian Campbell
  1 sibling, 2 replies; 23+ messages in thread
From: Ian Campbell @ 2010-12-03  8:52 UTC (permalink / raw)
  To: Jeremy Fitzhardinge
  Cc: xen-devel, Keir Fraser, Vincent CARON, Vincent Caron,
	Cris Daniluk, 603632

On Fri, 2010-12-03 at 00:12 +0000, Jeremy Fitzhardinge wrote:
> What about "numa=fake=1"?  I think that should force it to create a
> single NUMA node.

Is there any advantage to this vs numa=noacpi? Do they effectively end
up doing the same thing?

> IanC: it looks like passing a node id of "-1" is the correct way to
> say "I don't care". 

I thought so too but convinced myself from staring at the code that it
wouldn't work in this case -- I'll double check before I resubmit.

Ian.

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Re: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-12-03  0:27             ` Bug#603632: [Xen-devel] " Vincent Caron
@ 2010-12-03  8:54               ` Ian Campbell
  0 siblings, 0 replies; 23+ messages in thread
From: Ian Campbell @ 2010-12-03  8:54 UTC (permalink / raw)
  To: Vincent Caron
  Cc: Jeremy Fitzhardinge, xen-devel, Keir Fraser, Vincent CARON,
	Cris Daniluk, 603632

On Fri, 2010-12-03 at 00:27 +0000, Vincent Caron wrote:
> On Thu, 2010-12-02 at 16:12 -0800, Jeremy Fitzhardinge wrote:
> > On 12/02/2010 03:47 PM, Vincent Caron wrote:
> > >   It just happens that your kernel above (2.6.32-27+numa1) boots fine
> > > under hypervisor _when_ passed 'numa=noacpi'. Yeah !
> > >
> > >   I then tried again with Debian Squeeze's latest 2.6.32-28, which
> > > crashes as -27 under hypervisor (and changelog show no xen or
> > > numa-related thingies). Then I added 'numa=noacpi', and it boots fine
> > > too. I got my 8 cores, networking, etc.
> > >
> > >   Enclosed is the dmesg for the latter, Debian, kernel.
> > >
> > >   Is the 'numa=noacpi' a "production acceptable" workaround ?
> > 
> > What about "numa=fake=1"?  I think that should force it to create a
> > single NUMA node.
> 
>   Debian AMD64 2.6.32-28 on hypervisor 4.0.1, option 'numa=fake=1',
> boots fine too on my R410. Dmesg attached.

Thanks.

>   PS: in both "numa=noacpi" and "numa=fake=1" cases where I can actually
> run with a 4.0 hypervisor, I can't reboot. Dmesg ends with 'Restarting
> system.' but the machine never reboots. OTOH reboots works while booting
> native with the same kernel.

That was a known bug in 2.6.32.<something-recent>. AIUI a revert is in
the pipeline for the next 2.6.32.y and Jeremy has a proper fix queued
too, which I presume will make its way to stable in due course.

Ian.

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Re: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-12-03  8:52             ` Ian Campbell
@ 2010-12-03  9:20               ` Ian Campbell
  2010-12-03  9:49               ` Ian Campbell
  1 sibling, 0 replies; 23+ messages in thread
From: Ian Campbell @ 2010-12-03  9:20 UTC (permalink / raw)
  To: Jeremy Fitzhardinge
  Cc: xen-devel, Keir Fraser, Vincent CARON, Vincent Caron,
	Cris Daniluk, 603632

On Fri, 2010-12-03 at 08:52 +0000, Ian Campbell wrote:
> On Fri, 2010-12-03 at 00:12 +0000, Jeremy Fitzhardinge wrote:
> > What about "numa=fake=1"?  I think that should force it to create a
> > single NUMA node.
> 
> Is there any advantage to this vs numa=noacpi? Do they effectively end
> up doing the same thing?

The help text for CONFIG_NUMA_EMU (which enables numa=fake=N) says:

        Enable NUMA emulation. A flat machine will be split
        into virtual nodes when booted with "numa=fake=N", where N is
        the
        number of nodes. This is only useful for debugging.

I don't think this is the option we want.

Ian.

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Re: PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-12-03  8:52             ` Ian Campbell
  2010-12-03  9:20               ` Ian Campbell
@ 2010-12-03  9:49               ` Ian Campbell
  2010-12-03  9:54                 ` [PATCH] xen: disable ACPI NUMA for PV guests Ian Campbell
  1 sibling, 1 reply; 23+ messages in thread
From: Ian Campbell @ 2010-12-03  9:49 UTC (permalink / raw)
  To: Jeremy Fitzhardinge
  Cc: xen-devel, Keir Fraser, Vincent CARON, Vincent Caron,
	Cris Daniluk, 603632

On Fri, 2010-12-03 at 08:52 +0000, Ian Campbell wrote:
> 
> > IanC: it looks like passing a node id of "-1" is the correct way to
> > say "I don't care". 
> 
> I thought so too but convinced myself from staring at the code that it
> wouldn't work in this case -- I'll double check before I resubmit. 

I was mislead because node gets placed verbatim into desc->node which at
first glance seemed invalid but on second look it seems to be fine,
everything which reads that value is prepared to accept the -1. There is
precedent for using -1 in hpet_assign_irq, although most other places
seem to use numa_node_id().

I've tested with -1 and it seems ok. I see (too late) that you've
already made the change so I guess you knew this ;-)

Are you going to put this change into next-2.6.32 as well as 37?

Ian.

^ permalink raw reply	[flat|nested] 23+ messages in thread

* [PATCH] xen: disable ACPI NUMA for PV guests
  2010-12-03  9:49               ` Ian Campbell
@ 2010-12-03  9:54                 ` Ian Campbell
  2010-12-13 22:17                   ` Vincent Caron
  0 siblings, 1 reply; 23+ messages in thread
From: Ian Campbell @ 2010-12-03  9:54 UTC (permalink / raw)
  To: Jeremy Fitzhardinge; +Cc: xen-devel, Vincent Caron, linux-kernel, Ian Campbell

Xen does not currently expose PV-NUMA information to PV
guests. Therefore disable NUMA for the time being to prevent the
kernel picking up on an host-level NUMA information which it might
come across in the firmware.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
---
 arch/x86/xen/enlighten.c |    4 ++++
 1 files changed, 4 insertions(+), 0 deletions(-)

diff --git a/arch/x86/xen/enlighten.c b/arch/x86/xen/enlighten.c
index fbb35cd..7cdf2f3 100644
--- a/arch/x86/xen/enlighten.c
+++ b/arch/x86/xen/enlighten.c
@@ -1195,6 +1195,10 @@ asmlinkage void __init xen_start_kernel(void)
 
 	xen_smp_init();
 
+#ifdef CONFIG_ACPI_NUMA
+	acpi_numa = -1;
+#endif
+
 	pgd = (pgd_t *)xen_start_info->pt_base;
 
 	__supported_pte_mask |= _PAGE_IOMAP;
-- 
1.5.6.5


^ permalink raw reply related	[flat|nested] 23+ messages in thread

* Bug#603632: [Xen-devel] PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410))
  2010-12-03  8:51           ` PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410)) Ian Campbell
@ 2010-12-03 10:30             ` Vincent Caron
  0 siblings, 0 replies; 23+ messages in thread
From: Vincent Caron @ 2010-12-03 10:30 UTC (permalink / raw)
  To: Ian Campbell
  Cc: Vincent CARON, Cris Daniluk, xen-devel, Keir Fraser,
	Jeremy Fitzhardinge, 603632

On Fri, 2010-12-03 at 08:51 +0000, Ian Campbell wrote:
> On Thu, 2010-12-02 at 23:47 +0000, Vincent Caron wrote:
> > On Tue, 2010-11-23 at 22:18 +0000, Ian Campbell wrote:
> > > On Tue, 2010-11-23 at 22:12 +0000, Ian Campbell wrote: 
> > > > On Tue, 2010-11-23 at 18:52 +0000, Ian Campbell wrote: 
> > > > > On Tue, 2010-11-23 at 11:51 +0000, Ian Campbell wrote:
> > > > > > 
> > > > > > Perhaps we should be passing numa_node_id() (e.g. current node)
> > > > > > instead of node 0? 
> > > > > 
> > > > > I've just kicked off a build of the 2.6.32-27 Debian kernel with the
> > > > > following additional patch, I will hopefully post the binaries tomorrow.
> > > > 
> > > > Build was quicker than I thought... Vincent, Cris if you get a chance
> > > > please can you test the kernel from:
> > > > http://xenbits.xen.org/people/ianc/2.6.32-27+numa1/
> > > 
> > > Also, please can you try adding "numa=noacpi" to your kernel command
> > > line when running with the standard Debian kernel (not the one above).
> > > 
> > > Thanks!
> > 
> >   It just happens that your kernel above (2.6.32-27+numa1) boots fine
> > under hypervisor _when_ passed 'numa=noacpi'. Yeah !
> > 
> >   I then tried again with Debian Squeeze's latest 2.6.32-28, which
> > crashes as -27 under hypervisor (and changelog show no xen or
> > numa-related thingies). Then I added 'numa=noacpi', and it boots fine
> > too. I got my 8 cores, networking, etc.
> > 
> >   Enclosed is the dmesg for the latter, Debian, kernel.
> > 
> >   Is the 'numa=noacpi' a "production acceptable" workaround ?
> 
> Yes and in fact I think the actual fix is simply to have Xen fake out
> the behaviour of numa=noacpi as below. I'll send this plus the other fix
> out after I've given it a bit of proper testing.

  OK, I'll follow the patch until it makes it to Squeeze's kernel.

  Thanks a lot for your help and fix !

  Now going to stress some Xen 4.0 domains...

^ permalink raw reply	[flat|nested] 23+ messages in thread

* Re: [PATCH] xen: disable ACPI NUMA for PV guests
  2010-12-03  9:54                 ` [PATCH] xen: disable ACPI NUMA for PV guests Ian Campbell
@ 2010-12-13 22:17                   ` Vincent Caron
  0 siblings, 0 replies; 23+ messages in thread
From: Vincent Caron @ 2010-12-13 22:17 UTC (permalink / raw)
  To: Ian Campbell; +Cc: Jeremy Fitzhardinge, xen-devel, linux-kernel

On Fri, 2010-12-03 at 09:54 +0000, Ian Campbell wrote:
> Xen does not currently expose PV-NUMA information to PV
> guests. Therefore disable NUMA for the time being to prevent the
> kernel picking up on an host-level NUMA information which it might
> come across in the firmware.
> 
> Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
> ---
>  arch/x86/xen/enlighten.c |    4 ++++
>  1 files changed, 4 insertions(+), 0 deletions(-)
> 
> diff --git a/arch/x86/xen/enlighten.c b/arch/x86/xen/enlighten.c
> index fbb35cd..7cdf2f3 100644
> --- a/arch/x86/xen/enlighten.c
> +++ b/arch/x86/xen/enlighten.c
> @@ -1195,6 +1195,10 @@ asmlinkage void __init xen_start_kernel(void)
>  
>  	xen_smp_init();
>  
> +#ifdef CONFIG_ACPI_NUMA
> +	acpi_numa = -1;
> +#endif
> +
>  	pgd = (pgd_t *)xen_start_info->pt_base;
>  
>  	__supported_pte_mask |= _PAGE_IOMAP;

  This made it thru 2.6.32-29 in Debian on 10 dec and works like a
charm, Dell R410 properly booting with hypervisor Xen 4.0.1.

  Thanks a lot for your help and responsiveness.



^ permalink raw reply	[flat|nested] 23+ messages in thread

end of thread, other threads:[~2010-12-13 22:24 UTC | newest]

Thread overview: 23+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
     [not found] <20101115233253.11935.35707.reportbug@zerohal>
2010-11-23 11:51 ` PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410)) Ian Campbell
2010-11-23 12:44   ` Bug#603632: " Cris Daniluk
2010-11-23 18:24   ` Jeremy Fitzhardinge
2010-11-25 12:51     ` Bug#603632: [Xen-devel] " Vincent Caron
2010-11-25 15:01       ` Ian Campbell
2010-11-25 15:49         ` Bug#603632: [Xen-devel] " Vincent Caron
2010-11-23 18:52   ` Ian Campbell
2010-11-23 22:12     ` Ian Campbell
2010-11-23 22:18       ` Ian Campbell
2010-12-02 23:47         ` Bug#603632: [Xen-devel] " Vincent Caron
2010-12-03  0:12           ` Jeremy Fitzhardinge
2010-12-03  0:27             ` Bug#603632: [Xen-devel] " Vincent Caron
2010-12-03  8:54               ` Ian Campbell
2010-12-03  8:52             ` Ian Campbell
2010-12-03  9:20               ` Ian Campbell
2010-12-03  9:49               ` Ian Campbell
2010-12-03  9:54                 ` [PATCH] xen: disable ACPI NUMA for PV guests Ian Campbell
2010-12-13 22:17                   ` Vincent Caron
2010-12-03  8:51           ` PVops domain 0 crash on NUMA system only Node==1 present (Was: Re: Bug#603632: linux-image-2.6.32-5-xen-amd64: Linux kernel 2.6.32/xen/amd64 booting fine on bare metal, but not as dom0 with Xen 4.0.1 (Dell R410)) Ian Campbell
2010-12-03 10:30             ` Bug#603632: [Xen-devel] " Vincent Caron
2010-11-25 13:29   ` Bug#603632: " Vincent Caron
2010-11-25 14:44     ` Ian Campbell
2010-11-25 16:38       ` Bug#603632: " Vincent Caron

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.