xen-devel.lists.xenproject.org archive mirror
 help / color / mirror / Atom feed
* Nested Virtualization Support Host-Only Hypervisors
@ 2017-06-09  7:44 Kangjie Xi
  2017-06-09  8:24 ` Jan Beulich
  2017-06-09 10:12 ` Andrew Cooper
  0 siblings, 2 replies; 6+ messages in thread
From: Kangjie Xi @ 2017-06-09  7:44 UTC (permalink / raw)
  To: xen-devel

Xen supports Nested
Virtualization(https://wiki.xenproject.org/wiki/Nested_Virtualization_in_Xen),
which means I can run Xen or KVM hypervisor inside a virtual machine,
and then create a L2 guest. However when I run a Host-Only Hypervisor
(no L2 guests, like MoRE, SimpleVisor and HyperPlatform) inside of L1
guest, the L1 hangs.

Is it able to make Xen Nested Virtualization to support Host-Only
hypervisors? It is useful for security research.

* MoRE, https://github.com/ainfosec/MoRE
* SimpleVisor, https://github.com/ionescu007/SimpleVisor
* HyperPlatform, https://github.com/tandasat/HyperPlatform


Thanks
-kangjie

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 6+ messages in thread
* Re: Nested Virtualization Support Host-Only Hypervisors
  2017-06-09  7:44 Nested Virtualization Support Host-Only Hypervisors Kangjie Xi
@ 2017-06-09  8:24 ` Jan Beulich
  2017-06-09  8:54   ` Kangjie Xi
  2017-06-09 10:12 ` Andrew Cooper
  1 sibling, 1 reply; 6+ messages in thread
From: Jan Beulich @ 2017-06-09  8:24 UTC (permalink / raw)
  To: Kangjie Xi; +Cc: xen-devel

>>> On 09.06.17 at 09:44, <imxikangjie@gmail.com> wrote:
> Xen supports Nested
> Virtualization(https://wiki.xenproject.org/wiki/Nested_Virtualization_in_Xen ),
> which means I can run Xen or KVM hypervisor inside a virtual machine,
> and then create a L2 guest. However when I run a Host-Only Hypervisor
> (no L2 guests, like MoRE, SimpleVisor and HyperPlatform) inside of L1
> guest, the L1 hangs.
> 
> Is it able to make Xen Nested Virtualization to support Host-Only
> hypervisors? It is useful for security research.

Well, I'd certainly expect such to not be intentionally broken,
but with nested virtualization still not having reached mature,
fully supported state I'm not surprised you run into issues.
However, without you providing (much) more detail on the
hangs (or crashes?), there's no way forward here I'm afraid.

Jan


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 6+ messages in thread
* Re: Nested Virtualization Support Host-Only Hypervisors
  2017-06-09  8:24 ` Jan Beulich
@ 2017-06-09  8:54   ` Kangjie Xi
  2017-06-09  9:05     ` Jan Beulich
  0 siblings, 1 reply; 6+ messages in thread
From: Kangjie Xi @ 2017-06-09  8:54 UTC (permalink / raw)
  To: Jan Beulich; +Cc: xen-devel

I have asked the related issue on xen-users list
(https://lists.xenproject.org/archives/html/xen-users/2017-05/msg00090.html),
it has detail on hangs, if you want more detail, I can reproduce the
problem and send you more info.

HyperPlatform and SimpleVisor can work well inside VMware virtual
machine, so I think Xen or KVM should also support this.


Thanks
-kangjie

2017-06-09 16:24 GMT+08:00 Jan Beulich <JBeulich@suse.com>:
>>>> On 09.06.17 at 09:44, <imxikangjie@gmail.com> wrote:
>> Xen supports Nested
>> Virtualization(https://wiki.xenproject.org/wiki/Nested_Virtualization_in_Xen ),
>> which means I can run Xen or KVM hypervisor inside a virtual machine,
>> and then create a L2 guest. However when I run a Host-Only Hypervisor
>> (no L2 guests, like MoRE, SimpleVisor and HyperPlatform) inside of L1
>> guest, the L1 hangs.
>>
>> Is it able to make Xen Nested Virtualization to support Host-Only
>> hypervisors? It is useful for security research.
>
> Well, I'd certainly expect such to not be intentionally broken,
> but with nested virtualization still not having reached mature,
> fully supported state I'm not surprised you run into issues.
> However, without you providing (much) more detail on the
> hangs (or crashes?), there's no way forward here I'm afraid.
>
> Jan
>

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 6+ messages in thread
* Re: Nested Virtualization Support Host-Only Hypervisors
  2017-06-09  8:54   ` Kangjie Xi
@ 2017-06-09  9:05     ` Jan Beulich
  2017-06-09 10:03       ` Kangjie Xi
  0 siblings, 1 reply; 6+ messages in thread
From: Jan Beulich @ 2017-06-09  9:05 UTC (permalink / raw)
  To: Kangjie Xi; +Cc: xen-devel

>>> On 09.06.17 at 10:54, <imxikangjie@gmail.com> wrote:
> I have asked the related issue on xen-users list
> (https://lists.xenproject.org/archives/html/xen-users/2017-05/msg00090.html),
> it has detail on hangs, if you want more detail, I can reproduce the
> problem and send you more info.

It's not me to send that info to, but the list, but yes, what you
have there is insufficient - there's not even a complete log.

Jan


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 6+ messages in thread
* Re: Nested Virtualization Support Host-Only Hypervisors
  2017-06-09  9:05     ` Jan Beulich
@ 2017-06-09 10:03       ` Kangjie Xi
  0 siblings, 0 replies; 6+ messages in thread
From: Kangjie Xi @ 2017-06-09 10:03 UTC (permalink / raw)
  To: Jan Beulich; +Cc: xen-devel

[-- Attachment #1: Type: text/plain, Size: 836 bytes --]

I reproduce the issue again, and attachments are the log.

# xl dmesg > xldmesg.log
# dmesg > dmesg.log

However there is not error in the log.

Maybe just as you said, the nested virtualization is not mature. Do
you know how much work to do to change the Xen source code, to make
Xen support host-only hypervisors.

Thanks
-kangjie

2017-06-09 17:05 GMT+08:00 Jan Beulich <JBeulich@suse.com>:
>>>> On 09.06.17 at 10:54, <imxikangjie@gmail.com> wrote:
>> I have asked the related issue on xen-users list
>> (https://lists.xenproject.org/archives/html/xen-users/2017-05/msg00090.html),
>> it has detail on hangs, if you want more detail, I can reproduce the
>> problem and send you more info.
>
> It's not me to send that info to, but the list, but yes, what you
> have there is insufficient - there's not even a complete log.
>
> Jan
>

[-- Attachment #2: xldmesg.log --]
[-- Type: application/octet-stream, Size: 16961 bytes --]

 __  __            _  _   ___              
 \ \/ /___ _ __   | || | / _ \    _ __ ___ 
  \  // _ \ '_ \  | || || (_) |__| '__/ __|
  /  \  __/ | | | |__   _\__, |__| | | (__ 
 /_/\_\___|_| |_|    |_|(_)/_/   |_|  \___|
                                           
(XEN) Xen version 4.9-rc (xikangjie@(none)) (gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-16)) debug=n  Fri Jun  9 17:37:16 CST 2017
(XEN) Latest ChangeSet: 
(XEN) Bootloader: GNU GRUB 0.97
(XEN) Command line: dom0_mem=83886080 loglvl=all guest_loglvl=all
(XEN) Xen image load base address: 0
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: V2; EDID transfer time: 1 seconds
(XEN) Disc information:
(XEN)  Found 1 MBR signatures
(XEN)  Found 2 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 000000000009d800 (usable)
(XEN)  000000000009d800 - 00000000000a0000 (reserved)
(XEN)  00000000000e0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 000000007de9d000 (usable)
(XEN)  000000007de9d000 - 000000007dec1000 (reserved)
(XEN)  000000007dec1000 - 000000007dfd7000 (ACPI data)
(XEN)  000000007dfd7000 - 000000007e1f1000 (ACPI NVS)
(XEN)  000000007e1f1000 - 000000007f343000 (reserved)
(XEN)  000000007f343000 - 000000007f364000 (usable)
(XEN)  000000007f364000 - 000000007f366000 (reserved)
(XEN)  000000007f366000 - 000000007f367000 (usable)
(XEN)  000000007f367000 - 000000007f3ed000 (ACPI NVS)
(XEN)  000000007f3ed000 - 000000007f800000 (usable)
(XEN)  0000000080000000 - 0000000090000000 (reserved)
(XEN)  00000000fed1c000 - 00000000fed20000 (reserved)
(XEN)  00000000ff000000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000002080000000 (usable)
(XEN) New Xen image base address: 0x7d800000
(XEN) ACPI: RSDP 000F0490, 0024 (r2 ALASKA)
(XEN) ACPI: XSDT 7DEF8090, 009C (r1 ALASKA    A M I  1072009 AMI     10013)
(XEN) ACPI: FACP 7DF04BC0, 010C (r5 ALASKA    A M I  1072009 AMI     10013)
(XEN) ACPI: DSDT 7DEF81B8, CA01 (r2 ALASKA    A M I       21 INTL 20051117)
(XEN) ACPI: FACS 7E1E8080, 0040
(XEN) ACPI: APIC 7DF04CD0, 01B4 (r3 ALASKA    A M I  1072009 AMI     10013)
(XEN) ACPI: FPDT 7DF04E88, 0044 (r1 ALASKA    A M I  1072009 AMI     10013)
(XEN) ACPI: MCFG 7DF04ED0, 003C (r1 ALASKA OEMMCFG.  1072009 MSFT       97)
(XEN) ACPI: SRAT 7DF04F10, 0430 (r1 A M I  AMI SRAT        1 AMI.        0)
(XEN) ACPI: SLIT 7DF05340, 0030 (r1 A M I  AMI SLIT        0 AMI.        0)
(XEN) ACPI: HPET 7DF05370, 0038 (r1 ALASKA    A M I  1072009 AMI.        5)
(XEN) ACPI: PRAD 7DF053A8, 00BE (r2 PRADID  PRADTID        1 MSFT  3000001)
(XEN) ACPI: SPMI 7DF05468, 0040 (r5 A M I   OEMSPMI        0 AMI.        0)
(XEN) ACPI: SSDT 7DF054A8, D0CB0 (r2  INTEL    CpuPm     4000 INTL 20051117)
(XEN) ACPI: EINJ 7DFD6158, 0130 (r1    AMI AMI EINJ        0             0)
(XEN) ACPI: ERST 7DFD6288, 0230 (r1  AMIER AMI ERST        0             0)
(XEN) ACPI: HEST 7DFD64B8, 00A8 (r1    AMI AMI HEST        0             0)
(XEN) ACPI: BERT 7DFD6560, 0030 (r1    AMI AMI BERT        0             0)
(XEN) ACPI: DMAR 7DFD6590, 0170 (r1 A M I   OEMDMAR        1 INTL        1)
(XEN) System RAM: 131042MB (134187452kB)
(XEN) SRAT: PXM 0 -> APIC 00 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 01 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 02 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 03 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 04 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 05 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 06 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 07 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 08 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 09 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 0a -> Node 0
(XEN) SRAT: PXM 0 -> APIC 0b -> Node 0
(XEN) SRAT: PXM 1 -> APIC 20 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 21 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 22 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 23 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 24 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 25 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 26 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 27 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 28 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 29 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 2a -> Node 1
(XEN) SRAT: PXM 1 -> APIC 2b -> Node 1
(XEN) SRAT: Node 0 PXM 0 0-80000000
(XEN) SRAT: Node 0 PXM 0 100000000-1080000000
(XEN) SRAT: Node 1 PXM 1 1080000000-2080000000
(XEN) NUMA: Allocated memnodemap from 207d928000 - 207d929000
(XEN) NUMA: Using 19 for the hash shift.
(XEN) Domain heap initialised DMA width 32 bits
(XEN) CPU Vendor: Intel, Family 6 (0x6), Model 62 (0x3e), Stepping 4 (raw 000306e4)
(XEN) found SMP MP-table at 000fdbc0
(XEN) DMI 2.7 present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x408 (32 bits)
(XEN) ACPI: v5 SLEEP INFO: control[0:0], status[0:0]
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:404,1:0], pm1x_evt[1:400,1:0]
(XEN) ACPI: 32/64X FACS address mismatch in FADT - 7e1e8080/0000000000000000, using 32
(XEN) ACPI:             wakeup_vec[7e1e808c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x08] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x0a] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x20] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x22] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x24] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x26] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x28] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x2a] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x09] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x0b] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x21] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x23] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x25] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x27] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x29] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x2b] enabled)
(XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0a] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0c] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0e] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x10] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x12] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x14] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x16] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x09] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0b] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0d] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0f] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x11] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x13] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x15] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x17] high edge lint[0x1])
(XEN) Overriding APIC driver with bigsmp
(XEN) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: IOAPIC (id[0x02] address[0xfec01000] gsi_base[24])
(XEN) IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47
(XEN) ACPI: IOAPIC (id[0x03] address[0xfec40000] gsi_base[48])
(XEN) IOAPIC[2]: apic_id 3, version 32, address 0xfec40000, GSI 48-71
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode:  Phys.  Using 3 I/O APICs
(XEN) ACPI: HPET id: 0x8086a701 base: 0xfed00000
(XEN) Xen ERST support is initialized.
(XEN) HEST: Table parsing has been initialized
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 24 CPUs (0 hotplug CPUs)
(XEN) IRQ limits: 72 GSI, 4552 MSI/MSI-X
(XEN) Switched to APIC driver x2apic_cluster.
(XEN) xstate: size: 0x340 and states: 0x7
(XEN) CPU0: Intel machine check reporting enabled
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Platform timer is 14.318MHz HPET
(XEN) Detected 2600.015 MHz processor.
(XEN) Initing memory sharing.
(XEN) alt table ffff82d0803ed458 -> ffff82d0803eeb38
(XEN) PCI: MCFG configuration 0: base 80000000 segment 0000 buses 00 - ff
(XEN) PCI: MCFG area at 80000000 reserved in E820
(XEN) PCI: Using MCFG for segment 0000 bus 00-ff
(XEN) Intel VT-d iommu 0 supported page sizes: 4kB, 2MB, 1GB.
(XEN) Intel VT-d iommu 1 supported page sizes: 4kB, 2MB, 1GB.
(XEN) Intel VT-d Snoop Control enabled.
(XEN) Intel VT-d Dom0 DMA Passthrough not enabled.
(XEN) Intel VT-d Queued Invalidation enabled.
(XEN) Intel VT-d Interrupt Remapping enabled.
(XEN) Intel VT-d Posted Interrupt not enabled.
(XEN) Intel VT-d Shared EPT tables enabled.
(XEN) I/O virtualisation enabled
(XEN)  - Dom0 mode: Relaxed
(XEN) Interrupt remapping enabled
(XEN) nr_sockets: 4
(XEN) Enabled directed EOI with ioapic_ack_old on!
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using old ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) TSC deadline timer enabled
(XEN) Defaulting to alternative key handling; send 'A' to switch to normal mode.
(XEN) Allocated console ring of 256 KiB.
(XEN) mwait-idle: MWAIT substates: 0x1120
(XEN) mwait-idle: v0.4.1 model 0x3e
(XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Extended Page Tables (EPT)
(XEN)  - Virtual-Processor Identifiers (VPID)
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN)  - Unrestricted Guest
(XEN)  - APIC Register Virtualization
(XEN)  - Virtual Interrupt Delivery
(XEN)  - Posted Interrupt Processing
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) detected
(XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB
(XEN) Brought up 24 CPUs
(XEN) build-id: ad427f35b547f3aafba938a216a09a14c7d183a8
(XEN) ACPI sleep modes: S3
(XEN) VPMU: disabled
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) Dom0 has maximum 1032 PIRQs
(XEN) NX (Execute Disable) protection active
(XEN) *** LOADING DOMAIN 0 ***
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x20dc000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   000000202c000000->0000002030000000 (20951500 pages to be allocated)
(XEN)  Init. ramdisk: 000000207f1cc000->000000207ffff400
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff81000000->ffffffff820dc000
(XEN)  Init. ramdisk: 0000000000000000->0000000000000000
(XEN)  Phys-Mach map: 0000008000000000->000000800a000000
(XEN)  Start info:    ffffffff820dc000->ffffffff820dc4b4
(XEN)  Page tables:   ffffffff820dd000->ffffffff820f2000
(XEN)  Boot stack:    ffffffff820f2000->ffffffff820f3000
(XEN)  TOTAL:         ffffffff80000000->ffffffff82400000
(XEN)  ENTRY ADDRESS: ffffffff81d5a180
(XEN) Dom0 has maximum 24 VCPUs
(XEN) Scrubbing Free RAM on 2 nodes using 12 CPUs
(XEN) ........................................................................................done.
(XEN) Initial low memory virq threshold set at 0x4000 pages.
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 448kB init memory
(XEN) PCI add device 0000:00:00.0
(XEN) PCI add device 0000:00:01.0
(XEN) PCI add device 0000:00:01.1
(XEN) PCI add device 0000:00:02.0
(XEN) PCI add device 0000:00:02.2
(XEN) PCI add device 0000:00:03.0
(XEN) PCI add device 0000:00:04.0
(XEN) PCI add device 0000:00:04.1
(XEN) PCI add device 0000:00:04.2
(XEN) PCI add device 0000:00:04.3
(XEN) PCI add device 0000:00:04.4
(XEN) PCI add device 0000:00:04.5
(XEN) PCI add device 0000:00:04.6
(XEN) PCI add device 0000:00:04.7
(XEN) PCI add device 0000:00:05.0
(XEN) PCI add device 0000:00:05.2
(XEN) PCI add device 0000:00:05.4
(XEN) PCI add device 0000:00:11.0
(XEN) PCI add device 0000:00:16.0
(XEN) PCI add device 0000:00:16.1
(XEN) PCI add device 0000:00:1a.0
(XEN) PCI add device 0000:00:1c.0
(XEN) PCI add device 0000:00:1c.7
(XEN) PCI add device 0000:00:1d.0
(XEN) PCI add device 0000:00:1e.0
(XEN) PCI add device 0000:00:1f.0
(XEN) PCI add device 0000:00:1f.2
(XEN) PCI add device 0000:00:1f.3
(XEN) PCI add device 0000:06:00.0
(XEN) PCI add device 0000:07:00.0
(XEN) PCI add device 0000:07:00.1
(XEN) PCI add device 0000:09:00.0
(XEN) PCI add device 0000:0a:00.0
(XEN) PCI add device 0000:7f:08.0
(XEN) PCI add device 0000:7f:09.0
(XEN) PCI add device 0000:7f:0a.0
(XEN) PCI add device 0000:7f:0a.1
(XEN) PCI add device 0000:7f:0a.2
(XEN) PCI add device 0000:7f:0a.3
(XEN) PCI add device 0000:7f:0b.0
(XEN) PCI add device 0000:7f:0b.3
(XEN) PCI add device 0000:7f:0c.0
(XEN) PCI add device 0000:7f:0c.1
(XEN) PCI add device 0000:7f:0c.2
(XEN) PCI add device 0000:7f:0d.0
(XEN) PCI add device 0000:7f:0d.1
(XEN) PCI add device 0000:7f:0d.2
(XEN) PCI add device 0000:7f:0e.0
(XEN) PCI add device 0000:7f:0e.1
(XEN) PCI add device 0000:7f:0f.0
(XEN) PCI add device 0000:7f:0f.1
(XEN) PCI add device 0000:7f:0f.2
(XEN) PCI add device 0000:7f:0f.3
(XEN) PCI add device 0000:7f:0f.4
(XEN) PCI add device 0000:7f:0f.5
(XEN) PCI add device 0000:7f:10.0
(XEN) PCI add device 0000:7f:10.1
(XEN) PCI add device 0000:7f:10.2
(XEN) PCI add device 0000:7f:10.3
(XEN) PCI add device 0000:7f:10.4
(XEN) PCI add device 0000:7f:10.5
(XEN) PCI add device 0000:7f:10.6
(XEN) PCI add device 0000:7f:10.7
(XEN) PCI add device 0000:7f:13.0
(XEN) PCI add device 0000:7f:13.1
(XEN) PCI add device 0000:7f:13.4
(XEN) PCI add device 0000:7f:13.5
(XEN) PCI add device 0000:7f:16.0
(XEN) PCI add device 0000:7f:16.1
(XEN) PCI add device 0000:7f:16.2
(XEN) PCI add device 0000:80:00.0
(XEN) PCI add device 0000:80:01.0
(XEN) PCI add device 0000:80:02.0
(XEN) PCI add device 0000:80:03.0
(XEN) PCI add device 0000:80:04.0
(XEN) PCI add device 0000:80:04.1
(XEN) PCI add device 0000:80:04.2
(XEN) PCI add device 0000:80:04.3
(XEN) PCI add device 0000:80:04.4
(XEN) PCI add device 0000:80:04.5
(XEN) PCI add device 0000:80:04.6
(XEN) PCI add device 0000:80:04.7
(XEN) PCI add device 0000:80:05.0
(XEN) PCI add device 0000:80:05.2
(XEN) PCI add device 0000:80:05.4
(XEN) PCI add device 0000:82:00.0
(XEN) PCI add device 0000:84:00.0
(XEN) PCI add device 0000:84:00.1
(XEN) PCI add device 0000:ff:08.0
(XEN) PCI add device 0000:ff:09.0
(XEN) PCI add device 0000:ff:0a.0
(XEN) PCI add device 0000:ff:0a.1
(XEN) PCI add device 0000:ff:0a.2
(XEN) PCI add device 0000:ff:0a.3
(XEN) PCI add device 0000:ff:0b.0
(XEN) PCI add device 0000:ff:0b.3
(XEN) PCI add device 0000:ff:0c.0
(XEN) PCI add device 0000:ff:0c.1
(XEN) PCI add device 0000:ff:0c.2
(XEN) PCI add device 0000:ff:0d.0
(XEN) PCI add device 0000:ff:0d.1
(XEN) PCI add device 0000:ff:0d.2
(XEN) PCI add device 0000:ff:0e.0
(XEN) PCI add device 0000:ff:0e.1
(XEN) PCI add device 0000:ff:0f.0
(XEN) PCI add device 0000:ff:0f.1
(XEN) PCI add device 0000:ff:0f.2
(XEN) PCI add device 0000:ff:0f.3
(XEN) PCI add device 0000:ff:0f.4
(XEN) PCI add device 0000:ff:0f.5
(XEN) PCI add device 0000:ff:10.0
(XEN) PCI add device 0000:ff:10.1
(XEN) PCI add device 0000:ff:10.2
(XEN) PCI add device 0000:ff:10.3
(XEN) PCI add device 0000:ff:10.4
(XEN) PCI add device 0000:ff:10.5
(XEN) PCI add device 0000:ff:10.6
(XEN) PCI add device 0000:ff:10.7
(XEN) PCI add device 0000:ff:13.0
(XEN) PCI add device 0000:ff:13.1
(XEN) PCI add device 0000:ff:13.4
(XEN) PCI add device 0000:ff:13.5
(XEN) PCI add device 0000:ff:16.0
(XEN) PCI add device 0000:ff:16.1
(XEN) PCI add device 0000:ff:16.2
(XEN) HVM1 restore: CPU 0
(XEN) HVM1 restore: PIC 0
(XEN) HVM1 restore: PIC 1
(XEN) HVM1 restore: IOAPIC 0
(XEN) HVM1 restore: LAPIC 0
(XEN) HVM1 restore: LAPIC_REGS 0
(XEN) HVM1 restore: PCI_IRQ 0
(XEN) HVM1 restore: ISA_IRQ 0
(XEN) HVM1 restore: PCI_LINK 0
(XEN) HVM1 restore: PIT 0
(XEN) HVM1 restore: RTC 0
(XEN) HVM1 restore: HPET 0
(XEN) HVM1 restore: PMTIMER 0
(XEN) HVM1 restore: MTRR 0
(XEN) HVM1 restore: CPU_XSAVE 0
(XEN) HVM1 restore: VMCE_VCPU 0
(XEN) HVM1 restore: TSC_ADJUST 0
(XEN) d1v0: upcall vector b0

[-- Attachment #3: dmesg.log --]
[-- Type: application/octet-stream, Size: 58311 bytes --]

Linux version 4.12.0-rc2 (xikangjie@skyeye.360.cn) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-16) (GCC) ) #1 SMP Mon May 22 16:05:18 CST 2017
Command line: ro root=/dev/mapper/VolGroup00-LogVol--ROOT rd_NO_LUKS rd_LVM_LV=VolGroup00/LogVol-ROOT rd_LVM_LV=VolGroup00/LogVol-SWAP rd_NO_MD quiet SYSFONT=latarcyrheb-sun16 rhgb crashkernel=auto  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM LANG=en_US.UTF-8
x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
Released 0 page(s)
e820: BIOS-provided physical RAM map:
Xen: [mem 0x0000000000000000-0x000000000009cfff] usable
Xen: [mem 0x000000000009d800-0x00000000000fffff] reserved
Xen: [mem 0x0000000000100000-0x000000007de9cfff] usable
Xen: [mem 0x000000007de9d000-0x000000007dec0fff] reserved
Xen: [mem 0x000000007dec1000-0x000000007dfd6fff] ACPI data
Xen: [mem 0x000000007dfd7000-0x000000007e1f0fff] ACPI NVS
Xen: [mem 0x000000007e1f1000-0x000000007f342fff] reserved
Xen: [mem 0x000000007f343000-0x000000007f363fff] usable
Xen: [mem 0x000000007f364000-0x000000007f365fff] reserved
Xen: [mem 0x000000007f366000-0x000000007f366fff] usable
Xen: [mem 0x000000007f367000-0x000000007f3ecfff] ACPI NVS
Xen: [mem 0x000000007f3ed000-0x000000007f7fffff] usable
Xen: [mem 0x0000000080000000-0x000000008fffffff] reserved
Xen: [mem 0x00000000dfffc000-0x00000000dfffcfff] reserved
Xen: [mem 0x00000000fbffe000-0x00000000fbffefff] reserved
Xen: [mem 0x00000000fec00000-0x00000000fec01fff] reserved
Xen: [mem 0x00000000fec40000-0x00000000fec40fff] reserved
Xen: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
Xen: [mem 0x00000000fee00000-0x00000000feefffff] reserved
Xen: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
Xen: [mem 0x0000000100000000-0x000000207fffffff] usable
tsc: Fast TSC calibration using PIT
NX (Execute Disable) protection: active
SMBIOS 2.7 present.
DMI: Inspur NF5270M3/NF5270M3, BIOS CHEETAH-TY_2.1.7 05/22/2014
Hypervisor detected: Xen PV
e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
e820: remove [mem 0x000a0000-0x000fffff] usable
e820: last_pfn = 0x2080000 max_arch_pfn = 0x400000000
MTRR: Disabled
x86/PAT: MTRRs disabled, skipping PAT initialization too.
x86/PAT: Configuration [0-7]: WB  WT  UC- UC  WC  WP  UC  UC  
e820: last_pfn = 0x7f800 max_arch_pfn = 0x400000000
Base memory trampoline at [ffff880000096000] 96000 size 28672
BRK [0x020b6000, 0x020b6fff] PGTABLE
BRK [0x020b7000, 0x020b7fff] PGTABLE
BRK [0x020b8000, 0x020b8fff] PGTABLE
BRK [0x020b9000, 0x020b9fff] PGTABLE
BRK [0x020ba000, 0x020bafff] PGTABLE
BRK [0x020bb000, 0x020bbfff] PGTABLE
RAMDISK: [mem 0x04000000-0x04e33fff]
ACPI: Early table checksum verification disabled
ACPI: RSDP 0x00000000000F0490 000024 (v02 ALASKA)
ACPI: XSDT 0x000000007DEF8090 00009C (v01 ALASKA A M I    01072009 AMI  00010013)
ACPI: FACP 0x000000007DF04BC0 00010C (v05 ALASKA A M I    01072009 AMI  00010013)
ACPI: DSDT 0x000000007DEF81B8 00CA01 (v02 ALASKA A M I    00000021 INTL 20051117)
ACPI: FACS 0x000000007E1E8080 000040
ACPI: APIC 0x000000007DF04CD0 0001B4 (v03 ALASKA A M I    01072009 AMI  00010013)
ACPI: FPDT 0x000000007DF04E88 000044 (v01 ALASKA A M I    01072009 AMI  00010013)
ACPI: MCFG 0x000000007DF04ED0 00003C (v01 ALASKA OEMMCFG. 01072009 MSFT 00000097)
ACPI: SRAT 0x000000007DF04F10 000430 (v01 A M I  AMI SRAT 00000001 AMI. 00000000)
ACPI: SLIT 0x000000007DF05340 000030 (v01 A M I  AMI SLIT 00000000 AMI. 00000000)
ACPI: HPET 0x000000007DF05370 000038 (v01 ALASKA A M I    01072009 AMI. 00000005)
ACPI: PRAD 0x000000007DF053A8 0000BE (v02 PRADID PRADTID  00000001 MSFT 03000001)
ACPI: SPMI 0x000000007DF05468 000040 (v05 A M I  OEMSPMI  00000000 AMI. 00000000)
ACPI: SSDT 0x000000007DF054A8 0D0CB0 (v02 INTEL  CpuPm    00004000 INTL 20051117)
ACPI: EINJ 0x000000007DFD6158 000130 (v01 AMI    AMI EINJ 00000000      00000000)
ACPI: ERST 0x000000007DFD6288 000230 (v01 AMIER  AMI ERST 00000000      00000000)
ACPI: HEST 0x000000007DFD64B8 0000A8 (v01 AMI    AMI HEST 00000000      00000000)
ACPI: BERT 0x000000007DFD6560 000030 (v01 AMI    AMI BERT 00000000      00000000)
ACPI: RMAD 0x000000007DFD6590 000170 (v01 A M I  OEMDMAR  00000001 INTL 00000001)
ACPI: Local APIC address 0xfee00000
Setting APIC routing to Xen PV.
NUMA turned off
Faking a node at [mem 0x0000000000000000-0x000000207fffffff]
NODE_DATA(0) allocated [mem 0x13eff84000-0x13effa5fff]
crashkernel: memory value expected
Zone ranges:
  DMA      [mem 0x0000000000001000-0x0000000000ffffff]
  DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
  Normal   [mem 0x0000000100000000-0x000000207fffffff]
Movable zone start for each node
Early memory node ranges
  node   0: [mem 0x0000000000001000-0x000000000009cfff]
  node   0: [mem 0x0000000000100000-0x000000007de9cfff]
  node   0: [mem 0x000000007f343000-0x000000007f363fff]
  node   0: [mem 0x000000007f366000-0x000000007f366fff]
  node   0: [mem 0x000000007f3ed000-0x000000007f7fffff]
  node   0: [mem 0x0000000100000000-0x000000207fffffff]
Initmem setup node 0 [mem 0x0000000000001000-0x000000207fffffff]
On node 0 totalpages: 33546862
  DMA zone: 64 pages used for memmap
  DMA zone: 22 pages reserved
  DMA zone: 3996 pages, LIFO batch:0
  DMA32 zone: 8012 pages used for memmap
  DMA32 zone: 512722 pages, LIFO batch:31
  Normal zone: 516096 pages used for memmap
  Normal zone: 33030144 pages, LIFO batch:31
p2m virtual area at ffffc90000000000, size is 40000000
Remapped 531857 page(s)
ACPI: PM-Timer IO Port: 0x408
ACPI: Local APIC address 0xfee00000
ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x0a] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x0c] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x0e] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x10] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x12] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x14] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x16] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x09] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x0b] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x0d] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x0f] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x11] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x13] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x15] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x17] high edge lint[0x1])
IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47
IOAPIC[2]: apic_id 3, version 32, address 0xfec40000, GSI 48-71
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: IRQ0 used by override.
ACPI: IRQ9 used by override.
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a701 base: 0xfed00000
smpboot: Allowing 24 CPUs, 0 hotplug CPUs
PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
PM: Registered nosave memory: [mem 0x0009d000-0x0009dfff]
PM: Registered nosave memory: [mem 0x0009e000-0x000fffff]
PM: Registered nosave memory: [mem 0x7de9d000-0x7dec0fff]
PM: Registered nosave memory: [mem 0x7dec1000-0x7dfd6fff]
PM: Registered nosave memory: [mem 0x7dfd7000-0x7e1f0fff]
PM: Registered nosave memory: [mem 0x7e1f1000-0x7f342fff]
PM: Registered nosave memory: [mem 0x7f364000-0x7f365fff]
PM: Registered nosave memory: [mem 0x7f367000-0x7f3ecfff]
PM: Registered nosave memory: [mem 0x7f800000-0x7fffffff]
PM: Registered nosave memory: [mem 0x80000000-0x8fffffff]
PM: Registered nosave memory: [mem 0x90000000-0xdfffbfff]
PM: Registered nosave memory: [mem 0xdfffc000-0xdfffcfff]
PM: Registered nosave memory: [mem 0xdfffd000-0xfbffdfff]
PM: Registered nosave memory: [mem 0xfbffe000-0xfbffefff]
PM: Registered nosave memory: [mem 0xfbfff000-0xfebfffff]
PM: Registered nosave memory: [mem 0xfec00000-0xfec01fff]
PM: Registered nosave memory: [mem 0xfec02000-0xfec3ffff]
PM: Registered nosave memory: [mem 0xfec40000-0xfec40fff]
PM: Registered nosave memory: [mem 0xfec41000-0xfed1bfff]
PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
PM: Registered nosave memory: [mem 0xfee00000-0xfeefffff]
PM: Registered nosave memory: [mem 0xfef00000-0xfeffffff]
PM: Registered nosave memory: [mem 0xff000000-0xffffffff]
e820: [mem 0x90000000-0xdfffbfff] available for PCI devices
Booting paravirtualized kernel on Xen
Xen version: 4.9-rc (preserve-AD)
clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
setup_percpu: NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:24 nr_node_ids:1
percpu: Embedded 38 pages/cpu @ffff881481600000 s116312 r8192 d31144 u262144
pcpu-alloc: s116312 r8192 d31144 u262144 alloc=1*2097152
pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15 
pcpu-alloc: [0] 16 17 18 19 20 21 22 23 
Built 1 zonelists in Node order, mobility grouping on.  Total pages: 33022668
Policy zone: Normal
Kernel command line: ro root=/dev/mapper/VolGroup00-LogVol--ROOT rd_NO_LUKS rd_LVM_LV=VolGroup00/LogVol-ROOT rd_LVM_LV=VolGroup00/LogVol-SWAP rd_NO_MD quiet SYSFONT=latarcyrheb-sun16 rhgb crashkernel=auto  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM LANG=en_US.UTF-8
PID hash table entries: 4096 (order: 3, 32768 bytes)
software IO TLB [mem 0x147d600000-0x1481600000] (64MB) mapped at [ffff88147d600000-ffff8814815fffff]
Memory: 81157460K/134187448K available (7372K kernel code, 1202K rwdata, 2196K rodata, 2152K init, 1368K bss, 53029988K reserved, 0K cma-reserved)
ftrace: allocating 29690 entries in 116 pages
Hierarchical RCU implementation.
	RCU restricting CPUs from NR_CPUS=32 to nr_cpu_ids=24.
RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=24
Using NULL legacy PIC
NR_IRQS:4352 nr_irqs:1432 0
xen:events: Using FIFO-based ABI
xen: --> pirq=1 -> irq=1 (gsi=1)
xen: --> pirq=2 -> irq=2 (gsi=2)
xen: --> pirq=3 -> irq=3 (gsi=3)
xen: --> pirq=4 -> irq=4 (gsi=4)
xen: --> pirq=5 -> irq=5 (gsi=5)
xen: --> pirq=6 -> irq=6 (gsi=6)
xen: --> pirq=7 -> irq=7 (gsi=7)
xen: --> pirq=8 -> irq=8 (gsi=8)
xen: --> pirq=9 -> irq=9 (gsi=9)
xen: --> pirq=10 -> irq=10 (gsi=10)
xen: --> pirq=11 -> irq=11 (gsi=11)
xen: --> pirq=12 -> irq=12 (gsi=12)
xen: --> pirq=13 -> irq=13 (gsi=13)
xen: --> pirq=14 -> irq=14 (gsi=14)
xen: --> pirq=15 -> irq=15 (gsi=15)
Console: colour VGA+ 80x25
console [tty0] enabled
clocksource: xen: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
Xen: using vcpuop timer interface
installing Xen timer for CPU 0
tsc: Fast TSC calibration using PIT
tsc: Detected 2600.224 MHz processor
Calibrating delay loop (skipped), value calculated using timer frequency.. 5200.02 BogoMIPS (lpj=2600014)
pid_max: default: 32768 minimum: 301
ACPI: Core revision 20170303
ACPI: 2 ACPI AML tables successfully acquired and loaded
Security Framework initialized
SELinux:  Initializing.
SELinux:  Starting in permissive mode
Dentry cache hash table entries: 16777216 (order: 15, 134217728 bytes)
Inode-cache hash table entries: 8388608 (order: 14, 67108864 bytes)
Mount-cache hash table entries: 262144 (order: 9, 2097152 bytes)
Mountpoint-cache hash table entries: 262144 (order: 9, 2097152 bytes)
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
mce: CPU supports 2 MCE banks
Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
Last level dTLB entries: 4KB 512, 2MB 0, 4MB 0, 1GB 4
Freeing SMP alternatives memory: 28K
smpboot: Max logical packages: 2
VPMU disabled by hypervisor.
Performance Events: unsupported p6 CPU model 62 no PMU driver, software events only.
smp: Bringing up secondary CPUs ...
installing Xen timer for CPU 1
installing Xen timer for CPU 2
installing Xen timer for CPU 3
installing Xen timer for CPU 4
installing Xen timer for CPU 5
installing Xen timer for CPU 6
installing Xen timer for CPU 7
installing Xen timer for CPU 8
installing Xen timer for CPU 9
installing Xen timer for CPU 10
installing Xen timer for CPU 11
installing Xen timer for CPU 12
installing Xen timer for CPU 13
installing Xen timer for CPU 14
installing Xen timer for CPU 15
installing Xen timer for CPU 16
installing Xen timer for CPU 17
installing Xen timer for CPU 18
installing Xen timer for CPU 19
installing Xen timer for CPU 20
installing Xen timer for CPU 21
installing Xen timer for CPU 22
installing Xen timer for CPU 23
smp: Brought up 1 node, 24 CPUs
sched_clock: Marking stable (153000000, 0)->(22325603553, -22172603553)
devtmpfs: initialized
x86/mm: Memory block size: 2048MB
PM: Registering ACPI NVS region [mem 0x7dfd7000-0x7e1f0fff] (2203648 bytes)
PM: Registering ACPI NVS region [mem 0x7f367000-0x7f3ecfff] (548864 bytes)
clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
futex hash table entries: 8192 (order: 7, 524288 bytes)
NET: Registered protocol family 16
xen:grant_table: Grant tables using version 1 layout
Grant table initialized
PCCT header not found.
ACPI: bus type PCI registered
acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
PCI: Using configuration type 1 for base access
random: fast init done
ACPI: Added _OSI(Module Device)
ACPI: Added _OSI(Processor Device)
ACPI: Added _OSI(3.0 _SCP Extensions)
ACPI: Added _OSI(Processor Aggregator Device)
xen: registering gsi 9 triggering 0 polarity 0
ACPI: Executed 1 blocks of module-level executable AML code
ACPI: Interpreter enabled
ACPI: (supports S0 S1 S5)
ACPI: Using IOAPIC for interrupt routing
HEST: Table parsing has been initialized.
PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
acpi PNP0A08:00: _OSC: platform does not support [AER]
acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x0000-0x03af window]
pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7 window]
pci_bus 0000:00: root bus resource [io  0x03b0-0x03df window]
pci_bus 0000:00: root bus resource [io  0x0d00-0x9fff window]
pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000dffff window]
pci_bus 0000:00: root bus resource [mem 0x80000000-0xdfffffff window]
pci_bus 0000:00: root bus resource [bus 00-7e]
pci 0000:00:00.0: [8086:0e00] type 00 class 0x060000
pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
pci 0000:00:01.0: [8086:0e02] type 01 class 0x060400
pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
pci 0000:00:01.0: System wakeup disabled by ACPI
pci 0000:00:01.1: [8086:0e03] type 01 class 0x060400
pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
pci 0000:00:01.1: System wakeup disabled by ACPI
pci 0000:00:02.0: [8086:0e04] type 01 class 0x060400
pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
pci 0000:00:02.0: System wakeup disabled by ACPI
pci 0000:00:02.2: [8086:0e06] type 01 class 0x060400
pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
pci 0000:00:02.2: System wakeup disabled by ACPI
pci 0000:00:03.0: [8086:0e08] type 01 class 0x060400
pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
pci 0000:00:03.0: System wakeup disabled by ACPI
pci 0000:00:04.0: [8086:0e20] type 00 class 0x088000
pci 0000:00:04.0: reg 0x10: [mem 0xdf31c000-0xdf31ffff 64bit]
pci 0000:00:04.1: [8086:0e21] type 00 class 0x088000
pci 0000:00:04.1: reg 0x10: [mem 0xdf318000-0xdf31bfff 64bit]
pci 0000:00:04.2: [8086:0e22] type 00 class 0x088000
pci 0000:00:04.2: reg 0x10: [mem 0xdf314000-0xdf317fff 64bit]
pci 0000:00:04.3: [8086:0e23] type 00 class 0x088000
pci 0000:00:04.3: reg 0x10: [mem 0xdf310000-0xdf313fff 64bit]
pci 0000:00:04.4: [8086:0e24] type 00 class 0x088000
pci 0000:00:04.4: reg 0x10: [mem 0xdf30c000-0xdf30ffff 64bit]
pci 0000:00:04.5: [8086:0e25] type 00 class 0x088000
pci 0000:00:04.5: reg 0x10: [mem 0xdf308000-0xdf30bfff 64bit]
pci 0000:00:04.6: [8086:0e26] type 00 class 0x088000
pci 0000:00:04.6: reg 0x10: [mem 0xdf304000-0xdf307fff 64bit]
pci 0000:00:04.7: [8086:0e27] type 00 class 0x088000
pci 0000:00:04.7: reg 0x10: [mem 0xdf300000-0xdf303fff 64bit]
pci 0000:00:05.0: [8086:0e28] type 00 class 0x088000
pci 0000:00:05.2: [8086:0e2a] type 00 class 0x088000
pci 0000:00:05.4: [8086:0e2c] type 00 class 0x080020
pci 0000:00:05.4: reg 0x10: [mem 0xdf327000-0xdf327fff]
pci 0000:00:11.0: [8086:1d3e] type 01 class 0x060400
pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
pci 0000:00:16.0: [8086:1d3a] type 00 class 0x078000
pci 0000:00:16.0: reg 0x10: [mem 0xdf326000-0xdf32600f 64bit]
pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
pci 0000:00:16.1: [8086:1d3b] type 00 class 0x078000
pci 0000:00:16.1: reg 0x10: [mem 0xdf325000-0xdf32500f 64bit]
pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
pci 0000:00:1a.0: [8086:1d2d] type 00 class 0x0c0320
pci 0000:00:1a.0: reg 0x10: [mem 0xdf323000-0xdf3233ff]
pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1a.0: System wakeup disabled by ACPI
pci 0000:00:1c.0: [8086:1d10] type 01 class 0x060400
pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.0: Disabling UPDCR peer decodes
pci 0000:00:1c.0: Enabling MPC IRBNCE
pci 0000:00:1c.0: Intel PCH root port ACS workaround enabled
pci 0000:00:1c.0: System wakeup disabled by ACPI
pci 0000:00:1c.7: [8086:1d1e] type 01 class 0x060400
pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.7: Enabling MPC IRBNCE
pci 0000:00:1c.7: Intel PCH root port ACS workaround enabled
pci 0000:00:1c.7: System wakeup disabled by ACPI
pci 0000:00:1d.0: [8086:1d26] type 00 class 0x0c0320
pci 0000:00:1d.0: reg 0x10: [mem 0xdf322000-0xdf3223ff]
pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1d.0: System wakeup disabled by ACPI
pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401
pci 0000:00:1e.0: System wakeup disabled by ACPI
pci 0000:00:1f.0: [8086:1d41] type 00 class 0x060100
pci 0000:00:1f.2: [8086:1d02] type 00 class 0x010601
pci 0000:00:1f.2: reg 0x10: [io  0x9070-0x9077]
pci 0000:00:1f.2: reg 0x14: [io  0x9060-0x9063]
pci 0000:00:1f.2: reg 0x18: [io  0x9050-0x9057]
pci 0000:00:1f.2: reg 0x1c: [io  0x9040-0x9043]
pci 0000:00:1f.2: reg 0x20: [io  0x9020-0x903f]
pci 0000:00:1f.2: reg 0x24: [mem 0xdf321000-0xdf3217ff]
pci 0000:00:1f.2: PME# supported from D3hot
pci 0000:00:1f.3: [8086:1d22] type 00 class 0x0c0500
pci 0000:00:1f.3: reg 0x10: [mem 0xdf320000-0xdf3200ff 64bit]
pci 0000:00:1f.3: reg 0x20: [io  0x9000-0x901f]
pci 0000:00:01.0: PCI bridge to [bus 01]
pci 0000:00:01.1: PCI bridge to [bus 02]
pci 0000:00:02.0: PCI bridge to [bus 03]
pci 0000:00:02.2: PCI bridge to [bus 04]
pci 0000:00:03.0: PCI bridge to [bus 05]
pci 0000:06:00.0: [8086:1d6b] type 00 class 0x010700
pci 0000:06:00.0: reg 0x10: [mem 0xdfc7c000-0xdfc7ffff 64bit pref]
pci 0000:06:00.0: reg 0x18: [mem 0xdf800000-0xdfbfffff 64bit pref]
pci 0000:06:00.0: reg 0x20: [io  0x8000-0x80ff]
pci 0000:06:00.0: reg 0x164: [mem 0xdfc00000-0xdfc03fff 64bit pref]
pci 0000:06:00.0: VF(n) BAR0 space: [mem 0xdfc00000-0xdfc7bfff 64bit pref] (contains BAR0 for 31 VFs)
pci 0000:00:11.0: PCI bridge to [bus 06]
pci 0000:00:11.0:   bridge window [io  0x8000-0x8fff]
pci 0000:00:11.0:   bridge window [mem 0xdf200000-0xdf2fffff]
pci 0000:00:11.0:   bridge window [mem 0xdf800000-0xdfcfffff 64bit pref]
pci 0000:07:00.0: [8086:1521] type 00 class 0x020000
pci 0000:07:00.0: reg 0x10: [mem 0xdf120000-0xdf13ffff]
pci 0000:07:00.0: reg 0x18: [io  0x7020-0x703f]
pci 0000:07:00.0: reg 0x1c: [mem 0xdf144000-0xdf147fff]
pci 0000:07:00.0: PME# supported from D0 D3hot D3cold
pci 0000:07:00.0: reg 0x184: [mem 0xdfe60000-0xdfe63fff 64bit pref]
pci 0000:07:00.0: VF(n) BAR0 space: [mem 0xdfe60000-0xdfe7ffff 64bit pref] (contains BAR0 for 8 VFs)
pci 0000:07:00.0: reg 0x190: [mem 0xdfe40000-0xdfe43fff 64bit pref]
pci 0000:07:00.0: VF(n) BAR3 space: [mem 0xdfe40000-0xdfe5ffff 64bit pref] (contains BAR3 for 8 VFs)
pci 0000:07:00.1: [8086:1521] type 00 class 0x020000
pci 0000:07:00.1: reg 0x10: [mem 0xdf100000-0xdf11ffff]
pci 0000:07:00.1: reg 0x18: [io  0x7000-0x701f]
pci 0000:07:00.1: reg 0x1c: [mem 0xdf140000-0xdf143fff]
pci 0000:07:00.1: PME# supported from D0 D3hot D3cold
pci 0000:07:00.1: reg 0x184: [mem 0xdfe20000-0xdfe23fff 64bit pref]
pci 0000:07:00.1: VF(n) BAR0 space: [mem 0xdfe20000-0xdfe3ffff 64bit pref] (contains BAR0 for 8 VFs)
pci 0000:07:00.1: reg 0x190: [mem 0xdfe00000-0xdfe03fff 64bit pref]
pci 0000:07:00.1: VF(n) BAR3 space: [mem 0xdfe00000-0xdfe1ffff 64bit pref] (contains BAR3 for 8 VFs)
pci 0000:00:1c.0: PCI bridge to [bus 07-08]
pci 0000:00:1c.0:   bridge window [io  0x7000-0x7fff]
pci 0000:00:1c.0:   bridge window [mem 0xdf100000-0xdf1fffff]
pci 0000:00:1c.0:   bridge window [mem 0xdfe00000-0xdfefffff 64bit pref]
pci 0000:09:00.0: [1a03:1150] type 01 class 0x060400
pci 0000:09:00.0: supports D1 D2
pci 0000:09:00.0: PME# supported from D0 D1 D2 D3hot D3cold
pci 0000:09:00.0: disabling ASPM on pre-1.1 PCIe device.  You can enable it with 'pcie_aspm=force'
pci 0000:00:1c.7: PCI bridge to [bus 09-0a]
pci 0000:00:1c.7:   bridge window [io  0x6000-0x6fff]
pci 0000:00:1c.7:   bridge window [mem 0xde000000-0xdf0fffff]
pci 0000:0a:00.0: [1a03:2000] type 00 class 0x030000
pci 0000:0a:00.0: reg 0x10: [mem 0xde000000-0xdeffffff]
pci 0000:0a:00.0: reg 0x14: [mem 0xdf000000-0xdf01ffff]
pci 0000:0a:00.0: reg 0x18: [io  0x6000-0x607f]
pci 0000:0a:00.0: supports D1 D2
pci 0000:0a:00.0: PME# supported from D0 D1 D2 D3hot D3cold
pci 0000:09:00.0: PCI bridge to [bus 0a]
pci 0000:09:00.0:   bridge window [io  0x6000-0x6fff]
pci 0000:09:00.0:   bridge window [mem 0xde000000-0xdf0fffff]
pci 0000:00:1e.0: PCI bridge to [bus 0b] (subtractive decode)
pci 0000:00:1e.0:   bridge window [io  0x0000-0x03af window] (subtractive decode)
pci 0000:00:1e.0:   bridge window [io  0x03e0-0x0cf7 window] (subtractive decode)
pci 0000:00:1e.0:   bridge window [io  0x03b0-0x03df window] (subtractive decode)
pci 0000:00:1e.0:   bridge window [io  0x0d00-0x9fff window] (subtractive decode)
pci 0000:00:1e.0:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
pci 0000:00:1e.0:   bridge window [mem 0x000c0000-0x000dffff window] (subtractive decode)
pci 0000:00:1e.0:   bridge window [mem 0x80000000-0xdfffffff window] (subtractive decode)
xen: registering gsi 13 triggering 1 polarity 0
ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus 7f])
acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
acpi PNP0A03:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
PCI host bridge to bus 0000:7f
pci_bus 0000:7f: root bus resource [bus 7f]
pci 0000:7f:08.0: [8086:0e80] type 00 class 0x088000
pci 0000:7f:09.0: [8086:0e90] type 00 class 0x088000
pci 0000:7f:0a.0: [8086:0ec0] type 00 class 0x088000
pci 0000:7f:0a.1: [8086:0ec1] type 00 class 0x088000
pci 0000:7f:0a.2: [8086:0ec2] type 00 class 0x088000
pci 0000:7f:0a.3: [8086:0ec3] type 00 class 0x088000
pci 0000:7f:0b.0: [8086:0e1e] type 00 class 0x088000
pci 0000:7f:0b.3: [8086:0e1f] type 00 class 0x088000
pci 0000:7f:0c.0: [8086:0ee0] type 00 class 0x088000
pci 0000:7f:0c.1: [8086:0ee2] type 00 class 0x088000
pci 0000:7f:0c.2: [8086:0ee4] type 00 class 0x088000
pci 0000:7f:0d.0: [8086:0ee1] type 00 class 0x088000
pci 0000:7f:0d.1: [8086:0ee3] type 00 class 0x088000
pci 0000:7f:0d.2: [8086:0ee5] type 00 class 0x088000
pci 0000:7f:0e.0: [8086:0ea0] type 00 class 0x088000
pci 0000:7f:0e.1: [8086:0e30] type 00 class 0x110100
pci 0000:7f:0f.0: [8086:0ea8] type 00 class 0x088000
pci 0000:7f:0f.1: [8086:0e71] type 00 class 0x088000
pci 0000:7f:0f.2: [8086:0eaa] type 00 class 0x088000
pci 0000:7f:0f.3: [8086:0eab] type 00 class 0x088000
pci 0000:7f:0f.4: [8086:0eac] type 00 class 0x088000
pci 0000:7f:0f.5: [8086:0ead] type 00 class 0x088000
pci 0000:7f:10.0: [8086:0eb0] type 00 class 0x088000
pci 0000:7f:10.1: [8086:0eb1] type 00 class 0x088000
pci 0000:7f:10.2: [8086:0eb2] type 00 class 0x088000
pci 0000:7f:10.3: [8086:0eb3] type 00 class 0x088000
pci 0000:7f:10.4: [8086:0eb4] type 00 class 0x088000
pci 0000:7f:10.5: [8086:0eb5] type 00 class 0x088000
pci 0000:7f:10.6: [8086:0eb6] type 00 class 0x088000
pci 0000:7f:10.7: [8086:0eb7] type 00 class 0x088000
pci 0000:7f:13.0: [8086:0e1d] type 00 class 0x088000
pci 0000:7f:13.1: [8086:0e34] type 00 class 0x110100
pci 0000:7f:13.4: [8086:0e81] type 00 class 0x088000
pci 0000:7f:13.5: [8086:0e36] type 00 class 0x110100
pci 0000:7f:16.0: [8086:0ec8] type 00 class 0x088000
pci 0000:7f:16.1: [8086:0ec9] type 00 class 0x088000
pci 0000:7f:16.2: [8086:0eca] type 00 class 0x088000
ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
acpi PNP0A08:01: _OSC: platform does not support [AER]
acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
PCI host bridge to bus 0000:80
pci_bus 0000:80: root bus resource [io  0xa000-0xffff window]
pci_bus 0000:80: root bus resource [mem 0xe0000000-0xfbffffff window]
pci_bus 0000:80: root bus resource [bus 80-fe]
pci 0000:80:00.0: [8086:0e01] type 01 class 0x060400
pci 0000:80:00.0: PME# supported from D0 D3hot D3cold
pci 0000:80:01.0: [8086:0e02] type 01 class 0x060400
pci 0000:80:01.0: PME# supported from D0 D3hot D3cold
pci 0000:80:02.0: [8086:0e04] type 01 class 0x060400
pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
pci 0000:80:03.0: [8086:0e08] type 01 class 0x060400
pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
pci 0000:80:04.0: [8086:0e20] type 00 class 0x088000
pci 0000:80:04.0: reg 0x10: [mem 0xfbf1c000-0xfbf1ffff 64bit]
pci 0000:80:04.1: [8086:0e21] type 00 class 0x088000
pci 0000:80:04.1: reg 0x10: [mem 0xfbf18000-0xfbf1bfff 64bit]
pci 0000:80:04.2: [8086:0e22] type 00 class 0x088000
pci 0000:80:04.2: reg 0x10: [mem 0xfbf14000-0xfbf17fff 64bit]
pci 0000:80:04.3: [8086:0e23] type 00 class 0x088000
pci 0000:80:04.3: reg 0x10: [mem 0xfbf10000-0xfbf13fff 64bit]
pci 0000:80:04.4: [8086:0e24] type 00 class 0x088000
pci 0000:80:04.4: reg 0x10: [mem 0xfbf0c000-0xfbf0ffff 64bit]
pci 0000:80:04.5: [8086:0e25] type 00 class 0x088000
pci 0000:80:04.5: reg 0x10: [mem 0xfbf08000-0xfbf0bfff 64bit]
pci 0000:80:04.6: [8086:0e26] type 00 class 0x088000
pci 0000:80:04.6: reg 0x10: [mem 0xfbf04000-0xfbf07fff 64bit]
pci 0000:80:04.7: [8086:0e27] type 00 class 0x088000
pci 0000:80:04.7: reg 0x10: [mem 0xfbf00000-0xfbf03fff 64bit]
pci 0000:80:05.0: [8086:0e28] type 00 class 0x088000
pci 0000:80:05.2: [8086:0e2a] type 00 class 0x088000
pci 0000:80:05.4: [8086:0e2c] type 00 class 0x080020
pci 0000:80:05.4: reg 0x10: [mem 0xfbf20000-0xfbf20fff]
pci 0000:80:00.0: PCI bridge to [bus 81]
pci 0000:82:00.0: [1000:0079] type 00 class 0x010400
pci 0000:82:00.0: reg 0x10: [io  0xf000-0xf0ff]
pci 0000:82:00.0: reg 0x14: [mem 0xfbe80000-0xfbe83fff 64bit]
pci 0000:82:00.0: reg 0x1c: [mem 0xfbe40000-0xfbe7ffff 64bit]
pci 0000:82:00.0: reg 0x30: [mem 0xfbe00000-0xfbe3ffff pref]
pci 0000:82:00.0: supports D1 D2
pci 0000:80:01.0: PCI bridge to [bus 82]
pci 0000:80:01.0:   bridge window [io  0xf000-0xffff]
pci 0000:80:01.0:   bridge window [mem 0xfbe00000-0xfbefffff]
pci 0000:80:02.0: PCI bridge to [bus 83]
pci 0000:84:00.0: [8086:1521] type 00 class 0x020000
pci 0000:84:00.0: reg 0x10: [mem 0xfbb00000-0xfbbfffff]
pci 0000:84:00.0: reg 0x1c: [mem 0xfbd04000-0xfbd07fff]
pci 0000:84:00.0: reg 0x30: [mem 0xfbc80000-0xfbcfffff pref]
pci 0000:84:00.0: PME# supported from D0 D3hot D3cold
pci 0000:84:00.0: reg 0x184: [mem 0xfb960000-0xfb963fff 64bit pref]
pci 0000:84:00.0: VF(n) BAR0 space: [mem 0xfb960000-0xfb97ffff 64bit pref] (contains BAR0 for 8 VFs)
pci 0000:84:00.0: reg 0x190: [mem 0xfb940000-0xfb943fff 64bit pref]
pci 0000:84:00.0: VF(n) BAR3 space: [mem 0xfb940000-0xfb95ffff 64bit pref] (contains BAR3 for 8 VFs)
pci 0000:84:00.1: [8086:1521] type 00 class 0x020000
pci 0000:84:00.1: reg 0x10: [mem 0xfba00000-0xfbafffff]
pci 0000:84:00.1: reg 0x1c: [mem 0xfbd00000-0xfbd03fff]
pci 0000:84:00.1: reg 0x30: [mem 0xfbc00000-0xfbc7ffff pref]
pci 0000:84:00.1: PME# supported from D0 D3hot D3cold
pci 0000:84:00.1: reg 0x184: [mem 0xfb920000-0xfb923fff 64bit pref]
pci 0000:84:00.1: VF(n) BAR0 space: [mem 0xfb920000-0xfb93ffff 64bit pref] (contains BAR0 for 8 VFs)
pci 0000:84:00.1: reg 0x190: [mem 0xfb900000-0xfb903fff 64bit pref]
pci 0000:84:00.1: VF(n) BAR3 space: [mem 0xfb900000-0xfb91ffff 64bit pref] (contains BAR3 for 8 VFs)
pci 0000:80:03.0: PCI bridge to [bus 84-85]
pci 0000:80:03.0:   bridge window [mem 0xfba00000-0xfbdfffff]
pci 0000:80:03.0:   bridge window [mem 0xfb900000-0xfb9fffff 64bit pref]
ACPI: PCI Root Bridge [UNC1] (domain 0000 [bus ff])
acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
acpi PNP0A03:01: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
PCI host bridge to bus 0000:ff
pci_bus 0000:ff: root bus resource [bus ff]
pci 0000:ff:08.0: [8086:0e80] type 00 class 0x088000
pci 0000:ff:09.0: [8086:0e90] type 00 class 0x088000
pci 0000:ff:0a.0: [8086:0ec0] type 00 class 0x088000
pci 0000:ff:0a.1: [8086:0ec1] type 00 class 0x088000
pci 0000:ff:0a.2: [8086:0ec2] type 00 class 0x088000
pci 0000:ff:0a.3: [8086:0ec3] type 00 class 0x088000
pci 0000:ff:0b.0: [8086:0e1e] type 00 class 0x088000
pci 0000:ff:0b.3: [8086:0e1f] type 00 class 0x088000
pci 0000:ff:0c.0: [8086:0ee0] type 00 class 0x088000
pci 0000:ff:0c.1: [8086:0ee2] type 00 class 0x088000
pci 0000:ff:0c.2: [8086:0ee4] type 00 class 0x088000
pci 0000:ff:0d.0: [8086:0ee1] type 00 class 0x088000
pci 0000:ff:0d.1: [8086:0ee3] type 00 class 0x088000
pci 0000:ff:0d.2: [8086:0ee5] type 00 class 0x088000
pci 0000:ff:0e.0: [8086:0ea0] type 00 class 0x088000
pci 0000:ff:0e.1: [8086:0e30] type 00 class 0x110100
pci 0000:ff:0f.0: [8086:0ea8] type 00 class 0x088000
pci 0000:ff:0f.1: [8086:0e71] type 00 class 0x088000
pci 0000:ff:0f.2: [8086:0eaa] type 00 class 0x088000
pci 0000:ff:0f.3: [8086:0eab] type 00 class 0x088000
pci 0000:ff:0f.4: [8086:0eac] type 00 class 0x088000
pci 0000:ff:0f.5: [8086:0ead] type 00 class 0x088000
pci 0000:ff:10.0: [8086:0eb0] type 00 class 0x088000
pci 0000:ff:10.1: [8086:0eb1] type 00 class 0x088000
pci 0000:ff:10.2: [8086:0eb2] type 00 class 0x088000
pci 0000:ff:10.3: [8086:0eb3] type 00 class 0x088000
pci 0000:ff:10.4: [8086:0eb4] type 00 class 0x088000
pci 0000:ff:10.5: [8086:0eb5] type 00 class 0x088000
pci 0000:ff:10.6: [8086:0eb6] type 00 class 0x088000
pci 0000:ff:10.7: [8086:0eb7] type 00 class 0x088000
pci 0000:ff:13.0: [8086:0e1d] type 00 class 0x088000
pci 0000:ff:13.1: [8086:0e34] type 00 class 0x110100
pci 0000:ff:13.4: [8086:0e81] type 00 class 0x088000
pci 0000:ff:13.5: [8086:0e36] type 00 class 0x110100
pci 0000:ff:16.0: [8086:0ec8] type 00 class 0x088000
pci 0000:ff:16.1: [8086:0ec9] type 00 class 0x088000
pci 0000:ff:16.2: [8086:0eca] type 00 class 0x088000
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKD] (IRQs *3 4 5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) *0
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 14 15) *0
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 12 14 15) *0
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *7 10 11 12 14 15)
ACPI: Enabled 4 GPEs in block 00 to 3F
xen:balloon: Initialising balloon driver
random: crng init done
xen_balloon: Initialising balloon driver
pci 0000:0a:00.0: vgaarb: setting as boot VGA device
pci 0000:0a:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
pci 0000:0a:00.0: vgaarb: bridge control possible
vgaarb: loaded
SCSI subsystem initialized
libata version 3.00 loaded.
ACPI: bus type USB registered
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
EDAC MC: Ver: 3.0.0
PCI: Using ACPI for IRQ routing
PCI: pci_cache_line_size set to 64 bytes
e820: reserve RAM buffer [mem 0x0009d000-0x0009ffff]
e820: reserve RAM buffer [mem 0x7de9d000-0x7fffffff]
e820: reserve RAM buffer [mem 0x7f364000-0x7fffffff]
e820: reserve RAM buffer [mem 0x7f367000-0x7fffffff]
e820: reserve RAM buffer [mem 0x7f800000-0x7fffffff]
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
NetLabel:  unlabeled traffic allowed by default
clocksource: Switched to clocksource xen
VFS: Disk quotas dquot_6.6.0
VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
hugetlbfs: disabling because there are no supported hugepage sizes
pnp: PnP ACPI init
system 00:00: [mem 0xfc000000-0xfcffffff] has been reserved
system 00:00: [mem 0xfd000000-0xfdffffff] has been reserved
system 00:00: [mem 0xfe000000-0xfeafffff] has been reserved
system 00:00: [mem 0xfeb00000-0xfebfffff] has been reserved
system 00:00: [mem 0xfed00400-0xfed3ffff] could not be reserved
system 00:00: [mem 0xfed45000-0xfedfffff] has been reserved
system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active)
system 00:01: [mem 0xdfffc000-0xdfffdfff] could not be reserved
system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
system 00:02: [io  0x0a00-0x0a1f] has been reserved
system 00:02: Plug and Play ACPI device, IDs PNP0c02 (active)
xen: registering gsi 4 triggering 1 polarity 0
pnp 00:03: [dma 0 disabled]
pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
xen: registering gsi 8 triggering 1 polarity 0
pnp 00:04: Plug and Play ACPI device, IDs PNP0b00 (active)
system 00:05: [io  0x04d0-0x04d1] has been reserved
system 00:05: Plug and Play ACPI device, IDs PNP0c02 (active)
system 00:06: [io  0x0400-0x0453] has been reserved
system 00:06: [io  0x0458-0x047f] has been reserved
system 00:06: [io  0x1180-0x119f] has been reserved
system 00:06: [io  0x0500-0x057f] has been reserved
system 00:06: [mem 0xfed1c000-0xfed1ffff] has been reserved
system 00:06: [mem 0xfec00000-0xfecfffff] could not be reserved
system 00:06: [mem 0xfed08000-0xfed08fff] has been reserved
system 00:06: [mem 0xff000000-0xffffffff] has been reserved
system 00:06: Plug and Play ACPI device, IDs PNP0c01 (active)
system 00:07: [io  0x0454-0x0457] has been reserved
system 00:07: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active)
system 00:08: Plug and Play ACPI device, IDs PNP0c01 (active)
system 00:09: [mem 0xfbffe000-0xfbffffff] could not be reserved
system 00:09: Plug and Play ACPI device, IDs PNP0c02 (active)
pnp: PnP ACPI: found 10 devices
PM-Timer failed consistency check  (0xffffff) - aborting.
pci 0000:00:01.0: PCI bridge to [bus 01]
pci 0000:00:01.1: PCI bridge to [bus 02]
pci 0000:00:02.0: PCI bridge to [bus 03]
pci 0000:00:02.2: PCI bridge to [bus 04]
pci 0000:00:03.0: PCI bridge to [bus 05]
pci 0000:00:11.0: PCI bridge to [bus 06]
pci 0000:00:11.0:   bridge window [io  0x8000-0x8fff]
pci 0000:00:11.0:   bridge window [mem 0xdf200000-0xdf2fffff]
pci 0000:00:11.0:   bridge window [mem 0xdf800000-0xdfcfffff 64bit pref]
pci 0000:00:1c.0: PCI bridge to [bus 07-08]
pci 0000:00:1c.0:   bridge window [io  0x7000-0x7fff]
pci 0000:00:1c.0:   bridge window [mem 0xdf100000-0xdf1fffff]
pci 0000:00:1c.0:   bridge window [mem 0xdfe00000-0xdfefffff 64bit pref]
pci 0000:09:00.0: PCI bridge to [bus 0a]
pci 0000:09:00.0:   bridge window [io  0x6000-0x6fff]
pci 0000:09:00.0:   bridge window [mem 0xde000000-0xdf0fffff]
pci 0000:00:1c.7: PCI bridge to [bus 09-0a]
pci 0000:00:1c.7:   bridge window [io  0x6000-0x6fff]
pci 0000:00:1c.7:   bridge window [mem 0xde000000-0xdf0fffff]
pci 0000:00:1e.0: PCI bridge to [bus 0b]
pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
pci_bus 0000:00: resource 6 [io  0x03b0-0x03df window]
pci_bus 0000:00: resource 7 [io  0x0d00-0x9fff window]
pci_bus 0000:00: resource 8 [mem 0x000a0000-0x000bffff window]
pci_bus 0000:00: resource 9 [mem 0x000c0000-0x000dffff window]
pci_bus 0000:00: resource 10 [mem 0x80000000-0xdfffffff window]
pci_bus 0000:06: resource 0 [io  0x8000-0x8fff]
pci_bus 0000:06: resource 1 [mem 0xdf200000-0xdf2fffff]
pci_bus 0000:06: resource 2 [mem 0xdf800000-0xdfcfffff 64bit pref]
pci_bus 0000:07: resource 0 [io  0x7000-0x7fff]
pci_bus 0000:07: resource 1 [mem 0xdf100000-0xdf1fffff]
pci_bus 0000:07: resource 2 [mem 0xdfe00000-0xdfefffff 64bit pref]
pci_bus 0000:09: resource 0 [io  0x6000-0x6fff]
pci_bus 0000:09: resource 1 [mem 0xde000000-0xdf0fffff]
pci_bus 0000:0a: resource 0 [io  0x6000-0x6fff]
pci_bus 0000:0a: resource 1 [mem 0xde000000-0xdf0fffff]
pci_bus 0000:0b: resource 4 [io  0x0000-0x03af window]
pci_bus 0000:0b: resource 5 [io  0x03e0-0x0cf7 window]
pci_bus 0000:0b: resource 6 [io  0x03b0-0x03df window]
pci_bus 0000:0b: resource 7 [io  0x0d00-0x9fff window]
pci_bus 0000:0b: resource 8 [mem 0x000a0000-0x000bffff window]
pci_bus 0000:0b: resource 9 [mem 0x000c0000-0x000dffff window]
pci_bus 0000:0b: resource 10 [mem 0x80000000-0xdfffffff window]
pci 0000:80:00.0: PCI bridge to [bus 81]
pci 0000:80:01.0: PCI bridge to [bus 82]
pci 0000:80:01.0:   bridge window [io  0xf000-0xffff]
pci 0000:80:01.0:   bridge window [mem 0xfbe00000-0xfbefffff]
pci 0000:80:02.0: PCI bridge to [bus 83]
pci 0000:80:03.0: PCI bridge to [bus 84-85]
pci 0000:80:03.0:   bridge window [mem 0xfba00000-0xfbdfffff]
pci 0000:80:03.0:   bridge window [mem 0xfb900000-0xfb9fffff 64bit pref]
pci_bus 0000:80: resource 4 [io  0xa000-0xffff window]
pci_bus 0000:80: resource 5 [mem 0xe0000000-0xfbffffff window]
pci_bus 0000:82: resource 0 [io  0xf000-0xffff]
pci_bus 0000:82: resource 1 [mem 0xfbe00000-0xfbefffff]
pci_bus 0000:84: resource 1 [mem 0xfba00000-0xfbdfffff]
pci_bus 0000:84: resource 2 [mem 0xfb900000-0xfb9fffff 64bit pref]
NET: Registered protocol family 2
TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
UDP hash table entries: 65536 (order: 9, 2097152 bytes)
UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes)
NET: Registered protocol family 1
xen: registering gsi 16 triggering 0 polarity 1
xen: --> pirq=16 -> irq=16 (gsi=16)
xen: registering gsi 23 triggering 0 polarity 1
xen: --> pirq=23 -> irq=23 (gsi=23)
pci 0000:0a:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
pci 0000:82:00.0: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
PCI: CLS 64 bytes, default 64
Trying to unpack rootfs image as initramfs...
Freeing initrd memory: 14544K
RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
RAPL PMU: hw unit of domain package 2^-16 Joules
RAPL PMU: hw unit of domain dram 2^-16 Joules
audit: initializing netlink subsys (disabled)
audit: type=2000 audit(1497029984.244:1): state=initialized audit_enabled=0 res=1
Initialise system trusted keyrings
workingset: timestamp_bits=36 max_order=25 bucket_order=0
zbud: loaded
SELinux:  Registering netfilter hooks
Key type asymmetric registered
Asymmetric key parser 'x509' registered
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)
io scheduler noop registered
io scheduler deadline registered
io scheduler cfq registered (default)
io scheduler mq-deadline registered
io scheduler kyber registered
xen: registering gsi 26 triggering 0 polarity 1
xen: --> pirq=26 -> irq=26 (gsi=26)
xen: registering gsi 26 triggering 0 polarity 1
Already setup the GSI :26
xen: registering gsi 32 triggering 0 polarity 1
xen: --> pirq=32 -> irq=32 (gsi=32)
xen: registering gsi 32 triggering 0 polarity 1
Already setup the GSI :32
xen: registering gsi 41 triggering 0 polarity 1
xen: --> pirq=41 -> irq=41 (gsi=41)
xen: registering gsi 16 triggering 0 polarity 1
Already setup the GSI :16
xen: registering gsi 17 triggering 0 polarity 1
xen: --> pirq=17 -> irq=17 (gsi=17)
xen: registering gsi 19 triggering 0 polarity 1
xen: --> pirq=19 -> irq=19 (gsi=19)
xen: registering gsi 48 triggering 0 polarity 1
xen: --> pirq=48 -> irq=48 (gsi=48)
xen: registering gsi 50 triggering 0 polarity 1
xen: --> pirq=50 -> irq=50 (gsi=50)
xen: registering gsi 56 triggering 0 polarity 1
xen: --> pirq=56 -> irq=56 (gsi=56)
xen: registering gsi 64 triggering 0 polarity 1
xen: --> pirq=64 -> irq=64 (gsi=64)
pcieport 0000:00:01.0: Signaling PME with IRQ 218
pcieport 0000:00:01.1: Signaling PME with IRQ 219
pcieport 0000:00:02.0: Signaling PME with IRQ 220
pcieport 0000:00:02.2: Signaling PME with IRQ 221
pcieport 0000:00:03.0: Signaling PME with IRQ 222
pcieport 0000:00:11.0: Signaling PME with IRQ 223
pcieport 0000:00:1c.0: Signaling PME with IRQ 224
pcieport 0000:00:1c.7: Signaling PME with IRQ 225
pcieport 0000:80:00.0: Signaling PME with IRQ 226
pcieport 0000:80:01.0: Signaling PME with IRQ 227
pcieport 0000:80:02.0: Signaling PME with IRQ 228
pcieport 0000:80:03.0: Signaling PME with IRQ 229
intel_idle: MWAIT substates: 0x1120
intel_idle: v0.4.1 model 0x3E
intel_idle: intel_idle yielding to none
input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0
ACPI: Power Button [PWRB]
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1
ACPI: Power Button [PWRF]
Monitor-Mwait will be used to enter C-1 state
Warning: Processor Platform Limit not supported.
ERST: Error Record Serialization Table (ERST) support is initialized.
pstore: using zlib compression
pstore: Registered erst as persistent store backend
GHES: APEI firmware first mode is enabled by WHEA _OSC.
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
hpet_acpi_add: no address or irqs in _CRS
Non-volatile memory driver v1.3
Linux agpgart interface v0.103
brd: module loaded
loop: module loaded
libphy: Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci-pci: EHCI PCI platform driver
xen: registering gsi 16 triggering 0 polarity 1
Already setup the GSI :16
ehci-pci 0000:00:1a.0: EHCI Host Controller
ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
ehci-pci 0000:00:1a.0: debug port 2
ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
ehci-pci 0000:00:1a.0: irq 16, io mem 0xdf323000
ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: EHCI Host Controller
usb usb1: Manufacturer: Linux 4.12.0-rc2 ehci_hcd
usb usb1: SerialNumber: 0000:00:1a.0
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 2 ports detected
xen: registering gsi 23 triggering 0 polarity 1
Already setup the GSI :23
ehci-pci 0000:00:1d.0: EHCI Host Controller
ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
ehci-pci 0000:00:1d.0: debug port 2
ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
ehci-pci 0000:00:1d.0: irq 23, io mem 0xdf322000
ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: EHCI Host Controller
usb usb2: Manufacturer: Linux 4.12.0-rc2 ehci_hcd
usb usb2: SerialNumber: 0000:00:1d.0
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
ohci-pci: OHCI PCI platform driver
uhci_hcd: USB Universal Host Controller Interface driver
i8042: PNP: No PS/2 controller found.
mousedev: PS/2 mouse device common for all mice
rtc_cmos 00:04: RTC can wake from S4
rtc_cmos 00:04: rtc core: registered rtc_cmos as rtc0
rtc_cmos 00:04: alarms up to one month, y3k, 114 bytes nvram
ledtrig-cpu: registered to indicate activity on CPUs
hidraw: raw HID events driver (C) Jiri Kosina
usbcore: registered new interface driver usbhid
usbhid: USB HID core driver
drop_monitor: Initializing network drop monitor service
Initializing XFRM netlink socket
NET: Registered protocol family 17
registered taskstats version 1
Loading compiled-in X.509 certificates
Loaded X.509 cert 'Build time autogenerated kernel key: 7cf1ab62ff655a90e432c156631092a1e0875d04'
zswap: loaded using pool lzo/zbud
rtc_cmos 00:04: setting system clock to 2017-06-09 17:39:43 UTC (1497029983)
Freeing unused kernel memory: 2152K
Write protecting the kernel read-only data: 12288k
Freeing unused kernel memory: 804K
Freeing unused kernel memory: 1900K
rodata_test: all tests were successful
dracut: dracut-004-356.el6_6.2
dracut: rd_NO_LUKS: removing cryptoluks activation
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com
udev: starting version 147
udevd (262): /proc/262/oom_adj is deprecated, please use /proc/262/oom_score_adj instead.
dracut: Starting plymouth daemon
usb 1-1: new high-speed USB device number 2 using ehci-pci
usb 2-1: new high-speed USB device number 2 using ehci-pci
usb 1-1: New USB device found, idVendor=8087, idProduct=0024
usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
hub 1-1:1.0: USB hub found
hub 1-1:1.0: 6 ports detected
usb 2-1: New USB device found, idVendor=8087, idProduct=0024
usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
hub 2-1:1.0: USB hub found
hub 2-1:1.0: 8 ports detected
isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
isci 0000:06:00.0: driver configured for rev: 6 silicon
usb 1-1.5: new low-speed USB device number 3 using ehci-pci
usb 2-1.5: new high-speed USB device number 3 using ehci-pci
isci 0000:06:00.0: Direct firmware load for isci/isci_firmware.bin failed with error -2
isci 0000:06:00.0: Loading user firmware failed, using default values
isci 0000:06:00.0: Default OEM configuration being used: 4 narrow ports, and default SAS Addresses
xen: registering gsi 16 triggering 0 polarity 1
Already setup the GSI :16
isci 0000:06:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
scsi host0: isci
usb 1-1.5: New USB device found, idVendor=1c4f, idProduct=0002
usb 1-1.5: New USB device strings: Mfr=1, Product=2, SerialNumber=0
usb 1-1.5: Product: USB Keykoard
usb 1-1.5: Manufacturer: SIGMACH1P
usb 2-1.5: New USB device found, idVendor=046b, idProduct=ff01
usb 2-1.5: New USB device strings: Mfr=1, Product=2, SerialNumber=3
usb 2-1.5: Product: Virtual Hub
usb 2-1.5: Manufacturer: American Megatrends Inc.
usb 2-1.5: SerialNumber: serial
hub 2-1.5:1.0: USB hub found
hub 2-1.5:1.0: 5 ports detected
input: SIGMACH1P USB Keykoard as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.5/1-1.5:1.0/0003:1C4F:0002.0001/input/input2
hid-generic 0003:1C4F:0002.0001: input,hidraw0: USB HID v1.10 Keyboard [SIGMACH1P USB Keykoard] on usb-0000:00:1a.0-1.5/input0
input: SIGMACH1P USB Keykoard as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.5/1-1.5:1.1/0003:1C4F:0002.0002/input/input3
hid-generic 0003:1C4F:0002.0002: input,hidraw1: USB HID v1.10 Device [SIGMACH1P USB Keykoard] on usb-0000:00:1a.0-1.5/input1
clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x257a493a0cc, max_idle_ns: 440795272657 ns
usb 2-1.5.4: new low-speed USB device number 4 using ehci-pci
ahci 0000:00:1f.2: version 3.0
xen: registering gsi 19 triggering 0 polarity 1
Already setup the GSI :19
ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x1 impl SATA mode
ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
scsi host1: ahci
scsi host2: ahci
scsi host3: ahci
scsi host4: ahci
scsi host5: ahci
scsi host6: ahci
ata1: SATA max UDMA/133 abar m2048@0xdf321000 port 0xdf321100 irq 234
ata2: DUMMY
ata3: DUMMY
ata4: DUMMY
ata5: DUMMY
ata6: DUMMY
usb 2-1.5.4: New USB device found, idVendor=046b, idProduct=ff10
usb 2-1.5.4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
usb 2-1.5.4: Product: Virtual Keyboard and Mouse
usb 2-1.5.4: Manufacturer: American Megatrends Inc.
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.5/2-1.5.4/2-1.5.4:1.0/0003:046B:FF10.0003/input/input4
hid-generic 0003:046B:FF10.0003: input,hidraw2: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.5.4/input0
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.5/2-1.5.4/2-1.5.4:1.1/0003:046B:FF10.0004/input/input5
hid-generic 0003:046B:FF10.0004: input,hidraw3: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.5.4/input1
ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
ata1.00: ATA-9: INTEL SSDSC2BB800G4, D2010370, max UDMA/133
ata1.00: 1562824368 sectors, multi 1: LBA48 NCQ (depth 31/32)
ata1.00: configured for UDMA/133
scsi 1:0:0:0: Direct-Access     ATA      INTEL SSDSC2BB80 0370 PQ: 0 ANSI: 5
megasas: 07.701.17.00-rc1
xen: registering gsi 50 triggering 0 polarity 1
Already setup the GSI :50
megaraid_sas 0000:82:00.0: FW now in Ready state
megaraid_sas 0000:82:00.0: firmware supports msix	: (0)
megaraid_sas 0000:82:00.0: current msix/online cpus	: (1/24)
megaraid_sas 0000:82:00.0: RDPQ mode	: (disabled)
megaraid_sas 0000:82:00.0: controller type	: MR(512MB)
megaraid_sas 0000:82:00.0: Online Controller Reset(OCR)	: Enabled
megaraid_sas 0000:82:00.0: Secure JBOD support	: No
megaraid_sas 0000:82:00.0: megasas_init_mfi: fw_support_ieee=0
megaraid_sas 0000:82:00.0: INIT adapter done
megaraid_sas 0000:82:00.0: Jbod map is not supported megasas_setup_jbod_map 5092
megaraid_sas 0000:82:00.0: pci id		: (0x1000)/(0x0079)/(0x1bd4)/(0x0002)
megaraid_sas 0000:82:00.0: unevenspan support	: no
megaraid_sas 0000:82:00.0: firmware crash dump	: no
megaraid_sas 0000:82:00.0: jbod sync map		: no
scsi host7: Avago SAS based MegaRAID driver
clocksource: Switched to clocksource tsc
scsi 7:2:0:0: Direct-Access     LSI      MRSASRoMB-8i     2.90 PQ: 0 ANSI: 5
ata1.00: Enabling discard_zeroes_data
sd 1:0:0:0: [sda] 1562824368 512-byte logical blocks: (800 GB/745 GiB)
sd 1:0:0:0: [sda] 4096-byte physical blocks
sd 1:0:0:0: [sda] Write Protect is off
sd 1:0:0:0: [sda] Mode Sense: 00 3a 00 00
sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
ata1.00: Enabling discard_zeroes_data
sd 7:2:0:0: [sdb] 5859442688 512-byte logical blocks: (3.00 TB/2.73 TiB)
sd 7:2:0:0: [sdb] Write Protect is off
sd 7:2:0:0: [sdb] Mode Sense: 1f 00 00 08
sd 7:2:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
 sda: sda1 sda2
ata1.00: Enabling discard_zeroes_data
sd 1:0:0:0: [sda] Attached SCSI disk
sd 7:2:0:0: [sdb] Attached SCSI disk
dracut: Scanning devices sda2 sdb  for LVM logical volumes VolGroup00/LogVol-ROOT VolGroup00/LogVol-SWAP 
dracut: inactive '/dev/VolGroup00/LogVol-SWAP' [128.16 GiB] inherit
dracut: inactive '/dev/VolGroup00/LogVol-TMP' [20.00 GiB] inherit
dracut: inactive '/dev/VolGroup00/LogVol-VAR' [20.00 GiB] inherit
dracut: inactive '/dev/VolGroup00/LogVol-ROOT' [200.00 GiB] inherit
dracut: inactive '/dev/VolGroup00/LogVol-OPT' [10.00 GiB] inherit
dracut: inactive '/dev/VolGroup00/data1' [3.09 TiB] inherit
EXT4-fs (dm-1): mounted filesystem with ordered data mode. Opts: (null)
dracut: Mounted root filesystem /dev/mapper/VolGroup00-LogVol--ROOT
SELinux:  Disabled at runtime.
SELinux:  Unregistering netfilter hooks
audit: type=1404 audit(1497029989.900:2): selinux=0 auid=4294967295 ses=4294967295
dracut: 
dracut: Switching root
udev: starting version 147
dca service started, version 1.12.1
WARNING! power/level is deprecated; use power/control instead
ioatdma: Intel(R) QuickData Technology Driver 4.00
xen: registering gsi 31 triggering 0 polarity 1
xen: --> pirq=31 -> irq=31 (gsi=31)
xen: registering gsi 39 triggering 0 polarity 1
xen: --> pirq=39 -> irq=39 (gsi=39)
xen: registering gsi 31 triggering 0 polarity 1
Already setup the GSI :31
xen: registering gsi 39 triggering 0 polarity 1
Already setup the GSI :39
xen: registering gsi 31 triggering 0 polarity 1
Already setup the GSI :31
xen: registering gsi 39 triggering 0 polarity 1
Already setup the GSI :39
xen: registering gsi 31 triggering 0 polarity 1
Already setup the GSI :31
xen: registering gsi 39 triggering 0 polarity 1
Already setup the GSI :39
xen: registering gsi 55 triggering 0 polarity 1
xen: --> pirq=55 -> irq=55 (gsi=55)
xen: registering gsi 63 triggering 0 polarity 1
xen: --> pirq=63 -> irq=63 (gsi=63)
xen: registering gsi 55 triggering 0 polarity 1
Already setup the GSI :55
xen: registering gsi 63 triggering 0 polarity 1
Already setup the GSI :63
xen: registering gsi 55 triggering 0 polarity 1
Already setup the GSI :55
xen: registering gsi 63 triggering 0 polarity 1
Already setup the GSI :63
xen: registering gsi 55 triggering 0 polarity 1
Already setup the GSI :55
xen: registering gsi 63 triggering 0 polarity 1
Already setup the GSI :63
wmi: Mapper loaded
mei_me 0000:00:16.0: Device doesn't have valid ME Interface
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
igb: Copyright (c) 2007-2014 Intel Corporation.
xen: registering gsi 16 triggering 0 polarity 1
Already setup the GSI :16
igb 0000:07:00.0: added PHC on eth0
igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection
igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 6c:92:bf:07:d2:db
igb 0000:07:00.0: eth0: PBA No: 106100-000
igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
xen: registering gsi 17 triggering 0 polarity 1
Already setup the GSI :17
igb 0000:07:00.1: added PHC on eth1
igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection
igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 6c:92:bf:07:d2:da
igb 0000:07:00.1: eth1: PBA No: 106100-000
igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
xen: registering gsi 64 triggering 0 polarity 1
Already setup the GSI :64
igb 0000:84:00.0: added PHC on eth2
igb 0000:84:00.0: Intel(R) Gigabit Ethernet Network Connection
igb 0000:84:00.0: eth2: (PCIe:5.0Gb/s:Width x4) a0:36:9f:3f:a6:9c
igb 0000:84:00.0: eth2: PBA No: G15136-010
igb 0000:84:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
xen: registering gsi 68 triggering 0 polarity 1
xen: --> pirq=68 -> irq=68 (gsi=68)
igb 0000:84:00.1: added PHC on eth3
igb 0000:84:00.1: Intel(R) Gigabit Ethernet Network Connection
igb 0000:84:00.1: eth3: (PCIe:5.0Gb/s:Width x4) a0:36:9f:3f:a6:9d
igb 0000:84:00.1: eth3: PBA No: G15136-010
igb 0000:84:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
sd 1:0:0:0: Attached scsi generic sg0 type 0
sd 7:2:0:0: Attached scsi generic sg1 type 0
xen: registering gsi 18 triggering 0 polarity 1
xen: --> pirq=18 -> irq=18 (gsi=18)
i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
ipmi message handler version 39.2
ipmi_si IPI0001:00: ipmi_si: probing via ACPI
ipmi_si IPI0001:00: [io  0x0ca2] regsize 1 spacing 1 irq 0
ipmi_si: Adding ACPI-specified kcs state machine
IPMI System Interface driver.
ipmi_si: probing via SMBIOS
ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
ipmi_si: SMBIOS-specified kcs state machine: duplicate
ipmi_si: probing via SPMI
ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
ipmi_si: SPMI-specified kcs state machine: duplicate
ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
ipmi_si IPI0001:00: Found new BMC (man_id: 0x009439, prod_id: 0xaabb, dev_id: 0x20)
ipmi_si IPI0001:00: IPMI kcs interface initialized
input: PC Speaker as /devices/platform/pcspkr/input/input6
iTCO_vendor_support: vendor-support=0
iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
EXT4-fs (dm-1): re-mounted. Opts: (null)
EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
EXT4-fs (dm-4): mounted filesystem with ordered data mode. Opts: (null)
EXT4-fs (dm-2): mounted filesystem with ordered data mode. Opts: (null)
EXT4-fs (dm-3): mounted filesystem with ordered data mode. Opts: (null)
SGI XFS with ACLs, security attributes, no debug enabled
XFS (dm-5): Mounting V4 Filesystem
XFS (dm-5): Ending clean mount
Adding 134381564k swap on /dev/mapper/VolGroup00-LogVol--SWAP.  Priority:-1 extents:1 across:134381564k SSFS
ip_tables: (C) 2000-2006 Netfilter Core Team
nf_conntrack version 0.5.0 (65536 buckets, 262144 max)
NET: Registered protocol family 10
Segment Routing with IPv6
IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
igb 0000:07:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
xen:xen_evtchn: Event-channel device installed
xen_pciback: backend is vpci
xen:manage: Unable to read sysrq code in control/sysrq
virbr0: port 1(vif1.0) entered blocking state
virbr0: port 1(vif1.0) entered disabled state
device vif1.0 entered promiscuous mode
IPv6: ADDRCONF(NETDEV_UP): vif1.0: link is not ready
Bridge firewalling registered
virbr0: port 1(vif1.0) entered disabled state
IPv6: ADDRCONF(NETDEV_UP): vif1.0: link is not ready
vif vif-1-0 vif1.0: Guest Rx ready
IPv6: ADDRCONF(NETDEV_CHANGE): vif1.0: link becomes ready
virbr0: port 1(vif1.0) entered blocking state
virbr0: port 1(vif1.0) entered forwarding state

[-- Attachment #4: Type: text/plain, Size: 127 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 6+ messages in thread
* Re: Nested Virtualization Support Host-Only Hypervisors
  2017-06-09  7:44 Nested Virtualization Support Host-Only Hypervisors Kangjie Xi
  2017-06-09  8:24 ` Jan Beulich
@ 2017-06-09 10:12 ` Andrew Cooper
  1 sibling, 0 replies; 6+ messages in thread
From: Andrew Cooper @ 2017-06-09 10:12 UTC (permalink / raw)
  To: Kangjie Xi, xen-devel; +Cc: Jan Beulich

On 09/06/17 08:44, Kangjie Xi wrote:
> Xen supports Nested
> Virtualization(https://wiki.xenproject.org/wiki/Nested_Virtualization_in_Xen),
> which means I can run Xen or KVM hypervisor inside a virtual machine,
> and then create a L2 guest. However when I run a Host-Only Hypervisor
> (no L2 guests, like MoRE, SimpleVisor and HyperPlatform) inside of L1
> guest, the L1 hangs.
>
> Is it able to make Xen Nested Virtualization to support Host-Only
> hypervisors? It is useful for security research.
>
> * MoRE, https://github.com/ainfosec/MoRE
> * SimpleVisor, https://github.com/ionescu007/SimpleVisor
> * HyperPlatform, https://github.com/tandasat/HyperPlatform

Nested virt in Xen is very experimental, and almost doesn't function in
practice.

* No 32bit L1 hypervisor software will work.  Several VT-x instruction
use the operand size when reading parameters in memory, rather than the
proper 8, meaning that operations get attempted with an uninitialised
upper half.

* Running anything Linux-based requires you to compile L1 without
CONFIG_XEN.  The issue is that Linux ends up using event channels for
IPIs, and these don't get delivered when the vcpu is running L2.  If L2
spins in a loop waiting for something to happen, this ends up not
exiting to L1 until an NMI occurs.

* HyperV chokes on APIC related things.  I think the root cause is the
complete fiction of topology information currently exposed to guests,
but in the end, it either takes a #GP for trying to use x2apic MSRs
after disabling x2apic mode, or complains of a spurious #PF when trying
to access the xapic MMIO page.

* ESXi manages to take out L0 quite reliably.  Disabling VMCS shadowing
helps, but L1 still locks up when it tries booting L2.

There are at least 6 outstanding ways I am aware of for L1 to crash L0,
because of insufficient or incorrect parameter auditing.


I do not recommend anyone uses nested virt while it is in its current
state, other than to actively develop it.  There is active work ongoing
from XenServer to get nested virt into a usable state, but my estimation
of multiple person-years of effort still applies.

~Andrew

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 6+ messages in thread
end of thread, other threads:[~2017-06-09 10:13 UTC | newest]

Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2017-06-09  7:44 Nested Virtualization Support Host-Only Hypervisors Kangjie Xi
2017-06-09  8:24 ` Jan Beulich
2017-06-09  8:54   ` Kangjie Xi
2017-06-09  9:05     ` Jan Beulich
2017-06-09 10:03       ` Kangjie Xi
2017-06-09 10:12 ` Andrew Cooper

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).