All of lore.kernel.org
 help / color / mirror / Atom feed
* Shared page tables between ETP and IOMMU issue
@ 2015-02-26 15:45 Roger Pau Monné
  2015-02-26 15:57 ` Jan Beulich
  0 siblings, 1 reply; 10+ messages in thread
From: Roger Pau Monné @ 2015-02-26 15:45 UTC (permalink / raw)
  To: xen-devel; +Cc: yang.z.zhang, kevin.tian, Jan Beulich

Hello,

While testing PVH Dom0 support on a newer Core i3-5010U I've found that 
sharing the page tables between EPT and the IOMMUs don't work. Booting 
with iommu=no-sharept solves the problem, but I'm unsure what causes 
this issue.

Here is the output of the system successfully booting with 
iommu=debug,no-sharept:

/boot/xen data=0x1de9f0+0x7fd22610 -
/boot/kernel/kernel size=0x14bcd33
/boot/kernel/zfs.ko size 0x37d888 at 0x81550000
loading required module 'opensolaris'
/boot/kernel/opensolaris.ko size 0xc790 at 0x818ce000
Booting...
 Xen 4.6-unstable
(XEN) Xen version 4.6-unstable (root@) (gcc47 (FreeBSD Ports Collection) 4.7.4) debug=y Thu Feb 26 19:23:57 UTC 2015
(XEN) Latest ChangeSet: Wed Feb 11 17:21:14 2015 +0100 git:cb34a7c-dirty
(XEN) Bootloader: FreeBSD Loader
(XEN) Command line: dom0_mem=2048M dom0pvh=1 console=com1,vga iommu=debug,no-sharept guest_loglvl=all loglvl=all
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: V2; EDID transfer time: 1 seconds
(XEN) Disc information:
(XEN)  Found 1 MBR signatures
(XEN)  Found 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 000000000009d800 (usable)
(XEN)  000000000009d800 - 00000000000a0000 (reserved)
(XEN)  00000000000e0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 00000000d76d8000 (usable)
(XEN)  00000000d76d8000 - 00000000d7bb5000 (reserved)
(XEN)  00000000d7bb5000 - 00000000dc319000 (usable)
(XEN)  00000000dc319000 - 00000000dc378000 (reserved)
(XEN)  00000000dc378000 - 00000000dc39b000 (ACPI data)
(XEN)  00000000dc39b000 - 00000000dcccb000 (ACPI NVS)
(XEN)  00000000dcccb000 - 00000000dcfff000 (reserved)
(XEN)  00000000dcfff000 - 00000000dd000000 (usable)
(XEN)  00000000dd800000 - 00000000e0000000 (reserved)
(XEN)  00000000f8000000 - 00000000fc000000 (reserved)
(XEN)  00000000fec00000 - 00000000fec01000 (reserved)
(XEN)  00000000fed00000 - 00000000fed04000 (reserved)
(XEN)  00000000fed1c000 - 00000000fed20000 (reserved)
(XEN)  00000000fee00000 - 00000000fee01000 (reserved)
(XEN)  00000000ff000000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 000000021f000000 (usable)
(XEN) ACPI: RSDP 000F0580, 0024 (r2 INTEL )
(XEN) ACPI: XSDT DC37F090, 00A4 (r1  INTEL NUC5i3MY  1072009 AMI     10013)
(XEN) ACPI: FACP DC392C10, 010C (r5  INTEL NUC5i3MY  1072009 AMI     10013)
(XEN) ACPI: DSDT DC37F1C8, 13A48 (r2  INTEL NUC5i3MY  1072009 INTL 20120913)
(XEN) ACPI: FACS DCCC9F80, 0040
(XEN) ACPI: APIC DC392D20, 0084 (r3  INTEL NUC5i3MY  1072009 AMI     10013)
(XEN) ACPI: FPDT DC392DA8, 0044 (r1  INTEL NUC5i3MY  1072009 AMI     10013)
(XEN) ACPI: FIDT DC392DF0, 009C (r1  INTEL NUC5i3MY  1072009 AMI     10013)
(XEN) ACPI: MCFG DC392E90, 003C (r1  INTEL NUC5i3MY  1072009 MSFT       97)
(XEN) ACPI: HPET DC392ED0, 0038 (r1  INTEL NUC5i3MY  1072009 AMI.        5)
(XEN) ACPI: SSDT DC392F08, 0315 (r1  INTEL NUC5i3MY     1000 INTL 20120913)
(XEN) ACPI: UEFI DC393220, 0042 (r1  INTEL NUC5i3MY        0             0)
(XEN) ACPI: SSDT DC393268, 0C7D (r2  INTEL NUC5i3MY     1000 INTL 20120913)
(XEN) ACPI: ASF! DC393EE8, 00A0 (r32  INTEL NUC5i3MY        1 TFSM    F4240)
(XEN) ACPI: SSDT DC393F88, 0539 (r2  INTEL NUC5i3MY     3000 INTL 20120913)
(XEN) ACPI: SSDT DC3944C8, 0B74 (r2  INTEL NUC5i3MY     3000 INTL 20120913)
(XEN) ACPI: TPM2 DC395040, 0034 (r3  INTEL NUC5i3MY        1 AMI         0)
(XEN) ACPI: SSDT DC395078, 0041 (r1  INTEL NUC5i3MY     1000 INTL 20120913)
(XEN) ACPI: SSDT DC3950C0, 5CF6 (r2  INTEL NUC5i3MY     3000 INTL 20120913)
(XEN) ACPI: DMAR DC39ADB8, 00B0 (r1  INTEL NUC5i3MY        1 INTL        1)
(XEN) System RAM: 8109MB (8304488kB)
(XEN) No NUMA configuration found
(XEN) Faking a node at 0000000000000000-000000021f000000
(XEN) Domain heap initialised
(XEN) found SMP MP-table at 000fd7c0
(XEN) DMI 2.8 present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x1808
(XEN) ACPI: v5 SLEEP INFO: control[0:0], status[0:0]
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:1804,1:0], pm1x_evt[1:1800,1:0]
(XEN) ACPI: 32/64X FACS address mismatch in FADT - dccc9f80/0000000000000000, using 32
(XEN) ACPI:             wakeup_vec[dccc9f8c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
(XEN) Processor #0 7:13 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
(XEN) Processor #2 7:13 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x01] enabled)
(XEN) Processor #1 7:13 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x03] enabled)
(XEN) Processor #3 7:13 APIC version 21
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] dfl dfl lint[0])
(XEN) ACPI: NMI not connected to LINT 1!
(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] dfl dfl lint[0])
(XEN) ACPI: NMI not connected to LINT 1!
(XEN) ACPI: LAPIC_NMI (acpi_id[0x03] dfl dfl lint[0])
(XEN) ACPI: NMI not connected to LINT 1!
(XEN) ACPI: LAPIC_NMI (acpi_id[0x04] dfl dfl lint[0])
(XEN) ACPI: NMI not connected to LINT 1!
(XEN) ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-39
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
(XEN) ACPI: HPET id: 0x8086a701 base: 0xfed00000
(XEN) [VT-D]dmar.c:788: Host address width 39
(XEN) [VT-D]dmar.c:802: found ACPI_DMAR_DRHD:
(XEN) [VT-D]dmar.c:472:   dmaru->address = fed90000
(XEN) [VT-D]iommu.c:1136: drhd->address = fed90000 iommu->reg = ffff82c000201000
(XEN) [VT-D]iommu.c:1138: cap = 1c0000c40660462 ecap = 7e1ff0505e
(XEN) [VT-D]dmar.c:383:  endpoint: 0000:00:02.0
(XEN) [VT-D]dmar.c:802: found ACPI_DMAR_DRHD:
(XEN) [VT-D]dmar.c:472:   dmaru->address = fed91000
(XEN) [VT-D]iommu.c:1136: drhd->address = fed91000 iommu->reg = ffff82c000203000
(XEN) [VT-D]iommu.c:1138: cap = d2008c20660462 ecap = f010da
(XEN) [VT-D]dmar.c:397:  IOAPIC: 0000:f0:1f.0
(XEN) [VT-D]dmar.c:361:  MSI HPET: 0000:f0:0f.0
(XEN) [VT-D]dmar.c:486:   flags: INCLUDE_ALL
(XEN) [VT-D]dmar.c:807: found ACPI_DMAR_RMRR:
(XEN) [VT-D]dmar.c:383:  endpoint: 0000:00:1d.0
(XEN) [VT-D]dmar.c:383:  endpoint: 0000:00:14.0
(XEN) [VT-D]dmar.c:676:   RMRR region: base_addr dcefc000 end_address dcf0afff
(XEN) [VT-D]dmar.c:807: found ACPI_DMAR_RMRR:
(XEN) [VT-D]dmar.c:383:  endpoint: 0000:00:02.0
(XEN) [VT-D]dmar.c:676:   RMRR region: base_addr dd800000 end_address dfffffff
(XEN) ERST table was not found
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 4 CPUs (0 hotplug CPUs)
(XEN) IRQ limits: 40 GSI, 744 MSI/MSI-X
(XEN) Failed to enable Interrupt Remapping: Will not enable x2APIC.
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2095.238 MHz processor.
(XEN) Initing memory sharing.
(XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
(XEN) mce_intel.c:735: MCA Capability: BCAST 1 SER 1 CMCI 1 firstbank 0 extended MCE MSR 0
(XEN) Intel machine check reporting enabled
(XEN) alt table ffff82d0802dc330 -> ffff82d0802dd518
(XEN) spurious 8259A interrupt: IRQ7.
(XEN) PCI: MCFG configuration 0: base f8000000 segment 0000 buses 00 - 3f
(XEN) PCI: MCFG area at f8000000 reserved in E820
(XEN) PCI: Using MCFG for segment 0000 bus 00-3f
(XEN) Intel VT-d iommu 0 supported page sizes: 4kB, 2MB, 1GB.
(XEN) Intel VT-d iommu 1 supported page sizes: 4kB, 2MB, 1GB.
(XEN) Intel VT-d Snoop Control not enabled.
(XEN) Intel VT-d Dom0 DMA Passthrough not enabled.
(XEN) Intel VT-d Queued Invalidation enabled.
(XEN) Intel VT-d Interrupt Remapping enabled.
(XEN) Intel VT-d Shared EPT tables not enabled.
(XEN) I/O virtualisation enabled
(XEN)  - Dom0 mode: Relaxed
(XEN) Interrupt remapping enabled
(XEN) Enabled directed EOI with ioapic_ack_old on!
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using old ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=0 pin2=0
(XEN) TSC deadline timer enabled
(XEN) Platform timer is 14.318MHz HPET
(XEN) Allocated console ring of 32 KiB.
(XEN) mwait-idle: MWAIT substates: 0x11142120
(XEN) mwait-idle: v0.4 model 0x3d
(XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff
(XEN) mwait-idle: max C-state count of 8 reached
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Extended Page Tables (EPT)
(XEN)  - Virtual-Processor Identifiers (VPID)
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN)  - Unrestricted Guest
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) detected
(XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB
(XEN) mwait-idle: max C-state count of 8 reached
(XEN) mwait-idle: max C-state count of 8 reached
(XEN) mwait-idle: max C-state count of 8 reached
(XEN) Brought up 4 CPUs
(XEN) ACPI sleep modes: S3
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) Dom0 has maximum 616 PIRQs
(XEN) *** LOADING DOMAIN 0 ***
(XEN) elf_parse_binary: phdr: paddr=0xffffffff80200000 memsz=0x1027270
(XEN) elf_parse_binary: phdr: paddr=0xffffffff81427270 memsz=0x527a20
(XEN) elf_parse_binary: memory: 0xffffffff80200000 -> 0xffffffff8194ec90
(XEN) elf_xen_parse_note: GUEST_OS = "FreeBSD"
(XEN) elf_xen_parse_note: GUEST_VERSION = "0x10c91d"
(XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
(XEN) elf_xen_parse_note: VIRT_BASE = 0xffffffff80000000
(XEN) elf_xen_parse_note: PADDR_OFFSET = 0xffffffff80000000
(XEN) elf_xen_parse_note: ENTRY = 0xffffffff80d54000
(XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xffffffff80d53000
(XEN) elf_xen_parse_note: HV_START_LOW = 0xffff800000000000
(XEN) elf_xen_parse_note: FEATURES = "writable_descriptor_tables|auto_translated_physmap|supervisor_mode_kernel|hvm_callback_vector"
(XEN) elf_xen_parse_note: PAE_MODE = "yes"
(XEN) elf_xen_parse_note: unknown xen elf note (0xd)
(XEN) elf_xen_parse_note: LOADER = "generic"
(XEN) elf_xen_parse_note: SUSPEND_CANCEL = 0x0
(XEN) elf_xen_parse_note: BSD_SYMTAB = "yes"
(XEN) elf_xen_parse: using notes from SHT_NOTE section
(XEN) elf_xen_addr_calc_check: addresses:
(XEN)     virt_base        = 0xffffffff80000000
(XEN)     elf_paddr_offset = 0xffffffff80000000
(XEN)     virt_offset      = 0x0
(XEN)     virt_kstart      = 0xffffffff80200000
(XEN)     virt_kend        = 0xffffffff81c4fcf8
(XEN)     virt_entry       = 0xffffffff80d54000
(XEN)     p2m_base         = 0xffffffffffffffff
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0xffffffff80200000 -> 0xffffffff8194ec90
(XEN)  Dom0 symbol map 0xffffffff8194ec90 -> 0xffffffff81c4fcf8
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000210000000->0000000214000000 (506994 pages to be allocated)
(XEN)  Init. ramdisk: 000000021ec72000->000000021f000000
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff80200000->ffffffff81c4fcf8
(XEN)  Init. ramdisk: ffffffff81c50000->ffffffff81fde000
(XEN)  Phys-Mach map: ffffffff81fde000->ffffffff823de000
(XEN)  Start info:    ffffffff823de000->ffffffff823df4b4
(XEN)  Page tables:   ffffffff823e0000->ffffffff823f7000
(XEN)  Boot stack:    ffffffff823f7000->ffffffff823f8000
(XEN)  TOTAL:         ffffffff80000000->ffffffff82800000
(XEN)  ENTRY ADDRESS: ffffffff80d54000
(XEN) Dom0 has maximum 4 VCPUs
(XEN) elf_load_binary: phdr 2 at 0xffffffff80200000 -> 0xffffffff81227270
(XEN) elf_load_binary: phdr 3 at 0xffffffff81427270 -> 0xffffffff81553da0
(XEN) elf_load_bsdsyms: shdr 4 at 0xffff83021d83fa30 -> 0xffffffff8194f818
(XEN) elf_load_bsdsyms: shdr 42 at 0xffff83021e9c6d44 -> 0xffffffff819a5840
(XEN) elf_load_bsdsyms: shdr 43 at 0xffff83021e9c7ad0 -> 0xffffffff819a5a90
(XEN) elf_load_bsdsyms: shdr 44 at 0xffff83021eb0ed40 -> 0xffffffff81aecd00
(XEN) [VT-D]iommu.c:1420: d0:Hostbridge: skip 0000:00:00.0 map
(XEN) Bogus DMIBAR 0xfed18001 on 0000:00:00.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:02.0
(XEN) [VT-D]iommu.c:1434: d0:PCIe: map 0000:00:03.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:14.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:16.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:19.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:1b.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:1d.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:1f.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:1f.2
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:1f.3
(XEN) [VT-D]iommu.c:729: iommu_enable_translation: iommu->reg = ffff82c000201000
(XEN) [VT-D]iommu.c:729: iommu_enable_translation: iommu->reg = ffff82c000203000
(XEN) Scrubbing Free RAM on 1 nodes using 2 CPUs
(XEN) ..................................done.
(XEN) Initial low memory virq threshold set at 0x4000 pages.
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 280kB init memory.
FreeBSD PVH running on xen-3.0-x86_64p
GDB: no debug ports present
KDB: debugger backends: ddb
KDB: current backend: ddb
SMAP type=01 base=0000000000000000 len=000000000009d800
SMAP type=02 base=000000000009d800 len=0000000000002800
SMAP type=02 base=00000000000e0000 len=0000000000020000
SMAP type=01 base=0000000000100000 len=000000007ff62000
SMAP type=02 base=00000000d76d8000 len=00000000004dd000
SMAP type=02 base=00000000dc319000 len=000000000005f000
SMAP type=03 base=00000000dc378000 len=0000000000023000
SMAP type=04 base=00000000dc39b000 len=0000000000930000
SMAP type=02 base=00000000dcccb000 len=0000000000334000
SMAP type=02 base=00000000dd800000 len=0000000002800000
SMAP type=02 base=00000000f8000000 len=0000000004000000
SMAP type=02 base=00000000fec00000 len=0000000000001000
SMAP type=02 base=00000000fed00000 len=0000000000004000
SMAP type=02 base=00000000fed1c000 len=0000000000004000
SMAP type=02 base=00000000fee00000 len=0000000000001000
SMAP type=02 base=00000000ff000000 len=0000000001000000
Table 'FACP' at 0xdc392c10
Table 'APIC' at 0xdc392d20
APIC: Found table at 0xdc392d20
APIC: Using the Xen PV enumerator.
SMP: Added CPU 0 (BSP)
SMP: Added CPU 2 (AP)
SMP: Added CPU 4 (AP)
SMP: Added CPU 6 (AP)
Copyright (c) 1992-2015 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 11.0-CURRENT #1: Thu Feb 26 01:23:31 UTC 2015
    root@:/usr/obj/root/freebsd/sys/GENERIC amd64
FreeBSD clang version 3.5.1 (tags/RELEASE_351/final 225668) 20150115
WARNING: WITNESS option enabled, expect reduced performance.
(XEN) irq.c:386: Dom0 callback via changed to Direct Vector 0x93
Preloaded elf multiboot kernel "/boot/xen" at 0xffffffff81c50000.
Preloaded elf kernel "/boot/kernel/kernel" at 0xffffffff81c50180.
Preloaded elf obj module "/boot/kernel/zfs.ko" at 0xffffffff81c50258.
Preloaded elf obj module "/boot/kernel/opensolaris.ko" at 0xffffffff81c50a80.
Calibrating TSC clock ... TSC clock: 2095150328 Hz
CPU: Intel(R) Core(TM) i3-5010U CPU @ 2.10GHz (2095.15-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x306d4  Family=0x6  Model=0x3d  Stepping=4
  Features=0x1fc3ebff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,PGE,MCA,CMOV,PAT,PSE36,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT>
  Features2=0xfff83a83<SSE3,PCLMULQDQ,EST,SSSE3,SDBG,FMA,CX16,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND,HV>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  AMD Features2=0x121<LAHF,ABM,Prefetch>
  Structured Extended Features=0xc0328<BMI1,AVX2,BMI2,ERMS,RDSEED,ADX>
  XSAVE Features=0x1<XSAVEOPT>
  TSC: P-state invariant, performance statistics
Data TLB: 4 KB pages, 4-way set associative, 64 entries
L2 cache: 256 kbytes, 8-way associative, 64 bytes/line
Hypervisor: Origin = "XenVMMXenVMM"
real memory  = 2147885056 (2048 MB)
Physical memory chunk(s):
0x0000000000001000 - 0x000000000009cfff, 638976 bytes (156 pages)
0x0000000000100000 - 0x00000000001fffff, 1048576 bytes (256 pages)
0x0000000002428000 - 0x000000007cbd5fff, 2054873088 bytes (501678 pages)
avail memory = 2031898624 (1937 MB)
INTR: Adding local APIC 2 as a target
INTR: Adding local APIC 4 as a target
INTR: Adding local APIC 6 as a target
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  2
 cpu2 (AP): APIC ID:  4
 cpu3 (AP): APIC ID:  6
x86bios:  IVT 0x000000-0x0004ff at 0xfffff80000000000
x86bios: SSEG 0x001000-0x001fff at 0xfffffe00929f8000
x86bios:  ROM 0x0a0000-0x0fefff at 0xfffff800000a0000
ULE: setup cpu 0
ULE: setup cpu 1
ULE: setup cpu 2
ULE: setup cpu 3
Xen interrupt system initialized
Table 'FACP' at 0xdc392c10
Table 'APIC' at 0xdc392d20
APIC: Found table at 0xdc392d20
ACPI: RSDP 0x00000000000F0580 000024 (v02 INTEL )
ACPI: XSDT 0x00000000DC37F090 0000A4 (v01 INTEL  NUC5i3MY 01072009 AMI  00010013)
ACPI: FACP 0x00000000DC392C10 00010C (v05 INTEL  NUC5i3MY 01072009 AMI  00010013)
ACPI: DSDT 0x00000000DC37F1C8 013A48 (v02 INTEL  NUC5i3MY 01072009 INTL 20120913)
ACPI: FACS 0x00000000DCCC9F80 000040
ACPI: APIC 0x00000000DC392D20 000084 (v03 INTEL  NUC5i3MY 01072009 AMI  00010013)
ACPI: FPDT 0x00000000DC392DA8 000044 (v01 INTEL  NUC5i3MY 01072009 AMI  00010013)
ACPI: FIDT 0x00000000DC392DF0 00009C (v01 INTEL  NUC5i3MY 01072009 AMI  00010013)
ACPI: MCFG 0x00000000DC392E90 00003C (v01 INTEL  NUC5i3MY 01072009 MSFT 00000097)
ACPI: HPET 0x00000000DC392ED0 000038 (v01 INTEL  NUC5i3MY 01072009 AMI. 00000005)
ACPI: SSDT 0x00000000DC392F08 000315 (v01 INTEL  NUC5i3MY 00001000 INTL 20120913)
ACPI: UEFI 0x00000000DC393220 000042 (v01 INTEL  NUC5i3MY 00000000      00000000)
ACPI: SSDT 0x00000000DC393268 000C7D (v02 INTEL  NUC5i3MY 00001000 INTL 20120913)
ACPI: ASF! 0x00000000DC393EE8 0000A0 (v32 INTEL  NUC5i3MY 00000001 TFSM 000F4240)
ACPI: SSDT 0x00000000DC393F88 000539 (v02 INTEL  NUC5i3MY 00003000 INTL 20120913)
ACPI: SSDT 0x00000000DC3944C8 000B74 (v02 INTEL  NUC5i3MY 00003000 INTL 20120913)
ACPI: TPM2 0x00000000DC395040 000034 (v03 INTEL  NUC5i3MY 00000001 AMI  00000000)
ACPI: SSDT 0x00000000DC395078 000041 (v01 INTEL  NUC5i3MY 00001000 INTL 20120913)
ACPI: SSDT 0x00000000DC3950C0 005CF6 (v02 INTEL  NUC5i3MY 00003000 INTL 20120913)
ACPI: XMAR 0x00000000DC39ADB8 0000B0 (v01 INTEL  NUC5i3MY 00000001 INTL 00000001)
MADT: Interrupt override: source 0, irq 2
xen: register IRQ#2
MADT: Interrupt override: source 9, irq 9
xen: register IRQ#9
xen: register IRQ#1
xen: register IRQ#3
xen: register IRQ#4
xen: register IRQ#5
xen: register IRQ#6
xen: register IRQ#7
xen: register IRQ#8
xen: register IRQ#10
xen: register IRQ#11
xen: register IRQ#12
xen: register IRQ#13
xen: register IRQ#14
xen: register IRQ#15
cpu0 BSP XEN PV LAPIC
snd_unit_init() u=0x00ff8000 [512] d=0x00007c00 [32] c=0x000003ff [1024]
feeder_register: snd_unit=-1 snd_maxautovchans=16 latency=5 feeder_rate_min=1 feeder_rate_max=2016000 feeder_rate_round=25
wlan: <802.11 Link Layer>
random: entropy device infrastructure driver
random: selecting highest priority adaptor <Dummy>
kbd: new array size 4
kbd1 at kbdmux0
mem: <memory>
nfslock: pseudo-device
netmap: loaded module
null: <full device, null device, zero device>
random: SOFT: yarrow init()
random: selecting highest priority adaptor <Yarrow>
module_register_init: MOD_LOAD (vesa, 0xffffffff80dde720, 0) error 19
io: <I/O>
VMBUS: load
random: live provider: "Intel Secure Key RNG"
hptnr: R750/DC7280 controller driver v1.0.1
hpt27xx: RocketRAID 27xx controller driver v1.1
hptrr: RocketRAID 17xx/2xxx SATA controller driver v1.2
xenpv0: <Xen PV bus> on motherboard
granttable0: <Xen Grant-table Device> on xenpv0
Grant table initialized
xc0: <Xen Console> on xenpv0
xen_et0: <Xen PV Clock> on xenpv0
Event timer "XENTIMER" frequency 1000000000 Hz quality 950
Timecounter "XENTIMER" frequency 1000000000 Hz quality 950
xen_et0: registered as a time-of-day clock (resolution 10000000us, adjustment 5.000000000s)
pvcpu0: <Xen PV CPU> on xenpv0
pvcpu1: <Xen PV CPU> on xenpv0
pvcpu2: <Xen PV CPU> on xenpv0
pvcpu3: <Xen PV CPU> on xenpv0
xenstore0: <XenStore> on xenpv0
xsd_dev0: <Xenstored user-space device> on xenpv0
evtchn0: <Xen event channel user-space device> on xenpv0
privcmd0: <Xen privileged interface user-space device> on xenpv0
isa0: <ISA bus> on xenpv0
acpi0: <INTEL> on motherboard
ACPI: All ACPI Tables successfully acquired
PCIe: Memory Mapped configuration base @ 0xf8000000
ACPI: Executed 18 blocks of module-level executable AML code
acpi0: Power Button (fixed)
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: Warning: Couldn't map I/O.
atrtc0: not installed as time-of-day clock: clock xen_et has higher resolution
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
attimer0: Can't map interrupt.
pci_link0:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0   11   N     0  3 4 5 6 10 11 12 14 15
  Validation          0   11   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pci_link1:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0  255   N     0  3 4 5 6 10 11 12 14 15
  Validation          0  255   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pci_link2:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0   10   N     0  3 4 5 6 10 11 12 14 15
  Validation          0   10   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pci_link3:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0   10   N     0  3 4 5 6 10 11 12 14 15
  Validation          0   10   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pci_link4:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0    5   N     0  3 4 5 6 10 11 12 14 15
  Validation          0    5   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pci_link5:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0  255   N     0  3 4 5 6 10 11 12 14 15
  Validation          0  255   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pci_link6:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0    3   N     0  3 4 5 6 10 11 12 14 15
  Validation          0    3   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pci_link7:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0   11   N     0  3 4 5 6 10 11 12 14 15
  Validation          0   11   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pcib0: decoding 5 range 0-0x3e
pcib0: decoding 4 range 0-0xcf7
pcib0: decoding 4 range 0xd00-0xffff
pcib0: decoding 3 range 0xa0000-0xbffff
pcib0: decoding 3 range 0xe0000000-0xfeafffff
pci0: <Xen ACPI PCI bus> on pcib0
pci0: domain=0, physical bus=0
found-> vendor=0x8086, dev=0x1604, revid=0x09
        domain=0, bus=0, slot=0, func=0
        class=06-00-00, hdrtype=0x00, mfdev=0
        cmdreg=0x0006, statreg=0x2090, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
(XEN) Bogus DMIBAR 0xfed18001 on 0000:00:00.0
(XEN) PCI add device 0000:00:00.0
found-> vendor=0x8086, dev=0x1616, revid=0x09
        domain=0, bus=0, slot=2, func=0
        class=03-00-00, hdrtype=0x00, mfdev=0
        cmdreg=0x0007, statreg=0x0090, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=a, irq=11
        powerspec 2  supports D0 D3  current D0
        MSI supports 1 message
        map[10]: type Memory, range 64, base 0xf6000000, size 24, enabled
pcib0: allocated type 3 (0xf6000000-0xf6ffffff) for rid 10 of pci0:0:2:0
        map[18]: type Prefetchable Memory, range 64, base 0xe8000000, size 27, enabled
pcib0: allocated type 3 (0xe8000000-0xefffffff) for rid 18 of pci0:0:2:0
        map[20]: type I/O Port, range 32, base 0xf000, size  6, enabled
pcib0: allocated type 4 (0xf000-0xf03f) for rid 20 of pci0:0:2:0
pcib0: matched entry for 0.2.INTA
pcib0: slot 2 INTA hardwired to IRQ 16
xen: register IRQ#16
(XEN) PCI add device 0000:00:02.0
found-> vendor=0x8086, dev=0x160c, revid=0x09
        domain=0, bus=0, slot=3, func=0
        class=04-03-00, hdrtype=0x00, mfdev=0
        cmdreg=0x0006, statreg=0x0010, cachelnsz=16 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=a, irq=11
        powerspec 2  supports D0 D3  current D0
        MSI supports 1 message
        map[10]: type Memory, range 64, base 0xf7034000, size 14, enabled
pcib0: allocated type 3 (0xf7034000-0xf7037fff) for rid 10 of pci0:0:3:0
pcib0: matched entry for 0.3.INTA
pcib0: slot 3 INTA hardwired to IRQ 16
(XEN) PCI add device 0000:00:03.0
found-> vendor=0x8086, dev=0x9cb1, revid=0x03
        domain=0, bus=0, slot=20, func=0
        class=0c-03-30, hdrtype=0x00, mfdev=0
        cmdreg=0x0006, statreg=0x0290, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=a, irq=11
        powerspec 2  supports D0 D3  current D0
        MSI supports 8 messages, 64 bit
        map[10]: type Memory, range 64, base 0xf7020000, size 16, enabled
pcib0: allocated type 3 (0xf7020000-0xf702ffff) for rid 10 of pci0:0:20:0
pcib0: matched entry for 0.20.INTA
pcib0: slot 20 INTA hardwired to IRQ 21
xen: register IRQ#21
(XEN) PCI add device 0000:00:14.0
found-> vendor=0x8086, dev=0x9cba, revid=0x03
        domain=0, bus=0, slot=22, func=0
        class=07-80-00, hdrtype=0x00, mfdev=1
        cmdreg=0x0006, statreg=0x0010, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=a, irq=11
        powerspec 3  supports D0 D3  current D0
        MSI supports 1 message, 64 bit
        map[10]: type Memory, range 64, base 0xf703d000, size  5, enabled
pcib0: allocated type 3 (0xf703d000-0xf703d01f) for rid 10 of pci0:0:22:0
pcib0: matched entry for 0.22.INTA
pcib0: slot 22 INTA hardwired to IRQ 16
(XEN) PCI add device 0000:00:16.0
found-> vendor=0x8086, dev=0x15a3, revid=0x03
        domain=0, bus=0, slot=25, func=0
        class=02-00-00, hdrtype=0x00, mfdev=0
        cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=a, irq=5
        powerspec 2  supports D0 D3  current D0
        MSI supports 1 message, 64 bit
        map[10]: type Memory, range 32, base 0xf7000000, size 17, enabled
pcib0: allocated type 3 (0xf7000000-0xf701ffff) for rid 10 of pci0:0:25:0
        map[14]: type Memory, range 32, base 0xf703b000, size 12, enabled
pcib0: allocated type 3 (0xf703b000-0xf703bfff) for rid 14 of pci0:0:25:0
        map[18]: type I/O Port, range 32, base 0xf080, size  5, enabled
pcib0: allocated type 4 (0xf080-0xf09f) for rid 18 of pci0:0:25:0
pcib0: matched entry for 0.25.INTA
pcib0: slot 25 INTA hardwired to IRQ 20
xen: register IRQ#20
(XEN) PCI add device 0000:00:19.0
found-> vendor=0x8086, dev=0x9ca0, revid=0x03
        domain=0, bus=0, slot=27, func=0
        class=04-03-00, hdrtype=0x00, mfdev=0
        cmdreg=0x0006, statreg=0x0010, cachelnsz=16 (dwords)
        lattimer=0x20 (960 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=a, irq=3
        powerspec 3  supports D0 D3  current D0
        MSI supports 1 message, 64 bit
        map[10]: type Memory, range 64, base 0xf7030000, size 14, enabled
pcib0: allocated type 3 (0xf7030000-0xf7033fff) for rid 10 of pci0:0:27:0
pcib0: matched entry for 0.27.INTA
pcib0: slot 27 INTA hardwired to IRQ 22
xen: register IRQ#22
(XEN) PCI add device 0000:00:1b.0
found-> vendor=0x8086, dev=0x9ca6, revid=0x03
        domain=0, bus=0, slot=29, func=0
        class=0c-03-20, hdrtype=0x00, mfdev=0
        cmdreg=0x0006, statreg=0x2290, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=a, irq=11
        powerspec 3  supports D0 D3  current D0
        map[10]: type Memory, range 32, base 0xf703a000, size 10, enabled
pcib0: allocated type 3 (0xf703a000-0xf703a3ff) for rid 10 of pci0:0:29:0
pcib0: matched entry for 0.29.INTA
pcib0: slot 29 INTA hardwired to IRQ 23
xen: register IRQ#23
ehci early: SMM active, request owner change
(XEN) PCI add device 0000:00:1d.0
found-> vendor=0x8086, dev=0x9cc3, revid=0x03
        domain=0, bus=0, slot=31, func=0
        class=06-01-00, hdrtype=0x00, mfdev=1
        cmdreg=0x0007, statreg=0x0210, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
(XEN) PCI add device 0000:00:1f.0
found-> vendor=0x8086, dev=0x9c83, revid=0x03
        domain=0, bus=0, slot=31, func=2
        class=01-06-01, hdrtype=0x00, mfdev=0
        cmdreg=0x0007, statreg=0x02b0, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=b, irq=10
        powerspec 3  supports D0 D3  current D0
        MSI supports 1 message
        map[10]: type I/O Port, range 32, base 0xf0d0, size  3, enabled
pcib0: allocated type 4 (0xf0d0-0xf0d7) for rid 10 of pci0:0:31:2
        map[14]: type I/O Port, range 32, base 0xf0c0, size  2, enabled
pcib0: allocated type 4 (0xf0c0-0xf0c3) for rid 14 of pci0:0:31:2
        map[18]: type I/O Port, range 32, base 0xf0b0, size  3, enabled
pcib0: allocated type 4 (0xf0b0-0xf0b7) for rid 18 of pci0:0:31:2
        map[1c]: type I/O Port, range 32, base 0xf0a0, size  2, enabled
pcib0: allocated type 4 (0xf0a0-0xf0a3) for rid 1c of pci0:0:31:2
        map[20]: type I/O Port, range 32, base 0xf060, size  5, enabled
pcib0: allocated type 4 (0xf060-0xf07f) for rid 20 of pci0:0:31:2
        map[24]: type Memory, range 32, base 0xf7039000, size 11, enabled
pcib0: allocated type 3 (0xf7039000-0xf70397ff) for rid 24 of pci0:0:31:2
pcib0: matched entry for 0.31.INTB
pcib0: slot 31 INTB hardwired to IRQ 19
xen: register IRQ#19
(XEN) PCI add device 0000:00:1f.2
found-> vendor=0x8086, dev=0x9ca2, revid=0x03
        domain=0, bus=0, slot=31, func=3
        class=0c-05-00, hdrtype=0x00, mfdev=0
        cmdreg=0x0003, statreg=0x0280, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=c, irq=10
        map[10]: type Memory, range 64, base 0xf7038000, size  8, enabled
pcib0: allocated type 3 (0xf7038000-0xf70380ff) for rid 10 of pci0:0:31:3
        map[20]: type I/O Port, range 32, base 0xf040, size  5, enabled
pcib0: allocated type 4 (0xf040-0xf05f) for rid 20 of pci0:0:31:3
pcib0: matched entry for 0.31.INTC
pcib0: slot 31 INTC hardwired to IRQ 18
xen: register IRQ#18
(XEN) PCI add device 0000:00:1f.3
vgapci0: <VGA-compatible display> port 0xf000-0xf03f mem 0xf6000000-0xf6ffffff,0xe8000000-0xefffffff irq 16 at device 2.0 on pci0
vgapci0: Boot video device
hdac0: <Intel (0x160c) HDA Controller> mem 0xf7034000-0xf7037fff irq 16 at device 3.0 on pci0
hdac0: PCI card vendor: 0x8086, device: 0x2058
hdac0: HDA Driver Revision: 20120126_0002
hdac0: Config options: on=0x00000000 off=0x00000000
hdac0: attempting to allocate 1 MSI vectors (1 supported)
hdac0: using IRQ 256 for MSI
hdac0: Caps: OSS 3, ISS 0, BSS 0, NSDO 1, 64bit, CORB 256, RIRB 256
xhci0: <XHCI (generic) USB 3.0 controller> mem 0xf7020000-0xf702ffff irq 21 at device 20.0 on pci0
xhci0: 32 bytes context size, 64-bit DMA
xhci0: attempting to allocate 1 MSI vectors (8 supported)
xhci0: using IRQ 257 for MSI
xhci0: MSI enabled
usbus0 on xhci0
xhci0: usbpf: Attached
pci0: <simple comms> at device 22.0 (no driver attached)
em0: <Intel(R) PRO/1000 Network Connection 7.4.2> port 0xf080-0xf09f mem 0xf7000000-0xf701ffff,0xf703b000-0xf703bfff irq 20 at device 25.0 on pci0
em0: attempting to allocate 1 MSI vectors (1 supported)
em0: using IRQ 258 for MSI
em0: Using an MSI interrupt
em0: bpf attached
em0: Ethernet address: b8:ae:ed:70:85:31
001.000051 [2717] netmap_attach             success for em0 tx 1/1024 rx 1/1024 queues/slots
hdac1: <Intel (0x9ca0) HDA Controller> mem 0xf7030000-0xf7033fff irq 22 at device 27.0 on pci0
hdac1: PCI card vendor: 0x8086, device: 0x2058
hdac1: HDA Driver Revision: 20120126_0002
hdac1: Config options: on=0x00000000 off=0x00000000
hdac1: attempting to allocate 1 MSI vectors (1 supported)
hdac1: using IRQ 259 for MSI
hdac1: Caps: OSS 4, ISS 4, BSS 0, NSDO 1, 64bit, CORB 256, RIRB 256
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xf703a000-0xf703a3ff irq 23 at device 29.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci0
ehci0: usbpf: Attached
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa: isa0 already exists; skipping it
device_attach: isab0 attach returned 6
ahci0: <AHCI SATA controller> port 0xf0d0-0xf0d7,0xf0c0-0xf0c3,0xf0b0-0xf0b7,0xf0a0-0xf0a3,0xf060-0xf07f mem 0xf7039000-0xf70397ff irq 19 at device 31.2 on pci0
ahci0: attempting to allocate 1 MSI vectors (1 supported)
ahci0: using IRQ 260 for MSI
ahci0: AHCI v1.30 with 2 6Gbps ports, Port Multiplier not supported
ahci0: Caps: 64bit NCQ ALP AL CLO 6Gbps PMD SSC PSC 32cmd 2ports
ahci0: Caps2: DESO SADM SDS APST
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich0: Caps:
ahcich1: not probed (disabled)
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
acpi_button0: <Sleep Button> on acpi0
acpi_button1: <Power Button> on acpi0
acpi_tz0: <Thermal Zone> on acpi0
acpi_tz1: <Thermal Zone> on acpi0
ACPI: Enabled 4 GPEs in block 00 to 7F
acpi0: wakeup code va 0xfffffe0096c59000 pa 0x4000
ahc_isa_identify 0: ioport 0xc00 alloc failed
isa_probe_children: disabling PnP devices
atrtc: atrtc0 already exists; skipping it
attimer: attimer0 already exists; skipping it
sc: sc0 already exists; skipping it
isa_probe_children: probing non-PnP devices
orm0: <ISA Option ROM> at iomem 0xd0000-0xd0fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: CGA <16 virtual consoles, flags=0x300>
sc0: fb0, kbd1, terminal emulator: scteken (teken terminal)
vga0: <Generic ISA VGA> at port 0x3d0-0x3db iomem 0xb8000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
kbd0: atkbd0, generic (0), config:0x0, flags:0x3f0000
device_attach: atkbd0 attach returned 6
psm0: unable to allocate IRQ
fdc0: ic_type 90 part_id 80
fdc0: <Enhanced floppy controller> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
fdc0: ic_type 90 part_id 80
fdc0: cannot setup interrupt
device_attach: fdc0 attach returned 6
ppc0: cannot reserve I/O port range
ppc0 failed to probe at irq 7 on isa0
uart0 failed to probe at port 0x3f8 irq 4 on isa0
uart1 failed to probe at port 0x2f8-0x2ff irq 3 on isa0
wbwd0 failed to probe on isa0
isa_probe_children: probing PnP devices
Device configuration finished.
procfs registered
ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present;
            to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 10.000 msec
vlan: initialized, using hash tables with chaining
tcp_init: net.inet.tcp.tcbhashsize auto tuned to 16384
lo0: bpf attached
hptnr: no controller detected.
hpt27xx: no controller detected.
hptrr: no controller detected.
hdac0: Command timeout on address 0
hdac0: Command timeout on address 0
hdac0: CODEC is not responding!
hdacc0: <Realtek (0x0283) HDA CODEC> at cad 0 on hdac1
hdaa0: <Realtek (0x0283) Audio Function Group> at nid 1 on hdacc0
hdaa0: Subsystem ID: 0x80862058
hdaa0: NumGPIO=3 NumGPO=0 NumGPI=0 GPIWake=0 GPIUnsol=1
hdaa0:  GPIO0: disabled
hdaa0:  GPIO1: disabled
hdaa0:  GPIO2: disabled
hdaa0: Original pins configuration:
hdaa0: nid   0x    as seq device       conn  jack    loc        color   misc
hdaa0: 18 40000000 0  0  Line-out      None  Unknown 0x00       Unknown 0
hdaa0: 20 411111f0 15 0  Speaker       None  1/8     Rear       Black   1
hdaa0: 23 411111f0 15 0  Speaker       None  1/8     Rear       Black   1
hdaa0: 24 411111f0 15 0  Speaker       None  1/8     Rear       Black   1
hdaa0: 25 03a11020 2  0  Mic           Jack  1/8     Left       Black   0
hdaa0: 26 411111f0 15 0  Speaker       None  1/8     Rear       Black   1
hdaa0: 27 411111f0 15 0  Speaker       None  1/8     Rear       Black   1
hdaa0: 29 40500001 0  1  Digital-out   None  Unknown 0x00       Unknown 0
hdaa0: 30 411111f0 15 0  Speaker       None  1/8     Rear       Black   1
hdaa0: 33 03211010 1  0  Headphones    Jack  1/8     Left       Black   0
hdaa0: Patching widget caps nid=29 0x00400400 -> 0x00700400
hdaa0: Patched pins configuration:
hdaa0: nid   0x    as seq device       conn  jack    loc        color   misc
hdaa0: 18 40000000 0  0  Line-out      None  Unknown 0x00       Unknown 0 DISA
hdaa0: 20 411111f0 15 0  Speaker       None  1/8     Rear       Black   1 DISA
hdaa0: 23 411111f0 15 0  Speaker       None  1/8     Rear       Black   1 DISA
hdaa0: 24 411111f0 15 0  Speaker       None  1/8     Rear       Black   1 DISA
hdaa0: 25 03a11020 2  0  Mic           Jack  1/8     Left       Black   0
hdaa0: 26 411111f0 15 0  Speaker       None  1/8     Rear       Black   1 DISA
hdaa0: 27 411111f0 15 0  Speaker       None  1/8     Rear       Black   1 DISA
hdaa0: 30 411111f0 15 0  Speaker       None  1/8     Rear       Black   1 DISA
hdaa0: 33 03211010 1  0  Headphones    Jack  1/8     Left       Black   0
hdaa0: 2 associations found:
hdaa0: Association 0 (1) out:
hdaa0:  Pin nid=33 seq=0
hdaa0: Association 1 (2) in:
hdaa0:  Pin nid=25 seq=0
hdaa0: Tracing association 0 (1)
hdaa0:  Pin 33 traced to DAC 2
hdaa0: Association 0 (1) trace succeeded
hdaa0: Tracing association 1 (2)
hdaa0:  Pin 25 traced to ADC 8
hdaa0: Association 1 (2) trace succeeded
hdaa0: Looking for additional DAC for association 0 (1)
hdaa0: Looking for additional ADC for association 1 (2)
hdaa0:  ADC 9 considered equal to ADC 8
hdaa0: Tracing input monitor
hdaa0:  Tracing nid 11 to out
hdaa0:  nid 11 is input monitor
hdaa0:  Tracing nid 34 to out
hdaa0:  Tracing nid 35 to out
hdaa0: Tracing other input monitors
hdaa0:  Tracing nid 25 to out
hdaa0: Tracing beeper
hdaa0: FG config/quirks: forcestereo ivref50 ivref80 ivref100 ivref
pcm0: <Realtek (0x0283) (Left Analog)> at nid 33 and 25 on hdaa0
pcm0: Playback:
pcm0:      Stream cap: 0x00000001 PCM
pcm0:         PCM cap: 0x000e0560 16 20 24 bits, 44 48 96 192 KHz
pcm0:             DAC: 2
pcm0:
pcm0:     nid=33 [pin: Headphones (Black Jack)]
pcm0:       + <- nid=12 [audio mixer] [src: pcm, mix]
pcm0:              + <- nid=2 [audio output] [src: pcm]
pcm0:              + <- nid=11 [audio mixer] [src: mix]
pcm0:
pcm0: Record:
pcm0:      Stream cap: 0x00000001 PCM
pcm0:         PCM cap: 0x000e0560 16 20 24 bits, 44 48 96 192 KHz
pcm0:             ADC: 8
pcm0:             ADC: 9
pcm0:
pcm0:     nid=8 [audio input]
pcm0:       + <- nid=35 [audio mixer] [src: speaker, mic, mix]
pcm0:              + <- nid=25 [pin: Mic (Black Jack)] [src: mic]
pcm0:              + <- nid=29 [beep widget] [src: speaker]
pcm0:              + <- nid=11 [audio mixer] [src: mix]
pcm0:
pcm0:     nid=9 [audio input]
pcm0:       + <- nid=34 [audio mixer] [src: speaker, mic, mix]
pcm0:              + <- nid=25 [pin: Mic (Black Jack)] [src: mic]
pcm0:              + <- nid=29 [beep widget] [src: speaker]
pcm0:              + <- nid=11 [audio mixer] [src: mix]
pcm0:
pcm0: Input Mix:
pcm0:
pcm0:     nid=11 [audio mixer]
pcm0:       + <- nid=25 [pin: Mic (Black Jack)] [src: mic]
pcm0:       + <- nid=29 [beep widget] [src: speaker]
pcm0:
pcm0: Master Volume (OSS: vol): -65/0dB
pcm0:    +- ctl  1 (nid   2 out):    -65/0dB (88 steps)
pcm0:    +- ctl 10 (nid  12 in   0): mute
pcm0:    +- ctl 11 (nid  12 in   1): mute
pcm0:    +- ctl 24 (nid  33 in ):    mute
pcm0:
pcm0: PCM Volume (OSS: pcm): -65/0dB
pcm0:    +- ctl  1 (nid   2 out):    -65/0dB (88 steps)
pcm0:    +- ctl 10 (nid  12 in   0): mute
pcm0:
pcm0: Microphone Volume (OSS: mic): 0/36dB
pcm0:    +- ctl  6 (nid  11 in   1): -34/12dB (32 steps) + mute
pcm0:    +- ctl 20 (nid  25 out):    0/36dB (4 steps)
pcm0:    +- ctl 26 (nid  34 in   1): mute
pcm0:    +- ctl 32 (nid  35 in   1): mute
pcm0:
pcm0: Speaker/Beep Volume (OSS: speaker): -34/12dB
pcm0:    +- ctl  9 (nid  11 in   4): -34/12dB (32 steps) + mute
pcm0:    +- ctl 29 (nid  34 in   4): mute
pcm0:    +- ctl 35 (nid  35 in   4): mute
pcm0:
pcm0: Recording Level (OSS: rec): -17/30dB
pcm0:    +- ctl  3 (nid   8 in   0): -17/30dB (64 steps) + mute
pcm0:    +- ctl  4 (nid   9 in   0): -17/30dB (64 steps) + mute
pcm0:    +- ctl 26 (nid  34 in   1): mute
pcm0:    +- ctl 29 (nid  34 in   4): mute
pcm0:    +- ctl 30 (nid  34 in   5): mute
pcm0:    +- ctl 32 (nid  35 in   1): mute
pcm0:    +- ctl 35 (nid  35 in   4): mute
pcm0:    +- ctl 36 (nid  35 in   5): mute
pcm0:
pcm0: Input Mix Level (OSS: mix): -34/12dB
pcm0:    +- ctl  6 (nid  11 in   1): -34/12dB (32 steps) + mute
pcm0:    +- ctl  9 (nid  11 in   4): -34/12dB (32 steps) + mute
pcm0:    +- ctl 11 (nid  12 in   1): mute
pcm0:    +- ctl 30 (nid  34 in   5): mute
pcm0:    +- ctl 36 (nid  35 in   5): mute
pcm0:
pcm0: Input Monitoring Level (OSS: igain): 0/0dB
pcm0:    +- ctl 11 (nid  12 in   1): mute
pcm0:
pcm0: Mixer "vol":
pcm0: Mixer "pcm":
pcm0: Mixer "speaker":
pcm0: Mixer "mic":
pcm0: Mixer "mix":
pcm0: Mixer "rec":
pcm0: Mixer "igain":
pcm0: Mixer "ogain":
pcm0: Playback channel set is: Front Left, Front Right,
pcm0: Playback channel matrix is: 2.0 (disconnected)
pcm0: Recording channel set is: Front Left, Front Right,
pcm0: Recording channel matrix is: 2.0 (disconnected)
usbus0: 5.0Gbps Super Speed USB v3.0
usbus1: 480Mbps High Speed USB v2.0
ahcich0: AHCI reset...
ahcich0: SATA connect time=1000us status=00000123
ahcich0: AHCI reset: device found
ugen1.1: <Intel> at usbus1
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
ugen0.1: <0x8086> at usbus0
uhub1: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ahcich0: AHCI reset: device ready after 100ms
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <TOSHIBA MQ01ABD050 AX001A> ATA-8 SATA 2.x device
ada0: Serial Number Z3FPSWXES
ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad4
pass0 at ahcich0 bus 0 scbus0 target 0 lun 0
pass0: <TOSHIBA MQ01ABD050 AX001A> ATA-8 SATA 2.x device
pass0: Serial Number Z3FPSWXES
pass0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
pass0: Command Queueing enabled
GEOM: new disk ada0
random: unblocking device.
Netvsc initializing... done!
SMP: AP CPU #2 Launched!
cpu2 AP XEN PV LAPIC
SMP: AP CPU #3 Launched!
cpu3 AP XEN PV LAPIC
SMP: AP CPU #1 Launched!
cpu1 AP XEN PV LAPIC
Timecounter "TSC" frequency 2095150328 Hz quality -100
WARNING: WITNESS option enabled, expect reduced performance.
Root mount waiting for: usbus1 usbus0
uhub1: 15 ports with 15 removable, self powered
uhub0: 2 ports with 2 removable, self powered
Root mount waiting for: usbus1
ugen1.2: <vendor 0x8087> at usbus1
uhub2: <vendor 0x8087 product 0x8001, class 9/0, rev 2.00/0.03, addr 2> on usbus1
uhub2: 8 ports with 8 removable, self powered
Trying to mount root from zfs:tank/root []...
GEOM_PART: partition 2 is not aligned on 8192 bytes
start_init: trying /sbin/init
GEOM_PART: partition 1 is not aligned on 8192 bytes
GEOM_PART: partition 2 is not aligned on 8192 bytes
GEOM_PART: partition 3 is not aligned on 8192 bytes
Setting hostuuid: 6a092280-d797-11dd-a694-b8aeed708531.
Setting hostid: 0xfbe57a7e.
Starting file system checks:
Mounting local file systems:.
/etc/rc: WARNING: $hostname is not set -- see rc.conf(5).
Feeding entropy:.
bridge0: bpf attached
bridge0: Ethernet address: 02:fb:e5:7a:7e:00
Created clone interfaces: bridge0.
em0: promiscuous mode enabled
bridge0: link state changed to UP
Starting dhclient.
DHCPREQUEST on bridge0 to 255.255.255.255 port 67
DHCPREQUEST on bridge0 to 255.255.255.255 port 67
em0: Link is up 100 Mbps Full Duplex
em0: link state changed to UP
DHCPACK from 172.16.1.1
bound to 172.16.1.127 -- renewal in 43200 seconds.
Starting Network: lo0 em0 bridge0.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
        inet6 ::1 prefixlen 128
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2
        inet 127.0.0.1 netmask 0xff000000
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: lo
em0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
        ether b8:ae:ed:70:85:31
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect (100baseTX <full-duplex>)
        status: active
bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        ether b8:ae:ed:70:85:31
        inet 172.16.1.127 netmask 0xffffff00 broadcast 172.16.1.255
        nd6 options=9<PERFORMNUD,IFDISABLED>
        groups: bridge
        id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
        maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
        root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
        member: em0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
                ifmaxaddr 0 port 1 priority 128 path cost 2000000
Starting devd.
Starting pflogd:
add net fe80::: gateway ::1
add net ff02::: gateway ::1
add net ::ffff:0.0.0.0: gateway ::1
add net ::0.0.0.0: gateway ::1
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/gcc47
32-bit compatibility ldconfig path: /usr/lib32
Creating and/or trimming log files.
Starting syslogd.
No core dumps found.
Starting casperd.
Clearing /tmp (X related).
Cleaning xenstore database.
Starting xenservices: xenstored, xenconsoled.Feb 26 22:41:23  xenstored: TDB: tdb_open_ex: could not open file /var/lib/xenstored/tdb: No such file or directory
Feb 26 22:41:23  xenstored: Checking store ...
Feb 26 22:41:23  xenstored: Checking store complete.
WARNING: Failed to open connection to gnttab
xenballoon0: <Xen Balloon Device> on xenstore0
xctrl0: <Xen Control Device> on xenstore0
xs_dev0: <Xenstore user-space device> on xenstore0
xenbusb_front0: <Xen Frontend Devices> on xenstore0
xenbusb_back0: <Xen Backend Devices> on xenstore0

Setting domain 0 name, domid and JSON config...
Done setting up Dom0
Updating motd:.
Mounting late file systems:.
Configuring syscons: blanktime.
Performing sanity check on sshd configuration.
Starting sshd.
Starting cron.
Starting background file system checks in 60 seconds.

Thu Feb 26 22:41:24 UTC 2015

FreeBSD/amd64 (Amnesiac) (xc0)

And here is the output of the system booting with iommu=debug,no-
intremap. I had to add no-interemap in order to see the IOMMU page 
faults, without no-intremap the result is the same, but no IOMMU faults 
are reported (not sure why this happens also):

/boot/xen data=0x1de9f0+0x7fd22610 -
/boot/kernel/kernel size=0x14bcd33
/boot/kernel/zfs.ko size 0x37d888 at 0x81550000
loading required module 'opensolaris'
/boot/kernel/opensolaris.ko size 0xc790 at 0x818ce000
Booting...
 Xen 4.6-unstable
(XEN) Xen version 4.6-unstable (root@) (gcc47 (FreeBSD Ports Collection) 4.7.4) debug=y Thu Feb 26 19:23:57 UTC 2015
(XEN) Latest ChangeSet: Wed Feb 11 17:21:14 2015 +0100 git:cb34a7c-dirty
(XEN) Bootloader: FreeBSD Loader
(XEN) Command line: dom0_mem=2048M dom0pvh=1 console=com1,vga iommu=debug,no-intremap guest_loglvl=all loglvl=all
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: V2; EDID transfer time: 1 seconds
(XEN) Disc information:
(XEN)  Found 1 MBR signatures
(XEN)  Found 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 000000000009d800 (usable)
(XEN)  000000000009d800 - 00000000000a0000 (reserved)
(XEN)  00000000000e0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 00000000d76d8000 (usable)
(XEN)  00000000d76d8000 - 00000000d7bb5000 (reserved)
(XEN)  00000000d7bb5000 - 00000000dc319000 (usable)
(XEN)  00000000dc319000 - 00000000dc378000 (reserved)
(XEN)  00000000dc378000 - 00000000dc39b000 (ACPI data)
(XEN)  00000000dc39b000 - 00000000dcccb000 (ACPI NVS)
(XEN)  00000000dcccb000 - 00000000dcfff000 (reserved)
(XEN)  00000000dcfff000 - 00000000dd000000 (usable)
(XEN)  00000000dd800000 - 00000000e0000000 (reserved)
(XEN)  00000000f8000000 - 00000000fc000000 (reserved)
(XEN)  00000000fec00000 - 00000000fec01000 (reserved)
(XEN)  00000000fed00000 - 00000000fed04000 (reserved)
(XEN)  00000000fed1c000 - 00000000fed20000 (reserved)
(XEN)  00000000fee00000 - 00000000fee01000 (reserved)
(XEN)  00000000ff000000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 000000021f000000 (usable)
(XEN) ACPI: RSDP 000F0580, 0024 (r2 INTEL )
(XEN) ACPI: XSDT DC37F090, 00A4 (r1  INTEL NUC5i3MY  1072009 AMI     10013)
(XEN) ACPI: FACP DC392C10, 010C (r5  INTEL NUC5i3MY  1072009 AMI     10013)
(XEN) ACPI: DSDT DC37F1C8, 13A48 (r2  INTEL NUC5i3MY  1072009 INTL 20120913)
(XEN) ACPI: FACS DCCC9F80, 0040
(XEN) ACPI: APIC DC392D20, 0084 (r3  INTEL NUC5i3MY  1072009 AMI     10013)
(XEN) ACPI: FPDT DC392DA8, 0044 (r1  INTEL NUC5i3MY  1072009 AMI     10013)
(XEN) ACPI: FIDT DC392DF0, 009C (r1  INTEL NUC5i3MY  1072009 AMI     10013)
(XEN) ACPI: MCFG DC392E90, 003C (r1  INTEL NUC5i3MY  1072009 MSFT       97)
(XEN) ACPI: HPET DC392ED0, 0038 (r1  INTEL NUC5i3MY  1072009 AMI.        5)
(XEN) ACPI: SSDT DC392F08, 0315 (r1  INTEL NUC5i3MY     1000 INTL 20120913)
(XEN) ACPI: UEFI DC393220, 0042 (r1  INTEL NUC5i3MY        0             0)
(XEN) ACPI: SSDT DC393268, 0C7D (r2  INTEL NUC5i3MY     1000 INTL 20120913)
(XEN) ACPI: ASF! DC393EE8, 00A0 (r32  INTEL NUC5i3MY        1 TFSM    F4240)
(XEN) ACPI: SSDT DC393F88, 0539 (r2  INTEL NUC5i3MY     3000 INTL 20120913)
(XEN) ACPI: SSDT DC3944C8, 0B74 (r2  INTEL NUC5i3MY     3000 INTL 20120913)
(XEN) ACPI: TPM2 DC395040, 0034 (r3  INTEL NUC5i3MY        1 AMI         0)
(XEN) ACPI: SSDT DC395078, 0041 (r1  INTEL NUC5i3MY     1000 INTL 20120913)
(XEN) ACPI: SSDT DC3950C0, 5CF6 (r2  INTEL NUC5i3MY     3000 INTL 20120913)
(XEN) ACPI: DMAR DC39ADB8, 00B0 (r1  INTEL NUC5i3MY        1 INTL        1)
(XEN) System RAM: 8109MB (8304488kB)
(XEN) No NUMA configuration found
(XEN) Faking a node at 0000000000000000-000000021f000000
(XEN) Domain heap initialised
(XEN) found SMP MP-table at 000fd7c0
(XEN) DMI 2.8 present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x1808
(XEN) ACPI: v5 SLEEP INFO: control[0:0], status[0:0]
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:1804,1:0], pm1x_evt[1:1800,1:0]
(XEN) ACPI: 32/64X FACS address mismatch in FADT - dccc9f80/0000000000000000, using 32
(XEN) ACPI:             wakeup_vec[dccc9f8c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
(XEN) Processor #0 7:13 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
(XEN) Processor #2 7:13 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x01] enabled)
(XEN) Processor #1 7:13 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x03] enabled)
(XEN) Processor #3 7:13 APIC version 21
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] dfl dfl lint[0])
(XEN) ACPI: NMI not connected to LINT 1!
(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] dfl dfl lint[0])
(XEN) ACPI: NMI not connected to LINT 1!
(XEN) ACPI: LAPIC_NMI (acpi_id[0x03] dfl dfl lint[0])
(XEN) ACPI: NMI not connected to LINT 1!
(XEN) ACPI: LAPIC_NMI (acpi_id[0x04] dfl dfl lint[0])
(XEN) ACPI: NMI not connected to LINT 1!
(XEN) ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-39
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
(XEN) ACPI: HPET id: 0x8086a701 base: 0xfed00000
(XEN) [VT-D]dmar.c:788: Host address width 39
(XEN) [VT-D]dmar.c:802: found ACPI_DMAR_DRHD:
(XEN) [VT-D]dmar.c:472:   dmaru->address = fed90000
(XEN) [VT-D]iommu.c:1136: drhd->address = fed90000 iommu->reg = ffff82c000201000
(XEN) [VT-D]iommu.c:1138: cap = 1c0000c40660462 ecap = 7e1ff0505e
(XEN) [VT-D]dmar.c:383:  endpoint: 0000:00:02.0
(XEN) [VT-D]dmar.c:802: found ACPI_DMAR_DRHD:
(XEN) [VT-D]dmar.c:472:   dmaru->address = fed91000
(XEN) [VT-D]iommu.c:1136: drhd->address = fed91000 iommu->reg = ffff82c000203000
(XEN) [VT-D]iommu.c:1138: cap = d2008c20660462 ecap = f010da
(XEN) [VT-D]dmar.c:397:  IOAPIC: 0000:f0:1f.0
(XEN) [VT-D]dmar.c:361:  MSI HPET: 0000:f0:0f.0
(XEN) [VT-D]dmar.c:486:   flags: INCLUDE_ALL
(XEN) [VT-D]dmar.c:807: found ACPI_DMAR_RMRR:
(XEN) [VT-D]dmar.c:383:  endpoint: 0000:00:1d.0
(XEN) [VT-D]dmar.c:383:  endpoint: 0000:00:14.0
(XEN) [VT-D]dmar.c:676:   RMRR region: base_addr dcefc000 end_address dcf0afff
(XEN) [VT-D]dmar.c:807: found ACPI_DMAR_RMRR:
(XEN) [VT-D]dmar.c:383:  endpoint: 0000:00:02.0
(XEN) [VT-D]dmar.c:676:   RMRR region: base_addr dd800000 end_address dfffffff
(XEN) ERST table was not found
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 4 CPUs (0 hotplug CPUs)
(XEN) IRQ limits: 40 GSI, 744 MSI/MSI-X
(XEN) Not enabling x2APIC: depends on iommu_supports_eim.
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2095.196 MHz processor.
(XEN) Initing memory sharing.
(XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
(XEN) mce_intel.c:735: MCA Capability: BCAST 1 SER 1 CMCI 1 firstbank 0 extended MCE MSR 0
(XEN) Intel machine check reporting enabled
(XEN) alt table ffff82d0802dc330 -> ffff82d0802dd518
(XEN) spurious 8259A interrupt: IRQ7.
(XEN) PCI: MCFG configuration 0: base f8000000 segment 0000 buses 00 - 3f
(XEN) PCI: MCFG area at f8000000 reserved in E820
(XEN) PCI: Using MCFG for segment 0000 bus 00-3f
(XEN) Intel VT-d iommu 0 supported page sizes: 4kB, 2MB, 1GB.
(XEN) Intel VT-d iommu 1 supported page sizes: 4kB, 2MB, 1GB.
(XEN) Intel VT-d Snoop Control not enabled.
(XEN) Intel VT-d Dom0 DMA Passthrough not enabled.
(XEN) Intel VT-d Queued Invalidation enabled.
(XEN) Intel VT-d Interrupt Remapping not enabled.
(XEN) Intel VT-d Shared EPT tables enabled.
(XEN) I/O virtualisation enabled
(XEN)  - Dom0 mode: Relaxed
(XEN) Interrupt remapping disabled
(XEN) Enabled directed EOI with ioapic_ack_old on!
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using old ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=0 pin2=0
(XEN) TSC deadline timer enabled
(XEN) Platform timer is 14.318MHz HPET
(XEN) Allocated console ring of 32 KiB.
(XEN) mwait-idle: MWAIT substates: 0x11142120
(XEN) mwait-idle: v0.4 model 0x3d
(XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff
(XEN) mwait-idle: max C-state count of 8 reached
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Extended Page Tables (EPT)
(XEN)  - Virtual-Processor Identifiers (VPID)
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN)  - Unrestricted Guest
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) detected
(XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB
(XEN) mwait-idle: max C-state count of 8 reached
(XEN) mwait-idle: max C-state count of 8 reached
(XEN) mwait-idle: max C-state count of 8 reached
(XEN) Brought up 4 CPUs
(XEN) ACPI sleep modes: S3
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) Dom0 has maximum 616 PIRQs
(XEN) *** LOADING DOMAIN 0 ***
(XEN) elf_parse_binary: phdr: paddr=0xffffffff80200000 memsz=0x1027270
(XEN) elf_parse_binary: phdr: paddr=0xffffffff81427270 memsz=0x527a20
(XEN) elf_parse_binary: memory: 0xffffffff80200000 -> 0xffffffff8194ec90
(XEN) elf_xen_parse_note: GUEST_OS = "FreeBSD"
(XEN) elf_xen_parse_note: GUEST_VERSION = "0x10c91d"
(XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
(XEN) elf_xen_parse_note: VIRT_BASE = 0xffffffff80000000
(XEN) elf_xen_parse_note: PADDR_OFFSET = 0xffffffff80000000
(XEN) elf_xen_parse_note: ENTRY = 0xffffffff80d54000
(XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xffffffff80d53000
(XEN) elf_xen_parse_note: HV_START_LOW = 0xffff800000000000
(XEN) elf_xen_parse_note: FEATURES = "writable_descriptor_tables|auto_translated_physmap|supervisor_mode_kernel|hvm_callback_vector"
(XEN) elf_xen_parse_note: PAE_MODE = "yes"
(XEN) elf_xen_parse_note: unknown xen elf note (0xd)
(XEN) elf_xen_parse_note: LOADER = "generic"
(XEN) elf_xen_parse_note: SUSPEND_CANCEL = 0x0
(XEN) elf_xen_parse_note: BSD_SYMTAB = "yes"
(XEN) elf_xen_parse: using notes from SHT_NOTE section
(XEN) elf_xen_addr_calc_check: addresses:
(XEN)     virt_base        = 0xffffffff80000000
(XEN)     elf_paddr_offset = 0xffffffff80000000
(XEN)     virt_offset      = 0x0
(XEN)     virt_kstart      = 0xffffffff80200000
(XEN)     virt_kend        = 0xffffffff81c4fcf8
(XEN)     virt_entry       = 0xffffffff80d54000
(XEN)     p2m_base         = 0xffffffffffffffff
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0xffffffff80200000 -> 0xffffffff8194ec90
(XEN)  Dom0 symbol map 0xffffffff8194ec90 -> 0xffffffff81c4fcf8
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000210000000->0000000214000000 (506994 pages to be allocated)
(XEN)  Init. ramdisk: 000000021ec72000->000000021f000000
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff80200000->ffffffff81c4fcf8
(XEN)  Init. ramdisk: ffffffff81c50000->ffffffff81fde000
(XEN)  Phys-Mach map: ffffffff81fde000->ffffffff823de000
(XEN)  Start info:    ffffffff823de000->ffffffff823df4b4
(XEN)  Page tables:   ffffffff823e0000->ffffffff823f7000
(XEN)  Boot stack:    ffffffff823f7000->ffffffff823f8000
(XEN)  TOTAL:         ffffffff80000000->ffffffff82800000
(XEN)  ENTRY ADDRESS: ffffffff80d54000
(XEN) Dom0 has maximum 4 VCPUs
(XEN) elf_load_binary: phdr 2 at 0xffffffff80200000 -> 0xffffffff81227270
(XEN) elf_load_binary: phdr 3 at 0xffffffff81427270 -> 0xffffffff81553da0
(XEN) elf_load_bsdsyms: shdr 4 at 0xffff83021d83fa30 -> 0xffffffff8194f818
(XEN) elf_load_bsdsyms: shdr 42 at 0xffff83021e9c6d44 -> 0xffffffff819a5840
(XEN) elf_load_bsdsyms: shdr 43 at 0xffff83021e9c7ad0 -> 0xffffffff819a5a90
(XEN) elf_load_bsdsyms: shdr 44 at 0xffff83021eb0ed40 -> 0xffffffff81aecd00
(XEN) [VT-D]iommu.c:1420: d0:Hostbridge: skip 0000:00:00.0 map
(XEN) Bogus DMIBAR 0xfed18001 on 0000:00:00.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:02.0
(XEN) [VT-D]iommu.c:1434: d0:PCIe: map 0000:00:03.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:14.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:16.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:19.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:1b.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:1d.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:1f.0
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:1f.2
(XEN) [VT-D]iommu.c:1446: d0:PCI: map 0000:00:1f.3
(XEN) [VT-D]iommu.c:729: iommu_enable_translation: iommu->reg = ffff82c000201000
(XEN) [VT-D]iommu.c:729: iommu_enable_translation: iommu->reg = ffff82c000203000
(XEN) Scrubbing Free RAM on 1 nodes using 2 CPUs
(XEN) [VT-D]iommu.c:861: iommu_fault_status: Primary Pending Fault
(XEN) [VT-D]iommu.c:839: DMAR:[DMA Read] Request device [0000:00:1d.0] fault addr dcd97000, iommu reg = ffff82c000203000
(XEN) DMAR:[fault reason 06h] PTE Read access is not set
(XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1d.0 gmfn dcd97
(XEN)     root_entry = ffff8302197c0000
(XEN)     root_entry[0] = 197d44001
(XEN)     context = ffff830197d44000
(XEN)     context[e8] = 2_197d48001
(XEN)     l4 = ffff830197d48000
(XEN)     l4_index = 0
(XEN)     l4[0] = 197d47003
(XEN)     l3 = ffff830197d47000
(XEN)     l3_index = 3
(XEN)     l3[3] = 0
(XEN)     l3[3] not present
(XEN) ..................................done.
(XEN) Initial low memory virq threshold set at 0x4000 pages.
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 280kB init memory.
FreeBSD PVH running on xen-3.0-x86_64p
GDB: no debug ports present
KDB: debugger backends: ddb
KDB: current backend: ddb
SMAP type=01 base=0000000000000000 len=000000000009d800
SMAP type=02 base=000000000009d800 len=0000000000002800
SMAP type=02 base=00000000000e0000 len=0000000000020000
SMAP type=01 base=0000000000100000 len=000000007ff62000
SMAP type=02 base=00000000d76d8000 len=00000000004dd000
SMAP type=02 base=00000000dc319000 len=000000000005f000
SMAP type=03 base=00000000dc378000 len=0000000000023000
SMAP type=04 base=00000000dc39b000 len=0000000000930000
SMAP type=02 base=00000000dcccb000 len=0000000000334000
SMAP type=02 base=00000000dd800000 len=0000000002800000
SMAP type=02 base=00000000f8000000 len=0000000004000000
SMAP type=02 base=00000000fec00000 len=0000000000001000
SMAP type=02 base=00000000fed00000 len=0000000000004000
SMAP type=02 base=00000000fed1c000 len=0000000000004000
SMAP type=02 base=00000000fee00000 len=0000000000001000
SMAP type=02 base=00000000ff000000 len=0000000001000000
Table 'FACP' at 0xdc392c10
Table 'APIC' at 0xdc392d20
APIC: Found table at 0xdc392d20
APIC: Using the Xen PV enumerator.
SMP: Added CPU 0 (BSP)
SMP: Added CPU 2 (AP)
SMP: Added CPU 4 (AP)
SMP: Added CPU 6 (AP)
Copyright (c) 1992-2015 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 11.0-CURRENT #1: Thu Feb 26 01:23:31 UTC 2015
    root@:/usr/obj/root/freebsd/sys/GENERIC amd64
FreeBSD clang version 3.5.1 (tags/RELEASE_351/final 225668) 20150115
WARNING: WITNESS option enabled, expect reduced performance.
(XEN) irq.c:386: Dom0 callback via changed to Direct Vector 0x93
Preloaded elf multiboot kernel "/boot/xen" at 0xffffffff81c50000.
Preloaded elf kernel "/boot/kernel/kernel" at 0xffffffff81c50180.
Preloaded elf obj module "/boot/kernel/zfs.ko" at 0xffffffff81c50258.
Preloaded elf obj module "/boot/kernel/opensolaris.ko" at 0xffffffff81c50a80.
Calibrating TSC clock ... TSC clock: 2095150272 Hz
CPU: Intel(R) Core(TM) i3-5010U CPU @ 2.10GHz (2095.15-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x306d4  Family=0x6  Model=0x3d  Stepping=4
  Features=0x1fc3ebff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,PGE,MCA,CMOV,PAT,PSE36,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT>
  Features2=0xfff83a83<SSE3,PCLMULQDQ,EST,SSSE3,SDBG,FMA,CX16,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND,HV>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  AMD Features2=0x121<LAHF,ABM,Prefetch>
  Structured Extended Features=0xc0328<BMI1,AVX2,BMI2,ERMS,RDSEED,ADX>
  XSAVE Features=0x1<XSAVEOPT>
  TSC: P-state invariant, performance statistics
Data TLB: 4 KB pages, 4-way set associative, 64 entries
L2 cache: 256 kbytes, 8-way associative, 64 bytes/line
Hypervisor: Origin = "XenVMMXenVMM"
real memory  = 2147885056 (2048 MB)
Physical memory chunk(s):
0x0000000000001000 - 0x000000000009cfff, 638976 bytes (156 pages)
0x0000000000100000 - 0x00000000001fffff, 1048576 bytes (256 pages)
0x0000000002428000 - 0x000000007cbd5fff, 2054873088 bytes (501678 pages)
avail memory = 2031898624 (1937 MB)
INTR: Adding local APIC 2 as a target
INTR: Adding local APIC 4 as a target
INTR: Adding local APIC 6 as a target
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  2
 cpu2 (AP): APIC ID:  4
 cpu3 (AP): APIC ID:  6
x86bios:  IVT 0x000000-0x0004ff at 0xfffff80000000000
x86bios: SSEG 0x001000-0x001fff at 0xfffffe00929f8000
x86bios:  ROM 0x0a0000-0x0fefff at 0xfffff800000a0000
ULE: setup cpu 0
ULE: setup cpu 1
ULE: setup cpu 2
ULE: setup cpu 3
Xen interrupt system initialized
Table 'FACP' at 0xdc392c10
Table 'APIC' at 0xdc392d20
APIC: Found table at 0xdc392d20
ACPI: RSDP 0x00000000000F0580 000024 (v02 INTEL )
ACPI: XSDT 0x00000000DC37F090 0000A4 (v01 INTEL  NUC5i3MY 01072009 AMI  00010013)
ACPI: FACP 0x00000000DC392C10 00010C (v05 INTEL  NUC5i3MY 01072009 AMI  00010013)
ACPI: DSDT 0x00000000DC37F1C8 013A48 (v02 INTEL  NUC5i3MY 01072009 INTL 20120913)
ACPI: FACS 0x00000000DCCC9F80 000040
ACPI: APIC 0x00000000DC392D20 000084 (v03 INTEL  NUC5i3MY 01072009 AMI  00010013)
ACPI: FPDT 0x00000000DC392DA8 000044 (v01 INTEL  NUC5i3MY 01072009 AMI  00010013)
ACPI: FIDT 0x00000000DC392DF0 00009C (v01 INTEL  NUC5i3MY 01072009 AMI  00010013)
ACPI: MCFG 0x00000000DC392E90 00003C (v01 INTEL  NUC5i3MY 01072009 MSFT 00000097)
ACPI: HPET 0x00000000DC392ED0 000038 (v01 INTEL  NUC5i3MY 01072009 AMI. 00000005)
ACPI: SSDT 0x00000000DC392F08 000315 (v01 INTEL  NUC5i3MY 00001000 INTL 20120913)
ACPI: UEFI 0x00000000DC393220 000042 (v01 INTEL  NUC5i3MY 00000000      00000000)
ACPI: SSDT 0x00000000DC393268 000C7D (v02 INTEL  NUC5i3MY 00001000 INTL 20120913)
ACPI: ASF! 0x00000000DC393EE8 0000A0 (v32 INTEL  NUC5i3MY 00000001 TFSM 000F4240)
ACPI: SSDT 0x00000000DC393F88 000539 (v02 INTEL  NUC5i3MY 00003000 INTL 20120913)
ACPI: SSDT 0x00000000DC3944C8 000B74 (v02 INTEL  NUC5i3MY 00003000 INTL 20120913)
ACPI: TPM2 0x00000000DC395040 000034 (v03 INTEL  NUC5i3MY 00000001 AMI  00000000)
ACPI: SSDT 0x00000000DC395078 000041 (v01 INTEL  NUC5i3MY 00001000 INTL 20120913)
ACPI: SSDT 0x00000000DC3950C0 005CF6 (v02 INTEL  NUC5i3MY 00003000 INTL 20120913)
ACPI: XMAR 0x00000000DC39ADB8 0000B0 (v01 INTEL  NUC5i3MY 00000001 INTL 00000001)
MADT: Interrupt override: source 0, irq 2
xen: register IRQ#2
MADT: Interrupt override: source 9, irq 9
xen: register IRQ#9
xen: register IRQ#1
xen: register IRQ#3
xen: register IRQ#4
xen: register IRQ#5
xen: register IRQ#6
xen: register IRQ#7
xen: register IRQ#8
xen: register IRQ#10
xen: register IRQ#11
xen: register IRQ#12
xen: register IRQ#13
xen: register IRQ#14
xen: register IRQ#15
cpu0 BSP XEN PV LAPIC
snd_unit_init() u=0x00ff8000 [512] d=0x00007c00 [32] c=0x000003ff [1024]
feeder_register: snd_unit=-1 snd_maxautovchans=16 latency=5 feeder_rate_min=1 feeder_rate_max=2016000 feeder_rate_round=25
wlan: <802.11 Link Layer>
random: entropy device infrastructure driver
random: selecting highest priority adaptor <Dummy>
kbd: new array size 4
kbd1 at kbdmux0
mem: <memory>
nfslock: pseudo-device
netmap: loaded module
null: <full device, null device, zero device>
random: SOFT: yarrow init()
random: selecting highest priority adaptor <Yarrow>
module_register_init: MOD_LOAD (vesa, 0xffffffff80dde720, 0) error 19
io: <I/O>
VMBUS: load
random: live provider: "Intel Secure Key RNG"
hptnr: R750/DC7280 controller driver v1.0.1
hpt27xx: RocketRAID 27xx controller driver v1.1
hptrr: RocketRAID 17xx/2xxx SATA controller driver v1.2
xenpv0: <Xen PV bus> on motherboard
granttable0: <Xen Grant-table Device> on xenpv0
Grant table initialized
xc0: <Xen Console> on xenpv0
xen_et0: <Xen PV Clock> on xenpv0
Event timer "XENTIMER" frequency 1000000000 Hz quality 950
Timecounter "XENTIMER" frequency 1000000000 Hz quality 950
xen_et0: registered as a time-of-day clock (resolution 10000000us, adjustment 5.000000000s)
pvcpu0: <Xen PV CPU> on xenpv0
pvcpu1: <Xen PV CPU> on xenpv0
pvcpu2: <Xen PV CPU> on xenpv0
pvcpu3: <Xen PV CPU> on xenpv0
xenstore0: <XenStore> on xenpv0
xsd_dev0: <Xenstored user-space device> on xenpv0
evtchn0: <Xen event channel user-space device> on xenpv0
privcmd0: <Xen privileged interface user-space device> on xenpv0
isa0: <ISA bus> on xenpv0
acpi0: <INTEL> on motherboard
ACPI: All ACPI Tables successfully acquired
PCIe: Memory Mapped configuration base @ 0xf8000000
ACPI: Executed 18 blocks of module-level executable AML code
acpi0: Power Button (fixed)
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: Warning: Couldn't map I/O.
atrtc0: not installed as time-of-day clock: clock xen_et has higher resolution
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
attimer0: Can't map interrupt.
pci_link0:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0   11   N     0  3 4 5 6 10 11 12 14 15
  Validation          0   11   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pci_link1:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0  255   N     0  3 4 5 6 10 11 12 14 15
  Validation          0  255   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pci_link2:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0   10   N     0  3 4 5 6 10 11 12 14 15
  Validation          0   10   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pci_link3:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0   10   N     0  3 4 5 6 10 11 12 14 15
  Validation          0   10   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pci_link4:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0    5   N     0  3 4 5 6 10 11 12 14 15
  Validation          0    5   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pci_link5:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0  255   N     0  3 4 5 6 10 11 12 14 15
  Validation          0  255   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pci_link6:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0    3   N     0  3 4 5 6 10 11 12 14 15
  Validation          0    3   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pci_link7:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0   11   N     0  3 4 5 6 10 11 12 14 15
  Validation          0   11   N     0  3 4 5 6 10 11 12 14 15
  After Disable       0  255   N     0  3 4 5 6 10 11 12 14 15
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pcib0: decoding 5 range 0-0x3e
pcib0: decoding 4 range 0-0xcf7
pcib0: decoding 4 range 0xd00-0xffff
pcib0: decoding 3 range 0xa0000-0xbffff
pcib0: decoding 3 range 0xe0000000-0xfeafffff
pci0: <Xen ACPI PCI bus> on pcib0
pci0: domain=0, physical bus=0
found-> vendor=0x8086, dev=0x1604, revid=0x09
        domain=0, bus=0, slot=0, func=0
        class=06-00-00, hdrtype=0x00, mfdev=0
        cmdreg=0x0006, statreg=0x2090, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
(XEN) Bogus DMIBAR 0xfed18001 on 0000:00:00.0
(XEN) PCI add device 0000:00:00.0
found-> vendor=0x8086, dev=0x1616, revid=0x09
        domain=0, bus=0, slot=2, func=0
        class=03-00-00, hdrtype=0x00, mfdev=0
        cmdreg=0x0007, statreg=0x0090, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=a, irq=11
        powerspec 2  supports D0 D3  current D0
        MSI supports 1 message
        map[10]: type Memory, range 64, base 0xf6000000, size 24, enabled
pcib0: allocated type 3 (0xf6000000-0xf6ffffff) for rid 10 of pci0:0:2:0
        map[18]: type Prefetchable Memory, range 64, base 0xe8000000, size 27, enabled
pcib0: allocated type 3 (0xe8000000-0xefffffff) for rid 18 of pci0:0:2:0
        map[20]: type I/O Port, range 32, base 0xf000, size  6, enabled
pcib0: allocated type 4 (0xf000-0xf03f) for rid 20 of pci0:0:2:0
pcib0: matched entry for 0.2.INTA
pcib0: slot 2 INTA hardwired to IRQ 16
xen: register IRQ#16
(XEN) PCI add device 0000:00:02.0
found-> vendor=0x8086, dev=0x160c, revid=0x09
        domain=0, bus=0, slot=3, func=0
        class=04-03-00, hdrtype=0x00, mfdev=0
        cmdreg=0x0006, statreg=0x0010, cachelnsz=16 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=a, irq=11
        powerspec 2  supports D0 D3  current D0
        MSI supports 1 message
        map[10]: type Memory, range 64, base 0xf7034000, size 14, enabled
pcib0: allocated type 3 (0xf7034000-0xf7037fff) for rid 10 of pci0:0:3:0
pcib0: matched entry for 0.3.INTA
pcib0: slot 3 INTA hardwired to IRQ 16
(XEN) PCI add device 0000:00:03.0
found-> vendor=0x8086, dev=0x9cb1, revid=0x03
        domain=0, bus=0, slot=20, func=0
        class=0c-03-30, hdrtype=0x00, mfdev=0
        cmdreg=0x0006, statreg=0x0290, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=a, irq=11
        powerspec 2  supports D0 D3  current D0
        MSI supports 8 messages, 64 bit
        map[10]: type Memory, range 64, base 0xf7020000, size 16, enabled
pcib0: allocated type 3 (0xf7020000-0xf702ffff) for rid 10 of pci0:0:20:0
pcib0: matched entry for 0.20.INTA
pcib0: slot 20 INTA hardwired to IRQ 21
xen: register IRQ#21
(XEN) PCI add device 0000:00:14.0
found-> vendor=0x8086, dev=0x9cba, revid=0x03
        domain=0, bus=0, slot=22, func=0
        class=07-80-00, hdrtype=0x00, mfdev=1
        cmdreg=0x0006, statreg=0x0010, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=a, irq=11
        powerspec 3  supports D0 D3  current D0
        MSI supports 1 message, 64 bit
        map[10]: type Memory, range 64, base 0xf703d000, size  5, enabled
pcib0: allocated type 3 (0xf703d000-0xf703d01f) for rid 10 of pci0:0:22:0
pcib0: matched entry for 0.22.INTA
pcib0: slot 22 INTA hardwired to IRQ 16
(XEN) PCI add device 0000:00:16.0
found-> vendor=0x8086, dev=0x15a3, revid=0x03
        domain=0, bus=0, slot=25, func=0
        class=02-00-00, hdrtype=0x00, mfdev=0
        cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=a, irq=5
        powerspec 2  supports D0 D3  current D0
        MSI supports 1 message, 64 bit
        map[10]: type Memory, range 32, base 0xf7000000, size 17, enabled
pcib0: allocated type 3 (0xf7000000-0xf701ffff) for rid 10 of pci0:0:25:0
        map[14]: type Memory, range 32, base 0xf703b000, size 12, enabled
pcib0: allocated type 3 (0xf703b000-0xf703bfff) for rid 14 of pci0:0:25:0
        map[18]: type I/O Port, range 32, base 0xf080, size  5, enabled
pcib0: allocated type 4 (0xf080-0xf09f) for rid 18 of pci0:0:25:0
pcib0: matched entry for 0.25.INTA
pcib0: slot 25 INTA hardwired to IRQ 20
xen: register IRQ#20
(XEN) PCI add device 0000:00:19.0
found-> vendor=0x8086, dev=0x9ca0, revid=0x03
        domain=0, bus=0, slot=27, func=0
        class=04-03-00, hdrtype=0x00, mfdev=0
        cmdreg=0x0006, statreg=0x0010, cachelnsz=16 (dwords)
        lattimer=0x20 (960 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=a, irq=3
        powerspec 3  supports D0 D3  current D0
        MSI supports 1 message, 64 bit
        map[10]: type Memory, range 64, base 0xf7030000, size 14, enabled
pcib0: allocated type 3 (0xf7030000-0xf7033fff) for rid 10 of pci0:0:27:0
pcib0: matched entry for 0.27.INTA
pcib0: slot 27 INTA hardwired to IRQ 22
xen: register IRQ#22
(XEN) PCI add device 0000:00:1b.0
found-> vendor=0x8086, dev=0x9ca6, revid=0x03
        domain=0, bus=0, slot=29, func=0
        class=0c-03-20, hdrtype=0x00, mfdev=0
        cmdreg=0x0006, statreg=0x2290, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=a, irq=11
        powerspec 3  supports D0 D3  current D0
        map[10]: type Memory, range 32, base 0xf703a000, size 10, enabled
pcib0: allocated type 3 (0xf703a000-0xf703a3ff) for rid 10 of pci0:0:29:0
pcib0: matched entry for 0.29.INTA
pcib0: slot 29 INTA hardwired to IRQ 23
xen: register IRQ#23
ehci early: SMM active, request owner change
(XEN) PCI add device 0000:00:1d.0
found-> vendor=0x8086, dev=0x9cc3, revid=0x03
        domain=0, bus=0, slot=31, func=0
        class=06-01-00, hdrtype=0x00, mfdev=1
        cmdreg=0x0007, statreg=0x0210, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
(XEN) PCI add device 0000:00:1f.0
found-> vendor=0x8086, dev=0x9c83, revid=0x03
        domain=0, bus=0, slot=31, func=2
        class=01-06-01, hdrtype=0x00, mfdev=0
        cmdreg=0x0007, statreg=0x02b0, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=b, irq=10
        powerspec 3  supports D0 D3  current D0
        MSI supports 1 message
        map[10]: type I/O Port, range 32, base 0xf0d0, size  3, enabled
pcib0: allocated type 4 (0xf0d0-0xf0d7) for rid 10 of pci0:0:31:2
        map[14]: type I/O Port, range 32, base 0xf0c0, size  2, enabled
pcib0: allocated type 4 (0xf0c0-0xf0c3) for rid 14 of pci0:0:31:2
        map[18]: type I/O Port, range 32, base 0xf0b0, size  3, enabled
pcib0: allocated type 4 (0xf0b0-0xf0b7) for rid 18 of pci0:0:31:2
        map[1c]: type I/O Port, range 32, base 0xf0a0, size  2, enabled
pcib0: allocated type 4 (0xf0a0-0xf0a3) for rid 1c of pci0:0:31:2
        map[20]: type I/O Port, range 32, base 0xf060, size  5, enabled
pcib0: allocated type 4 (0xf060-0xf07f) for rid 20 of pci0:0:31:2
        map[24]: type Memory, range 32, base 0xf7039000, size 11, enabled
pcib0: allocated type 3 (0xf7039000-0xf70397ff) for rid 24 of pci0:0:31:2
pcib0: matched entry for 0.31.INTB
pcib0: slot 31 INTB hardwired to IRQ 19
xen: register IRQ#19
(XEN) PCI add device 0000:00:1f.2
found-> vendor=0x8086, dev=0x9ca2, revid=0x03
        domain=0, bus=0, slot=31, func=3
        class=0c-05-00, hdrtype=0x00, mfdev=0
        cmdreg=0x0003, statreg=0x0280, cachelnsz=0 (dwords)
        lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
        intpin=c, irq=10
        map[10]: type Memory, range 64, base 0xf7038000, size  8, enabled
pcib0: allocated type 3 (0xf7038000-0xf70380ff) for rid 10 of pci0:0:31:3
        map[20]: type I/O Port, range 32, base 0xf040, size  5, enabled
pcib0: allocated type 4 (0xf040-0xf05f) for rid 20 of pci0:0:31:3
pcib0: matched entry for 0.31.INTC
pcib0: slot 31 INTC hardwired to IRQ 18
xen: register IRQ#18
(XEN) PCI add device 0000:00:1f.3
vgapci0: <VGA-compatible display> port 0xf000-0xf03f mem 0xf6000000-0xf6ffffff,0xe8000000-0xefffffff irq 16 at device 2.0 on pci0
vgapci0: Boot video device
hdac0: <Intel (0x160c) HDA Controller> mem 0xf7034000-0xf7037fff irq 16 at device 3.0 on pci0
hdac0: PCI card vendor: 0x8086, device: 0x2058
hdac0: HDA Driver Revision: 20120126_0002
hdac0: Config options: on=0x00000000 off=0x00000000
hdac0: attempting to allocate 1 MSI vectors (1 supported)
hdac0: using IRQ 256 for MSI
hdac0: Caps: OSS 3, ISS 0, BSS 0, NSDO 1, 64bit, CORB 256, RIRB 256
xhci0: <XHCI (generic) USB 3.0 controller> mem 0xf7020000-0xf702ffff irq 21 at device 20.0 on pci0
xhci0: 32 bytes context size, 64-bit DMA
xhci0: attempting to allocate 1 MSI vectors (8 supported)
xhci0: using IRQ 257 for MSI
xhci0: MSI enabled
(XEN) [VT-D]iommu.c:861: iommu_fault_status: Primary Pending Fault
(XEN) [VT-D]iommu.c:839: DMAR:[DMA Read] Request device [0000:00:14.0] fault addr 7c5ff000, iommu reg = ffff82c000203000
(XEN) DMAR:[fault reason 06h] PTE Read access is not set
(XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:14.0 gmfn 7c5ff
(XEN)     root_entry = ffff8302197c0000
(XEN)     root_entry[0] = 197d44001
(XEN)     context = ffff830197d44000
(XEN)     context[a0] = 2_197d48001
(XEN)     l4 = ffff830197d48000
(XEN)     l4_index = 0
(XEN)     l4[0] = 197d47003
(XEN)     l3 = ffff830197d47000
(XEN)     l3_index = 1
(XEN)     l3[1] = 0
(XEN)     l3[1] not present
xhci0: Run timeout.
xhci0: XHCI halt/start/probe failed err=18
device_attach: xhci0 attach returned 6
pci0: <simple comms> at device 22.0 (no driver attached)
em0: <Intel(R) PRO/1000 Network Connection 7.4.2> port 0xf080-0xf09f mem 0xf7000000-0xf701ffff,0xf703b000-0xf703bfff irq 20 at device 25.0 on pci0
em0: attempting to allocate 1 MSI vectors (1 supported)
em0: using IRQ 258 for MSI
em0: Using an MSI interrupt
em0: bpf attached
em0: Ethernet address: b8:ae:ed:70:85:31
001.000050 [2717] netmap_attach             success for em0 tx 1/1024 rx 1/1024 queues/slots
hdac1: <Intel (0x9ca0) HDA Controller> mem 0xf7030000-0xf7033fff irq 22 at device 27.0 on pci0
hdac1: PCI card vendor: 0x8086, device: 0x2058
hdac1: HDA Driver Revision: 20120126_0002
hdac1: Config options: on=0x00000000 off=0x00000000
hdac1: attempting to allocate 1 MSI vectors (1 supported)
hdac1: using IRQ 259 for MSI
hdac1: Caps: OSS 4, ISS 4, BSS 0, NSDO 1, 64bit, CORB 256, RIRB 256
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xf703a000-0xf703a3ff irq 23 at device 29.0 on pci0
usbus0: EHCI version 1.0
(XEN) [VT-D]iommu.c:859: iommu_fault_status: Fault Overflow
(XEN) [VT-D]iommu.c:861: iommu_fault_status: Primary Pending Fault
(XEN) [VT-D]iommu.c:839: DMAR:[DMA Read] Request device [0000:00:1d.0] fault addr 3b91000, iommu reg = ffff82c000203000
(XEN) DMAR:[fault reason 06h] PTE Read access is not set
(XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1d.0 gmfn 3b91
(XEN)     root_entry = ffff8302197c0000
(XEN)     root_entry[0] = 197d44001
(XEN)     context = ffff830197d44000
(XEN)     context[e8] = 2_197d48001
(XEN)     l4 = ffff830197d48000
(XEN)     l4_index = 0
(XEN)     l4[0] = 197d47003
(XEN)     l3 = ffff830197d47000
(XEN)     l3_index = 0
(XEN)     l3[0] = 197d46003
(XEN)     l2 = ffff830197d46000
(XEN)     l2_index = 1d
(XEN)     l2[1d] = 0
(XEN)     l2[1d] not present
usbus0: run timeout
ehci0: USB init failed err=18
device_attach: ehci0 attach returned 6
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa: isa0 already exists; skipping it
device_attach: isab0 attach returned 6
ahci0: <AHCI SATA controller> port 0xf0d0-0xf0d7,0xf0c0-0xf0c3,0xf0b0-0xf0b7,0xf0a0-0xf0a3,0xf060-0xf07f mem 0xf7039000-0xf70397ff irq 19 at device 31.2 on pci0
ahci0: attempting to allocate 1 MSI vectors (1 supported)
ahci0: using IRQ 260 for MSI
ahci0: AHCI v1.30 with 2 6Gbps ports, Port Multiplier not supported
ahci0: Caps: 64bit NCQ ALP AL CLO 6Gbps PMD SSC PSC 32cmd 2ports
ahci0: Caps2: DESO SADM SDS APST
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich0: Caps:
ahcich1: not probed (disabled)
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
acpi_button0: <Sleep Button> on acpi0
acpi_button1: <Power Button> on acpi0
(XEN) [VT-D]iommu.c:861: iommu_fault_status: Primary Pending Fault
(XEN) [VT-D]iommu.c:839: DMAR:[DMA Write] Request device [0000:00:1f.2] fault addr 43e0000, iommu reg = ffff82c000203000
(XEN) DMAR:[fault reason 05h] PTE Write access is not set
(XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1f.2 gmfn 43e0
(XEN)     root_entry = ffff8302197c0000
(XEN)     root_entry[0] = 197d44001
(XEN)     context = ffff830197d44000
(XEN)     context[fa] = 2_197d48001
(XEN)     l4 = ffff830197d48000
(XEN)     l4_index = 0
(XEN)     l4[0] = 197d47003
(XEN)     l3 = ffff830197d47000
(XEN)     l3_index = 0
(XEN)     l3[0] = 197d46003
(XEN)     l2 = ffff830197d46000
(XEN)     l2_index = 21
(XEN)     l2[21] = 0
(XEN)     l2[21] not present
acpi_tz0: <Thermal Zone> on acpi0
acpi_tz1: <Thermal Zone> on acpi0
ACPI: Enabled 4 GPEs in block 00 to 7F
acpi0: wakeup code va 0xfffffe0096c0d000 pa 0x4000
ahc_isa_identify 0: ioport 0xc00 alloc failed
isa_probe_children: disabling PnP devices
atrtc: atrtc0 already exists; skipping it
attimer: attimer0 already exists; skipping it
sc: sc0 already exists; skipping it
isa_probe_children: probing non-PnP devices
orm0: <ISA Option ROM> at iomem 0xd0000-0xd0fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: CGA <16 virtual consoles, flags=0x300>
sc0: fb0, kbd1, terminal emulator: scteken (teken terminal)
vga0: <Generic ISA VGA> at port 0x3d0-0x3db iomem 0xb8000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
kbd0: atkbd0, generic (0), config:0x0, flags:0x3f0000
device_attach: atkbd0 attach returned 6
psm0: unable to allocate IRQ
fdc0: ic_type 90 part_id 80
fdc0: <Enhanced floppy controller> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
fdc0: ic_type 90 part_id 80
fdc0: cannot setup interrupt
device_attach: fdc0 attach returned 6
ppc0: cannot reserve I/O port range
ppc0 failed to probe at irq 7 on isa0
uart0 failed to probe at port 0x3f8 irq 4 on isa0
uart1 failed to probe at port 0x2f8-0x2ff irq 3 on isa0
wbwd0 failed to probe on isa0
isa_probe_children: probing PnP devices
Device configuration finished.
procfs registered
ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present;
            to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 10.000 msec
vlan: initialized, using hash tables with chaining
tcp_init: net.inet.tcp.tcbhashsize auto tuned to 16384
lo0: bpf attached
hptnr: no controller detected.
hpt27xx: no controller detected.
hptrr: no controller detected.
(XEN) [VT-D]iommu.c:861: iommu_fault_status: Primary Pending Fault
(XEN) [VT-D]iommu.c:839: DMAR:[DMA Read] Request device [0000:00:03.0] fault addr 7cb92000, iommu reg = ffff82c000203000
(XEN) DMAR:[fault reason 06h] PTE Read access is not set
(XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:03.0 gmfn 7cb92
(XEN)     root_entry = ffff8302197c0000
(XEN)     root_entry[0] = 197d44001
(XEN)     context = ffff830197d44000
(XEN)     context[18] = 2_197d48001
(XEN)     l4 = ffff830197d48000
(XEN)     l4_index = 0
(XEN)     l4[0] = 197d47003
(XEN)     l3 = ffff830197d47000
(XEN)     l3_index = 1
(XEN)     l3[1] = 0
(XEN)     l3[1] not present
hdac0: Command timeout on address 0
(XEN) [VT-D]iommu.c:861: iommu_fault_status: Primary Pending Fault
(XEN) [VT-D]iommu.c:839: DMAR:[DMA Read] Request device [0000:00:03.0] fault addr 7cb92000, iommu reg = ffff82c000203000
(XEN) DMAR:[fault reason 06h] PTE Read access is not set
(XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:03.0 gmfn 7cb92
(XEN)     root_entry = ffff8302197c0000
(XEN)     root_entry[0] = 197d44001
(XEN)     context = ffff830197d44000
(XEN)     context[18] = 2_197d48001
(XEN)     l4 = ffff830197d48000
(XEN)     l4_index = 0
(XEN)     l4[0] = 197d47003
(XEN)     l3 = ffff830197d47000
(XEN)     l3_index = 1
(XEN)     l3[1] = 0
(XEN)     l3[1] not present
hdac0: Command timeout on address 0
hdac0: CODEC is not responding!
(XEN) [VT-D]iommu.c:861: iommu_fault_status: Primary Pending Fault
(XEN) [VT-D]iommu.c:839: DMAR:[DMA Read] Request device [0000:00:1b.0] fault addr 7c5ff000, iommu reg = ffff82c000203000
(XEN) DMAR:[fault reason 06h] PTE Read access is not set
(XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1b.0 gmfn 7c5ff
(XEN)     root_entry = ffff8302197c0000
(XEN)     root_entry[0] = 197d44001
(XEN)     context = ffff830197d44000
(XEN)     context[d8] = 2_197d48001
(XEN)     l4 = ffff830197d48000
(XEN)     l4_index = 0
(XEN)     l4[0] = 197d47003
(XEN)     l3 = ffff830197d47000
(XEN)     l3_index = 1
(XEN)     l3[1] = 0
(XEN)     l3[1] not present
hdac1: Command timeout on address 0
hdac1: Command timeout on address 0
hdac1: CODEC is not responding!
ahcich0: AHCI reset...
ahcich0: SATA connect time=900us status=00000123
ahcich0: AHCI reset: device found
(XEN) [VT-D]iommu.c:861: iommu_fault_status: Primary Pending Fault
(XEN) [VT-D]iommu.c:839: DMAR:[DMA Write] Request device [0000:00:1f.2] fault addr 43e0000, iommu reg = ffff82c000203000
(XEN) DMAR:[fault reason 05h] PTE Write access is not set
(XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1f.2 gmfn 43e0
(XEN)     root_entry = ffff8302197c0000
(XEN)     root_entry[0] = 197d44001
(XEN)     context = ffff830197d44000
(XEN)     context[fa] = 2_197d48001
(XEN)     l4 = ffff830197d48000
(XEN)     l4_index = 0
(XEN)     l4[0] = 197d47003
(XEN)     l3 = ffff830197d47000
(XEN)     l3_index = 0
(XEN)     l3[0] = 197d46003
(XEN)     l2 = ffff830197d46000
(XEN)     l2_index = 21
(XEN)     l2[21] = 0
(XEN)     l2[21] not present
ahcich0: AHCI reset: device ready after 100ms
(XEN) [VT-D]iommu.c:861: iommu_fault_status: Primary Pending Fault
(XEN) [VT-D]iommu.c:839: DMAR:[DMA Read] Request device [0000:00:1f.2] fault addr 43eb000, iommu reg = ffff82c000203000
(XEN) DMAR:[fault reason 06h] PTE Read access is not set
(XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1f.2 gmfn 43eb
(XEN)     root_entry = ffff8302197c0000
(XEN)     root_entry[0] = 197d44001
(XEN)     context = ffff830197d44000
(XEN)     context[fa] = 2_197d48001
(XEN)     l4 = ffff830197d48000
(XEN)     l4_index = 0
(XEN)     l4[0] = 197d47003
(XEN)     l3 = ffff830197d47000
(XEN)     l3_index = 0
(XEN)     l3[0] = 197d46003
(XEN)     l2 = ffff830197d46000
(XEN)     l2_index = 21
(XEN)     l2[21] = 0
(XEN)     l2[21] not present
ahcich0: Poll timeout on slot 1 port 0
ahcich0: is 20000000 cs 00000002 ss 00000000 rs 00000002 tfd 1d0 serr 00000800 cmd 00004117
(aprobe0:ahcich0:0:0:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe0:ahcich0:0:0:0): CAM status: Command timeout
(aprobe0:ahcich0:0:0:0): Error 5, Retries exhausted
(XEN) [VT-D]iommu.c:861: iommu_fault_status: Primary Pending Fault
(XEN) [VT-D]iommu.c:839: DMAR:[DMA Read] Request device [0000:00:1f.2] fault addr 43eb000, iommu reg = ffff82c000203000
(XEN) DMAR:[fault reason 06h] PTE Read access is not set
(XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1f.2 gmfn 43eb
(XEN)     root_entry = ffff8302197c0000
(XEN)     root_entry[0] = 197d44001
(XEN)     context = ffff830197d44000
(XEN)     context[fa] = 2_197d48001
(XEN)     l4 = ffff830197d48000
(XEN)     l4_index = 0
(XEN)     l4[0] = 197d47003
(XEN)     l3 = ffff830197d47000
(XEN)     l3_index = 0
(XEN)     l3[0] = 197d46003
(XEN)     l2 = ffff830197d46000
(XEN)     l2_index = 21
(XEN)     l2[21] = 0
(XEN)     l2[21] not present
ahcich0: Poll timeout on slot 2 port 0
ahcich0: is 20000000 cs 00000004 ss 00000000 rs 00000004 tfd 1d0 serr 00000800 cmd 00004217
(aprobe0:ahcich0:0:0:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe0:ahcich0:0:0:0): CAM status: Command timeout
(aprobe0:ahcich0:0:0:0): Error 5, Retries exhausted
random: unblocking device.
Netvsc initializing... done!
SMP: AP CPU #2 Launched!
cpu2 AP XEN PV LAPIC
SMP: AP CPU #3 Launched!
cpu3 AP XEN PV LAPIC
SMP: AP CPU #1 Launched!
cpu1 AP XEN PV LAPIC
Timecounter "TSC" frequency 2095150272 Hz quality -100
WARNING: WITNESS option enabled, expect reduced performance.
Trying to mount root from zfs:tank/root []...
Solaris: NOTICE: Cannot find the pool label for 'tank'
Mounting from zfs:tank/root failed with error 5.

Loader variables:
  vfs.root.mountfrom=zfs:tank/root

Manual root filesystem specification:
  <fstype>:<device> [options]
      Mount <device> using filesystem <fstype>
      and with the specified (optional) option list.

    eg. ufs:/dev/da0s1a
        zfs:tank
        cd9660:/dev/acd0 ro
          (which is equivalent to: mount -t cd9660 -o ro /dev/acd0 /)

  ?               List valid disk boot devices
  .               Yield 1 second (for background tasks)
  <empty line>    Abort manual input

mountroot>

Roger.

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Shared page tables between ETP and IOMMU issue
  2015-02-26 15:45 Shared page tables between ETP and IOMMU issue Roger Pau Monné
@ 2015-02-26 15:57 ` Jan Beulich
  2015-02-26 16:29   ` Roger Pau Monné
  0 siblings, 1 reply; 10+ messages in thread
From: Jan Beulich @ 2015-02-26 15:57 UTC (permalink / raw)
  To: Roger Pau Monné; +Cc: yang.z.zhang, xen-devel, kevin.tian

>>> On 26.02.15 at 16:45, <roger.pau@citrix.com> wrote:
> While testing PVH Dom0 support on a newer Core i3-5010U I've found that 
> sharing the page tables between EPT and the IOMMUs don't work. Booting 
> with iommu=no-sharept solves the problem, but I'm unsure what causes 
> this issue.

Is FreeBSD fiddling with its own memory map in some way? It's rather
surprising to see not just an occasional fault, but many of them, and
with L2 or even L3 entries not present. I.e. if it's not the OS
requesting re-arrangements, I would suppose table setup itself is
screwed up in some way. In the end - knowing the valid GFN range
for the guest - you may want to monitor/log how tables get created
and whether (and if so by whom) later some of the entries get
zapped.

Jan

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Shared page tables between ETP and IOMMU issue
  2015-02-26 15:57 ` Jan Beulich
@ 2015-02-26 16:29   ` Roger Pau Monné
  2015-02-26 16:43     ` Jan Beulich
  0 siblings, 1 reply; 10+ messages in thread
From: Roger Pau Monné @ 2015-02-26 16:29 UTC (permalink / raw)
  To: Jan Beulich; +Cc: yang.z.zhang, xen-devel, kevin.tian

El 26/02/15 a les 16.57, Jan Beulich ha escrit:
>>>> On 26.02.15 at 16:45, <roger.pau@citrix.com> wrote:
>> While testing PVH Dom0 support on a newer Core i3-5010U I've found that 
>> sharing the page tables between EPT and the IOMMUs don't work. Booting 
>> with iommu=no-sharept solves the problem, but I'm unsure what causes 
>> this issue.
> 
> Is FreeBSD fiddling with its own memory map in some way? It's rather
> surprising to see not just an occasional fault, but many of them, and
> with L2 or even L3 entries not present.

No, FreeBSD doesn't touch the physical memory map at all. No ballooning
or anything like that.

> I.e. if it's not the OS
> requesting re-arrangements, I would suppose table setup itself is
> screwed up in some way. In the end - knowing the valid GFN range
> for the guest - you may want to monitor/log how tables get created
> and whether (and if so by whom) later some of the entries get
> zapped.

OK, I will try to take a look. All those faults come from physical
memory ranges that are supposed to be usable, and in fact the CPU seems
to be able to read/write from them without problems, or else the guest
would have crashed much more early. Regarding sharing the page tables
between EPT and the IOMMU, is there some bit that needs to be set in the
ept entry in order to mark a page as available by the IOMMU?

Roger.

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Shared page tables between ETP and IOMMU issue
  2015-02-26 16:29   ` Roger Pau Monné
@ 2015-02-26 16:43     ` Jan Beulich
  2015-02-26 18:02       ` Roger Pau Monné
  0 siblings, 1 reply; 10+ messages in thread
From: Jan Beulich @ 2015-02-26 16:43 UTC (permalink / raw)
  To: Roger Pau Monné; +Cc: yang.z.zhang, xen-devel, kevin.tian

>>> On 26.02.15 at 17:29, <roger.pau@citrix.com> wrote:
> OK, I will try to take a look. All those faults come from physical
> memory ranges that are supposed to be usable, and in fact the CPU seems
> to be able to read/write from them without problems, or else the guest
> would have crashed much more early. Regarding sharing the page tables
> between EPT and the IOMMU, is there some bit that needs to be set in the
> ept entry in order to mark a page as available by the IOMMU?

Bits 0 and 1 (read and write) are shared between VT-d and EPT
(as is bit 7 - see struct dma_pte and ept_entry_t).

Jan

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Shared page tables between ETP and IOMMU issue
  2015-02-26 16:43     ` Jan Beulich
@ 2015-02-26 18:02       ` Roger Pau Monné
  2015-02-26 19:28         ` Konrad Rzeszutek Wilk
                           ` (2 more replies)
  0 siblings, 3 replies; 10+ messages in thread
From: Roger Pau Monné @ 2015-02-26 18:02 UTC (permalink / raw)
  To: Jan Beulich; +Cc: yang.z.zhang, xen-devel, kevin.tian

El 26/02/15 a les 17.43, Jan Beulich ha escrit:
>>>> On 26.02.15 at 17:29, <roger.pau@citrix.com> wrote:
>> OK, I will try to take a look. All those faults come from physical
>> memory ranges that are supposed to be usable, and in fact the CPU seems
>> to be able to read/write from them without problems, or else the guest
>> would have crashed much more early. Regarding sharing the page tables
>> between EPT and the IOMMU, is there some bit that needs to be set in the
>> ept entry in order to mark a page as available by the IOMMU?
> 
> Bits 0 and 1 (read and write) are shared between VT-d and EPT
> (as is bit 7 - see struct dma_pte and ept_entry_t).

I've added some debug prints at the end of construct_dom0 to print the 
MFN of a RAM page (using get_gfn_query_unlocked) and the VTd entry 
(using print_vtd_entries):

(XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1f.2 gmfn 43e0
(XEN)     root_entry = ffff8302197c0000
(XEN)     root_entry[0] = 140144001
(XEN)     context = ffff830140144000
(XEN)     context[fa] = 2_140148001
(XEN)     l4 = ffff830140148000
(XEN)     l4_index = 0
(XEN)     l4[0] = 140147003
(XEN)     l3 = ffff830140147000
(XEN)     l3_index = 0
(XEN)     l3[0] = 140146003
(XEN)     l2 = ffff830140146000
(XEN)     l2_index = 21
(XEN)     l2[21] = 0
(XEN)     l2[21] not present
(XEN) GFN: 0x43e0 MFN: 0x1401e3 type: 0

This is before Dom0 has been started, so I think there's something 
wrong in the way we build the page tables, because AFAICT the VTd 
code is not able to resolve the GFN, but the EPT code is.

Roger.

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Shared page tables between ETP and IOMMU issue
  2015-02-26 18:02       ` Roger Pau Monné
@ 2015-02-26 19:28         ` Konrad Rzeszutek Wilk
  2015-02-26 19:34           ` Roger Pau Monné
  2015-02-26 19:31         ` Roger Pau Monné
  2015-02-27  8:16         ` Jan Beulich
  2 siblings, 1 reply; 10+ messages in thread
From: Konrad Rzeszutek Wilk @ 2015-02-26 19:28 UTC (permalink / raw)
  To: Roger Pau Monné
  Cc: yang.z.zhang, xen-devel, kevin.tian, ufimtseva, Jan Beulich

On Thu, Feb 26, 2015 at 07:02:22PM +0100, Roger Pau Monné wrote:
> El 26/02/15 a les 17.43, Jan Beulich ha escrit:
> >>>> On 26.02.15 at 17:29, <roger.pau@citrix.com> wrote:
> >> OK, I will try to take a look. All those faults come from physical
> >> memory ranges that are supposed to be usable, and in fact the CPU seems
> >> to be able to read/write from them without problems, or else the guest
> >> would have crashed much more early. Regarding sharing the page tables
> >> between EPT and the IOMMU, is there some bit that needs to be set in the
> >> ept entry in order to mark a page as available by the IOMMU?
> > 
> > Bits 0 and 1 (read and write) are shared between VT-d and EPT
> > (as is bit 7 - see struct dma_pte and ept_entry_t).
> 
> I've added some debug prints at the end of construct_dom0 to print the 
> MFN of a RAM page (using get_gfn_query_unlocked) and the VTd entry 
> (using print_vtd_entries):
> 
> (XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1f.2 gmfn 43e0
> (XEN)     root_entry = ffff8302197c0000
> (XEN)     root_entry[0] = 140144001
> (XEN)     context = ffff830140144000
> (XEN)     context[fa] = 2_140148001
> (XEN)     l4 = ffff830140148000
> (XEN)     l4_index = 0
> (XEN)     l4[0] = 140147003
> (XEN)     l3 = ffff830140147000
> (XEN)     l3_index = 0
> (XEN)     l3[0] = 140146003
> (XEN)     l2 = ffff830140146000
> (XEN)     l2_index = 21
> (XEN)     l2[21] = 0
> (XEN)     l2[21] not present
> (XEN) GFN: 0x43e0 MFN: 0x1401e3 type: 0
> 
> This is before Dom0 has been started, so I think there's something 
> wrong in the way we build the page tables, because AFAICT the VTd 
> code is not able to resolve the GFN, but the EPT code is.

This looks like what Elena was hitting (how we parsed E820_RSV or
MMIO ranges). Are those GPFNs  special? 
> 
> Roger.
> 
> 
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Shared page tables between ETP and IOMMU issue
  2015-02-26 18:02       ` Roger Pau Monné
  2015-02-26 19:28         ` Konrad Rzeszutek Wilk
@ 2015-02-26 19:31         ` Roger Pau Monné
  2015-02-26 22:17           ` Elena Ufimtseva
  2015-02-27  8:16         ` Jan Beulich
  2 siblings, 1 reply; 10+ messages in thread
From: Roger Pau Monné @ 2015-02-26 19:31 UTC (permalink / raw)
  To: Jan Beulich; +Cc: yang.z.zhang, xen-devel, kevin.tian

El 26/02/15 a les 19.02, Roger Pau Monné ha escrit:
> El 26/02/15 a les 17.43, Jan Beulich ha escrit:
>>>>> On 26.02.15 at 17:29, <roger.pau@citrix.com> wrote:
>>> OK, I will try to take a look. All those faults come from physical
>>> memory ranges that are supposed to be usable, and in fact the CPU seems
>>> to be able to read/write from them without problems, or else the guest
>>> would have crashed much more early. Regarding sharing the page tables
>>> between EPT and the IOMMU, is there some bit that needs to be set in the
>>> ept entry in order to mark a page as available by the IOMMU?
>>
>> Bits 0 and 1 (read and write) are shared between VT-d and EPT
>> (as is bit 7 - see struct dma_pte and ept_entry_t).
> 
> I've added some debug prints at the end of construct_dom0 to print the 
> MFN of a RAM page (using get_gfn_query_unlocked) and the VTd entry 
> (using print_vtd_entries):
> 
> (XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1f.2 gmfn 43e0
> (XEN)     root_entry = ffff8302197c0000
> (XEN)     root_entry[0] = 140144001
> (XEN)     context = ffff830140144000
> (XEN)     context[fa] = 2_140148001
> (XEN)     l4 = ffff830140148000
> (XEN)     l4_index = 0
> (XEN)     l4[0] = 140147003
> (XEN)     l3 = ffff830140147000
> (XEN)     l3_index = 0
> (XEN)     l3[0] = 140146003
> (XEN)     l2 = ffff830140146000
> (XEN)     l2_index = 21
> (XEN)     l2[21] = 0
> (XEN)     l2[21] not present
> (XEN) GFN: 0x43e0 MFN: 0x1401e3 type: 0
> 
> This is before Dom0 has been started, so I think there's something 
> wrong in the way we build the page tables, because AFAICT the VTd 
> code is not able to resolve the GFN, but the EPT code is.

BTW, if I set no-sharept the output is as expected:

(XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1f.2 gmfn 43e0
(XEN)     root_entry = ffff8302197c0000
(XEN)     root_entry[0] = 19793f001
(XEN)     context = ffff83019793f000
(XEN)     context[fa] = 2_140149001
(XEN)     l4 = ffff830140149000
(XEN)     l4_index = 0
(XEN)     l4[0] = 140148003
(XEN)     l3 = ffff830140148000
(XEN)     l3_index = 0
(XEN)     l3[0] = 140147003
(XEN)     l2 = ffff830140147000
(XEN)     l2_index = 21
(XEN)     l2[21] = 14012c003
(XEN)     l1 = ffff83014012c000
(XEN)     l1_index = 1e0
(XEN)     l1[1e0] = 1401e3003
(XEN) GFN: 0x43e0 MFN: 0x1401e3 type: 0

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Shared page tables between ETP and IOMMU issue
  2015-02-26 19:28         ` Konrad Rzeszutek Wilk
@ 2015-02-26 19:34           ` Roger Pau Monné
  0 siblings, 0 replies; 10+ messages in thread
From: Roger Pau Monné @ 2015-02-26 19:34 UTC (permalink / raw)
  To: Konrad Rzeszutek Wilk
  Cc: yang.z.zhang, xen-devel, kevin.tian, ufimtseva, Jan Beulich

El 26/02/15 a les 20.28, Konrad Rzeszutek Wilk ha escrit:
> On Thu, Feb 26, 2015 at 07:02:22PM +0100, Roger Pau Monné wrote:
>> El 26/02/15 a les 17.43, Jan Beulich ha escrit:
>>>>>> On 26.02.15 at 17:29, <roger.pau@citrix.com> wrote:
>>>> OK, I will try to take a look. All those faults come from physical
>>>> memory ranges that are supposed to be usable, and in fact the CPU seems
>>>> to be able to read/write from them without problems, or else the guest
>>>> would have crashed much more early. Regarding sharing the page tables
>>>> between EPT and the IOMMU, is there some bit that needs to be set in the
>>>> ept entry in order to mark a page as available by the IOMMU?
>>>
>>> Bits 0 and 1 (read and write) are shared between VT-d and EPT
>>> (as is bit 7 - see struct dma_pte and ept_entry_t).
>>
>> I've added some debug prints at the end of construct_dom0 to print the 
>> MFN of a RAM page (using get_gfn_query_unlocked) and the VTd entry 
>> (using print_vtd_entries):
>>
>> (XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1f.2 gmfn 43e0
>> (XEN)     root_entry = ffff8302197c0000
>> (XEN)     root_entry[0] = 140144001
>> (XEN)     context = ffff830140144000
>> (XEN)     context[fa] = 2_140148001
>> (XEN)     l4 = ffff830140148000
>> (XEN)     l4_index = 0
>> (XEN)     l4[0] = 140147003
>> (XEN)     l3 = ffff830140147000
>> (XEN)     l3_index = 0
>> (XEN)     l3[0] = 140146003
>> (XEN)     l2 = ffff830140146000
>> (XEN)     l2_index = 21
>> (XEN)     l2[21] = 0
>> (XEN)     l2[21] not present
>> (XEN) GFN: 0x43e0 MFN: 0x1401e3 type: 0
>>
>> This is before Dom0 has been started, so I think there's something 
>> wrong in the way we build the page tables, because AFAICT the VTd 
>> code is not able to resolve the GFN, but the EPT code is.
> 
> This looks like what Elena was hitting (how we parsed E820_RSV or
> MMIO ranges). Are those GPFNs  special? 

No, they are regular RAM (p2m_ram_rw). I think Elena's problem was due
to missing RMRR regions in the ACPI tables. On the other hand this is
the IOMMU failing to provide translations for RAM regions. It seems like
it's caused by sharing the page tables between EPT and the IOMMUs.

Roger.

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Shared page tables between ETP and IOMMU issue
  2015-02-26 19:31         ` Roger Pau Monné
@ 2015-02-26 22:17           ` Elena Ufimtseva
  0 siblings, 0 replies; 10+ messages in thread
From: Elena Ufimtseva @ 2015-02-26 22:17 UTC (permalink / raw)
  To: Roger Pau Monné; +Cc: Zhang, Yang Z, xen-devel, kevin.tian, Jan Beulich

On Thu, Feb 26, 2015 at 2:31 PM, Roger Pau Monné <roger.pau@citrix.com> wrote:
> El 26/02/15 a les 19.02, Roger Pau Monné ha escrit:
>> El 26/02/15 a les 17.43, Jan Beulich ha escrit:
>>>>>> On 26.02.15 at 17:29, <roger.pau@citrix.com> wrote:
>>>> OK, I will try to take a look. All those faults come from physical
>>>> memory ranges that are supposed to be usable, and in fact the CPU seems
>>>> to be able to read/write from them without problems, or else the guest
>>>> would have crashed much more early. Regarding sharing the page tables
>>>> between EPT and the IOMMU, is there some bit that needs to be set in the
>>>> ept entry in order to mark a page as available by the IOMMU?
>>>
>>> Bits 0 and 1 (read and write) are shared between VT-d and EPT
>>> (as is bit 7 - see struct dma_pte and ept_entry_t).
>>
>> I've added some debug prints at the end of construct_dom0 to print the
>> MFN of a RAM page (using get_gfn_query_unlocked) and the VTd entry
>> (using print_vtd_entries):
>>
>> (XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1f.2 gmfn 43e0
>> (XEN)     root_entry = ffff8302197c0000
>> (XEN)     root_entry[0] = 140144001
>> (XEN)     context = ffff830140144000
>> (XEN)     context[fa] = 2_140148001
>> (XEN)     l4 = ffff830140148000
>> (XEN)     l4_index = 0
>> (XEN)     l4[0] = 140147003
>> (XEN)     l3 = ffff830140147000
>> (XEN)     l3_index = 0
>> (XEN)     l3[0] = 140146003
>> (XEN)     l2 = ffff830140146000
>> (XEN)     l2_index = 21
>> (XEN)     l2[21] = 0
>> (XEN)     l2[21] not present
>> (XEN) GFN: 0x43e0 MFN: 0x1401e3 type: 0
>>
>> This is before Dom0 has been started, so I think there's something
>> wrong in the way we build the page tables, because AFAICT the VTd
>> code is not able to resolve the GFN, but the EPT code is.
>
> BTW, if I set no-sharept the output is as expected:
>
> (XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1f.2 gmfn 43e0
> (XEN)     root_entry = ffff8302197c0000
> (XEN)     root_entry[0] = 19793f001
> (XEN)     context = ffff83019793f000
> (XEN)     context[fa] = 2_140149001
> (XEN)     l4 = ffff830140149000
> (XEN)     l4_index = 0
> (XEN)     l4[0] = 140148003
> (XEN)     l3 = ffff830140148000
> (XEN)     l3_index = 0
> (XEN)     l3[0] = 140147003
> (XEN)     l2 = ffff830140147000
> (XEN)     l2_index = 21
> (XEN)     l2[21] = 14012c003
> (XEN)     l1 = ffff83014012c000
> (XEN)     l1_index = 1e0
> (XEN)     l1[1e0] = 1401e3003
> (XEN) GFN: 0x43e0 MFN: 0x1401e3 type: 0
>
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel


Hi Roger

Can you please print same debug for 7cb92 address (where L3 page table
is missing).
With shared and not shared ept?

Thank you!

-- 
Elena

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Shared page tables between ETP and IOMMU issue
  2015-02-26 18:02       ` Roger Pau Monné
  2015-02-26 19:28         ` Konrad Rzeszutek Wilk
  2015-02-26 19:31         ` Roger Pau Monné
@ 2015-02-27  8:16         ` Jan Beulich
  2 siblings, 0 replies; 10+ messages in thread
From: Jan Beulich @ 2015-02-27  8:16 UTC (permalink / raw)
  To: Roger Pau Monné; +Cc: yang.z.zhang, xen-devel, kevin.tian

>>> On 26.02.15 at 19:02, <roger.pau@citrix.com> wrote:
> El 26/02/15 a les 17.43, Jan Beulich ha escrit:
>>>>> On 26.02.15 at 17:29, <roger.pau@citrix.com> wrote:
>>> OK, I will try to take a look. All those faults come from physical
>>> memory ranges that are supposed to be usable, and in fact the CPU seems
>>> to be able to read/write from them without problems, or else the guest
>>> would have crashed much more early. Regarding sharing the page tables
>>> between EPT and the IOMMU, is there some bit that needs to be set in the
>>> ept entry in order to mark a page as available by the IOMMU?
>> 
>> Bits 0 and 1 (read and write) are shared between VT-d and EPT
>> (as is bit 7 - see struct dma_pte and ept_entry_t).
> 
> I've added some debug prints at the end of construct_dom0 to print the 
> MFN of a RAM page (using get_gfn_query_unlocked) and the VTd entry 
> (using print_vtd_entries):
> 
> (XEN) print_vtd_entries: iommu ffff8302197c3a40 dev 0000:00:1f.2 gmfn 43e0
> (XEN)     root_entry = ffff8302197c0000
> (XEN)     root_entry[0] = 140144001
> (XEN)     context = ffff830140144000
> (XEN)     context[fa] = 2_140148001
> (XEN)     l4 = ffff830140148000
> (XEN)     l4_index = 0
> (XEN)     l4[0] = 140147003
> (XEN)     l3 = ffff830140147000
> (XEN)     l3_index = 0
> (XEN)     l3[0] = 140146003
> (XEN)     l2 = ffff830140146000
> (XEN)     l2_index = 21
> (XEN)     l2[21] = 0
> (XEN)     l2[21] not present
> (XEN) GFN: 0x43e0 MFN: 0x1401e3 type: 0
> 
> This is before Dom0 has been started, so I think there's something 
> wrong in the way we build the page tables, because AFAICT the VTd 
> code is not able to resolve the GFN, but the EPT code is.

So obviously we'd want to see the EPT page table walk for the
same GFN for comparison. I'd expect them to differ at some
higher level already, and be wrong possibly because of the
context[] slot not having got updated at some point after its
initial setup (or the other way around - the context slot having
got updated without consideration of EPT, albeit that seems
less likely).

And then of course the question arises why you see this issue
with FreeBSD, but no-one so far saw it with Linux. Did you try
PVH Linux on that particular box (i.e. to tell a machine specific
issue from a guest dependent one)?

Jan

^ permalink raw reply	[flat|nested] 10+ messages in thread

end of thread, other threads:[~2015-02-27  8:16 UTC | newest]

Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-02-26 15:45 Shared page tables between ETP and IOMMU issue Roger Pau Monné
2015-02-26 15:57 ` Jan Beulich
2015-02-26 16:29   ` Roger Pau Monné
2015-02-26 16:43     ` Jan Beulich
2015-02-26 18:02       ` Roger Pau Monné
2015-02-26 19:28         ` Konrad Rzeszutek Wilk
2015-02-26 19:34           ` Roger Pau Monné
2015-02-26 19:31         ` Roger Pau Monné
2015-02-26 22:17           ` Elena Ufimtseva
2015-02-27  8:16         ` Jan Beulich

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.