linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* d63e2e1f3df breaks sparc/T5-8
@ 2015-03-26 16:51 David Ahern
  2015-03-26 20:43 ` Yinghai Lu
  0 siblings, 1 reply; 39+ messages in thread
From: David Ahern @ 2015-03-26 16:51 UTC (permalink / raw)
  To: yinghai, sparclinux; +Cc: LKML

Hi:

Boot of an 8-socket T5 sparc system fails on top of tree. git bisect 
points to this commit:

commit 	904bf6bd150bdafb42ddbb3257ea8
Author: Yinghai Lu <yinghai@kernel.org>
Date:   Thu Jan 15 16:21:51 2015 -0600

sparc/PCI: Clip bridge windows to fit in upstream windows

Every PCI-PCI bridge window should fit inside an upstream bridge window 
because orphaned address space is unreachable from the primary side of 
the upstream bridge.  If we inherit invalid bridge windows that overlap 
an upstream window from firmware, clip them to fit and update the bridge 
accordingly.


Sure enough if I revert it on top of tree the system boots fine.

David

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-26 16:51 d63e2e1f3df breaks sparc/T5-8 David Ahern
@ 2015-03-26 20:43 ` Yinghai Lu
  2015-03-26 23:27   ` David Ahern
  0 siblings, 1 reply; 39+ messages in thread
From: Yinghai Lu @ 2015-03-26 20:43 UTC (permalink / raw)
  To: David Ahern, Bjorn Helgaas, linux-pci; +Cc: sparclinux, LKML

[+bjorn, pci list]

On Thu, Mar 26, 2015 at 9:51 AM, David Ahern <david.ahern@oracle.com> wrote:
> Hi:
>
> Boot of an 8-socket T5 sparc system fails on top of tree. git bisect points
> to this commit:
>
> commit  904bf6bd150bdafb42ddbb3257ea8
> Author: Yinghai Lu <yinghai@kernel.org>
> Date:   Thu Jan 15 16:21:51 2015 -0600
>
> sparc/PCI: Clip bridge windows to fit in upstream windows
>
> Every PCI-PCI bridge window should fit inside an upstream bridge window
> because orphaned address space is unreachable from the primary side of the
> upstream bridge.  If we inherit invalid bridge windows that overlap an
> upstream window from firmware, clip them to fit and update the bridge
> accordingly.
>
>
> Sure enough if I revert it on top of tree the system boots fine.

Can you send out boot log with "debug ignore_loglevel"?

Thanks

Yinghai

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-26 20:43 ` Yinghai Lu
@ 2015-03-26 23:27   ` David Ahern
  2015-03-27 21:01     ` Yinghai Lu
  0 siblings, 1 reply; 39+ messages in thread
From: David Ahern @ 2015-03-26 23:27 UTC (permalink / raw)
  To: Yinghai Lu, Bjorn Helgaas, linux-pci; +Cc: sparclinux, LKML

[-- Attachment #1: Type: text/plain, Size: 106 bytes --]

On 3/26/15 2:43 PM, Yinghai Lu wrote:
> Can you send out boot log with "debug ignore_loglevel"?

attached

[-- Attachment #2: dmesg --]
[-- Type: text/plain, Size: 50844 bytes --]

PROMLIB: Sun IEEE Boot Prom 'OBP 4.36.2 2014/10/24 08:15'
PROMLIB: Root node compatible: sun4v
Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Initializing cgroup subsys cpuacct
Linux version 4.0.0-rc5+ (root@ca-qasparc24) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-4.0.9) (GCC) ) #1 SMP Thu Mar 26 18:51:40 EDT 2015
debug: skip boot console de-registration.
debug: ignoring loglevel setting.
bootconsole [earlyprom0] enabled
ARCH: SUN4V
Ethernet address: 00:10:e0:35:15:f6
MM: PAGE_OFFSET is 0xfff8000000000000 (max_phys_bits == 47)
MM: VMALLOC [0x0000000100000000 --> 0x0006000000000000]
MM: VMEMMAP [0x0006000000000000 --> 0x000c000000000000]
Kernel: Using 3 locked TLB entries for main kernel image.
Remapping the kernel... done.
OF stdout device is: /virtual-devices@100/console@1
PROM: Built device tree with 1478492 bytes of memory.
MDESC: Size is 774368 bytes.
PLATFORM: banner-name [SPARC T5-8]
PLATFORM: name [ORCL,SPARC-T5-8]
PLATFORM: hostid [863515f6]
PLATFORM: serial# [003515f6]
PLATFORM: stick-frequency [3b9aca00]
PLATFORM: mac-address [10e03515f6]
PLATFORM: watchdog-resolution [1000 ms]
PLATFORM: watchdog-max-timeout [31536000000 ms]
PLATFORM: max-cpus [1024]
Allocated 81920 bytes for kernel page tables.
Zone ranges:
  DMA      [mem 0x0000000030400000-0xffffffffffffffff]
  Normal   [mem 0x0000000000000000-0x0000383fffd11fff]
Movable zone start for each node
Early memory node ranges
  node   0: [mem 0x0000000030400000-0x0000003fddeeffff]
  node   0: [mem 0x0000003fddef6000-0x0000003fddef7fff]
  node   1: [mem 0x0000080000000000-0x0000083fffffffff]
  node   2: [mem 0x0000100000000000-0x0000103fffffffff]
  node   3: [mem 0x0000180000000000-0x0000183fffffffff]
  node   4: [mem 0x0000200000000000-0x0000203fffffffff]
  node   5: [mem 0x0000280000000000-0x0000283fffffffff]
  node   6: [mem 0x0000300000000000-0x0000303fffffffff]
  node   7: [mem 0x0000380000000000-0x0000383fffcddfff]
  node   7: [mem 0x0000383fffcee000-0x0000383fffd11fff]
Initmem setup node 0 [mem 0x0000000030400000-0x0000003fddef7fff]
On node 0 totalpages: 33385849
  Normal zone: 293431 pages used for memmap
  Normal zone: 33385849 pages, LIFO batch:15
Initmem setup node 1 [mem 0x0000080000000000-0x0000083fffffffff]
On node 1 totalpages: 33554432
  Normal zone: 294912 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
Initmem setup node 2 [mem 0x0000100000000000-0x0000103fffffffff]
On node 2 totalpages: 33554432
  Normal zone: 294912 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
Initmem setup node 3 [mem 0x0000180000000000-0x0000183fffffffff]
On node 3 totalpages: 33554432
  Normal zone: 294912 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
Initmem setup node 4 [mem 0x0000200000000000-0x0000203fffffffff]
On node 4 totalpages: 33554432
  Normal zone: 294912 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
Initmem setup node 5 [mem 0x0000280000000000-0x0000283fffffffff]
On node 5 totalpages: 33554432
  Normal zone: 294912 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
Initmem setup node 6 [mem 0x0000300000000000-0x0000303fffffffff]
On node 6 totalpages: 33554432
  Normal zone: 294912 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
Initmem setup node 7 [mem 0x0000380000000000-0x0000383fffd11fff]
On node 7 totalpages: 33554049
  Normal zone: 294909 pages used for memmap
  Normal zone: 33554049 pages, LIFO batch:15
Booting Linux...
CPU CAPS: [flush,stbar,swap,muldiv,v9,blkinit,n2,mul32]
CPU CAPS: [div32,v8plus,popc,vis,vis2,ASIBlkInit,fmaf,vis3]
CPU CAPS: [hpc,ima,pause,cbcond,aes,des,kasumi,camellia]
CPU CAPS: [md5,sha1,sha256,sha512,mpmul,montmul,montsqr,crc32c]
PERCPU: Embedded 8 pages/cpu @fff8003f4d000000 s27776 r8192 d29568 u65536
pcpu-alloc: s27776 r8192 d29568 u65536 alloc=1*4194304
pcpu-alloc: [0] 0000 0001 0002 0003 0004 0005 0006 0007 0008 0009 0010 0011 0012 0013 0014 0015 0016 0017 0018 0019 0020 0021 0022 0023 0024 0025 0026 0027 0028 0029 0030 0031 0032 0033 0034 0035 0036 0037 0038 0039 0040 0041 0042 0043 0044 0045 0046 0047 0048 0049 0050 0051 0052 0053 0054 0055 0056 0057 0058 0059 0060 0061 0062 0063 
pcpu-alloc: [0] 0064 0065 0066 0067 0068 0069 0070 0071 0072 0073 0074 0075 0076 0077 0078 0079 0080 0081 0082 0083 0084 0085 0086 0087 0088 0089 0090 0091 0092 0093 0094 0095 0096 0097 0098 0099 0100 0101 0102 0103 0104 0105 0106 0107 0108 0109 0110 0111 0112 0113 0114 0115 0116 0117 0118 0119 0120 0121 0122 0123 0124 0125 0126 0127 
pcpu-alloc: [1] 0128 0129 0130 0131 0132 0133 0134 0135 0136 0137 0138 0139 0140 0141 0142 0143 0144 0145 0146 0147 0148 0149 0150 0151 0152 0153 0154 0155 0156 0157 0158 0159 0160 0161 0162 0163 0164 0165 0166 0167 0168 0169 0170 0171 0172 0173 0174 0175 0176 0177 0178 0179 0180 0181 0182 0183 0184 0185 0186 0187 0188 0189 0190 0191 
pcpu-alloc: [1] 0192 0193 0194 0195 0196 0197 0198 0199 0200 0201 0202 0203 0204 0205 0206 0207 0208 0209 0210 0211 0212 0213 0214 0215 0216 0217 0218 0219 0220 0221 0222 0223 0224 0225 0226 0227 0228 0229 0230 0231 0232 0233 0234 0235 0236 0237 0238 0239 0240 0241 0242 0243 0244 0245 0246 0247 0248 0249 0250 0251 0252 0253 0254 0255 
pcpu-alloc: [2] 0256 0257 0258 0259 0260 0261 0262 0263 0264 0265 0266 0267 0268 0269 0270 0271 0272 0273 0274 0275 0276 0277 0278 0279 0280 0281 0282 0283 0284 0285 0286 0287 0288 0289 0290 0291 0292 0293 0294 0295 0296 0297 0298 0299 0300 0301 0302 0303 0304 0305 0306 0307 0308 0309 0310 0311 0312 0313 0314 0315 0316 0317 0318 0319 
pcpu-alloc: [2] 0320 0321 0322 0323 0324 0325 0326 0327 0328 0329 0330 0331 0332 0333 0334 0335 0336 0337 0338 0339 0340 0341 0342 0343 0344 0345 0346 0347 0348 0349 0350 0351 0352 0353 0354 0355 0356 0357 0358 0359 0360 0361 0362 0363 0364 0365 0366 0367 0368 0369 0370 0371 0372 0373 0374 0375 0376 0377 0378 0379 0380 0381 0382 0383 
pcpu-alloc: [3] 0384 0385 0386 0387 0388 0389 0390 0391 0392 0393 0394 0395 0396 0397 0398 0399 0400 0401 0402 0403 0404 0405 0406 0407 0408 0409 0410 0411 0412 0413 0414 0415 0416 0417 0418 0419 0420 0421 0422 0423 0424 0425 0426 0427 0428 0429 0430 0431 0432 0433 0434 0435 0436 0437 0438 0439 0440 0441 0442 0443 0444 0445 0446 0447 
pcpu-alloc: [3] 0448 0449 0450 0451 0452 0453 0454 0455 0456 0457 0458 0459 0460 0461 0462 0463 0464 0465 0466 0467 0468 0469 0470 0471 0472 0473 0474 0475 0476 0477 0478 0479 0480 0481 0482 0483 0484 0485 0486 0487 0488 0489 0490 0491 0492 0493 0494 0495 0496 0497 0498 0499 0500 0501 0502 0503 0504 0505 0506 0507 0508 0509 0510 0511 
pcpu-alloc: [4] 0512 0513 0514 0515 0516 0517 0518 0519 0520 0521 0522 0523 0524 0525 0526 0527 0528 0529 0530 0531 0532 0533 0534 0535 0536 0537 0538 0539 0540 0541 0542 0543 0544 0545 0546 0547 0548 0549 0550 0551 0552 0553 0554 0555 0556 0557 0558 0559 0560 0561 0562 0563 0564 0565 0566 0567 0568 0569 0570 0571 0572 0573 0574 0575 
pcpu-alloc: [4] 0576 0577 0578 0579 0580 0581 0582 0583 0584 0585 0586 0587 0588 0589 0590 0591 0592 0593 0594 0595 0596 0597 0598 0599 0600 0601 0602 0603 0604 0605 0606 0607 0608 0609 0610 0611 0612 0613 0614 0615 0616 0617 0618 0619 0620 0621 0622 0623 0624 0625 0626 0627 0628 0629 0630 0631 0632 0633 0634 0635 0636 0637 0638 0639 
pcpu-alloc: [5] 0640 0641 0642 0643 0644 0645 0646 0647 0648 0649 0650 0651 0652 0653 0654 0655 0656 0657 0658 0659 0660 0661 0662 0663 0664 0665 0666 0667 0668 0669 0670 0671 0672 0673 0674 0675 0676 0677 0678 0679 0680 0681 0682 0683 0684 0685 0686 0687 0688 0689 0690 0691 0692 0693 0694 0695 0696 0697 0698 0699 0700 0701 0702 0703 
pcpu-alloc: [5] 0704 0705 0706 0707 0708 0709 0710 0711 0712 0713 0714 0715 0716 0717 0718 0719 0720 0721 0722 0723 0724 0725 0726 0727 0728 0729 0730 0731 0732 0733 0734 0735 0736 0737 0738 0739 0740 0741 0742 0743 0744 0745 0746 0747 0748 0749 0750 0751 0752 0753 0754 0755 0756 0757 0758 0759 0760 0761 0762 0763 0764 0765 0766 0767 
pcpu-alloc: [6] 0768 0769 0770 0771 0772 0773 0774 0775 0776 0777 0778 0779 0780 0781 0782 0783 0784 0785 0786 0787 0788 0789 0790 0791 0792 0793 0794 0795 0796 0797 0798 0799 0800 0801 0802 0803 0804 0805 0806 0807 0808 0809 0810 0811 0812 0813 0814 0815 0816 0817 0818 0819 0820 0821 0822 0823 0824 0825 0826 0827 0828 0829 0830 0831 
pcpu-alloc: [6] 0832 0833 0834 0835 0836 0837 0838 0839 0840 0841 0842 0843 0844 0845 0846 0847 0848 0849 0850 0851 0852 0853 0854 0855 0856 0857 0858 0859 0860 0861 0862 0863 0864 0865 0866 0867 0868 0869 0870 0871 0872 0873 0874 0875 0876 0877 0878 0879 0880 0881 0882 0883 0884 0885 0886 0887 0888 0889 0890 0891 0892 0893 0894 0895 
pcpu-alloc: [7] 0896 0897 0898 0899 0900 0901 0902 0903 0904 0905 0906 0907 0908 0909 0910 0911 0912 0913 0914 0915 0916 0917 0918 0919 0920 0921 0922 0923 0924 0925 0926 0927 0928 0929 0930 0931 0932 0933 0934 0935 0936 0937 0938 0939 0940 0941 0942 0943 0944 0945 0946 0947 0948 0949 0950 0951 0952 0953 0954 0955 0956 0957 0958 0959 
pcpu-alloc: [7] 0960 0961 0962 0963 0964 0965 0966 0967 0968 0969 0970 0971 0972 0973 0974 0975 0976 0977 0978 0979 0980 0981 0982 0983 0984 0985 0986 0987 0988 0989 0990 0991 0992 0993 0994 0995 0996 0997 0998 0999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 
SUN4V: Mondo queue sizes [cpu(131072) dev(16384) r(8192) nr(256)]
Built 8 zonelists in Node order, mobility grouping on.  Total pages: 265908678
Policy zone: Normal
Kernel command line: root=/dev/mapper/VolGroup-lv_root ro rd_NO_LUKS LANG=en_US.UTF-8 rd_NO_MD rd_LVM_LV=VolGroup/lv_swap SYSFONT=latarcyrheb-sun16 rd_LVM_LV=VolGroup/lv_root KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM keep_bootcon debug ignore_loglevel
log_buf_len individual max cpu contribution: 4096 bytes
log_buf_len total cpu_extra contributions: 4190208 bytes
log_buf_len min size: 1048576 bytes
log_buf_len: 8388608 bytes
early log buf free: 1036920(98%)
PID hash table entries: 4096 (order: 2, 32768 bytes)
Sorting __ex_table...
Memory: 2127126464K/2146131920K available (5727K kernel code, 817K rwdata, 2488K rodata, 544K init, 2002K bss, 19005456K reserved, 0K cma-reserved)
Hierarchical RCU implementation.
NR_IRQS:2048 nr_irqs:2048 1
SUN4V: Using IRQ API major 3, cookie only virqs enabled
clocksource: mult[800000] shift[23]
clockevent: mult[80000000] shift[31]
Console: colour dummy device 80x25
console [tty0] enabled
Calibrating delay using timer specific routine.. 2001.25 BogoMIPS (lpj=4002500)
pid_max: default: 1048576 minimum: 8192
Security Framework initialized
SELinux:  Initializing.
SELinux:  Starting in permissive mode
Dentry cache hash table entries: 268435456 (order: 18, 2147483648 bytes)
Inode-cache hash table entries: 134217728 (order: 17, 1073741824 bytes)
Mount-cache hash table entries: 4194304 (order: 12, 33554432 bytes)
Mountpoint-cache hash table entries: 4194304 (order: 12, 33554432 bytes)
Initializing cgroup subsys blkio
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys perf_event
Initializing cgroup subsys hugetlb
ftrace: allocating 20534 entries in 41 pages
Brought up 1024 CPUs
devtmpfs: initialized
Performance events: 
Testing NMI watchdog ... OK.
Supported PMU type is 'niagara5'
ldc.c:v1.1 (July 22, 2008)
NET: Registered protocol family 16
VIO: Adding device channel-devices
VIO: Adding device vldc-port-0-0
VIO: Adding device vldc-port-0-1
VIO: Adding device vldc-port-0-2
VIO: Adding device vldc-port-1-0
VIO: Adding device vldc-port-2-0
VIO: Adding device vldc-port-3-0
VIO: Adding device vldc-port-3-1
VIO: Adding device vldc-port-3-4
VIO: Adding device vldc-port-3-3
VIO: Adding device vlds-port-0-0
VIO: Adding device ds-0
VIO: Adding device ds-1
pci_sun4v: Registered hvapi major[1] minor[0]
/pci@300: SUN4V PCI Bus Module
/pci@300: On NUMA node -1
/pci@300: PCI IO[804000000000] MEM[800000000000]
/pci@300: Unable to request IOMMU resource.
/pci@300: Imported 26 TSB entries from OBP
/pci@300: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@300: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@300: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@300: MSI queues at RA [0000383f51800000]
PCI: Scanning PBM /pci@300
pci_sun4v f02dbcfc: PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x804000000000-0x80400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0000:00: root bus resource [mem 0x800000000000-0x80007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0000:00: root bus resource [bus 00-77]
pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
pci 0000:02:04.0: PME# supported from D0 D3hot D3cold
pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
pci 0000:04:06.0: PME# supported from D0 D3hot D3cold
pci 0000:05:00.0: PME# supported from D0 D3hot D3cold
pci 0000:04:08.0: PME# supported from D0 D3hot D3cold
pci 0000:06:00.0: PME# supported from D0 D3hot D3cold
pci 0000:06:00.0: reg 0x184: can't handle BAR above 4GB (bus address 0x110204000)
pci 0000:06:00.0: reg 0x184: [mem size 0x00004000 64bit]
pci 0000:06:00.0: reg 0x190: can't handle BAR above 4GB (bus address 0x110304000)
pci 0000:06:00.0: reg 0x190: [mem size 0x00004000 64bit]
pci 0000:06:00.1: PME# supported from D0 D3hot D3cold
pci 0000:06:00.1: reg 0x184: can't handle BAR above 4GB (bus address 0x110408000)
pci 0000:06:00.1: reg 0x184: [mem size 0x00004000 64bit]
pci 0000:06:00.1: reg 0x190: can't handle BAR above 4GB (bus address 0x110800000)
pci 0000:06:00.1: reg 0x190: [mem size 0x00004000 64bit]
pci 0000:04:0c.0: PME# supported from D0 D3hot D3cold
pci 0000:07:00.0: supports D1 D2
pci 0000:02:06.0: PME# supported from D0 D3hot D3cold
pci 0000:02:04.0: can't claim BAR 15 [mem 0x800000000000-0x80002fffffff pref]: no compatible bridge window
pci 0000:05:00.0: can't claim BAR 0 [mem 0x800100000000-0x800100001fff]: no compatible bridge window
pci 0000:06:00.0: can't claim BAR 0 [mem 0x800110000000-0x8001101fffff pref]: no compatible bridge window
pci 0000:06:00.0: can't claim BAR 4 [mem 0x800110200000-0x800110203fff pref]: no compatible bridge window
pci 0000:06:00.1: can't claim BAR 0 [mem 0x800110600000-0x8001107fffff pref]: no compatible bridge window
pci 0000:06:00.1: can't claim BAR 4 [mem 0x800110404000-0x800110407fff pref]: no compatible bridge window
pci 0000:07:00.0: can't claim BAR 1 [mem 0x800120000000-0x80012000ffff]: no compatible bridge window
pci 0000:07:00.0: can't claim BAR 3 [mem 0x800120040000-0x80012007ffff]: no compatible bridge window
/pci@340: SUN4V PCI Bus Module
/pci@340: On NUMA node -1
/pci@340: PCI IO[804100000000] MEM[801000000000]
/pci@340: Unable to request IOMMU resource.
/pci@340: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@340: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@340: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@340: MSI queues at RA [0000283f52800000]
PCI: Scanning PBM /pci@340
pci_sun4v f02eab24: PCI host bridge to bus 0001:00
pci_bus 0001:00: root bus resource [io  0x804100000000-0x80410fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0001:00: root bus resource [mem 0x801000000000-0x80107effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0001:00: root bus resource [bus 00-e2]
pci 0001:00:01.0: PME# supported from D0 D3hot D3cold
pci 0001:01:00.0: PME# supported from D0 D3hot D3cold
pci 0001:02:06.0: PME# supported from D0 D3hot D3cold
/pci@380: SUN4V PCI Bus Module
/pci@380: On NUMA node -1
/pci@380: PCI IO[80c000000000] MEM[808000000000]
/pci@380: Unable to request IOMMU resource.
/pci@380: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@380: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@380: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@380: MSI queues at RA [0000103f52000000]
PCI: Scanning PBM /pci@380
pci_sun4v f02f994c: PCI host bridge to bus 0002:00
pci_bus 0002:00: root bus resource [io  0x80c000000000-0x80c00fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0002:00: root bus resource [mem 0x808000000000-0x80807effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0002:00: root bus resource [bus 00-e2]
pci 0002:00:01.0: PME# supported from D0 D3hot D3cold
pci 0002:01:00.0: PME# supported from D0 D3hot D3cold
pci 0002:02:0a.0: PME# supported from D0 D3hot D3cold
pci 0002:03:00.0: can't claim BAR 1 [mem 0x808100000000-0x808100003fff]: no compatible bridge window
pci 0002:03:00.1: can't claim BAR 1 [mem 0x808100004000-0x808100007fff]: no compatible bridge window
/pci@3c0: SUN4V PCI Bus Module
/pci@3c0: On NUMA node -1
/pci@3c0: PCI IO[80c100000000] MEM[809000000000]
/pci@3c0: Unable to request IOMMU resource.
/pci@3c0: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@3c0: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@3c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@3c0: MSI queues at RA [0000383f51000000]
PCI: Scanning PBM /pci@3c0
pci_sun4v f0308774: PCI host bridge to bus 0003:00
pci_bus 0003:00: root bus resource [io  0x80c100000000-0x80c10fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0003:00: root bus resource [mem 0x809000000000-0x80907effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0003:00: root bus resource [bus 00-e2]
pci 0003:00:01.0: PME# supported from D0 D3hot D3cold
pci 0003:01:00.0: PME# supported from D0 D3hot D3cold
pci 0003:02:0e.0: PME# supported from D0 D3hot D3cold
/pci@400: SUN4V PCI Bus Module
/pci@400: On NUMA node -1
/pci@400: PCI IO[814000000000] MEM[810000000000]
/pci@400: Unable to request IOMMU resource.
/pci@400: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@400: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@400: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@400: MSI queues at RA [0000203f52e00000]
PCI: Scanning PBM /pci@400
pci_sun4v f031759c: PCI host bridge to bus 0004:00
pci_bus 0004:00: root bus resource [io  0x814000000000-0x81400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0004:00: root bus resource [mem 0x810000000000-0x81007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0004:00: root bus resource [bus 00-72]
pci 0004:00:01.0: PME# supported from D0 D3hot D3cold
pci 0004:01:00.0: PME# supported from D0 D3hot D3cold
pci 0004:02:0c.0: PME# supported from D0 D3hot D3cold
pci 0004:02:0c.0: can't claim BAR 15 [mem 0x810000000000-0x810077ffffff pref]: no compatible bridge window
/pci@440: SUN4V PCI Bus Module
/pci@440: On NUMA node -1
/pci@440: PCI IO[814100000000] MEM[811000000000]
/pci@440: Unable to request IOMMU resource.
/pci@440: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@440: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@440: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@440: MSI queues at RA [0000103f52200000]
PCI: Scanning PBM /pci@440
pci_sun4v f03263c4: PCI host bridge to bus 0005:00
pci_bus 0005:00: root bus resource [io  0x814100000000-0x81410fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0005:00: root bus resource [mem 0x811000000000-0x81107effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0005:00: root bus resource [bus 00-e2]
pci 0005:00:01.0: PME# supported from D0 D3hot D3cold
pci 0005:01:00.0: PME# supported from D0 D3hot D3cold
pci 0005:02:0c.0: PME# supported from D0 D3hot D3cold
/pci@480: SUN4V PCI Bus Module
/pci@480: On NUMA node -1
/pci@480: PCI IO[81c000000000] MEM[818000000000]
/pci@480: Unable to request IOMMU resource.
/pci@480: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@480: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@480: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@480: MSI queues at RA [0000383f50c00000]
PCI: Scanning PBM /pci@480
pci_sun4v f03351ec: PCI host bridge to bus 0006:00
pci_bus 0006:00: root bus resource [io  0x81c000000000-0x81c00fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0006:00: root bus resource [mem 0x818000000000-0x81807effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0006:00: root bus resource [bus 00-e2]
pci 0006:00:01.0: PME# supported from D0 D3hot D3cold
pci 0006:01:00.0: PME# supported from D0 D3hot D3cold
pci 0006:02:04.0: PME# supported from D0 D3hot D3cold
/pci@4c0: SUN4V PCI Bus Module
/pci@4c0: On NUMA node -1
/pci@4c0: PCI IO[81c100000000] MEM[819000000000]
/pci@4c0: Unable to request IOMMU resource.
/pci@4c0: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@4c0: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@4c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@4c0: MSI queues at RA [0000203f52000000]
PCI: Scanning PBM /pci@4c0
pci_sun4v f0344014: PCI host bridge to bus 0007:00
pci_bus 0007:00: root bus resource [io  0x81c100000000-0x81c10fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0007:00: root bus resource [mem 0x819000000000-0x81907effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0007:00: root bus resource [bus 00-e2]
pci 0007:00:01.0: PME# supported from D0 D3hot D3cold
pci 0007:01:00.0: PME# supported from D0 D3hot D3cold
pci 0007:02:08.0: PME# supported from D0 D3hot D3cold
/pci@500: SUN4V PCI Bus Module
/pci@500: On NUMA node -1
/pci@500: PCI IO[824000000000] MEM[820000000000]
/pci@500: Unable to request IOMMU resource.
/pci@500: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@500: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@500: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@500: MSI queues at RA [0000103f52400000]
PCI: Scanning PBM /pci@500
pci_sun4v f0352e3c: PCI host bridge to bus 0008:00
pci_bus 0008:00: root bus resource [io  0x824000000000-0x82400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0008:00: root bus resource [mem 0x820000000000-0x82007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0008:00: root bus resource [bus 00-e2]
pci 0008:00:01.0: PME# supported from D0 D3hot D3cold
pci 0008:01:00.0: PME# supported from D0 D3hot D3cold
pci 0008:02:0e.0: PME# supported from D0 D3hot D3cold
/pci@540: SUN4V PCI Bus Module
/pci@540: On NUMA node -1
/pci@540: PCI IO[824100000000] MEM[821000000000]
/pci@540: Unable to request IOMMU resource.
/pci@540: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@540: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@540: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@540: MSI queues at RA [0000303f52200000]
PCI: Scanning PBM /pci@540
pci_sun4v f0361c64: PCI host bridge to bus 0009:00
pci_bus 0009:00: root bus resource [io  0x824100000000-0x82410fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0009:00: root bus resource [mem 0x821000000000-0x82107effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0009:00: root bus resource [bus 00-e2]
pci 0009:00:01.0: PME# supported from D0 D3hot D3cold
pci 0009:01:00.0: PME# supported from D0 D3hot D3cold
pci 0009:02:0e.0: PME# supported from D0 D3hot D3cold
/pci@580: SUN4V PCI Bus Module
/pci@580: On NUMA node -1
/pci@580: PCI IO[82c000000000] MEM[828000000000]
/pci@580: Unable to request IOMMU resource.
/pci@580: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@580: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@580: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@580: MSI queues at RA [0000203f52200000]
PCI: Scanning PBM /pci@580
pci_sun4v f0370a8c: PCI host bridge to bus 000a:00
pci_bus 000a:00: root bus resource [io  0x82c000000000-0x82c00fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000a:00: root bus resource [mem 0x828000000000-0x82807effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000a:00: root bus resource [bus 00-e2]
pci 000a:00:01.0: PME# supported from D0 D3hot D3cold
pci 000a:01:00.0: PME# supported from D0 D3hot D3cold
pci 000a:02:0a.0: PME# supported from D0 D3hot D3cold
/pci@5c0: SUN4V PCI Bus Module
/pci@5c0: On NUMA node -1
/pci@5c0: PCI IO[82c100000000] MEM[829000000000]
/pci@5c0: Unable to request IOMMU resource.
/pci@5c0: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@5c0: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@5c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@5c0: MSI queues at RA [0000083f52e00000]
PCI: Scanning PBM /pci@5c0
pci_sun4v f037f8b4: PCI host bridge to bus 000b:00
pci_bus 000b:00: root bus resource [io  0x82c100000000-0x82c10fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000b:00: root bus resource [mem 0x829000000000-0x82907effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000b:00: root bus resource [bus 00-72]
pci 000b:00:01.0: PME# supported from D0 D3hot D3cold
pci 000b:01:00.0: PME# supported from D0 D3hot D3cold
pci 000b:02:08.0: PME# supported from D0 D3hot D3cold
pci 000b:02:08.0: can't claim BAR 15 [mem 0x829000000000-0x829077ffffff pref]: no compatible bridge window
/pci@600: SUN4V PCI Bus Module
/pci@600: On NUMA node -1
/pci@600: PCI IO[834000000000] MEM[830000000000]
/pci@600: Unable to request IOMMU resource.
/pci@600: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@600: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@600: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@600: MSI queues at RA [0000383f50e00000]
PCI: Scanning PBM /pci@600
pci_sun4v f038e6dc: PCI host bridge to bus 000c:00
pci_bus 000c:00: root bus resource [io  0x834000000000-0x83400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000c:00: root bus resource [mem 0x830000000000-0x83007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000c:00: root bus resource [bus 00-e2]
pci 000c:00:01.0: PME# supported from D0 D3hot D3cold
pci 000c:01:00.0: PME# supported from D0 D3hot D3cold
pci 000c:02:08.0: PME# supported from D0 D3hot D3cold
/pci@640: SUN4V PCI Bus Module
/pci@640: On NUMA node -1
/pci@640: PCI IO[834100000000] MEM[831000000000]
/pci@640: Unable to request IOMMU resource.
/pci@640: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@640: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@640: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@640: MSI queues at RA [0000283f52e00000]
PCI: Scanning PBM /pci@640
pci_sun4v f039d504: PCI host bridge to bus 000d:00
pci_bus 000d:00: root bus resource [io  0x834100000000-0x83410fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000d:00: root bus resource [mem 0x831000000000-0x83107effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000d:00: root bus resource [bus 00-e2]
pci 000d:00:01.0: PME# supported from D0 D3hot D3cold
pci 000d:01:00.0: PME# supported from D0 D3hot D3cold
pci 000d:02:08.0: PME# supported from D0 D3hot D3cold
pci 000d:03:00.0: can't claim BAR 0 [mem 0x831100000000-0x831100001fff]: no compatible bridge window
pci 000d:03:00.0: can't claim BAR 2 [mem 0x831100004000-0x831100007fff]: no compatible bridge window
pci 000d:03:00.1: can't claim BAR 0 [mem 0x831100002000-0x831100003fff]: no compatible bridge window
pci 000d:03:00.1: can't claim BAR 2 [mem 0x831100008000-0x83110000bfff]: no compatible bridge window
/pci@680: SUN4V PCI Bus Module
/pci@680: On NUMA node -1
/pci@680: PCI IO[83c000000000] MEM[838000000000]
/pci@680: Unable to request IOMMU resource.
/pci@680: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@680: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@680: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@680: MSI queues at RA [0000003f22e00000]
PCI: Scanning PBM /pci@680
pci_sun4v f03ac32c: PCI host bridge to bus 000e:00
pci_bus 000e:00: root bus resource [io  0x83c000000000-0x83c00fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000e:00: root bus resource [mem 0x838000000000-0x83807effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000e:00: root bus resource [bus 00-e2]
pci 000e:00:01.0: PME# supported from D0 D3hot D3cold
pci 000e:01:00.0: PME# supported from D0 D3hot D3cold
pci 000e:02:04.0: PME# supported from D0 D3hot D3cold
/pci@6c0: SUN4V PCI Bus Module
/pci@6c0: On NUMA node -1
/pci@6c0: PCI IO[83c100000000] MEM[839000000000]
/pci@6c0: Unable to request IOMMU resource.
/pci@6c0: Imported 13 TSB entries from OBP
/pci@6c0: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@6c0: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@6c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@6c0: MSI queues at RA [0000303f52400000]
PCI: Scanning PBM /pci@6c0
pci_sun4v f03bb154: PCI host bridge to bus 000f:00
pci_bus 000f:00: root bus resource [io  0x83c100000000-0x83c10fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000f:00: root bus resource [mem 0x839000000000-0x83907effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000f:00: root bus resource [bus 00-78]
pci 000f:00:01.0: PME# supported from D0 D3hot D3cold
pci 000f:01:00.0: PME# supported from D0 D3hot D3cold
pci 000f:02:04.0: PME# supported from D0 D3hot D3cold
pci 000f:02:0c.0: PME# supported from D0 D3hot D3cold
pci 000f:73:00.0: PME# supported from D0 D3hot D3cold
pci 000f:74:04.0: PME# supported from D0 D3hot D3cold
pci 000f:75:00.0: PME# supported from D0 D3hot D3cold
pci 000f:75:00.0: reg 0x184: can't handle BAR above 4GB (bus address 0x480204000)
pci 000f:75:00.0: reg 0x184: [mem size 0x00004000 64bit]
pci 000f:75:00.0: reg 0x190: can't handle BAR above 4GB (bus address 0x480304000)
pci 000f:75:00.0: reg 0x190: [mem size 0x00004000 64bit]
pci 000f:75:00.1: PME# supported from D0 D3hot D3cold
pci 000f:75:00.1: reg 0x184: can't handle BAR above 4GB (bus address 0x480408000)
pci 000f:75:00.1: reg 0x184: [mem size 0x00004000 64bit]
pci 000f:75:00.1: reg 0x190: can't handle BAR above 4GB (bus address 0x480800000)
pci 000f:75:00.1: reg 0x190: [mem size 0x00004000 64bit]
pci 000f:74:06.0: PME# supported from D0 D3hot D3cold
pci 000f:76:00.0: PME# supported from D0 D3hot D3cold
pci 000f:74:07.0: PME# supported from D0 D3hot D3cold
pci 000f:74:0c.0: PME# supported from D0 D3hot D3cold
pci 000f:78:00.0: supports D1 D2
pci 000f:02:04.0: can't claim BAR 15 [mem 0x839000000000-0x839077ffffff pref]: no compatible bridge window
pci 000f:75:00.0: can't claim BAR 0 [mem 0x839480000000-0x8394801fffff pref]: no compatible bridge window
pci 000f:75:00.0: can't claim BAR 4 [mem 0x839480200000-0x839480203fff pref]: no compatible bridge window
pci 000f:75:00.1: can't claim BAR 0 [mem 0x839480600000-0x8394807fffff pref]: no compatible bridge window
pci 000f:75:00.1: can't claim BAR 4 [mem 0x839480404000-0x839480407fff pref]: no compatible bridge window
pci 000f:76:00.0: can't claim BAR 0 [mem 0x839490000000-0x839490001fff]: no compatible bridge window
pci 000f:78:00.0: can't claim BAR 1 [mem 0x8394a0000000-0x8394a000ffff]: no compatible bridge window
pci 000f:78:00.0: can't claim BAR 3 [mem 0x8394a0040000-0x8394a007ffff]: no compatible bridge window
vgaarb: device added: PCI:000f:77:00.0,decodes=io+mem,owns=none,locks=none
vgaarb: loaded
vgaarb: bridge control possible 000f:77:00.0
SCSI subsystem initialized
libata version 3.00 loaded.
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
SUN4V: Reboot data supported (maj=1,min=0).
ds.c:v1.0 (Jul 11, 2007)
Switched to clocksource stick
ds-1: Registered pri service.
ds-1: Registered var-config-backup service.
NET: Registered protocol family 2
TCP established hash table entries: 524288 (order: 9, 4194304 bytes)
TCP bind hash table entries: 65536 (order: 7, 1048576 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
TCP: reno registered
UDP hash table entries: 65536 (order: 8, 2097152 bytes)
UDP-Lite hash table entries: 65536 (order: 8, 2097152 bytes)
NET: Registered protocol family 1
pci 0000:05:00.0: xHCI BIOS handoff failed (BIOS bug ?) 00010401
pci 000f:76:00.0: xHCI BIOS handoff failed (BIOS bug ?) 00010401
PCI: CLS mismatch (64 != 512), using 64 bytes
Trying to unpack rootfs image as initramfs...
Freeing initrd memory: 7328K (fff8380004000000 - fff8380004728000)
futex hash table entries: 262144 (order: 11, 16777216 bytes)
Initialise system trusted keyring
audit: initializing netlink subsys (disabled)
audit: type=2000 audit(9.536:1): initialized
HugeTLB registered 8 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.2
VFS: Dquot-cache hash table entries: 1024 (order 0, 8192 bytes)
SELinux:  Registering netfilter hooks
alg: No test for stdrng (krng)
Key type asymmetric registered
Asymmetric key parser 'x509' registered
bounce: pool size: 64 pages
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
io scheduler noop registered
io scheduler deadline registered (default)
io scheduler cfq registered
f0290cf4: ttyS0 at I/O 0x0 (irq = 1, base_baud = 115200) is a SUN4V HCONS
console [ttyHV0] enabled
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
brd: module loaded
loop: module loaded
zram: Created 1 device(s)
libphy: Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci-pci: EHCI PCI platform driver
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
ohci-pci: OHCI PCI platform driver
uhci_hcd: USB Universal Host Controller Interface driver
mousedev: PS/2 mouse device common for all mice
rtc-sun4v rtc-sun4v: rtc core: registered sun4v as rtc0
hidraw: raw HID events driver (C) Jiri Kosina
usbcore: registered new interface driver usbhid
usbhid: USB HID core driver
drop_monitor: Initializing network drop monitor service
TCP: cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
Key type dns_resolver registered
Loading compiled-in X.509 certificates
Loaded X.509 cert 'Magrathea: Glacier signing key: 24126097c732472da3af1a69eba095e47fce52e1'
registered taskstats version 1
ima: No TPM chip found, activating TPM-bypass!
rtc-sun4v rtc-sun4v: setting system clock to 2015-03-26 23:24:13 UTC (1427412253)
dracut: dracut-004-336.0.2.el6_5.2
dracut: rd_NO_LUKS: removing cryptoluks activation
dm_mod: module verification failed: signature and/or required key missing - tainting kernel
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.30.0-ioctl (2014-12-22) initialised: dm-devel@redhat.com
udev: starting version 147
dracut: Starting plymouth daemon
sha256_sparc64: Using sparc64 sha256 opcode optimized SHA-256/SHA-224 implementation
aes_sparc64: Using sparc64 aes opcodes optimized AES implementation
qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.16-k.
qla2xxx [0002:03:00.0]-001d: : Found an ISP2532 irq 11 iobase 0x0000808100000000.
qla2xxx 0002:03:00.0: Direct firmware load for ql2500_fw.bin failed with error -2
qla2xxx [0002:03:00.0]-0063:0: Failed to load firmware image (ql2500_fw.bin).
qla2xxx [0002:03:00.0]-0090:0: Fimware image unavailable.
qla2xxx [0002:03:00.0]-0091:0: Firmware images can be retrieved from: http://ldriver.qlogic.com/firmware/.
scsi host0: qla2xxx
qla2xxx [0002:03:00.0]-00fb:0: QLogic QLE2562 - Sun StorageTek 8Gb FC PCIe HBA, dual port.
qla2xxx [0002:03:00.0]-00fc:0: ISP2532: PCIe (2.5GT/s x8) @ 0002:03:00.0 hdma- host#=0 fw=4.03.02 (80).
qla2xxx [0002:03:00.1]-001d: : Found an ISP2532 irq 12 iobase 0x0000808100004000.
qla2xxx [0002:03:00.0]-500a:0: LOOP UP detected (8 Gbps).
qla2xxx [0002:03:00.0]-2064:0: SNS scan failed -- assuming zero-entry result.
qla2xxx 0002:03:00.1: Direct firmware load for ql2500_fw.bin failed with error -2
qla2xxx [0002:03:00.1]-0063:1: Failed to load firmware image (ql2500_fw.bin).
qla2xxx [0002:03:00.1]-0090:1: Fimware image unavailable.
qla2xxx [0002:03:00.1]-0091:1: Firmware images can be retrieved from: http://ldriver.qlogic.com/firmware/.
scsi host1: qla2xxx
qla2xxx [0002:03:00.1]-00fb:1: QLogic QLE2562 - Sun StorageTek 8Gb FC PCIe HBA, dual port.
qla2xxx [0002:03:00.1]-00fc:1: ISP2532: PCIe (2.5GT/s x8) @ 0002:03:00.1 hdma- host#=1 fw=4.03.02 (80).
Emulex LightPulse Fibre Channel SCSI driver 10.4.8000.0.
Copyright(c) 2004-2014 Emulex.  All rights reserved.
scsi host2: Emulex LPe12000-S PCIe Fibre Channel Adapter  on PCI bus 03 device 00 irq 35
scsi host3: Emulex LPe12000-S PCIe Fibre Channel Adapter  on PCI bus 03 device 01 irq 36
mpt2sas version 20.100.00.00 loaded
mpt2sas0: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (2127134336 kB)
mpt2sas0: MSI-X vectors supported: 8, no of cores: 1024, max_msix_vectors: 8
mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 973
mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 974
mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 975
mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 976
mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 977
mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 978
mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 979
mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 980
mpt2sas0: iomem(0x0000800120000000), mapped(0x0000800120000000), size(65536)
mpt2sas0: ioport(0x0000804000001000), size(256)
mpt2sas0: Allocated physical memory: size(4603 kB)
mpt2sas0: Current Controller Queue Depth(2811), Max Controller Queue Depth(3072)
mpt2sas0: Scatter Gather Elements per IO(128)
mpt2sas0: LSISAS2308: FWVersion(14.00.00.00), ChipRevision(0x05), BiosVersion(00.00.00.00)
mpt2sas0: Protocol=(Initiator), Capabilities=(Raid,TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
scsi host4: Fusion MPT SAS Host
mpt2sas0: sending port enable !!
mpt2sas1: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (2127134336 kB)
mpt2sas1: MSI-X vectors supported: 8, no of cores: 1024, max_msix_vectors: 8
mpt2sas1-msix0: PCI-MSI-X enabled: IRQ 981
mpt2sas1-msix1: PCI-MSI-X enabled: IRQ 982
mpt2sas1-msix2: PCI-MSI-X enabled: IRQ 983
mpt2sas1-msix3: PCI-MSI-X enabled: IRQ 984
mpt2sas1-msix4: PCI-MSI-X enabled: IRQ 985
mpt2sas1-msix5: PCI-MSI-X enabled: IRQ 986
mpt2sas1-msix6: PCI-MSI-X enabled: IRQ 987
mpt2sas1-msix7: PCI-MSI-X enabled: IRQ 988
mpt2sas1: iomem(0x00008394a0000000), mapped(0x00008394a0000000), size(65536)
mpt2sas1: ioport(0x000083c104001000), size(256)
mpt2sas1: Allocated physical memory: size(4603 kB)
mpt2sas1: Current Controller Queue Depth(2811), Max Controller Queue Depth(3072)
mpt2sas1: Scatter Gather Elements per IO(128)
mpt2sas0: host_add: handle(0x0001), sas_addr(0x508002000159c0d0), phys(8)
mpt2sas1: LSISAS2308: FWVersion(14.00.00.00), ChipRevision(0x05), BiosVersion(00.00.00.00)
mpt2sas1: Protocol=(Initiator), Capabilities=(Raid,TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
scsi host5: Fusion MPT SAS Host
mpt2sas1: sending port enable !!
mpt2sas1: host_add: handle(0x0001), sas_addr(0x508002000159c0d1), phys(8)
mpt2sas0: port enable: SUCCESS
scsi 4:0:0:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 4:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0163295b1), phy(1), device_name(0x5000cca0163295b3)
scsi 4:0:0:0: SSP: enclosure_logical_id(0x508002000159c0d0), slot(1)
scsi 4:0:1:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 4:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca0162a4c1d), phy(2), device_name(0x5000cca0162a4c1f)
scsi 4:0:1:0: SSP: enclosure_logical_id(0x508002000159c0d0), slot(2)
qla2xxx [0002:03:00.1]-8038:1: Cable is unplugged...
mpt2sas1: port enable: SUCCESS
scsi 5:0:0:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 5:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0162f2e39), phy(0), device_name(0x5000cca0162f2e3b)
scsi 5:0:0:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(0)
scsi 5:0:1:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 5:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca016322ee5), phy(1), device_name(0x5000cca016322ee7)
scsi 5:0:1:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(1)
scsi 5:0:2:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 5:0:2:0: SSP: handle(0x000b), sas_addr(0x5000cca016322f71), phy(2), device_name(0x5000cca016322f73)
random: nonblocking pool is initialized
scsi 5:0:2:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(2)
sd 4:0:0:0: [sda] Enabling DIF Type 1 protection
sd 4:0:1:0: [sdb] Enabling DIF Type 1 protection
sd 4:0:1:0: [sdb] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 5:0:0:0: [sdc] Enabling DIF Type 1 protection
sd 5:0:0:0: [sdc] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 5:0:1:0: [sdd] Enabling DIF Type 1 protection
sd 5:0:1:0: [sdd] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 5:0:2:0: [sde] Enabling DIF Type 1 protection
sd 5:0:2:0: [sde] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 5:0:0:0: [sdc] Write Protect is off
sd 5:0:0:0: [sdc] Mode Sense: e7 00 10 08
sd 5:0:1:0: [sdd] Write Protect is off
sd 5:0:1:0: [sdd] Mode Sense: e7 00 10 08
sd 5:0:2:0: [sde] Write Protect is off
sd 5:0:2:0: [sde] Mode Sense: e7 00 10 08
sd 4:0:1:0: [sdb] Write Protect is off
sd 4:0:1:0: [sdb] Mode Sense: e7 00 10 08
sd 5:0:0:0: [sdc] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 5:0:1:0: [sdd] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 5:0:2:0: [sde] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 4:0:1:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA
 sdb: sdb1 sdb2 sdb3 sdb7
 sde: sde1 sde2 sde3
 sdc: sdc1 sdc2 sdc3 sdc7
 sdd: sdd1 sdd2 sdd3 sdd7
sd 4:0:1:0: [sdb] Attached SCSI disk
sd 5:0:2:0: [sde] Attached SCSI disk
sd 5:0:0:0: [sdc] Attached SCSI disk
sd 5:0:1:0: [sdd] Attached SCSI disk
sd 4:0:0:0: [sda] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 4:0:0:0: [sda] Write Protect is off
sd 4:0:0:0: [sda] Mode Sense: e7 00 10 08
sd 4:0:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
 sda: sda1 sda2 sda3
sd 4:0:0:0: [sda] Attached SCSI disk
dracut: Scanning devices sda2 sde2  for LVM logical volumes VolGroup/lv_swap VolGroup/lv_root 
dracut: inactive '/dev/VolGroup/lv_root' [274.38 GiB] inherit
dracut: inactive '/dev/VolGroup/lv_swap' [4.00 GiB] inherit
dracut: inactive '/dev/vg/root' [10.00 GiB] inherit
dracut: inactive '/dev/vg/swap' [2.00 GiB] inherit
dracut: inactive '/dev/vg/tmpdir' [10.00 GiB] inherit
dracut: inactive '/dev/vg/mountpoint' [5.00 GiB] inherit
EXT4-fs (dm-0): INFO: recovery required on readonly filesystem
EXT4-fs (dm-0): write access will be enabled during recovery
EXT4-fs (dm-0): orphan cleanup on readonly fs
EXT4-fs (dm-0): 1 orphan inode deleted
EXT4-fs (dm-0): recovery complete
EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
dracut: Mounted root filesystem /dev/mapper/VolGroup-lv_root
dracut: Loading SELinux policy
audit: type=1404 audit(1427412386.096:2): enforcing=1 old_enforcing=0 auid=4294967295 ses=4294967295
SELinux: 2048 avtab hash slots, 277818 rules.
SELinux: 2048 avtab hash slots, 277818 rules.
SELinux:  9 users, 12 roles, 3918 types, 217 bools, 1 sens, 1024 cats
SELinux:  81 classes, 277818 rules
SELinux:  Permission audit_access in class file not defined in policy.
SELinux:  Permission audit_access in class dir not defined in policy.
SELinux:  Permission execmod in class dir not defined in policy.
SELinux:  Permission audit_access in class lnk_file not defined in policy.
SELinux:  Permission open in class lnk_file not defined in policy.
SELinux:  Permission execmod in class lnk_file not defined in policy.
SELinux:  Permission audit_access in class chr_file not defined in policy.
SELinux:  Permission audit_access in class blk_file not defined in policy.
SELinux:  Permission execmod in class blk_file not defined in policy.
SELinux:  Permission audit_access in class sock_file not defined in policy.
SELinux:  Permission execmod in class sock_file not defined in policy.
SELinux:  Permission audit_access in class fifo_file not defined in policy.
SELinux:  Permission execmod in class fifo_file not defined in policy.
SELinux:  Permission syslog in class capability2 not defined in policy.
SELinux:  Permission wake_alarm in class capability2 not defined in policy.
SELinux:  Permission block_suspend in class capability2 not defined in policy.
SELinux:  Permission audit_read in class capability2 not defined in policy.
SELinux:  Permission attach_queue in class tun_socket not defined in policy.
SELinux:  Class binder not defined in policy.
SELinux: the above unknown classes and permissions will be allowed
SELinux:  Completing initialization.
SELinux:  Setting up existing superblocks.
audit: type=1403 audit(1427412388.948:3): policy loaded auid=4294967295 ses=4294967295
dracut: 
dracut: Switching root
udev: starting version 147
sha1_sparc64: Using sparc64 sha1 opcode optimized SHA-1 implementation
sha512_sparc64: Using sparc64 sha512 opcode optimized SHA-512/SHA-384 implementation
md5_sparc64: Using sparc64 md5 opcode optimized MD5 implementation
des_sparc64: Using sparc64 des opcodes optimized DES implementation
camellia_sparc64: Using sparc64 camellia opcodes optimized CAMELLIA implementation
crc32c_sparc64: Using sparc64 crc32c opcode optimized CRC32C implementation
sd 4:0:0:0: Attached scsi generic sg0 type 0
sd 4:0:1:0: Attached scsi generic sg1 type 0
sd 5:0:0:0: Attached scsi generic sg2 type 0
sd 5:0:1:0: Attached scsi generic sg3 type 0
sd 5:0:2:0: Attached scsi generic sg4 type 0
xhci_hcd 0000:05:00.0: xHCI Host Controller
xhci_hcd 0000:05:00.0: new USB bus registered, assigned bus number 1
xhci_hcd 0000:05:00.0: hcc params 0x014051cf hci version 0x100 quirks 0x00000010
usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: xHCI Host Controller
usb usb1: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
usb usb1: SerialNumber: 0000:05:00.0
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 4 ports detected
xhci_hcd 0000:05:00.0: xHCI Host Controller
xhci_hcd 0000:05:00.0: new USB bus registered, assigned bus number 2
usb usb2: New USB device found, idVendor=1d6b, idProduct=0003
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: xHCI Host Controller
usb usb2: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
usb usb2: SerialNumber: 0000:05:00.0
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 4 ports detected
xhci_hcd 000f:76:00.0: xHCI Host Controller
usb 1-3: new high-speed USB device number 2 using xhci_hcd
xhci_hcd 000f:76:00.0: new USB bus registered, assigned bus number 3
xhci_hcd 000f:76:00.0: hcc params 0x014051cf hci version 0x100 quirks 0x00000010
usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb3: Product: xHCI Host Controller
usb usb3: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
usb usb3: SerialNumber: 000f:76:00.0
usb 1-3: New USB device found, idVendor=090c, idProduct=1000
usb 1-3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
usb 1-3: Product: USB DISK
usb 1-3: Manufacturer: SMI Corporation
usb 1-3: SerialNumber: 2011081500000723
usb 1-3: ep 0x81 - rounding interval to 128 microframes, ep desc says 255 microframes
usb 1-3: ep 0x2 - rounding interval to 128 microframes, ep desc says 255 microframes
hub 3-0:1.0: USB hub found
hub 3-0:1.0: 4 ports detected
xhci_hcd 000f:76:00.0: xHCI Host Controller
xhci_hcd 000f:76:00.0: new USB bus registered, assigned bus number 4
usb usb4: New USB device found, idVendor=1d6b, idProduct=0003
usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb4: Product: xHCI Host Controller
usb usb4: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
usb usb4: SerialNumber: 000f:76:00.0
hub 4-0:1.0: USB hub found
hub 4-0:1.0: 4 ports detected
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 4.0.1-k
ixgbe: Copyright (c) 1999-2014 Intel Corporation.
PCI: Enabling device: (0000:06:00.0), cmd 2
ixgbe 0000:06:00.0: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
ixgbe 0000:06:00.0: PCI Express bandwidth of 32GT/s available
ixgbe 0000:06:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
ixgbe 0000:06:00.0: MAC: 3, PHY: 0, PBA No: 000000-000
ixgbe 0000:06:00.0: 00:10:e0:35:15:f6
ixgbe 0000:06:00.0: Intel(R) 10 Gigabit Network Connection
PCI: Enabling device: (0000:06:00.1), cmd 2
ixgbe 0000:06:00.1: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
ixgbe 0000:06:00.1: PCI Express bandwidth of 32GT/s available
ixgbe 0000:06:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
ixgbe 0000:06:00.1: MAC: 3, PHY: 0, PBA No: 000000-000
ixgbe 0000:06:00.1: 00:10:e0:35:15:f7
ixgbe 0000:06:00.1: Intel(R) 10 Gigabit Network Connection
PCI: Enabling device: (000f:75:00.0), cmd 2
ixgbe 000f:75:00.0: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
ixgbe 000f:75:00.0: PCI Express bandwidth of 32GT/s available
ixgbe 000f:75:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
ixgbe 000f:75:00.0: MAC: 3, PHY: 0, PBA No: 000000-000
ixgbe 000f:75:00.0: 00:10:e0:35:15:f8
ixgbe 000f:75:00.0: Intel(R) 10 Gigabit Network Connection
PCI: Enabling device: (000f:75:00.1), cmd 2
ixgbe 000f:75:00.1: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
ixgbe 000f:75:00.1: PCI Express bandwidth of 32GT/s available
ixgbe 000f:75:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
ixgbe 000f:75:00.1: MAC: 3, PHY: 0, PBA No: 000000-000
ixgbe 000f:75:00.1: 00:10:e0:35:15:f9
ixgbe 000f:75:00.1: Intel(R) 10 Gigabit Network Connection
usb-storage 1-3:1.0: USB Mass Storage device detected
scsi host6: usb-storage 1-3:1.0
usbcore: registered new interface driver usb-storage
scsi 6:0:0:0: Direct-Access     SMI      USB DISK         3000 PQ: 0 ANSI: 0 CCS
sd 6:0:0:0: Attached scsi generic sg5 type 0
sd 6:0:0:0: [sdf] 62652416 512-byte logical blocks: (32.0 GB/29.8 GiB)
sd 6:0:0:0: [sdf] Write Protect is off
sd 6:0:0:0: [sdf] Mode Sense: 43 00 00 00
sd 6:0:0:0: [sdf] No Caching mode page found
sd 6:0:0:0: [sdf] Assuming drive cache: write through
 sdf: sdf1 sdf2 sdf3
sd 6:0:0:0: [sdf] Attached SCSI removable disk
EXT4-fs (dm-0): re-mounted. Opts: (null)
kjournald starting.  Commit interval 5 seconds
EXT3-fs (sde1): using internal journal
EXT3-fs (sde1): mounted filesystem with ordered data mode
Adding 4194296k swap on /dev/mapper/VolGroup-lv_swap.  Priority:-1 extents:1 across:4194296k FS
NET: Registered protocol family 10
pps pps0: new PPS source ptp0
ixgbe 0000:06:00.0: registered PHC device on eth0
IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
audit: type=1305 audit(1427412422.136:4): audit_pid=11720 old=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:auditd_t:s0 res=1
ixgbe 0000:06:00.0 eth0: NIC Link is Up 1 Gbps, Flow Control: RX/TX
IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
sd 5:0:2:0: attempting task abort! scmd(fff8083f4ec54640)
sd 5:0:2:0: [sde] CDB: Read(10) 28 20 10 a0 31 03 00 00 08 00
scsi target5:0:2: handle(0x000b), sas_address(0x5000cca016322f71), phy(2)
scsi target5:0:2: enclosure_logical_id(0x508002000159c0d1), slot(2)
sd 5:0:2:0: task abort: SUCCESS scmd(fff8083f4ec54640)

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-26 23:27   ` David Ahern
@ 2015-03-27 21:01     ` Yinghai Lu
  2015-03-27 21:50       ` David Miller
  2015-03-27 23:57       ` Yinghai Lu
  0 siblings, 2 replies; 39+ messages in thread
From: Yinghai Lu @ 2015-03-27 21:01 UTC (permalink / raw)
  To: David Ahern; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

On Thu, Mar 26, 2015 at 4:27 PM, David Ahern <david.ahern@oracle.com> wrote:
> On 3/26/15 2:43 PM, Yinghai Lu wrote:
>>
>> Can you send out boot log with "debug ignore_loglevel"?
>
>
> attached

So the kernel config is sparc32 or sparc64 ?

pci 0000:06:00.0: reg 0x184: can't handle BAR above 4GB (bus address
0x110204000)


only could happen when dma_addr_t is 32bit.

in drivers/pci/probe.c::__pcie_read_base()
                if ((sizeof(dma_addr_t) < 8) && l) {
                        /* Above 32-bit boundary; try to reallocate */
                        res->flags |= IORESOURCE_UNSET;
                        res->start = 0;
                        res->end = sz64;
                        dev_info(&dev->dev, "reg 0x%x: can't handle
BAR above 4GB (bus address %#010llx)\n",
                                 pos, (unsigned long long)l64);
                        goto out;
                }

also root bus has
pci_sun4v f02dbcfc: PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x804000000000-0x80400fffffff]
(bus address [0x0000-0xfffffff])
pci_bus 0000:00: root bus resource [mem 0x800000000000-0x80007effffff]
(bus address [0x00000000-0x7effffff])
pci_bus 0000:00: root bus resource [bus 00-77]

and children device have
pci 0000:05:00.0: can't claim BAR 0 [mem
0x800100000000-0x800100001fff]: no compatible bridge window
pci 0000:06:00.0: can't claim BAR 0 [mem 0x800110000000-0x8001101fffff
pref]: no compatible bridge window
pci 0000:06:00.0: can't claim BAR 4 [mem 0x800110200000-0x800110203fff
pref]: no compatible bridge window
pci 0000:06:00.1: can't claim BAR 0 [mem 0x800110600000-0x8001107fffff
pref]: no compatible bridge window
pci 0000:06:00.1: can't claim BAR 4 [mem 0x800110404000-0x800110407fff
pref]: no compatible bridge window
pci 0000:07:00.0: can't claim BAR 1 [mem
0x800120000000-0x80012000ffff]: no compatible bridge window
pci 0000:07:00.0: can't claim BAR 3 [mem
0x800120040000-0x80012007ffff]: no compatible bridge window


looks like some root bus resource get dumped because it is out of range.

Also please make sure your config have

CONFIG_PCI_DEBUG=y

and capture serial console with "debug ignore_loglevel", so we check if
pci 0000:00:01.0 really have resource assigned.

Thanks

Yinghai

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-27 21:01     ` Yinghai Lu
@ 2015-03-27 21:50       ` David Miller
  2015-03-27 22:51         ` Yinghai Lu
       [not found]         ` <CABhMZUVqgsYdT4wn2H8hsrh4f=6hT0G+sg=wwYSt33+jtvBS9A@mail.gmail.com>
  2015-03-27 23:57       ` Yinghai Lu
  1 sibling, 2 replies; 39+ messages in thread
From: David Miller @ 2015-03-27 21:50 UTC (permalink / raw)
  To: yinghai; +Cc: david.ahern, bhelgaas, linux-pci, sparclinux, linux-kernel

From: Yinghai Lu <yinghai@kernel.org>
Date: Fri, 27 Mar 2015 14:01:54 -0700

> On Thu, Mar 26, 2015 at 4:27 PM, David Ahern <david.ahern@oracle.com> wrote:
>> On 3/26/15 2:43 PM, Yinghai Lu wrote:
>>>
>>> Can you send out boot log with "debug ignore_loglevel"?
>>
>>
>> attached
> 
> So the kernel config is sparc32 or sparc64 ?
> 
> pci 0000:06:00.0: reg 0x184: can't handle BAR above 4GB (bus address
> 0x110204000)
> 
> 
> only could happen when dma_addr_t is 32bit.

All DMA occurs behind an IOMMU and these IOMMUs only
support 32-bit addressing, therefore dma_addr_t is
32-bit on sparc64.

If you want to represent PCI address in some way, you
absolutely cannot use dma_addr_t as your data type.

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-27 21:50       ` David Miller
@ 2015-03-27 22:51         ` Yinghai Lu
       [not found]         ` <CABhMZUVqgsYdT4wn2H8hsrh4f=6hT0G+sg=wwYSt33+jtvBS9A@mail.gmail.com>
  1 sibling, 0 replies; 39+ messages in thread
From: Yinghai Lu @ 2015-03-27 22:51 UTC (permalink / raw)
  To: David Miller, Bjorn Helgaas
  Cc: David Ahern, linux-pci, sparclinux, Linux Kernel Mailing List

On Fri, Mar 27, 2015 at 2:50 PM, David Miller <davem@davemloft.net> wrote:

> All DMA occurs behind an IOMMU and these IOMMUs only
> support 32-bit addressing, therefore dma_addr_t is
> 32-bit on sparc64.
>
> If you want to represent PCI address in some way, you
> absolutely cannot use dma_addr_t as your data type.

Oh no, we missed that for a while.

Hi Bjorn,

I would suggest that we introduce pci_bus_addr_t or pci_addr_t.

    Yinghai

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-27 21:01     ` Yinghai Lu
  2015-03-27 21:50       ` David Miller
@ 2015-03-27 23:57       ` Yinghai Lu
  2015-03-28  0:32         ` David Ahern
                           ` (2 more replies)
  1 sibling, 3 replies; 39+ messages in thread
From: Yinghai Lu @ 2015-03-27 23:57 UTC (permalink / raw)
  To: David Ahern; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

[-- Attachment #1: Type: text/plain, Size: 429 bytes --]

On Fri, Mar 27, 2015 at 2:01 PM, Yinghai Lu <yinghai@kernel.org> wrote:
> On Thu, Mar 26, 2015 at 4:27 PM, David Ahern <david.ahern@oracle.com> wrote:

> Also please make sure your config have
>
> CONFIG_PCI_DEBUG=y
>
> and capture serial console with "debug ignore_loglevel", so we check if
> pci 0000:00:01.0 really have resource assigned.

Please check attached patch and send out boot log with above config.

Thanks

Yinghai

[-- Attachment #2: pci_bus_addr_t.patch --]
[-- Type: text/x-patch, Size: 10938 bytes --]

Subject: [RFC PATCH] PCI: Introduce pci_bus_addr_t

David Ahern found commit d63e2e1f3df9 ("sparc/PCI: Clip bridge windows
to fit in upstream windows") broke sparc/T5-8.

In the boot log, there is
  pci 0000:06:00.0: reg 0x184: can't handle BAR above 4GB (bus address
  0x110204000)
but that only could happen when dma_addr_t is 32-bit.

According to David Miller, all DMA occurs behind an IOMMU and these
IOMMUs only support 32-bit addressing, therefore dma_addr_t is
32-bit on sparc64.

Let's introduce pci_bus_addr instead of using dma_addr_t.

Fixes: commit d63e2e1f3df9 ("sparc/PCI: Clip bridge windows to fit in upstream windows")
Fixes: commit 23b13bc76f35 ("PCI: Fail safely if we can't handle BARs larger than 4GB")
Link: http://lkml.kernel.org/r/CAE9FiQU1gJY1LYrxs+ma5LCTEEe4xmtjRG0aXJ9K_Tsu+m9Wuw@mail.gmail.com
Reported-by: David Ahern <david.ahern@oracle.com>
Signed-off-by: Yinghai Lu <yinghai@kernel.org>

---
 arch/alpha/Kconfig             |    3 +++
 arch/arm/Kconfig               |    1 +
 arch/arm/mach-axxia/Kconfig    |    1 +
 arch/arm/mach-exynos/Kconfig   |    1 +
 arch/arm/mach-highbank/Kconfig |    1 +
 arch/arm/mach-shmobile/Kconfig |    1 +
 arch/arm/mm/Kconfig            |    3 +++
 arch/arm64/Kconfig             |    3 +++
 arch/ia64/Kconfig              |    3 +++
 arch/mips/Kconfig              |    3 +++
 arch/powerpc/Kconfig           |    3 +++
 arch/sparc/Kconfig             |    3 +++
 arch/tile/Kconfig              |    3 +++
 arch/x86/Kconfig               |    4 ++++
 drivers/pci/bus.c              |    8 ++++----
 drivers/pci/probe.c            |   12 ++++++------
 include/linux/pci.h            |    6 +++---
 include/linux/types.h          |    7 +++++++
 18 files changed, 53 insertions(+), 13 deletions(-)

Index: linux-2.6/arch/alpha/Kconfig
===================================================================
--- linux-2.6.orig/arch/alpha/Kconfig
+++ linux-2.6/arch/alpha/Kconfig
@@ -66,6 +66,9 @@ config ZONE_DMA
 config ARCH_DMA_ADDR_T_64BIT
 	def_bool y
 
+config ARCH_PCI_BUS_ADDR_T_64BIT
+	def_bool y
+
 config NEED_DMA_MAP_STATE
        def_bool y
 
Index: linux-2.6/arch/arm/Kconfig
===================================================================
--- linux-2.6.orig/arch/arm/Kconfig
+++ linux-2.6/arch/arm/Kconfig
@@ -1779,6 +1779,7 @@ config XEN
 	depends on !GENERIC_ATOMIC64
 	depends on MMU
 	select ARCH_DMA_ADDR_T_64BIT
+	select ARCH_PCI_BUS_ADDR_T_64BIT
 	select ARM_PSCI
 	select SWIOTLB_XEN
 	help
Index: linux-2.6/arch/arm/mach-axxia/Kconfig
===================================================================
--- linux-2.6.orig/arch/arm/mach-axxia/Kconfig
+++ linux-2.6/arch/arm/mach-axxia/Kconfig
@@ -1,6 +1,7 @@
 config ARCH_AXXIA
 	bool "LSI Axxia platforms" if (ARCH_MULTI_V7 && ARM_LPAE)
 	select ARCH_DMA_ADDR_T_64BIT
+	select ARCH_PCI_BUS_ADDR_T_64BIT
 	select ARM_AMBA
 	select ARM_GIC
 	select ARM_TIMER_SP804
Index: linux-2.6/arch/arm/mach-exynos/Kconfig
===================================================================
--- linux-2.6.orig/arch/arm/mach-exynos/Kconfig
+++ linux-2.6/arch/arm/mach-exynos/Kconfig
@@ -106,6 +106,7 @@ config SOC_EXYNOS5440
 	default y
 	depends on ARCH_EXYNOS5
 	select ARCH_DMA_ADDR_T_64BIT if ARM_LPAE
+	select ARCH_PCI_BUS_ADDR_T_64BIT if ARM_LPAE
 	select HAVE_ARM_ARCH_TIMER
 	select AUTO_ZRELADDR
 	select MIGHT_HAVE_PCI
Index: linux-2.6/arch/arm/mach-highbank/Kconfig
===================================================================
--- linux-2.6.orig/arch/arm/mach-highbank/Kconfig
+++ linux-2.6/arch/arm/mach-highbank/Kconfig
@@ -1,6 +1,7 @@
 config ARCH_HIGHBANK
 	bool "Calxeda ECX-1000/2000 (Highbank/Midway)" if ARCH_MULTI_V7
 	select ARCH_DMA_ADDR_T_64BIT if ARM_LPAE
+	select ARCH_PCI_BUS_ADDR_T_64BIT if ARM_LPAE
 	select ARCH_HAS_HOLES_MEMORYMODEL
 	select ARCH_SUPPORTS_BIG_ENDIAN
 	select ARM_AMBA
Index: linux-2.6/arch/arm/mach-shmobile/Kconfig
===================================================================
--- linux-2.6.orig/arch/arm/mach-shmobile/Kconfig
+++ linux-2.6/arch/arm/mach-shmobile/Kconfig
@@ -36,6 +36,7 @@ menuconfig ARCH_SHMOBILE_MULTI
 	select HAVE_ARM_TWD if SMP
 	select ARM_GIC
 	select ARCH_DMA_ADDR_T_64BIT if ARM_LPAE
+	select ARCH_PCI_BUS_ADDR_T_64BIT if ARM_LPAE
 	select NO_IOPORT_MAP
 	select PINCTRL
 	select ARCH_REQUIRE_GPIOLIB
Index: linux-2.6/arch/arm/mm/Kconfig
===================================================================
--- linux-2.6.orig/arch/arm/mm/Kconfig
+++ linux-2.6/arch/arm/mm/Kconfig
@@ -630,6 +630,9 @@ config ARCH_PHYS_ADDR_T_64BIT
 config ARCH_DMA_ADDR_T_64BIT
 	bool
 
+config ARCH_PCI_BUS_ADDR_T_64BIT
+	bool
+
 config ARM_THUMB
 	bool "Support Thumb user binaries" if !CPU_THUMBONLY
 	depends on CPU_ARM720T || CPU_ARM740T || CPU_ARM920T || CPU_ARM922T || \
Index: linux-2.6/arch/arm64/Kconfig
===================================================================
--- linux-2.6.orig/arch/arm64/Kconfig
+++ linux-2.6/arch/arm64/Kconfig
@@ -125,6 +125,9 @@ config HAVE_GENERIC_RCU_GUP
 config ARCH_DMA_ADDR_T_64BIT
 	def_bool y
 
+config ARCH_PCI_BUS_ADDR_T_64BIT
+	def_bool y
+
 config NEED_DMA_MAP_STATE
 	def_bool y
 
Index: linux-2.6/arch/ia64/Kconfig
===================================================================
--- linux-2.6.orig/arch/ia64/Kconfig
+++ linux-2.6/arch/ia64/Kconfig
@@ -74,6 +74,9 @@ config MMU
 config ARCH_DMA_ADDR_T_64BIT
 	def_bool y
 
+config ARCH_PCI_BUS_ADDR_T_64BIT
+	def_bool y
+
 config NEED_DMA_MAP_STATE
 	def_bool y
 
Index: linux-2.6/arch/mips/Kconfig
===================================================================
--- linux-2.6.orig/arch/mips/Kconfig
+++ linux-2.6/arch/mips/Kconfig
@@ -984,6 +984,9 @@ config FW_CFE
 config ARCH_DMA_ADDR_T_64BIT
 	def_bool (HIGHMEM && ARCH_PHYS_ADDR_T_64BIT) || 64BIT
 
+config ARCH_PCI_BUS_ADDR_T_64BIT
+	def_bool (HIGHMEM && ARCH_PHYS_ADDR_T_64BIT) || 64BIT
+
 config DMA_MAYBE_COHERENT
 	select DMA_NONCOHERENT
 	bool
Index: linux-2.6/arch/powerpc/Kconfig
===================================================================
--- linux-2.6.orig/arch/powerpc/Kconfig
+++ linux-2.6/arch/powerpc/Kconfig
@@ -23,6 +23,9 @@ config ARCH_PHYS_ADDR_T_64BIT
 config ARCH_DMA_ADDR_T_64BIT
 	def_bool ARCH_PHYS_ADDR_T_64BIT
 
+config ARCH_PCI_ADDR_T_64BIT
+	def_bool ARCH_PHYS_ADDR_T_64BIT
+
 config MMU
 	bool
 	default y
Index: linux-2.6/arch/sparc/Kconfig
===================================================================
--- linux-2.6.orig/arch/sparc/Kconfig
+++ linux-2.6/arch/sparc/Kconfig
@@ -143,6 +143,9 @@ config GENERIC_ISA_DMA
 	bool
 	default y if SPARC32
 
+config ARCH_PCI_BUS_ADDR_T_64BIT
+	def_bool y if SPARC64
+
 config ARCH_SUPPORTS_DEBUG_PAGEALLOC
 	def_bool y if SPARC64
 
Index: linux-2.6/arch/tile/Kconfig
===================================================================
--- linux-2.6.orig/arch/tile/Kconfig
+++ linux-2.6/arch/tile/Kconfig
@@ -86,6 +86,9 @@ config ARCH_PHYS_ADDR_T_64BIT
 config ARCH_DMA_ADDR_T_64BIT
 	def_bool y
 
+config ARCH_PCI_BUS_ADDR_T_64BIT
+	def_bool y
+
 config NEED_DMA_MAP_STATE
 	def_bool y
 
Index: linux-2.6/arch/x86/Kconfig
===================================================================
--- linux-2.6.orig/arch/x86/Kconfig
+++ linux-2.6/arch/x86/Kconfig
@@ -1295,6 +1295,10 @@ config ARCH_DMA_ADDR_T_64BIT
 	def_bool y
 	depends on X86_64 || HIGHMEM64G
 
+config ARCH_PCI_BUS_ADDR_T_64BIT
+	def_bool y
+	depends on X86_64 || HIGHMEM64G
+
 config X86_DIRECT_GBPAGES
 	def_bool y
 	depends on X86_64 && !DEBUG_PAGEALLOC && !KMEMCHECK
Index: linux-2.6/drivers/pci/bus.c
===================================================================
--- linux-2.6.orig/drivers/pci/bus.c
+++ linux-2.6/drivers/pci/bus.c
@@ -92,11 +92,11 @@ void pci_bus_remove_resources(struct pci
 }
 
 static struct pci_bus_region pci_32_bit = {0, 0xffffffffULL};
-#ifdef CONFIG_ARCH_DMA_ADDR_T_64BIT
+#ifdef CONFIG_ARCH_PCI_BUS_ADDR_T_64BIT
 static struct pci_bus_region pci_64_bit = {0,
-				(dma_addr_t) 0xffffffffffffffffULL};
-static struct pci_bus_region pci_high = {(dma_addr_t) 0x100000000ULL,
-				(dma_addr_t) 0xffffffffffffffffULL};
+				(pci_bus_addr_t) 0xffffffffffffffffULL};
+static struct pci_bus_region pci_high = {(pci_bus_addr_t) 0x100000000ULL,
+				(pci_bus_addr_t) 0xffffffffffffffffULL};
 #endif
 
 /*
Index: linux-2.6/drivers/pci/probe.c
===================================================================
--- linux-2.6.orig/drivers/pci/probe.c
+++ linux-2.6/drivers/pci/probe.c
@@ -254,8 +254,8 @@ int __pci_read_base(struct pci_dev *dev,
 	}
 
 	if (res->flags & IORESOURCE_MEM_64) {
-		if ((sizeof(dma_addr_t) < 8 || sizeof(resource_size_t) < 8) &&
-		    sz64 > 0x100000000ULL) {
+		if ((sizeof(pci_bus_addr_t) < 8 || sizeof(resource_size_t) < 8)
+		    && sz64 > 0x100000000ULL) {
 			res->flags |= IORESOURCE_UNSET | IORESOURCE_DISABLED;
 			res->start = 0;
 			res->end = 0;
@@ -264,7 +264,7 @@ int __pci_read_base(struct pci_dev *dev,
 			goto out;
 		}
 
-		if ((sizeof(dma_addr_t) < 8) && l) {
+		if ((sizeof(pci_bus_addr_t) < 8) && l) {
 			/* Above 32-bit boundary; try to reallocate */
 			res->flags |= IORESOURCE_UNSET;
 			res->start = 0;
@@ -399,7 +399,7 @@ static void pci_read_bridge_mmio_pref(st
 	struct pci_dev *dev = child->self;
 	u16 mem_base_lo, mem_limit_lo;
 	u64 base64, limit64;
-	dma_addr_t base, limit;
+	pci_bus_addr_t base, limit;
 	struct pci_bus_region region;
 	struct resource *res;
 
@@ -426,8 +426,8 @@ static void pci_read_bridge_mmio_pref(st
 		}
 	}
 
-	base = (dma_addr_t) base64;
-	limit = (dma_addr_t) limit64;
+	base = (pci_bus_addr_t) base64;
+	limit = (pci_bus_addr_t) limit64;
 
 	if (base != base64) {
 		dev_err(&dev->dev, "can't handle bridge window above 4GB (bus address %#010llx)\n",
Index: linux-2.6/include/linux/pci.h
===================================================================
--- linux-2.6.orig/include/linux/pci.h
+++ linux-2.6/include/linux/pci.h
@@ -577,8 +577,8 @@ int raw_pci_write(unsigned int domain, u
 		  int reg, int len, u32 val);
 
 struct pci_bus_region {
-	dma_addr_t start;
-	dma_addr_t end;
+	pci_bus_addr_t start;
+	pci_bus_addr_t end;
 };
 
 struct pci_dynids {
@@ -1127,7 +1127,7 @@ int __must_check pci_bus_alloc_resource(
 
 int pci_remap_iospace(const struct resource *res, phys_addr_t phys_addr);
 
-static inline dma_addr_t pci_bus_address(struct pci_dev *pdev, int bar)
+static inline pci_bus_addr_t pci_bus_address(struct pci_dev *pdev, int bar)
 {
 	struct pci_bus_region region;
 
Index: linux-2.6/include/linux/types.h
===================================================================
--- linux-2.6.orig/include/linux/types.h
+++ linux-2.6/include/linux/types.h
@@ -146,6 +146,13 @@ typedef u64 dma_addr_t;
 typedef u32 dma_addr_t;
 #endif /* dma_addr_t */
 
+/* A pci_bus_addr_t can hold pci bus address for the platform */
+#ifdef CONFIG_ARCH_PCI_BUS_ADDR_T_64BIT
+typedef u64 pci_bus_addr_t;
+#else
+typedef u32 pci_bus_addr_t;
+#endif /* pci_bus_addr_t */
+
 #ifdef __CHECKER__
 #else
 #endif

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-27 23:57       ` Yinghai Lu
@ 2015-03-28  0:32         ` David Ahern
  2015-03-28  0:36           ` David Ahern
  2015-03-28  1:05         ` Sam Ravnborg
  2015-03-28 18:16         ` David Miller
  2 siblings, 1 reply; 39+ messages in thread
From: David Ahern @ 2015-03-28  0:32 UTC (permalink / raw)
  To: Yinghai Lu; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

[-- Attachment #1: Type: text/plain, Size: 572 bytes --]

On 3/27/15 5:57 PM, Yinghai Lu wrote:
> On Fri, Mar 27, 2015 at 2:01 PM, Yinghai Lu <yinghai@kernel.org> wrote:
>> On Thu, Mar 26, 2015 at 4:27 PM, David Ahern <david.ahern@oracle.com> wrote:
>
>> Also please make sure your config have
>>
>> CONFIG_PCI_DEBUG=y
>>
>> and capture serial console with "debug ignore_loglevel", so we check if
>> pci 0000:00:01.0 really have resource assigned.
>
> Please check attached patch and send out boot log with above config.

patched applied. PCI_DEBUG enabled. options added. log attached. This is 
with d63e2e1f3df reverted still.


[-- Attachment #2: dmesg --]
[-- Type: text/plain, Size: 55660 bytes --]

PROMLIB: Sun IEEE Boot Prom 'OBP 4.36.2 2014/10/24 08:15'
PROMLIB: Root node compatible: sun4v
Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Initializing cgroup subsys cpuacct
Linux version 4.0.0-rc5+ (root@ca-qasparc24) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-4.0.9) (GCC) ) #2 SMP Fri Mar 27 20:12:10 EDT 2015
debug: skip boot console de-registration.
debug: ignoring loglevel setting.
bootconsole [earlyprom0] enabled
ARCH: SUN4V
Ethernet address: 00:10:e0:35:15:f6
MM: PAGE_OFFSET is 0xfff8000000000000 (max_phys_bits == 47)
MM: VMALLOC [0x0000000100000000 --> 0x0006000000000000]
MM: VMEMMAP [0x0006000000000000 --> 0x000c000000000000]
Kernel: Using 3 locked TLB entries for main kernel image.
Remapping the kernel... done.
OF stdout device is: /virtual-devices@100/console@1
PROM: Built device tree with 1478490 bytes of memory.
MDESC: Size is 774368 bytes.
PLATFORM: banner-name [SPARC T5-8]
PLATFORM: name [ORCL,SPARC-T5-8]
PLATFORM: hostid [863515f6]
PLATFORM: serial# [003515f6]
PLATFORM: stick-frequency [3b9aca00]
PLATFORM: mac-address [10e03515f6]
PLATFORM: watchdog-resolution [1000 ms]
PLATFORM: watchdog-max-timeout [31536000000 ms]
PLATFORM: max-cpus [1024]
Allocated 81920 bytes for kernel page tables.
Zone ranges:
  DMA      [mem 0x0000000030400000-0xffffffffffffffff]
  Normal   [mem 0x0000000000000000-0x0000383fffd11fff]
Movable zone start for each node
Early memory node ranges
  node   0: [mem 0x0000000030400000-0x0000003fddeeffff]
  node   0: [mem 0x0000003fddef6000-0x0000003fddef7fff]
  node   1: [mem 0x0000080000000000-0x0000083fffffffff]
  node   2: [mem 0x0000100000000000-0x0000103fffffffff]
  node   3: [mem 0x0000180000000000-0x0000183fffffffff]
  node   4: [mem 0x0000200000000000-0x0000203fffffffff]
  node   5: [mem 0x0000280000000000-0x0000283fffffffff]
  node   6: [mem 0x0000300000000000-0x0000303fffffffff]
  node   7: [mem 0x0000380000000000-0x0000383fffcddfff]
  node   7: [mem 0x0000383fffcee000-0x0000383fffd11fff]
Initmem setup node 0 [mem 0x0000000030400000-0x0000003fddef7fff]
On node 0 totalpages: 33385849
  Normal zone: 293431 pages used for memmap
  Normal zone: 33385849 pages, LIFO batch:15
Initmem setup node 1 [mem 0x0000080000000000-0x0000083fffffffff]
On node 1 totalpages: 33554432
  Normal zone: 294912 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
Initmem setup node 2 [mem 0x0000100000000000-0x0000103fffffffff]
On node 2 totalpages: 33554432
  Normal zone: 294912 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
Initmem setup node 3 [mem 0x0000180000000000-0x0000183fffffffff]
On node 3 totalpages: 33554432
  Normal zone: 294912 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
Initmem setup node 4 [mem 0x0000200000000000-0x0000203fffffffff]
On node 4 totalpages: 33554432
  Normal zone: 294912 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
Initmem setup node 5 [mem 0x0000280000000000-0x0000283fffffffff]
On node 5 totalpages: 33554432
  Normal zone: 294912 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
Initmem setup node 6 [mem 0x0000300000000000-0x0000303fffffffff]
On node 6 totalpages: 33554432
  Normal zone: 294912 pages used for memmap
  Normal zone: 33554432 pages, LIFO batch:15
Initmem setup node 7 [mem 0x0000380000000000-0x0000383fffd11fff]
On node 7 totalpages: 33554049
  Normal zone: 294909 pages used for memmap
  Normal zone: 33554049 pages, LIFO batch:15
Booting Linux...
CPU CAPS: [flush,stbar,swap,muldiv,v9,blkinit,n2,mul32]
CPU CAPS: [div32,v8plus,popc,vis,vis2,ASIBlkInit,fmaf,vis3]
CPU CAPS: [hpc,ima,pause,cbcond,aes,des,kasumi,camellia]
CPU CAPS: [md5,sha1,sha256,sha512,mpmul,montmul,montsqr,crc32c]
PERCPU: Embedded 8 pages/cpu @fff8003f4d000000 s27776 r8192 d29568 u65536
pcpu-alloc: s27776 r8192 d29568 u65536 alloc=1*4194304
pcpu-alloc: [0] 0000 0001 0002 0003 0004 0005 0006 0007 0008 0009 0010 0011 0012 0013 0014 0015 0016 0017 0018 0019 0020 0021 0022 0023 0024 0025 0026 0027 0028 0029 0030 0031 0032 0033 0034 0035 0036 0037 0038 0039 0040 0041 0042 0043 0044 0045 0046 0047 0048 0049 0050 0051 0052 0053 0054 0055 0056 0057 0058 0059 0060 0061 0062 0063 
pcpu-alloc: [0] 0064 0065 0066 0067 0068 0069 0070 0071 0072 0073 0074 0075 0076 0077 0078 0079 0080 0081 0082 0083 0084 0085 0086 0087 0088 0089 0090 0091 0092 0093 0094 0095 0096 0097 0098 0099 0100 0101 0102 0103 0104 0105 0106 0107 0108 0109 0110 0111 0112 0113 0114 0115 0116 0117 0118 0119 0120 0121 0122 0123 0124 0125 0126 0127 
pcpu-alloc: [1] 0128 0129 0130 0131 0132 0133 0134 0135 0136 0137 0138 0139 0140 0141 0142 0143 0144 0145 0146 0147 0148 0149 0150 0151 0152 0153 0154 0155 0156 0157 0158 0159 0160 0161 0162 0163 0164 0165 0166 0167 0168 0169 0170 0171 0172 0173 0174 0175 0176 0177 0178 0179 0180 0181 0182 0183 0184 0185 0186 0187 0188 0189 0190 0191 
pcpu-alloc: [1] 0192 0193 0194 0195 0196 0197 0198 0199 0200 0201 0202 0203 0204 0205 0206 0207 0208 0209 0210 0211 0212 0213 0214 0215 0216 0217 0218 0219 0220 0221 0222 0223 0224 0225 0226 0227 0228 0229 0230 0231 0232 0233 0234 0235 0236 0237 0238 0239 0240 0241 0242 0243 0244 0245 0246 0247 0248 0249 0250 0251 0252 0253 0254 0255 
pcpu-alloc: [2] 0256 0257 0258 0259 0260 0261 0262 0263 0264 0265 0266 0267 0268 0269 0270 0271 0272 0273 0274 0275 0276 0277 0278 0279 0280 0281 0282 0283 0284 0285 0286 0287 0288 0289 0290 0291 0292 0293 0294 0295 0296 0297 0298 0299 0300 0301 0302 0303 0304 0305 0306 0307 0308 0309 0310 0311 0312 0313 0314 0315 0316 0317 0318 0319 
pcpu-alloc: [2] 0320 0321 0322 0323 0324 0325 0326 0327 0328 0329 0330 0331 0332 0333 0334 0335 0336 0337 0338 0339 0340 0341 0342 0343 0344 0345 0346 0347 0348 0349 0350 0351 0352 0353 0354 0355 0356 0357 0358 0359 0360 0361 0362 0363 0364 0365 0366 0367 0368 0369 0370 0371 0372 0373 0374 0375 0376 0377 0378 0379 0380 0381 0382 0383 
pcpu-alloc: [3] 0384 0385 0386 0387 0388 0389 0390 0391 0392 0393 0394 0395 0396 0397 0398 0399 0400 0401 0402 0403 0404 0405 0406 0407 0408 0409 0410 0411 0412 0413 0414 0415 0416 0417 0418 0419 0420 0421 0422 0423 0424 0425 0426 0427 0428 0429 0430 0431 0432 0433 0434 0435 0436 0437 0438 0439 0440 0441 0442 0443 0444 0445 0446 0447 
pcpu-alloc: [3] 0448 0449 0450 0451 0452 0453 0454 0455 0456 0457 0458 0459 0460 0461 0462 0463 0464 0465 0466 0467 0468 0469 0470 0471 0472 0473 0474 0475 0476 0477 0478 0479 0480 0481 0482 0483 0484 0485 0486 0487 0488 0489 0490 0491 0492 0493 0494 0495 0496 0497 0498 0499 0500 0501 0502 0503 0504 0505 0506 0507 0508 0509 0510 0511 
pcpu-alloc: [4] 0512 0513 0514 0515 0516 0517 0518 0519 0520 0521 0522 0523 0524 0525 0526 0527 0528 0529 0530 0531 0532 0533 0534 0535 0536 0537 0538 0539 0540 0541 0542 0543 0544 0545 0546 0547 0548 0549 0550 0551 0552 0553 0554 0555 0556 0557 0558 0559 0560 0561 0562 0563 0564 0565 0566 0567 0568 0569 0570 0571 0572 0573 0574 0575 
pcpu-alloc: [4] 0576 0577 0578 0579 0580 0581 0582 0583 0584 0585 0586 0587 0588 0589 0590 0591 0592 0593 0594 0595 0596 0597 0598 0599 0600 0601 0602 0603 0604 0605 0606 0607 0608 0609 0610 0611 0612 0613 0614 0615 0616 0617 0618 0619 0620 0621 0622 0623 0624 0625 0626 0627 0628 0629 0630 0631 0632 0633 0634 0635 0636 0637 0638 0639 
pcpu-alloc: [5] 0640 0641 0642 0643 0644 0645 0646 0647 0648 0649 0650 0651 0652 0653 0654 0655 0656 0657 0658 0659 0660 0661 0662 0663 0664 0665 0666 0667 0668 0669 0670 0671 0672 0673 0674 0675 0676 0677 0678 0679 0680 0681 0682 0683 0684 0685 0686 0687 0688 0689 0690 0691 0692 0693 0694 0695 0696 0697 0698 0699 0700 0701 0702 0703 
pcpu-alloc: [5] 0704 0705 0706 0707 0708 0709 0710 0711 0712 0713 0714 0715 0716 0717 0718 0719 0720 0721 0722 0723 0724 0725 0726 0727 0728 0729 0730 0731 0732 0733 0734 0735 0736 0737 0738 0739 0740 0741 0742 0743 0744 0745 0746 0747 0748 0749 0750 0751 0752 0753 0754 0755 0756 0757 0758 0759 0760 0761 0762 0763 0764 0765 0766 0767 
pcpu-alloc: [6] 0768 0769 0770 0771 0772 0773 0774 0775 0776 0777 0778 0779 0780 0781 0782 0783 0784 0785 0786 0787 0788 0789 0790 0791 0792 0793 0794 0795 0796 0797 0798 0799 0800 0801 0802 0803 0804 0805 0806 0807 0808 0809 0810 0811 0812 0813 0814 0815 0816 0817 0818 0819 0820 0821 0822 0823 0824 0825 0826 0827 0828 0829 0830 0831 
pcpu-alloc: [6] 0832 0833 0834 0835 0836 0837 0838 0839 0840 0841 0842 0843 0844 0845 0846 0847 0848 0849 0850 0851 0852 0853 0854 0855 0856 0857 0858 0859 0860 0861 0862 0863 0864 0865 0866 0867 0868 0869 0870 0871 0872 0873 0874 0875 0876 0877 0878 0879 0880 0881 0882 0883 0884 0885 0886 0887 0888 0889 0890 0891 0892 0893 0894 0895 
pcpu-alloc: [7] 0896 0897 0898 0899 0900 0901 0902 0903 0904 0905 0906 0907 0908 0909 0910 0911 0912 0913 0914 0915 0916 0917 0918 0919 0920 0921 0922 0923 0924 0925 0926 0927 0928 0929 0930 0931 0932 0933 0934 0935 0936 0937 0938 0939 0940 0941 0942 0943 0944 0945 0946 0947 0948 0949 0950 0951 0952 0953 0954 0955 0956 0957 0958 0959 
pcpu-alloc: [7] 0960 0961 0962 0963 0964 0965 0966 0967 0968 0969 0970 0971 0972 0973 0974 0975 0976 0977 0978 0979 0980 0981 0982 0983 0984 0985 0986 0987 0988 0989 0990 0991 0992 0993 0994 0995 0996 0997 0998 0999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 
SUN4V: Mondo queue sizes [cpu(131072) dev(16384) r(8192) nr(256)]
Built 8 zonelists in Node order, mobility grouping on.  Total pages: 265908678
Policy zone: Normal
Kernel command line: root=/dev/mapper/VolGroup-lv_root ro rd_NO_LUKS LANG=en_US.UTF-8 rd_NO_MD rd_LVM_LV=VolGroup/lv_swap SYSFONT=latarcyrheb-sun16 rd_LVM_LV=VolGroup/lv_root KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM keep_bootcon debug ignore_loglevel
log_buf_len individual max cpu contribution: 4096 bytes
log_buf_len total cpu_extra contributions: 4190208 bytes
log_buf_len min size: 1048576 bytes
log_buf_len: 8388608 bytes
early log buf free: 1036920(98%)
PID hash table entries: 4096 (order: 2, 32768 bytes)
Sorting __ex_table...
Memory: 2127126200K/2146131920K available (5730K kernel code, 937K rwdata, 2488K rodata, 544K init, 2010K bss, 19005720K reserved, 0K cma-reserved)
Hierarchical RCU implementation.
NR_IRQS:2048 nr_irqs:2048 1
SUN4V: Using IRQ API major 3, cookie only virqs enabled
clocksource: mult[800000] shift[23]
clockevent: mult[80000000] shift[31]
Console: colour dummy device 80x25
console [tty0] enabled
Calibrating delay using timer specific routine.. 2001.25 BogoMIPS (lpj=4002516)
pid_max: default: 1048576 minimum: 8192
Security Framework initialized
SELinux:  Initializing.
SELinux:  Starting in permissive mode
Dentry cache hash table entries: 268435456 (order: 18, 2147483648 bytes)
Inode-cache hash table entries: 134217728 (order: 17, 1073741824 bytes)
Mount-cache hash table entries: 4194304 (order: 12, 33554432 bytes)
Mountpoint-cache hash table entries: 4194304 (order: 12, 33554432 bytes)
Initializing cgroup subsys blkio
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys perf_event
Initializing cgroup subsys hugetlb
ftrace: allocating 20541 entries in 41 pages
Brought up 1024 CPUs
devtmpfs: initialized
Performance events: 
Testing NMI watchdog ... OK.
Supported PMU type is 'niagara5'
ldc.c:v1.1 (July 22, 2008)
NET: Registered protocol family 16
VIO: Adding device channel-devices
VIO: Adding device vldc-port-0-0
VIO: Adding device vldc-port-0-1
VIO: Adding device vldc-port-0-2
VIO: Adding device vldc-port-1-0
VIO: Adding device vldc-port-2-0
VIO: Adding device vldc-port-3-0
VIO: Adding device vldc-port-3-1
VIO: Adding device vldc-port-3-4
VIO: Adding device vldc-port-3-3
VIO: Adding device vlds-port-0-0
VIO: Adding device ds-0
VIO: Adding device ds-1
pci_sun4v: Registered hvapi major[1] minor[0]
/pci@300: SUN4V PCI Bus Module
/pci@300: On NUMA node -1
/pci@300: PCI IO[804000000000] MEM[800000000000]
/pci@300: Unable to request IOMMU resource.
/pci@300: Imported 26 TSB entries from OBP
/pci@300: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@300: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@300: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@300: MSI queues at RA [0000383f51000000]
PCI: Scanning PBM /pci@300
pci_sun4v f02dbcfc: PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x804000000000-0x80400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0000:00: root bus resource [mem 0x800000000000-0x80007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0000:00: root bus resource [bus 00-77]
pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
pci 0000:00:01.0: PME# disabled
pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
pci 0000:01:00.0: PME# disabled
pci 0000:02:04.0: PME# supported from D0 D3hot D3cold
pci 0000:02:04.0: PME# disabled
pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
pci 0000:03:00.0: PME# disabled
pci 0000:04:06.0: PME# supported from D0 D3hot D3cold
pci 0000:04:06.0: PME# disabled
pci 0000:05:00.0: PME# supported from D0 D3hot D3cold
pci 0000:05:00.0: PME# disabled
pci 0000:04:08.0: PME# supported from D0 D3hot D3cold
pci 0000:04:08.0: PME# disabled
pci 0000:06:00.0: PME# supported from D0 D3hot D3cold
pci 0000:06:00.0: PME# disabled
pci 0000:06:00.0: reg 0x184: [mem 0x110204000-0x110207fff 64bit]
pci 0000:06:00.0: reg 0x190: [mem 0x110304000-0x110307fff 64bit]
pci 0000:06:00.1: PME# supported from D0 D3hot D3cold
pci 0000:06:00.1: PME# disabled
pci 0000:06:00.1: reg 0x184: [mem 0x110408000-0x11040bfff 64bit]
pci 0000:06:00.1: reg 0x190: [mem 0x110800000-0x110803fff 64bit]
pci 0000:04:0c.0: PME# supported from D0 D3hot D3cold
pci 0000:04:0c.0: PME# disabled
pci 0000:07:00.0: supports D1 D2
pci 0000:02:06.0: PME# supported from D0 D3hot D3cold
pci 0000:02:06.0: PME# disabled
pci 0000:00:01.0: can't claim BAR 15 [mem 0x100000000-0x4afffffff pref]: no compatible bridge window
pci 0000:00:01.0: can't claim BAR 15 [mem 0x100000000-0x4afffffff pref]: no compatible bridge window
pci 0000:05:00.0: can't claim BAR 0 [mem 0x800100000000-0x800100001fff]: no compatible bridge window
pci 0000:06:00.0: can't claim BAR 0 [mem 0x800110000000-0x8001101fffff pref]: no compatible bridge window
pci 0000:06:00.0: can't claim BAR 4 [mem 0x800110200000-0x800110203fff pref]: no compatible bridge window
pci 0000:06:00.0: can't claim BAR 7 [mem 0x110204000-0x110303fff 64bit]: no compatible bridge window
pci 0000:06:00.0: can't claim BAR 10 [mem 0x110304000-0x110403fff 64bit]: no compatible bridge window
pci 0000:06:00.1: can't claim BAR 0 [mem 0x800110600000-0x8001107fffff pref]: no compatible bridge window
pci 0000:06:00.1: can't claim BAR 4 [mem 0x800110404000-0x800110407fff pref]: no compatible bridge window
pci 0000:06:00.1: can't claim BAR 7 [mem 0x110408000-0x110507fff 64bit]: no compatible bridge window
pci 0000:06:00.1: can't claim BAR 10 [mem 0x110800000-0x1108fffff 64bit]: no compatible bridge window
pci 0000:07:00.0: can't claim BAR 1 [mem 0x800120000000-0x80012000ffff]: no compatible bridge window
pci 0000:07:00.0: can't claim BAR 3 [mem 0x800120040000-0x80012007ffff]: no compatible bridge window
/pci@340: SUN4V PCI Bus Module
/pci@340: On NUMA node -1
/pci@340: PCI IO[804100000000] MEM[801000000000]
/pci@340: Unable to request IOMMU resource.
/pci@340: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@340: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@340: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@340: MSI queues at RA [0000283f52000000]
PCI: Scanning PBM /pci@340
pci_sun4v f02eab24: PCI host bridge to bus 0001:00
pci_bus 0001:00: root bus resource [io  0x804100000000-0x80410fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0001:00: root bus resource [mem 0x801000000000-0x80107effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0001:00: root bus resource [bus 00-e2]
pci 0001:00:01.0: PME# supported from D0 D3hot D3cold
pci 0001:00:01.0: PME# disabled
pci 0001:01:00.0: PME# supported from D0 D3hot D3cold
pci 0001:01:00.0: PME# disabled
pci 0001:02:06.0: PME# supported from D0 D3hot D3cold
pci 0001:02:06.0: PME# disabled
pci 0001:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
pci 0001:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
/pci@380: SUN4V PCI Bus Module
/pci@380: On NUMA node -1
/pci@380: PCI IO[80c000000000] MEM[808000000000]
/pci@380: Unable to request IOMMU resource.
/pci@380: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@380: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@380: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@380: MSI queues at RA [0000103f52200000]
PCI: Scanning PBM /pci@380
pci_sun4v f02f994c: PCI host bridge to bus 0002:00
pci_bus 0002:00: root bus resource [io  0x80c000000000-0x80c00fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0002:00: root bus resource [mem 0x808000000000-0x80807effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0002:00: root bus resource [bus 00-e2]
pci 0002:00:01.0: PME# supported from D0 D3hot D3cold
pci 0002:00:01.0: PME# disabled
pci 0002:01:00.0: PME# supported from D0 D3hot D3cold
pci 0002:01:00.0: PME# disabled
pci 0002:02:0a.0: PME# supported from D0 D3hot D3cold
pci 0002:02:0a.0: PME# disabled
pci 0002:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
pci 0002:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
pci 0002:03:00.0: can't claim BAR 1 [mem 0x808100000000-0x808100003fff]: no compatible bridge window
pci 0002:03:00.1: can't claim BAR 1 [mem 0x808100004000-0x808100007fff]: no compatible bridge window
/pci@3c0: SUN4V PCI Bus Module
/pci@3c0: On NUMA node -1
/pci@3c0: PCI IO[80c100000000] MEM[809000000000]
/pci@3c0: Unable to request IOMMU resource.
/pci@3c0: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@3c0: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@3c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@3c0: MSI queues at RA [0000383f50a00000]
PCI: Scanning PBM /pci@3c0
pci_sun4v f0308774: PCI host bridge to bus 0003:00
pci_bus 0003:00: root bus resource [io  0x80c100000000-0x80c10fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0003:00: root bus resource [mem 0x809000000000-0x80907effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0003:00: root bus resource [bus 00-e2]
pci 0003:00:01.0: PME# supported from D0 D3hot D3cold
pci 0003:00:01.0: PME# disabled
pci 0003:01:00.0: PME# supported from D0 D3hot D3cold
pci 0003:01:00.0: PME# disabled
pci 0003:02:0e.0: PME# supported from D0 D3hot D3cold
pci 0003:02:0e.0: PME# disabled
pci 0003:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
pci 0003:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
/pci@400: SUN4V PCI Bus Module
/pci@400: On NUMA node -1
/pci@400: PCI IO[814000000000] MEM[810000000000]
/pci@400: Unable to request IOMMU resource.
/pci@400: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@400: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@400: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@400: MSI queues at RA [0000203f52200000]
PCI: Scanning PBM /pci@400
pci_sun4v f031759c: PCI host bridge to bus 0004:00
pci_bus 0004:00: root bus resource [io  0x814000000000-0x81400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0004:00: root bus resource [mem 0x810000000000-0x81007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0004:00: root bus resource [bus 00-72]
pci 0004:00:01.0: PME# supported from D0 D3hot D3cold
pci 0004:00:01.0: PME# disabled
pci 0004:01:00.0: PME# supported from D0 D3hot D3cold
pci 0004:01:00.0: PME# disabled
pci 0004:02:0c.0: PME# supported from D0 D3hot D3cold
pci 0004:02:0c.0: PME# disabled
pci 0004:00:01.0: can't claim BAR 15 [mem 0x100000000-0x47fffffff pref]: no compatible bridge window
pci 0004:00:01.0: can't claim BAR 15 [mem 0x100000000-0x47fffffff pref]: no compatible bridge window
/pci@440: SUN4V PCI Bus Module
/pci@440: On NUMA node -1
/pci@440: PCI IO[814100000000] MEM[811000000000]
/pci@440: Unable to request IOMMU resource.
/pci@440: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@440: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@440: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@440: MSI queues at RA [0000103f52400000]
PCI: Scanning PBM /pci@440
pci_sun4v f03263c4: PCI host bridge to bus 0005:00
pci_bus 0005:00: root bus resource [io  0x814100000000-0x81410fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0005:00: root bus resource [mem 0x811000000000-0x81107effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0005:00: root bus resource [bus 00-e2]
pci 0005:00:01.0: PME# supported from D0 D3hot D3cold
pci 0005:00:01.0: PME# disabled
pci 0005:01:00.0: PME# supported from D0 D3hot D3cold
pci 0005:01:00.0: PME# disabled
pci 0005:02:0c.0: PME# supported from D0 D3hot D3cold
pci 0005:02:0c.0: PME# disabled
pci 0005:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
pci 0005:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
/pci@480: SUN4V PCI Bus Module
/pci@480: On NUMA node -1
/pci@480: PCI IO[81c000000000] MEM[818000000000]
/pci@480: Unable to request IOMMU resource.
/pci@480: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@480: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@480: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@480: MSI queues at RA [0000383f50c00000]
PCI: Scanning PBM /pci@480
pci_sun4v f03351ec: PCI host bridge to bus 0006:00
pci_bus 0006:00: root bus resource [io  0x81c000000000-0x81c00fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0006:00: root bus resource [mem 0x818000000000-0x81807effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0006:00: root bus resource [bus 00-e2]
pci 0006:00:01.0: PME# supported from D0 D3hot D3cold
pci 0006:00:01.0: PME# disabled
pci 0006:01:00.0: PME# supported from D0 D3hot D3cold
pci 0006:01:00.0: PME# disabled
pci 0006:02:04.0: PME# supported from D0 D3hot D3cold
pci 0006:02:04.0: PME# disabled
pci 0006:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
pci 0006:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
/pci@4c0: SUN4V PCI Bus Module
/pci@4c0: On NUMA node -1
/pci@4c0: PCI IO[81c100000000] MEM[819000000000]
/pci@4c0: Unable to request IOMMU resource.
/pci@4c0: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@4c0: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@4c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@4c0: MSI queues at RA [0000203f52400000]
PCI: Scanning PBM /pci@4c0
pci_sun4v f0344014: PCI host bridge to bus 0007:00
pci_bus 0007:00: root bus resource [io  0x81c100000000-0x81c10fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0007:00: root bus resource [mem 0x819000000000-0x81907effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0007:00: root bus resource [bus 00-e2]
pci 0007:00:01.0: PME# supported from D0 D3hot D3cold
pci 0007:00:01.0: PME# disabled
pci 0007:01:00.0: PME# supported from D0 D3hot D3cold
pci 0007:01:00.0: PME# disabled
pci 0007:02:08.0: PME# supported from D0 D3hot D3cold
pci 0007:02:08.0: PME# disabled
pci 0007:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
pci 0007:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
/pci@500: SUN4V PCI Bus Module
/pci@500: On NUMA node -1
/pci@500: PCI IO[824000000000] MEM[820000000000]
/pci@500: Unable to request IOMMU resource.
/pci@500: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@500: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@500: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@500: MSI queues at RA [0000103f52600000]
PCI: Scanning PBM /pci@500
pci_sun4v f0352e3c: PCI host bridge to bus 0008:00
pci_bus 0008:00: root bus resource [io  0x824000000000-0x82400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0008:00: root bus resource [mem 0x820000000000-0x82007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0008:00: root bus resource [bus 00-e2]
pci 0008:00:01.0: PME# supported from D0 D3hot D3cold
pci 0008:00:01.0: PME# disabled
pci 0008:01:00.0: PME# supported from D0 D3hot D3cold
pci 0008:01:00.0: PME# disabled
pci 0008:02:0e.0: PME# supported from D0 D3hot D3cold
pci 0008:02:0e.0: PME# disabled
pci 0008:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
pci 0008:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
/pci@540: SUN4V PCI Bus Module
/pci@540: On NUMA node -1
/pci@540: PCI IO[824100000000] MEM[821000000000]
/pci@540: Unable to request IOMMU resource.
/pci@540: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@540: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@540: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@540: MSI queues at RA [0000303f52000000]
PCI: Scanning PBM /pci@540
pci_sun4v f0361c64: PCI host bridge to bus 0009:00
pci_bus 0009:00: root bus resource [io  0x824100000000-0x82410fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0009:00: root bus resource [mem 0x821000000000-0x82107effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0009:00: root bus resource [bus 00-e2]
pci 0009:00:01.0: PME# supported from D0 D3hot D3cold
pci 0009:00:01.0: PME# disabled
pci 0009:01:00.0: PME# supported from D0 D3hot D3cold
pci 0009:01:00.0: PME# disabled
pci 0009:02:0e.0: PME# supported from D0 D3hot D3cold
pci 0009:02:0e.0: PME# disabled
pci 0009:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
pci 0009:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
/pci@580: SUN4V PCI Bus Module
/pci@580: On NUMA node -1
/pci@580: PCI IO[82c000000000] MEM[828000000000]
/pci@580: Unable to request IOMMU resource.
/pci@580: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@580: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@580: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@580: MSI queues at RA [0000203f52600000]
PCI: Scanning PBM /pci@580
pci_sun4v f0370a8c: PCI host bridge to bus 000a:00
pci_bus 000a:00: root bus resource [io  0x82c000000000-0x82c00fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000a:00: root bus resource [mem 0x828000000000-0x82807effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000a:00: root bus resource [bus 00-e2]
pci 000a:00:01.0: PME# supported from D0 D3hot D3cold
pci 000a:00:01.0: PME# disabled
pci 000a:01:00.0: PME# supported from D0 D3hot D3cold
pci 000a:01:00.0: PME# disabled
pci 000a:02:0a.0: PME# supported from D0 D3hot D3cold
pci 000a:02:0a.0: PME# disabled
pci 000a:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
pci 000a:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
/pci@5c0: SUN4V PCI Bus Module
/pci@5c0: On NUMA node -1
/pci@5c0: PCI IO[82c100000000] MEM[829000000000]
/pci@5c0: Unable to request IOMMU resource.
/pci@5c0: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@5c0: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@5c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@5c0: MSI queues at RA [0000083f52c00000]
PCI: Scanning PBM /pci@5c0
pci_sun4v f037f8b4: PCI host bridge to bus 000b:00
pci_bus 000b:00: root bus resource [io  0x82c100000000-0x82c10fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000b:00: root bus resource [mem 0x829000000000-0x82907effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000b:00: root bus resource [bus 00-72]
pci 000b:00:01.0: PME# supported from D0 D3hot D3cold
pci 000b:00:01.0: PME# disabled
pci 000b:01:00.0: PME# supported from D0 D3hot D3cold
pci 000b:01:00.0: PME# disabled
pci 000b:02:08.0: PME# supported from D0 D3hot D3cold
pci 000b:02:08.0: PME# disabled
pci 000b:00:01.0: can't claim BAR 15 [mem 0x100000000-0x47fffffff pref]: no compatible bridge window
pci 000b:00:01.0: can't claim BAR 15 [mem 0x100000000-0x47fffffff pref]: no compatible bridge window
/pci@600: SUN4V PCI Bus Module
/pci@600: On NUMA node -1
/pci@600: PCI IO[834000000000] MEM[830000000000]
/pci@600: Unable to request IOMMU resource.
/pci@600: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@600: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@600: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@600: MSI queues at RA [0000383f50e00000]
PCI: Scanning PBM /pci@600
pci_sun4v f038e6dc: PCI host bridge to bus 000c:00
pci_bus 000c:00: root bus resource [io  0x834000000000-0x83400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000c:00: root bus resource [mem 0x830000000000-0x83007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000c:00: root bus resource [bus 00-e2]
pci 000c:00:01.0: PME# supported from D0 D3hot D3cold
pci 000c:00:01.0: PME# disabled
pci 000c:01:00.0: PME# supported from D0 D3hot D3cold
pci 000c:01:00.0: PME# disabled
pci 000c:02:08.0: PME# supported from D0 D3hot D3cold
pci 000c:02:08.0: PME# disabled
pci 000c:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
pci 000c:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
/pci@640: SUN4V PCI Bus Module
/pci@640: On NUMA node -1
/pci@640: PCI IO[834100000000] MEM[831000000000]
/pci@640: Unable to request IOMMU resource.
/pci@640: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@640: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@640: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@640: MSI queues at RA [0000283f52200000]
PCI: Scanning PBM /pci@640
pci_sun4v f039d504: PCI host bridge to bus 000d:00
pci_bus 000d:00: root bus resource [io  0x834100000000-0x83410fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000d:00: root bus resource [mem 0x831000000000-0x83107effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000d:00: root bus resource [bus 00-e2]
pci 000d:00:01.0: PME# supported from D0 D3hot D3cold
pci 000d:00:01.0: PME# disabled
pci 000d:01:00.0: PME# supported from D0 D3hot D3cold
pci 000d:01:00.0: PME# disabled
pci 000d:02:08.0: PME# supported from D0 D3hot D3cold
pci 000d:02:08.0: PME# disabled
pci 000d:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
pci 000d:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
pci 000d:03:00.0: can't claim BAR 0 [mem 0x831100000000-0x831100001fff]: no compatible bridge window
pci 000d:03:00.0: can't claim BAR 2 [mem 0x831100004000-0x831100007fff]: no compatible bridge window
pci 000d:03:00.1: can't claim BAR 0 [mem 0x831100002000-0x831100003fff]: no compatible bridge window
pci 000d:03:00.1: can't claim BAR 2 [mem 0x831100008000-0x83110000bfff]: no compatible bridge window
/pci@680: SUN4V PCI Bus Module
/pci@680: On NUMA node -1
/pci@680: PCI IO[83c000000000] MEM[838000000000]
/pci@680: Unable to request IOMMU resource.
/pci@680: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@680: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@680: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@680: MSI queues at RA [0000003f22e00000]
PCI: Scanning PBM /pci@680
pci_sun4v f03ac32c: PCI host bridge to bus 000e:00
pci_bus 000e:00: root bus resource [io  0x83c000000000-0x83c00fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000e:00: root bus resource [mem 0x838000000000-0x83807effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000e:00: root bus resource [bus 00-e2]
pci 000e:00:01.0: PME# supported from D0 D3hot D3cold
pci 000e:00:01.0: PME# disabled
pci 000e:01:00.0: PME# supported from D0 D3hot D3cold
pci 000e:01:00.0: PME# disabled
pci 000e:02:04.0: PME# supported from D0 D3hot D3cold
pci 000e:02:04.0: PME# disabled
pci 000e:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
pci 000e:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
/pci@6c0: SUN4V PCI Bus Module
/pci@6c0: On NUMA node -1
/pci@6c0: PCI IO[83c100000000] MEM[839000000000]
/pci@6c0: Unable to request IOMMU resource.
/pci@6c0: Imported 13 TSB entries from OBP
/pci@6c0: MSI Queue first[0] num[56] count[512] devino[0x6]
/pci@6c0: MSI first[0] num[512] mask[0x3ff] width[32]
/pci@6c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
/pci@6c0: MSI queues at RA [0000303f52200000]
PCI: Scanning PBM /pci@6c0
pci_sun4v f03bb154: PCI host bridge to bus 000f:00
pci_bus 000f:00: root bus resource [io  0x83c100000000-0x83c10fffffff] (bus address [0x0000-0xfffffff])
pci_bus 000f:00: root bus resource [mem 0x839000000000-0x83907effffff] (bus address [0x00000000-0x7effffff])
pci_bus 000f:00: root bus resource [bus 00-78]
pci 000f:00:01.0: PME# supported from D0 D3hot D3cold
pci 000f:00:01.0: PME# disabled
pci 000f:01:00.0: PME# supported from D0 D3hot D3cold
pci 000f:01:00.0: PME# disabled
pci 000f:02:04.0: PME# supported from D0 D3hot D3cold
pci 000f:02:04.0: PME# disabled
pci 000f:02:0c.0: PME# supported from D0 D3hot D3cold
pci 000f:02:0c.0: PME# disabled
pci 000f:73:00.0: PME# supported from D0 D3hot D3cold
pci 000f:73:00.0: PME# disabled
pci 000f:74:04.0: PME# supported from D0 D3hot D3cold
pci 000f:74:04.0: PME# disabled
pci 000f:75:00.0: PME# supported from D0 D3hot D3cold
pci 000f:75:00.0: PME# disabled
pci 000f:75:00.0: reg 0x184: [mem 0x480204000-0x480207fff 64bit]
pci 000f:75:00.0: reg 0x190: [mem 0x480304000-0x480307fff 64bit]
pci 000f:75:00.1: PME# supported from D0 D3hot D3cold
pci 000f:75:00.1: PME# disabled
pci 000f:75:00.1: reg 0x184: [mem 0x480408000-0x48040bfff 64bit]
pci 000f:75:00.1: reg 0x190: [mem 0x480800000-0x480803fff 64bit]
pci 000f:74:06.0: PME# supported from D0 D3hot D3cold
pci 000f:74:06.0: PME# disabled
pci 000f:76:00.0: PME# supported from D0 D3hot D3cold
pci 000f:76:00.0: PME# disabled
pci 000f:74:07.0: PME# supported from D0 D3hot D3cold
pci 000f:74:07.0: PME# disabled
pci 000f:74:0c.0: PME# supported from D0 D3hot D3cold
pci 000f:74:0c.0: PME# disabled
pci 000f:78:00.0: supports D1 D2
pci 000f:00:01.0: can't claim BAR 15 [mem 0x100000000-0x4afffffff pref]: no compatible bridge window
pci 000f:00:01.0: can't claim BAR 15 [mem 0x100000000-0x4afffffff pref]: no compatible bridge window
pci 000f:75:00.0: can't claim BAR 0 [mem 0x839480000000-0x8394801fffff pref]: no compatible bridge window
pci 000f:75:00.0: can't claim BAR 4 [mem 0x839480200000-0x839480203fff pref]: no compatible bridge window
pci 000f:75:00.0: can't claim BAR 7 [mem 0x480204000-0x480303fff 64bit]: no compatible bridge window
pci 000f:75:00.0: can't claim BAR 10 [mem 0x480304000-0x480403fff 64bit]: no compatible bridge window
pci 000f:75:00.1: can't claim BAR 0 [mem 0x839480600000-0x8394807fffff pref]: no compatible bridge window
pci 000f:75:00.1: can't claim BAR 4 [mem 0x839480404000-0x839480407fff pref]: no compatible bridge window
pci 000f:75:00.1: can't claim BAR 7 [mem 0x480408000-0x480507fff 64bit]: no compatible bridge window
pci 000f:75:00.1: can't claim BAR 10 [mem 0x480800000-0x4808fffff 64bit]: no compatible bridge window
pci 000f:76:00.0: can't claim BAR 0 [mem 0x839490000000-0x839490001fff]: no compatible bridge window
pci 000f:78:00.0: can't claim BAR 1 [mem 0x8394a0000000-0x8394a000ffff]: no compatible bridge window
pci 000f:78:00.0: can't claim BAR 3 [mem 0x8394a0040000-0x8394a007ffff]: no compatible bridge window
vgaarb: device added: PCI:000f:77:00.0,decodes=io+mem,owns=none,locks=none
vgaarb: loaded
vgaarb: bridge control possible 000f:77:00.0
SCSI subsystem initialized
libata version 3.00 loaded.
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
SUN4V: Reboot data supported (maj=1,min=0).
ds.c:v1.0 (Jul 11, 2007)
Switched to clocksource stick
ds-1: Registered pri service.
ds-1: Registered var-config-backup service.
NET: Registered protocol family 2
TCP established hash table entries: 524288 (order: 9, 4194304 bytes)
TCP bind hash table entries: 65536 (order: 7, 1048576 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
TCP: reno registered
UDP hash table entries: 65536 (order: 8, 2097152 bytes)
UDP-Lite hash table entries: 65536 (order: 8, 2097152 bytes)
NET: Registered protocol family 1
pci 0000:05:00.0: calling quirk_usb_early_handoff+0x0/0x220
pci 0000:05:00.0: xHCI BIOS handoff failed (BIOS bug ?) 00010401
pci 0000:06:00.0: calling quirk_e100_interrupt+0x0/0x220
pci 0000:06:00.1: calling quirk_e100_interrupt+0x0/0x220
pci 000f:75:00.0: calling quirk_e100_interrupt+0x0/0x220
pci 000f:75:00.1: calling quirk_e100_interrupt+0x0/0x220
pci 000f:76:00.0: calling quirk_usb_early_handoff+0x0/0x220
pci 000f:76:00.0: xHCI BIOS handoff failed (BIOS bug ?) 00010401
PCI: CLS mismatch (64 != 512), using 64 bytes
Trying to unpack rootfs image as initramfs...
Freeing initrd memory: 7456K (fff8380004000000 - fff8380004748000)
futex hash table entries: 262144 (order: 11, 16777216 bytes)
Initialise system trusted keyring
audit: initializing netlink subsys (disabled)
audit: type=2000 audit(18.252:1): initialized
HugeTLB registered 8 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.2
VFS: Dquot-cache hash table entries: 1024 (order 0, 8192 bytes)
SELinux:  Registering netfilter hooks
alg: No test for stdrng (krng)
Key type asymmetric registered
Asymmetric key parser 'x509' registered
bounce: pool size: 64 pages
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
io scheduler noop registered
io scheduler deadline registered (default)
io scheduler cfq registered
f0290cf4: ttyS0 at I/O 0x0 (irq = 1, base_baud = 115200) is a SUN4V HCONS
console [ttyHV0] enabled
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
brd: module loaded
loop: module loaded
zram: Created 1 device(s)
libphy: Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci-pci: EHCI PCI platform driver
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
ohci-pci: OHCI PCI platform driver
uhci_hcd: USB Universal Host Controller Interface driver
mousedev: PS/2 mouse device common for all mice
rtc-sun4v rtc-sun4v: rtc core: registered sun4v as rtc0
hidraw: raw HID events driver (C) Jiri Kosina
usbcore: registered new interface driver usbhid
usbhid: USB HID core driver
drop_monitor: Initializing network drop monitor service
TCP: cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
Key type dns_resolver registered
Loading compiled-in X.509 certificates
Loaded X.509 cert 'Magrathea: Glacier signing key: 0ec1e3ae3ed5a95c3d5d67431d9bd97634dafbd8'
registered taskstats version 1
ima: No TPM chip found, activating TPM-bypass!
rtc-sun4v rtc-sun4v: setting system clock to 2015-03-28 00:31:15 UTC (1427502675)
dracut: dracut-004-336.0.2.el6_5.2
dracut: rd_NO_LUKS: removing cryptoluks activation
dm_mod: module verification failed: signature and/or required key missing - tainting kernel
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.30.0-ioctl (2014-12-22) initialised: dm-devel@redhat.com
udev: starting version 147
dracut: Starting plymouth daemon
sha256_sparc64: Using sparc64 sha256 opcode optimized SHA-256/SHA-224 implementation
aes_sparc64: Using sparc64 aes opcodes optimized AES implementation
qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.16-k.
qla2xxx [0002:03:00.0]-001d: : Found an ISP2532 irq 11 iobase 0x0000808100000000.
qla2xxx 0002:03:00.0: enabling Mem-Wr-Inval
scsi host0: qla2xxx
qla2xxx [0002:03:00.0]-00fb:0: QLogic QLE2562 - Sun StorageTek 8Gb FC PCIe HBA, dual port.
qla2xxx [0002:03:00.0]-00fc:0: ISP2532: PCIe (2.5GT/s x8) @ 0002:03:00.0 hdma- host#=0 fw=7.03.00 (90d5).
qla2xxx [0002:03:00.0]-500a:0: LOOP UP detected (8 Gbps).
qla2xxx [0002:03:00.1]-001d: : Found an ISP2532 irq 12 iobase 0x0000808100004000.
qla2xxx 0002:03:00.1: enabling Mem-Wr-Inval
qla2xxx [0002:03:00.0]-2064:0: SNS scan failed -- assuming zero-entry result.
scsi host1: qla2xxx
qla2xxx [0002:03:00.1]-00fb:1: QLogic QLE2562 - Sun StorageTek 8Gb FC PCIe HBA, dual port.
qla2xxx [0002:03:00.1]-00fc:1: ISP2532: PCIe (2.5GT/s x8) @ 0002:03:00.1 hdma- host#=1 fw=7.03.00 (90d5).
Emulex LightPulse Fibre Channel SCSI driver 10.4.8000.0.
Copyright(c) 2004-2014 Emulex.  All rights reserved.
lpfc 000d:03:00.0: enabling Mem-Wr-Inval
scsi host2: Emulex LPe12000-S PCIe Fibre Channel Adapter  on PCI bus 03 device 00 irq 35
lpfc 000d:03:00.1: enabling Mem-Wr-Inval
scsi host3: Emulex LPe12000-S PCIe Fibre Channel Adapter  on PCI bus 03 device 01 irq 36
mpt2sas version 20.100.00.00 loaded
mpt2sas 0000:07:00.0: enabling bus mastering
mpt2sas0: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (2127134200 kB)
mpt2sas0: MSI-X vectors supported: 8, no of cores: 1024, max_msix_vectors: 8
mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 973
mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 974
mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 975
mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 976
mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 977
mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 978
mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 979
mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 980
mpt2sas0: iomem(0x0000800120000000), mapped(0x0000800120000000), size(65536)
mpt2sas0: ioport(0x0000804000001000), size(256)
mpt2sas0: Allocated physical memory: size(4603 kB)
mpt2sas0: Current Controller Queue Depth(2811), Max Controller Queue Depth(3072)
mpt2sas0: Scatter Gather Elements per IO(128)
mpt2sas0: LSISAS2308: FWVersion(14.00.00.00), ChipRevision(0x05), BiosVersion(00.00.00.00)
mpt2sas0: Protocol=(Initiator), Capabilities=(Raid,TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
scsi host4: Fusion MPT SAS Host
mpt2sas0: sending port enable !!
mpt2sas1: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (2127134200 kB)
mpt2sas1: MSI-X vectors supported: 8, no of cores: 1024, max_msix_vectors: 8
mpt2sas1-msix0: PCI-MSI-X enabled: IRQ 981
mpt2sas1-msix1: PCI-MSI-X enabled: IRQ 982
mpt2sas1-msix2: PCI-MSI-X enabled: IRQ 983
mpt2sas1-msix3: PCI-MSI-X enabled: IRQ 984
mpt2sas1-msix4: PCI-MSI-X enabled: IRQ 985
mpt2sas1-msix5: PCI-MSI-X enabled: IRQ 986
mpt2sas1-msix6: PCI-MSI-X enabled: IRQ 987
mpt2sas1-msix7: PCI-MSI-X enabled: IRQ 988
mpt2sas1: iomem(0x00008394a0000000), mapped(0x00008394a0000000), size(65536)
mpt2sas1: ioport(0x000083c104001000), size(256)
mpt2sas1: Allocated physical memory: size(4603 kB)
mpt2sas1: Current Controller Queue Depth(2811), Max Controller Queue Depth(3072)
mpt2sas1: Scatter Gather Elements per IO(128)
mpt2sas0: host_add: handle(0x0001), sas_addr(0x508002000159c0d0), phys(8)
mpt2sas1: LSISAS2308: FWVersion(14.00.00.00), ChipRevision(0x05), BiosVersion(00.00.00.00)
mpt2sas1: Protocol=(Initiator), Capabilities=(Raid,TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
scsi host5: Fusion MPT SAS Host
mpt2sas1: sending port enable !!
mpt2sas1: host_add: handle(0x0001), sas_addr(0x508002000159c0d1), phys(8)
mpt2sas0: port enable: SUCCESS
scsi 4:0:0:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 4:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0163295b1), phy(1), device_name(0x5000cca0163295b3)
scsi 4:0:0:0: SSP: enclosure_logical_id(0x508002000159c0d0), slot(1)
scsi 4:0:1:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 4:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca0162a4c1d), phy(2), device_name(0x5000cca0162a4c1f)
qla2xxx [0002:03:00.1]-8038:1: Cable is unplugged...
scsi 4:0:1:0: SSP: enclosure_logical_id(0x508002000159c0d0), slot(2)
mpt2sas1: port enable: SUCCESS
scsi 5:0:0:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 5:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0162f2e39), phy(0), device_name(0x5000cca0162f2e3b)
scsi 5:0:0:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(0)
scsi 5:0:1:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 5:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca016322ee5), phy(1), device_name(0x5000cca016322ee7)
scsi 5:0:1:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(1)
scsi 5:0:2:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
scsi 5:0:2:0: SSP: handle(0x000b), sas_addr(0x5000cca016322f71), phy(2), device_name(0x5000cca016322f73)
scsi 5:0:2:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(2)
sd 4:0:0:0: [sda] Enabling DIF Type 1 protection
sd 4:0:1:0: [sdb] Enabling DIF Type 1 protection
sd 4:0:1:0: [sdb] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 5:0:0:0: [sdc] Enabling DIF Type 1 protection
sd 5:0:0:0: [sdc] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 5:0:1:0: [sdd] Enabling DIF Type 1 protection
sd 5:0:1:0: [sdd] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 5:0:2:0: [sde] Enabling DIF Type 1 protection
sd 5:0:2:0: [sde] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 4:0:1:0: [sdb] Write Protect is off
sd 4:0:1:0: [sdb] Mode Sense: e7 00 10 08
sd 5:0:0:0: [sdc] Write Protect is off
sd 5:0:0:0: [sdc] Mode Sense: e7 00 10 08
sd 5:0:1:0: [sdd] Write Protect is off
sd 5:0:1:0: [sdd] Mode Sense: e7 00 10 08
sd 5:0:2:0: [sde] Write Protect is off
sd 5:0:2:0: [sde] Mode Sense: e7 00 10 08
sd 4:0:1:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 5:0:0:0: [sdc] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 5:0:1:0: [sdd] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 5:0:2:0: [sde] Write cache: disabled, read cache: enabled, supports DPO and FUA
 sde: sde1 sde2 sde3
 sdd: sdd1 sdd2 sdd3 sdd7
random: nonblocking pool is initialized
 sdb: sdb1 sdb2 sdb3 sdb7
 sdc: sdc1 sdc2 sdc3 sdc7
sd 4:0:1:0: [sdb] Attached SCSI disk
sd 5:0:1:0: [sdd] Attached SCSI disk
sd 5:0:2:0: [sde] Attached SCSI disk
sd 5:0:0:0: [sdc] Attached SCSI disk
sd 4:0:0:0: [sda] 585937500 512-byte logical blocks: (300 GB/279 GiB)
sd 4:0:0:0: [sda] Write Protect is off
sd 4:0:0:0: [sda] Mode Sense: e7 00 10 08
sd 4:0:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
 sda: sda1 sda2 sda3
sd 4:0:0:0: [sda] Attached SCSI disk
dracut: Scanning devices sda2 sde2  for LVM logical volumes VolGroup/lv_swap VolGroup/lv_root 
dracut: inactive '/dev/VolGroup/lv_root' [274.38 GiB] inherit
dracut: inactive '/dev/VolGroup/lv_swap' [4.00 GiB] inherit
dracut: inactive '/dev/vg/root' [10.00 GiB] inherit
dracut: inactive '/dev/vg/swap' [2.00 GiB] inherit
dracut: inactive '/dev/vg/tmpdir' [10.00 GiB] inherit
dracut: inactive '/dev/vg/mountpoint' [5.00 GiB] inherit
EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
dracut: Mounted root filesystem /dev/mapper/VolGroup-lv_root
dracut: Loading SELinux policy
audit: type=1404 audit(1427502714.060:2): enforcing=1 old_enforcing=0 auid=4294967295 ses=4294967295
SELinux: 2048 avtab hash slots, 277818 rules.
SELinux: 2048 avtab hash slots, 277818 rules.
SELinux:  9 users, 12 roles, 3918 types, 217 bools, 1 sens, 1024 cats
SELinux:  81 classes, 277818 rules
SELinux:  Permission audit_access in class file not defined in policy.
SELinux:  Permission audit_access in class dir not defined in policy.
SELinux:  Permission execmod in class dir not defined in policy.
SELinux:  Permission audit_access in class lnk_file not defined in policy.
SELinux:  Permission open in class lnk_file not defined in policy.
SELinux:  Permission execmod in class lnk_file not defined in policy.
SELinux:  Permission audit_access in class chr_file not defined in policy.
SELinux:  Permission audit_access in class blk_file not defined in policy.
SELinux:  Permission execmod in class blk_file not defined in policy.
SELinux:  Permission audit_access in class sock_file not defined in policy.
SELinux:  Permission execmod in class sock_file not defined in policy.
SELinux:  Permission audit_access in class fifo_file not defined in policy.
SELinux:  Permission execmod in class fifo_file not defined in policy.
SELinux:  Permission syslog in class capability2 not defined in policy.
SELinux:  Permission wake_alarm in class capability2 not defined in policy.
SELinux:  Permission block_suspend in class capability2 not defined in policy.
SELinux:  Permission audit_read in class capability2 not defined in policy.
SELinux:  Permission attach_queue in class tun_socket not defined in policy.
SELinux:  Class binder not defined in policy.
SELinux: the above unknown classes and permissions will be allowed
SELinux:  Completing initialization.
SELinux:  Setting up existing superblocks.
audit: type=1403 audit(1427502716.972:3): policy loaded auid=4294967295 ses=4294967295
dracut: 
dracut: Switching root
udev: starting version 147
sha1_sparc64: Using sparc64 sha1 opcode optimized SHA-1 implementation
sha512_sparc64: Using sparc64 sha512 opcode optimized SHA-512/SHA-384 implementation
md5_sparc64: Using sparc64 md5 opcode optimized MD5 implementation
des_sparc64: Using sparc64 des opcodes optimized DES implementation
camellia_sparc64: Using sparc64 camellia opcodes optimized CAMELLIA implementation
crc32c_sparc64: Using sparc64 crc32c opcode optimized CRC32C implementation
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 4.0.1-k
ixgbe: Copyright (c) 1999-2014 Intel Corporation.
PCI: Enabling device: (0000:06:00.0), cmd 2
ixgbe 0000:06:00.0: enabling bus mastering
ixgbe 0000:06:00.0: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
ixgbe 0000:06:00.0: PCI Express bandwidth of 32GT/s available
ixgbe 0000:06:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
ixgbe 0000:06:00.0: MAC: 3, PHY: 0, PBA No: 000000-000
ixgbe 0000:06:00.0: 00:10:e0:35:15:f6
ixgbe 0000:06:00.0: Intel(R) 10 Gigabit Network Connection
PCI: Enabling device: (0000:06:00.1), cmd 2
ixgbe 0000:06:00.1: enabling bus mastering
ixgbe 0000:06:00.1: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
ixgbe 0000:06:00.1: PCI Express bandwidth of 32GT/s available
ixgbe 0000:06:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
ixgbe 0000:06:00.1: MAC: 3, PHY: 0, PBA No: 000000-000
ixgbe 0000:06:00.1: 00:10:e0:35:15:f7
ixgbe 0000:06:00.1: Intel(R) 10 Gigabit Network Connection
PCI: Enabling device: (000f:75:00.0), cmd 2
ixgbe 000f:75:00.0: enabling bus mastering
ixgbe 000f:75:00.0: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
ixgbe 000f:75:00.0: PCI Express bandwidth of 32GT/s available
ixgbe 000f:75:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
ixgbe 000f:75:00.0: MAC: 3, PHY: 0, PBA No: 000000-000
ixgbe 000f:75:00.0: 00:10:e0:35:15:f8
ixgbe 000f:75:00.0: Intel(R) 10 Gigabit Network Connection
PCI: Enabling device: (000f:75:00.1), cmd 2
ixgbe 000f:75:00.1: enabling bus mastering
ixgbe 000f:75:00.1: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
ixgbe 000f:75:00.1: PCI Express bandwidth of 32GT/s available
ixgbe 000f:75:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
ixgbe 000f:75:00.1: MAC: 3, PHY: 0, PBA No: 000000-000
ixgbe 000f:75:00.1: 00:10:e0:35:15:f9
ixgbe 000f:75:00.1: Intel(R) 10 Gigabit Network Connection
xhci_hcd 0000:05:00.0: enabling bus mastering
xhci_hcd 0000:05:00.0: xHCI Host Controller
xhci_hcd 0000:05:00.0: new USB bus registered, assigned bus number 1
xhci_hcd 0000:05:00.0: hcc params 0x014051cf hci version 0x100 quirks 0x00000010
xhci_hcd 0000:05:00.0: enabling Mem-Wr-Inval
usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: xHCI Host Controller
usb usb1: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
usb usb1: SerialNumber: 0000:05:00.0
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 4 ports detected
xhci_hcd 0000:05:00.0: xHCI Host Controller
xhci_hcd 0000:05:00.0: new USB bus registered, assigned bus number 2
usb usb2: New USB device found, idVendor=1d6b, idProduct=0003
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: xHCI Host Controller
usb usb2: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
usb usb2: SerialNumber: 0000:05:00.0
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 4 ports detected
xhci_hcd 000f:76:00.0: enabling bus mastering
usb 1-3: new high-speed USB device number 2 using xhci_hcd
xhci_hcd 000f:76:00.0: xHCI Host Controller
xhci_hcd 000f:76:00.0: new USB bus registered, assigned bus number 3
xhci_hcd 000f:76:00.0: hcc params 0x014051cf hci version 0x100 quirks 0x00000010
xhci_hcd 000f:76:00.0: enabling Mem-Wr-Inval
usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb3: Product: xHCI Host Controller
usb usb3: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
usb 1-3: New USB device found, idVendor=090c, idProduct=1000
usb 1-3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
usb 1-3: Product: USB DISK
usb 1-3: Manufacturer: SMI Corporation
usb 1-3: SerialNumber: 2011081500000723
usb 1-3: ep 0x81 - rounding interval to 128 microframes, ep desc says 255 microframes
usb 1-3: ep 0x2 - rounding interval to 128 microframes, ep desc says 255 microframes
usb usb3: SerialNumber: 000f:76:00.0
hub 3-0:1.0: USB hub found
hub 3-0:1.0: 4 ports detected
xhci_hcd 000f:76:00.0: xHCI Host Controller
xhci_hcd 000f:76:00.0: new USB bus registered, assigned bus number 4
usb usb4: New USB device found, idVendor=1d6b, idProduct=0003
usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb4: Product: xHCI Host Controller
usb usb4: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
usb usb4: SerialNumber: 000f:76:00.0
hub 4-0:1.0: USB hub found
hub 4-0:1.0: 4 ports detected
sd 4:0:0:0: Attached scsi generic sg0 type 0
sd 4:0:1:0: Attached scsi generic sg1 type 0
sd 5:0:0:0: Attached scsi generic sg2 type 0
sd 5:0:1:0: Attached scsi generic sg3 type 0
sd 5:0:2:0: Attached scsi generic sg4 type 0
usb-storage 1-3:1.0: USB Mass Storage device detected
scsi host6: usb-storage 1-3:1.0
usbcore: registered new interface driver usb-storage
scsi 6:0:0:0: Direct-Access     SMI      USB DISK         3000 PQ: 0 ANSI: 0 CCS
sd 6:0:0:0: [sdf] 62652416 512-byte logical blocks: (32.0 GB/29.8 GiB)
sd 6:0:0:0: Attached scsi generic sg5 type 0
sd 6:0:0:0: [sdf] Write Protect is off
sd 6:0:0:0: [sdf] Mode Sense: 43 00 00 00
sd 6:0:0:0: [sdf] No Caching mode page found
sd 6:0:0:0: [sdf] Assuming drive cache: write through
 sdf: sdf1 sdf2 sdf3
sd 6:0:0:0: [sdf] Attached SCSI removable disk
EXT4-fs (dm-0): re-mounted. Opts: (null)
kjournald starting.  Commit interval 5 seconds
EXT3-fs (sde1): using internal journal
EXT3-fs (sde1): mounted filesystem with ordered data mode
Adding 4194296k swap on /dev/mapper/VolGroup-lv_swap.  Priority:-1 extents:1 across:4194296k FS
NET: Registered protocol family 10
pps pps0: new PPS source ptp0
ixgbe 0000:06:00.0: registered PHC device on eth0
IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
audit: type=1305 audit(1427502750.796:4): audit_pid=11679 old=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:auditd_t:s0 res=1
ixgbe 0000:06:00.0 eth0: NIC Link is Up 1 Gbps, Flow Control: RX/TX
IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-28  0:32         ` David Ahern
@ 2015-03-28  0:36           ` David Ahern
  2015-03-28  3:19             ` Yinghai Lu
  0 siblings, 1 reply; 39+ messages in thread
From: David Ahern @ 2015-03-28  0:36 UTC (permalink / raw)
  To: Yinghai Lu; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

On 3/27/15 6:32 PM, David Ahern wrote:
> On 3/27/15 5:57 PM, Yinghai Lu wrote:
>> On Fri, Mar 27, 2015 at 2:01 PM, Yinghai Lu <yinghai@kernel.org> wrote:
>>> On Thu, Mar 26, 2015 at 4:27 PM, David Ahern <david.ahern@oracle.com>
>>> wrote:
>>
>>> Also please make sure your config have
>>>
>>> CONFIG_PCI_DEBUG=y
>>>
>>> and capture serial console with "debug ignore_loglevel", so we check if
>>> pci 0000:00:01.0 really have resource assigned.
>>
>> Please check attached patch and send out boot log with above config.
>
> patched applied. PCI_DEBUG enabled. options added. log attached. This is
> with d63e2e1f3df reverted still.
>

oops lied about that last one; I forgot to revert the patch this round. 
That the system booted with it applied is progress.

David

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-27 23:57       ` Yinghai Lu
  2015-03-28  0:32         ` David Ahern
@ 2015-03-28  1:05         ` Sam Ravnborg
  2015-03-28  2:07           ` Yinghai Lu
  2015-03-28 18:16         ` David Miller
  2 siblings, 1 reply; 39+ messages in thread
From: Sam Ravnborg @ 2015-03-28  1:05 UTC (permalink / raw)
  To: Yinghai Lu; +Cc: David Ahern, Bjorn Helgaas, linux-pci, sparclinux, LKML

> 
> Index: linux-2.6/arch/alpha/Kconfig
> ===================================================================
> --- linux-2.6.orig/arch/alpha/Kconfig
> +++ linux-2.6/arch/alpha/Kconfig
> @@ -66,6 +66,9 @@ config ZONE_DMA
>  config ARCH_DMA_ADDR_T_64BIT
>  	def_bool y
>  
> +config ARCH_PCI_BUS_ADDR_T_64BIT
> +	def_bool y
> +
For alpha you define a new symbol with a default value.

>  config NEED_DMA_MAP_STATE
>         def_bool y
>  
> Index: linux-2.6/arch/arm/Kconfig
> ===================================================================
> --- linux-2.6.orig/arch/arm/Kconfig
> +++ linux-2.6/arch/arm/Kconfig
> @@ -1779,6 +1779,7 @@ config XEN
>  	depends on !GENERIC_ATOMIC64
>  	depends on MMU
>  	select ARCH_DMA_ADDR_T_64BIT
> +	select ARCH_PCI_BUS_ADDR_T_64BIT
>  	select ARM_PSCI
>  	select SWIOTLB_XEN
>  	help
For arm you use select ...

As the actual definition of the Kconfig symbol is already
present in mm/Kconfig please use select in all cases.

> Index: linux-2.6/arch/arm/mm/Kconfig
> ===================================================================
> --- linux-2.6.orig/arch/arm/mm/Kconfig
> +++ linux-2.6/arch/arm/mm/Kconfig
> @@ -630,6 +630,9 @@ config ARCH_PHYS_ADDR_T_64BIT
>  config ARCH_DMA_ADDR_T_64BIT
>  	bool
>  
> +config ARCH_PCI_BUS_ADDR_T_64BIT
> +	bool
> +
Here it would have been nice with a comment that explains the use of ths symbol.

>  config ARM_THUMB
>  	bool "Support Thumb user binaries" if !CPU_THUMBONLY
>  	depends on CPU_ARM720T || CPU_ARM740T || CPU_ARM920T || CPU_ARM922T || \
> Index: linux-2.6/arch/arm64/Kconfig
> ===================================================================
> --- linux-2.6.orig/arch/arm64/Kconfig
> +++ linux-2.6/arch/arm64/Kconfig
> @@ -125,6 +125,9 @@ config HAVE_GENERIC_RCU_GUP
>  config ARCH_DMA_ADDR_T_64BIT
>  	def_bool y
>  
> +config ARCH_PCI_BUS_ADDR_T_64BIT
> +	def_bool y
> +
Use select

>  config NEED_DMA_MAP_STATE
>  	def_bool y
>  
> Index: linux-2.6/arch/ia64/Kconfig
> ===================================================================
> --- linux-2.6.orig/arch/ia64/Kconfig
> +++ linux-2.6/arch/ia64/Kconfig
> @@ -74,6 +74,9 @@ config MMU
>  config ARCH_DMA_ADDR_T_64BIT
>  	def_bool y
>  
> +config ARCH_PCI_BUS_ADDR_T_64BIT
> +	def_bool y
> +
Use select

>  config NEED_DMA_MAP_STATE
>  	def_bool y
>  
> Index: linux-2.6/arch/mips/Kconfig
> ===================================================================
> --- linux-2.6.orig/arch/mips/Kconfig
> +++ linux-2.6/arch/mips/Kconfig
> @@ -984,6 +984,9 @@ config FW_CFE
>  config ARCH_DMA_ADDR_T_64BIT
>  	def_bool (HIGHMEM && ARCH_PHYS_ADDR_T_64BIT) || 64BIT
>  
> +config ARCH_PCI_BUS_ADDR_T_64BIT
> +	def_bool (HIGHMEM && ARCH_PHYS_ADDR_T_64BIT) || 64BIT

Use select ... if

> ===================================================================
> --- linux-2.6.orig/arch/powerpc/Kconfig
> +++ linux-2.6/arch/powerpc/Kconfig
> @@ -23,6 +23,9 @@ config ARCH_PHYS_ADDR_T_64BIT
>  config ARCH_DMA_ADDR_T_64BIT
>  	def_bool ARCH_PHYS_ADDR_T_64BIT
>  
> +config ARCH_PCI_ADDR_T_64BIT
> +	def_bool ARCH_PHYS_ADDR_T_64BIT
> +
Use select

> Index: linux-2.6/arch/sparc/Kconfig
> ===================================================================
> --- linux-2.6.orig/arch/sparc/Kconfig
> +++ linux-2.6/arch/sparc/Kconfig
> @@ -143,6 +143,9 @@ config GENERIC_ISA_DMA
>  	bool
>  	default y if SPARC32
>  
> +config ARCH_PCI_BUS_ADDR_T_64BIT
> +	def_bool y if SPARC64
> +
Use select ...

>  config ARCH_SUPPORTS_DEBUG_PAGEALLOC
>  	def_bool y if SPARC64
>  
> Index: linux-2.6/arch/tile/Kconfig
> ===================================================================
> --- linux-2.6.orig/arch/tile/Kconfig
> +++ linux-2.6/arch/tile/Kconfig
> @@ -86,6 +86,9 @@ config ARCH_PHYS_ADDR_T_64BIT
>  config ARCH_DMA_ADDR_T_64BIT
>  	def_bool y
>  
> +config ARCH_PCI_BUS_ADDR_T_64BIT
> +	def_bool y
> +
Use select ...

> Index: linux-2.6/arch/x86/Kconfig
> ===================================================================
> --- linux-2.6.orig/arch/x86/Kconfig
> +++ linux-2.6/arch/x86/Kconfig
> @@ -1295,6 +1295,10 @@ config ARCH_DMA_ADDR_T_64BIT
>  	def_bool y
>  	depends on X86_64 || HIGHMEM64G
>  
> +config ARCH_PCI_BUS_ADDR_T_64BIT
> +	def_bool y
> +	depends on X86_64 || HIGHMEM64G
Use select ...

> +
>  config X86_DIRECT_GBPAGES
>  	def_bool y
>  	depends on X86_64 && !DEBUG_PAGEALLOC && !KMEMCHECK

> Index: linux-2.6/include/linux/types.h
> ===================================================================
> --- linux-2.6.orig/include/linux/types.h
> +++ linux-2.6/include/linux/types.h
> @@ -146,6 +146,13 @@ typedef u64 dma_addr_t;
>  typedef u32 dma_addr_t;
>  #endif /* dma_addr_t */
>  
> +/* A pci_bus_addr_t can hold pci bus address for the platform */
> +#ifdef CONFIG_ARCH_PCI_BUS_ADDR_T_64BIT
> +typedef u64 pci_bus_addr_t;
> +#else
> +typedef u32 pci_bus_addr_t;
> +#endif /* pci_bus_addr_t */
> +
Looking att all the Kconfig logic I get the impression that
the type of pci_bus_addr_t equals unsigned long.
If this is correct then you can skip that and things
gets much simpler.

	Sam

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-28  1:05         ` Sam Ravnborg
@ 2015-03-28  2:07           ` Yinghai Lu
  2015-03-28  8:18             ` Sam Ravnborg
  0 siblings, 1 reply; 39+ messages in thread
From: Yinghai Lu @ 2015-03-28  2:07 UTC (permalink / raw)
  To: Sam Ravnborg; +Cc: David Ahern, Bjorn Helgaas, linux-pci, sparclinux, LKML

On Fri, Mar 27, 2015 at 6:05 PM, Sam Ravnborg <sam@ravnborg.org> wrote:
>>
>> Index: linux-2.6/arch/alpha/Kconfig
>> ===================================================================
>> --- linux-2.6.orig/arch/alpha/Kconfig
>> +++ linux-2.6/arch/alpha/Kconfig
>> @@ -66,6 +66,9 @@ config ZONE_DMA
>>  config ARCH_DMA_ADDR_T_64BIT
>>       def_bool y
>>
>> +config ARCH_PCI_BUS_ADDR_T_64BIT
>> +     def_bool y
>> +
> For alpha you define a new symbol with a default value.
>
>>  config NEED_DMA_MAP_STATE
>>         def_bool y
>>
>> Index: linux-2.6/arch/arm/Kconfig
>> ===================================================================
>> --- linux-2.6.orig/arch/arm/Kconfig
>> +++ linux-2.6/arch/arm/Kconfig
>> @@ -1779,6 +1779,7 @@ config XEN
>>       depends on !GENERIC_ATOMIC64
>>       depends on MMU
>>       select ARCH_DMA_ADDR_T_64BIT
>> +     select ARCH_PCI_BUS_ADDR_T_64BIT
>>       select ARM_PSCI
>>       select SWIOTLB_XEN
>>       help
> For arm you use select ...
>
> As the actual definition of the Kconfig symbol is already
> present in mm/Kconfig please use select in all cases.
>
>> Index: linux-2.6/arch/arm/mm/Kconfig
>> ===================================================================
>> --- linux-2.6.orig/arch/arm/mm/Kconfig
>> +++ linux-2.6/arch/arm/mm/Kconfig
>> @@ -630,6 +630,9 @@ config ARCH_PHYS_ADDR_T_64BIT
>>  config ARCH_DMA_ADDR_T_64BIT
>>       bool
>>
>> +config ARCH_PCI_BUS_ADDR_T_64BIT
>> +     bool
>> +
> Here it would have been nice with a comment that explains the use of ths symbol.

just duplicate the ARCH_DMA_ADDR_T_64BIT above

>
>>  config ARM_THUMB
>>       bool "Support Thumb user binaries" if !CPU_THUMBONLY
>>       depends on CPU_ARM720T || CPU_ARM740T || CPU_ARM920T || CPU_ARM922T || \
>> Index: linux-2.6/arch/arm64/Kconfig
>> ===================================================================
>> --- linux-2.6.orig/arch/arm64/Kconfig
>> +++ linux-2.6/arch/arm64/Kconfig
>> @@ -125,6 +125,9 @@ config HAVE_GENERIC_RCU_GUP
>>  config ARCH_DMA_ADDR_T_64BIT
>>       def_bool y
>>
>> +config ARCH_PCI_BUS_ADDR_T_64BIT
>> +     def_bool y
>> +
> Use select
...

I was trying to keep the style to be consistent with old one in each Kconfig.

So do we just need to make sure new added lines to use new style?


>
>> Index: linux-2.6/include/linux/types.h
>> ===================================================================
>> --- linux-2.6.orig/include/linux/types.h
>> +++ linux-2.6/include/linux/types.h
>> @@ -146,6 +146,13 @@ typedef u64 dma_addr_t;
>>  typedef u32 dma_addr_t;
>>  #endif /* dma_addr_t */
>>
>> +/* A pci_bus_addr_t can hold pci bus address for the platform */
>> +#ifdef CONFIG_ARCH_PCI_BUS_ADDR_T_64BIT
>> +typedef u64 pci_bus_addr_t;
>> +#else
>> +typedef u32 pci_bus_addr_t;
>> +#endif /* pci_bus_addr_t */
>> +
> Looking att all the Kconfig logic I get the impression that
> the type of pci_bus_addr_t equals unsigned long.
> If this is correct then you can skip that and things
> gets much simpler.

For x86 32bit with PAE support, we could use 64bit for bus address.
but unsigned long is 32bit.

Thanks

Yinghai

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-28  0:36           ` David Ahern
@ 2015-03-28  3:19             ` Yinghai Lu
  2015-03-28  3:22               ` David Ahern
  2015-03-28  3:45               ` David Ahern
  0 siblings, 2 replies; 39+ messages in thread
From: Yinghai Lu @ 2015-03-28  3:19 UTC (permalink / raw)
  To: David Ahern; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

[-- Attachment #1: Type: text/plain, Size: 983 bytes --]

On Fri, Mar 27, 2015 at 5:36 PM, David Ahern <david.ahern@oracle.com> wrote:
>>>
>>>> Also please make sure your config have
>>>>
>>>> CONFIG_PCI_DEBUG=y
>>>>
>>>> and capture serial console with "debug ignore_loglevel", so we check if
>>>> pci 0000:00:01.0 really have resource assigned.
>>>
>>>
>>> Please check attached patch and send out boot log with above config.
>>
>>
>> patched applied. PCI_DEBUG enabled. options added. log attached. This is
>> with d63e2e1f3df reverted still.
>>
>
> oops lied about that last one; I forgot to revert the patch this round. That
> the system booted with it applied is progress.

Good. But we still have annoying warning about "no compatible window".

Please try attached patch that support 64bit pci mem space for sparc.

BTW, looks like you still do not have   CONFIG_PCI_DEBUG=y in your .config.
otherwise we should more verbose print out.
Or did you have DYNAMIC_DEBUG enabled ?
If it is that case, can you remove that?

Thanks

Yinghai

[-- Attachment #2: sparc_sun4v_mem64.patch --]
[-- Type: text/x-patch, Size: 3483 bytes --]

Subject: [RFC PATCH] sparc/PCI: Add mem64 resource parsing for root bus

Found no compatible bridge window warning in boot log from T5-8.

pci 0000:00:01.0: can't claim BAR 15 [mem 0x100000000-0x4afffffff pref]: no compatible bridge window

and root bus only report io and mem32.

pci_sun4v f02dbcfc: PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x804000000000-0x80400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0000:00: root bus resource [mem 0x800000000000-0x80007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0000:00: root bus resource [bus 00-77]

Add mem64 handling in pci_common for sparc, so we can have 64bit resource
registered for bus at first.

Signed-off-by: Yinghai Lu <yinghai@kernel.org>

---
 arch/sparc/kernel/pci.c        |    3 +++
 arch/sparc/kernel/pci_common.c |   15 +++++++++++++--
 arch/sparc/kernel/pci_impl.h   |    1 +
 3 files changed, 17 insertions(+), 2 deletions(-)

Index: linux-2.6/arch/sparc/kernel/pci.c
===================================================================
--- linux-2.6.orig/arch/sparc/kernel/pci.c
+++ linux-2.6/arch/sparc/kernel/pci.c
@@ -663,6 +663,9 @@ struct pci_bus *pci_scan_one_pbm(struct
 				pbm->io_space.start);
 	pci_add_resource_offset(&resources, &pbm->mem_space,
 				pbm->mem_space.start);
+	if (pbm->mem64_space.flags)
+		pci_add_resource_offset(&resources, &pbm->mem64_space,
+					pbm->mem64_space.start);
 	pbm->busn.start = pbm->pci_first_busno;
 	pbm->busn.end	= pbm->pci_last_busno;
 	pbm->busn.flags	= IORESOURCE_BUS;
Index: linux-2.6/arch/sparc/kernel/pci_common.c
===================================================================
--- linux-2.6.orig/arch/sparc/kernel/pci_common.c
+++ linux-2.6/arch/sparc/kernel/pci_common.c
@@ -406,6 +406,7 @@ void pci_determine_mem_io_space(struct p
 	}
 
 	num_pbm_ranges = i / sizeof(*pbm_ranges);
+	memset(&pbm->mem64_space, 0, sizeof(struct resource));
 
 	for (i = 0; i < num_pbm_ranges; i++) {
 		const struct linux_prom_pci_ranges *pr = &pbm_ranges[i];
@@ -451,7 +452,11 @@ void pci_determine_mem_io_space(struct p
 			break;
 
 		case 3:
-			/* XXX 64-bit MEM handling XXX */
+			/* 64-bit MEM handling */
+			pbm->mem64_space.start = a;
+			pbm->mem64_space.end = a + size - 1UL;
+			pbm->mem64_space.flags = IORESOURCE_MEM;
+			break;
 
 		default:
 			break;
@@ -465,15 +470,21 @@ void pci_determine_mem_io_space(struct p
 		prom_halt();
 	}
 
-	printk("%s: PCI IO[%llx] MEM[%llx]\n",
+	printk("%s: PCI IO[%llx] MEM[%llx]",
 	       pbm->name,
 	       pbm->io_space.start,
 	       pbm->mem_space.start);
+	if (pbm->mem64_space.flags)
+		printk(" MEM64[%llx]",
+		       pbm->mem64_space.start);
+	printk("\n");
 
 	pbm->io_space.name = pbm->mem_space.name = pbm->name;
 
 	request_resource(&ioport_resource, &pbm->io_space);
 	request_resource(&iomem_resource, &pbm->mem_space);
+	if (pbm->mem64_space.flags)
+		request_resource(&iomem_resource, &pbm->mem64_space);
 
 	pci_register_legacy_regions(&pbm->io_space,
 				    &pbm->mem_space);
Index: linux-2.6/arch/sparc/kernel/pci_impl.h
===================================================================
--- linux-2.6.orig/arch/sparc/kernel/pci_impl.h
+++ linux-2.6/arch/sparc/kernel/pci_impl.h
@@ -97,6 +97,7 @@ struct pci_pbm_info {
 	/* PBM I/O and Memory space resources. */
 	struct resource			io_space;
 	struct resource			mem_space;
+	struct resource			mem64_space;
 	struct resource			busn;
 
 	/* Base of PCI Config space, can be per-PBM or shared. */

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-28  3:19             ` Yinghai Lu
@ 2015-03-28  3:22               ` David Ahern
  2015-03-28  3:27                 ` Yinghai Lu
  2015-03-28  3:45               ` David Ahern
  1 sibling, 1 reply; 39+ messages in thread
From: David Ahern @ 2015-03-28  3:22 UTC (permalink / raw)
  To: Yinghai Lu; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

On 3/27/15 9:19 PM, Yinghai Lu wrote:
> Good. But we still have annoying warning about "no compatible window".
>
> Please try attached patch that support 64bit pci mem space for sparc.

in place of or on top of the previous patch?

>
> BTW, looks like you still do not have   CONFIG_PCI_DEBUG=y in your .config.
> otherwise we should more verbose print out.

# zcat /proc/config.gz  | grep PCI_DEBUG
CONFIG_PCI_DEBUG=y

> Or did you have DYNAMIC_DEBUG enabled ?

# zcat /proc/config.gz  | grep DYNAMIC
CONFIG_NETCONSOLE_DYNAMIC=y
CONFIG_SND_DYNAMIC_MINORS=y
# CONFIG_USB_DYNAMIC_MINORS is not set
CONFIG_DYNAMIC_DEBUG=y
CONFIG_HAVE_DYNAMIC_FTRACE=y
CONFIG_DYNAMIC_FTRACE=y

> If it is that case, can you remove that?

will do; wasn't aware of it before now. Let me know about the patch ordering

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-28  3:22               ` David Ahern
@ 2015-03-28  3:27                 ` Yinghai Lu
  0 siblings, 0 replies; 39+ messages in thread
From: Yinghai Lu @ 2015-03-28  3:27 UTC (permalink / raw)
  To: David Ahern; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

On Fri, Mar 27, 2015 at 8:22 PM, David Ahern <david.ahern@oracle.com> wrote:
> On 3/27/15 9:19 PM, Yinghai Lu wrote:
>>
>> Good. But we still have annoying warning about "no compatible window".
>>
>> Please try attached patch that support 64bit pci mem space for sparc.
>
>
> in place of or on top of the previous patch?

on top of the previous patch.

Thanks

Yinghai

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-28  3:19             ` Yinghai Lu
  2015-03-28  3:22               ` David Ahern
@ 2015-03-28  3:45               ` David Ahern
  2015-03-28  5:26                 ` Yinghai Lu
  1 sibling, 1 reply; 39+ messages in thread
From: David Ahern @ 2015-03-28  3:45 UTC (permalink / raw)
  To: Yinghai Lu; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

[-- Attachment #1: Type: text/plain, Size: 416 bytes --]

On 3/27/15 9:19 PM, Yinghai Lu wrote:
> Good. But we still have annoying warning about "no compatible window".
>
> Please try attached patch that support 64bit pci mem space for sparc.
>
> BTW, looks like you still do not have   CONFIG_PCI_DEBUG=y in your .config.
> otherwise we should more verbose print out.
> Or did you have DYNAMIC_DEBUG enabled ?
> If it is that case, can you remove that?
>

done. attached.


[-- Attachment #2: dmesg --]
[-- Type: text/plain, Size: 71159 bytes --]

sshlab root@ca-qasparc24 dmesg
[    0.000000] PROMLIB: Sun IEEE Boot Prom 'OBP 4.36.2 2014/10/24 08:15'
[    0.000000] PROMLIB: Root node compatible: sun4v
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 4.0.0-rc5+ (root@ca-qasparc24) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-4.0.9) (GCC) ) #1 SMP Fri Mar 27 23:32:21 EDT 2015
[    0.000000] debug: skip boot console de-registration.
[    0.000000] debug: ignoring loglevel setting.
[    0.000000] bootconsole [earlyprom0] enabled
[    0.000000] ARCH: SUN4V
[    0.000000] Ethernet address: 00:10:e0:35:15:f6
[    0.000000] MM: PAGE_OFFSET is 0xfff8000000000000 (max_phys_bits == 47)
[    0.000000] MM: VMALLOC [0x0000000100000000 --> 0x0006000000000000]
[    0.000000] MM: VMEMMAP [0x0006000000000000 --> 0x000c000000000000]
[    0.000000] Kernel: Using 3 locked TLB entries for main kernel image.
[    0.000000] Remapping the kernel... done.
[    0.000000] OF stdout device is: /virtual-devices@100/console@1
[    0.000000] PROM: Built device tree with 1478492 bytes of memory.
[    0.000000] MDESC: Size is 774368 bytes.
[    0.000000] PLATFORM: banner-name [SPARC T5-8]
[    0.000000] PLATFORM: name [ORCL,SPARC-T5-8]
[    0.000000] PLATFORM: hostid [863515f6]
[    0.000000] PLATFORM: serial# [003515f6]
[    0.000000] PLATFORM: stick-frequency [3b9aca00]
[    0.000000] PLATFORM: mac-address [10e03515f6]
[    0.000000] PLATFORM: watchdog-resolution [1000 ms]
[    0.000000] PLATFORM: watchdog-max-timeout [31536000000 ms]
[    0.000000] PLATFORM: max-cpus [1024]
[    0.000000] Allocated 81920 bytes for kernel page tables.
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000030400000-0xffffffffffffffff]
[    0.000000]   Normal   [mem 0x0000000000000000-0x0000383fffd11fff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000030400000-0x0000003fddeeffff]
[    0.000000]   node   0: [mem 0x0000003fddef6000-0x0000003fddef7fff]
[    0.000000]   node   1: [mem 0x0000080000000000-0x0000083fffffffff]
[    0.000000]   node   2: [mem 0x0000100000000000-0x0000103fffffffff]
[    0.000000]   node   3: [mem 0x0000180000000000-0x0000183fffffffff]
[    0.000000]   node   4: [mem 0x0000200000000000-0x0000203fffffffff]
[    0.000000]   node   5: [mem 0x0000280000000000-0x0000283fffffffff]
[    0.000000]   node   6: [mem 0x0000300000000000-0x0000303fffffffff]
[    0.000000]   node   7: [mem 0x0000380000000000-0x0000383fffcddfff]
[    0.000000]   node   7: [mem 0x0000383fffcee000-0x0000383fffd11fff]
[    0.000000] Initmem setup node 0 [mem 0x0000000030400000-0x0000003fddef7fff]
[    0.000000] On node 0 totalpages: 33385849
[    0.000000]   Normal zone: 293431 pages used for memmap
[    0.000000]   Normal zone: 33385849 pages, LIFO batch:15
[    0.000000] Initmem setup node 1 [mem 0x0000080000000000-0x0000083fffffffff]
[    0.000000] On node 1 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 2 [mem 0x0000100000000000-0x0000103fffffffff]
[    0.000000] On node 2 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 3 [mem 0x0000180000000000-0x0000183fffffffff]
[    0.000000] On node 3 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 4 [mem 0x0000200000000000-0x0000203fffffffff]
[    0.000000] On node 4 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 5 [mem 0x0000280000000000-0x0000283fffffffff]
[    0.000000] On node 5 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 6 [mem 0x0000300000000000-0x0000303fffffffff]
[    0.000000] On node 6 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 7 [mem 0x0000380000000000-0x0000383fffd11fff]
[    0.000000] On node 7 totalpages: 33554049
[    0.000000]   Normal zone: 294909 pages used for memmap
[    0.000000]   Normal zone: 33554049 pages, LIFO batch:15
[    0.000000] Booting Linux...
[    0.000000] CPU CAPS: [flush,stbar,swap,muldiv,v9,blkinit,n2,mul32]
[    0.000000] CPU CAPS: [div32,v8plus,popc,vis,vis2,ASIBlkInit,fmaf,vis3]
[    0.000000] CPU CAPS: [hpc,ima,pause,cbcond,aes,des,kasumi,camellia]
[    0.000000] CPU CAPS: [md5,sha1,sha256,sha512,mpmul,montmul,montsqr,crc32c]
[    0.000000] PERCPU: Embedded 8 pages/cpu @fff8003f4d000000 s27776 r8192 d29568 u65536
[    0.000000] pcpu-alloc: s27776 r8192 d29568 u65536 alloc=1*4194304
[    0.000000] pcpu-alloc: [0] 0000 0001 0002 0003 0004 0005 0006 0007 0008 0009 0010 0011 0012 0013 0014 0015 0016 0017 0018 0019 0020 0021 0022 0023 0024 0025 0026 0027 0028 0029 0030 0031 0032 0033 0034 0035 0036 0037 0038 0039 0040 0041 0042 0043 0044 0045 0046 0047 0048 0049 0050 0051 0052 0053 0054 0055 0056 0057 0058 0059 0060 0061 0062 0063 
[    0.000000] pcpu-alloc: [0] 0064 0065 0066 0067 0068 0069 0070 0071 0072 0073 0074 0075 0076 0077 0078 0079 0080 0081 0082 0083 0084 0085 0086 0087 0088 0089 0090 0091 0092 0093 0094 0095 0096 0097 0098 0099 0100 0101 0102 0103 0104 0105 0106 0107 0108 0109 0110 0111 0112 0113 0114 0115 0116 0117 0118 0119 0120 0121 0122 0123 0124 0125 0126 0127 
[    0.000000] pcpu-alloc: [1] 0128 0129 0130 0131 0132 0133 0134 0135 0136 0137 0138 0139 0140 0141 0142 0143 0144 0145 0146 0147 0148 0149 0150 0151 0152 0153 0154 0155 0156 0157 0158 0159 0160 0161 0162 0163 0164 0165 0166 0167 0168 0169 0170 0171 0172 0173 0174 0175 0176 0177 0178 0179 0180 0181 0182 0183 0184 0185 0186 0187 0188 0189 0190 0191 
[    0.000000] pcpu-alloc: [1] 0192 0193 0194 0195 0196 0197 0198 0199 0200 0201 0202 0203 0204 0205 0206 0207 0208 0209 0210 0211 0212 0213 0214 0215 0216 0217 0218 0219 0220 0221 0222 0223 0224 0225 0226 0227 0228 0229 0230 0231 0232 0233 0234 0235 0236 0237 0238 0239 0240 0241 0242 0243 0244 0245 0246 0247 0248 0249 0250 0251 0252 0253 0254 0255 
[    0.000000] pcpu-alloc: [2] 0256 0257 0258 0259 0260 0261 0262 0263 0264 0265 0266 0267 0268 0269 0270 0271 0272 0273 0274 0275 0276 0277 0278 0279 0280 0281 0282 0283 0284 0285 0286 0287 0288 0289 0290 0291 0292 0293 0294 0295 0296 0297 0298 0299 0300 0301 0302 0303 0304 0305 0306 0307 0308 0309 0310 0311 0312 0313 0314 0315 0316 0317 0318 0319 
[    0.000000] pcpu-alloc: [2] 0320 0321 0322 0323 0324 0325 0326 0327 0328 0329 0330 0331 0332 0333 0334 0335 0336 0337 0338 0339 0340 0341 0342 0343 0344 0345 0346 0347 0348 0349 0350 0351 0352 0353 0354 0355 0356 0357 0358 0359 0360 0361 0362 0363 0364 0365 0366 0367 0368 0369 0370 0371 0372 0373 0374 0375 0376 0377 0378 0379 0380 0381 0382 0383 
[    0.000000] pcpu-alloc: [3] 0384 0385 0386 0387 0388 0389 0390 0391 0392 0393 0394 0395 0396 0397 0398 0399 0400 0401 0402 0403 0404 0405 0406 0407 0408 0409 0410 0411 0412 0413 0414 0415 0416 0417 0418 0419 0420 0421 0422 0423 0424 0425 0426 0427 0428 0429 0430 0431 0432 0433 0434 0435 0436 0437 0438 0439 0440 0441 0442 0443 0444 0445 0446 0447 
[    0.000000] pcpu-alloc: [3] 0448 0449 0450 0451 0452 0453 0454 0455 0456 0457 0458 0459 0460 0461 0462 0463 0464 0465 0466 0467 0468 0469 0470 0471 0472 0473 0474 0475 0476 0477 0478 0479 0480 0481 0482 0483 0484 0485 0486 0487 0488 0489 0490 0491 0492 0493 0494 0495 0496 0497 0498 0499 0500 0501 0502 0503 0504 0505 0506 0507 0508 0509 0510 0511 
[    0.000000] pcpu-alloc: [4] 0512 0513 0514 0515 0516 0517 0518 0519 0520 0521 0522 0523 0524 0525 0526 0527 0528 0529 0530 0531 0532 0533 0534 0535 0536 0537 0538 0539 0540 0541 0542 0543 0544 0545 0546 0547 0548 0549 0550 0551 0552 0553 0554 0555 0556 0557 0558 0559 0560 0561 0562 0563 0564 0565 0566 0567 0568 0569 0570 0571 0572 0573 0574 0575 
[    0.000000] pcpu-alloc: [4] 0576 0577 0578 0579 0580 0581 0582 0583 0584 0585 0586 0587 0588 0589 0590 0591 0592 0593 0594 0595 0596 0597 0598 0599 0600 0601 0602 0603 0604 0605 0606 0607 0608 0609 0610 0611 0612 0613 0614 0615 0616 0617 0618 0619 0620 0621 0622 0623 0624 0625 0626 0627 0628 0629 0630 0631 0632 0633 0634 0635 0636 0637 0638 0639 
[    0.000000] pcpu-alloc: [5] 0640 0641 0642 0643 0644 0645 0646 0647 0648 0649 0650 0651 0652 0653 0654 0655 0656 0657 0658 0659 0660 0661 0662 0663 0664 0665 0666 0667 0668 0669 0670 0671 0672 0673 0674 0675 0676 0677 0678 0679 0680 0681 0682 0683 0684 0685 0686 0687 0688 0689 0690 0691 0692 0693 0694 0695 0696 0697 0698 0699 0700 0701 0702 0703 
[    0.000000] pcpu-alloc: [5] 0704 0705 0706 0707 0708 0709 0710 0711 0712 0713 0714 0715 0716 0717 0718 0719 0720 0721 0722 0723 0724 0725 0726 0727 0728 0729 0730 0731 0732 0733 0734 0735 0736 0737 0738 0739 0740 0741 0742 0743 0744 0745 0746 0747 0748 0749 0750 0751 0752 0753 0754 0755 0756 0757 0758 0759 0760 0761 0762 0763 0764 0765 0766 0767 
[    0.000000] pcpu-alloc: [6] 0768 0769 0770 0771 0772 0773 0774 0775 0776 0777 0778 0779 0780 0781 0782 0783 0784 0785 0786 0787 0788 0789 0790 0791 0792 0793 0794 0795 0796 0797 0798 0799 0800 0801 0802 0803 0804 0805 0806 0807 0808 0809 0810 0811 0812 0813 0814 0815 0816 0817 0818 0819 0820 0821 0822 0823 0824 0825 0826 0827 0828 0829 0830 0831 
[    0.000000] pcpu-alloc: [6] 0832 0833 0834 0835 0836 0837 0838 0839 0840 0841 0842 0843 0844 0845 0846 0847 0848 0849 0850 0851 0852 0853 0854 0855 0856 0857 0858 0859 0860 0861 0862 0863 0864 0865 0866 0867 0868 0869 0870 0871 0872 0873 0874 0875 0876 0877 0878 0879 0880 0881 0882 0883 0884 0885 0886 0887 0888 0889 0890 0891 0892 0893 0894 0895 
[    0.000000] pcpu-alloc: [7] 0896 0897 0898 0899 0900 0901 0902 0903 0904 0905 0906 0907 0908 0909 0910 0911 0912 0913 0914 0915 0916 0917 0918 0919 0920 0921 0922 0923 0924 0925 0926 0927 0928 0929 0930 0931 0932 0933 0934 0935 0936 0937 0938 0939 0940 0941 0942 0943 0944 0945 0946 0947 0948 0949 0950 0951 0952 0953 0954 0955 0956 0957 0958 0959 
[    0.000000] pcpu-alloc: [7] 0960 0961 0962 0963 0964 0965 0966 0967 0968 0969 0970 0971 0972 0973 0974 0975 0976 0977 0978 0979 0980 0981 0982 0983 0984 0985 0986 0987 0988 0989 0990 0991 0992 0993 0994 0995 0996 0997 0998 0999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 
[    0.000000] SUN4V: Mondo queue sizes [cpu(131072) dev(16384) r(8192) nr(256)]
[    0.000000] Built 8 zonelists in Node order, mobility grouping on.  Total pages: 265908678
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: root=/dev/mapper/VolGroup-lv_root ro rd_NO_LUKS LANG=en_US.UTF-8 rd_NO_MD rd_LVM_LV=VolGroup/lv_swap SYSFONT=latarcyrheb-sun16 rd_LVM_LV=VolGroup/lv_root KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM keep_bootcon debug ignore_loglevel
[    0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[    0.000000] log_buf_len total cpu_extra contributions: 4190208 bytes
[    0.000000] log_buf_len min size: 1048576 bytes
[    0.000000] log_buf_len: 8388608 bytes
[    0.000000] early log buf free: 1036920(98%)
[    0.000000] PID hash table entries: 4096 (order: 2, 32768 bytes)
[    0.000000] Sorting __ex_table...
[    0.000000] Memory: 2127126480K/2146131920K available (5650K kernel code, 902K rwdata, 2384K rodata, 536K init, 2010K bss, 19005440K reserved, 0K cma-reserved)
[    0.000000] Hierarchical RCU implementation.
[    0.000000] NR_IRQS:2048 nr_irqs:2048 1
[    0.000000] SUN4V: Using IRQ API major 3, cookie only virqs enabled
[99503.072265] clocksource: mult[800000] shift[23]
[99503.127107] clockevent: mult[80000000] shift[31]
[99503.193690] Console: colour dummy device 80x25
[99503.246837] console [tty0] enabled
[99503.368791] Calibrating delay using timer specific routine.. 2001.27 BogoMIPS (lpj=4002541)
[99503.467934] pid_max: default: 1048576 minimum: 8192
[99503.527670] Security Framework initialized
[99503.576114] SELinux:  Initializing.
[99503.618965] SELinux:  Starting in permissive mode
[99503.828145] Dentry cache hash table entries: 268435456 (order: 18, 2147483648 bytes)
[99505.601320] Inode-cache hash table entries: 134217728 (order: 17, 1073741824 bytes)
[99506.500091] Mount-cache hash table entries: 4194304 (order: 12, 33554432 bytes)
[99506.590995] Mountpoint-cache hash table entries: 4194304 (order: 12, 33554432 bytes)
[99506.740519] Initializing cgroup subsys blkio
[99506.791097] Initializing cgroup subsys memory
[99506.843747] Initializing cgroup subsys devices
[99506.894882] Initializing cgroup subsys freezer
[99506.948348] Initializing cgroup subsys net_cls
[99507.000550] Initializing cgroup subsys perf_event
[99507.056425] Initializing cgroup subsys hugetlb
[99507.111056] ftrace: allocating 20497 entries in 41 pages
[99508.616635] Brought up 1024 CPUs
[99508.720943] devtmpfs: initialized
[99508.760658] Performance events: 
[99508.797536] Testing NMI watchdog ... OK.
[99508.925535] Supported PMU type is 'niagara5'
[99509.036528] ldc.c:v1.1 (July 22, 2008)
[99509.131897] NET: Registered protocol family 16
[99509.263661] VIO: Adding device channel-devices
[99509.318108] VIO: Adding device vldc-port-0-0
[99509.370888] VIO: Adding device vldc-port-0-1
[99509.423651] VIO: Adding device vldc-port-0-2
[99509.476413] VIO: Adding device vldc-port-1-0
[99509.528588] VIO: Adding device vldc-port-2-0
[99509.582064] VIO: Adding device vldc-port-3-0
[99509.634835] VIO: Adding device vldc-port-3-1
[99509.687597] VIO: Adding device vldc-port-3-4
[99509.739710] VIO: Adding device vldc-port-3-3
[99509.792484] VIO: Adding device vlds-port-0-0
[99509.845297] VIO: Adding device ds-0
[99509.888595] VIO: Adding device ds-1
[99510.148795] pci_sun4v: Registered hvapi major[1] minor[0]
[99510.215242] /pci@300: SUN4V PCI Bus Module
[99510.263707] /pci@300: On NUMA node -1
[99510.306883] /pci@300: PCI IO[804000000000] MEM[800000000000] MEM64[800100000000]
[99510.393281] /pci@300: Unable to request IOMMU resource.
[99510.474440] /pci@300: Imported 26 TSB entries from OBP
[99510.599133] /pci@300: MSI Queue first[0] num[56] count[512] devino[0x6]
[99510.678076] /pci@300: MSI first[0] num[512] mask[0x3ff] width[32]
[99510.750344] /pci@300: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99510.848215] /pci@300: MSI queues at RA [0000083f52c00000]
[99510.912425] PCI: Scanning PBM /pci@300
[99510.956337] pci_sun4v f02dbcfc: PCI host bridge to bus 0000:00
[99511.025812] pci_bus 0000:00: root bus resource [io  0x804000000000-0x80400fffffff] (bus address [0x0000-0xfffffff])
[99511.151039] pci_bus 0000:00: root bus resource [mem 0x800000000000-0x80007effffff] (bus address [0x00000000-0x7effffff])
[99511.282693] pci_bus 0000:00: root bus resource [mem 0x800100000000-0x8007ffffffff] (bus address [0x00000000-0x6ffffffff])
[99511.414878] pci_bus 0000:00: root bus resource [bus 00-77]
[99511.480699] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[99511.553694] pci 0000:00:01.0: PME# disabled
[99511.605095] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[99511.677979] pci 0000:01:00.0: PME# disabled
[99511.728118] pci 0000:02:04.0: PME# supported from D0 D3hot D3cold
[99511.801870] pci 0000:02:04.0: PME# disabled
[99511.852010] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[99511.924648] pci 0000:03:00.0: PME# disabled
[99511.974932] pci 0000:04:06.0: PME# supported from D0 D3hot D3cold
[99512.047804] pci 0000:04:06.0: PME# disabled
[99512.098102] pci 0000:05:00.0: PME# supported from D0 D3hot D3cold
[99512.170743] pci 0000:05:00.0: PME# disabled
[99512.220810] pci 0000:04:08.0: PME# supported from D0 D3hot D3cold
[99512.293448] pci 0000:04:08.0: PME# disabled
[99512.343744] pci 0000:06:00.0: PME# supported from D0 D3hot D3cold
[99512.416385] pci 0000:06:00.0: PME# disabled
[99512.466446] pci 0000:06:00.0: reg 0x184: [mem 0x800210204000-0x800210207fff 64bit]
[99512.557430] pci 0000:06:00.0: reg 0x190: [mem 0x800210304000-0x800210307fff 64bit]
[99512.648562] pci 0000:06:00.1: PME# supported from D0 D3hot D3cold
[99512.721203] pci 0000:06:00.1: PME# disabled
[99512.771407] pci 0000:06:00.1: reg 0x184: [mem 0x800210408000-0x80021040bfff 64bit]
[99512.862024] pci 0000:06:00.1: reg 0x190: [mem 0x800210800000-0x800210803fff 64bit]
[99512.951786] pci 0000:04:0c.0: PME# supported from D0 D3hot D3cold
[99513.024426] pci 0000:04:0c.0: PME# disabled
[99513.074980] pci 0000:07:00.0: supports D1 D2
[99513.126076] pci 0000:02:06.0: PME# supported from D0 D3hot D3cold
[99513.199379] pci 0000:02:06.0: PME# disabled
[99513.249214] pci 0000:05:00.0: can't claim BAR 0 [mem 0x800100000000-0x800100001fff]: no compatible bridge window
[99513.371531] pci 0000:06:00.0: can't claim BAR 0 [mem 0x800110000000-0x8001101fffff pref]: no compatible bridge window
[99513.499033] pci 0000:06:00.0: can't claim BAR 4 [mem 0x800110200000-0x800110203fff pref]: no compatible bridge window
[99513.627043] pci 0000:06:00.0: can't claim BAR 7 [mem 0x800210204000-0x800210303fff 64bit]: no compatible bridge window
[99513.755417] pci 0000:06:00.0: can't claim BAR 10 [mem 0x800210304000-0x800210403fff 64bit]: no compatible bridge window
[99513.884840] pci 0000:06:00.1: can't claim BAR 0 [mem 0x800110600000-0x8001107fffff pref]: no compatible bridge window
[99514.012160] pci 0000:06:00.1: can't claim BAR 4 [mem 0x800110404000-0x800110407fff pref]: no compatible bridge window
[99514.140459] pci 0000:06:00.1: can't claim BAR 7 [mem 0x800210408000-0x800210507fff 64bit]: no compatible bridge window
[99514.269519] pci 0000:06:00.1: can't claim BAR 10 [mem 0x800210800000-0x8002108fffff 64bit]: no compatible bridge window
[99514.400725] pci 0000:07:00.0: can't claim BAR 1 [mem 0x800120000000-0x80012000ffff]: no compatible bridge window
[99514.523057] pci 0000:07:00.0: can't claim BAR 3 [mem 0x800120040000-0x80012007ffff]: no compatible bridge window
[99514.648065] /pci@340: SUN4V PCI Bus Module
[99514.696315] /pci@340: On NUMA node -1
[99514.740020] /pci@340: PCI IO[804100000000] MEM[801000000000] MEM64[801100000000]
[99514.826423] /pci@340: Unable to request IOMMU resource.
[99514.970597] /pci@340: MSI Queue first[0] num[56] count[512] devino[0x6]
[99515.050828] /pci@340: MSI first[0] num[512] mask[0x3ff] width[32]
[99515.124125] /pci@340: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99515.220275] /pci@340: MSI queues at RA [0000083f52e00000]
[99515.285167] PCI: Scanning PBM /pci@340
[99515.329471] pci_sun4v f02eab24: PCI host bridge to bus 0001:00
[99515.399091] pci_bus 0001:00: root bus resource [io  0x804100000000-0x80410fffffff] (bus address [0x0000-0xfffffff])
[99515.526725] pci_bus 0001:00: root bus resource [mem 0x801000000000-0x80107effffff] (bus address [0x00000000-0x7effffff])
[99515.656457] pci_bus 0001:00: root bus resource [mem 0x801100000000-0x8017ffffffff] (bus address [0x00000000-0x6ffffffff])
[99515.787989] pci_bus 0001:00: root bus resource [bus 00-e2]
[99515.853588] pci 0001:00:01.0: PME# supported from D0 D3hot D3cold
[99515.926225] pci 0001:00:01.0: PME# disabled
[99515.976278] pci 0001:01:00.0: PME# supported from D0 D3hot D3cold
[99516.048915] pci 0001:01:00.0: PME# disabled
[99516.099049] pci 0001:02:06.0: PME# supported from D0 D3hot D3cold
[99516.171689] pci 0001:02:06.0: PME# disabled
[99516.221488] pci 0001:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99516.343554] pci 0001:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99516.466973] /pci@380: SUN4V PCI Bus Module
[99516.515408] /pci@380: On NUMA node -1
[99516.558582] /pci@380: PCI IO[80c000000000] MEM[808000000000] MEM64[808100000000]
[99516.644967] /pci@380: Unable to request IOMMU resource.
[99516.789501] /pci@380: MSI Queue first[0] num[56] count[512] devino[0x6]
[99516.870571] /pci@380: MSI first[0] num[512] mask[0x3ff] width[32]
[99516.943870] /pci@380: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99517.040954] /pci@380: MSI queues at RA [0000003f22c00000]
[99517.106841] PCI: Scanning PBM /pci@380
[99517.151136] pci_sun4v f02f994c: PCI host bridge to bus 0002:00
[99517.221541] pci_bus 0002:00: root bus resource [io  0x80c000000000-0x80c00fffffff] (bus address [0x0000-0xfffffff])
[99517.346955] pci_bus 0002:00: root bus resource [mem 0x808000000000-0x80807effffff] (bus address [0x00000000-0x7effffff])
[99517.478007] pci_bus 0002:00: root bus resource [mem 0x808100000000-0x8087ffffffff] (bus address [0x00000000-0x6ffffffff])
[99517.609842] pci_bus 0002:00: root bus resource [bus 00-e2]
[99517.676159] pci 0002:00:01.0: PME# supported from D0 D3hot D3cold
[99517.748800] pci 0002:00:01.0: PME# disabled
[99517.799058] pci 0002:01:00.0: PME# supported from D0 D3hot D3cold
[99517.871700] pci 0002:01:00.0: PME# disabled
[99517.922039] pci 0002:02:0a.0: PME# supported from D0 D3hot D3cold
[99517.994682] pci 0002:02:0a.0: PME# disabled
[99518.046128] pci 0002:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99518.168194] pci 0002:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99518.292879] pci 0002:03:00.0: can't claim BAR 1 [mem 0x808100000000-0x808100003fff]: no compatible bridge window
[99518.415656] pci 0002:03:00.1: can't claim BAR 1 [mem 0x808100004000-0x808100007fff]: no compatible bridge window
[99518.536997] /pci@3c0: SUN4V PCI Bus Module
[99518.585302] /pci@3c0: On NUMA node -1
[99518.628853] /pci@3c0: PCI IO[80c100000000] MEM[809000000000] MEM64[809100000000]
[99518.715316] /pci@3c0: Unable to request IOMMU resource.
[99518.858825] /pci@3c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[99518.936925] /pci@3c0: MSI first[0] num[512] mask[0x3ff] width[32]
[99519.009846] /pci@3c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99519.108371] /pci@3c0: MSI queues at RA [0000383f51000000]
[99519.172273] PCI: Scanning PBM /pci@3c0
[99519.216858] pci_sun4v f0308774: PCI host bridge to bus 0003:00
[99519.287180] pci_bus 0003:00: root bus resource [io  0x80c100000000-0x80c10fffffff] (bus address [0x0000-0xfffffff])
[99519.412960] pci_bus 0003:00: root bus resource [mem 0x809000000000-0x80907effffff] (bus address [0x00000000-0x7effffff])
[99519.544976] pci_bus 0003:00: root bus resource [mem 0x809100000000-0x8097ffffffff] (bus address [0x00000000-0x6ffffffff])
[99519.678059] pci_bus 0003:00: root bus resource [bus 00-e2]
[99519.743919] pci 0003:00:01.0: PME# supported from D0 D3hot D3cold
[99519.814818] pci 0003:00:01.0: PME# disabled
[99519.866431] pci 0003:01:00.0: PME# supported from D0 D3hot D3cold
[99519.939865] pci 0003:01:00.0: PME# disabled
[99519.990211] pci 0003:02:0e.0: PME# supported from D0 D3hot D3cold
[99520.062856] pci 0003:02:0e.0: PME# disabled
[99520.113650] pci 0003:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99520.235330] pci 0003:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99520.357772] /pci@400: SUN4V PCI Bus Module
[99520.405817] /pci@400: On NUMA node -1
[99520.448992] /pci@400: PCI IO[814000000000] MEM[810000000000] MEM64[810100000000]
[99520.536091] /pci@400: Unable to request IOMMU resource.
[99520.680558] /pci@400: MSI Queue first[0] num[56] count[512] devino[0x6]
[99520.759504] /pci@400: MSI first[0] num[512] mask[0x3ff] width[32]
[99520.832344] /pci@400: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99520.930212] /pci@400: MSI queues at RA [0000303f52000000]
[99520.994424] PCI: Scanning PBM /pci@400
[99521.038711] pci_sun4v f031759c: PCI host bridge to bus 0004:00
[99521.108229] pci_bus 0004:00: root bus resource [io  0x814000000000-0x81400fffffff] (bus address [0x0000-0xfffffff])
[99521.233481] pci_bus 0004:00: root bus resource [mem 0x810000000000-0x81007effffff] (bus address [0x00000000-0x7effffff])
[99521.363957] pci_bus 0004:00: root bus resource [mem 0x810100000000-0x8107ffffffff] (bus address [0x00000000-0x6ffffffff])
[99521.496396] pci_bus 0004:00: root bus resource [bus 00-72]
[99521.562164] pci 0004:00:01.0: PME# supported from D0 D3hot D3cold
[99521.634804] pci 0004:00:01.0: PME# disabled
[99521.685036] pci 0004:01:00.0: PME# supported from D0 D3hot D3cold
[99521.757678] pci 0004:01:00.0: PME# disabled
[99521.808242] pci 0004:02:0c.0: PME# supported from D0 D3hot D3cold
[99521.880883] pci 0004:02:0c.0: PME# disabled
[99521.930888] /pci@440: SUN4V PCI Bus Module
[99521.979323] /pci@440: On NUMA node -1
[99522.022497] /pci@440: PCI IO[814100000000] MEM[811000000000] MEM64[811100000000]
[99522.109696] /pci@440: Unable to request IOMMU resource.
[99522.254072] /pci@440: MSI Queue first[0] num[56] count[512] devino[0x6]
[99522.333014] /pci@440: MSI first[0] num[512] mask[0x3ff] width[32]
[99522.405638] /pci@440: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99522.503650] /pci@440: MSI queues at RA [0000303f52200000]
[99522.568261] PCI: Scanning PBM /pci@440
[99522.612761] pci_sun4v f03263c4: PCI host bridge to bus 0005:00
[99522.682232] pci_bus 0005:00: root bus resource [io  0x814100000000-0x81410fffffff] (bus address [0x0000-0xfffffff])
[99522.806451] pci_bus 0005:00: root bus resource [mem 0x811000000000-0x81107effffff] (bus address [0x00000000-0x7effffff])
[99522.938227] pci_bus 0005:00: root bus resource [mem 0x811100000000-0x8117ffffffff] (bus address [0x00000000-0x6ffffffff])
[99523.069754] pci_bus 0005:00: root bus resource [bus 00-e2]
[99523.135815] pci 0005:00:01.0: PME# supported from D0 D3hot D3cold
[99523.208736] pci 0005:00:01.0: PME# disabled
[99523.258961] pci 0005:01:00.0: PME# supported from D0 D3hot D3cold
[99523.331797] pci 0005:01:00.0: PME# disabled
[99523.383485] pci 0005:02:0c.0: PME# supported from D0 D3hot D3cold
[99523.456568] pci 0005:02:0c.0: PME# disabled
[99523.506432] pci 0005:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99523.629143] pci 0005:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99523.753414] /pci@480: SUN4V PCI Bus Module
[99523.801849] /pci@480: On NUMA node -1
[99523.845022] /pci@480: PCI IO[81c000000000] MEM[818000000000] MEM64[818100000000]
[99523.932615] /pci@480: Unable to request IOMMU resource.
[99524.076906] /pci@480: MSI Queue first[0] num[56] count[512] devino[0x6]
[99524.155853] /pci@480: MSI first[0] num[512] mask[0x3ff] width[32]
[99524.228476] /pci@480: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99524.325497] /pci@480: MSI queues at RA [0000283f52e00000]
[99524.389705] PCI: Scanning PBM /pci@480
[99524.433989] pci_sun4v f03351ec: PCI host bridge to bus 0006:00
[99524.503926] pci_bus 0006:00: root bus resource [io  0x81c000000000-0x81c00fffffff] (bus address [0x0000-0xfffffff])
[99524.629142] pci_bus 0006:00: root bus resource [mem 0x818000000000-0x81807effffff] (bus address [0x00000000-0x7effffff])
[99524.759618] pci_bus 0006:00: root bus resource [mem 0x818100000000-0x8187ffffffff] (bus address [0x00000000-0x6ffffffff])
[99524.893376] pci_bus 0006:00: root bus resource [bus 00-e2]
[99524.960220] pci 0006:00:01.0: PME# supported from D0 D3hot D3cold
[99525.031339] pci 0006:00:01.0: PME# disabled
[99525.081576] pci 0006:01:00.0: PME# supported from D0 D3hot D3cold
[99525.154216] pci 0006:01:00.0: PME# disabled
[99525.205799] pci 0006:02:04.0: PME# supported from D0 D3hot D3cold
[99525.278771] pci 0006:02:04.0: PME# disabled
[99525.329385] pci 0006:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99525.452093] pci 0006:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99525.574897] /pci@4c0: SUN4V PCI Bus Module
[99525.623340] /pci@4c0: On NUMA node -1
[99525.666512] /pci@4c0: PCI IO[81c100000000] MEM[819000000000] MEM64[819100000000]
[99525.753114] /pci@4c0: Unable to request IOMMU resource.
[99525.897360] /pci@4c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[99525.976307] /pci@4c0: MSI first[0] num[512] mask[0x3ff] width[32]
[99526.048930] /pci@4c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99526.146795] /pci@4c0: MSI queues at RA [0000203f52000000]
[99526.211003] PCI: Scanning PBM /pci@4c0
[99526.255286] pci_sun4v f0344014: PCI host bridge to bus 0007:00
[99526.324756] pci_bus 0007:00: root bus resource [io  0x81c100000000-0x81c10fffffff] (bus address [0x0000-0xfffffff])
[99526.450340] pci_bus 0007:00: root bus resource [mem 0x819000000000-0x81907effffff] (bus address [0x00000000-0x7effffff])
[99526.581713] pci_bus 0007:00: root bus resource [mem 0x819100000000-0x8197ffffffff] (bus address [0x00000000-0x6ffffffff])
[99526.713241] pci_bus 0007:00: root bus resource [bus 00-e2]
[99526.781211] pci 0007:00:01.0: PME# supported from D0 D3hot D3cold
[99526.852852] pci 0007:00:01.0: PME# disabled
[99526.903084] pci 0007:01:00.0: PME# supported from D0 D3hot D3cold
[99526.976241] pci 0007:01:00.0: PME# disabled
[99527.027245] pci 0007:02:08.0: PME# supported from D0 D3hot D3cold
[99527.100229] pci 0007:02:08.0: PME# disabled
[99527.150104] pci 0007:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99527.274705] pci 0007:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99527.397074] /pci@500: SUN4V PCI Bus Module
[99527.446322] /pci@500: On NUMA node -1
[99527.489514] /pci@500: PCI IO[824000000000] MEM[820000000000] MEM64[820100000000]
[99527.575901] /pci@500: Unable to request IOMMU resource.
[99527.719516] /pci@500: MSI Queue first[0] num[56] count[512] devino[0x6]
[99527.798459] /pci@500: MSI first[0] num[512] mask[0x3ff] width[32]
[99527.870387] /pci@500: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99527.969430] /pci@500: MSI queues at RA [0000203f52400000]
[99528.033638] PCI: Scanning PBM /pci@500
[99528.078677] pci_sun4v f0352e3c: PCI host bridge to bus 0008:00
[99528.149236] pci_bus 0008:00: root bus resource [io  0x824000000000-0x82400fffffff] (bus address [0x0000-0xfffffff])
[99528.274452] pci_bus 0008:00: root bus resource [mem 0x820000000000-0x82007effffff] (bus address [0x00000000-0x7effffff])
[99528.404926] pci_bus 0008:00: root bus resource [mem 0x820100000000-0x8207ffffffff] (bus address [0x00000000-0x6ffffffff])
[99528.536452] pci_bus 0008:00: root bus resource [bus 00-e2]
[99528.602200] pci 0008:00:01.0: PME# supported from D0 D3hot D3cold
[99528.674840] pci 0008:00:01.0: PME# disabled
[99528.725176] pci 0008:01:00.0: PME# supported from D0 D3hot D3cold
[99528.799173] pci 0008:01:00.0: PME# disabled
[99528.849512] pci 0008:02:0e.0: PME# supported from D0 D3hot D3cold
[99528.922152] pci 0008:02:0e.0: PME# disabled
[99528.972146] pci 0008:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99529.094208] pci 0008:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99529.216981] /pci@540: SUN4V PCI Bus Module
[99529.265415] /pci@540: On NUMA node -1
[99529.308588] /pci@540: PCI IO[824100000000] MEM[821000000000] MEM64[821100000000]
[99529.395957] /pci@540: Unable to request IOMMU resource.
[99529.540284] /pci@540: MSI Queue first[0] num[56] count[512] devino[0x6]
[99529.619589] /pci@540: MSI first[0] num[512] mask[0x3ff] width[32]
[99529.691263] /pci@540: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99529.789745] /pci@540: MSI queues at RA [0000103f52200000]
[99529.853951] PCI: Scanning PBM /pci@540
[99529.898235] pci_sun4v f0361c64: PCI host bridge to bus 0009:00
[99529.967707] pci_bus 0009:00: root bus resource [io  0x824100000000-0x82410fffffff] (bus address [0x0000-0xfffffff])
[99530.093622] pci_bus 0009:00: root bus resource [mem 0x821000000000-0x82107effffff] (bus address [0x00000000-0x7effffff])
[99530.224956] pci_bus 0009:00: root bus resource [mem 0x821100000000-0x8217ffffffff] (bus address [0x00000000-0x6ffffffff])
[99530.356482] pci_bus 0009:00: root bus resource [bus 00-e2]
[99530.422229] pci 0009:00:01.0: PME# supported from D0 D3hot D3cold
[99530.494870] pci 0009:00:01.0: PME# disabled
[99530.545099] pci 0009:01:00.0: PME# supported from D0 D3hot D3cold
[99530.617740] pci 0009:01:00.0: PME# disabled
[99530.668075] pci 0009:02:0e.0: PME# supported from D0 D3hot D3cold
[99530.742156] pci 0009:02:0e.0: PME# disabled
[99530.793011] pci 0009:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99530.915120] pci 0009:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99531.037712] /pci@580: SUN4V PCI Bus Module
[99531.085749] /pci@580: On NUMA node -1
[99531.129374] /pci@580: PCI IO[82c000000000] MEM[828000000000] MEM64[828100000000]
[99531.216490] /pci@580: Unable to request IOMMU resource.
[99531.358697] /pci@580: MSI Queue first[0] num[56] count[512] devino[0x6]
[99531.436548] /pci@580: MSI first[0] num[512] mask[0x3ff] width[32]
[99531.509171] /pci@580: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99531.608172] /pci@580: MSI queues at RA [0000103f52400000]
[99531.672723] PCI: Scanning PBM /pci@580
[99531.717012] pci_sun4v f0370a8c: PCI host bridge to bus 000a:00
[99531.786483] pci_bus 000a:00: root bus resource [io  0x82c000000000-0x82c00fffffff] (bus address [0x0000-0xfffffff])
[99531.910756] pci_bus 000a:00: root bus resource [mem 0x828000000000-0x82807effffff] (bus address [0x00000000-0x7effffff])
[99532.041232] pci_bus 000a:00: root bus resource [mem 0x828100000000-0x8287ffffffff] (bus address [0x00000000-0x6ffffffff])
[99532.172204] pci_bus 000a:00: root bus resource [bus 00-e2]
[99532.237154] pci 000a:00:01.0: PME# supported from D0 D3hot D3cold
[99532.310079] pci 000a:00:01.0: PME# disabled
[99532.360363] pci 000a:01:00.0: PME# supported from D0 D3hot D3cold
[99532.434003] pci 000a:01:00.0: PME# disabled
[99532.485752] pci 000a:02:0a.0: PME# supported from D0 D3hot D3cold
[99532.558392] pci 000a:02:0a.0: PME# disabled
[99532.608261] pci 000a:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99532.731887] pci 000a:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99532.853554] /pci@5c0: SUN4V PCI Bus Module
[99532.901989] /pci@5c0: On NUMA node -1
[99532.945163] /pci@5c0: PCI IO[82c100000000] MEM[829000000000] MEM64[829100000000]
[99533.031552] /pci@5c0: Unable to request IOMMU resource.
[99533.174637] /pci@5c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[99533.253577] /pci@5c0: MSI first[0] num[512] mask[0x3ff] width[32]
[99533.326201] /pci@5c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99533.424766] /pci@5c0: MSI queues at RA [0000083f52000000]
[99533.489295] PCI: Scanning PBM /pci@5c0
[99533.533589] pci_sun4v f037f8b4: PCI host bridge to bus 000b:00
[99533.603223] pci_bus 000b:00: root bus resource [io  0x82c100000000-0x82c10fffffff] (bus address [0x0000-0xfffffff])
[99533.729026] pci_bus 000b:00: root bus resource [mem 0x829000000000-0x82907effffff] (bus address [0x00000000-0x7effffff])
[99533.858109] pci_bus 000b:00: root bus resource [mem 0x829100000000-0x8297ffffffff] (bus address [0x00000000-0x6ffffffff])
[99533.990444] pci_bus 000b:00: root bus resource [bus 00-72]
[99534.056219] pci 000b:00:01.0: PME# supported from D0 D3hot D3cold
[99534.127991] pci 000b:00:01.0: PME# disabled
[99534.178218] pci 000b:01:00.0: PME# supported from D0 D3hot D3cold
[99534.251087] pci 000b:01:00.0: PME# disabled
[99534.301416] pci 000b:02:08.0: PME# supported from D0 D3hot D3cold
[99534.374056] pci 000b:02:08.0: PME# disabled
[99534.424013] /pci@600: SUN4V PCI Bus Module
[99534.472448] /pci@600: On NUMA node -1
[99534.515622] /pci@600: PCI IO[834000000000] MEM[830000000000] MEM64[830100000000]
[99534.602324] /pci@600: Unable to request IOMMU resource.
[99534.745582] /pci@600: MSI Queue first[0] num[56] count[512] devino[0x6]
[99534.824522] /pci@600: MSI first[0] num[512] mask[0x3ff] width[32]
[99534.897145] /pci@600: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99534.995012] /pci@600: MSI queues at RA [0000083f52200000]
[99535.059222] PCI: Scanning PBM /pci@600
[99535.103508] pci_sun4v f038e6dc: PCI host bridge to bus 000c:00
[99535.174381] pci_bus 000c:00: root bus resource [io  0x834000000000-0x83400fffffff] (bus address [0x0000-0xfffffff])
[99535.300370] pci_bus 000c:00: root bus resource [mem 0x830000000000-0x83007effffff] (bus address [0x00000000-0x7effffff])
[99535.432186] pci_bus 000c:00: root bus resource [mem 0x830100000000-0x8307ffffffff] (bus address [0x00000000-0x6ffffffff])
[99535.564608] pci_bus 000c:00: root bus resource [bus 00-e2]
[99535.630975] pci 000c:00:01.0: PME# supported from D0 D3hot D3cold
[99535.704258] pci 000c:00:01.0: PME# disabled
[99535.754501] pci 000c:01:00.0: PME# supported from D0 D3hot D3cold
[99535.827829] pci 000c:01:00.0: PME# disabled
[99535.878167] pci 000c:02:08.0: PME# supported from D0 D3hot D3cold
[99535.951074] pci 000c:02:08.0: PME# disabled
[99536.000958] pci 000c:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99536.122642] pci 000c:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99536.243745] /pci@640: SUN4V PCI Bus Module
[99536.292179] /pci@640: On NUMA node -1
[99536.335352] /pci@640: PCI IO[834100000000] MEM[831000000000] MEM64[831100000000]
[99536.422293] /pci@640: Unable to request IOMMU resource.
[99536.565187] /pci@640: MSI Queue first[0] num[56] count[512] devino[0x6]
[99536.643237] /pci@640: MSI first[0] num[512] mask[0x3ff] width[32]
[99536.714600] /pci@640: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99536.813118] /pci@640: MSI queues at RA [0000083f52400000]
[99536.877326] PCI: Scanning PBM /pci@640
[99536.921617] pci_sun4v f039d504: PCI host bridge to bus 000d:00
[99536.991088] pci_bus 000d:00: root bus resource [io  0x834100000000-0x83410fffffff] (bus address [0x0000-0xfffffff])
[99537.116303] pci_bus 000d:00: root bus resource [mem 0x831000000000-0x83107effffff] (bus address [0x00000000-0x7effffff])
[99537.246778] pci_bus 000d:00: root bus resource [mem 0x831100000000-0x8317ffffffff] (bus address [0x00000000-0x6ffffffff])
[99537.378309] pci_bus 000d:00: root bus resource [bus 00-e2]
[99537.444041] pci 000d:00:01.0: PME# supported from D0 D3hot D3cold
[99537.516683] pci 000d:00:01.0: PME# disabled
[99537.566930] pci 000d:01:00.0: PME# supported from D0 D3hot D3cold
[99537.640404] pci 000d:01:00.0: PME# disabled
[99537.690747] pci 000d:02:08.0: PME# supported from D0 D3hot D3cold
[99537.764736] pci 000d:02:08.0: PME# disabled
[99537.816255] pci 000d:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99537.938319] pci 000d:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99538.060380] pci 000d:03:00.0: can't claim BAR 0 [mem 0x831100000000-0x831100001fff]: no compatible bridge window
[99538.182619] pci 000d:03:00.0: can't claim BAR 2 [mem 0x831100004000-0x831100007fff]: no compatible bridge window
[99538.304976] pci 000d:03:00.1: can't claim BAR 0 [mem 0x831100002000-0x831100003fff]: no compatible bridge window
[99538.427982] pci 000d:03:00.1: can't claim BAR 2 [mem 0x831100008000-0x83110000bfff]: no compatible bridge window
[99538.551205] /pci@680: SUN4V PCI Bus Module
[99538.599709] /pci@680: On NUMA node -1
[99538.642881] /pci@680: PCI IO[83c000000000] MEM[838000000000] MEM64[838100000000]
[99538.729266] /pci@680: Unable to request IOMMU resource.
[99538.871447] /pci@680: MSI Queue first[0] num[56] count[512] devino[0x6]
[99538.951833] /pci@680: MSI first[0] num[512] mask[0x3ff] width[32]
[99539.024456] /pci@680: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99539.122322] /pci@680: MSI queues at RA [0000303f52400000]
[99539.186530] PCI: Scanning PBM /pci@680
[99539.230817] pci_sun4v f03ac32c: PCI host bridge to bus 000e:00
[99539.300292] pci_bus 000e:00: root bus resource [io  0x83c000000000-0x83c00fffffff] (bus address [0x0000-0xfffffff])
[99539.425508] pci_bus 000e:00: root bus resource [mem 0x838000000000-0x83807effffff] (bus address [0x00000000-0x7effffff])
[99539.556059] pci_bus 000e:00: root bus resource [mem 0x838100000000-0x8387ffffffff] (bus address [0x00000000-0x6ffffffff])
[99539.688095] pci_bus 000e:00: root bus resource [bus 00-e2]
[99539.754096] pci 000e:00:01.0: PME# supported from D0 D3hot D3cold
[99539.826738] pci 000e:00:01.0: PME# disabled
[99539.877564] pci 000e:01:00.0: PME# supported from D0 D3hot D3cold
[99539.951138] pci 000e:01:00.0: PME# disabled
[99540.001474] pci 000e:02:04.0: PME# supported from D0 D3hot D3cold
[99540.074169] pci 000e:02:04.0: PME# disabled
[99540.124571] pci 000e:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99540.246677] pci 000e:00:01.0: can't claim BAR 15 [mem 0x100000000-0x7efffffff pref]: no compatible bridge window
[99540.369663] /pci@6c0: SUN4V PCI Bus Module
[99540.418097] /pci@6c0: On NUMA node -1
[99540.461269] /pci@6c0: PCI IO[83c100000000] MEM[839000000000] MEM64[839100000000]
[99540.547683] /pci@6c0: Unable to request IOMMU resource.
[99540.627341] /pci@6c0: Imported 13 TSB entries from OBP
[99540.751465] /pci@6c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[99540.830403] /pci@6c0: MSI first[0] num[512] mask[0x3ff] width[32]
[99540.903814] /pci@6c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[99541.001681] /pci@6c0: MSI queues at RA [0000303f52600000]
[99541.065890] PCI: Scanning PBM /pci@6c0
[99541.110179] pci_sun4v f03bb154: PCI host bridge to bus 000f:00
[99541.179649] pci_bus 000f:00: root bus resource [io  0x83c100000000-0x83c10fffffff] (bus address [0x0000-0xfffffff])
[99541.304866] pci_bus 000f:00: root bus resource [mem 0x839000000000-0x83907effffff] (bus address [0x00000000-0x7effffff])
[99541.436005] pci_bus 000f:00: root bus resource [mem 0x839100000000-0x8397ffffffff] (bus address [0x00000000-0x6ffffffff])
[99541.567578] pci_bus 000f:00: root bus resource [bus 00-78]
[99541.633939] pci 000f:00:01.0: PME# supported from D0 D3hot D3cold
[99541.706581] pci 000f:00:01.0: PME# disabled
[99541.756813] pci 000f:01:00.0: PME# supported from D0 D3hot D3cold
[99541.829453] pci 000f:01:00.0: PME# disabled
[99541.879786] pci 000f:02:04.0: PME# supported from D0 D3hot D3cold
[99541.953244] pci 000f:02:04.0: PME# disabled
[99542.004364] pci 000f:02:0c.0: PME# supported from D0 D3hot D3cold
[99542.077004] pci 000f:02:0c.0: PME# disabled
[99542.127321] pci 000f:73:00.0: PME# supported from D0 D3hot D3cold
[99542.199963] pci 000f:73:00.0: PME# disabled
[99542.251137] pci 000f:74:04.0: PME# supported from D0 D3hot D3cold
[99542.324001] pci 000f:74:04.0: PME# disabled
[99542.374523] pci 000f:75:00.0: PME# supported from D0 D3hot D3cold
[99542.447166] pci 000f:75:00.0: PME# disabled
[99542.496977] pci 000f:75:00.0: reg 0x184: [mem 0x839580204000-0x839580207fff 64bit]
[99542.588188] pci 000f:75:00.0: reg 0x190: [mem 0x839580304000-0x839580307fff 64bit]
[99542.678494] pci 000f:75:00.1: PME# supported from D0 D3hot D3cold
[99542.751137] pci 000f:75:00.1: PME# disabled
[99542.800912] pci 000f:75:00.1: reg 0x184: [mem 0x839580408000-0x83958040bfff 64bit]
[99542.891572] pci 000f:75:00.1: reg 0x190: [mem 0x839580800000-0x839580803fff 64bit]
[99542.982228] pci 000f:74:06.0: PME# supported from D0 D3hot D3cold
[99543.055221] pci 000f:74:06.0: PME# disabled
[99543.106229] pci 000f:76:00.0: PME# supported from D0 D3hot D3cold
[99543.178872] pci 000f:76:00.0: PME# disabled
[99543.230026] pci 000f:74:07.0: PME# supported from D0 D3hot D3cold
[99543.303975] pci 000f:74:07.0: PME# disabled
[99543.355128] pci 000f:74:0c.0: PME# supported from D0 D3hot D3cold
[99543.428146] pci 000f:74:0c.0: PME# disabled
[99543.478993] pci 000f:78:00.0: supports D1 D2
[99543.530717] pci 000f:75:00.0: can't claim BAR 0 [mem 0x839480000000-0x8394801fffff pref]: no compatible bridge window
[99543.656894] pci 000f:75:00.0: can't claim BAR 4 [mem 0x839480200000-0x839480203fff pref]: no compatible bridge window
[99543.785141] pci 000f:75:00.0: can't claim BAR 7 [mem 0x839580204000-0x839580303fff 64bit]: no compatible bridge window
[99543.915709] pci 000f:75:00.0: can't claim BAR 10 [mem 0x839580304000-0x839580403fff 64bit]: no compatible bridge window
[99544.045948] pci 000f:75:00.1: can't claim BAR 0 [mem 0x839480600000-0x8394807fffff pref]: no compatible bridge window
[99544.174797] pci 000f:75:00.1: can't claim BAR 4 [mem 0x839480404000-0x839480407fff pref]: no compatible bridge window
[99544.302988] pci 000f:75:00.1: can't claim BAR 7 [mem 0x839580408000-0x839580507fff 64bit]: no compatible bridge window
[99544.432331] pci 000f:75:00.1: can't claim BAR 10 [mem 0x839580800000-0x8395808fffff 64bit]: no compatible bridge window
[99544.560901] pci 000f:76:00.0: can't claim BAR 0 [mem 0x839490000000-0x839490001fff]: no compatible bridge window
[99544.684447] pci 000f:78:00.0: can't claim BAR 1 [mem 0x8394a0000000-0x8394a000ffff]: no compatible bridge window
[99544.806738] pci 000f:78:00.0: can't claim BAR 3 [mem 0x8394a0040000-0x8394a007ffff]: no compatible bridge window
[99544.995877] vgaarb: device added: PCI:000f:77:00.0,decodes=io+mem,owns=none,locks=none
[99545.090858] vgaarb: loaded
[99545.122797] vgaarb: bridge control possible 000f:77:00.0
[99545.196673] SCSI subsystem initialized
[99545.246572] libata version 3.00 loaded.
[99545.292053] usbcore: registered new interface driver usbfs
[99545.357354] usbcore: registered new interface driver hub
[99545.428267] usbcore: registered new device driver usb
[99545.501630] NetLabel: Initializing
[99545.541658] NetLabel:  domain hash size = 128
[99545.594193] NetLabel:  protocols = UNLABELED CIPSOv4
[99545.653584] NetLabel:  unlabeled traffic allowed by default
[99545.721925] SUN4V: Reboot data supported (maj=1,min=0).
[99545.783202] ds.c:v1.0 (Jul 11, 2007)
[99545.834883] Switched to clocksource stick
[99545.863230] ds-1: Registered pri service.
[99545.868944] ds-1: Registered var-config-backup service.
[99546.078703] NET: Registered protocol family 2
[99546.146274] TCP established hash table entries: 524288 (order: 9, 4194304 bytes)
[99546.238320] TCP bind hash table entries: 65536 (order: 7, 1048576 bytes)
[99546.319143] TCP: Hash tables configured (established 524288 bind 65536)
[99546.397230] TCP: reno registered
[99546.436150] UDP hash table entries: 65536 (order: 8, 2097152 bytes)
[99546.513175] UDP-Lite hash table entries: 65536 (order: 8, 2097152 bytes)
[99546.609346] NET: Registered protocol family 1
[99546.661055] pci 0000:05:00.0: calling quirk_usb_early_handoff+0x0/0x220
[99546.747867] pci 0000:05:00.0: xHCI BIOS handoff failed (BIOS bug ?) 00010401
[99546.838131] pci 0000:06:00.0: calling quirk_e100_interrupt+0x0/0x220
[99546.913932] pci 0000:06:00.1: calling quirk_e100_interrupt+0x0/0x220
[99546.990254] pci 000f:75:00.0: calling quirk_e100_interrupt+0x0/0x220
[99547.066051] pci 000f:75:00.1: calling quirk_e100_interrupt+0x0/0x220
[99547.141854] pci 000f:76:00.0: calling quirk_usb_early_handoff+0x0/0x220
[99547.227385] pci 000f:76:00.0: xHCI BIOS handoff failed (BIOS bug ?) 00010401
[99547.318557] PCI: CLS mismatch (64 != 512), using 64 bytes
[99547.383082] Trying to unpack rootfs image as initramfs...
[99547.723565] Freeing initrd memory: 7408K (fff8380004000000 - fff838000473c000)
[99547.839330] futex hash table entries: 262144 (order: 11, 16777216 bytes)
[99547.928300] Initialise system trusted keyring
[99547.984333] audit: initializing netlink subsys (disabled)
[99548.048598] audit: type=2000 audit(11.048:1): initialized
[99548.116166] HugeTLB registered 8 MB page size, pre-allocated 0 pages
[99548.203415] VFS: Disk quotas dquot_6.5.2
[99548.257670] VFS: Dquot-cache hash table entries: 1024 (order 0, 8192 bytes)
[99548.369004] SELinux:  Registering netfilter hooks
[99548.429625] alg: No test for stdrng (krng)
[99548.478146] Key type asymmetric registered
[99548.527042] Asymmetric key parser 'x509' registered
[99548.586173] bounce: pool size: 64 pages
[99548.636263] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
[99548.730489] io scheduler noop registered
[99548.775819] io scheduler deadline registered (default)
[99548.840996] io scheduler cfq registered
[99548.887239] f0290cf4: ttyS0 at I/O 0x0 (irq = 1, base_baud = 115200) is a SUN4V HCONS
[99557.711898] console [ttyHV0] enabled
[99557.763936] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[99557.941059] brd: module loaded
[99558.150688] loop: module loaded
[99558.198824] zram: Created 1 device(s)
[99558.255226] libphy: Fixed MDIO Bus: probed
[99558.313021] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[99558.404743] ehci-pci: EHCI PCI platform driver
[99558.468170] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[99558.556329] ohci-pci: OHCI PCI platform driver
[99558.618745] uhci_hcd: USB Universal Host Controller Interface driver
[99558.709195] mousedev: PS/2 mouse device common for all mice
[99558.789488] rtc-sun4v rtc-sun4v: rtc core: registered sun4v as rtc0
[99558.878301] hidraw: raw HID events driver (C) Jiri Kosina
[99558.954449] usbcore: registered new interface driver usbhid
[99559.031777] usbhid: USB HID core driver
[99559.085632] drop_monitor: Initializing network drop monitor service
[99559.175368] TCP: cubic registered
[99559.221754] Initializing XFRM netlink socket
[99559.281720] NET: Registered protocol family 17
[99559.345109] Key type dns_resolver registered
[99559.410546] Loading compiled-in X.509 certificates
[99559.478705] Loaded X.509 cert 'Magrathea: Glacier signing key: dbc223be1a955463bb52b6d4075d495a808a787e'
[99559.612730] registered taskstats version 1
[99559.670244] ima: No TPM chip found, activating TPM-bypass!
[99559.758915] rtc-sun4v rtc-sun4v: setting system clock to 2015-03-28 03:44:08 UTC (1427514248)
[99559.917299] dracut: dracut-004-336.0.2.el6_5.2
[99559.994479] dracut: rd_NO_LUKS: removing cryptoluks activation
[99560.088959] dm_mod: module verification failed: signature and/or required key missing - tainting kernel
[99560.229347] device-mapper: uevent: version 1.0.3
[99560.301351] device-mapper: ioctl: 4.30.0-ioctl (2014-12-22) initialised: dm-devel@redhat.com
[99560.444289] udev: starting version 147
[99560.696120] dracut: Starting plymouth daemon
[99560.898411] sha256_sparc64: Using sparc64 sha256 opcode optimized SHA-256/SHA-224 implementation
[99561.023617] aes_sparc64: Using sparc64 aes opcodes optimized AES implementation
[99563.861017] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.16-k.
[99563.976276] qla2xxx [0002:03:00.0]-001d: : Found an ISP2532 irq 11 iobase 0x0000808100000000.
[99564.102864] qla2xxx 0002:03:00.0: enabling Mem-Wr-Inval
[99567.047422] scsi host0: qla2xxx
[99567.107118] qla2xxx [0002:03:00.0]-00fb:0: QLogic QLE2562 - Sun StorageTek 8Gb FC PCIe HBA, dual port.
[99567.238521] qla2xxx [0002:03:00.0]-00fc:0: ISP2532: PCIe (2.5GT/s x8) @ 0002:03:00.0 hdma- host#=0 fw=7.03.00 (90d5).
[99567.318490] qla2xxx [0002:03:00.0]-500a:0: LOOP UP detected (8 Gbps).
[99567.479109] qla2xxx [0002:03:00.1]-001d: : Found an ISP2532 irq 12 iobase 0x0000808100004000.
[99567.604749] qla2xxx 0002:03:00.1: enabling Mem-Wr-Inval
[99567.808718] qla2xxx [0002:03:00.0]-2064:0: SNS scan failed -- assuming zero-entry result.
[99570.547399] scsi host1: qla2xxx
[99570.606221] qla2xxx [0002:03:00.1]-00fb:1: QLogic QLE2562 - Sun StorageTek 8Gb FC PCIe HBA, dual port.
[99570.738878] qla2xxx [0002:03:00.1]-00fc:1: ISP2532: PCIe (2.5GT/s x8) @ 0002:03:00.1 hdma- host#=1 fw=7.03.00 (90d5).
[99575.626200] Emulex LightPulse Fibre Channel SCSI driver 10.4.8000.0.
[99575.715500] Copyright(c) 2004-2014 Emulex.  All rights reserved.
[99575.801146] lpfc 000d:03:00.0: enabling Mem-Wr-Inval
[99575.872884] scsi host2: Emulex LPe12000-S PCIe Fibre Channel Adapter  on PCI bus 03 device 00 irq 35
[99578.459989] lpfc 000d:03:00.1: enabling Mem-Wr-Inval
[99578.531736] scsi host3: Emulex LPe12000-S PCIe Fibre Channel Adapter  on PCI bus 03 device 01 irq 36
[99581.186870] mpt2sas version 20.100.00.00 loaded
[99581.251058] mpt2sas 0000:07:00.0: enabling bus mastering
[99581.325675] mpt2sas0: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (2127134424 kB)
[99581.727355] mpt2sas0: MSI-X vectors supported: 8, no of cores: 1024, max_msix_vectors: 8
[99581.850980] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 973
[99581.923760] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 974
[99581.996620] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 975
[99582.069204] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 976
[99582.141586] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 977
[99582.214026] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 978
[99582.286707] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 979
[99582.360328] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 980
[99582.432544] mpt2sas0: iomem(0x0000800120000000), mapped(0x0000800120000000), size(65536)
[99582.546129] mpt2sas0: ioport(0x0000804000001000), size(256)
[99583.059890] mpt2sas0: Allocated physical memory: size(4603 kB)
[99583.141804] mpt2sas0: Current Controller Queue Depth(2811), Max Controller Queue Depth(3072)
[99583.260579] mpt2sas0: Scatter Gather Elements per IO(128)
[99583.568932] mpt2sas0: LSISAS2308: FWVersion(14.00.00.00), ChipRevision(0x05), BiosVersion(00.00.00.00)
[99583.700422] mpt2sas0: Protocol=(Initiator), Capabilities=(Raid,TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
[99583.858220] scsi host4: Fusion MPT SAS Host
[99583.923540] mpt2sas0: sending port enable !!
[99583.924088] mpt2sas1: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (2127134424 kB)
[99584.211350] mpt2sas1: MSI-X vectors supported: 8, no of cores: 1024, max_msix_vectors: 8
[99584.334957] mpt2sas1-msix0: PCI-MSI-X enabled: IRQ 981
[99584.407435] mpt2sas1-msix1: PCI-MSI-X enabled: IRQ 982
[99584.479651] mpt2sas1-msix2: PCI-MSI-X enabled: IRQ 983
[99584.551869] mpt2sas1-msix3: PCI-MSI-X enabled: IRQ 984
[99584.623721] mpt2sas1-msix4: PCI-MSI-X enabled: IRQ 985
[99584.695936] mpt2sas1-msix5: PCI-MSI-X enabled: IRQ 986
[99584.768644] mpt2sas1-msix6: PCI-MSI-X enabled: IRQ 987
[99584.843729] mpt2sas1-msix7: PCI-MSI-X enabled: IRQ 988
[99584.916193] mpt2sas1: iomem(0x00008394a0000000), mapped(0x00008394a0000000), size(65536)
[99585.030699] mpt2sas1: ioport(0x000083c104001000), size(256)
[99585.543784] mpt2sas1: Allocated physical memory: size(4603 kB)
[99585.625695] mpt2sas1: Current Controller Queue Depth(2811), Max Controller Queue Depth(3072)
[99585.716420] mpt2sas0: host_add: handle(0x0001), sas_addr(0x508002000159c0d0), phys(8)
[99585.854932] mpt2sas1: Scatter Gather Elements per IO(128)
[99586.164464] mpt2sas1: LSISAS2308: FWVersion(14.00.00.00), ChipRevision(0x05), BiosVersion(00.00.00.00)
[99586.296231] mpt2sas1: Protocol=(Initiator), Capabilities=(Raid,TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
[99586.454056] scsi host5: Fusion MPT SAS Host
[99586.516626] mpt2sas1: sending port enable !!
[99588.116973] mpt2sas1: host_add: handle(0x0001), sas_addr(0x508002000159c0d1), phys(8)
[99591.843255] mpt2sas0: port enable: SUCCESS
[99591.880328] qla2xxx [0002:03:00.1]-8038:1: Cable is unplugged...
[99591.993355] scsi 4:0:0:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[99592.106313] scsi 4:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0163295b1), phy(1), device_name(0x5000cca0163295b3)
[99592.255426] scsi 4:0:0:0: SSP: enclosure_logical_id(0x508002000159c0d0), slot(1)
[99592.368374] scsi 4:0:1:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[99592.483014] scsi 4:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca0162a4c1d), phy(2), device_name(0x5000cca0162a4c1f)
[99592.630984] scsi 4:0:1:0: SSP: enclosure_logical_id(0x508002000159c0d0), slot(2)
[99592.689305] random: nonblocking pool is initialized
[99594.239254] mpt2sas1: port enable: SUCCESS
[99594.305340] scsi 5:0:0:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[99594.420929] scsi 5:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0162f2e39), phy(0), device_name(0x5000cca0162f2e3b)
[99594.570333] scsi 5:0:0:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(0)
[99594.684670] scsi 5:0:1:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[99594.798919] scsi 5:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca016322ee5), phy(1), device_name(0x5000cca016322ee7)
[99594.945454] scsi 5:0:1:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(1)
[99595.058059] scsi 5:0:2:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[99595.174354] scsi 5:0:2:0: SSP: handle(0x000b), sas_addr(0x5000cca016322f71), phy(2), device_name(0x5000cca016322f73)
[99595.323927] scsi 5:0:2:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(2)
[99595.476079] sd 4:0:0:0: [sda] Enabling DIF Type 1 protection
[99595.487523] sd 5:0:0:0: [sdc] Enabling DIF Type 1 protection
[99595.487530] sd 5:0:0:0: [sdc] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[99595.487561] sd 5:0:1:0: [sdd] Enabling DIF Type 1 protection
[99595.487566] sd 5:0:1:0: [sdd] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[99595.487567] sd 5:0:2:0: [sde] Enabling DIF Type 1 protection
[99595.487572] sd 5:0:2:0: [sde] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[99595.487583] sd 4:0:1:0: [sdb] Enabling DIF Type 1 protection
[99595.487589] sd 4:0:1:0: [sdb] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[99595.488500] sd 4:0:1:0: [sdb] Write Protect is off
[99595.488504] sd 4:0:1:0: [sdb] Mode Sense: e7 00 10 08
[99595.488985] sd 4:0:1:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA
[99595.492381] sd 5:0:1:0: [sdd] Write Protect is off
[99595.492384] sd 5:0:1:0: [sdd] Mode Sense: e7 00 10 08
[99595.492387] sd 5:0:2:0: [sde] Write Protect is off
[99595.492390] sd 5:0:2:0: [sde] Mode Sense: e7 00 10 08
[99595.492396] sd 5:0:0:0: [sdc] Write Protect is off
[99595.492400] sd 5:0:0:0: [sdc] Mode Sense: e7 00 10 08
[99595.492891] sd 5:0:1:0: [sdd] Write cache: disabled, read cache: enabled, supports DPO and FUA
[99595.492907] sd 5:0:2:0: [sde] Write cache: disabled, read cache: enabled, supports DPO and FUA
[99595.492915] sd 5:0:0:0: [sdc] Write cache: disabled, read cache: enabled, supports DPO and FUA
[99595.497242]  sdb: sdb1 sdb2 sdb3 sdb7
[99595.500715]  sdc: sdc1 sdc2 sdc3 sdc7
[99595.500718]  sdd: sdd1 sdd2 sdd3 sdd7
[99595.500721]  sde: sde1 sde2 sde3
[99595.506066] sd 4:0:1:0: [sdb] Attached SCSI disk
[99595.512323] sd 5:0:2:0: [sde] Attached SCSI disk
[99595.512447] sd 5:0:1:0: [sdd] Attached SCSI disk
[99595.512452] sd 5:0:0:0: [sdc] Attached SCSI disk
[99597.807230] sd 4:0:0:0: [sda] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[99597.913800] sd 4:0:0:0: [sda] Write Protect is off
[99597.981961] sd 4:0:0:0: [sda] Mode Sense: e7 00 10 08
[99598.053548] sd 4:0:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
[99598.182142]  sda: sda1 sda2 sda3
[99598.234500] sd 4:0:0:0: [sda] Attached SCSI disk
[99598.467691] dracut: Scanning devices sda2 sde2  for LVM logical volumes VolGroup/lv_swap VolGroup/lv_root 
[99598.941161] dracut: inactive '/dev/VolGroup/lv_root' [274.38 GiB] inherit
[99599.037555] dracut: inactive '/dev/VolGroup/lv_swap' [4.00 GiB] inherit
[99599.132490] dracut: inactive '/dev/vg/root' [10.00 GiB] inherit
[99599.215798] dracut: inactive '/dev/vg/swap' [2.00 GiB] inherit
[99599.297845] dracut: inactive '/dev/vg/tmpdir' [10.00 GiB] inherit
[99599.383575] dracut: inactive '/dev/vg/mountpoint' [5.00 GiB] inherit
[99599.797911] EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
[99599.971525] dracut: Mounted root filesystem /dev/mapper/VolGroup-lv_root
[99600.269090] dracut: Loading SELinux policy
[99600.541574] audit: type=1404 audit(1427514289.280:2): enforcing=1 old_enforcing=0 auid=4294967295 ses=4294967295
[99600.846087] SELinux: 2048 avtab hash slots, 277818 rules.
[99601.027953] SELinux: 2048 avtab hash slots, 277818 rules.
[99601.422111] SELinux:  9 users, 12 roles, 3918 types, 217 bools, 1 sens, 1024 cats
[99601.530047] SELinux:  81 classes, 277818 rules
[99601.600355] SELinux:  Permission audit_access in class file not defined in policy.
[99601.708831] SELinux:  Permission audit_access in class dir not defined in policy.
[99601.814132] SELinux:  Permission execmod in class dir not defined in policy.
[99601.913651] SELinux:  Permission audit_access in class lnk_file not defined in policy.
[99602.029029] SELinux:  Permission open in class lnk_file not defined in policy.
[99602.130658] SELinux:  Permission execmod in class lnk_file not defined in policy.
[99602.240196] SELinux:  Permission audit_access in class chr_file not defined in policy.
[99602.351625] SELinux:  Permission audit_access in class blk_file not defined in policy.
[99602.463925] SELinux:  Permission execmod in class blk_file not defined in policy.
[99602.569658] SELinux:  Permission audit_access in class sock_file not defined in policy.
[99602.685137] SELinux:  Permission execmod in class sock_file not defined in policy.
[99602.792350] SELinux:  Permission audit_access in class fifo_file not defined in policy.
[99602.905002] SELinux:  Permission execmod in class fifo_file not defined in policy.
[99603.014037] SELinux:  Permission syslog in class capability2 not defined in policy.
[99603.121685] SELinux:  Permission wake_alarm in class capability2 not defined in policy.
[99603.235050] SELinux:  Permission block_suspend in class capability2 not defined in policy.
[99603.351377] SELinux:  Permission audit_read in class capability2 not defined in policy.
[99603.464040] SELinux:  Permission attach_queue in class tun_socket not defined in policy.
[99603.577918] SELinux:  Class binder not defined in policy.
[99603.653813] SELinux: the above unknown classes and permissions will be allowed
[99603.755458] SELinux:  Completing initialization.
[99603.820800] SELinux:  Setting up existing superblocks.
[99603.992394] audit: type=1403 audit(1427514292.732:3): policy loaded auid=4294967295 ses=4294967295
[99604.123452] dracut: 
[99606.106168] dracut: Switching root
[99609.187581] udev: starting version 147
[99609.585103] sha1_sparc64: Using sparc64 sha1 opcode optimized SHA-1 implementation
[99609.715318] sha512_sparc64: Using sparc64 sha512 opcode optimized SHA-512/SHA-384 implementation
[99609.872770] md5_sparc64: Using sparc64 md5 opcode optimized MD5 implementation
[99610.025707] des_sparc64: Using sparc64 des opcodes optimized DES implementation
[99610.146999] camellia_sparc64: Using sparc64 camellia opcodes optimized CAMELLIA implementation
[99610.315649] crc32c_sparc64: Using sparc64 crc32c opcode optimized CRC32C implementation
[99614.894973] pps_core: LinuxPPS API ver. 1 registered
[99614.964850] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[99615.115882] PTP clock support registered
[99615.280262] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 4.0.1-k
[99615.388722] ixgbe: Copyright (c) 1999-2014 Intel Corporation.
[99615.470843] PCI: Enabling device: (0000:06:00.0), cmd 2
[99615.545164] ixgbe 0000:06:00.0: enabling bus mastering
[99616.020098] ixgbe 0000:06:00.0: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[99616.198953] ixgbe 0000:06:00.0: PCI Express bandwidth of 32GT/s available
[99616.294710] ixgbe 0000:06:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[99616.433980] ixgbe 0000:06:00.0: MAC: 3, PHY: 0, PBA No: 000000-000
[99616.522003] ixgbe 0000:06:00.0: 00:10:e0:35:15:f6
[99616.834119] ixgbe 0000:06:00.0: Intel(R) 10 Gigabit Network Connection
[99616.926306] PCI: Enabling device: (0000:06:00.1), cmd 2
[99616.998903] ixgbe 0000:06:00.1: enabling bus mastering
[99617.475785] ixgbe 0000:06:00.1: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[99617.655311] ixgbe 0000:06:00.1: PCI Express bandwidth of 32GT/s available
[99617.752233] ixgbe 0000:06:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[99617.894125] ixgbe 0000:06:00.1: MAC: 3, PHY: 0, PBA No: 000000-000
[99617.980939] ixgbe 0000:06:00.1: 00:10:e0:35:15:f7
[99618.293397] ixgbe 0000:06:00.1: Intel(R) 10 Gigabit Network Connection
[99618.386539] PCI: Enabling device: (000f:75:00.0), cmd 2
[99618.460358] ixgbe 000f:75:00.0: enabling bus mastering
[99618.929983] ixgbe 000f:75:00.0: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[99619.108845] ixgbe 000f:75:00.0: PCI Express bandwidth of 32GT/s available
[99619.204348] ixgbe 000f:75:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[99619.344961] ixgbe 000f:75:00.0: MAC: 3, PHY: 0, PBA No: 000000-000
[99619.432566] ixgbe 000f:75:00.0: 00:10:e0:35:15:f8
[99619.742724] ixgbe 000f:75:00.0: Intel(R) 10 Gigabit Network Connection
[99619.837738] PCI: Enabling device: (000f:75:00.1), cmd 2
[99619.911152] ixgbe 000f:75:00.1: enabling bus mastering
[99620.380276] ixgbe 000f:75:00.1: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[99620.562492] ixgbe 000f:75:00.1: PCI Express bandwidth of 32GT/s available
[99620.658105] ixgbe 000f:75:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[99620.800997] ixgbe 000f:75:00.1: MAC: 3, PHY: 0, PBA No: 000000-000
[99620.885884] ixgbe 000f:75:00.1: 00:10:e0:35:15:f9
[99621.199165] ixgbe 000f:75:00.1: Intel(R) 10 Gigabit Network Connection
[99621.369395] sd 4:0:0:0: Attached scsi generic sg0 type 0
[99621.444713] sd 4:0:1:0: Attached scsi generic sg1 type 0
[99621.521116] sd 5:0:0:0: Attached scsi generic sg2 type 0
[99621.596335] sd 5:0:1:0: Attached scsi generic sg3 type 0
[99621.671617] sd 5:0:2:0: Attached scsi generic sg4 type 0
[99621.888362] xhci_hcd 0000:05:00.0: enabling bus mastering
[99621.964233] xhci_hcd 0000:05:00.0: xHCI Host Controller
[99622.039329] xhci_hcd 0000:05:00.0: new USB bus registered, assigned bus number 1
[99622.148868] xhci_hcd 0000:05:00.0: hcc params 0x014051cf hci version 0x100 quirks 0x00000010
[99622.268143] xhci_hcd 0000:05:00.0: enabling Mem-Wr-Inval
[99622.352567] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[99622.448311] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[99622.549923] usb usb1: Product: xHCI Host Controller
[99622.618448] usb usb1: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
[99622.699839] usb usb1: SerialNumber: 0000:05:00.0
[99622.765055] hub 1-0:1.0: USB hub found
[99622.817581] hub 1-0:1.0: 4 ports detected
[99622.874182] xhci_hcd 0000:05:00.0: xHCI Host Controller
[99622.947624] xhci_hcd 0000:05:00.0: new USB bus registered, assigned bus number 2
[99623.051781] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003
[99623.147191] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[99623.249641] usb usb2: Product: xHCI Host Controller
[99623.318165] usb usb2: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
[99623.399830] usb usb2: SerialNumber: 0000:05:00.0
[99623.464967] hub 2-0:1.0: USB hub found
[99623.517493] hub 2-0:1.0: 4 ports detected
[99623.572559] xhci_hcd 000f:76:00.0: enabling bus mastering
[99623.583276] usb 1-3: new high-speed USB device number 2 using xhci_hcd
[99623.745847] xhci_hcd 000f:76:00.0: xHCI Host Controller
[99623.820529] xhci_hcd 000f:76:00.0: new USB bus registered, assigned bus number 3
[99623.929984] xhci_hcd 000f:76:00.0: hcc params 0x014051cf hci version 0x100 quirks 0x00000010
[99624.050245] xhci_hcd 000f:76:00.0: enabling Mem-Wr-Inval
[99624.134171] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[99624.195740] usb 1-3: New USB device found, idVendor=090c, idProduct=1000
[99624.195743] usb 1-3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[99624.195745] usb 1-3: Product: USB DISK
[99624.195746] usb 1-3: Manufacturer: SMI Corporation
[99624.195749] usb 1-3: SerialNumber: 2011081500000723
[99624.195899] usb 1-3: ep 0x81 - rounding interval to 128 microframes, ep desc says 255 microframes
[99624.195911] usb 1-3: ep 0x2 - rounding interval to 128 microframes, ep desc says 255 microframes
[99624.865755] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[99624.968158] usb usb3: Product: xHCI Host Controller
[99625.036706] usb usb3: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
[99625.117501] usb usb3: SerialNumber: 000f:76:00.0
[99625.182792] hub 3-0:1.0: USB hub found
[99625.235319] hub 3-0:1.0: 4 ports detected
[99625.291826] xhci_hcd 000f:76:00.0: xHCI Host Controller
[99625.365312] xhci_hcd 000f:76:00.0: new USB bus registered, assigned bus number 4
[99625.469504] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003
[99625.564899] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[99625.666666] usb usb4: Product: xHCI Host Controller
[99625.735604] usb usb4: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
[99625.816506] usb usb4: SerialNumber: 000f:76:00.0
[99625.881572] hub 4-0:1.0: USB hub found
[99625.934097] hub 4-0:1.0: 4 ports detected
[99626.223612] usb-storage 1-3:1.0: USB Mass Storage device detected
[99626.310511] scsi host6: usb-storage 1-3:1.0
[99626.369314] usbcore: registered new interface driver usb-storage
[99627.465271] scsi 6:0:0:0: Direct-Access     SMI      USB DISK         3000 PQ: 0 ANSI: 0 CCS
[99627.589364] sd 6:0:0:0: Attached scsi generic sg5 type 0
[99627.589379] sd 6:0:0:0: [sdf] 62652416 512-byte logical blocks: (32.0 GB/29.8 GiB)
[99627.601804] sd 6:0:0:0: [sdf] Write Protect is off
[99627.601808] sd 6:0:0:0: [sdf] Mode Sense: 43 00 00 00
[99627.602568] sd 6:0:0:0: [sdf] No Caching mode page found
[99627.602571] sd 6:0:0:0: [sdf] Assuming drive cache: write through
[99627.608756]  sdf: sdf1 sdf2 sdf3
[99627.613943] sd 6:0:0:0: [sdf] Attached SCSI removable disk
[99629.188686] EXT4-fs (dm-0): re-mounted. Opts: (null)
[99630.087314] kjournald starting.  Commit interval 5 seconds
[99630.098100] EXT3-fs (sde1): using internal journal
[99630.098104] EXT3-fs (sde1): mounted filesystem with ordered data mode
[99631.290149] Adding 4194296k swap on /dev/mapper/VolGroup-lv_swap.  Priority:-1 extents:1 across:4194296k FS
[99635.813745] NET: Registered protocol family 10
[99636.912008] pps pps0: new PPS source ptp0
[99636.968275] ixgbe 0000:06:00.0: registered PHC device on eth0
[99637.273621] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[99640.194121] ixgbe 0000:06:00.0 eth0: NIC Link is Up 1 Gbps, Flow Control: RX/TX
[99640.298014] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[99640.304172] audit: type=1305 audit(1427514329.044:4): audit_pid=11694 old=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:auditd_t:s0 res=1

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-28  3:45               ` David Ahern
@ 2015-03-28  5:26                 ` Yinghai Lu
  2015-03-28 14:48                   ` David Ahern
  0 siblings, 1 reply; 39+ messages in thread
From: Yinghai Lu @ 2015-03-28  5:26 UTC (permalink / raw)
  To: David Ahern; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

[-- Attachment #1: Type: text/plain, Size: 1126 bytes --]

On Fri, Mar 27, 2015 at 8:45 PM, David Ahern <david.ahern@oracle.com> wrote:
> On 3/27/15 9:19 PM, Yinghai Lu wrote:
>>
>> Good. But we still have annoying warning about "no compatible window".
>>
>> Please try attached patch that support 64bit pci mem space for sparc.
>>
>> BTW, looks like you still do not have   CONFIG_PCI_DEBUG=y in your
>> .config.
>> otherwise we should more verbose print out.
>> Or did you have DYNAMIC_DEBUG enabled ?
>> If it is that case, can you remove that?
>>
>
> done. attached.
>

ok, we are almost there.

[99510.956337] pci_sun4v f02dbcfc: PCI host bridge to bus 0000:00
[99511.025812] pci_bus 0000:00: root bus resource [io
0x804000000000-0x80400fffffff] (bus address [0x0000-0xfffffff])
[99511.151039] pci_bus 0000:00: root bus resource [mem
0x800000000000-0x80007effffff] (bus address [0x00000000-0x7effffff])
[99511.282693] pci_bus 0000:00: root bus resource [mem
0x800100000000-0x8007ffffffff] (bus address [0x00000000-0x6ffffffff])
[99511.414878] pci_bus 0000:00: root bus resource [bus 00-77]


looks like the offset for mem64 is not right.

Please try attached v2.

Thanks

Yinghai

[-- Attachment #2: sparc_sun4v_mem64_v2.patch --]
[-- Type: text/x-patch, Size: 3543 bytes --]

Subject: [RFC PATCH v2] sparc/PCI: Add mem64 resource parsing for root bus

Found no compatible bridge window warning in boot log from T5-8.

pci 0000:00:01.0: can't claim BAR 15 [mem 0x100000000-0x4afffffff pref]: no compatible bridge window

and root bus only report io and mem32.

pci_sun4v f02dbcfc: PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x804000000000-0x80400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0000:00: root bus resource [mem 0x800000000000-0x80007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0000:00: root bus resource [bus 00-77]

Add mem64 handling in pci_common for sparc, so we can have 64bit resource
registered for bus at first.

Signed-off-by: Yinghai Lu <yinghai@kernel.org>

---
-v2: mem64_space should use mem_space.start as offset.
---
 arch/sparc/kernel/pci.c        |    3 +++
 arch/sparc/kernel/pci_common.c |   15 +++++++++++++--
 arch/sparc/kernel/pci_impl.h   |    1 +
 3 files changed, 17 insertions(+), 2 deletions(-)

Index: linux-2.6/arch/sparc/kernel/pci.c
===================================================================
--- linux-2.6.orig/arch/sparc/kernel/pci.c
+++ linux-2.6/arch/sparc/kernel/pci.c
@@ -663,6 +663,9 @@ struct pci_bus *pci_scan_one_pbm(struct
 				pbm->io_space.start);
 	pci_add_resource_offset(&resources, &pbm->mem_space,
 				pbm->mem_space.start);
+	if (pbm->mem64_space.flags)
+		pci_add_resource_offset(&resources, &pbm->mem64_space,
+					pbm->mem_space.start);
 	pbm->busn.start = pbm->pci_first_busno;
 	pbm->busn.end	= pbm->pci_last_busno;
 	pbm->busn.flags	= IORESOURCE_BUS;
Index: linux-2.6/arch/sparc/kernel/pci_common.c
===================================================================
--- linux-2.6.orig/arch/sparc/kernel/pci_common.c
+++ linux-2.6/arch/sparc/kernel/pci_common.c
@@ -406,6 +406,7 @@ void pci_determine_mem_io_space(struct p
 	}
 
 	num_pbm_ranges = i / sizeof(*pbm_ranges);
+	memset(&pbm->mem64_space, 0, sizeof(struct resource));
 
 	for (i = 0; i < num_pbm_ranges; i++) {
 		const struct linux_prom_pci_ranges *pr = &pbm_ranges[i];
@@ -451,7 +452,11 @@ void pci_determine_mem_io_space(struct p
 			break;
 
 		case 3:
-			/* XXX 64-bit MEM handling XXX */
+			/* 64-bit MEM handling */
+			pbm->mem64_space.start = a;
+			pbm->mem64_space.end = a + size - 1UL;
+			pbm->mem64_space.flags = IORESOURCE_MEM;
+			break;
 
 		default:
 			break;
@@ -465,15 +470,21 @@ void pci_determine_mem_io_space(struct p
 		prom_halt();
 	}
 
-	printk("%s: PCI IO[%llx] MEM[%llx]\n",
+	printk("%s: PCI IO[%llx] MEM[%llx]",
 	       pbm->name,
 	       pbm->io_space.start,
 	       pbm->mem_space.start);
+	if (pbm->mem64_space.flags)
+		printk(" MEM64[%llx]",
+		       pbm->mem64_space.start);
+	printk("\n");
 
 	pbm->io_space.name = pbm->mem_space.name = pbm->name;
 
 	request_resource(&ioport_resource, &pbm->io_space);
 	request_resource(&iomem_resource, &pbm->mem_space);
+	if (pbm->mem64_space.flags)
+		request_resource(&iomem_resource, &pbm->mem64_space);
 
 	pci_register_legacy_regions(&pbm->io_space,
 				    &pbm->mem_space);
Index: linux-2.6/arch/sparc/kernel/pci_impl.h
===================================================================
--- linux-2.6.orig/arch/sparc/kernel/pci_impl.h
+++ linux-2.6/arch/sparc/kernel/pci_impl.h
@@ -97,6 +97,7 @@ struct pci_pbm_info {
 	/* PBM I/O and Memory space resources. */
 	struct resource			io_space;
 	struct resource			mem_space;
+	struct resource			mem64_space;
 	struct resource			busn;
 
 	/* Base of PCI Config space, can be per-PBM or shared. */

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-28  2:07           ` Yinghai Lu
@ 2015-03-28  8:18             ` Sam Ravnborg
  0 siblings, 0 replies; 39+ messages in thread
From: Sam Ravnborg @ 2015-03-28  8:18 UTC (permalink / raw)
  To: Yinghai Lu; +Cc: David Ahern, Bjorn Helgaas, linux-pci, sparclinux, LKML

> >>  config ARM_THUMB
> >>       bool "Support Thumb user binaries" if !CPU_THUMBONLY
> >>       depends on CPU_ARM720T || CPU_ARM740T || CPU_ARM920T || CPU_ARM922T || \
> >> Index: linux-2.6/arch/arm64/Kconfig
> >> ===================================================================
> >> --- linux-2.6.orig/arch/arm64/Kconfig
> >> +++ linux-2.6/arch/arm64/Kconfig
> >> @@ -125,6 +125,9 @@ config HAVE_GENERIC_RCU_GUP
> >>  config ARCH_DMA_ADDR_T_64BIT
> >>       def_bool y
> >>
> >> +config ARCH_PCI_BUS_ADDR_T_64BIT
> >> +     def_bool y
> >> +
> > Use select
> ...
> 
> I was trying to keep the style to be consistent with old one in each Kconfig.
> 
> So do we just need to make sure new added lines to use new style?

Use new style select everywhere.
That could maybe in the future trigger someone to update the different arch
configs to use select for the remaining bits.

> >> Index: linux-2.6/include/linux/types.h
> >> ===================================================================
> >> --- linux-2.6.orig/include/linux/types.h
> >> +++ linux-2.6/include/linux/types.h
> >> @@ -146,6 +146,13 @@ typedef u64 dma_addr_t;
> >>  typedef u32 dma_addr_t;
> >>  #endif /* dma_addr_t */
> >>
> >> +/* A pci_bus_addr_t can hold pci bus address for the platform */
> >> +#ifdef CONFIG_ARCH_PCI_BUS_ADDR_T_64BIT
> >> +typedef u64 pci_bus_addr_t;
> >> +#else
> >> +typedef u32 pci_bus_addr_t;
> >> +#endif /* pci_bus_addr_t */
> >> +
> > Looking att all the Kconfig logic I get the impression that
> > the type of pci_bus_addr_t equals unsigned long.
> > If this is correct then you can skip that and things
> > gets much simpler.
> 
> For x86 32bit with PAE support, we could use 64bit for bus address.
> but unsigned long is 32bit.

Missed that part - OK.

	Sam

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-28  5:26                 ` Yinghai Lu
@ 2015-03-28 14:48                   ` David Ahern
  2015-03-28 20:24                     ` Yinghai Lu
  0 siblings, 1 reply; 39+ messages in thread
From: David Ahern @ 2015-03-28 14:48 UTC (permalink / raw)
  To: Yinghai Lu; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

[-- Attachment #1: Type: text/plain, Size: 1195 bytes --]

On 3/27/15 11:26 PM, Yinghai Lu wrote:
> On Fri, Mar 27, 2015 at 8:45 PM, David Ahern <david.ahern@oracle.com> wrote:
>> On 3/27/15 9:19 PM, Yinghai Lu wrote:
>>>
>>> Good. But we still have annoying warning about "no compatible window".
>>>
>>> Please try attached patch that support 64bit pci mem space for sparc.
>>>
>>> BTW, looks like you still do not have   CONFIG_PCI_DEBUG=y in your
>>> .config.
>>> otherwise we should more verbose print out.
>>> Or did you have DYNAMIC_DEBUG enabled ?
>>> If it is that case, can you remove that?
>>>
>>
>> done. attached.
>>
>
> ok, we are almost there.
>
> [99510.956337] pci_sun4v f02dbcfc: PCI host bridge to bus 0000:00
> [99511.025812] pci_bus 0000:00: root bus resource [io
> 0x804000000000-0x80400fffffff] (bus address [0x0000-0xfffffff])
> [99511.151039] pci_bus 0000:00: root bus resource [mem
> 0x800000000000-0x80007effffff] (bus address [0x00000000-0x7effffff])
> [99511.282693] pci_bus 0000:00: root bus resource [mem
> 0x800100000000-0x8007ffffffff] (bus address [0x00000000-0x6ffffffff])
> [99511.414878] pci_bus 0000:00: root bus resource [bus 00-77]
>
>
> looks like the offset for mem64 is not right.
>
> Please try attached v2.




[-- Attachment #2: dmesg --]
[-- Type: text/plain, Size: 69125 bytes --]

sshlab root@ca-qasparc24 dmesg
[    0.000000] PROMLIB: Sun IEEE Boot Prom 'OBP 4.36.2 2014/10/24 08:15'
[    0.000000] PROMLIB: Root node compatible: sun4v
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 4.0.0-rc5+ (root@ca-qasparc24) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-4.0.9) (GCC) ) #1 SMP Sat Mar 28 10:35:16 EDT 2015
[    0.000000] debug: skip boot console de-registration.
[    0.000000] debug: ignoring loglevel setting.
[    0.000000] bootconsole [earlyprom0] enabled
[    0.000000] ARCH: SUN4V
[    0.000000] Ethernet address: 00:10:e0:35:15:f6
[    0.000000] MM: PAGE_OFFSET is 0xfff8000000000000 (max_phys_bits == 47)
[    0.000000] MM: VMALLOC [0x0000000100000000 --> 0x0006000000000000]
[    0.000000] MM: VMEMMAP [0x0006000000000000 --> 0x000c000000000000]
[    0.000000] Kernel: Using 3 locked TLB entries for main kernel image.
[    0.000000] Remapping the kernel... done.
[    0.000000] OF stdout device is: /virtual-devices@100/console@1
[    0.000000] PROM: Built device tree with 1478490 bytes of memory.
[    0.000000] MDESC: Size is 774368 bytes.
[    0.000000] PLATFORM: banner-name [SPARC T5-8]
[    0.000000] PLATFORM: name [ORCL,SPARC-T5-8]
[    0.000000] PLATFORM: hostid [863515f6]
[    0.000000] PLATFORM: serial# [003515f6]
[    0.000000] PLATFORM: stick-frequency [3b9aca00]
[    0.000000] PLATFORM: mac-address [10e03515f6]
[    0.000000] PLATFORM: watchdog-resolution [1000 ms]
[    0.000000] PLATFORM: watchdog-max-timeout [31536000000 ms]
[    0.000000] PLATFORM: max-cpus [1024]
[    0.000000] Allocated 81920 bytes for kernel page tables.
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000030400000-0xffffffffffffffff]
[    0.000000]   Normal   [mem 0x0000000000000000-0x0000383fffd11fff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000030400000-0x0000003fddeeffff]
[    0.000000]   node   0: [mem 0x0000003fddef6000-0x0000003fddef7fff]
[    0.000000]   node   1: [mem 0x0000080000000000-0x0000083fffffffff]
[    0.000000]   node   2: [mem 0x0000100000000000-0x0000103fffffffff]
[    0.000000]   node   3: [mem 0x0000180000000000-0x0000183fffffffff]
[    0.000000]   node   4: [mem 0x0000200000000000-0x0000203fffffffff]
[    0.000000]   node   5: [mem 0x0000280000000000-0x0000283fffffffff]
[    0.000000]   node   6: [mem 0x0000300000000000-0x0000303fffffffff]
[    0.000000]   node   7: [mem 0x0000380000000000-0x0000383fffcddfff]
[    0.000000]   node   7: [mem 0x0000383fffcee000-0x0000383fffd11fff]
[    0.000000] Initmem setup node 0 [mem 0x0000000030400000-0x0000003fddef7fff]
[    0.000000] On node 0 totalpages: 33385849
[    0.000000]   Normal zone: 293431 pages used for memmap
[    0.000000]   Normal zone: 33385849 pages, LIFO batch:15
[    0.000000] Initmem setup node 1 [mem 0x0000080000000000-0x0000083fffffffff]
[    0.000000] On node 1 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 2 [mem 0x0000100000000000-0x0000103fffffffff]
[    0.000000] On node 2 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 3 [mem 0x0000180000000000-0x0000183fffffffff]
[    0.000000] On node 3 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 4 [mem 0x0000200000000000-0x0000203fffffffff]
[    0.000000] On node 4 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 5 [mem 0x0000280000000000-0x0000283fffffffff]
[    0.000000] On node 5 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 6 [mem 0x0000300000000000-0x0000303fffffffff]
[    0.000000] On node 6 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 7 [mem 0x0000380000000000-0x0000383fffd11fff]
[    0.000000] On node 7 totalpages: 33554049
[    0.000000]   Normal zone: 294909 pages used for memmap
[    0.000000]   Normal zone: 33554049 pages, LIFO batch:15
[    0.000000] Booting Linux...
[    0.000000] CPU CAPS: [flush,stbar,swap,muldiv,v9,blkinit,n2,mul32]
[    0.000000] CPU CAPS: [div32,v8plus,popc,vis,vis2,ASIBlkInit,fmaf,vis3]
[    0.000000] CPU CAPS: [hpc,ima,pause,cbcond,aes,des,kasumi,camellia]
[    0.000000] CPU CAPS: [md5,sha1,sha256,sha512,mpmul,montmul,montsqr,crc32c]
[    0.000000] PERCPU: Embedded 8 pages/cpu @fff8003f4d000000 s27776 r8192 d29568 u65536
[    0.000000] pcpu-alloc: s27776 r8192 d29568 u65536 alloc=1*4194304
[    0.000000] pcpu-alloc: [0] 0000 0001 0002 0003 0004 0005 0006 0007 0008 0009 0010 0011 0012 0013 0014 0015 0016 0017 0018 0019 0020 0021 0022 0023 0024 0025 0026 0027 0028 0029 0030 0031 0032 0033 0034 0035 0036 0037 0038 0039 0040 0041 0042 0043 0044 0045 0046 0047 0048 0049 0050 0051 0052 0053 0054 0055 0056 0057 0058 0059 0060 0061 0062 0063 
[    0.000000] pcpu-alloc: [0] 0064 0065 0066 0067 0068 0069 0070 0071 0072 0073 0074 0075 0076 0077 0078 0079 0080 0081 0082 0083 0084 0085 0086 0087 0088 0089 0090 0091 0092 0093 0094 0095 0096 0097 0098 0099 0100 0101 0102 0103 0104 0105 0106 0107 0108 0109 0110 0111 0112 0113 0114 0115 0116 0117 0118 0119 0120 0121 0122 0123 0124 0125 0126 0127 
[    0.000000] pcpu-alloc: [1] 0128 0129 0130 0131 0132 0133 0134 0135 0136 0137 0138 0139 0140 0141 0142 0143 0144 0145 0146 0147 0148 0149 0150 0151 0152 0153 0154 0155 0156 0157 0158 0159 0160 0161 0162 0163 0164 0165 0166 0167 0168 0169 0170 0171 0172 0173 0174 0175 0176 0177 0178 0179 0180 0181 0182 0183 0184 0185 0186 0187 0188 0189 0190 0191 
[    0.000000] pcpu-alloc: [1] 0192 0193 0194 0195 0196 0197 0198 0199 0200 0201 0202 0203 0204 0205 0206 0207 0208 0209 0210 0211 0212 0213 0214 0215 0216 0217 0218 0219 0220 0221 0222 0223 0224 0225 0226 0227 0228 0229 0230 0231 0232 0233 0234 0235 0236 0237 0238 0239 0240 0241 0242 0243 0244 0245 0246 0247 0248 0249 0250 0251 0252 0253 0254 0255 
[    0.000000] pcpu-alloc: [2] 0256 0257 0258 0259 0260 0261 0262 0263 0264 0265 0266 0267 0268 0269 0270 0271 0272 0273 0274 0275 0276 0277 0278 0279 0280 0281 0282 0283 0284 0285 0286 0287 0288 0289 0290 0291 0292 0293 0294 0295 0296 0297 0298 0299 0300 0301 0302 0303 0304 0305 0306 0307 0308 0309 0310 0311 0312 0313 0314 0315 0316 0317 0318 0319 
[    0.000000] pcpu-alloc: [2] 0320 0321 0322 0323 0324 0325 0326 0327 0328 0329 0330 0331 0332 0333 0334 0335 0336 0337 0338 0339 0340 0341 0342 0343 0344 0345 0346 0347 0348 0349 0350 0351 0352 0353 0354 0355 0356 0357 0358 0359 0360 0361 0362 0363 0364 0365 0366 0367 0368 0369 0370 0371 0372 0373 0374 0375 0376 0377 0378 0379 0380 0381 0382 0383 
[    0.000000] pcpu-alloc: [3] 0384 0385 0386 0387 0388 0389 0390 0391 0392 0393 0394 0395 0396 0397 0398 0399 0400 0401 0402 0403 0404 0405 0406 0407 0408 0409 0410 0411 0412 0413 0414 0415 0416 0417 0418 0419 0420 0421 0422 0423 0424 0425 0426 0427 0428 0429 0430 0431 0432 0433 0434 0435 0436 0437 0438 0439 0440 0441 0442 0443 0444 0445 0446 0447 
[    0.000000] pcpu-alloc: [3] 0448 0449 0450 0451 0452 0453 0454 0455 0456 0457 0458 0459 0460 0461 0462 0463 0464 0465 0466 0467 0468 0469 0470 0471 0472 0473 0474 0475 0476 0477 0478 0479 0480 0481 0482 0483 0484 0485 0486 0487 0488 0489 0490 0491 0492 0493 0494 0495 0496 0497 0498 0499 0500 0501 0502 0503 0504 0505 0506 0507 0508 0509 0510 0511 
[    0.000000] pcpu-alloc: [4] 0512 0513 0514 0515 0516 0517 0518 0519 0520 0521 0522 0523 0524 0525 0526 0527 0528 0529 0530 0531 0532 0533 0534 0535 0536 0537 0538 0539 0540 0541 0542 0543 0544 0545 0546 0547 0548 0549 0550 0551 0552 0553 0554 0555 0556 0557 0558 0559 0560 0561 0562 0563 0564 0565 0566 0567 0568 0569 0570 0571 0572 0573 0574 0575 
[    0.000000] pcpu-alloc: [4] 0576 0577 0578 0579 0580 0581 0582 0583 0584 0585 0586 0587 0588 0589 0590 0591 0592 0593 0594 0595 0596 0597 0598 0599 0600 0601 0602 0603 0604 0605 0606 0607 0608 0609 0610 0611 0612 0613 0614 0615 0616 0617 0618 0619 0620 0621 0622 0623 0624 0625 0626 0627 0628 0629 0630 0631 0632 0633 0634 0635 0636 0637 0638 0639 
[    0.000000] pcpu-alloc: [5] 0640 0641 0642 0643 0644 0645 0646 0647 0648 0649 0650 0651 0652 0653 0654 0655 0656 0657 0658 0659 0660 0661 0662 0663 0664 0665 0666 0667 0668 0669 0670 0671 0672 0673 0674 0675 0676 0677 0678 0679 0680 0681 0682 0683 0684 0685 0686 0687 0688 0689 0690 0691 0692 0693 0694 0695 0696 0697 0698 0699 0700 0701 0702 0703 
[    0.000000] pcpu-alloc: [5] 0704 0705 0706 0707 0708 0709 0710 0711 0712 0713 0714 0715 0716 0717 0718 0719 0720 0721 0722 0723 0724 0725 0726 0727 0728 0729 0730 0731 0732 0733 0734 0735 0736 0737 0738 0739 0740 0741 0742 0743 0744 0745 0746 0747 0748 0749 0750 0751 0752 0753 0754 0755 0756 0757 0758 0759 0760 0761 0762 0763 0764 0765 0766 0767 
[    0.000000] pcpu-alloc: [6] 0768 0769 0770 0771 0772 0773 0774 0775 0776 0777 0778 0779 0780 0781 0782 0783 0784 0785 0786 0787 0788 0789 0790 0791 0792 0793 0794 0795 0796 0797 0798 0799 0800 0801 0802 0803 0804 0805 0806 0807 0808 0809 0810 0811 0812 0813 0814 0815 0816 0817 0818 0819 0820 0821 0822 0823 0824 0825 0826 0827 0828 0829 0830 0831 
[    0.000000] pcpu-alloc: [6] 0832 0833 0834 0835 0836 0837 0838 0839 0840 0841 0842 0843 0844 0845 0846 0847 0848 0849 0850 0851 0852 0853 0854 0855 0856 0857 0858 0859 0860 0861 0862 0863 0864 0865 0866 0867 0868 0869 0870 0871 0872 0873 0874 0875 0876 0877 0878 0879 0880 0881 0882 0883 0884 0885 0886 0887 0888 0889 0890 0891 0892 0893 0894 0895 
[    0.000000] pcpu-alloc: [7] 0896 0897 0898 0899 0900 0901 0902 0903 0904 0905 0906 0907 0908 0909 0910 0911 0912 0913 0914 0915 0916 0917 0918 0919 0920 0921 0922 0923 0924 0925 0926 0927 0928 0929 0930 0931 0932 0933 0934 0935 0936 0937 0938 0939 0940 0941 0942 0943 0944 0945 0946 0947 0948 0949 0950 0951 0952 0953 0954 0955 0956 0957 0958 0959 
[    0.000000] pcpu-alloc: [7] 0960 0961 0962 0963 0964 0965 0966 0967 0968 0969 0970 0971 0972 0973 0974 0975 0976 0977 0978 0979 0980 0981 0982 0983 0984 0985 0986 0987 0988 0989 0990 0991 0992 0993 0994 0995 0996 0997 0998 0999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 
[    0.000000] SUN4V: Mondo queue sizes [cpu(131072) dev(16384) r(8192) nr(256)]
[    0.000000] Built 8 zonelists in Node order, mobility grouping on.  Total pages: 265908678
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: root=/dev/mapper/VolGroup-lv_root ro rd_NO_LUKS LANG=en_US.UTF-8 rd_NO_MD rd_LVM_LV=VolGroup/lv_swap SYSFONT=latarcyrheb-sun16 rd_LVM_LV=VolGroup/lv_root KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM keep_bootcon debug ignore_loglevel
[    0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[    0.000000] log_buf_len total cpu_extra contributions: 4190208 bytes
[    0.000000] log_buf_len min size: 1048576 bytes
[    0.000000] log_buf_len: 8388608 bytes
[    0.000000] early log buf free: 1036920(98%)
[    0.000000] PID hash table entries: 4096 (order: 2, 32768 bytes)
[    0.000000] Sorting __ex_table...
[    0.000000] Memory: 2127126480K/2146131920K available (5650K kernel code, 902K rwdata, 2384K rodata, 536K init, 2010K bss, 19005440K reserved, 0K cma-reserved)
[    0.000000] Hierarchical RCU implementation.
[    0.000000] NR_IRQS:2048 nr_irqs:2048 1
[    0.000000] SUN4V: Using IRQ API major 3, cookie only virqs enabled
[139287.823242] clocksource: mult[800000] shift[23]
[139287.878001] clockevent: mult[80000000] shift[31]
[139287.945671] Console: colour dummy device 80x25
[139287.999373] console [tty0] enabled
[139288.121677] Calibrating delay using timer specific routine.. 2001.25 BogoMIPS (lpj=4002509)
[139288.221701] pid_max: default: 1048576 minimum: 8192
[139288.283500] Security Framework initialized
[139288.332995] SELinux:  Initializing.
[139288.375483] SELinux:  Starting in permissive mode
[139288.586387] Dentry cache hash table entries: 268435456 (order: 18, 2147483648 bytes)
[139290.368276] Inode-cache hash table entries: 134217728 (order: 17, 1073741824 bytes)
[139291.271946] Mount-cache hash table entries: 4194304 (order: 12, 33554432 bytes)
[139291.361418] Mountpoint-cache hash table entries: 4194304 (order: 12, 33554432 bytes)
[139291.511283] Initializing cgroup subsys blkio
[139291.562914] Initializing cgroup subsys memory
[139291.615877] Initializing cgroup subsys devices
[139291.669689] Initializing cgroup subsys freezer
[139291.723386] Initializing cgroup subsys net_cls
[139291.777673] Initializing cgroup subsys perf_event
[139291.835145] Initializing cgroup subsys hugetlb
[139291.890463] ftrace: allocating 20497 entries in 41 pages
[139293.385928] Brought up 1024 CPUs
[139293.491927] devtmpfs: initialized
[139293.532298] Performance events: 
[139293.569799] Testing NMI watchdog ... OK.
[139293.699059] Supported PMU type is 'niagara5'
[139293.811226] ldc.c:v1.1 (July 22, 2008)
[139293.907737] NET: Registered protocol family 16
[139294.041873] VIO: Adding device channel-devices
[139294.097840] VIO: Adding device vldc-port-0-0
[139294.151665] VIO: Adding device vldc-port-0-1
[139294.205486] VIO: Adding device vldc-port-0-2
[139294.259298] VIO: Adding device vldc-port-1-0
[139294.313110] VIO: Adding device vldc-port-2-0
[139294.366928] VIO: Adding device vldc-port-3-0
[139294.420742] VIO: Adding device vldc-port-3-1
[139294.474555] VIO: Adding device vldc-port-3-4
[139294.528387] VIO: Adding device vldc-port-3-3
[139294.582222] VIO: Adding device vlds-port-0-0
[139294.636090] VIO: Adding device ds-0
[139294.680440] VIO: Adding device ds-1
[139294.940512] pci_sun4v: Registered hvapi major[1] minor[0]
[139295.008019] /pci@300: SUN4V PCI Bus Module
[139295.057533] /pci@300: On NUMA node -1
[139295.101760] /pci@300: PCI IO[804000000000] MEM[800000000000] MEM64[800100000000]
[139295.189214] /pci@300: Unable to request IOMMU resource.
[139295.271572] /pci@300: Imported 26 TSB entries from OBP
[139295.397197] /pci@300: MSI Queue first[0] num[56] count[512] devino[0x6]
[139295.477635] /pci@300: MSI first[0] num[512] mask[0x3ff] width[32]
[139295.551316] /pci@300: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139295.650251] /pci@300: MSI queues at RA [0000083f52c00000]
[139295.715521] PCI: Scanning PBM /pci@300
[139295.760918] pci_sun4v f02dbcfc: PCI host bridge to bus 0000:00
[139295.831448] pci_bus 0000:00: root bus resource [io  0x804000000000-0x80400fffffff] (bus address [0x0000-0xfffffff])
[139295.958623] pci_bus 0000:00: root bus resource [mem 0x800000000000-0x80007effffff] (bus address [0x00000000-0x7effffff])
[139296.091392] pci_bus 0000:00: root bus resource [mem 0x800100000000-0x8007ffffffff] (bus address [0x100000000-0x7ffffffff])
[139296.225779] pci_bus 0000:00: root bus resource [bus 00-77]
[139296.292945] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[139296.367158] pci 0000:00:01.0: PME# disabled
[139296.418898] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[139296.492776] pci 0000:01:00.0: PME# disabled
[139296.545650] pci 0000:02:04.0: PME# supported from D0 D3hot D3cold
[139296.619346] pci 0000:02:04.0: PME# disabled
[139296.670546] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[139296.745469] pci 0000:03:00.0: PME# disabled
[139296.796727] pci 0000:04:06.0: PME# supported from D0 D3hot D3cold
[139296.868410] pci 0000:04:06.0: PME# disabled
[139296.920734] pci 0000:05:00.0: PME# supported from D0 D3hot D3cold
[139296.994485] pci 0000:05:00.0: PME# disabled
[139297.045612] pci 0000:04:08.0: PME# supported from D0 D3hot D3cold
[139297.119803] pci 0000:04:08.0: PME# disabled
[139297.171553] pci 0000:06:00.0: PME# supported from D0 D3hot D3cold
[139297.245466] pci 0000:06:00.0: PME# disabled
[139297.297511] pci 0000:06:00.0: reg 0x184: [mem 0x800110204000-0x800110207fff 64bit]
[139297.389702] pci 0000:06:00.0: reg 0x190: [mem 0x800110304000-0x800110307fff 64bit]
[139297.481884] pci 0000:06:00.1: PME# supported from D0 D3hot D3cold
[139297.555575] pci 0000:06:00.1: PME# disabled
[139297.606323] pci 0000:06:00.1: reg 0x184: [mem 0x800110408000-0x80011040bfff 64bit]
[139297.698007] pci 0000:06:00.1: reg 0x190: [mem 0x800110800000-0x800110803fff 64bit]
[139297.790355] pci 0000:04:0c.0: PME# supported from D0 D3hot D3cold
[139297.864464] pci 0000:04:0c.0: PME# disabled
[139297.915840] pci 0000:07:00.0: supports D1 D2
[139297.967983] pci 0000:02:06.0: PME# supported from D0 D3hot D3cold
[139298.041916] pci 0000:02:06.0: PME# disabled
[139298.092814] pci 0000:05:00.0: can't claim BAR 0 [mem 0x800100000000-0x800100001fff]: no compatible bridge window
[139298.215949] pci 0000:06:00.0: can't claim BAR 7 [mem 0x800110204000-0x800110303fff 64bit]: no compatible bridge window
[139298.346479] pci 0000:06:00.0: can't claim BAR 10 [mem 0x800110304000-0x800110403fff 64bit]: no compatible bridge window
[139298.476953] pci 0000:06:00.1: can't claim BAR 7 [mem 0x800110408000-0x800110507fff 64bit]: no compatible bridge window
[139298.607105] pci 0000:06:00.1: can't claim BAR 10 [mem 0x800110800000-0x8001108fffff 64bit]: no compatible bridge window
[139298.739341] pci 0000:07:00.0: can't claim BAR 1 [mem 0x800120000000-0x80012000ffff]: no compatible bridge window
[139298.862467] pci 0000:07:00.0: can't claim BAR 3 [mem 0x800120040000-0x80012007ffff]: no compatible bridge window
[139298.986722] /pci@340: SUN4V PCI Bus Module
[139299.036914] /pci@340: On NUMA node -1
[139299.081138] /pci@340: PCI IO[804100000000] MEM[801000000000] MEM64[801100000000]
[139299.168631] /pci@340: Unable to request IOMMU resource.
[139299.313772] /pci@340: MSI Queue first[0] num[56] count[512] devino[0x6]
[139299.393767] /pci@340: MSI first[0] num[512] mask[0x3ff] width[32]
[139299.467448] /pci@340: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139299.566373] /pci@340: MSI queues at RA [0000083f52e00000]
[139299.631640] PCI: Scanning PBM /pci@340
[139299.677003] pci_sun4v f02eab24: PCI host bridge to bus 0001:00
[139299.747538] pci_bus 0001:00: root bus resource [io  0x804100000000-0x80410fffffff] (bus address [0x0000-0xfffffff])
[139299.873824] pci_bus 0001:00: root bus resource [mem 0x801000000000-0x80107effffff] (bus address [0x00000000-0x7effffff])
[139300.005990] pci_bus 0001:00: root bus resource [mem 0x801100000000-0x8017ffffffff] (bus address [0x100000000-0x7ffffffff])
[139300.139953] pci_bus 0001:00: root bus resource [bus 00-e2]
[139300.206246] pci 0001:00:01.0: PME# supported from D0 D3hot D3cold
[139300.279946] pci 0001:00:01.0: PME# disabled
[139300.331054] pci 0001:01:00.0: PME# supported from D0 D3hot D3cold
[139300.405505] pci 0001:01:00.0: PME# disabled
[139300.456704] pci 0001:02:06.0: PME# supported from D0 D3hot D3cold
[139300.530393] pci 0001:02:06.0: PME# disabled
[139300.581439] /pci@380: SUN4V PCI Bus Module
[139300.633114] /pci@380: On NUMA node -1
[139300.677338] /pci@380: PCI IO[80c000000000] MEM[808000000000] MEM64[808100000000]
[139300.764777] /pci@380: Unable to request IOMMU resource.
[139300.908521] /pci@380: MSI Queue first[0] num[56] count[512] devino[0x6]
[139300.988517] /pci@380: MSI first[0] num[512] mask[0x3ff] width[32]
[139301.063218] /pci@380: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139301.163426] /pci@380: MSI queues at RA [0000003f22c00000]
[139301.228699] PCI: Scanning PBM /pci@380
[139301.274395] pci_sun4v f02f994c: PCI host bridge to bus 0002:00
[139301.345528] pci_bus 0002:00: root bus resource [io  0x80c000000000-0x80c00fffffff] (bus address [0x0000-0xfffffff])
[139301.472183] pci_bus 0002:00: root bus resource [mem 0x808000000000-0x80807effffff] (bus address [0x00000000-0x7effffff])
[139301.605859] pci_bus 0002:00: root bus resource [mem 0x808100000000-0x8087ffffffff] (bus address [0x100000000-0x7ffffffff])
[139301.739023] pci_bus 0002:00: root bus resource [bus 00-e2]
[139301.806283] pci 0002:00:01.0: PME# supported from D0 D3hot D3cold
[139301.879984] pci 0002:00:01.0: PME# disabled
[139301.931683] pci 0002:01:00.0: PME# supported from D0 D3hot D3cold
[139302.005703] pci 0002:01:00.0: PME# disabled
[139302.057095] pci 0002:02:0a.0: PME# supported from D0 D3hot D3cold
[139302.130798] pci 0002:02:0a.0: PME# disabled
[139302.183539] pci 0002:03:00.0: can't claim BAR 1 [mem 0x808100000000-0x808100003fff]: no compatible bridge window
[139302.306662] pci 0002:03:00.1: can't claim BAR 1 [mem 0x808100004000-0x808100007fff]: no compatible bridge window
[139302.430416] /pci@3c0: SUN4V PCI Bus Module
[139302.480179] /pci@3c0: On NUMA node -1
[139302.524749] /pci@3c0: PCI IO[80c100000000] MEM[809000000000] MEM64[809100000000]
[139302.612238] /pci@3c0: Unable to request IOMMU resource.
[139302.756082] /pci@3c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[139302.836088] /pci@3c0: MSI first[0] num[512] mask[0x3ff] width[32]
[139302.910191] /pci@3c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139303.008471] /pci@3c0: MSI queues at RA [0000383f51c00000]
[139303.074167] PCI: Scanning PBM /pci@3c0
[139303.119521] pci_sun4v f0308774: PCI host bridge to bus 0003:00
[139303.190557] pci_bus 0003:00: root bus resource [io  0x80c100000000-0x80c10fffffff] (bus address [0x0000-0xfffffff])
[139303.318136] pci_bus 0003:00: root bus resource [mem 0x809000000000-0x80907effffff] (bus address [0x00000000-0x7effffff])
[139303.449662] pci_bus 0003:00: root bus resource [mem 0x809100000000-0x8097ffffffff] (bus address [0x100000000-0x7ffffffff])
[139303.584568] pci_bus 0003:00: root bus resource [bus 00-e2]
[139303.651877] pci 0003:00:01.0: PME# supported from D0 D3hot D3cold
[139303.725580] pci 0003:00:01.0: PME# disabled
[139303.777064] pci 0003:01:00.0: PME# supported from D0 D3hot D3cold
[139303.850756] pci 0003:01:00.0: PME# disabled
[139303.903408] pci 0003:02:0e.0: PME# supported from D0 D3hot D3cold
[139303.977106] pci 0003:02:0e.0: PME# disabled
[139304.028479] /pci@400: SUN4V PCI Bus Module
[139304.078089] /pci@400: On NUMA node -1
[139304.122319] /pci@400: PCI IO[814000000000] MEM[810000000000] MEM64[810100000000]
[139304.209762] /pci@400: Unable to request IOMMU resource.
[139304.353455] /pci@400: MSI Queue first[0] num[56] count[512] devino[0x6]
[139304.433456] /pci@400: MSI first[0] num[512] mask[0x3ff] width[32]
[139304.507144] /pci@400: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139304.606079] /pci@400: MSI queues at RA [0000303f52200000]
[139304.671349] PCI: Scanning PBM /pci@400
[139304.716693] pci_sun4v f031759c: PCI host bridge to bus 0004:00
[139304.787977] pci_bus 0004:00: root bus resource [io  0x814000000000-0x81400fffffff] (bus address [0x0000-0xfffffff])
[139304.914631] pci_bus 0004:00: root bus resource [mem 0x810000000000-0x81007effffff] (bus address [0x00000000-0x7effffff])
[139305.046603] pci_bus 0004:00: root bus resource [mem 0x810100000000-0x8107ffffffff] (bus address [0x100000000-0x7ffffffff])
[139305.180264] pci_bus 0004:00: root bus resource [bus 00-72]
[139305.248155] pci 0004:00:01.0: PME# supported from D0 D3hot D3cold
[139305.321849] pci 0004:00:01.0: PME# disabled
[139305.373138] pci 0004:01:00.0: PME# supported from D0 D3hot D3cold
[139305.446009] pci 0004:01:00.0: PME# disabled
[139305.498127] pci 0004:02:0c.0: PME# supported from D0 D3hot D3cold
[139305.571819] pci 0004:02:0c.0: PME# disabled
[139305.623231] /pci@440: SUN4V PCI Bus Module
[139305.673016] /pci@440: On NUMA node -1
[139305.717246] /pci@440: PCI IO[814100000000] MEM[811000000000] MEM64[811100000000]
[139305.804694] /pci@440: Unable to request IOMMU resource.
[139305.948588] /pci@440: MSI Queue first[0] num[56] count[512] devino[0x6]
[139306.029224] /pci@440: MSI first[0] num[512] mask[0x3ff] width[32]
[139306.102908] /pci@440: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139306.201841] /pci@440: MSI queues at RA [0000303f52400000]
[139306.268435] PCI: Scanning PBM /pci@440
[139306.313785] pci_sun4v f03263c4: PCI host bridge to bus 0005:00
[139306.384319] pci_bus 0005:00: root bus resource [io  0x814100000000-0x81410fffffff] (bus address [0x0000-0xfffffff])
[139306.510602] pci_bus 0005:00: root bus resource [mem 0x811000000000-0x81107effffff] (bus address [0x00000000-0x7effffff])
[139306.642149] pci_bus 0005:00: root bus resource [mem 0x811100000000-0x8117ffffffff] (bus address [0x100000000-0x7ffffffff])
[139306.776327] pci_bus 0005:00: root bus resource [bus 00-e2]
[139306.842113] pci 0005:00:01.0: PME# supported from D0 D3hot D3cold
[139306.916194] pci 0005:00:01.0: PME# disabled
[139306.967477] pci 0005:01:00.0: PME# supported from D0 D3hot D3cold
[139307.041743] pci 0005:01:00.0: PME# disabled
[139307.093927] pci 0005:02:0c.0: PME# supported from D0 D3hot D3cold
[139307.167628] pci 0005:02:0c.0: PME# disabled
[139307.218958] /pci@480: SUN4V PCI Bus Module
[139307.268442] /pci@480: On NUMA node -1
[139307.312672] /pci@480: PCI IO[81c000000000] MEM[818000000000] MEM64[818100000000]
[139307.401026] /pci@480: Unable to request IOMMU resource.
[139307.544586] /pci@480: MSI Queue first[0] num[56] count[512] devino[0x6]
[139307.624732] /pci@480: MSI first[0] num[512] mask[0x3ff] width[32]
[139307.698614] /pci@480: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139307.797821] /pci@480: MSI queues at RA [0000283f52e00000]
[139307.864319] PCI: Scanning PBM /pci@480
[139307.909659] pci_sun4v f03351ec: PCI host bridge to bus 0006:00
[139307.980181] pci_bus 0006:00: root bus resource [io  0x81c000000000-0x81c00fffffff] (bus address [0x0000-0xfffffff])
[139308.107237] pci_bus 0006:00: root bus resource [mem 0x818000000000-0x81807effffff] (bus address [0x00000000-0x7effffff])
[139308.238775] pci_bus 0006:00: root bus resource [mem 0x818100000000-0x8187ffffffff] (bus address [0x100000000-0x7ffffffff])
[139308.372410] pci_bus 0006:00: root bus resource [bus 00-e2]
[139308.439224] pci 0006:00:01.0: PME# supported from D0 D3hot D3cold
[139308.513072] pci 0006:00:01.0: PME# disabled
[139308.564363] pci 0006:01:00.0: PME# supported from D0 D3hot D3cold
[139308.640064] pci 0006:01:00.0: PME# disabled
[139308.692055] pci 0006:02:04.0: PME# supported from D0 D3hot D3cold
[139308.766135] pci 0006:02:04.0: PME# disabled
[139308.816749] /pci@4c0: SUN4V PCI Bus Module
[139308.866684] /pci@4c0: On NUMA node -1
[139308.910914] /pci@4c0: PCI IO[81c100000000] MEM[819000000000] MEM64[819100000000]
[139308.998761] /pci@4c0: Unable to request IOMMU resource.
[139309.143291] /pci@4c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[139309.223293] /pci@4c0: MSI first[0] num[512] mask[0x3ff] width[32]
[139309.297917] /pci@4c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139309.396835] /pci@4c0: MSI queues at RA [0000203f52200000]
[139309.462100] PCI: Scanning PBM /pci@4c0
[139309.507802] pci_sun4v f0344014: PCI host bridge to bus 0007:00
[139309.579765] pci_bus 0007:00: root bus resource [io  0x81c100000000-0x81c10fffffff] (bus address [0x0000-0xfffffff])
[139309.706455] pci_bus 0007:00: root bus resource [mem 0x819000000000-0x81907effffff] (bus address [0x00000000-0x7effffff])
[139309.838984] pci_bus 0007:00: root bus resource [mem 0x819100000000-0x8197ffffffff] (bus address [0x100000000-0x7ffffffff])
[139309.973178] pci_bus 0007:00: root bus resource [bus 00-e2]
[139310.041657] pci 0007:00:01.0: PME# supported from D0 D3hot D3cold
[139310.115705] pci 0007:00:01.0: PME# disabled
[139310.167327] pci 0007:01:00.0: PME# supported from D0 D3hot D3cold
[139310.241529] pci 0007:01:00.0: PME# disabled
[139310.292916] pci 0007:02:08.0: PME# supported from D0 D3hot D3cold
[139310.366613] pci 0007:02:08.0: PME# disabled
[139310.417669] /pci@500: SUN4V PCI Bus Module
[139310.467156] /pci@500: On NUMA node -1
[139310.511382] /pci@500: PCI IO[824000000000] MEM[820000000000] MEM64[820100000000]
[139310.598829] /pci@500: Unable to request IOMMU resource.
[139310.743040] /pci@500: MSI Queue first[0] num[56] count[512] devino[0x6]
[139310.823032] /pci@500: MSI first[0] num[512] mask[0x3ff] width[32]
[139310.897208] /pci@500: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139310.996176] /pci@500: MSI queues at RA [0000203f52400000]
[139311.062318] PCI: Scanning PBM /pci@500
[139311.107664] pci_sun4v f0352e3c: PCI host bridge to bus 0008:00
[139311.178196] pci_bus 0008:00: root bus resource [io  0x824000000000-0x82400fffffff] (bus address [0x0000-0xfffffff])
[139311.304703] pci_bus 0008:00: root bus resource [mem 0x820000000000-0x82007effffff] (bus address [0x00000000-0x7effffff])
[139311.436003] pci_bus 0008:00: root bus resource [mem 0x820100000000-0x8207ffffffff] (bus address [0x100000000-0x7ffffffff])
[139311.569650] pci_bus 0008:00: root bus resource [bus 00-e2]
[139311.637106] pci 0008:00:01.0: PME# supported from D0 D3hot D3cold
[139311.710804] pci 0008:00:01.0: PME# disabled
[139311.762006] pci 0008:01:00.0: PME# supported from D0 D3hot D3cold
[139311.835224] pci 0008:01:00.0: PME# disabled
[139311.886879] pci 0008:02:0e.0: PME# supported from D0 D3hot D3cold
[139311.960574] pci 0008:02:0e.0: PME# disabled
[139312.012606] /pci@540: SUN4V PCI Bus Module
[139312.062803] /pci@540: On NUMA node -1
[139312.107028] /pci@540: PCI IO[824100000000] MEM[821000000000] MEM64[821100000000]
[139312.195103] /pci@540: Unable to request IOMMU resource.
[139312.339217] /pci@540: MSI Queue first[0] num[56] count[512] devino[0x6]
[139312.419210] /pci@540: MSI first[0] num[512] mask[0x3ff] width[32]
[139312.492894] /pci@540: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139312.591825] /pci@540: MSI queues at RA [0000103f52e00000]
[139312.657091] PCI: Scanning PBM /pci@540
[139312.702428] pci_sun4v f0361c64: PCI host bridge to bus 0009:00
[139312.773588] pci_bus 0009:00: root bus resource [io  0x824100000000-0x82410fffffff] (bus address [0x0000-0xfffffff])
[139312.900881] pci_bus 0009:00: root bus resource [mem 0x821000000000-0x82107effffff] (bus address [0x00000000-0x7effffff])
[139313.033235] pci_bus 0009:00: root bus resource [mem 0x821100000000-0x8217ffffffff] (bus address [0x100000000-0x7ffffffff])
[139313.166134] pci_bus 0009:00: root bus resource [bus 00-e2]
[139313.233851] pci 0009:00:01.0: PME# supported from D0 D3hot D3cold
[139313.308314] pci 0009:00:01.0: PME# disabled
[139313.359593] pci 0009:01:00.0: PME# supported from D0 D3hot D3cold
[139313.433237] pci 0009:01:00.0: PME# disabled
[139313.484630] pci 0009:02:0e.0: PME# supported from D0 D3hot D3cold
[139313.558324] pci 0009:02:0e.0: PME# disabled
[139313.611141] /pci@580: SUN4V PCI Bus Module
[139313.660950] /pci@580: On NUMA node -1
[139313.705179] /pci@580: PCI IO[82c000000000] MEM[828000000000] MEM64[828100000000]
[139313.793435] /pci@580: Unable to request IOMMU resource.
[139313.937906] /pci@580: MSI Queue first[0] num[56] count[512] devino[0x6]
[139314.018298] /pci@580: MSI first[0] num[512] mask[0x3ff] width[32]
[139314.093151] /pci@580: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139314.192589] /pci@580: MSI queues at RA [0000103f52000000]
[139314.257855] PCI: Scanning PBM /pci@580
[139314.303194] pci_sun4v f0370a8c: PCI host bridge to bus 000a:00
[139314.373720] pci_bus 000a:00: root bus resource [io  0x82c000000000-0x82c00fffffff] (bus address [0x0000-0xfffffff])
[139314.500418] pci_bus 000a:00: root bus resource [mem 0x828000000000-0x82807effffff] (bus address [0x00000000-0x7effffff])
[139314.632474] pci_bus 000a:00: root bus resource [mem 0x828100000000-0x8287ffffffff] (bus address [0x100000000-0x7ffffffff])
[139314.766610] pci_bus 000a:00: root bus resource [bus 00-e2]
[139314.834287] pci 000a:00:01.0: PME# supported from D0 D3hot D3cold
[139314.907984] pci 000a:00:01.0: PME# disabled
[139314.959982] pci 000a:01:00.0: PME# supported from D0 D3hot D3cold
[139315.033672] pci 000a:01:00.0: PME# disabled
[139315.085067] pci 000a:02:0a.0: PME# supported from D0 D3hot D3cold
[139315.159601] pci 000a:02:0a.0: PME# disabled
[139315.210639] /pci@5c0: SUN4V PCI Bus Module
[139315.260123] /pci@5c0: On NUMA node -1
[139315.304348] /pci@5c0: PCI IO[82c100000000] MEM[829000000000] MEM64[829100000000]
[139315.391789] /pci@5c0: Unable to request IOMMU resource.
[139315.536287] /pci@5c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[139315.616465] /pci@5c0: MSI first[0] num[512] mask[0x3ff] width[32]
[139315.690140] /pci@5c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139315.789058] /pci@5c0: MSI queues at RA [0000083f52000000]
[139315.855404] PCI: Scanning PBM /pci@5c0
[139315.900937] pci_sun4v f037f8b4: PCI host bridge to bus 000b:00
[139315.971923] pci_bus 000b:00: root bus resource [io  0x82c100000000-0x82c10fffffff] (bus address [0x0000-0xfffffff])
[139316.098189] pci_bus 000b:00: root bus resource [mem 0x829000000000-0x82907effffff] (bus address [0x00000000-0x7effffff])
[139316.229288] pci_bus 000b:00: root bus resource [mem 0x829100000000-0x8297ffffffff] (bus address [0x100000000-0x7ffffffff])
[139316.362964] pci_bus 000b:00: root bus resource [bus 00-72]
[139316.429789] pci 000b:00:01.0: PME# supported from D0 D3hot D3cold
[139316.504568] pci 000b:00:01.0: PME# disabled
[139316.556346] pci 000b:01:00.0: PME# supported from D0 D3hot D3cold
[139316.630037] pci 000b:01:00.0: PME# disabled
[139316.682284] pci 000b:02:08.0: PME# supported from D0 D3hot D3cold
[139316.755370] pci 000b:02:08.0: PME# disabled
[139316.806397] /pci@600: SUN4V PCI Bus Module
[139316.855881] /pci@600: On NUMA node -1
[139316.900424] /pci@600: PCI IO[834000000000] MEM[830000000000] MEM64[830100000000]
[139316.987301] /pci@600: Unable to request IOMMU resource.
[139317.132244] /pci@600: MSI Queue first[0] num[56] count[512] devino[0x6]
[139317.213975] /pci@600: MSI first[0] num[512] mask[0x3ff] width[32]
[139317.288542] /pci@600: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139317.389136] /pci@600: MSI queues at RA [0000083f52200000]
[139317.454401] PCI: Scanning PBM /pci@600
[139317.500859] pci_sun4v f038e6dc: PCI host bridge to bus 000c:00
[139317.571093] pci_bus 000c:00: root bus resource [io  0x834000000000-0x83400fffffff] (bus address [0x0000-0xfffffff])
[139317.698263] pci_bus 000c:00: root bus resource [mem 0x830000000000-0x83007effffff] (bus address [0x00000000-0x7effffff])
[139317.830330] pci_bus 000c:00: root bus resource [mem 0x830100000000-0x8307ffffffff] (bus address [0x100000000-0x7ffffffff])
[139317.964841] pci_bus 000c:00: root bus resource [bus 00-e2]
[139318.031835] pci 000c:00:01.0: PME# supported from D0 D3hot D3cold
[139318.106577] pci 000c:00:01.0: PME# disabled
[139318.158371] pci 000c:01:00.0: PME# supported from D0 D3hot D3cold
[139318.232423] pci 000c:01:00.0: PME# disabled
[139318.284153] pci 000c:02:08.0: PME# supported from D0 D3hot D3cold
[139318.357846] pci 000c:02:08.0: PME# disabled
[139318.408886] /pci@640: SUN4V PCI Bus Module
[139318.458376] /pci@640: On NUMA node -1
[139318.502607] /pci@640: PCI IO[834100000000] MEM[831000000000] MEM64[831100000000]
[139318.590049] /pci@640: Unable to request IOMMU resource.
[139318.734647] /pci@640: MSI Queue first[0] num[56] count[512] devino[0x6]
[139318.814828] /pci@640: MSI first[0] num[512] mask[0x3ff] width[32]
[139318.889320] /pci@640: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139318.988547] /pci@640: MSI queues at RA [0000083f52400000]
[139319.053816] PCI: Scanning PBM /pci@640
[139319.099160] pci_sun4v f039d504: PCI host bridge to bus 000d:00
[139319.169694] pci_bus 000d:00: root bus resource [io  0x834100000000-0x83410fffffff] (bus address [0x0000-0xfffffff])
[139319.297724] pci_bus 000d:00: root bus resource [mem 0x831000000000-0x83107effffff] (bus address [0x00000000-0x7effffff])
[139319.429849] pci_bus 000d:00: root bus resource [mem 0x831100000000-0x8317ffffffff] (bus address [0x100000000-0x7ffffffff])
[139319.563497] pci_bus 000d:00: root bus resource [bus 00-e2]
[139319.632064] pci 000d:00:01.0: PME# supported from D0 D3hot D3cold
[139319.705884] pci 000d:00:01.0: PME# disabled
[139319.757216] pci 000d:01:00.0: PME# supported from D0 D3hot D3cold
[139319.830912] pci 000d:01:00.0: PME# disabled
[139319.882315] pci 000d:02:08.0: PME# supported from D0 D3hot D3cold
[139319.956095] pci 000d:02:08.0: PME# disabled
[139320.009525] pci 000d:03:00.0: can't claim BAR 0 [mem 0x831100000000-0x831100001fff]: no compatible bridge window
[139320.132806] pci 000d:03:00.0: can't claim BAR 2 [mem 0x831100004000-0x831100007fff]: no compatible bridge window
[139320.255914] pci 000d:03:00.1: can't claim BAR 0 [mem 0x831100002000-0x831100003fff]: no compatible bridge window
[139320.379046] pci 000d:03:00.1: can't claim BAR 2 [mem 0x831100008000-0x83110000bfff]: no compatible bridge window
[139320.502278] /pci@680: SUN4V PCI Bus Module
[139320.551769] /pci@680: On NUMA node -1
[139320.595999] /pci@680: PCI IO[83c000000000] MEM[838000000000] MEM64[838100000000]
[139320.682995] /pci@680: Unable to request IOMMU resource.
[139320.828410] /pci@680: MSI Queue first[0] num[56] count[512] devino[0x6]
[139320.909171] /pci@680: MSI first[0] num[512] mask[0x3ff] width[32]
[139320.983950] /pci@680: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139321.082870] /pci@680: MSI queues at RA [0000303f52600000]
[139321.148129] PCI: Scanning PBM /pci@680
[139321.194069] pci_sun4v f03ac32c: PCI host bridge to bus 000e:00
[139321.265984] pci_bus 000e:00: root bus resource [io  0x83c000000000-0x83c00fffffff] (bus address [0x0000-0xfffffff])
[139321.393009] pci_bus 000e:00: root bus resource [mem 0x838000000000-0x83807effffff] (bus address [0x00000000-0x7effffff])
[139321.525372] pci_bus 000e:00: root bus resource [mem 0x838100000000-0x8387ffffffff] (bus address [0x100000000-0x7ffffffff])
[139321.659019] pci_bus 000e:00: root bus resource [bus 00-e2]
[139321.726388] pci 000e:00:01.0: PME# supported from D0 D3hot D3cold
[139321.800499] pci 000e:00:01.0: PME# disabled
[139321.851793] pci 000e:01:00.0: PME# supported from D0 D3hot D3cold
[139321.925782] pci 000e:01:00.0: PME# disabled
[139321.977409] pci 000e:02:04.0: PME# supported from D0 D3hot D3cold
[139322.051253] pci 000e:02:04.0: PME# disabled
[139322.102294] /pci@6c0: SUN4V PCI Bus Module
[139322.150712] /pci@6c0: On NUMA node -1
[139322.196068] /pci@6c0: PCI IO[83c100000000] MEM[839000000000] MEM64[839100000000]
[139322.284354] /pci@6c0: Unable to request IOMMU resource.
[139322.365460] /pci@6c0: Imported 13 TSB entries from OBP
[139322.491858] /pci@6c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[139322.571853] /pci@6c0: MSI first[0] num[512] mask[0x3ff] width[32]
[139322.645533] /pci@6c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[139322.743440] /pci@6c0: MSI queues at RA [0000303f51800000]
[139322.808699] PCI: Scanning PBM /pci@6c0
[139322.854040] pci_sun4v f03bb154: PCI host bridge to bus 000f:00
[139322.924572] pci_bus 000f:00: root bus resource [io  0x83c100000000-0x83c10fffffff] (bus address [0x0000-0xfffffff])
[139323.052241] pci_bus 000f:00: root bus resource [mem 0x839000000000-0x83907effffff] (bus address [0x00000000-0x7effffff])
[139323.183781] pci_bus 000f:00: root bus resource [mem 0x839100000000-0x8397ffffffff] (bus address [0x100000000-0x7ffffffff])
[139323.317412] pci_bus 000f:00: root bus resource [bus 00-78]
[139323.384341] pci 000f:00:01.0: PME# supported from D0 D3hot D3cold
[139323.458039] pci 000f:00:01.0: PME# disabled
[139323.510286] pci 000f:01:00.0: PME# supported from D0 D3hot D3cold
[139323.583983] pci 000f:01:00.0: PME# disabled
[139323.635370] pci 000f:02:04.0: PME# supported from D0 D3hot D3cold
[139323.709444] pci 000f:02:04.0: PME# disabled
[139323.761132] pci 000f:02:0c.0: PME# supported from D0 D3hot D3cold
[139323.834833] pci 000f:02:0c.0: PME# disabled
[139323.886205] pci 000f:73:00.0: PME# supported from D0 D3hot D3cold
[139323.959937] pci 000f:73:00.0: PME# disabled
[139324.011390] pci 000f:74:04.0: PME# supported from D0 D3hot D3cold
[139324.085159] pci 000f:74:04.0: PME# disabled
[139324.136951] pci 000f:75:00.0: PME# supported from D0 D3hot D3cold
[139324.210646] pci 000f:75:00.0: PME# disabled
[139324.261523] pci 000f:75:00.0: reg 0x184: [mem 0x839480204000-0x839480207fff 64bit]
[139324.353242] pci 000f:75:00.0: reg 0x190: [mem 0x839480304000-0x839480307fff 64bit]
[139324.445599] pci 000f:75:00.1: PME# supported from D0 D3hot D3cold
[139324.519304] pci 000f:75:00.1: PME# disabled
[139324.570126] pci 000f:75:00.1: reg 0x184: [mem 0x839480408000-0x83948040bfff 64bit]
[139324.661839] pci 000f:75:00.1: reg 0x190: [mem 0x839480800000-0x839480803fff 64bit]
[139324.755390] pci 000f:74:06.0: PME# supported from D0 D3hot D3cold
[139324.829090] pci 000f:74:06.0: PME# disabled
[139324.881473] pci 000f:76:00.0: PME# supported from D0 D3hot D3cold
[139324.956582] pci 000f:76:00.0: PME# disabled
[139325.007865] pci 000f:74:07.0: PME# supported from D0 D3hot D3cold
[139325.081885] pci 000f:74:07.0: PME# disabled
[139325.134094] pci 000f:74:0c.0: PME# supported from D0 D3hot D3cold
[139325.207786] pci 000f:74:0c.0: PME# disabled
[139325.259822] pci 000f:78:00.0: supports D1 D2
[139325.312209] pci 000f:75:00.0: can't claim BAR 7 [mem 0x839480204000-0x839480303fff 64bit]: no compatible bridge window
[139325.442227] pci 000f:75:00.0: can't claim BAR 10 [mem 0x839480304000-0x839480403fff 64bit]: no compatible bridge window
[139325.572702] pci 000f:75:00.1: can't claim BAR 7 [mem 0x839480408000-0x839480507fff 64bit]: no compatible bridge window
[139325.702763] pci 000f:75:00.1: can't claim BAR 10 [mem 0x839480800000-0x8394808fffff 64bit]: no compatible bridge window
[139325.834118] pci 000f:76:00.0: can't claim BAR 0 [mem 0x839490000000-0x839490001fff]: no compatible bridge window
[139325.957228] pci 000f:78:00.0: can't claim BAR 1 [mem 0x8394a0000000-0x8394a000ffff]: no compatible bridge window
[139326.080750] pci 000f:78:00.0: can't claim BAR 3 [mem 0x8394a0040000-0x8394a007ffff]: no compatible bridge window
[139326.271044] vgaarb: device added: PCI:000f:77:00.0,decodes=io+mem,owns=none,locks=none
[139326.366864] vgaarb: loaded
[139326.399524] vgaarb: bridge control possible 000f:77:00.0
[139326.474878] SCSI subsystem initialized
[139326.526691] libata version 3.00 loaded.
[139326.573230] usbcore: registered new interface driver usbfs
[139326.639662] usbcore: registered new interface driver hub
[139326.712188] usbcore: registered new device driver usb
[139326.785605] NetLabel: Initializing
[139326.826690] NetLabel:  domain hash size = 128
[139326.879374] NetLabel:  protocols = UNLABELED CIPSOv4
[139326.939891] NetLabel:  unlabeled traffic allowed by default
[139327.009240] SUN4V: Reboot data supported (maj=1,min=0).
[139327.072982] ds.c:v1.0 (Jul 11, 2007)
[139327.125146] Switched to clocksource stick
[139327.166739] ds-1: Registered pri service.
[139327.214338] ds-1: Registered var-config-backup service.
[139327.303339] NET: Registered protocol family 2
[139327.375103] TCP established hash table entries: 524288 (order: 9, 4194304 bytes)
[139327.467814] TCP bind hash table entries: 65536 (order: 7, 1048576 bytes)
[139327.549705] TCP: Hash tables configured (established 524288 bind 65536)
[139327.630184] TCP: reno registered
[139327.669388] UDP hash table entries: 65536 (order: 8, 2097152 bytes)
[139327.746388] UDP-Lite hash table entries: 65536 (order: 8, 2097152 bytes)
[139327.844149] NET: Registered protocol family 1
[139327.896162] pci 0000:05:00.0: calling quirk_usb_early_handoff+0x0/0x220
[139327.982838] pci 0000:05:00.0: xHCI BIOS handoff failed (BIOS bug ?) 00010401
[139328.074496] pci 0000:06:00.0: calling quirk_e100_interrupt+0x0/0x220
[139328.151340] pci 0000:06:00.1: calling quirk_e100_interrupt+0x0/0x220
[139328.228736] pci 000f:75:00.0: calling quirk_e100_interrupt+0x0/0x220
[139328.305802] pci 000f:75:00.1: calling quirk_e100_interrupt+0x0/0x220
[139328.382661] pci 000f:76:00.0: calling quirk_usb_early_handoff+0x0/0x220
[139328.470123] pci 000f:76:00.0: xHCI BIOS handoff failed (BIOS bug ?) 00010401
[139328.561900] PCI: CLS mismatch (64 != 512), using 64 bytes
[139328.627347] Trying to unpack rootfs image as initramfs...
[139328.968472] Freeing initrd memory: 7408K (fff8380004000000 - fff838000473c000)
[139329.081232] futex hash table entries: 262144 (order: 11, 16777216 bytes)
[139329.169942] Initialise system trusted keyring
[139329.226726] audit: initializing netlink subsys (disabled)
[139329.294889] audit: type=2000 audit(10.888:1): initialized
[139329.362177] HugeTLB registered 8 MB page size, pre-allocated 0 pages
[139329.449681] VFS: Disk quotas dquot_6.5.2
[139329.505171] VFS: Dquot-cache hash table entries: 1024 (order 0, 8192 bytes)
[139329.610834] SELinux:  Registering netfilter hooks
[139329.671839] alg: No test for stdrng (krng)
[139329.721451] Key type asymmetric registered
[139329.770952] Asymmetric key parser 'x509' registered
[139329.829951] bounce: pool size: 64 pages
[139329.880059] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
[139329.976914] io scheduler noop registered
[139330.023667] io scheduler deadline registered (default)
[139330.089323] io scheduler cfq registered
[139330.137087] f0290cf4: ttyS0 at I/O 0x0 (irq = 1, base_baud = 115200) is a SUN4V HCONS
[139338.360933] console [ttyHV0] enabled
[139338.416027] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[139338.594202] brd: module loaded
[139338.804116] loop: module loaded
[139338.853459] zram: Created 1 device(s)
[139338.910996] libphy: Fixed MDIO Bus: probed
[139338.970018] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[139339.062966] ehci-pci: EHCI PCI platform driver
[139339.126675] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[139339.214741] ohci-pci: OHCI PCI platform driver
[139339.278845] uhci_hcd: USB Universal Host Controller Interface driver
[139339.369834] mousedev: PS/2 mouse device common for all mice
[139339.451744] rtc-sun4v rtc-sun4v: rtc core: registered sun4v as rtc0
[139339.541062] hidraw: raw HID events driver (C) Jiri Kosina
[139339.617607] usbcore: registered new interface driver usbhid
[139339.697673] usbhid: USB HID core driver
[139339.753149] drop_monitor: Initializing network drop monitor service
[139339.844679] TCP: cubic registered
[139339.892328] Initializing XFRM netlink socket
[139339.954175] NET: Registered protocol family 17
[139340.020773] Key type dns_resolver registered
[139340.087090] Loading compiled-in X.509 certificates
[139340.158038] Loaded X.509 cert 'Magrathea: Glacier signing key: 27dea44d4f68f59da1d990078a739ea78826754b'
[139340.291326] registered taskstats version 1
[139340.351093] ima: No TPM chip found, activating TPM-bypass!
[139340.441890] rtc-sun4v rtc-sun4v: setting system clock to 2015-03-28 14:47:11 UTC (1427554031)
[139340.601656] dracut: dracut-004-336.0.2.el6_5.2
[139340.680812] dracut: rd_NO_LUKS: removing cryptoluks activation
[139340.776853] dm_mod: module verification failed: signature and/or required key missing - tainting kernel
[139340.919525] device-mapper: uevent: version 1.0.3
[139340.992825] device-mapper: ioctl: 4.30.0-ioctl (2014-12-22) initialised: dm-devel@redhat.com
[139341.136599] udev: starting version 147
[139341.388673] dracut: Starting plymouth daemon
[139341.594479] sha256_sparc64: Using sparc64 sha256 opcode optimized SHA-256/SHA-224 implementation
[139341.721482] aes_sparc64: Using sparc64 aes opcodes optimized AES implementation
[139344.555671] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.16-k.
[139344.672208] qla2xxx [0002:03:00.0]-001d: : Found an ISP2532 irq 11 iobase 0x0000808100000000.
[139344.796813] qla2xxx 0002:03:00.0: enabling Mem-Wr-Inval
[139347.741739] scsi host0: qla2xxx
[139347.803176] qla2xxx [0002:03:00.0]-00fb:0: QLogic QLE2562 - Sun StorageTek 8Gb FC PCIe HBA, dual port.
[139347.936152] qla2xxx [0002:03:00.0]-00fc:0: ISP2532: PCIe (2.5GT/s x8) @ 0002:03:00.0 hdma- host#=0 fw=7.03.00 (90d5).
[139348.011704] qla2xxx [0002:03:00.0]-500a:0: LOOP UP detected (8 Gbps).
[139348.179190] qla2xxx [0002:03:00.1]-001d: : Found an ISP2532 irq 12 iobase 0x0000808100004000.
[139348.304100] qla2xxx 0002:03:00.1: enabling Mem-Wr-Inval
[139348.496096] qla2xxx [0002:03:00.0]-2064:0: SNS scan failed -- assuming zero-entry result.
[139351.249712] scsi host1: qla2xxx
[139351.310716] qla2xxx [0002:03:00.1]-00fb:1: QLogic QLE2562 - Sun StorageTek 8Gb FC PCIe HBA, dual port.
[139351.442890] qla2xxx [0002:03:00.1]-00fc:1: ISP2532: PCIe (2.5GT/s x8) @ 0002:03:00.1 hdma- host#=1 fw=7.03.00 (90d5).
[139356.332716] Emulex LightPulse Fibre Channel SCSI driver 10.4.8000.0.
[139356.423232] Copyright(c) 2004-2014 Emulex.  All rights reserved.
[139356.509846] lpfc 000d:03:00.0: enabling Mem-Wr-Inval
[139356.582955] scsi host2: Emulex LPe12000-S PCIe Fibre Channel Adapter  on PCI bus 03 device 00 irq 35
[139359.182301] lpfc 000d:03:00.1: enabling Mem-Wr-Inval
[139359.255954] scsi host3: Emulex LPe12000-S PCIe Fibre Channel Adapter  on PCI bus 03 device 01 irq 36
[139361.984141] mpt2sas version 20.100.00.00 loaded
[139362.051285] mpt2sas 0000:07:00.0: enabling bus mastering
[139362.127118] mpt2sas0: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (2127134424 kB)
[139362.529670] mpt2sas0: MSI-X vectors supported: 8, no of cores: 1024, max_msix_vectors: 8
[139362.654515] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 973
[139362.727845] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 974
[139362.801280] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 975
[139362.874727] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 976
[139362.948167] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 977
[139363.021608] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 978
[139363.095491] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 979
[139363.168933] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 980
[139363.242373] mpt2sas0: iomem(0x0000800120000000), mapped(0x0000800120000000), size(65536)
[139363.357489] mpt2sas0: ioport(0x0000804000001000), size(256)
[139363.874212] mpt2sas0: Allocated physical memory: size(4603 kB)
[139363.957347] mpt2sas0: Current Controller Queue Depth(2811), Max Controller Queue Depth(3072)
[139364.077921] mpt2sas0: Scatter Gather Elements per IO(128)
[139364.387251] mpt2sas0: LSISAS2308: FWVersion(14.00.00.00), ChipRevision(0x05), BiosVersion(00.00.00.00)
[139364.519442] mpt2sas0: Protocol=(Initiator), Capabilities=(Raid,TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
[139364.680115] scsi host4: Fusion MPT SAS Host
[139364.743859] mpt2sas0: sending port enable !!
[139364.744378] mpt2sas1: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (2127134424 kB)
[139365.029666] mpt2sas1: MSI-X vectors supported: 8, no of cores: 1024, max_msix_vectors: 8
[139365.154585] mpt2sas1-msix0: PCI-MSI-X enabled: IRQ 981
[139365.229717] mpt2sas1-msix1: PCI-MSI-X enabled: IRQ 982
[139365.304034] mpt2sas1-msix2: PCI-MSI-X enabled: IRQ 983
[139365.377995] mpt2sas1-msix3: PCI-MSI-X enabled: IRQ 984
[139365.453042] mpt2sas1-msix4: PCI-MSI-X enabled: IRQ 985
[139365.526897] mpt2sas1-msix5: PCI-MSI-X enabled: IRQ 986
[139365.600849] mpt2sas1-msix6: PCI-MSI-X enabled: IRQ 987
[139365.674283] mpt2sas1-msix7: PCI-MSI-X enabled: IRQ 988
[139365.750227] mpt2sas1: iomem(0x00008394a0000000), mapped(0x00008394a0000000), size(65536)
[139365.866979] mpt2sas1: ioport(0x000083c104001000), size(256)
[139366.382330] mpt2sas1: Allocated physical memory: size(4603 kB)
[139366.457337] mpt2sas0: host_add: handle(0x0001), sas_addr(0x508002000159c0d0), phys(8)
[139366.579875] mpt2sas1: Current Controller Queue Depth(2811), Max Controller Queue Depth(3072)
[139366.701165] mpt2sas1: Scatter Gather Elements per IO(128)
[139367.010675] mpt2sas1: LSISAS2308: FWVersion(14.00.00.00), ChipRevision(0x05), BiosVersion(00.00.00.00)
[139367.142857] mpt2sas1: Protocol=(Initiator), Capabilities=(Raid,TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
[139367.302103] scsi host5: Fusion MPT SAS Host
[139367.367513] mpt2sas1: sending port enable !!
[139369.024859] mpt2sas1: host_add: handle(0x0001), sas_addr(0x508002000159c0d1), phys(8)
[139372.414647] qla2xxx [0002:03:00.1]-8038:1: Cable is unplugged...
[139372.577572] mpt2sas0: port enable: SUCCESS
[139372.645164] scsi 4:0:0:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[139372.760799] scsi 4:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0163295b1), phy(1), device_name(0x5000cca0163295b3)
[139372.910764] scsi 4:0:0:0: SSP: enclosure_logical_id(0x508002000159c0d0), slot(1)
[139373.026038] scsi 4:0:1:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[139373.142336] scsi 4:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca0162a4c1d), phy(2), device_name(0x5000cca0162a4c1f)
[139373.291749] scsi 4:0:1:0: SSP: enclosure_logical_id(0x508002000159c0d0), slot(2)
[139373.349187] random: nonblocking pool is initialized
[139375.153568] mpt2sas1: port enable: SUCCESS
[139375.219620] scsi 5:0:0:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[139375.334994] scsi 5:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0162f2e39), phy(0), device_name(0x5000cca0162f2e3b)
[139375.484839] scsi 5:0:0:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(0)
[139375.599921] scsi 5:0:1:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[139375.714933] scsi 5:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca016322ee5), phy(1), device_name(0x5000cca016322ee7)
[139375.863979] scsi 5:0:1:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(1)
[139375.978128] scsi 5:0:2:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[139376.092879] scsi 5:0:2:0: SSP: handle(0x000b), sas_addr(0x5000cca016322f71), phy(2), device_name(0x5000cca016322f73)
[139376.242542] scsi 5:0:2:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(2)
[139376.393882] sd 4:0:0:0: [sda] Enabling DIF Type 1 protection
[139376.405422] sd 5:0:0:0: [sdc] Enabling DIF Type 1 protection
[139376.405429] sd 5:0:0:0: [sdc] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[139376.405470] sd 5:0:1:0: [sdd] Enabling DIF Type 1 protection
[139376.405475] sd 5:0:1:0: [sdd] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[139376.405478] sd 5:0:2:0: [sde] Enabling DIF Type 1 protection
[139376.405482] sd 5:0:2:0: [sde] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[139376.405497] sd 4:0:1:0: [sdb] Enabling DIF Type 1 protection
[139376.405504] sd 4:0:1:0: [sdb] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[139376.406361] sd 4:0:1:0: [sdb] Write Protect is off
[139376.406365] sd 4:0:1:0: [sdb] Mode Sense: e7 00 10 08
[139376.406846] sd 4:0:1:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA
[139376.413993] sd 5:0:0:0: [sdc] Write Protect is off
[139376.413997] sd 5:0:0:0: [sdc] Mode Sense: e7 00 10 08
[139376.414000] sd 5:0:1:0: [sdd] Write Protect is off
[139376.414003] sd 5:0:1:0: [sdd] Mode Sense: e7 00 10 08
[139376.414008] sd 5:0:2:0: [sde] Write Protect is off
[139376.414011] sd 5:0:2:0: [sde] Mode Sense: e7 00 10 08
[139376.415042]  sdb: sdb1 sdb2 sdb3 sdb7
[139376.418323] sd 5:0:1:0: [sdd] Write cache: disabled, read cache: enabled, supports DPO and FUA
[139376.418330] sd 5:0:0:0: [sdc] Write cache: disabled, read cache: enabled, supports DPO and FUA
[139376.418339] sd 5:0:2:0: [sde] Write cache: disabled, read cache: enabled, supports DPO and FUA
[139376.422997] sd 4:0:1:0: [sdb] Attached SCSI disk
[139376.437300]  sdc: sdc1 sdc2 sdc3 sdc7
[139376.437362]  sde: sde1 sde2 sde3
[139376.437430]  sdd: sdd1 sdd2 sdd3 sdd7
[139376.448003] sd 5:0:2:0: [sde] Attached SCSI disk
[139376.448756] sd 5:0:0:0: [sdc] Attached SCSI disk
[139376.448881] sd 5:0:1:0: [sdd] Attached SCSI disk
[139378.768240] sd 4:0:0:0: [sda] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[139378.876488] sd 4:0:0:0: [sda] Write Protect is off
[139378.945523] sd 4:0:0:0: [sda] Mode Sense: e7 00 10 08
[139379.018248] sd 4:0:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
[139379.148712]  sda: sda1 sda2 sda3
[139379.201944] sd 4:0:0:0: [sda] Attached SCSI disk
[139379.471145] dracut: Scanning devices sda2 sde2  for LVM logical volumes VolGroup/lv_swap VolGroup/lv_root 
[139379.925188] dracut: inactive '/dev/VolGroup/lv_root' [274.38 GiB] inherit
[139380.025660] dracut: inactive '/dev/VolGroup/lv_swap' [4.00 GiB] inherit
[139380.120476] dracut: inactive '/dev/vg/root' [10.00 GiB] inherit
[139380.206946] dracut: inactive '/dev/vg/swap' [2.00 GiB] inherit
[139380.290516] dracut: inactive '/dev/vg/tmpdir' [10.00 GiB] inherit
[139380.378861] dracut: inactive '/dev/vg/mountpoint' [5.00 GiB] inherit
[139380.757435] EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
[139380.924902] dracut: Mounted root filesystem /dev/mapper/VolGroup-lv_root
[139381.228604] dracut: Loading SELinux policy
[139381.503895] audit: type=1404 audit(1427554072.560:2): enforcing=1 old_enforcing=0 auid=4294967295 ses=4294967295
[139381.787655] SELinux: 2048 avtab hash slots, 277818 rules.
[139381.971063] SELinux: 2048 avtab hash slots, 277818 rules.
[139382.368975] SELinux:  9 users, 12 roles, 3918 types, 217 bools, 1 sens, 1024 cats
[139382.475955] SELinux:  81 classes, 277818 rules
[139382.547437] SELinux:  Permission audit_access in class file not defined in policy.
[139382.655083] SELinux:  Permission audit_access in class dir not defined in policy.
[139382.761612] SELinux:  Permission execmod in class dir not defined in policy.
[139382.862027] SELinux:  Permission audit_access in class lnk_file not defined in policy.
[139382.975140] SELinux:  Permission open in class lnk_file not defined in policy.
[139383.080661] SELinux:  Permission execmod in class lnk_file not defined in policy.
[139383.187719] SELinux:  Permission audit_access in class chr_file not defined in policy.
[139383.303781] SELinux:  Permission audit_access in class blk_file not defined in policy.
[139383.417224] SELinux:  Permission execmod in class blk_file not defined in policy.
[139383.526816] SELinux:  Permission audit_access in class sock_file not defined in policy.
[139383.641758] SELinux:  Permission execmod in class sock_file not defined in policy.
[139383.749944] SELinux:  Permission audit_access in class fifo_file not defined in policy.
[139383.864185] SELinux:  Permission execmod in class fifo_file not defined in policy.
[139383.975548] SELinux:  Permission syslog in class capability2 not defined in policy.
[139384.084245] SELinux:  Permission wake_alarm in class capability2 not defined in policy.
[139384.198125] SELinux:  Permission block_suspend in class capability2 not defined in policy.
[139384.315685] SELinux:  Permission audit_read in class capability2 not defined in policy.
[139384.429615] SELinux:  Permission attach_queue in class tun_socket not defined in policy.
[139384.545603] SELinux:  Class binder not defined in policy.
[139384.622723] SELinux: the above unknown classes and permissions will be allowed
[139384.725599] SELinux:  Completing initialization.
[139384.791664] SELinux:  Setting up existing superblocks.
[139384.958692] audit: type=1403 audit(1427554076.016:3): policy loaded auid=4294967295 ses=4294967295
[139385.090956] dracut: 
[139387.068126] dracut: Switching root
[139390.093277] udev: starting version 147
[139390.470135] sha1_sparc64: Using sparc64 sha1 opcode optimized SHA-1 implementation
[139390.603974] sha512_sparc64: Using sparc64 sha512 opcode optimized SHA-512/SHA-384 implementation
[139390.758177] md5_sparc64: Using sparc64 md5 opcode optimized MD5 implementation
[139390.902658] des_sparc64: Using sparc64 des opcodes optimized DES implementation
[139391.034021] camellia_sparc64: Using sparc64 camellia opcodes optimized CAMELLIA implementation
[139391.175772] crc32c_sparc64: Using sparc64 crc32c opcode optimized CRC32C implementation
[139395.763215] pps_core: LinuxPPS API ver. 1 registered
[139395.834166] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[139395.981865] PTP clock support registered
[139396.130610] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 4.0.1-k
[139396.240362] ixgbe: Copyright (c) 1999-2014 Intel Corporation.
[139396.323545] PCI: Enabling device: (0000:06:00.0), cmd 2
[139396.398158] ixgbe 0000:06:00.0: enabling bus mastering
[139396.870811] ixgbe 0000:06:00.0: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[139397.051870] ixgbe 0000:06:00.0: PCI Express bandwidth of 32GT/s available
[139397.148498] ixgbe 0000:06:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[139397.290187] ixgbe 0000:06:00.0: MAC: 3, PHY: 0, PBA No: 000000-000
[139397.378436] ixgbe 0000:06:00.0: 00:10:e0:35:15:f6
[139397.694548] ixgbe 0000:06:00.0: Intel(R) 10 Gigabit Network Connection
[139397.788471] PCI: Enabling device: (0000:06:00.1), cmd 2
[139397.863089] ixgbe 0000:06:00.1: enabling bus mastering
[139398.334501] ixgbe 0000:06:00.1: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[139398.514745] ixgbe 0000:06:00.1: PCI Express bandwidth of 32GT/s available
[139398.611375] ixgbe 0000:06:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[139398.755558] ixgbe 0000:06:00.1: MAC: 3, PHY: 0, PBA No: 000000-000
[139398.843587] ixgbe 0000:06:00.1: 00:10:e0:35:15:f7
[139399.157213] ixgbe 0000:06:00.1: Intel(R) 10 Gigabit Network Connection
[139399.250506] PCI: Enabling device: (000f:75:00.0), cmd 2
[139399.325114] ixgbe 000f:75:00.0: enabling bus mastering
[139399.798217] ixgbe 000f:75:00.0: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[139399.978658] ixgbe 000f:75:00.0: PCI Express bandwidth of 32GT/s available
[139400.075572] ixgbe 000f:75:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[139400.217278] ixgbe 000f:75:00.0: MAC: 3, PHY: 0, PBA No: 000000-000
[139400.305308] ixgbe 000f:75:00.0: 00:10:e0:35:15:f8
[139400.618963] ixgbe 000f:75:00.0: Intel(R) 10 Gigabit Network Connection
[139400.714727] PCI: Enabling device: (000f:75:00.1), cmd 2
[139400.789550] ixgbe 000f:75:00.1: enabling bus mastering
[139401.262715] ixgbe 000f:75:00.1: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[139401.443724] ixgbe 000f:75:00.1: PCI Express bandwidth of 32GT/s available
[139401.540349] ixgbe 000f:75:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[139401.683301] ixgbe 000f:75:00.1: MAC: 3, PHY: 0, PBA No: 000000-000
[139401.772031] ixgbe 000f:75:00.1: 00:10:e0:35:15:f9
[139402.085989] ixgbe 000f:75:00.1: Intel(R) 10 Gigabit Network Connection
[139402.416704] xhci_hcd 0000:05:00.0: enabling bus mastering
[139402.493806] xhci_hcd 0000:05:00.0: xHCI Host Controller
[139402.577442] xhci_hcd 0000:05:00.0: new USB bus registered, assigned bus number 1
[139402.688738] xhci_hcd 0000:05:00.0: hcc params 0x014051cf hci version 0x100 quirks 0x00000010
[139402.809007] xhci_hcd 0000:05:00.0: enabling Mem-Wr-Inval
[139402.892677] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[139402.990049] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[139403.094369] usb usb1: Product: xHCI Host Controller
[139403.164697] usb usb1: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
[139403.246704] usb usb1: SerialNumber: 0000:05:00.0
[139403.313196] hub 1-0:1.0: USB hub found
[139403.367518] hub 1-0:1.0: 4 ports detected
[139403.425264] xhci_hcd 0000:05:00.0: xHCI Host Controller
[139403.499934] xhci_hcd 0000:05:00.0: new USB bus registered, assigned bus number 2
[139403.606684] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003
[139403.704278] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[139403.808287] usb usb2: Product: xHCI Host Controller
[139403.878162] usb usb2: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
[139403.960176] usb usb2: SerialNumber: 0000:05:00.0
[139404.027373] hub 2-0:1.0: USB hub found
[139404.081164] hub 2-0:1.0: 4 ports detected
[139404.139552] xhci_hcd 000f:76:00.0: enabling bus mastering
[139404.145592] usb 1-3: new high-speed USB device number 2 using xhci_hcd
[139404.311176] xhci_hcd 000f:76:00.0: xHCI Host Controller
[139404.385960] xhci_hcd 000f:76:00.0: new USB bus registered, assigned bus number 3
[139404.497103] xhci_hcd 000f:76:00.0: hcc params 0x014051cf hci version 0x100 quirks 0x00000010
[139404.617048] xhci_hcd 000f:76:00.0: enabling Mem-Wr-Inval
[139404.702085] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[139404.746013] usb 1-3: New USB device found, idVendor=090c, idProduct=1000
[139404.746016] usb 1-3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[139404.746018] usb 1-3: Product: USB DISK
[139404.746020] usb 1-3: Manufacturer: SMI Corporation
[139404.746022] usb 1-3: SerialNumber: 2011081500000723
[139404.746164] usb 1-3: ep 0x81 - rounding interval to 128 microframes, ep desc says 255 microframes
[139404.746175] usb 1-3: ep 0x2 - rounding interval to 128 microframes, ep desc says 255 microframes
[139405.441112] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[139405.546893] usb usb3: Product: xHCI Host Controller
[139405.616661] usb usb3: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
[139405.699423] usb usb3: SerialNumber: 000f:76:00.0
[139405.766814] hub 3-0:1.0: USB hub found
[139405.820595] hub 3-0:1.0: 4 ports detected
[139405.878267] xhci_hcd 000f:76:00.0: xHCI Host Controller
[139405.953872] xhci_hcd 000f:76:00.0: new USB bus registered, assigned bus number 4
[139406.059920] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003
[139406.156306] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[139406.259155] usb usb4: Product: xHCI Host Controller
[139406.328631] usb usb4: Manufacturer: Linux 4.0.0-rc5+ xhci-hcd
[139406.412021] usb usb4: SerialNumber: 000f:76:00.0
[139406.478315] hub 4-0:1.0: USB hub found
[139406.532471] hub 4-0:1.0: 4 ports detected
[139406.627982] sd 4:0:0:0: Attached scsi generic sg0 type 0
[139406.704523] sd 4:0:1:0: Attached scsi generic sg1 type 0
[139406.780958] sd 5:0:0:0: Attached scsi generic sg2 type 0
[139406.857384] sd 5:0:1:0: Attached scsi generic sg3 type 0
[139406.933886] sd 5:0:2:0: Attached scsi generic sg4 type 0
[139407.297694] usb-storage 1-3:1.0: USB Mass Storage device detected
[139407.385002] scsi host6: usb-storage 1-3:1.0
[139407.445040] usbcore: registered new interface driver usb-storage
[139408.539522] scsi 6:0:0:0: Direct-Access     SMI      USB DISK         3000 PQ: 0 ANSI: 0 CCS
[139408.666801] sd 6:0:0:0: Attached scsi generic sg5 type 0
[139408.666808] sd 6:0:0:0: [sdf] 62652416 512-byte logical blocks: (32.0 GB/29.8 GiB)
[139408.677704] sd 6:0:0:0: [sdf] Write Protect is off
[139408.677707] sd 6:0:0:0: [sdf] Mode Sense: 43 00 00 00
[139408.678565] sd 6:0:0:0: [sdf] No Caching mode page found
[139408.678568] sd 6:0:0:0: [sdf] Assuming drive cache: write through
[139408.684760]  sdf: sdf1 sdf2 sdf3
[139408.689820] sd 6:0:0:0: [sdf] Attached SCSI removable disk
[139410.178165] EXT4-fs (dm-0): re-mounted. Opts: (null)
[139411.064879] kjournald starting.  Commit interval 5 seconds
[139411.075831] EXT3-fs (sde1): using internal journal
[139411.075835] EXT3-fs (sde1): mounted filesystem with ordered data mode
[139412.279604] Adding 4194296k swap on /dev/mapper/VolGroup-lv_swap.  Priority:-1 extents:1 across:4194296k FS
[139416.870354] NET: Registered protocol family 10
[139417.970758] pps pps0: new PPS source ptp0
[139418.028033] ixgbe 0000:06:00.0: registered PHC device on eth0
[139418.333472] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[139421.242652] audit: type=1305 audit(1427554112.300:4): audit_pid=11691 old=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:auditd_t:s0 res=1
[139421.632455] ixgbe 0000:06:00.0 eth0: NIC Link is Up 1 Gbps, Flow Control: RX/TX
[139421.737719] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-27 23:57       ` Yinghai Lu
  2015-03-28  0:32         ` David Ahern
  2015-03-28  1:05         ` Sam Ravnborg
@ 2015-03-28 18:16         ` David Miller
  2015-03-28 20:19           ` Yinghai Lu
  2 siblings, 1 reply; 39+ messages in thread
From: David Miller @ 2015-03-28 18:16 UTC (permalink / raw)
  To: yinghai; +Cc: david.ahern, bhelgaas, linux-pci, sparclinux, linux-kernel

From: Yinghai Lu <yinghai@kernel.org>
Date: Fri, 27 Mar 2015 16:57:23 -0700

> On Fri, Mar 27, 2015 at 2:01 PM, Yinghai Lu <yinghai@kernel.org> wrote:
>> On Thu, Mar 26, 2015 at 4:27 PM, David Ahern <david.ahern@oracle.com> wrote:
> 
>> Also please make sure your config have
>>
>> CONFIG_PCI_DEBUG=y
>>
>> and capture serial console with "debug ignore_loglevel", so we check if
>> pci 0000:00:01.0 really have resource assigned.
> 
> Please check attached patch and send out boot log with above config.

PCI addresses being 64-bit or not is an attribute of the PCI
controller and the geography of the bridges behind it, not the
cpu architecture.

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-28 18:16         ` David Miller
@ 2015-03-28 20:19           ` Yinghai Lu
  0 siblings, 0 replies; 39+ messages in thread
From: Yinghai Lu @ 2015-03-28 20:19 UTC (permalink / raw)
  To: David Miller
  Cc: David Ahern, Bjorn Helgaas, linux-pci, sparclinux,
	Linux Kernel Mailing List

On Sat, Mar 28, 2015 at 11:16 AM, David Miller <davem@davemloft.net> wrote:
> PCI addresses being 64-bit or not is an attribute of the PCI
> controller and the geography of the bridges behind it, not the
> cpu architecture.

Good point. We should add one choice in pci subsystem Kconfig.

Thanks

Yinghai

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-28 14:48                   ` David Ahern
@ 2015-03-28 20:24                     ` Yinghai Lu
  2015-03-29 14:47                       ` David Ahern
  0 siblings, 1 reply; 39+ messages in thread
From: Yinghai Lu @ 2015-03-28 20:24 UTC (permalink / raw)
  To: David Ahern; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

On Sat, Mar 28, 2015 at 7:48 AM, David Ahern <david.ahern@oracle.com> wrote:
> On 3/27/15 11:26 PM, Yinghai Lu wrote:
>>

>>
>> looks like the offset for mem64 is not right.
>>
>> Please try attached v2.

still have problem.

[139295.760918] pci_sun4v f02dbcfc: PCI host bridge to bus 0000:00
[139295.831448] pci_bus 0000:00: root bus resource [io
0x804000000000-0x80400fffffff] (bus address [0x0000-0xfffffff])
[139295.958623] pci_bus 0000:00: root bus resource [mem
0x800000000000-0x80007effffff] (bus address [0x00000000-0x7effffff])
[139296.091392] pci_bus 0000:00: root bus resource [mem
0x800100000000-0x8007ffffffff] (bus address [0x100000000-0x7ffffffff])
[139296.225779] pci_bus 0000:00: root bus resource [bus 00-77]
...
[139298.092814] pci 0000:05:00.0: can't claim BAR 0 [mem
0x800100000000-0x800100001fff]: no compatible bridge window
[139298.215949] pci 0000:06:00.0: can't claim BAR 7 [mem
0x800110204000-0x800110303fff 64bit]: no compatible bridge window
[139298.346479] pci 0000:06:00.0: can't claim BAR 10 [mem
0x800110304000-0x800110403fff 64bit]: no compatible bridge window
[139298.476953] pci 0000:06:00.1: can't claim BAR 7 [mem
0x800110408000-0x800110507fff 64bit]: no compatible bridge window
[139298.607105] pci 0000:06:00.1: can't claim BAR 10 [mem
0x800110800000-0x8001108fffff 64bit]: no compatible bridge window
[139298.739341] pci 0000:07:00.0: can't claim BAR 1 [mem
0x800120000000-0x80012000ffff]: no compatible bridge window
[139298.862467] pci 0000:07:00.0: can't claim BAR 3 [mem
0x800120040000-0x80012007ffff]: no compatible bridge window

Can you append "ofpci_debug=1" in boot command line?

So we can check if the bridge get 64 bus from the of layer.

Thanks

Yinghai

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-28 20:24                     ` Yinghai Lu
@ 2015-03-29 14:47                       ` David Ahern
  2015-03-29 20:07                         ` Yinghai Lu
  0 siblings, 1 reply; 39+ messages in thread
From: David Ahern @ 2015-03-29 14:47 UTC (permalink / raw)
  To: Yinghai Lu; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

[-- Attachment #1: Type: text/plain, Size: 114 bytes --]

On 3/28/15 2:24 PM, Yinghai Lu wrote:
> Can you append "ofpci_debug=1" in boot command line?

here you go.

David

[-- Attachment #2: screenlog.0 --]
[-- Type: application/octet-stream, Size: 286523 bytes --]

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
       [not found]         ` <CABhMZUVqgsYdT4wn2H8hsrh4f=6hT0G+sg=wwYSt33+jtvBS9A@mail.gmail.com>
@ 2015-03-29 18:32           ` David Miller
  2015-04-03 15:45             ` Bjorn Helgaas
  0 siblings, 1 reply; 39+ messages in thread
From: David Miller @ 2015-03-29 18:32 UTC (permalink / raw)
  To: bjorn, bjorn.helgaas
  Cc: sparclinux, linux-pci, yinghai, david.ahern, bhelgaas, linux-kernel

From: Bjorn Helgaas <bjorn.helgaas@gmail.com>
Date: Sun, 29 Mar 2015 08:30:40 -0500

> Help me understand the sparc64 situation: are you saying that BAR
> addresses, i.e., MMIO transactions from a CPU or a peer-to-peer DMA can be
> 64 bits, but a DMA to main memory can only be 32 bits?
> 
> I assume this would work if we made dma_addr_t 64 bits on sparc64.  What
> would be the cost of doing that?

The cost is 4 extra bytes in every datastructure, kernel wide, that
stores DMA addresses.

This choice was very intentional, and well thought out.

Don't use DMA addresses for PCI addresses.  They are absolutely not
the same, especially when an IOMMU is always present because in that
case all DMA addresses are virtual and exist in a different realm
and set of constraints/restrictions.

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-29 14:47                       ` David Ahern
@ 2015-03-29 20:07                         ` Yinghai Lu
  2015-03-30 22:54                           ` David Ahern
  0 siblings, 1 reply; 39+ messages in thread
From: Yinghai Lu @ 2015-03-29 20:07 UTC (permalink / raw)
  To: David Ahern, David Miller; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

On Sun, Mar 29, 2015 at 7:47 AM, David Ahern <david.ahern@oracle.com> wrote:
> On 3/28/15 2:24 PM, Yinghai Lu wrote:
>>
>> Can you append "ofpci_debug=1" in boot command line?
>
>
> here you go.


[  286.647560] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@6] bus no 8
[  286.921232] PCI: Claiming 0000:00:01.0: Resource 15:
0000800100000000..00008004afffffff [220c]
[  287.229190] PCI: Claiming 0000:01:00.0: Resource 15:
0000800100000000..00008004afffffff [220c]
[  287.533428] PCI: Claiming 0000:02:04.0: Resource 15:
0000800100000000..000080012fffffff [220c]
[  288.149831] PCI: Claiming 0000:03:00.0: Resource 15:
0000800100000000..000080012fffffff [220c]
[  288.252466] PCI: Claiming 0000:04:06.0: Resource 14:
0000800100000000..000080010fffffff [220c]
[  288.867196] PCI: Claiming 0000:05:00.0: Resource 0:
0000800100000000..0000800100001fff [204]
[  288.968221] pci 0000:05:00.0: can't claim BAR 0 [mem
0x800100000000-0x800100001fff]: no compatible bridge window

the bridge resource has IORESOURCE_PREFETCH, but the device doesn't have that.

So pci_claim_resource can not find parent resource for device
resource: we can not
put non pref mem under pref mem.

Can you send out result from ?
lspci -vvxxx -s 0000:05:00.0

If it does have pref, could be of device layer does not pass the pref
flag properly
via pci_parse_of_addrs/of_get_property(node, "assigned-addresses".

or the addr0 from "ranges" and "assigned-address" has different definition.

Thanks

Yinghai

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-29 20:07                         ` Yinghai Lu
@ 2015-03-30 22:54                           ` David Ahern
  2015-03-31  1:06                             ` Yinghai Lu
  0 siblings, 1 reply; 39+ messages in thread
From: David Ahern @ 2015-03-30 22:54 UTC (permalink / raw)
  To: Yinghai Lu, David Miller; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

On 3/29/15 2:07 PM, Yinghai Lu wrote:
> [  286.647560] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@6] bus no 8
> [  286.921232] PCI: Claiming 0000:00:01.0: Resource 15:
> 0000800100000000..00008004afffffff [220c]
> [  287.229190] PCI: Claiming 0000:01:00.0: Resource 15:
> 0000800100000000..00008004afffffff [220c]
> [  287.533428] PCI: Claiming 0000:02:04.0: Resource 15:
> 0000800100000000..000080012fffffff [220c]
> [  288.149831] PCI: Claiming 0000:03:00.0: Resource 15:
> 0000800100000000..000080012fffffff [220c]
> [  288.252466] PCI: Claiming 0000:04:06.0: Resource 14:
> 0000800100000000..000080010fffffff [220c]
> [  288.867196] PCI: Claiming 0000:05:00.0: Resource 0:
> 0000800100000000..0000800100001fff [204]
> [  288.968221] pci 0000:05:00.0: can't claim BAR 0 [mem
> 0x800100000000-0x800100001fff]: no compatible bridge window
>
> the bridge resource has IORESOURCE_PREFETCH, but the device doesn't have that.
>
> So pci_claim_resource can not find parent resource for device
> resource: we can not
> put non pref mem under pref mem.
>
> Can you send out result from ?
> lspci -vvxxx -s 0000:05:00.0

# lspci -vvxxx -s 0000:05:00.0
0000:05:00.0 USB controller: Renesas Technology Corp. uPD720201 USB 3.0 
Host Controller (rev 03) (prog-if 30 [XHCI])
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- 
<MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 00000004
	Region 0: Memory at 100000000 (64-bit, non-prefetchable) [size=8K]
	Region 2: [virtual] Memory at ffff800000000000 (32-bit, non-prefetchable)
	Region 3: [virtual] Memory at ffff800000000000 (32-bit, non-prefetchable)
	Region 4: [virtual] Memory at ffff800000000000 (32-bit, non-prefetchable)
	Region 5: [virtual] Memory at ffff800000000000 (32-bit, non-prefetchable)
	[virtual] Expansion ROM at ffff800000000000 [disabled]
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA 
PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [70] MSI: Enable- Count=1/8 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [90] MSI-X: Enable+ Count=8 Masked-
		Vector table: BAR=0 offset=00001000
		PBA: BAR=0 offset=00001080
	Capabilities: [a0] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s unlimited, L1 
unlimited
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
		LnkCap:	Port #0, Speed 5GT/s, Width x1, ASPM L0s L1, Latency L0 <4us, 
L1 unlimited
			ClockPM+ Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- 
BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+, LTR+, OBFF 
Not Supported
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF 
Disabled
		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- 
ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, 
EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- 
MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ 
MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [150 v1] Latency Tolerance Reporting
		Max snoop latency: 0ns
		Max no snoop latency: 0ns
	Kernel driver in use: xhci_hcd
00: 12 19 14 00 06 04 10 00 03 30 03 0c 10 00 00 00
10: 04 00 00 00 01 00 00 00 00 00 00 00 00 00 00 00
20: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
30: 00 00 00 00 50 00 00 00 00 00 00 00 00 01 00 00
40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
50: 01 70 c3 c9 08 00 00 00 00 00 00 00 00 00 00 00
60: 30 20 00 00 00 00 00 00 00 00 00 00 09 18 20 00
70: 05 90 86 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
90: 11 a0 07 80 00 10 00 00 80 10 00 00 00 00 00 00
a0: 10 00 02 00 c0 8f 00 00 00 28 19 00 12 ec 07 00
b0: 00 00 12 10 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 10 08 00 00 00 00 00 00 00 00 00 00
d0: 02 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 55 00 00 00 01 05 10 20 20 00
f0: 50 07 00 00 00 00 00 80 00 00 00 00 00 00 00 00


>
> If it does have pref, could be of device layer does not pass the pref
> flag properly
> via pci_parse_of_addrs/of_get_property(node, "assigned-addresses".
>
> or the addr0 from "ranges" and "assigned-address" has different definition.
>
> Thanks
>
> Yinghai
>


^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-30 22:54                           ` David Ahern
@ 2015-03-31  1:06                             ` Yinghai Lu
  2015-03-31  4:10                               ` David Ahern
  2015-03-31 15:06                               ` David Miller
  0 siblings, 2 replies; 39+ messages in thread
From: Yinghai Lu @ 2015-03-31  1:06 UTC (permalink / raw)
  To: David Ahern; +Cc: David Miller, Bjorn Helgaas, linux-pci, sparclinux, LKML

[-- Attachment #1: Type: text/plain, Size: 1925 bytes --]

On Mon, Mar 30, 2015 at 3:54 PM, David Ahern <david.ahern@oracle.com> wrote:
> On 3/29/15 2:07 PM, Yinghai Lu wrote:
>>
>> [  286.647560] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@6] bus no 8
>> [  286.921232] PCI: Claiming 0000:00:01.0: Resource 15:
>> 0000800100000000..00008004afffffff [220c]
>> [  287.229190] PCI: Claiming 0000:01:00.0: Resource 15:
>> 0000800100000000..00008004afffffff [220c]
>> [  287.533428] PCI: Claiming 0000:02:04.0: Resource 15:
>> 0000800100000000..000080012fffffff [220c]
>> [  288.149831] PCI: Claiming 0000:03:00.0: Resource 15:
>> 0000800100000000..000080012fffffff [220c]
>> [  288.252466] PCI: Claiming 0000:04:06.0: Resource 14:
>> 0000800100000000..000080010fffffff [220c]
>> [  288.867196] PCI: Claiming 0000:05:00.0: Resource 0:
>> 0000800100000000..0000800100001fff [204]
>> [  288.968221] pci 0000:05:00.0: can't claim BAR 0 [mem
>> 0x800100000000-0x800100001fff]: no compatible bridge window
>>
>> the bridge resource has IORESOURCE_PREFETCH, but the device doesn't have
>> that.
>
> # lspci -vvxxx -s 0000:05:00.0
> 0000:05:00.0 USB controller: Renesas Technology Corp. uPD720201 USB 3.0 Host
> Controller (rev 03) (prog-if 30 [XHCI])
>         Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
> Stepping- SERR- FastB2B- DisINTx+
>         Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
> <TAbort- <MAbort- >SERR- <PERR- INTx-
>         Latency: 0, Cache Line Size: 64 bytes
>         Interrupt: pin A routed to IRQ 00000004
>         Region 0: Memory at 100000000 (64-bit, non-prefetchable) [size=8K]

ok, that is really non-pref mmio 64bit.
We can workaround the problem by honoring firmware setting, according
to https://www.pcisig.com/specifications/pciexpress/base2/PCIe_Base_r2.1_Errata_08Jun10.pdf
page 13

Please check attached updated patches that should fix the regression
and kill those "no compatible window" warnings.

Thanks

Yinghai

[-- Attachment #2: pci_bus_addr_t_v2.patch --]
[-- Type: text/x-patch, Size: 5233 bytes --]

Subject: [RFC PATCH v2] PCI: Introduce pci_bus_addr_t

David Ahern found commit d63e2e1f3df9 ("sparc/PCI: Clip bridge windows
to fit in upstream windows") broke sparc/T5-8.

In the boot log, there is
  pci 0000:06:00.0: reg 0x184: can't handle BAR above 4GB (bus address
  0x110204000)
but that only could happen when dma_addr_t is 32-bit.

According to David Miller, all DMA occurs behind an IOMMU and these
IOMMUs only support 32-bit addressing, therefore dma_addr_t is
32-bit on sparc64.

Let's introduce pci_bus_addr_t instead of using dma_addr_t,
and pci_bus_addr_t will be 64-bit on 64-bit platform or X86 PAE kernel.

Fixes: commit d63e2e1f3df9 ("sparc/PCI: Clip bridge windows to fit in upstream windows")
Fixes: commit 23b13bc76f35 ("PCI: Fail safely if we can't handle BARs larger than 4GB")
Link: http://lkml.kernel.org/r/CAE9FiQU1gJY1LYrxs+ma5LCTEEe4xmtjRG0aXJ9K_Tsu+m9Wuw@mail.gmail.com
Reported-by: David Ahern <david.ahern@oracle.com>
Signed-off-by: Yinghai Lu <yinghai@kernel.org>

---
-v2: use PCI_BUS_ADDR in drivers/pci/bus.c
     put config option in pci/Kconfig: as David Miller said:
       PCI addresses being 64-bit or not is an attribute of the PCI
       controller and the geography of the bridges behind it, not the
       cpu architecture.
---
 drivers/pci/Kconfig |    4 ++++
 drivers/pci/bus.c   |   10 +++++-----
 drivers/pci/probe.c |   12 ++++++------
 include/linux/pci.h |   12 +++++++++---
 4 files changed, 24 insertions(+), 14 deletions(-)

Index: linux-2.6/drivers/pci/bus.c
===================================================================
--- linux-2.6.orig/drivers/pci/bus.c
+++ linux-2.6/drivers/pci/bus.c
@@ -92,11 +92,11 @@ void pci_bus_remove_resources(struct pci
 }
 
 static struct pci_bus_region pci_32_bit = {0, 0xffffffffULL};
-#ifdef CONFIG_ARCH_DMA_ADDR_T_64BIT
+#ifdef CONFIG_PCI_BUS_ADDR_T_64BIT
 static struct pci_bus_region pci_64_bit = {0,
-				(dma_addr_t) 0xffffffffffffffffULL};
-static struct pci_bus_region pci_high = {(dma_addr_t) 0x100000000ULL,
-				(dma_addr_t) 0xffffffffffffffffULL};
+				(pci_bus_addr_t) 0xffffffffffffffffULL};
+static struct pci_bus_region pci_high = {(pci_bus_addr_t) 0x100000000ULL,
+				(pci_bus_addr_t) 0xffffffffffffffffULL};
 #endif
 
 /*
@@ -200,7 +200,7 @@ int pci_bus_alloc_resource(struct pci_bu
 					  resource_size_t),
 		void *alignf_data)
 {
-#ifdef CONFIG_ARCH_DMA_ADDR_T_64BIT
+#ifdef CONFIG_PCI_BUS_ADDR_T_64BIT
 	int rc;
 
 	if (res->flags & IORESOURCE_MEM_64) {
Index: linux-2.6/drivers/pci/probe.c
===================================================================
--- linux-2.6.orig/drivers/pci/probe.c
+++ linux-2.6/drivers/pci/probe.c
@@ -254,8 +254,8 @@ int __pci_read_base(struct pci_dev *dev,
 	}
 
 	if (res->flags & IORESOURCE_MEM_64) {
-		if ((sizeof(dma_addr_t) < 8 || sizeof(resource_size_t) < 8) &&
-		    sz64 > 0x100000000ULL) {
+		if ((sizeof(pci_bus_addr_t) < 8 || sizeof(resource_size_t) < 8)
+		    && sz64 > 0x100000000ULL) {
 			res->flags |= IORESOURCE_UNSET | IORESOURCE_DISABLED;
 			res->start = 0;
 			res->end = 0;
@@ -264,7 +264,7 @@ int __pci_read_base(struct pci_dev *dev,
 			goto out;
 		}
 
-		if ((sizeof(dma_addr_t) < 8) && l) {
+		if ((sizeof(pci_bus_addr_t) < 8) && l) {
 			/* Above 32-bit boundary; try to reallocate */
 			res->flags |= IORESOURCE_UNSET;
 			res->start = 0;
@@ -399,7 +399,7 @@ static void pci_read_bridge_mmio_pref(st
 	struct pci_dev *dev = child->self;
 	u16 mem_base_lo, mem_limit_lo;
 	u64 base64, limit64;
-	dma_addr_t base, limit;
+	pci_bus_addr_t base, limit;
 	struct pci_bus_region region;
 	struct resource *res;
 
@@ -426,8 +426,8 @@ static void pci_read_bridge_mmio_pref(st
 		}
 	}
 
-	base = (dma_addr_t) base64;
-	limit = (dma_addr_t) limit64;
+	base = (pci_bus_addr_t) base64;
+	limit = (pci_bus_addr_t) limit64;
 
 	if (base != base64) {
 		dev_err(&dev->dev, "can't handle bridge window above 4GB (bus address %#010llx)\n",
Index: linux-2.6/include/linux/pci.h
===================================================================
--- linux-2.6.orig/include/linux/pci.h
+++ linux-2.6/include/linux/pci.h
@@ -576,9 +576,15 @@ int raw_pci_read(unsigned int domain, un
 int raw_pci_write(unsigned int domain, unsigned int bus, unsigned int devfn,
 		  int reg, int len, u32 val);
 
+#ifdef CONFIG_PCI_BUS_ADDR_T_64BIT
+typedef u64 pci_bus_addr_t;
+#else
+typedef u32 pci_bus_addr_t;
+#endif
+
 struct pci_bus_region {
-	dma_addr_t start;
-	dma_addr_t end;
+	pci_bus_addr_t start;
+	pci_bus_addr_t end;
 };
 
 struct pci_dynids {
@@ -1127,7 +1133,7 @@ int __must_check pci_bus_alloc_resource(
 
 int pci_remap_iospace(const struct resource *res, phys_addr_t phys_addr);
 
-static inline dma_addr_t pci_bus_address(struct pci_dev *pdev, int bar)
+static inline pci_bus_addr_t pci_bus_address(struct pci_dev *pdev, int bar)
 {
 	struct pci_bus_region region;
 
Index: linux-2.6/drivers/pci/Kconfig
===================================================================
--- linux-2.6.orig/drivers/pci/Kconfig
+++ linux-2.6/drivers/pci/Kconfig
@@ -1,6 +1,10 @@
 #
 # PCI configuration
 #
+config PCI_BUS_ADDR_T_64BIT
+	def_bool y if (64BIT || X86_PAE)
+	depends on PCI
+
 config PCI_MSI
 	bool "Message Signaled Interrupts (MSI and MSI-X)"
 	depends on PCI

[-- Attachment #3: sparc_sun4v_mem64_v3.patch --]
[-- Type: text/x-patch, Size: 4046 bytes --]

Subject: [RFC PATCH v3] sparc/PCI: Add mem64 resource parsing for root bus

Found no compatible bridge window warning in boot log from T5-8.

pci 0000:00:01.0: can't claim BAR 15 [mem 0x100000000-0x4afffffff pref]: no compatible bridge window

and root bus only report io and mem32.

pci_sun4v f02dbcfc: PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x804000000000-0x80400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0000:00: root bus resource [mem 0x800000000000-0x80007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0000:00: root bus resource [bus 00-77]

Add mem64 handling in pci_common for sparc, so we can have 64bit resource
registered for root bus at first.

Signed-off-by: Yinghai Lu <yinghai@kernel.org>

---
-v2: mem64_space should use mem_space.start as offset.
-v3: add IORESOURCE_MEM_64 flag
---
 arch/sparc/kernel/pci.c        |    7 ++++++-
 arch/sparc/kernel/pci_common.c |   15 +++++++++++++--
 arch/sparc/kernel/pci_impl.h   |    1 +
 3 files changed, 20 insertions(+), 3 deletions(-)

Index: linux-2.6/arch/sparc/kernel/pci.c
===================================================================
--- linux-2.6.orig/arch/sparc/kernel/pci.c
+++ linux-2.6/arch/sparc/kernel/pci.c
@@ -185,8 +185,10 @@ static unsigned long pci_parse_of_flags(
 
 	if (addr0 & 0x02000000) {
 		flags = IORESOURCE_MEM | PCI_BASE_ADDRESS_SPACE_MEMORY;
-		flags |= (addr0 >> 22) & PCI_BASE_ADDRESS_MEM_TYPE_64;
 		flags |= (addr0 >> 28) & PCI_BASE_ADDRESS_MEM_TYPE_1M;
+		if (addr0 & 0x01000000)
+			flags |= IORESOURCE_MEM_64
+				 | PCI_BASE_ADDRESS_MEM_TYPE_64;
 		if (addr0 & 0x40000000)
 			flags |= IORESOURCE_PREFETCH
 				 | PCI_BASE_ADDRESS_MEM_PREFETCH;
@@ -663,6 +665,9 @@ struct pci_bus *pci_scan_one_pbm(struct
 				pbm->io_space.start);
 	pci_add_resource_offset(&resources, &pbm->mem_space,
 				pbm->mem_space.start);
+	if (pbm->mem64_space.flags)
+		pci_add_resource_offset(&resources, &pbm->mem64_space,
+					pbm->mem_space.start);
 	pbm->busn.start = pbm->pci_first_busno;
 	pbm->busn.end	= pbm->pci_last_busno;
 	pbm->busn.flags	= IORESOURCE_BUS;
Index: linux-2.6/arch/sparc/kernel/pci_common.c
===================================================================
--- linux-2.6.orig/arch/sparc/kernel/pci_common.c
+++ linux-2.6/arch/sparc/kernel/pci_common.c
@@ -406,6 +406,7 @@ void pci_determine_mem_io_space(struct p
 	}
 
 	num_pbm_ranges = i / sizeof(*pbm_ranges);
+	memset(&pbm->mem64_space, 0, sizeof(struct resource));
 
 	for (i = 0; i < num_pbm_ranges; i++) {
 		const struct linux_prom_pci_ranges *pr = &pbm_ranges[i];
@@ -451,7 +452,11 @@ void pci_determine_mem_io_space(struct p
 			break;
 
 		case 3:
-			/* XXX 64-bit MEM handling XXX */
+			/* 64-bit MEM handling */
+			pbm->mem64_space.start = a;
+			pbm->mem64_space.end = a + size - 1UL;
+			pbm->mem64_space.flags = IORESOURCE_MEM;
+			break;
 
 		default:
 			break;
@@ -465,15 +470,21 @@ void pci_determine_mem_io_space(struct p
 		prom_halt();
 	}
 
-	printk("%s: PCI IO[%llx] MEM[%llx]\n",
+	printk("%s: PCI IO[%llx] MEM[%llx]",
 	       pbm->name,
 	       pbm->io_space.start,
 	       pbm->mem_space.start);
+	if (pbm->mem64_space.flags)
+		printk(" MEM64[%llx]",
+		       pbm->mem64_space.start);
+	printk("\n");
 
 	pbm->io_space.name = pbm->mem_space.name = pbm->name;
 
 	request_resource(&ioport_resource, &pbm->io_space);
 	request_resource(&iomem_resource, &pbm->mem_space);
+	if (pbm->mem64_space.flags)
+		request_resource(&iomem_resource, &pbm->mem64_space);
 
 	pci_register_legacy_regions(&pbm->io_space,
 				    &pbm->mem_space);
Index: linux-2.6/arch/sparc/kernel/pci_impl.h
===================================================================
--- linux-2.6.orig/arch/sparc/kernel/pci_impl.h
+++ linux-2.6/arch/sparc/kernel/pci_impl.h
@@ -97,6 +97,7 @@ struct pci_pbm_info {
 	/* PBM I/O and Memory space resources. */
 	struct resource			io_space;
 	struct resource			mem_space;
+	struct resource			mem64_space;
 	struct resource			busn;
 
 	/* Base of PCI Config space, can be per-PBM or shared. */

[-- Attachment #4: pcie_pref_64bit_mem.patch --]
[-- Type: text/x-patch, Size: 3127 bytes --]

Subject: [RFC PATCH] PCI: Set pref for mem64 resource of pcie device

We still get "no compatible bridge window" warning on sparc T5-8
after we add support for 64bit resource for root bus.

[  286.647560] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@6] bus no 8
[  286.921232] PCI: Claiming 0000:00:01.0: Resource 15: 0000800100000000..00008004afffffff [220c]
[  287.229190] PCI: Claiming 0000:01:00.0: Resource 15: 0000800100000000..00008004afffffff [220c]
[  287.533428] PCI: Claiming 0000:02:04.0: Resource 15: 0000800100000000..000080012fffffff [220c]
[  288.149831] PCI: Claiming 0000:03:00.0: Resource 15: 0000800100000000..000080012fffffff [220c]
[  288.252466] PCI: Claiming 0000:04:06.0: Resource 14: 0000800100000000..000080010fffffff [220c]
[  288.867196] PCI: Claiming 0000:05:00.0: Resource 0: 0000800100000000..0000800100001fff [204]
[  288.968221] pci 0000:05:00.0: can't claim BAR 0 [mem 0x800100000000-0x800100001fff]: no compatible bridge window

All the bridges have pref mem 64-bit resource, but the device resource does not
have pref set, then we can not find parent for the device resource,
as we can not put non-pref mem under pref mem.

According to pcie spec errta
https://www.pcisig.com/specifications/pciexpress/base2/PCIe_Base_r2.1_Errata_08Jun10.pdf
page 13, in some case it is ok to mark some as pref.

only set the bit when the mmio is above 4G by BIOS.

Signed-off-by: Yinghai Lu <yinghai@kernel.org>

---
 drivers/pci/probe.c |   40 ++++++++++++++++++++++++++++++++++++++++
 1 file changed, 40 insertions(+)

Index: linux-2.6/drivers/pci/probe.c
===================================================================
--- linux-2.6.orig/drivers/pci/probe.c
+++ linux-2.6/drivers/pci/probe.c
@@ -1508,6 +1508,43 @@ static void pci_init_capabilities(struct
 	pci_enable_acs(dev);
 }
 
+/*
+ * According to
+ * https://www.pcisig.com/specifications/pciexpress/base2/PCIe_Base_r2.1_Errata_08Jun10.pdf
+ * page 13, system firmware could put some 64bit non-pref under 64bit pref,
+ * on some cases.
+ * Let's set pref bit when pci bus address is above 4G.
+ */
+static void set_pcie_64bit_pref(struct pci_dev *dev)
+{
+	int i;
+
+	if (!pci_is_pcie(dev))
+		return;
+
+	for (i = 0; i < PCI_BRIDGE_RESOURCES; i++) {
+		struct resource *res = &dev->resource[i];
+		struct pci_bus_region r;
+		enum pci_bar_type type;
+		int reg;
+
+		if (!(res->flags & IORESOURCE_MEM_64))
+			continue;
+
+		if (res->flags & IORESOURCE_PREFETCH)
+			continue;
+
+		pcibios_resource_to_bus(dev->bus, &r, res);
+		if (r.start < 0xffffffff)
+			continue;
+
+		reg = pci_resource_bar(dev, i, &type);
+		dev_printk(KERN_DEBUG, &dev->dev, "reg %d %pR + pref\n",
+			   reg, res);
+		res->flags |= IORESOURCE_PREFETCH;
+	}
+}
+
 void pci_device_add(struct pci_dev *dev, struct pci_bus *bus)
 {
 	int ret;
@@ -1538,6 +1575,9 @@ void pci_device_add(struct pci_dev *dev,
 	/* Initialize various capabilities */
 	pci_init_capabilities(dev);
 
+	/* After pcie_cap is assigned and sriov bar is probed */
+	set_pcie_64bit_pref(dev);
+
 	/*
 	 * Add the device to our list of discovered devices
 	 * and the bus list for fixup functions, etc.

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-31  1:06                             ` Yinghai Lu
@ 2015-03-31  4:10                               ` David Ahern
  2015-03-31 16:53                                 ` Yinghai Lu
  2015-03-31 15:06                               ` David Miller
  1 sibling, 1 reply; 39+ messages in thread
From: David Ahern @ 2015-03-31  4:10 UTC (permalink / raw)
  To: Yinghai Lu; +Cc: David Miller, Bjorn Helgaas, linux-pci, sparclinux, LKML

On 3/30/15 7:06 PM, Yinghai Lu wrote:
> ok, that is really non-pref mmio 64bit.
> We can workaround the problem by honoring firmware setting, according
> to https://www.pcisig.com/specifications/pciexpress/base2/PCIe_Base_r2.1_Errata_08Jun10.pdf
> page 13
>
> Please check attached updated patches that should fix the regression
> and kill those "no compatible window" warnings.

To make sure I am on the same page: these are a new round of patches? 
clear out the old, apply these?

David


^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-31  1:06                             ` Yinghai Lu
  2015-03-31  4:10                               ` David Ahern
@ 2015-03-31 15:06                               ` David Miller
  2015-03-31 18:16                                 ` Yinghai Lu
  1 sibling, 1 reply; 39+ messages in thread
From: David Miller @ 2015-03-31 15:06 UTC (permalink / raw)
  To: yinghai; +Cc: david.ahern, bhelgaas, linux-pci, sparclinux, linux-kernel

From: Yinghai Lu <yinghai@kernel.org>
Date: Mon, 30 Mar 2015 18:06:02 -0700

> ok, that is really non-pref mmio 64bit.
> We can workaround the problem by honoring firmware setting, according
> to https://www.pcisig.com/specifications/pciexpress/base2/PCIe_Base_r2.1_Errata_08Jun10.pdf
> page 13
> 
> Please check attached updated patches that should fix the regression
> and kill those "no compatible window" warnings.

Your patch only allows the condition behind resources that have 64-bits
of significance, but that is not what the document above says about
when this situation is allowed.

Please implement the check either exactly as stated in the errata
document, or more loosely if that is not possible, rather than more
strictly than allowed.

Your overly strict and restrictive checks are what got us into this
predicament in the first place. :-(

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-31  4:10                               ` David Ahern
@ 2015-03-31 16:53                                 ` Yinghai Lu
  2015-03-31 17:04                                   ` David Ahern
  0 siblings, 1 reply; 39+ messages in thread
From: Yinghai Lu @ 2015-03-31 16:53 UTC (permalink / raw)
  To: David Ahern; +Cc: David Miller, Bjorn Helgaas, linux-pci, sparclinux, LKML

On Mon, Mar 30, 2015 at 9:10 PM, David Ahern <david.ahern@oracle.com> wrote:
> On 3/30/15 7:06 PM, Yinghai Lu wrote:
> To make sure I am on the same page: these are a new round of patches? clear
> out the old, apply these?

Clear out the old and apply these new ones.

Thanks

Yinghai

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-31 16:53                                 ` Yinghai Lu
@ 2015-03-31 17:04                                   ` David Ahern
  2015-03-31 20:28                                     ` Yinghai Lu
  0 siblings, 1 reply; 39+ messages in thread
From: David Ahern @ 2015-03-31 17:04 UTC (permalink / raw)
  To: Yinghai Lu; +Cc: David Miller, Bjorn Helgaas, linux-pci, sparclinux, LKML

On 3/31/15 10:53 AM, Yinghai Lu wrote:
> On Mon, Mar 30, 2015 at 9:10 PM, David Ahern <david.ahern@oracle.com> wrote:
>> On 3/30/15 7:06 PM, Yinghai Lu wrote:
>> To make sure I am on the same page: these are a new round of patches? clear
>> out the old, apply these?
>
> Clear out the old and apply these new ones.

I take DaveM's response to mean the patches (3rd one?) needs another 
version.

I will be on PTO Wed-Fri with limited access through Sunday. If you have 
something to try out later today I can do that; else it needs to wait 
until next week. Given the likelihood that Linus will release 4.0 this 
weekend that means both 3.19 and 4.0 will be broken for these systems.

David


^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-31 15:06                               ` David Miller
@ 2015-03-31 18:16                                 ` Yinghai Lu
  2015-03-31 18:19                                   ` David Miller
  0 siblings, 1 reply; 39+ messages in thread
From: Yinghai Lu @ 2015-03-31 18:16 UTC (permalink / raw)
  To: David Miller
  Cc: David Ahern, Bjorn Helgaas, linux-pci, sparclinux,
	Linux Kernel Mailing List

On Tue, Mar 31, 2015 at 8:06 AM, David Miller <davem@davemloft.net> wrote:
> Your patch only allows the condition behind resources that have 64-bits
> of significance, but that is not what the document above says about
> when this situation is allowed.
>
> Please implement the check either exactly as stated in the errata
> document, or more loosely if that is not possible, rather than more
> strictly than allowed.
>
> Your overly strict and restrictive checks are what got us into this
> predicament in the first place. :-(

>From that errata:
---
Here are criteria that are sufficient to guarantee correctness for a
given candidate BAR:
‰
The entire path from the host to the adapter is over PCI Express.
‰
No conventional PCI or PCI-X devices do peer-t o-peer reads to the
range mapped by the BAR.
‰
The PCI Express Host Bridge does no byte merging. (This is believed to
be true on most
platforms.)
‰
Any locations with read side-effects are never the target of Memory
Reads with the TH bit Set.
See Section 2.2.5
---

We can verify first one that we have all pcie device all the way to
the hostbridge.

But we can not verify or guarantee other three.

System should get better about the constraints with system design.
So if it would assign 64bit (and above 4G) mmio to those non-pref 64bit BAR,
that means it already make sure system design will follow those criteria.
and then we can safely set pref bit in resource flags.

Thanks

Yinghai

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-31 18:16                                 ` Yinghai Lu
@ 2015-03-31 18:19                                   ` David Miller
  2015-03-31 18:25                                     ` Yinghai Lu
  0 siblings, 1 reply; 39+ messages in thread
From: David Miller @ 2015-03-31 18:19 UTC (permalink / raw)
  To: yinghai; +Cc: david.ahern, bhelgaas, linux-pci, sparclinux, linux-kernel

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: Text/Plain; charset=utf-8, Size: 2129 bytes --]

From: Yinghai Lu <yinghai@kernel.org>
Date: Tue, 31 Mar 2015 11:16:11 -0700

> On Tue, Mar 31, 2015 at 8:06 AM, David Miller <davem@davemloft.net> wrote:
>> Your patch only allows the condition behind resources that have 64-bits
>> of significance, but that is not what the document above says about
>> when this situation is allowed.
>>
>> Please implement the check either exactly as stated in the errata
>> document, or more loosely if that is not possible, rather than more
>> strictly than allowed.
>>
>> Your overly strict and restrictive checks are what got us into this
>> predicament in the first place. :-(
> 
> From that errata:
> ---
> Here are criteria that are sufficient to guarantee correctness for a
> given candidate BAR:
> ‰
> The entire path from the host to the adapter is over PCI Express.
> ‰
> No conventional PCI or PCI-X devices do peer-t o-peer reads to the
> range mapped by the BAR.
> ‰
> The PCI Express Host Bridge does no byte merging. (This is believed to
> be true on most
> platforms.)
> ‰
> Any locations with read side-effects are never the target of Memory
> Reads with the TH bit Set.
> See Section 2.2.5
> ---
> 
> We can verify first one that we have all pcie device all the way to
> the hostbridge.
> 
> But we can not verify or guarantee other three.

Lack of peer-to-peer reads we can assume, the byte merging we can
add as a per-controller attribute in the future if it turns out there
are some that do and it matters (I doubt this will ever be necessary)
and the side-effect issue is outside the scope of the PCI layer.

> System should get better about the constraints with system design.
> So if it would assign 64bit (and above 4G) mmio to those non-pref 64bit BAR,
> that means it already make sure system design will follow those criteria.
> and then we can safely set pref bit in resource flags.

I totally disagree, I think your test is too stringent and should be
significantly relaxed if not removed entirely.
ÿôèº{.nÇ+‰·Ÿ®‰­†+%ŠËÿ±éݶ\x17¥Šwÿº{.nÇ+‰·¥Š{±þG«éÿŠ{ayº\x1dʇڙë,j\a­¢f£¢·hšïêÿ‘êçz_è®\x03(­éšŽŠÝ¢j"ú\x1a¶^[m§ÿÿ¾\a«þG«éÿ¢¸?™¨è­Ú&£ø§~á¶iO•æ¬z·švØ^\x14\x04\x1a¶^[m§ÿÿÃ\fÿ¶ìÿ¢¸?–I¥

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-31 18:19                                   ` David Miller
@ 2015-03-31 18:25                                     ` Yinghai Lu
  0 siblings, 0 replies; 39+ messages in thread
From: Yinghai Lu @ 2015-03-31 18:25 UTC (permalink / raw)
  To: David Miller
  Cc: David Ahern, Bjorn Helgaas, linux-pci, sparclinux,
	Linux Kernel Mailing List

On Tue, Mar 31, 2015 at 11:19 AM, David Miller <davem@davemloft.net> wrote:

> I totally disagree, I think your test is too stringent and should be
> significantly relaxed if not removed entirely.

ok, will produce one version that only verify first criteria.

Thanks

Yinghai

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-31 17:04                                   ` David Ahern
@ 2015-03-31 20:28                                     ` Yinghai Lu
  2015-03-31 22:29                                       ` David Ahern
  0 siblings, 1 reply; 39+ messages in thread
From: Yinghai Lu @ 2015-03-31 20:28 UTC (permalink / raw)
  To: David Ahern, David Miller; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

[-- Attachment #1: Type: text/plain, Size: 590 bytes --]

On Tue, Mar 31, 2015 at 10:04 AM, David Ahern <david.ahern@oracle.com> wrote:
>> Clear out the old and apply these new ones.
>
>
> I take DaveM's response to mean the patches (3rd one?) needs another
> version.
>
> I will be on PTO Wed-Fri with limited access through Sunday. If you have
> something to try out later today I can do that; else it needs to wait until
> next week. Given the likelihood that Linus will release 4.0 this weekend
> that means both 3.19 and 4.0 will be broken for these systems.

Please check attached three patches on top of current linus tree.

Thanks

Yinghai

[-- Attachment #2: pci_bus_addr_t_v2.patch --]
[-- Type: text/x-patch, Size: 5233 bytes --]

Subject: [RFC PATCH v2] PCI: Introduce pci_bus_addr_t

David Ahern found commit d63e2e1f3df9 ("sparc/PCI: Clip bridge windows
to fit in upstream windows") broke sparc/T5-8.

In the boot log, there is
  pci 0000:06:00.0: reg 0x184: can't handle BAR above 4GB (bus address
  0x110204000)
but that only could happen when dma_addr_t is 32-bit.

According to David Miller, all DMA occurs behind an IOMMU and these
IOMMUs only support 32-bit addressing, therefore dma_addr_t is
32-bit on sparc64.

Let's introduce pci_bus_addr_t instead of using dma_addr_t,
and pci_bus_addr_t will be 64-bit on 64-bit platform or X86 PAE kernel.

Fixes: commit d63e2e1f3df9 ("sparc/PCI: Clip bridge windows to fit in upstream windows")
Fixes: commit 23b13bc76f35 ("PCI: Fail safely if we can't handle BARs larger than 4GB")
Link: http://lkml.kernel.org/r/CAE9FiQU1gJY1LYrxs+ma5LCTEEe4xmtjRG0aXJ9K_Tsu+m9Wuw@mail.gmail.com
Reported-by: David Ahern <david.ahern@oracle.com>
Signed-off-by: Yinghai Lu <yinghai@kernel.org>

---
-v2: use PCI_BUS_ADDR in drivers/pci/bus.c
     put config option in pci/Kconfig: as David Miller said:
       PCI addresses being 64-bit or not is an attribute of the PCI
       controller and the geography of the bridges behind it, not the
       cpu architecture.
---
 drivers/pci/Kconfig |    4 ++++
 drivers/pci/bus.c   |   10 +++++-----
 drivers/pci/probe.c |   12 ++++++------
 include/linux/pci.h |   12 +++++++++---
 4 files changed, 24 insertions(+), 14 deletions(-)

Index: linux-2.6/drivers/pci/bus.c
===================================================================
--- linux-2.6.orig/drivers/pci/bus.c
+++ linux-2.6/drivers/pci/bus.c
@@ -92,11 +92,11 @@ void pci_bus_remove_resources(struct pci
 }
 
 static struct pci_bus_region pci_32_bit = {0, 0xffffffffULL};
-#ifdef CONFIG_ARCH_DMA_ADDR_T_64BIT
+#ifdef CONFIG_PCI_BUS_ADDR_T_64BIT
 static struct pci_bus_region pci_64_bit = {0,
-				(dma_addr_t) 0xffffffffffffffffULL};
-static struct pci_bus_region pci_high = {(dma_addr_t) 0x100000000ULL,
-				(dma_addr_t) 0xffffffffffffffffULL};
+				(pci_bus_addr_t) 0xffffffffffffffffULL};
+static struct pci_bus_region pci_high = {(pci_bus_addr_t) 0x100000000ULL,
+				(pci_bus_addr_t) 0xffffffffffffffffULL};
 #endif
 
 /*
@@ -200,7 +200,7 @@ int pci_bus_alloc_resource(struct pci_bu
 					  resource_size_t),
 		void *alignf_data)
 {
-#ifdef CONFIG_ARCH_DMA_ADDR_T_64BIT
+#ifdef CONFIG_PCI_BUS_ADDR_T_64BIT
 	int rc;
 
 	if (res->flags & IORESOURCE_MEM_64) {
Index: linux-2.6/drivers/pci/probe.c
===================================================================
--- linux-2.6.orig/drivers/pci/probe.c
+++ linux-2.6/drivers/pci/probe.c
@@ -254,8 +254,8 @@ int __pci_read_base(struct pci_dev *dev,
 	}
 
 	if (res->flags & IORESOURCE_MEM_64) {
-		if ((sizeof(dma_addr_t) < 8 || sizeof(resource_size_t) < 8) &&
-		    sz64 > 0x100000000ULL) {
+		if ((sizeof(pci_bus_addr_t) < 8 || sizeof(resource_size_t) < 8)
+		    && sz64 > 0x100000000ULL) {
 			res->flags |= IORESOURCE_UNSET | IORESOURCE_DISABLED;
 			res->start = 0;
 			res->end = 0;
@@ -264,7 +264,7 @@ int __pci_read_base(struct pci_dev *dev,
 			goto out;
 		}
 
-		if ((sizeof(dma_addr_t) < 8) && l) {
+		if ((sizeof(pci_bus_addr_t) < 8) && l) {
 			/* Above 32-bit boundary; try to reallocate */
 			res->flags |= IORESOURCE_UNSET;
 			res->start = 0;
@@ -399,7 +399,7 @@ static void pci_read_bridge_mmio_pref(st
 	struct pci_dev *dev = child->self;
 	u16 mem_base_lo, mem_limit_lo;
 	u64 base64, limit64;
-	dma_addr_t base, limit;
+	pci_bus_addr_t base, limit;
 	struct pci_bus_region region;
 	struct resource *res;
 
@@ -426,8 +426,8 @@ static void pci_read_bridge_mmio_pref(st
 		}
 	}
 
-	base = (dma_addr_t) base64;
-	limit = (dma_addr_t) limit64;
+	base = (pci_bus_addr_t) base64;
+	limit = (pci_bus_addr_t) limit64;
 
 	if (base != base64) {
 		dev_err(&dev->dev, "can't handle bridge window above 4GB (bus address %#010llx)\n",
Index: linux-2.6/include/linux/pci.h
===================================================================
--- linux-2.6.orig/include/linux/pci.h
+++ linux-2.6/include/linux/pci.h
@@ -576,9 +576,15 @@ int raw_pci_read(unsigned int domain, un
 int raw_pci_write(unsigned int domain, unsigned int bus, unsigned int devfn,
 		  int reg, int len, u32 val);
 
+#ifdef CONFIG_PCI_BUS_ADDR_T_64BIT
+typedef u64 pci_bus_addr_t;
+#else
+typedef u32 pci_bus_addr_t;
+#endif
+
 struct pci_bus_region {
-	dma_addr_t start;
-	dma_addr_t end;
+	pci_bus_addr_t start;
+	pci_bus_addr_t end;
 };
 
 struct pci_dynids {
@@ -1127,7 +1133,7 @@ int __must_check pci_bus_alloc_resource(
 
 int pci_remap_iospace(const struct resource *res, phys_addr_t phys_addr);
 
-static inline dma_addr_t pci_bus_address(struct pci_dev *pdev, int bar)
+static inline pci_bus_addr_t pci_bus_address(struct pci_dev *pdev, int bar)
 {
 	struct pci_bus_region region;
 
Index: linux-2.6/drivers/pci/Kconfig
===================================================================
--- linux-2.6.orig/drivers/pci/Kconfig
+++ linux-2.6/drivers/pci/Kconfig
@@ -1,6 +1,10 @@
 #
 # PCI configuration
 #
+config PCI_BUS_ADDR_T_64BIT
+	def_bool y if (64BIT || X86_PAE)
+	depends on PCI
+
 config PCI_MSI
 	bool "Message Signaled Interrupts (MSI and MSI-X)"
 	depends on PCI

[-- Attachment #3: sparc_sun4v_mem64_v3.patch --]
[-- Type: text/x-patch, Size: 4046 bytes --]

Subject: [RFC PATCH v3] sparc/PCI: Add mem64 resource parsing for root bus

Found no compatible bridge window warning in boot log from T5-8.

pci 0000:00:01.0: can't claim BAR 15 [mem 0x100000000-0x4afffffff pref]: no compatible bridge window

and root bus only report io and mem32.

pci_sun4v f02dbcfc: PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x804000000000-0x80400fffffff] (bus address [0x0000-0xfffffff])
pci_bus 0000:00: root bus resource [mem 0x800000000000-0x80007effffff] (bus address [0x00000000-0x7effffff])
pci_bus 0000:00: root bus resource [bus 00-77]

Add mem64 handling in pci_common for sparc, so we can have 64bit resource
registered for root bus at first.

Signed-off-by: Yinghai Lu <yinghai@kernel.org>

---
-v2: mem64_space should use mem_space.start as offset.
-v3: add IORESOURCE_MEM_64 flag
---
 arch/sparc/kernel/pci.c        |    7 ++++++-
 arch/sparc/kernel/pci_common.c |   15 +++++++++++++--
 arch/sparc/kernel/pci_impl.h   |    1 +
 3 files changed, 20 insertions(+), 3 deletions(-)

Index: linux-2.6/arch/sparc/kernel/pci.c
===================================================================
--- linux-2.6.orig/arch/sparc/kernel/pci.c
+++ linux-2.6/arch/sparc/kernel/pci.c
@@ -185,8 +185,10 @@ static unsigned long pci_parse_of_flags(
 
 	if (addr0 & 0x02000000) {
 		flags = IORESOURCE_MEM | PCI_BASE_ADDRESS_SPACE_MEMORY;
-		flags |= (addr0 >> 22) & PCI_BASE_ADDRESS_MEM_TYPE_64;
 		flags |= (addr0 >> 28) & PCI_BASE_ADDRESS_MEM_TYPE_1M;
+		if (addr0 & 0x01000000)
+			flags |= IORESOURCE_MEM_64
+				 | PCI_BASE_ADDRESS_MEM_TYPE_64;
 		if (addr0 & 0x40000000)
 			flags |= IORESOURCE_PREFETCH
 				 | PCI_BASE_ADDRESS_MEM_PREFETCH;
@@ -663,6 +665,9 @@ struct pci_bus *pci_scan_one_pbm(struct
 				pbm->io_space.start);
 	pci_add_resource_offset(&resources, &pbm->mem_space,
 				pbm->mem_space.start);
+	if (pbm->mem64_space.flags)
+		pci_add_resource_offset(&resources, &pbm->mem64_space,
+					pbm->mem_space.start);
 	pbm->busn.start = pbm->pci_first_busno;
 	pbm->busn.end	= pbm->pci_last_busno;
 	pbm->busn.flags	= IORESOURCE_BUS;
Index: linux-2.6/arch/sparc/kernel/pci_common.c
===================================================================
--- linux-2.6.orig/arch/sparc/kernel/pci_common.c
+++ linux-2.6/arch/sparc/kernel/pci_common.c
@@ -406,6 +406,7 @@ void pci_determine_mem_io_space(struct p
 	}
 
 	num_pbm_ranges = i / sizeof(*pbm_ranges);
+	memset(&pbm->mem64_space, 0, sizeof(struct resource));
 
 	for (i = 0; i < num_pbm_ranges; i++) {
 		const struct linux_prom_pci_ranges *pr = &pbm_ranges[i];
@@ -451,7 +452,11 @@ void pci_determine_mem_io_space(struct p
 			break;
 
 		case 3:
-			/* XXX 64-bit MEM handling XXX */
+			/* 64-bit MEM handling */
+			pbm->mem64_space.start = a;
+			pbm->mem64_space.end = a + size - 1UL;
+			pbm->mem64_space.flags = IORESOURCE_MEM;
+			break;
 
 		default:
 			break;
@@ -465,15 +470,21 @@ void pci_determine_mem_io_space(struct p
 		prom_halt();
 	}
 
-	printk("%s: PCI IO[%llx] MEM[%llx]\n",
+	printk("%s: PCI IO[%llx] MEM[%llx]",
 	       pbm->name,
 	       pbm->io_space.start,
 	       pbm->mem_space.start);
+	if (pbm->mem64_space.flags)
+		printk(" MEM64[%llx]",
+		       pbm->mem64_space.start);
+	printk("\n");
 
 	pbm->io_space.name = pbm->mem_space.name = pbm->name;
 
 	request_resource(&ioport_resource, &pbm->io_space);
 	request_resource(&iomem_resource, &pbm->mem_space);
+	if (pbm->mem64_space.flags)
+		request_resource(&iomem_resource, &pbm->mem64_space);
 
 	pci_register_legacy_regions(&pbm->io_space,
 				    &pbm->mem_space);
Index: linux-2.6/arch/sparc/kernel/pci_impl.h
===================================================================
--- linux-2.6.orig/arch/sparc/kernel/pci_impl.h
+++ linux-2.6/arch/sparc/kernel/pci_impl.h
@@ -97,6 +97,7 @@ struct pci_pbm_info {
 	/* PBM I/O and Memory space resources. */
 	struct resource			io_space;
 	struct resource			mem_space;
+	struct resource			mem64_space;
 	struct resource			busn;
 
 	/* Base of PCI Config space, can be per-PBM or shared. */

[-- Attachment #4: pcie_pref_64bit_mem_v2.patch --]
[-- Type: text/x-patch, Size: 3440 bytes --]

Subject: [RFC PATCH v2] PCI: Set pref for mem64 resource of pcie device

We still get "no compatible bridge window" warning on sparc T5-8
after we add support for 64bit resource for root bus.

[  286.647560] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@6] bus no 8
[  286.921232] PCI: Claiming 0000:00:01.0: Resource 15: 0000800100000000..00008004afffffff [220c]
[  287.229190] PCI: Claiming 0000:01:00.0: Resource 15: 0000800100000000..00008004afffffff [220c]
[  287.533428] PCI: Claiming 0000:02:04.0: Resource 15: 0000800100000000..000080012fffffff [220c]
[  288.149831] PCI: Claiming 0000:03:00.0: Resource 15: 0000800100000000..000080012fffffff [220c]
[  288.252466] PCI: Claiming 0000:04:06.0: Resource 14: 0000800100000000..000080010fffffff [220c]
[  288.867196] PCI: Claiming 0000:05:00.0: Resource 0: 0000800100000000..0000800100001fff [204]
[  288.968221] pci 0000:05:00.0: can't claim BAR 0 [mem 0x800100000000-0x800100001fff]: no compatible bridge window

All the bridges have pref mem 64-bit resource, but the device resource does not
have pref set, then we can not find parent for the device resource,
as we can not put non-pref mem under pref mem.

According to pcie spec errta
https://www.pcisig.com/specifications/pciexpress/base2/PCIe_Base_r2.1_Errata_08Jun10.pdf
page 13, in some case it is ok to mark some as pref.

only set pref for 64bit mmio when the entire path from the host to the adapter is
over PCI Express.

Signed-off-by: Yinghai Lu <yinghai@kernel.org>

---
-v2: set pref for mmio 64 when whole path is PCI Express.
---

 drivers/pci/probe.c |   50 ++++++++++++++++++++++++++++++++++++++++++++++++++
 1 file changed, 50 insertions(+)

Index: linux-2.6/drivers/pci/probe.c
===================================================================
--- linux-2.6.orig/drivers/pci/probe.c
+++ linux-2.6/drivers/pci/probe.c
@@ -1508,6 +1508,53 @@ static void pci_init_capabilities(struct
 	pci_enable_acs(dev);
 }
 
+static bool pci_up_path_over_pcie(struct pci_bus *bus)
+{
+	if (!bus)
+		return true;
+
+	if (bus->self && !pci_is_pcie(bus->self))
+		return false;
+
+	return pci_up_path_over_pcie(bus->parent);
+}
+
+/*
+ * According to
+ * https://www.pcisig.com/specifications/pciexpress/base2/PCIe_Base_r2.1_Errata_08Jun10.pdf
+ * page 13, system firmware could put some 64bit non-pref under 64bit pref,
+ * on some cases.
+ * Let's set pref bit for 64bit mmio when entire path from the host to
+ * the adapter is over PCI Express.
+ */
+static void set_pcie_64bit_pref(struct pci_dev *dev)
+{
+	int i;
+
+	if (!pci_is_pcie(dev))
+		return;
+
+	if (!pci_up_path_over_pcie(dev->bus))
+		return;
+
+	for (i = 0; i < PCI_BRIDGE_RESOURCES; i++) {
+		struct resource *res = &dev->resource[i];
+		enum pci_bar_type type;
+		int reg;
+
+		if (!(res->flags & IORESOURCE_MEM_64))
+			continue;
+
+		if (res->flags & IORESOURCE_PREFETCH)
+			continue;
+
+		reg = pci_resource_bar(dev, i, &type);
+		dev_printk(KERN_DEBUG, &dev->dev, "reg 0x%x %pR + pref\n",
+			   reg, res);
+		res->flags |= IORESOURCE_PREFETCH;
+	}
+}
+
 void pci_device_add(struct pci_dev *dev, struct pci_bus *bus)
 {
 	int ret;
@@ -1538,6 +1585,9 @@ void pci_device_add(struct pci_dev *dev,
 	/* Initialize various capabilities */
 	pci_init_capabilities(dev);
 
+	/* After pcie_cap is assigned and sriov bar is probed */
+	set_pcie_64bit_pref(dev);
+
 	/*
 	 * Add the device to our list of discovered devices
 	 * and the bus list for fixup functions, etc.

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-31 20:28                                     ` Yinghai Lu
@ 2015-03-31 22:29                                       ` David Ahern
  2015-03-31 22:38                                         ` Yinghai Lu
  0 siblings, 1 reply; 39+ messages in thread
From: David Ahern @ 2015-03-31 22:29 UTC (permalink / raw)
  To: Yinghai Lu, David Miller; +Cc: Bjorn Helgaas, linux-pci, sparclinux, LKML

[-- Attachment #1: Type: text/plain, Size: 698 bytes --]

On 3/31/15 2:28 PM, Yinghai Lu wrote:
> On Tue, Mar 31, 2015 at 10:04 AM, David Ahern <david.ahern@oracle.com> wrote:
>>> Clear out the old and apply these new ones.
>>
>>
>> I take DaveM's response to mean the patches (3rd one?) needs another
>> version.
>>
>> I will be on PTO Wed-Fri with limited access through Sunday. If you have
>> something to try out later today I can do that; else it needs to wait until
>> next week. Given the likelihood that Linus will release 4.0 this weekend
>> that means both 3.19 and 4.0 will be broken for these systems.
>
> Please check attached three patches on top of current linus tree.
>

new log. Same as before -- PCI_DEBUG, ignore_loglevel ofpci_debug=1


[-- Attachment #2: screenlog.0 --]
[-- Type: text/plain, Size: 320981 bytes --]

[    0.000000] PROMLIB: Sun IEEE Boot Prom 'OBP 4.36.2 2014/10/24 08:15'
[    0.000000] PROMLIB: Root node compatible: sun4v
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 4.0.0-rc6+ (root@ca-qasparc24) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-4.0.9) (GCC) ) #1 SMP Tue Mar 31 17:08:36 EDT 2015
[    0.000000] debug: skip boot console de-registration.
[    0.000000] debug: ignoring loglevel setting.
[    0.000000] debug: ignoring loglevel setting.
[    0.000000] bootconsole [earlyprom0] enabled
[    0.000000] ARCH: SUN4V
[    0.000000] Ethernet address: 00:10:e0:35:15:f6
[    0.000000] MM: PAGE_OFFSET is 0xfff8000000000000 (max_phys_bits == 47)
[    0.000000] MM: VMALLOC [0x0000000100000000 --> 0x0006000000000000]
[    0.000000] MM: VMEMMAP [0x0006000000000000 --> 0x000c000000000000]
[    0.000000] Kernel: Using 3 locked TLB entries for main kernel image.
[    0.000000] Remapping the kernel... done.
[    0.000000] OF stdout device is: /virtual-devices@100/console@1
[    0.000000] PROM: Built device tree with 1478535 bytes of memory.
[    0.000000] MDESC: Size is 774368 bytes.
[    0.000000] PLATFORM: banner-name [SPARC T5-8]
[    0.000000] PLATFORM: name [ORCL,SPARC-T5-8]
[    0.000000] PLATFORM: hostid [863515f6]
[    0.000000] PLATFORM: serial# [003515f6]
[    0.000000] PLATFORM: stick-frequency [3b9aca00]
[    0.000000] PLATFORM: mac-address [10e03515f6]
[    0.000000] PLATFORM: watchdog-resolution [1000 ms]
[    0.000000] PLATFORM: watchdog-max-timeout [31536000000 ms]
[    0.000000] PLATFORM: max-cpus [1024]
[    0.000000] Allocated 81920 bytes for kernel page tables.
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000030400000-0xffffffffffffffff]
[    0.000000]   Normal   [mem 0x0000000000000000-0x0000383fffd11fff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000030400000-0x0000003fddeeffff]
[    0.000000]   node   0: [mem 0x0000003fddef6000-0x0000003fddef7fff]
[    0.000000]   node   1: [mem 0x0000080000000000-0x0000083fffffffff]
[    0.000000]   node   2: [mem 0x0000100000000000-0x0000103fffffffff]
[    0.000000]   node   3: [mem 0x0000180000000000-0x0000183fffffffff]
[    0.000000]   node   4: [mem 0x0000200000000000-0x0000203fffffffff]
[    0.000000]   node   5: [mem 0x0000280000000000-0x0000283fffffffff]
[    0.000000]   node   6: [mem 0x0000300000000000-0x0000303fffffffff]
[    0.000000]   node   7: [mem 0x0000380000000000-0x0000383fffcddfff]
[    0.000000]   node   7: [mem 0x0000383fffcee000-0x0000383fffd11fff]
[    0.000000] Initmem setup node 0 [mem 0x0000000030400000-0x0000003fddef7fff]
[    0.000000] On node 0 totalpages: 33385849
[    0.000000]   Normal zone: 293431 pages used for memmap
[    0.000000]   Normal zone: 33385849 pages, LIFO batch:15
[    0.000000] Initmem setup node 1 [mem 0x0000080000000000-0x0000083fffffffff]
[    0.000000] On node 1 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 2 [mem 0x0000100000000000-0x0000103fffffffff]
[    0.000000] On node 2 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 3 [mem 0x0000180000000000-0x0000183fffffffff]
[    0.000000] On node 3 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 4 [mem 0x0000200000000000-0x0000203fffffffff]
[    0.000000] On node 4 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 5 [mem 0x0000280000000000-0x0000283fffffffff]
[    0.000000] On node 5 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 6 [mem 0x0000300000000000-0x0000303fffffffff]
[    0.000000] On node 6 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 7 [mem 0x0000380000000000-0x0000383fffd11fff]
[    0.000000] On node 7 totalpages: 33554049
[    0.000000]   Normal zone: 294909 pages used for memmap
[    0.000000]   Normal zone: 33554049 pages, LIFO batch:15
[    0.000000] Booting Linux...
[    0.000000] CPU CAPS: [flush,stbar,swap,muldiv,v9,blkinit,n2,mul32]
[    0.000000] CPU CAPS: [div32,v8plus,popc,vis,vis2,ASIBlkInit,fmaf,vis3]
[    0.000000] CPU CAPS: [hpc,ima,pause,cbcond,aes,des,kasumi,camellia]
[    0.000000] CPU CAPS: [md5,sha1,sha256,sha512,mpmul,montmul,montsqr,crc32c]
[    0.000000] PERCPU: Embedded 8 pages/cpu @fff8003f4d000000 s27776 r8192 d29568 u65536
[    0.000000] pcpu-alloc: s27776 r8192 d29568 u65536 alloc=1*4194304
[    0.000000] pcpu-alloc: [0] 0000 0001 0002 0003 0004 0005 0006 0007 0008 0009 0010 0011 0012 0013 0014 0015 0016 0017 0018 0019 0020 0021 0022 0023 0024 0025 0026 0027 0028 0029 0030 0031 0032 0033 0034 0035 0036 0037 0038 0039 0040 0041 0042 0043 0044 0045 0046 0047 0048 0049 0050 0051 0052 0053 0054 0055 0056 0057 0058 0059 0060 0061 0062 0063 
[    0.000000] pcpu-alloc: [0] 0064 0065 0066 0067 0068 0069 0070 0071 0072 0073 0074 0075 0076 0077 0078 0079 0080 0081 0082 0083 0084 0085 0086 0087 0088 0089 0090 0091 0092 0093 0094 0095 0096 0097 0098 0099 0100 0101 0102 0103 0104 0105 0106 0107 0108 0109 0110 0111 0112 0113 0114 0115 0116 0117 0118 0119 0120 0121 0122 0123 0124 0125 0126 0127 
[    0.000000] pcpu-alloc: [1] 0128 0129 0130 0131 0132 0133 0134 0135 0136 0137 0138 0139 0140 0141 0142 0143 0144 0145 0146 0147 0148 0149 0150 0151 0152 0153 0154 0155 0156 0157 0158 0159 0160 0161 0162 0163 0164 0165 0166 0167 0168 0169 0170 0171 0172 0173 0174 0175 0176 0177 0178 0179 0180 0181 0182 0183 0184 0185 0186 0187 0188 0189 0190 0191 
[    0.000000] pcpu-alloc: [1] 0192 0193 0194 0195 0196 0197 0198 0199 0200 0201 0202 0203 0204 0205 0206 0207 0208 0209 0210 0211 0212 0213 0214 0215 0216 0217 0218 0219 0220 0221 0222 0223 0224 0225 0226 0227 0228 0229 0230 0231 0232 0233 0234 0235 0236 0237 0238 0239 0240 0241 0242 0243 0244 0245 0246 0247 0248 0249 0250 0251 0252 0253 0254 0255 
[    0.000000] pcpu-alloc: [2] 0256 0257 0258 0259 0260 0261 0262 0263 0264 0265 0266 0267 0268 0269 0270 0271 0272 0273 0274 0275 0276 0277 0278 0279 0280 0281 0282 0283 0284 0285 0286 0287 0288 0289 0290 0291 0292 0293 0294 0295 0296 0297 0298 0299 0300 0301 0302 0303 0304 0305 0306 0307 0308 0309 0310 0311 0312 0313 0314 0315 0316 0317 0318 0319 
[    0.000000] pcpu-alloc: [2] 0320 0321 0322 0323 0324 0325 0326 0327 0328 0329 0330 0331 0332 0333 0334 0335 0336 0337 0338 0339 0340 0341 0342 0343 0344 0345 0346 0347 0348 0349 0350 0351 0352 0353 0354 0355 0356 0357 0358 0359 0360 0361 0362 0363 0364 0365 0366 0367 0368 0369 0370 0371 0372 0373 0374 0375 0376 0377 0378 0379 0380 0381 0382 0383 
[    0.000000] pcpu-alloc: [3] 0384 0385 0386 0387 0388 0389 0390 0391 0392 0393 0394 0395 0396 0397 0398 0399 0400 0401 0402 0403 0404 0405 0406 0407 0408 0409 0410 0411 0412 0413 0414 0415 0416 0417 0418 0419 0420 0421 0422 0423 0424 0425 0426 0427 0428 0429 0430 0431 0432 0433 0434 0435 0436 0437 0438 0439 0440 0441 0442 0443 0444 0445 0446 0447 
[    0.000000] pcpu-alloc: [3] 0448 0449 0450 0451 0452 0453 0454 0455 0456 0457 0458 0459 0460 0461 0462 0463 0464 0465 0466 0467 0468 0469 0470 0471 0472 0473 0474 0475 0476 0477 0478 0479 0480 0481 0482 0483 0484 0485 0486 0487 0488 0489 0490 0491 0492 0493 0494 0495 0496 0497 0498 0499 0500 0501 0502 0503 0504 0505 0506 0507 0508 0509 0510 0511 
[    0.000000] pcpu-alloc: [4] 0512 0513 0514 0515 0516 0517 0518 0519 0520 0521 0522 0523 0524 0525 0526 0527 0528 0529 0530 0531 0532 0533 0534 0535 0536 0537 0538 0539 0540 0541 0542 0543 0544 0545 0546 0547 0548 0549 0550 0551 0552 0553 0554 0555 0556 0557 0558 0559 0560 0561 0562 0563 0564 0565 0566 0567 0568 0569 0570 0571 0572 0573 0574 0575 
[    0.000000] pcpu-alloc: [4] 0576 0577 0578 0579 0580 0581 0582 0583 0584 0585 0586 0587 0588 0589 0590 0591 0592 0593 0594 0595 0596 0597 0598 0599 0600 0601 0602 0603 0604 0605 0606 0607 0608 0609 0610 0611 0612 0613 0614 0615 0616 0617 0618 0619 0620 0621 0622 0623 0624 0625 0626 0627 0628 0629 0630 0631 0632 0633 0634 0635 0636 0637 0638 0639 
[    0.000000] pcpu-alloc: [5] 0640 0641 0642 0643 0644 0645 0646 0647 0648 0649 0650 0651 0652 0653 0654 0655 0656 0657 0658 0659 0660 0661 0662 0663 0664 0665 0666 0667 0668 0669 0670 0671 0672 0673 0674 0675 0676 0677 0678 0679 0680 0681 0682 0683 0684 0685 0686 0687 0688 0689 0690 0691 0692 0693 0694 0695 0696 0697 0698 0699 0700 0701 0702 0703 
[    0.000000] pcpu-alloc: [5] 0704 0705 0706 0707 0708 0709 0710 0711 0712 0713 0714 0715 0716 0717 0718 0719 0720 0721 0722 0723 0724 0725 0726 0727 0728 0729 0730 0731 0732 0733 0734 0735 0736 0737 0738 0739 0740 0741 0742 0743 0744 0745 0746 0747 0748 0749 0750 0751 0752 0753 0754 0755 0756 0757 0758 0759 0760 0761 0762 0763 0764 0765 0766 0767 
[    0.000000] pcpu-alloc: [6] 0768 0769 0770 0771 0772 0773 0774 0775 0776 0777 0778 0779 0780 0781 0782 0783 0784 0785 0786 0787 0788 0789 0790 0791 0792 0793 0794 0795 0796 0797 0798 0799 0800 0801 0802 0803 0804 0805 0806 0807 0808 0809 0810 0811 0812 0813 0814 0815 0816 0817 0818 0819 0820 0821 0822 0823 0824 0825 0826 0827 0828 0829 0830 0831 
[    0.000000] pcpu-alloc: [6] 0832 0833 0834 0835 0836 0837 0838 0839 0840 0841 0842 0843 0844 0845 0846 0847 0848 0849 0850 0851 0852 0853 0854 0855 0856 0857 0858 0859 0860 0861 0862 0863 0864 0865 0866 0867 0868 0869 0870 0871 0872 0873 0874 0875 0876 0877 0878 0879 0880 0881 0882 0883 0884 0885 0886 0887 0888 0889 0890 0891 0892 0893 0894 0895 
[    0.000000] pcpu-alloc: [7] 0896 0897 0898 0899 0900 0901 0902 0903 0904 0905 0906 0907 0908 0909 0910 0911 0912 0913 0914 0915 0916 0917 0918 0919 0920 0921 0922 0923 0924 0925 0926 0927 0928 0929 0930 0931 0932 0933 0934 0935 0936 0937 0938 0939 0940 0941 0942 0943 0944 0945 0946 0947 0948 0949 0950 0951 0952 0953 0954 0955 0956 0957 0958 0959 
[    0.000000] pcpu-alloc: [7] 0960 0961 0962 0963 0964 0965 0966 0967 0968 0969 0970 0971 0972 0973 0974 0975 0976 0977 0978 0979 0980 0981 0982 0983 0984 0985 0986 0987 0988 0989 0990 0991 0992 0993 0994 0995 0996 0997 0998 0999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 
[    0.000000] SUN4V: Mondo queue sizes [cpu(131072) dev(16384) r(8192) nr(256)]
[    0.000000] Built 8 zonelists in Node order, mobility grouping on.  Total pages: 265908678
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: root=/dev/mapper/VolGroup-lv_root ro rd_NO_LUKS LANG=en_US.UTF-8 rd_NO_MD rd_LVM_LV=VolGroup/lv_swap SYSFONT=latarcyrheb-sun16 rd_LVM_LV=VolGroup/lv_root KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM keep_bootcon debug ignore_loglevel ofpci_debug=1 debug ignore_loglevel ofpci_debug=1
[    0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[    0.000000] log_buf_len total cpu_extra contributions: 4190208 bytes
[    0.000000] log_buf_len min size: 1048576 bytes
[    0.000000] log_buf_len: 8388608 bytes
[    0.000000] early log buf free: 1036816(98%)
[    0.000000] PID hash table entries: 4096 (order: 2, 32768 bytes)
[    0.000000] Sorting __ex_table...
[    0.000000] Memory: 2127126632K/2146131920K available (5648K kernel code, 766K rwdata, 2376K rodata, 536K init, 2002K bss, 19005288K reserved, 0K cma-reserved)
[    0.000000] Hierarchical RCU implementation.
[    0.000000] NR_IRQS:2048 nr_irqs:2048 1
[    0.000000] SUN4V: Using IRQ API major 3, cookie only virqs enabled
[200395.122618] clocksource: mult[800000] shift[23]
[200395.177376] clockevent: mult[80000000] shift[31]
[200395.245006] Console: colour dummy device 80x25
[200395.298706] console [tty0] enabled
[200395.421695] Calibrating delay using timer specific routine.. 2001.26 BogoMIPS (lpj=4002520)
[200395.521712] pid_max: default: 1048576 minimum: 8192
[200395.583482] Security Framework initialized
[200395.632976] SELinux:  Initializing.
[200395.675459] SELinux:  Starting in permissive mode
[200395.886802] Dentry cache hash table entries: 268435456 (order: 18, 2147483648 bytes)
[200397.637065] Inode-cache hash table entries: 134217728 (order: 17, 1073741824 bytes)
[200398.527080] Mount-cache hash table entries: 4194304 (order: 12, 33554432 bytes)
[200398.617835] Mountpoint-cache hash table entries: 4194304 (order: 12, 33554432 bytes)
[200398.766772] Initializing cgroup subsys blkio
[200398.818399] Initializing cgroup subsys memory
[200398.872064] Initializing cgroup subsys devices
[200398.925757] Initializing cgroup subsys freezer
[200398.979708] Initializing cgroup subsys net_cls
[200399.033398] Initializing cgroup subsys perf_event
[200399.089644] Initializing cgroup subsys hugetlb
[200399.144686] ftrace: allocating 20491 entries in 41 pages
[200400.649786] Brought up 1024 CPUs
[200400.755973] devtmpfs: initialized
[200400.796357] Performance events: 
[200400.834428] Testing NMI watchdog ... OK.
[200400.963421] Supported PMU type is 'niagara5'
[200401.075787] ldc.c:v1.1 (July 22, 2008)
[200401.171475] NET: Registered protocol family 16
[200401.306241] VIO: Adding device channel-devices
[200401.362388] VIO: Adding device vldc-port-0-0
[200401.416269] VIO: Adding device vldc-port-0-1
[200401.470141] VIO: Adding device vldc-port-0-2
[200401.524949] VIO: Adding device vldc-port-1-0
[200401.579506] VIO: Adding device vldc-port-2-0
[200401.633488] VIO: Adding device vldc-port-3-0
[200401.687360] VIO: Adding device vldc-port-3-1
[200401.743395] VIO: Adding device vldc-port-3-4
[200401.797264] VIO: Adding device vldc-port-3-3
[200401.851135] VIO: Adding device vlds-port-0-0
[200401.905049] VIO: Adding device ds-0
[200401.949454] VIO: Adding device ds-1
[200402.217296] pci_sun4v: Registered hvapi major[1] minor[0]
[200402.284815] /pci@300: SUN4V PCI Bus Module
[200402.334344] /pci@300: On NUMA node -1
[200402.378730] /pci@300: PCI IO[804000000000] MEM[800000000000] MEM64[800100000000]
[200402.467087] /pci@300: Unable to request IOMMU resource.
[200402.548127] /pci@300: Imported 26 TSB entries from OBP
[200402.674469] /pci@300: MSI Queue first[0] num[56] count[512] devino[0x6]
[200402.754475] /pci@300: MSI first[0] num[512] mask[0x3ff] width[32]
[200402.828741] /pci@300: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200402.927672] /pci@300: MSI queues at RA [0000083f52c00000]
[200402.993412] PCI: Scanning PBM /pci@300
[200403.038800] pci_sun4v f02dbcfc: PCI host bridge to bus 0000:00
[200403.109334] pci_bus 0000:00: root bus resource [io  0x804000000000-0x80400fffffff] (bus address [0x0000-0xfffffff])
[200403.235498] pci_bus 0000:00: root bus resource [mem 0x800000000000-0x80007effffff] (bus address [0x00000000-0x7effffff])
[200403.367043] pci_bus 0000:00: root bus resource [mem 0x800100000000-0x8007ffffffff] (bus address [0x100000000-0x7ffffffff])
[200403.500196] pci_bus 0000:00: root bus resource [bus 00-77]
[200403.566515] PCI: scan_bus[/pci@300] bus no 0
[200403.617182]   * /pci@300/pci@1
[200403.654367]     create device, devfn: 8, type: pciex
[200403.714432]     class: 0x60400 device name: 0000:00:01.0
[200403.778649]     adding to system ...
[200403.821236] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[200403.894943] pci 0000:00:01.0: PME# disabled
[200403.945610] PCI: dev header type: 1
[200403.986725] of_scan_pci_bridge(/pci@300/pci@1)
[200404.040420]     Bridge bus range [1 --> 119]
[200404.092141]     Bridge ranges[fff8383fffba8c00] simba[0]
[200404.155349]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04002000]
[200404.264260]       Using flags[00000101] start[0000000000000000] size[0000000004002000]
[200404.360042]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20100000]
[200404.468446]       Using flags[00000200] start[0000000000100000] size[0000000020100000]
[200404.564493]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:b0000000]
[200404.673493]       Using flags[0010220c] start[0000000100000000] size[00000003b0000000]
[200404.769131]     bus name: PCI Bus 0000:01
[200404.817571] PCI: scan_bus[/pci@300/pci@1] bus no 1
[200404.875475]   * /pci@300/pci@1/pci@0
[200404.918805]     create device, devfn: 0, type: pciex
[200404.978189]     class: 0x60400 device name: 0000:01:00.0
[200405.043384]     adding to system ...
[200405.086763] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[200405.160658] pci 0000:01:00.0: PME# disabled
[200405.212035] PCI: dev header type: 1
[200405.254162] of_scan_pci_bridge(/pci@300/pci@1/pci@0)
[200405.314162]     Bridge bus range [2 --> 119]
[200405.365890]     Bridge ranges[fff8383fffba79c0] simba[0]
[200405.427984]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04002000]
[200405.535103]       Using flags[00000101] start[0000000000000000] size[0000000004002000]
[200405.630911]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20100000]
[200405.740294]       Using flags[00000200] start[0000000000100000] size[0000000020100000]
[200405.834786]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:b0000000]
[200405.943782]       Using flags[0010220c] start[0000000100000000] size[00000003b0000000]
[200406.040022]     bus name: PCI Bus 0000:02
[200406.087590] PCI: scan_bus[/pci@300/pci@1/pci@0] bus no 2
[200406.150595]   * /pci@300/pci@1/pci@0/pci@4
[200406.200153]     create device, devfn: 20, type: pciex
[200406.261255]     class: 0x60400 device name: 0000:02:04.0
[200406.325463]     adding to system ...
[200406.368662] pci 0000:02:04.0: PME# supported from D0 D3hot D3cold
[200406.442349] pci 0000:02:04.0: PME# disabled
[200406.493015] PCI: dev header type: 1
[200406.534210] of_scan_pci_bridge(/pci@300/pci@1/pci@0/pci@4)
[200406.600734]     Bridge bus range [3 --> 7]
[200406.651009]     Bridge ranges[fff8383fffba6880] simba[0]
[200406.715234]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:00002000]
[200406.823888]       Using flags[00000101] start[0000000000000000] size[0000000000002000]
[200406.919927]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:00100000]
[200407.028769]       Using flags[00000200] start[0000000000100000] size[0000000000100000]
[200407.124533]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000000:30000000]
[200407.232972]       Using flags[0010220c] start[0000000100000000] size[0000000030000000]
[200407.328735]     bus name: PCI Bus 0000:03
[200407.377225] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@4] bus no 3
[200407.447744]   * /pci@300/pci@1/pci@0/pci@4/pci@0
[200407.503612]     create device, devfn: 0, type: pciex
[200407.563668]     class: 0x60400 device name: 0000:03:00.0
[200407.627875]     adding to system ...
[200407.671266] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[200407.745041] pci 0000:03:00.0: PME# disabled
[200407.795746] PCI: dev header type: 1
[200407.837878] of_scan_pci_bridge(/pci@300/pci@1/pci@0/pci@4/pci@0)
[200407.910501]     Bridge bus range [4 --> 7]
[200407.960135]     Bridge ranges[fff8383fffba5740] simba[0]
[200408.023339]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:00002000]
[200408.131763]       Using flags[00000101] start[0000000000000000] size[0000000000002000]
[200408.227527]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:00100000]
[200408.335911]       Using flags[00000200] start[0000000000100000] size[0000000000100000]
[200408.431674]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000000:30000000]
[200408.540058]       Using flags[0010220c] start[0000000100000000] size[0000000030000000]
[200408.635822]     bus name: PCI Bus 0000:04
[200408.684252] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@4/pci@0] bus no 4
[200408.762027]   * /pci@300/pci@1/pci@0/pci@4/pci@0/pci@6
[200408.826676]     create device, devfn: 30, type: pciex
[200408.887906]     class: 0x60400 device name: 0000:04:06.0
[200408.952922]     adding to system ...
[200408.996546] pci 0000:04:06.0: PME# supported from D0 D3hot D3cold
[200409.069292] pci 0000:04:06.0: PME# disabled
[200409.119970] PCI: dev header type: 1
[200409.161080] of_scan_pci_bridge(/pci@300/pci@1/pci@0/pci@4/pci@0/pci@6)
[200409.243216]     Bridge bus range [5 --> 5]
[200409.293540]     Bridge ranges[fff8383fffba4540] simba[0]
[200409.357752]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000000:10000000]
[200409.467707]       Using flags[0010220c] start[0000000100000000] size[0000000010000000]
[200409.563798]     bus name: PCI Bus 0000:05
[200409.614404] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@4/pci@0/pci@6] bus no 5
[200409.697225]   * /pci@300/pci@1/pci@0/pci@4/pci@0/pci@6/usb@0
[200409.766182]     create device, devfn: 0, type: xchi
[200409.826847]     class: 0xc0330 device name: 0000:05:00.0
[200409.891149]     parse addresses (20 bytes) @ fff8383fffba3340
[200409.960614]   start: 800100000000, end: 800100001fff, i: 10
[200410.027293]     adding to system ...
[200410.069229] pci 0000:05:00.0: PME# supported from D0 D3hot D3cold
[200410.143339] pci 0000:05:00.0: PME# disabled
[200410.193989] pci 0000:05:00.0: reg 0x10 [mem 0x800100000000-0x800100001fff 64bit] + pref
[200410.292619] PCI: dev header type: 0
[200410.334741]   * /pci@300/pci@1/pci@0/pci@4/pci@0/pci@8
[200410.396923]     create device, devfn: 40, type: pciex
[200410.458031]     class: 0x60400 device name: 0000:04:08.0
[200410.522237]     adding to system ...
[200410.565668] pci 0000:04:08.0: PME# supported from D0 D3hot D3cold
[200410.639356] pci 0000:04:08.0: PME# disabled
[200410.690026] PCI: dev header type: 1
[200410.731138] of_scan_pci_bridge(/pci@300/pci@1/pci@0/pci@4/pci@0/pci@8)
[200410.810748]     Bridge bus range [6 --> 6]
[200410.860425]     Bridge ranges[fff8383fffba0240] simba[0]
[200410.925473]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:00001000]
[200411.034022]       Using flags[00000101] start[0000000000000000] size[0000000000001000]
[200411.131444]     RAW Range[c3000000:00000001:10000000:c3000000:00000001:10000000:00000000:10000000]
[200411.239831]       Using flags[0010220c] start[0000000110000000] size[0000000010000000]
[200411.335965]     bus name: PCI Bus 0000:06
[200411.384395] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@4/pci@0/pci@8] bus no 6
[200411.467810]   * /pci@300/pci@1/pci@0/pci@4/pci@0/pci@8/network@0
[200411.541016]     create device, devfn: 0, type: network
[200411.603219]     class: 0x20000 device name: 0000:06:00.0
[200411.667428]     parse addresses (60 bytes) @ fff8383fffb9ed80
[200411.736466]   start: 800110000000, end: 8001101fffff, i: 10
[200411.803827]   start: 804000000000, end: 80400000001f, i: 18
[200411.872517]   start: 800110200000, end: 800110203fff, i: 20
[200411.940085]     adding to system ...
[200411.983567] pci 0000:06:00.0: PME# supported from D0 D3hot D3cold
[200412.057255] pci 0000:06:00.0: PME# disabled
[200412.108452] pci 0000:06:00.0: reg 0x184: [mem 0x800110204000-0x800110207fff 64bit]
[200412.199787] pci 0000:06:00.0: reg 0x190: [mem 0x800110304000-0x800110307fff 64bit]
[200412.290656] pci 0000:06:00.0: reg 0x184 [mem 0x800110204000-0x800110303fff 64bit] + pref
[200412.388524] pci 0000:06:00.0: reg 0x190 [mem 0x800110304000-0x800110403fff 64bit] + pref
[200412.486471] PCI: dev header type: 0
[200412.528593]   * /pci@300/pci@1/pci@0/pci@4/pci@0/pci@8/network@0,1
[200412.603394]     create device, devfn: 1, type: network
[200412.665596]     class: 0x20000 device name: 0000:06:00.1
[200412.729805]     parse addresses (60 bytes) @ fff8383fffb9d140
[200412.799273]   start: 800110600000, end: 8001107fffff, i: 10
[200412.867540]   start: 804000000020, end: 80400000003f, i: 18
[200412.935680]   start: 800110404000, end: 800110407fff, i: 20
[200413.003041]     adding to system ...
[200413.046523] pci 0000:06:00.1: PME# supported from D0 D3hot D3cold
[200413.122205] pci 0000:06:00.1: PME# disabled
[200413.172950] pci 0000:06:00.1: reg 0x184: [mem 0x800110408000-0x80011040bfff 64bit]
[200413.264617] pci 0000:06:00.1: reg 0x190: [mem 0x800110800000-0x800110803fff 64bit]
[200413.357343] pci 0000:06:00.1: reg 0x184 [mem 0x800110408000-0x800110507fff 64bit] + pref
[200413.455843] pci 0000:06:00.1: reg 0x190 [mem 0x800110800000-0x8001108fffff 64bit] + pref
[200413.554987] PCI: dev header type: 0
[200413.597110]   * /pci@300/pci@1/pci@0/pci@4/pci@0/pci@c
[200413.659291]     create device, devfn: 60, type: pciex
[200413.721226]     class: 0x60400 device name: 0000:04:0c.0
[200413.786724]     adding to system ...
[200413.830156] pci 0000:04:0c.0: PME# supported from D0 D3hot D3cold
[200413.903842] pci 0000:04:0c.0: PME# disabled
[200413.956818] PCI: dev header type: 1
[200413.998665] of_scan_pci_bridge(/pci@300/pci@1/pci@0/pci@4/pci@0/pci@c)
[200414.077598]     Bridge bus range [7 --> 7]
[200414.127633]     Bridge ranges[fff8383fffb9b6c0] simba[0]
[200414.192739]     RAW Range[81000000:00000000:00001000:81000000:00000000:00001000:00000000:00001000]
[200414.301599]       Using flags[00000101] start[0000000000001000] size[0000000000001000]
[200414.399545]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:00100000]
[200414.507929]       Using flags[00000200] start[0000000000100000] size[0000000000100000]
[200414.603694]     RAW Range[c3000000:00000001:20000000:c3000000:00000001:20000000:00000000:10000000]
[200414.712079]       Using flags[0010220c] start[0000000120000000] size[0000000010000000]
[200414.807843]     bus name: PCI Bus 0000:07
[200414.856274] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@4/pci@0/pci@c] bus no 7
[200414.939414]   * /pci@300/pci@1/pci@0/pci@4/pci@0/pci@c/scsi@0
[200415.008957]     create device, devfn: 0, type: scsi-sas
[200415.072457]     class: 0x10700 device name: 0000:07:00.0
[200415.136665]     parse addresses (80 bytes) @ fff8383fffb9a4c0
[200415.206134]   start: 804000001000, end: 8040000010ff, i: 10
[200415.273497]   start: 800120000000, end: 80012000ffff, i: 14
[200415.341338]   start: 800120040000, end: 80012007ffff, i: 1c
[200415.408799]   start: 800000100000, end: 8000001fffff, i: 30
[200415.476163]     adding to system ...
[200415.519683] pci 0000:07:00.0: supports D1 D2
[200415.571389] pci 0000:07:00.0: reg 0x14 [mem 0x800120000000-0x80012000ffff 64bit] + pref
[200415.668206] pci 0000:07:00.0: reg 0x1c [mem 0x800120040000-0x80012007ffff 64bit] + pref
[200415.764721] PCI: dev header type: 0
[200415.806844]   * /pci@300/pci@1/pci@0/pci@6
[200415.856405]     create device, devfn: 30, type: pciex
[200415.917507]     class: 0x60400 device name: 0000:02:06.0
[200415.981715]     adding to system ...
[200416.025470] pci 0000:02:06.0: PME# supported from D0 D3hot D3cold
[200416.099155] pci 0000:02:06.0: PME# disabled
[200416.149821] PCI: dev header type: 1
[200416.190932] of_scan_pci_bridge(/pci@300/pci@1/pci@0/pci@6)
[200416.257243]     Bridge bus range [8 --> 119]
[200416.309000]     Bridge ranges[fff8383fffb98140] simba[0]
[200416.373222]     RAW Range[81000000:00000000:00002000:81000000:00000000:00002000:00000000:04000000]
[200416.482211]       Using flags[00000101] start[0000000000002000] size[0000000004000000]
[200416.579503]     RAW Range[82000000:00000000:00200000:82000000:00000000:00200000:00000000:20000000]
[200416.687937]       Using flags[00000200] start[0000000000200000] size[0000000020000000]
[200416.784591]     RAW Range[c3000000:00000001:30000000:c3000000:00000001:30000000:00000003:78000000]
[200416.895287]       Using flags[0010220c] start[0000000130000000] size[0000000378000000]
[200416.991381]     bus name: PCI Bus 0000:08
[200417.039812] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@6] bus no 8
[200417.111970] PCI: Claiming 0000:00:01.0: Resource 13: 0000804000000000..0000804004001fff [101]
[200417.215458] PCI: Claiming 0000:00:01.0: Resource 14: 0000800000100000..00008000201fffff [200]
[200417.319901] PCI: Claiming 0000:00:01.0: Resource 15: 0000800100000000..00008004afffffff [10220c]
[200417.425937] PCI: Claiming 0000:01:00.0: Resource 13: 0000804000000000..0000804004001fff [101]
[200417.529065] PCI: Claiming 0000:01:00.0: Resource 14: 0000800000100000..00008000201fffff [200]
[200417.633623] PCI: Claiming 0000:01:00.0: Resource 15: 0000800100000000..00008004afffffff [10220c]
[200417.739953] PCI: Claiming 0000:02:04.0: Resource 13: 0000804000000000..0000804000001fff [101]
[200417.842083] PCI: Claiming 0000:02:04.0: Resource 14: 0000800000100000..00008000001fffff [200]
[200417.945373] PCI: Claiming 0000:02:04.0: Resource 15: 0000800100000000..000080012fffffff [10220c]
[200418.051937] PCI: Claiming 0000:02:06.0: Resource 13: 0000804000002000..0000804004001fff [101]
[200418.156265] PCI: Claiming 0000:02:06.0: Resource 14: 0000800000200000..00008000201fffff [200]
[200418.259575] PCI: Claiming 0000:02:06.0: Resource 15: 0000800130000000..00008004a7ffffff [10220c]
[200418.365614] PCI: Claiming 0000:03:00.0: Resource 13: 0000804000000000..0000804000001fff [101]
[200418.467929] PCI: Claiming 0000:03:00.0: Resource 14: 0000800000100000..00008000001fffff [200]
[200418.571058] PCI: Claiming 0000:03:00.0: Resource 15: 0000800100000000..000080012fffffff [10220c]
[200418.677841] PCI: Claiming 0000:04:06.0: Resource 14: 0000800100000000..000080010fffffff [10220c]
[200418.783965] PCI: Claiming 0000:04:08.0: Resource 13: 0000804000000000..0000804000000fff [101]
[200418.887331] PCI: Claiming 0000:04:08.0: Resource 14: 0000800110000000..000080011fffffff [10220c]
[200418.992718] PCI: Claiming 0000:04:0c.0: Resource 13: 0000804000001000..0000804000001fff [101]
[200419.096342] PCI: Claiming 0000:04:0c.0: Resource 14: 0000800000100000..00008000001fffff [200]
[200419.199361] PCI: Claiming 0000:04:0c.0: Resource 15: 0000800120000000..000080012fffffff [10220c]
[200419.305642] PCI: Claiming 0000:05:00.0: Resource 0: 0000800100000000..0000800100001fff [102204]
[200419.410639] PCI: Claiming 0000:06:00.0: Resource 0: 0000800110000000..00008001101fffff [10220c]
[200419.516136] PCI: Claiming 0000:06:00.0: Resource 2: 0000804000000000..000080400000001f [101]
[200419.618255] PCI: Claiming 0000:06:00.0: Resource 4: 0000800110200000..0000800110203fff [10220c]
[200419.724612] PCI: Claiming 0000:06:00.0: Resource 7: 0000800110204000..0000800110303fff [142204]
[200419.827552] PCI: Claiming 0000:06:00.0: Resource 10: 0000800110304000..0000800110403fff [142204]
[200419.934319] PCI: Claiming 0000:06:00.1: Resource 0: 0000800110600000..00008001107fffff [10220c]
[200420.039547] PCI: Claiming 0000:06:00.1: Resource 2: 0000804000000020..000080400000003f [101]
[200420.139783] PCI: Claiming 0000:06:00.1: Resource 4: 0000800110404000..0000800110407fff [10220c]
[200420.245671] PCI: Claiming 0000:06:00.1: Resource 7: 0000800110408000..0000800110507fff [142204]
[200420.351862] PCI: Claiming 0000:06:00.1: Resource 10: 0000800110800000..00008001108fffff [142204]
[200420.458552] PCI: Claiming 0000:07:00.0: Resource 0: 0000804000001000..00008040000010ff [101]
[200420.560626] PCI: Claiming 0000:07:00.0: Resource 1: 0000800120000000..000080012000ffff [102204]
[200420.666834] PCI: Claiming 0000:07:00.0: Resource 3: 0000800120040000..000080012007ffff [102204]
[200420.770814] PCI: Claiming 0000:07:00.0: Resource 6: 0000800000100000..00008000001fffff [4c200]
[200420.875239] /pci@340: SUN4V PCI Bus Module
[200420.924723] /pci@340: On NUMA node -1
[200420.968947] /pci@340: PCI IO[804100000000] MEM[801000000000] MEM64[801100000000]
[200421.056388] /pci@340: Unable to request IOMMU resource.
[200421.200691] /pci@340: MSI Queue first[0] num[56] count[512] devino[0x6]
[200421.280688] /pci@340: MSI first[0] num[512] mask[0x3ff] width[32]
[200421.355646] /pci@340: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200421.454661] /pci@340: MSI queues at RA [0000083f52e00000]
[200421.521314] PCI: Scanning PBM /pci@340
[200421.567247] pci_sun4v f02eab24: PCI host bridge to bus 0001:00
[200421.636253] pci_bus 0001:00: root bus resource [io  0x804100000000-0x80410fffffff] (bus address [0x0000-0xfffffff])
[200421.761404] pci_bus 0001:00: root bus resource [mem 0x801000000000-0x80107effffff] (bus address [0x00000000-0x7effffff])
[200421.893649] pci_bus 0001:00: root bus resource [mem 0x801100000000-0x8017ffffffff] (bus address [0x100000000-0x7ffffffff])
[200422.028042] pci_bus 0001:00: root bus resource [bus 00-e2]
[200422.094874] PCI: scan_bus[/pci@340] bus no 0
[200422.146933]   * /pci@340/pci@1
[200422.183937]     create device, devfn: 8, type: pciex
[200422.244296]     class: 0x60400 device name: 0001:00:01.0
[200422.309002]     adding to system ...
[200422.352342] pci 0001:00:01.0: PME# supported from D0 D3hot D3cold
[200422.427370] pci 0001:00:01.0: PME# disabled
[200422.479800] PCI: dev header type: 1
[200422.521921] of_scan_pci_bridge(/pci@340/pci@1)
[200422.575611]     Bridge bus range [1 --> 226]
[200422.627322]     Bridge ranges[fff8383fffb94d00] simba[0]
[200422.691879]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200422.801254]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200422.897838]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200423.006820]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200423.102582]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200423.210968]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200423.306729]     bus name: PCI Bus 0001:01
[200423.355159] PCI: scan_bus[/pci@340/pci@1] bus no 1
[200423.413054]   * /pci@340/pci@1/pci@0
[200423.456302]     create device, devfn: 0, type: pciex
[200423.516354]     class: 0x60400 device name: 0001:01:00.0
[200423.580562]     adding to system ...
[200423.623929] pci 0001:01:00.0: PME# supported from D0 D3hot D3cold
[200423.697614] pci 0001:01:00.0: PME# disabled
[200423.748302] PCI: dev header type: 1
[200423.789414] of_scan_pci_bridge(/pci@340/pci@1/pci@0)
[200423.849803]     Bridge bus range [2 --> 226]
[200423.902145]     Bridge ranges[fff8383fffb93bc0] simba[0]
[200423.965343]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200424.074191]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200424.169954]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200424.279796]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200424.375559]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200424.483057]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200424.578820]     bus name: PCI Bus 0001:02
[200424.627249] PCI: scan_bus[/pci@340/pci@1/pci@0] bus no 2
[200424.690598]   * /pci@340/pci@1/pci@0/pci@6
[200424.740158]     create device, devfn: 30, type: pciex
[200424.801261]     class: 0x60400 device name: 0001:02:06.0
[200424.865467]     adding to system ...
[200424.909783] pci 0001:02:06.0: PME# supported from D0 D3hot D3cold
[200424.983470] pci 0001:02:06.0: PME# disabled
[200425.034135] PCI: dev header type: 1
[200425.075246] of_scan_pci_bridge(/pci@340/pci@1/pci@0/pci@6)
[200425.142085]     Bridge bus range [3 --> 226]
[200425.193840]     Bridge ranges[fff8383fffb92880] simba[0]
[200425.258064]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200425.366449]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200425.462211]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200425.570773]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200425.667815]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200425.776201]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200425.872614]     bus name: PCI Bus 0001:03
[200425.921043] PCI: scan_bus[/pci@340/pci@1/pci@0/pci@6] bus no 3
[200425.991872] PCI: Claiming 0001:00:01.0: Resource 13: 0000804100000000..0000804107ffffff [101]
[200426.096237] PCI: Claiming 0001:00:01.0: Resource 14: 0000801000100000..00008010400fffff [200]
[200426.199367] PCI: Claiming 0001:00:01.0: Resource 15: 0000801100000000..00008017efffffff [10220c]
[200426.307249] PCI: Claiming 0001:01:00.0: Resource 13: 0000804100000000..0000804107ffffff [101]
[200426.410631] PCI: Claiming 0001:01:00.0: Resource 14: 0000801000100000..00008010400fffff [200]
[200426.514111] PCI: Claiming 0001:01:00.0: Resource 15: 0000801100000000..00008017efffffff [10220c]
[200426.620392] PCI: Claiming 0001:02:06.0: Resource 13: 0000804100000000..0000804107ffffff [101]
[200426.724361] PCI: Claiming 0001:02:06.0: Resource 14: 0000801000100000..00008010400fffff [200]
[200426.828147] PCI: Claiming 0001:02:06.0: Resource 15: 0000801100000000..00008017efffffff [10220c]
[200426.935390] /pci@380: SUN4V PCI Bus Module
[200426.983864] /pci@380: On NUMA node -1
[200427.028089] /pci@380: PCI IO[80c000000000] MEM[808000000000] MEM64[808100000000]
[200427.115450] /pci@380: Unable to request IOMMU resource.
[200427.259781] /pci@380: MSI Queue first[0] num[56] count[512] devino[0x6]
[200427.339773] /pci@380: MSI first[0] num[512] mask[0x3ff] width[32]
[200427.413447] /pci@380: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200427.512370] /pci@380: MSI queues at RA [0000003f22e00000]
[200427.576123] PCI: Scanning PBM /pci@380
[200427.621588] pci_sun4v f02f994c: PCI host bridge to bus 0002:00
[200427.692273] pci_bus 0002:00: root bus resource [io  0x80c000000000-0x80c00fffffff] (bus address [0x0000-0xfffffff])
[200427.819046] pci_bus 0002:00: root bus resource [mem 0x808000000000-0x80807effffff] (bus address [0x00000000-0x7effffff])
[200427.949563] pci_bus 0002:00: root bus resource [mem 0x808100000000-0x8087ffffffff] (bus address [0x100000000-0x7ffffffff])
[200428.084593] pci_bus 0002:00: root bus resource [bus 00-e2]
[200428.150903] PCI: scan_bus[/pci@380] bus no 0
[200428.203427]   * /pci@380/pci@1
[200428.240473]     create device, devfn: 8, type: pciex
[200428.300553]     class: 0x60400 device name: 0002:00:01.0
[200428.364948]     adding to system ...
[200428.408401] pci 0002:00:01.0: PME# supported from D0 D3hot D3cold
[200428.482092] pci 0002:00:01.0: PME# disabled
[200428.533101] PCI: dev header type: 1
[200428.574691] of_scan_pci_bridge(/pci@380/pci@1)
[200428.628381]     Bridge bus range [1 --> 226]
[200428.679603]     Bridge ranges[fff8383fffb8f440] simba[0]
[200428.742847]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200428.851416]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200428.947181]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200429.055564]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200429.151327]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200429.259713]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200429.355476]     bus name: PCI Bus 0002:01
[200429.404388] PCI: scan_bus[/pci@380/pci@1] bus no 1
[200429.462528]   * /pci@380/pci@1/pci@0
[200429.505781]     create device, devfn: 0, type: pciex
[200429.565854]     class: 0x60400 device name: 0002:01:00.0
[200429.631061]     adding to system ...
[200429.674746] pci 0002:01:00.0: PME# supported from D0 D3hot D3cold
[200429.748738] pci 0002:01:00.0: PME# disabled
[200429.799466] PCI: dev header type: 1
[200429.841587] of_scan_pci_bridge(/pci@380/pci@1/pci@0)
[200429.902359]     Bridge bus range [2 --> 226]
[200429.954317]     Bridge ranges[fff8383fffb8e300] simba[0]
[200430.018991]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200430.127664]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200430.223695]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200430.331667]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200430.427668]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200430.535573]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200430.631350]     bus name: PCI Bus 0002:02
[200430.679778] PCI: scan_bus[/pci@380/pci@1/pci@0] bus no 2
[200430.744487]   * /pci@380/pci@1/pci@0/pci@a
[200430.794222]     create device, devfn: 50, type: pciex
[200430.855345]     class: 0x60400 device name: 0002:02:0a.0
[200430.919552]     adding to system ...
[200430.963972] pci 0002:02:0a.0: PME# supported from D0 D3hot D3cold
[200431.037244] pci 0002:02:0a.0: PME# disabled
[200431.087936] PCI: dev header type: 1
[200431.129062] of_scan_pci_bridge(/pci@380/pci@1/pci@0/pci@a)
[200431.196004]     Bridge bus range [3 --> 226]
[200431.247814]     Bridge ranges[fff8383fffb8cfc0] simba[0]
[200431.312298]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200431.420741]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200431.515387]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200431.623772]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200431.719536]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200431.828187]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200431.923756]     bus name: PCI Bus 0002:03
[200431.972186] PCI: scan_bus[/pci@380/pci@1/pci@0/pci@a] bus no 3
[200432.042143]   * /pci@380/pci@1/pci@0/pci@a/SUNW,qlc@0
[200432.103954]     create device, devfn: 0, type: scsi-fcp
[200432.167579]     class: 0xc0400 device name: 0002:03:00.0
[200432.232269]     parse addresses (60 bytes) @ fff8383fffb8bc40
[200432.301735]   start: 80c000000000, end: 80c0000000ff, i: 10
[200432.369859]   start: 808100000000, end: 808100003fff, i: 14
[200432.437220]   start: 808000100000, end: 80800013ffff, i: 30
[200432.503646]     adding to system ...
[200432.546462] pci 0002:03:00.0: reg 0x14 [mem 0x808100000000-0x808100003fff 64bit] + pref
[200432.642586] PCI: dev header type: 0
[200432.684974]   * /pci@380/pci@1/pci@0/pci@a/SUNW,qlc@0,1
[200432.748498]     create device, devfn: 1, type: scsi-fcp
[200432.811754]     class: 0xc0400 device name: 0002:03:00.1
[200432.876130]     parse addresses (60 bytes) @ fff8383fffb891c0
[200432.945595]   start: 80c000000100, end: 80c0000001ff, i: 10
[200433.014474]   start: 808100004000, end: 808100007fff, i: 14
[200433.082503]   start: 808000140000, end: 80800017ffff, i: 30
[200433.149864]     adding to system ...
[200433.193550] pci 0002:03:00.1: reg 0x14 [mem 0x808100004000-0x808100007fff 64bit] + pref
[200433.291050] PCI: dev header type: 0
[200433.333189] PCI: Claiming 0002:00:01.0: Resource 13: 000080c000000000..000080c007ffffff [101]
[200433.437658] PCI: Claiming 0002:00:01.0: Resource 14: 0000808000100000..00008080400fffff [200]
[200433.541256] PCI: Claiming 0002:00:01.0: Resource 15: 0000808100000000..00008087efffffff [10220c]
[200433.647536] PCI: Claiming 0002:01:00.0: Resource 13: 000080c000000000..000080c007ffffff [101]
[200433.751861] PCI: Claiming 0002:01:00.0: Resource 14: 0000808000100000..00008080400fffff [200]
[200433.854985] PCI: Claiming 0002:01:00.0: Resource 15: 0000808100000000..00008087efffffff [10220c]
[200433.962942] PCI: Claiming 0002:02:0a.0: Resource 13: 000080c000000000..000080c007ffffff [101]
[200434.066503] PCI: Claiming 0002:02:0a.0: Resource 14: 0000808000100000..00008080400fffff [200]
[200434.170624] PCI: Claiming 0002:02:0a.0: Resource 15: 0000808100000000..00008087efffffff [10220c]
[200434.278666] PCI: Claiming 0002:03:00.0: Resource 0: 000080c000000000..000080c0000000ff [101]
[200434.381761] PCI: Claiming 0002:03:00.0: Resource 1: 0000808100000000..0000808100003fff [102204]
[200434.487536] PCI: Claiming 0002:03:00.0: Resource 6: 0000808000100000..000080800013ffff [4c200]
[200434.593529] PCI: Claiming 0002:03:00.1: Resource 0: 000080c000000100..000080c0000001ff [101]
[200434.695603] PCI: Claiming 0002:03:00.1: Resource 1: 0000808100004000..0000808100007fff [102204]
[200434.801228] PCI: Claiming 0002:03:00.1: Resource 6: 0000808000140000..000080800017ffff [4c200]
[200434.905565] /pci@3c0: SUN4V PCI Bus Module
[200434.951961] /pci@3c0: On NUMA node -1
[200434.994986] /pci@3c0: PCI IO[80c100000000] MEM[809000000000] MEM64[809100000000]
[200435.082426] /pci@3c0: Unable to request IOMMU resource.
[200435.225085] /pci@3c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[200435.305079] /pci@3c0: MSI first[0] num[512] mask[0x3ff] width[32]
[200435.375593] /pci@3c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200435.474515] /pci@3c0: MSI queues at RA [0000383f50800000]
[200435.539774] PCI: Scanning PBM /pci@3c0
[200435.585491] pci_sun4v f0308774: PCI host bridge to bus 0003:00
[200435.655886] pci_bus 0003:00: root bus resource [io  0x80c100000000-0x80c10fffffff] (bus address [0x0000-0xfffffff])
[200435.783302] pci_bus 0003:00: root bus resource [mem 0x809000000000-0x80907effffff] (bus address [0x00000000-0x7effffff])
[200435.914994] pci_bus 0003:00: root bus resource [mem 0x809100000000-0x8097ffffffff] (bus address [0x100000000-0x7ffffffff])
[200436.048624] pci_bus 0003:00: root bus resource [bus 00-e2]
[200436.114936] PCI: scan_bus[/pci@3c0] bus no 0
[200436.166521]   * /pci@3c0/pci@1
[200436.203769]     create device, devfn: 8, type: pciex
[200436.262841]     class: 0x60400 device name: 0003:00:01.0
[200436.327049]     adding to system ...
[200436.370499] pci 0003:00:01.0: PME# supported from D0 D3hot D3cold
[200436.444188] pci 0003:00:01.0: PME# disabled
[200436.495397] PCI: dev header type: 1
[200436.536885] of_scan_pci_bridge(/pci@3c0/pci@1)
[200436.590575]     Bridge bus range [1 --> 226]
[200436.642506]     Bridge ranges[fff8383fffb84680] simba[0]
[200436.706719]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200436.815169]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200436.909722]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200437.018107]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200437.112011]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200437.221089]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200437.316853]     bus name: PCI Bus 0003:01
[200437.365284] PCI: scan_bus[/pci@3c0/pci@1] bus no 1
[200437.423180]   * /pci@3c0/pci@1/pci@0
[200437.466970]     create device, devfn: 0, type: pciex
[200437.527042]     class: 0x60400 device name: 0003:01:00.0
[200437.591250]     adding to system ...
[200437.634704] pci 0003:01:00.0: PME# supported from D0 D3hot D3cold
[200437.708394] pci 0003:01:00.0: PME# disabled
[200437.759126] PCI: dev header type: 1
[200437.801248] of_scan_pci_bridge(/pci@3c0/pci@1/pci@0)
[200437.861250]     Bridge bus range [2 --> 226]
[200437.913023]     Bridge ranges[fff8383fffb83540] simba[0]
[200437.978897]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200438.087302]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200438.183719]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200438.294420]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200438.388716]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200438.493123]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200438.588598]     bus name: PCI Bus 0003:02
[200438.637027] PCI: scan_bus[/pci@3c0/pci@1/pci@0] bus no 2
[200438.700928]   * /pci@3c0/pci@1/pci@0/pci@e
[200438.750492]     create device, devfn: 70, type: pciex
[200438.811615]     class: 0x60400 device name: 0003:02:0e.0
[200438.876706]     adding to system ...
[200438.920211] pci 0003:02:0e.0: PME# supported from D0 D3hot D3cold
[200438.994677] pci 0003:02:0e.0: PME# disabled
[200439.044489] PCI: dev header type: 1
[200439.085625] of_scan_pci_bridge(/pci@3c0/pci@1/pci@0/pci@e)
[200439.151952]     Bridge bus range [3 --> 226]
[200439.204028]     Bridge ranges[fff8383fffb82200] simba[0]
[200439.269809]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200439.378196]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200439.473958]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200439.582343]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200439.678496]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200439.786883]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200439.883725]     bus name: PCI Bus 0003:03
[200439.932155] PCI: scan_bus[/pci@3c0/pci@1/pci@0/pci@e] bus no 3
[200440.003763] PCI: Claiming 0003:00:01.0: Resource 13: 000080c100000000..000080c107ffffff [101]
[200440.105392] PCI: Claiming 0003:00:01.0: Resource 14: 0000809000100000..00008090400fffff [200]
[200440.209248] PCI: Claiming 0003:00:01.0: Resource 15: 0000809100000000..00008097efffffff [10220c]
[200440.316020] PCI: Claiming 0003:01:00.0: Resource 13: 000080c100000000..000080c107ffffff [101]
[200440.419149] PCI: Claiming 0003:01:00.0: Resource 14: 0000809000100000..00008090400fffff [200]
[200440.522275] PCI: Claiming 0003:01:00.0: Resource 15: 0000809100000000..00008097efffffff [10220c]
[200440.628846] PCI: Claiming 0003:02:0e.0: Resource 13: 000080c100000000..000080c107ffffff [101]
[200440.732481] PCI: Claiming 0003:02:0e.0: Resource 14: 0000809000100000..00008090400fffff [200]
[200440.835608] PCI: Claiming 0003:02:0e.0: Resource 15: 0000809100000000..00008097efffffff [10220c]
[200440.943236] /pci@400: SUN4V PCI Bus Module
[200440.992029] /pci@400: On NUMA node -1
[200441.036252] /pci@400: PCI IO[814000000000] MEM[810000000000] MEM64[810100000000]
[200441.123791] /pci@400: Unable to request IOMMU resource.
[200441.268337] /pci@400: MSI Queue first[0] num[56] count[512] devino[0x6]
[200441.348330] /pci@400: MSI first[0] num[512] mask[0x3ff] width[32]
[200441.422006] /pci@400: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200441.521500] /pci@400: MSI queues at RA [0000303f52200000]
[200441.586763] PCI: Scanning PBM /pci@400
[200441.632621] pci_sun4v f031759c: PCI host bridge to bus 0004:00
[200441.704991] pci_bus 0004:00: root bus resource [io  0x814000000000-0x81400fffffff] (bus address [0x0000-0xfffffff])
[200441.832151] pci_bus 0004:00: root bus resource [mem 0x810000000000-0x81007effffff] (bus address [0x00000000-0x7effffff])
[200441.965098] pci_bus 0004:00: root bus resource [mem 0x810100000000-0x8107ffffffff] (bus address [0x100000000-0x7ffffffff])
[200442.098947] pci_bus 0004:00: root bus resource [bus 00-72]
[200442.165858] PCI: scan_bus[/pci@400] bus no 0
[200442.217933]   * /pci@400/pci@1
[200442.254935]     create device, devfn: 8, type: pciex
[200442.315581]     class: 0x60400 device name: 0004:00:01.0
[200442.380401]     adding to system ...
[200442.422902] pci 0004:00:01.0: PME# supported from D0 D3hot D3cold
[200442.496592] pci 0004:00:01.0: PME# disabled
[200442.547268] PCI: dev header type: 1
[200442.589706] of_scan_pci_bridge(/pci@400/pci@1)
[200442.643823]     Bridge bus range [1 --> 114]
[200442.695592]     Bridge ranges[fff8383fffb7edc0] simba[0]
[200442.759317]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04000000]
[200442.865666]       Using flags[00000101] start[0000000000000000] size[0000000004000000]
[200442.961895]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20000000]
[200443.071048]       Using flags[00000200] start[0000000000100000] size[0000000020000000]
[200443.166811]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:80000000]
[200443.275987]       Using flags[0010220c] start[0000000100000000] size[0000000380000000]
[200443.372405]     bus name: PCI Bus 0004:01
[200443.420836] PCI: scan_bus[/pci@400/pci@1] bus no 1
[200443.478732]   * /pci@400/pci@1/pci@0
[200443.521985]     create device, devfn: 0, type: pciex
[200443.582057]     class: 0x60400 device name: 0004:01:00.0
[200443.646265]     adding to system ...
[200443.689716] pci 0004:01:00.0: PME# supported from D0 D3hot D3cold
[200443.763406] pci 0004:01:00.0: PME# disabled
[200443.814130] PCI: dev header type: 1
[200443.856251] of_scan_pci_bridge(/pci@400/pci@1/pci@0)
[200443.914593]     Bridge bus range [2 --> 114]
[200443.966362]     Bridge ranges[fff8383fffb7db80] simba[0]
[200444.030572]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04000000]
[200444.139277]       Using flags[00000101] start[0000000000000000] size[0000000004000000]
[200444.235040]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20000000]
[200444.343944]       Using flags[00000200] start[0000000000100000] size[0000000020000000]
[200444.439708]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:80000000]
[200444.548092]       Using flags[0010220c] start[0000000100000000] size[0000000380000000]
[200444.643856]     bus name: PCI Bus 0004:02
[200444.692686] PCI: scan_bus[/pci@400/pci@1/pci@0] bus no 2
[200444.756894]   * /pci@400/pci@1/pci@0/pci@c
[200444.806456]     create device, devfn: 60, type: pciex
[200444.867577]     class: 0x60400 device name: 0004:02:0c.0
[200444.931084]     adding to system ...
[200444.974586] pci 0004:02:0c.0: PME# supported from D0 D3hot D3cold
[200445.047529] pci 0004:02:0c.0: PME# disabled
[200445.098223] PCI: dev header type: 1
[200445.139745] of_scan_pci_bridge(/pci@400/pci@1/pci@0/pci@c)
[200445.206055]     Bridge bus range [3 --> 114]
[200445.258027]     Bridge ranges[fff8383fffb7c840] simba[0]
[200445.322607]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04000000]
[200445.431367]       Using flags[00000101] start[0000000000000000] size[0000000004000000]
[200445.527867]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20000000]
[200445.636459]       Using flags[00000200] start[0000000000100000] size[0000000020000000]
[200445.732418]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:78000000]
[200445.839487]       Using flags[0010220c] start[0000000100000000] size[0000000378000000]
[200445.936159]     bus name: PCI Bus 0004:03
[200445.986473] PCI: scan_bus[/pci@400/pci@1/pci@0/pci@c] bus no 3
[200446.057003] PCI: Claiming 0004:00:01.0: Resource 13: 0000814000000000..0000814003ffffff [101]
[200446.160128] PCI: Claiming 0004:00:01.0: Resource 14: 0000810000100000..00008100200fffff [200]
[200446.263608] PCI: Claiming 0004:00:01.0: Resource 15: 0000810100000000..000081047fffffff [10220c]
[200446.370539] PCI: Claiming 0004:01:00.0: Resource 13: 0000814000000000..0000814003ffffff [101]
[200446.473991] PCI: Claiming 0004:01:00.0: Resource 14: 0000810000100000..00008100200fffff [200]
[200446.575637] PCI: Claiming 0004:01:00.0: Resource 15: 0000810100000000..000081047fffffff [10220c]
[200446.681919] PCI: Claiming 0004:02:0c.0: Resource 13: 0000814000000000..0000814003ffffff [101]
[200446.785020] PCI: Claiming 0004:02:0c.0: Resource 14: 0000810000100000..00008100200fffff [200]
[200446.889254] PCI: Claiming 0004:02:0c.0: Resource 15: 0000810100000000..0000810477ffffff [10220c]
[200446.996108] /pci@440: SUN4V PCI Bus Module
[200447.044583] /pci@440: On NUMA node -1
[200447.088807] /pci@440: PCI IO[814100000000] MEM[811000000000] MEM64[811100000000]
[200447.176537] /pci@440: Unable to request IOMMU resource.
[200447.322372] /pci@440: MSI Queue first[0] num[56] count[512] devino[0x6]
[200447.403525] /pci@440: MSI first[0] num[512] mask[0x3ff] width[32]
[200447.477201] /pci@440: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200447.577059] /pci@440: MSI queues at RA [0000303f52400000]
[200447.642369] PCI: Scanning PBM /pci@440
[200447.687709] pci_sun4v f03263c4: PCI host bridge to bus 0005:00
[200447.758233] pci_bus 0005:00: root bus resource [io  0x814100000000-0x81410fffffff] (bus address [0x0000-0xfffffff])
[200447.884502] pci_bus 0005:00: root bus resource [mem 0x811000000000-0x81107effffff] (bus address [0x00000000-0x7effffff])
[200448.017300] pci_bus 0005:00: root bus resource [mem 0x811100000000-0x8117ffffffff] (bus address [0x100000000-0x7ffffffff])
[200448.149240] pci_bus 0005:00: root bus resource [bus 00-e2]
[200448.215990] PCI: scan_bus[/pci@440] bus no 0
[200448.267576]   * /pci@440/pci@1
[200448.303677]     create device, devfn: 8, type: pciex
[200448.364112]     class: 0x60400 device name: 0005:00:01.0
[200448.428379]     adding to system ...
[200448.471901] pci 0005:00:01.0: PME# supported from D0 D3hot D3cold
[200448.546155] pci 0005:00:01.0: PME# disabled
[200448.596828] PCI: dev header type: 1
[200448.638514] of_scan_pci_bridge(/pci@440/pci@1)
[200448.692204]     Bridge bus range [1 --> 226]
[200448.743972]     Bridge ranges[fff8383fffb79400] simba[0]
[200448.808272]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200448.917634]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200449.014030]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200449.122413]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200449.218197]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200449.325325]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200449.421584]     bus name: PCI Bus 0005:01
[200449.470014] PCI: scan_bus[/pci@440/pci@1] bus no 1
[200449.527909]   * /pci@440/pci@1/pci@0
[200449.571158]     create device, devfn: 0, type: pciex
[200449.631230]     class: 0x60400 device name: 0005:01:00.0
[200449.695438]     adding to system ...
[200449.738892] pci 0005:01:00.0: PME# supported from D0 D3hot D3cold
[200449.813098] pci 0005:01:00.0: PME# disabled
[200449.863818] PCI: dev header type: 1
[200449.905941] of_scan_pci_bridge(/pci@440/pci@1/pci@0)
[200449.964267]     Bridge bus range [2 --> 226]
[200450.017826]     Bridge ranges[fff8383fffb782c0] simba[0]
[200450.082037]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200450.188720]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200450.284184]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200450.392570]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200450.489338]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200450.597829]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200450.695152]     bus name: PCI Bus 0005:02
[200450.743580] PCI: scan_bus[/pci@440/pci@1/pci@0] bus no 2
[200450.807788]   * /pci@440/pci@1/pci@0/pci@c
[200450.857355]     create device, devfn: 60, type: pciex
[200450.918268]     class: 0x60400 device name: 0005:02:0c.0
[200450.982853]     adding to system ...
[200451.026723] pci 0005:02:0c.0: PME# supported from D0 D3hot D3cold
[200451.102169] pci 0005:02:0c.0: PME# disabled
[200451.152991] PCI: dev header type: 1
[200451.194101] of_scan_pci_bridge(/pci@440/pci@1/pci@0/pci@c)
[200451.260412]     Bridge bus range [3 --> 226]
[200451.312578]     Bridge ranges[fff8383fffb76f80] simba[0]
[200451.374972]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200451.482978]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200451.577848]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200451.683306]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200451.779068]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200451.887452]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200451.983215]     bus name: PCI Bus 0005:03
[200452.031645] PCI: scan_bus[/pci@440/pci@1/pci@0/pci@c] bus no 3
[200452.102173] PCI: Claiming 0005:00:01.0: Resource 13: 0000814100000000..0000814107ffffff [101]
[200452.206048] PCI: Claiming 0005:00:01.0: Resource 14: 0000811000100000..00008110400fffff [200]
[200452.309031] PCI: Claiming 0005:00:01.0: Resource 15: 0000811100000000..00008117efffffff [10220c]
[200452.416249] PCI: Claiming 0005:01:00.0: Resource 13: 0000814100000000..0000814107ffffff [101]
[200452.519789] PCI: Claiming 0005:01:00.0: Resource 14: 0000811000100000..00008110400fffff [200]
[200452.622235] PCI: Claiming 0005:01:00.0: Resource 15: 0000811100000000..00008117efffffff [10220c]
[200452.728516] PCI: Claiming 0005:02:0c.0: Resource 13: 0000814100000000..0000814107ffffff [101]
[200452.832413] PCI: Claiming 0005:02:0c.0: Resource 14: 0000811000100000..00008110400fffff [200]
[200452.935794] PCI: Claiming 0005:02:0c.0: Resource 15: 0000811100000000..00008117efffffff [10220c]
[200453.042556] /pci@480: SUN4V PCI Bus Module
[200453.092040] /pci@480: On NUMA node -1
[200453.136264] /pci@480: PCI IO[81c000000000] MEM[818000000000] MEM64[818100000000]
[200453.222193] /pci@480: Unable to request IOMMU resource.
[200453.366684] /pci@480: MSI Queue first[0] num[56] count[512] devino[0x6]
[200453.446975] /pci@480: MSI first[0] num[512] mask[0x3ff] width[32]
[200453.520650] /pci@480: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200453.619043] /pci@480: MSI queues at RA [0000283f52000000]
[200453.684638] PCI: Scanning PBM /pci@480
[200453.729975] pci_sun4v f03351ec: PCI host bridge to bus 0006:00
[200453.802032] pci_bus 0006:00: root bus resource [io  0x81c000000000-0x81c00fffffff] (bus address [0x0000-0xfffffff])
[200453.928505] pci_bus 0006:00: root bus resource [mem 0x818000000000-0x81807effffff] (bus address [0x00000000-0x7effffff])
[200454.060032] pci_bus 0006:00: root bus resource [mem 0x818100000000-0x8187ffffffff] (bus address [0x100000000-0x7ffffffff])
[200454.193662] pci_bus 0006:00: root bus resource [bus 00-e2]
[200454.259973] PCI: scan_bus[/pci@480] bus no 0
[200454.311558]   * /pci@480/pci@1
[200454.348538]     create device, devfn: 8, type: pciex
[200454.409765]     class: 0x60400 device name: 0006:00:01.0
[200454.473974]     adding to system ...
[200454.517521] pci 0006:00:01.0: PME# supported from D0 D3hot D3cold
[200454.591211] pci 0006:00:01.0: PME# disabled
[200454.644001] PCI: dev header type: 1
[200454.685113] of_scan_pci_bridge(/pci@480/pci@1)
[200454.738802]     Bridge bus range [1 --> 226]
[200454.790571]     Bridge ranges[fff8383fffb73b40] simba[0]
[200454.856482]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200454.965532]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200455.060807]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200455.168413]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200455.264176]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200455.370974]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200455.466738]     bus name: PCI Bus 0006:01
[200455.516030] PCI: scan_bus[/pci@480/pci@1] bus no 1
[200455.574556]   * /pci@480/pci@1/pci@0
[200455.618246]     create device, devfn: 0, type: pciex
[200455.678318]     class: 0x60400 device name: 0006:01:00.0
[200455.742859]     adding to system ...
[200455.786909] pci 0006:01:00.0: PME# supported from D0 D3hot D3cold
[200455.860599] pci 0006:01:00.0: PME# disabled
[200455.911321] PCI: dev header type: 1
[200455.953443] of_scan_pci_bridge(/pci@480/pci@1/pci@0)
[200456.013914]     Bridge bus range [2 --> 226]
[200456.065986]     Bridge ranges[fff8383fffb72a00] simba[0]
[200456.130197]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200456.238583]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200456.334345]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200456.442729]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200456.538493]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200456.646875]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200456.741622]     bus name: PCI Bus 0006:02
[200456.790051] PCI: scan_bus[/pci@480/pci@1/pci@0] bus no 2
[200456.854258]   * /pci@480/pci@1/pci@0/pci@4
[200456.903820]     create device, devfn: 20, type: pciex
[200456.964942]     class: 0x60400 device name: 0006:02:04.0
[200457.029149]     adding to system ...
[200457.073149] pci 0006:02:04.0: PME# supported from D0 D3hot D3cold
[200457.146840] pci 0006:02:04.0: PME# disabled
[200457.197531] PCI: dev header type: 1
[200457.238657] of_scan_pci_bridge(/pci@480/pci@1/pci@0/pci@4)
[200457.304967]     Bridge bus range [3 --> 226]
[200457.356777]     Bridge ranges[fff8383fffb716c0] simba[0]
[200457.420558]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200457.529678]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200457.625441]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200457.733824]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200457.828441]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200457.938482]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200458.034246]     bus name: PCI Bus 0006:03
[200458.082555] PCI: scan_bus[/pci@480/pci@1/pci@0/pci@4] bus no 3
[200458.153634] PCI: Claiming 0006:00:01.0: Resource 13: 000081c000000000..000081c007ffffff [101]
[200458.257409] PCI: Claiming 0006:00:01.0: Resource 14: 0000818000100000..00008180400fffff [200]
[200458.360752] PCI: Claiming 0006:00:01.0: Resource 15: 0000818100000000..00008187efffffff [10220c]
[200458.467369] PCI: Claiming 0006:01:00.0: Resource 13: 000081c000000000..000081c007ffffff [101]
[200458.570525] PCI: Claiming 0006:01:00.0: Resource 14: 0000818000100000..00008180400fffff [200]
[200458.673834] PCI: Claiming 0006:01:00.0: Resource 15: 0000818100000000..00008187efffffff [10220c]
[200458.781757] PCI: Claiming 0006:02:04.0: Resource 13: 000081c000000000..000081c007ffffff [101]
[200458.885499] PCI: Claiming 0006:02:04.0: Resource 14: 0000818000100000..00008180400fffff [200]
[200458.989539] PCI: Claiming 0006:02:04.0: Resource 15: 0000818100000000..00008187efffffff [10220c]
[200459.098223] /pci@4c0: SUN4V PCI Bus Module
[200459.147707] /pci@4c0: On NUMA node -1
[200459.192191] /pci@4c0: PCI IO[81c100000000] MEM[819000000000] MEM64[819100000000]
[200459.280439] /pci@4c0: Unable to request IOMMU resource.
[200459.425372] /pci@4c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[200459.505394] /pci@4c0: MSI first[0] num[512] mask[0x3ff] width[32]
[200459.580021] /pci@4c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200459.679185] /pci@4c0: MSI queues at RA [0000203f52400000]
[200459.745041] PCI: Scanning PBM /pci@4c0
[200459.790375] pci_sun4v f0344014: PCI host bridge to bus 0007:00
[200459.860898] pci_bus 0007:00: root bus resource [io  0x81c100000000-0x81c10fffffff] (bus address [0x0000-0xfffffff])
[200459.988693] pci_bus 0007:00: root bus resource [mem 0x819000000000-0x81907effffff] (bus address [0x00000000-0x7effffff])
[200460.120973] pci_bus 0007:00: root bus resource [mem 0x819100000000-0x8197ffffffff] (bus address [0x100000000-0x7ffffffff])
[200460.254604] pci_bus 0007:00: root bus resource [bus 00-e2]
[200460.320916] PCI: scan_bus[/pci@4c0] bus no 0
[200460.372501]   * /pci@4c0/pci@1
[200460.409497]     create device, devfn: 8, type: pciex
[200460.468568]     class: 0x60400 device name: 0007:00:01.0
[200460.532853]     adding to system ...
[200460.576303] pci 0007:00:01.0: PME# supported from D0 D3hot D3cold
[200460.650107] pci 0007:00:01.0: PME# disabled
[200460.701169] PCI: dev header type: 1
[200460.742281] of_scan_pci_bridge(/pci@4c0/pci@1)
[200460.796087]     Bridge bus range [1 --> 226]
[200460.847853]     Bridge ranges[fff8383fffb6e280] simba[0]
[200460.912356]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200461.021741]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200461.117801]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200461.226372]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200461.322134]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200461.430231]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200461.525993]     bus name: PCI Bus 0007:01
[200461.574423] PCI: scan_bus[/pci@4c0/pci@1] bus no 1
[200461.632530]   * /pci@4c0/pci@1/pci@0
[200461.675785]     create device, devfn: 0, type: pciex
[200461.735263]     class: 0x60400 device name: 0007:01:00.0
[200461.799496]     adding to system ...
[200461.842952] pci 0007:01:00.0: PME# supported from D0 D3hot D3cold
[200461.915993] pci 0007:01:00.0: PME# disabled
[200461.966722] PCI: dev header type: 1
[200462.008844] of_scan_pci_bridge(/pci@4c0/pci@1/pci@0)
[200462.068845]     Bridge bus range [2 --> 226]
[200462.120611]     Bridge ranges[fff8383fffb6d140] simba[0]
[200462.184822]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200462.293207]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200462.388970]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200462.497736]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200462.592878]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200462.701661]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200462.799070]     bus name: PCI Bus 0007:02
[200462.847499] PCI: scan_bus[/pci@4c0/pci@1/pci@0] bus no 2
[200462.911707]   * /pci@4c0/pci@1/pci@0/pci@8
[200462.961734]     create device, devfn: 40, type: pciex
[200463.023844]     class: 0x60400 device name: 0007:02:08.0
[200463.088415]     adding to system ...
[200463.131920] pci 0007:02:08.0: PME# supported from D0 D3hot D3cold
[200463.205611] pci 0007:02:08.0: PME# disabled
[200463.253771] PCI: dev header type: 1
[200463.294993] of_scan_pci_bridge(/pci@4c0/pci@1/pci@0/pci@8)
[200463.361593]     Bridge bus range [3 --> 226]
[200463.413408]     Bridge ranges[fff8383fffb6be00] simba[0]
[200463.478129]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200463.586306]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200463.681317]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200463.785377]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200463.881637]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200463.991411]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200464.087295]     bus name: PCI Bus 0007:03
[200464.135725] PCI: scan_bus[/pci@4c0/pci@1/pci@0/pci@8] bus no 3
[200464.205862] PCI: Claiming 0007:00:01.0: Resource 13: 000081c100000000..000081c107ffffff [101]
[200464.308990] PCI: Claiming 0007:00:01.0: Resource 14: 0000819000100000..00008190400fffff [200]
[200464.412117] PCI: Claiming 0007:00:01.0: Resource 15: 0000819100000000..00008197efffffff [10220c]
[200464.518397] PCI: Claiming 0007:01:00.0: Resource 13: 000081c100000000..000081c107ffffff [101]
[200464.621522] PCI: Claiming 0007:01:00.0: Resource 14: 0000819000100000..00008190400fffff [200]
[200464.724648] PCI: Claiming 0007:01:00.0: Resource 15: 0000819100000000..00008197efffffff [10220c]
[200464.831307] PCI: Claiming 0007:02:08.0: Resource 13: 000081c100000000..000081c107ffffff [101]
[200464.934695] PCI: Claiming 0007:02:08.0: Resource 14: 0000819000100000..00008190400fffff [200]
[200465.037964] PCI: Claiming 0007:02:08.0: Resource 15: 0000819100000000..00008197efffffff [10220c]
[200465.144367] /pci@500: SUN4V PCI Bus Module
[200465.193852] /pci@500: On NUMA node -1
[200465.239077] /pci@500: PCI IO[824000000000] MEM[820000000000] MEM64[820100000000]
[200465.326517] /pci@500: Unable to request IOMMU resource.
[200465.470981] /pci@500: MSI Queue first[0] num[56] count[512] devino[0x6]
[200465.551214] /pci@500: MSI first[0] num[512] mask[0x3ff] width[32]
[200465.625254] /pci@500: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200465.724174] /pci@500: MSI queues at RA [0000203f52600000]
[200465.789434] PCI: Scanning PBM /pci@500
[200465.834776] pci_sun4v f0352e3c: PCI host bridge to bus 0008:00
[200465.905301] pci_bus 0008:00: root bus resource [io  0x824000000000-0x82400fffffff] (bus address [0x0000-0xfffffff])
[200466.031839] pci_bus 0008:00: root bus resource [mem 0x820000000000-0x82007effffff] (bus address [0x00000000-0x7effffff])
[200466.163518] pci_bus 0008:00: root bus resource [mem 0x820100000000-0x8207ffffffff] (bus address [0x100000000-0x7ffffffff])
[200466.297151] pci_bus 0008:00: root bus resource [bus 00-e2]
[200466.363462] PCI: scan_bus[/pci@500] bus no 0
[200466.415048]   * /pci@500/pci@1
[200466.452176]     create device, devfn: 8, type: pciex
[200466.513054]     class: 0x60400 device name: 0008:00:01.0
[200466.577608]     adding to system ...
[200466.621057] pci 0008:00:01.0: PME# supported from D0 D3hot D3cold
[200466.694748] pci 0008:00:01.0: PME# disabled
[200466.745424] PCI: dev header type: 1
[200466.788676] of_scan_pci_bridge(/pci@500/pci@1)
[200466.842367]     Bridge bus range [1 --> 226]
[200466.894259]     Bridge ranges[fff8383fffb689c0] simba[0]
[200466.959267]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200467.068411]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200467.165551]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200467.275119]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200467.371680]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200467.480067]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200467.574578]     bus name: PCI Bus 0008:01
[200467.622605] PCI: scan_bus[/pci@500/pci@1] bus no 1
[200467.681012]   * /pci@500/pci@1/pci@0
[200467.724264]     create device, devfn: 0, type: pciex
[200467.785507]     class: 0x60400 device name: 0008:01:00.0
[200467.849715]     adding to system ...
[200467.893169] pci 0008:01:00.0: PME# supported from D0 D3hot D3cold
[200467.966858] pci 0008:01:00.0: PME# disabled
[200468.018178] PCI: dev header type: 1
[200468.060583] of_scan_pci_bridge(/pci@500/pci@1/pci@0)
[200468.120584]     Bridge bus range [2 --> 226]
[200468.172351]     Bridge ranges[fff8383fffb67880] simba[0]
[200468.236563]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200468.344947]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200468.441299]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200468.549768]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200468.645534]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200468.753918]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200468.848117]     bus name: PCI Bus 0008:02
[200468.896580] PCI: scan_bus[/pci@500/pci@1/pci@0] bus no 2
[200468.960789]   * /pci@500/pci@1/pci@0/pci@e
[200469.010355]     create device, devfn: 70, type: pciex
[200469.071729]     class: 0x60400 device name: 0008:02:0e.0
[200469.136062]     adding to system ...
[200469.178758] pci 0008:02:0e.0: PME# supported from D0 D3hot D3cold
[200469.252448] pci 0008:02:0e.0: PME# disabled
[200469.303138] PCI: dev header type: 1
[200469.344265] of_scan_pci_bridge(/pci@500/pci@1/pci@0/pci@e)
[200469.410575]     Bridge bus range [3 --> 226]
[200469.462384]     Bridge ranges[fff8383fffb66540] simba[0]
[200469.527569]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200469.633931]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200469.729694]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200469.837879]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200469.933643]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200470.042632]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200470.138396]     bus name: PCI Bus 0008:03
[200470.187151] PCI: scan_bus[/pci@500/pci@1/pci@0/pci@e] bus no 3
[200470.258366] PCI: Claiming 0008:00:01.0: Resource 13: 0000824000000000..0000824007ffffff [101]
[200470.362354] PCI: Claiming 0008:00:01.0: Resource 14: 0000820000100000..00008200400fffff [200]
[200470.465980] PCI: Claiming 0008:00:01.0: Resource 15: 0000820100000000..00008207efffffff [10220c]
[200470.569512] PCI: Claiming 0008:01:00.0: Resource 13: 0000824000000000..0000824007ffffff [101]
[200470.673415] PCI: Claiming 0008:01:00.0: Resource 14: 0000820000100000..00008200400fffff [200]
[200470.777417] PCI: Claiming 0008:01:00.0: Resource 15: 0000820100000000..00008207efffffff [10220c]
[200470.883243] PCI: Claiming 0008:02:0e.0: Resource 13: 0000824000000000..0000824007ffffff [101]
[200470.986748] PCI: Claiming 0008:02:0e.0: Resource 14: 0000820000100000..00008200400fffff [200]
[200471.089966] PCI: Claiming 0008:02:0e.0: Resource 15: 0000820100000000..00008207efffffff [10220c]
[200471.199466] /pci@540: SUN4V PCI Bus Module
[200471.247941] /pci@540: On NUMA node -1
[200471.292816] /pci@540: PCI IO[824100000000] MEM[821000000000] MEM64[821100000000]
[200471.381185] /pci@540: Unable to request IOMMU resource.
[200471.525601] /pci@540: MSI Queue first[0] num[56] count[512] devino[0x6]
[200471.606703] /pci@540: MSI first[0] num[512] mask[0x3ff] width[32]
[200471.680695] /pci@540: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200471.780514] /pci@540: MSI queues at RA [0000103f52200000]
[200471.845965] PCI: Scanning PBM /pci@540
[200471.889798] pci_sun4v f0361c64: PCI host bridge to bus 0009:00
[200471.959650] pci_bus 0009:00: root bus resource [io  0x824100000000-0x82410fffffff] (bus address [0x0000-0xfffffff])
[200472.086177] pci_bus 0009:00: root bus resource [mem 0x821000000000-0x82107effffff] (bus address [0x00000000-0x7effffff])
[200472.219730] pci_bus 0009:00: root bus resource [mem 0x821100000000-0x8217ffffffff] (bus address [0x100000000-0x7ffffffff])
[200472.355139] pci_bus 0009:00: root bus resource [bus 00-e2]
[200472.421450] PCI: scan_bus[/pci@540] bus no 0
[200472.473036]   * /pci@540/pci@1
[200472.510024]     create device, devfn: 8, type: pciex
[200472.569094]     class: 0x60400 device name: 0009:00:01.0
[200472.633303]     adding to system ...
[200472.676751] pci 0009:00:01.0: PME# supported from D0 D3hot D3cold
[200472.750442] pci 0009:00:01.0: PME# disabled
[200472.801120] PCI: dev header type: 1
[200472.842231] of_scan_pci_bridge(/pci@540/pci@1)
[200472.895920]     Bridge bus range [1 --> 226]
[200472.947691]     Bridge ranges[fff8383fffb63100] simba[0]
[200473.012933]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200473.120958]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200473.218027]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200473.327340]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200473.423103]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200473.532324]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200473.628940]     bus name: PCI Bus 0009:01
[200473.676499] PCI: scan_bus[/pci@540/pci@1] bus no 1
[200473.734513]   * /pci@540/pci@1/pci@0
[200473.778001]     create device, devfn: 0, type: pciex
[200473.838073]     class: 0x60400 device name: 0009:01:00.0
[200473.903118]     adding to system ...
[200473.946083] pci 0009:01:00.0: PME# supported from D0 D3hot D3cold
[200474.019772] pci 0009:01:00.0: PME# disabled
[200474.071026] PCI: dev header type: 1
[200474.113546] of_scan_pci_bridge(/pci@540/pci@1/pci@0)
[200474.173547]     Bridge bus range [2 --> 226]
[200474.225317]     Bridge ranges[fff8383fffb61fc0] simba[0]
[200474.289527]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200474.399499]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200474.495261]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200474.603985]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200474.699749]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200474.808132]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200474.903894]     bus name: PCI Bus 0009:02
[200474.952322] PCI: scan_bus[/pci@540/pci@1/pci@0] bus no 2
[200475.016531]   * /pci@540/pci@1/pci@0/pci@e
[200475.066094]     create device, devfn: 70, type: pciex
[200475.127217]     class: 0x60400 device name: 0009:02:0e.0
[200475.192109]     adding to system ...
[200475.235615] pci 0009:02:0e.0: PME# supported from D0 D3hot D3cold
[200475.309378] pci 0009:02:0e.0: PME# disabled
[200475.360071] PCI: dev header type: 1
[200475.401755] of_scan_pci_bridge(/pci@540/pci@1/pci@0/pci@e)
[200475.468069]     Bridge bus range [3 --> 226]
[200475.519880]     Bridge ranges[fff8383fffb60c80] simba[0]
[200475.584181]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200475.693694]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200475.789456]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200475.897454]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200475.993216]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200476.101687]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200476.197504]     bus name: PCI Bus 0009:03
[200476.245934] PCI: scan_bus[/pci@540/pci@1/pci@0/pci@e] bus no 3
[200476.317522] PCI: Claiming 0009:00:01.0: Resource 13: 0000824100000000..0000824107ffffff [101]
[200476.420071] PCI: Claiming 0009:00:01.0: Resource 14: 0000821000100000..00008210400fffff [200]
[200476.524736] PCI: Claiming 0009:00:01.0: Resource 15: 0000821100000000..00008217efffffff [10220c]
[200476.631512] PCI: Claiming 0009:01:00.0: Resource 13: 0000824100000000..0000824107ffffff [101]
[200476.735041] PCI: Claiming 0009:01:00.0: Resource 14: 0000821000100000..00008210400fffff [200]
[200476.838739] PCI: Claiming 0009:01:00.0: Resource 15: 0000821100000000..00008217efffffff [10220c]
[200476.945019] PCI: Claiming 0009:02:0e.0: Resource 13: 0000824100000000..0000824107ffffff [101]
[200477.048145] PCI: Claiming 0009:02:0e.0: Resource 14: 0000821000100000..00008210400fffff [200]
[200477.151271] PCI: Claiming 0009:02:0e.0: Resource 15: 0000821100000000..00008217efffffff [10220c]
[200477.258180] /pci@580: SUN4V PCI Bus Module
[200477.307665] /pci@580: On NUMA node -1
[200477.352629] /pci@580: PCI IO[82c000000000] MEM[828000000000] MEM64[828100000000]
[200477.440069] /pci@580: Unable to request IOMMU resource.
[200477.584484] /pci@580: MSI Queue first[0] num[56] count[512] devino[0x6]
[200477.664478] /pci@580: MSI first[0] num[512] mask[0x3ff] width[32]
[200477.738154] /pci@580: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200477.837810] /pci@580: MSI queues at RA [0000103f52400000]
[200477.903202] PCI: Scanning PBM /pci@580
[200477.949188] pci_sun4v f0370a8c: PCI host bridge to bus 000a:00
[200478.019910] pci_bus 000a:00: root bus resource [io  0x82c000000000-0x82c00fffffff] (bus address [0x0000-0xfffffff])
[200478.146178] pci_bus 000a:00: root bus resource [mem 0x828000000000-0x82807effffff] (bus address [0x00000000-0x7effffff])
[200478.278543] pci_bus 000a:00: root bus resource [mem 0x828100000000-0x8287ffffffff] (bus address [0x100000000-0x7ffffffff])
[200478.412815] pci_bus 000a:00: root bus resource [bus 00-e2]
[200478.479126] PCI: scan_bus[/pci@580] bus no 0
[200478.530711]   * /pci@580/pci@1
[200478.567834]     create device, devfn: 8, type: pciex
[200478.627915]     class: 0x60400 device name: 000a:00:01.0
[200478.692124]     adding to system ...
[200478.735574] pci 000a:00:01.0: PME# supported from D0 D3hot D3cold
[200478.809263] pci 000a:00:01.0: PME# disabled
[200478.859939] PCI: dev header type: 1
[200478.901049] of_scan_pci_bridge(/pci@580/pci@1)
[200478.954739]     Bridge bus range [1 --> 226]
[200479.006510]     Bridge ranges[fff8383fffb5d840] simba[0]
[200479.070800]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200479.177961]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200479.274502]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200479.380497]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200479.476491]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200479.584088]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200479.679335]     bus name: PCI Bus 000a:01
[200479.728010] PCI: scan_bus[/pci@580/pci@1] bus no 1
[200479.785906]   * /pci@580/pci@1/pci@0
[200479.829157]     create device, devfn: 0, type: pciex
[200479.888616]     class: 0x60400 device name: 000a:01:00.0
[200479.953152]     adding to system ...
[200479.995129] pci 000a:01:00.0: PME# supported from D0 D3hot D3cold
[200480.070138] pci 000a:01:00.0: PME# disabled
[200480.119986] PCI: dev header type: 1
[200480.162108] of_scan_pci_bridge(/pci@580/pci@1/pci@0)
[200480.222594]     Bridge bus range [2 --> 226]
[200480.275416]     Bridge ranges[fff8383fffb5c700] simba[0]
[200480.339762]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200480.448602]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200480.544763]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200480.653147]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200480.748911]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200480.857294]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200480.953462]     bus name: PCI Bus 000a:02
[200481.001890] PCI: scan_bus[/pci@580/pci@1/pci@0] bus no 2
[200481.065137]   * /pci@580/pci@1/pci@0/pci@a
[200481.114086]     create device, devfn: 50, type: pciex
[200481.175442]     class: 0x60400 device name: 000a:02:0a.0
[200481.239649]     adding to system ...
[200481.283156] pci 000a:02:0a.0: PME# supported from D0 D3hot D3cold
[200481.356846] pci 000a:02:0a.0: PME# disabled
[200481.407534] PCI: dev header type: 1
[200481.449760] of_scan_pci_bridge(/pci@580/pci@1/pci@0/pci@a)
[200481.516391]     Bridge bus range [3 --> 226]
[200481.568204]     Bridge ranges[fff8383fffb5b3c0] simba[0]
[200481.631949]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200481.740334]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200481.836096]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200481.944208]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200482.039971]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200482.149165]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200482.244928]     bus name: PCI Bus 000a:03
[200482.293871] PCI: scan_bus[/pci@580/pci@1/pci@0/pci@a] bus no 3
[200482.364946] PCI: Claiming 000a:00:01.0: Resource 13: 000082c000000000..000082c007ffffff [101]
[200482.468426] PCI: Claiming 000a:00:01.0: Resource 14: 0000828000100000..00008280400fffff [200]
[200482.571552] PCI: Claiming 000a:00:01.0: Resource 15: 0000828100000000..00008287efffffff [10220c]
[200482.675390] PCI: Claiming 000a:01:00.0: Resource 13: 000082c000000000..000082c007ffffff [101]
[200482.778739] PCI: Claiming 000a:01:00.0: Resource 14: 0000828000100000..00008280400fffff [200]
[200482.882416] PCI: Claiming 000a:01:00.0: Resource 15: 0000828100000000..00008287efffffff [10220c]
[200482.988696] PCI: Claiming 000a:02:0a.0: Resource 13: 000082c000000000..000082c007ffffff [101]
[200483.091821] PCI: Claiming 000a:02:0a.0: Resource 14: 0000828000100000..00008280400fffff [200]
[200483.195830] PCI: Claiming 000a:02:0a.0: Resource 15: 0000828100000000..00008287efffffff [10220c]
[200483.302227] /pci@5c0: SUN4V PCI Bus Module
[200483.351976] /pci@5c0: On NUMA node -1
[200483.396471] /pci@5c0: PCI IO[82c100000000] MEM[829000000000] MEM64[829100000000]
[200483.484448] /pci@5c0: Unable to request IOMMU resource.
[200483.628868] /pci@5c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[200483.709641] /pci@5c0: MSI first[0] num[512] mask[0x3ff] width[32]
[200483.783316] /pci@5c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200483.883234] /pci@5c0: MSI queues at RA [0000083f52000000]
[200483.948493] PCI: Scanning PBM /pci@5c0
[200483.995085] pci_sun4v f037f8b4: PCI host bridge to bus 000b:00
[200484.067886] pci_bus 000b:00: root bus resource [io  0x82c100000000-0x82c10fffffff] (bus address [0x0000-0xfffffff])
[200484.193513] pci_bus 000b:00: root bus resource [mem 0x829000000000-0x82907effffff] (bus address [0x00000000-0x7effffff])
[200484.326623] pci_bus 000b:00: root bus resource [mem 0x829100000000-0x8297ffffffff] (bus address [0x100000000-0x7ffffffff])
[200484.460571] pci_bus 000b:00: root bus resource [bus 00-72]
[200484.526090] PCI: scan_bus[/pci@5c0] bus no 0
[200484.577676]   * /pci@5c0/pci@1
[200484.613590]     create device, devfn: 8, type: pciex
[200484.671208]     class: 0x60400 device name: 000b:00:01.0
[200484.735888]     adding to system ...
[200484.779337] pci 000b:00:01.0: PME# supported from D0 D3hot D3cold
[200484.853832] pci 000b:00:01.0: PME# disabled
[200484.905005] PCI: dev header type: 1
[200484.946876] of_scan_pci_bridge(/pci@5c0/pci@1)
[200485.000566]     Bridge bus range [1 --> 114]
[200485.052332]     Bridge ranges[fff8383fffb57f80] simba[0]
[200485.117720]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04000000]
[200485.223199]       Using flags[00000101] start[0000000000000000] size[0000000004000000]
[200485.319589]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20000000]
[200485.429013]       Using flags[00000200] start[0000000000100000] size[0000000020000000]
[200485.524813]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:80000000]
[200485.635428]       Using flags[0010220c] start[0000000100000000] size[0000000380000000]
[200485.731261]     bus name: PCI Bus 000b:01
[200485.780341] PCI: scan_bus[/pci@5c0/pci@1] bus no 1
[200485.839309]   * /pci@5c0/pci@1/pci@0
[200485.882564]     create device, devfn: 0, type: pciex
[200485.942635]     class: 0x60400 device name: 000b:01:00.0
[200486.006842]     adding to system ...
[200486.050294] pci 000b:01:00.0: PME# supported from D0 D3hot D3cold
[200486.123983] pci 000b:01:00.0: PME# disabled
[200486.174705] PCI: dev header type: 1
[200486.216828] of_scan_pci_bridge(/pci@5c0/pci@1/pci@0)
[200486.276827]     Bridge bus range [2 --> 114]
[200486.328594]     Bridge ranges[fff8383fffb56d40] simba[0]
[200486.392805]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04000000]
[200486.499972]       Using flags[00000101] start[0000000000000000] size[0000000004000000]
[200486.594884]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20000000]
[200486.703435]       Using flags[00000200] start[0000000000100000] size[0000000020000000]
[200486.799199]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:80000000]
[200486.905074]       Using flags[0010220c] start[0000000100000000] size[0000000380000000]
[200487.000837]     bus name: PCI Bus 000b:02
[200487.049265] PCI: scan_bus[/pci@5c0/pci@1/pci@0] bus no 2
[200487.113473]   * /pci@5c0/pci@1/pci@0/pci@8
[200487.163134]     create device, devfn: 40, type: pciex
[200487.224433]     class: 0x60400 device name: 000b:02:08.0
[200487.288640]     adding to system ...
[200487.332169] pci 000b:02:08.0: PME# supported from D0 D3hot D3cold
[200487.406238] pci 000b:02:08.0: PME# disabled
[200487.456924] PCI: dev header type: 1
[200487.498036] of_scan_pci_bridge(/pci@5c0/pci@1/pci@0/pci@8)
[200487.564883]     Bridge bus range [3 --> 114]
[200487.616690]     Bridge ranges[fff8383fffaad780] simba[0]
[200487.680901]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04000000]
[200487.789284]       Using flags[00000101] start[0000000000000000] size[0000000004000000]
[200487.885047]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20000000]
[200487.993431]       Using flags[00000200] start[0000000000100000] size[0000000020000000]
[200488.089194]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:78000000]
[200488.197379]       Using flags[0010220c] start[0000000100000000] size[0000000378000000]
[200488.293142]     bus name: PCI Bus 000b:03
[200488.341573] PCI: scan_bus[/pci@5c0/pci@1/pci@0/pci@8] bus no 3
[200488.413864] PCI: Claiming 000b:00:01.0: Resource 13: 000082c100000000..000082c103ffffff [101]
[200488.517753] PCI: Claiming 000b:00:01.0: Resource 14: 0000829000100000..00008290200fffff [200]
[200488.618391] PCI: Claiming 000b:00:01.0: Resource 15: 0000829100000000..000082947fffffff [10220c]
[200488.724672] PCI: Claiming 000b:01:00.0: Resource 13: 000082c100000000..000082c103ffffff [101]
[200488.829758] PCI: Claiming 000b:01:00.0: Resource 14: 0000829000100000..00008290200fffff [200]
[200488.933921] PCI: Claiming 000b:01:00.0: Resource 15: 0000829100000000..000082947fffffff [10220c]
[200489.040202] PCI: Claiming 000b:02:08.0: Resource 13: 000082c100000000..000082c103ffffff [101]
[200489.144861] PCI: Claiming 000b:02:08.0: Resource 14: 0000829000100000..00008290200fffff [200]
[200489.248674] PCI: Claiming 000b:02:08.0: Resource 15: 0000829100000000..0000829477ffffff [10220c]
[200489.355575] /pci@600: SUN4V PCI Bus Module
[200489.405059] /pci@600: On NUMA node -1
[200489.449283] /pci@600: PCI IO[834000000000] MEM[830000000000] MEM64[830100000000]
[200489.535855] /pci@600: Unable to request IOMMU resource.
[200489.680491] /pci@600: MSI Queue first[0] num[56] count[512] devino[0x6]
[200489.760484] /pci@600: MSI first[0] num[512] mask[0x3ff] width[32]
[200489.834158] /pci@600: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200489.933078] /pci@600: MSI queues at RA [0000083f52200000]
[200489.998514] PCI: Scanning PBM /pci@600
[200490.043945] pci_sun4v f038e6dc: PCI host bridge to bus 000c:00
[200490.114685] pci_bus 000c:00: root bus resource [io  0x834000000000-0x83400fffffff] (bus address [0x0000-0xfffffff])
[200490.240959] pci_bus 000c:00: root bus resource [mem 0x830000000000-0x83007effffff] (bus address [0x00000000-0x7effffff])
[200490.372485] pci_bus 000c:00: root bus resource [mem 0x830100000000-0x8307ffffffff] (bus address [0x100000000-0x7ffffffff])
[200490.506175] pci_bus 000c:00: root bus resource [bus 00-e2]
[200490.571237] PCI: scan_bus[/pci@600] bus no 0
[200490.622822]   * /pci@600/pci@1
[200490.660406]     create device, devfn: 8, type: pciex
[200490.720507]     class: 0x60400 device name: 000c:00:01.0
[200490.784715]     adding to system ...
[200490.828167] pci 000c:00:01.0: PME# supported from D0 D3hot D3cold
[200490.902481] pci 000c:00:01.0: PME# disabled
[200490.953149] PCI: dev header type: 1
[200490.994661] of_scan_pci_bridge(/pci@600/pci@1)
[200491.048447]     Bridge bus range [1 --> 226]
[200491.100214]     Bridge ranges[fff8383fff9aa340] simba[0]
[200491.164426]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200491.272811]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200491.368575]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200491.476959]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200491.572722]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200491.682545]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200491.778835]     bus name: PCI Bus 000c:01
[200491.827265] PCI: scan_bus[/pci@600/pci@1] bus no 1
[200491.886208]   * /pci@600/pci@1/pci@0
[200491.929462]     create device, devfn: 0, type: pciex
[200491.989535]     class: 0x60400 device name: 000c:01:00.0
[200492.053743]     adding to system ...
[200492.097898] pci 000c:01:00.0: PME# supported from D0 D3hot D3cold
[200492.170593] pci 000c:01:00.0: PME# disabled
[200492.221816] PCI: dev header type: 1
[200492.263938] of_scan_pci_bridge(/pci@600/pci@1/pci@0)
[200492.325733]     Bridge bus range [2 --> 226]
[200492.377971]     Bridge ranges[fff8383fff9a9200] simba[0]
[200492.441692]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200492.550480]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200492.643801]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200492.754311]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200492.850006]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200492.958389]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200493.052006]     bus name: PCI Bus 000c:02
[200493.100435] PCI: scan_bus[/pci@600/pci@1/pci@0] bus no 2
[200493.164902]   * /pci@600/pci@1/pci@0/pci@8
[200493.214466]     create device, devfn: 40, type: pciex
[200493.275127]     class: 0x60400 device name: 000c:02:08.0
[200493.339334]     adding to system ...
[200493.382840] pci 000c:02:08.0: PME# supported from D0 D3hot D3cold
[200493.456530] pci 000c:02:08.0: PME# disabled
[200493.507222] PCI: dev header type: 1
[200493.548350] of_scan_pci_bridge(/pci@600/pci@1/pci@0/pci@8)
[200493.614661]     Bridge bus range [3 --> 226]
[200493.666470]     Bridge ranges[fff8383fff9a7ec0] simba[0]
[200493.730680]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200493.839346]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200493.933412]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200494.041796]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200494.138988]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200494.247915]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200494.343708]     bus name: PCI Bus 000c:03
[200494.392139] PCI: scan_bus[/pci@600/pci@1/pci@0/pci@8] bus no 3
[200494.462668] PCI: Claiming 000c:00:01.0: Resource 13: 0000834000000000..0000834007ffffff [101]
[200494.566079] PCI: Claiming 000c:00:01.0: Resource 14: 0000830000100000..00008300400fffff [200]
[200494.669461] PCI: Claiming 000c:00:01.0: Resource 15: 0000830100000000..00008307efffffff [10220c]
[200494.775743] PCI: Claiming 000c:01:00.0: Resource 13: 0000834000000000..0000834007ffffff [101]
[200494.880313] PCI: Claiming 000c:01:00.0: Resource 14: 0000830000100000..00008300400fffff [200]
[200494.981775] PCI: Claiming 000c:01:00.0: Resource 15: 0000830100000000..00008307efffffff [10220c]
[200495.088953] PCI: Claiming 000c:02:08.0: Resource 13: 0000834000000000..0000834007ffffff [101]
[200495.192414] PCI: Claiming 000c:02:08.0: Resource 14: 0000830000100000..00008300400fffff [200]
[200495.294610] PCI: Claiming 000c:02:08.0: Resource 15: 0000830100000000..00008307efffffff [10220c]
[200495.401015] /pci@640: SUN4V PCI Bus Module
[200495.450709] /pci@640: On NUMA node -1
[200495.494932] /pci@640: PCI IO[834100000000] MEM[831000000000] MEM64[831100000000]
[200495.582487] /pci@640: Unable to request IOMMU resource.
[200495.724218] /pci@640: MSI Queue first[0] num[56] count[512] devino[0x6]
[200495.804853] /pci@640: MSI first[0] num[512] mask[0x3ff] width[32]
[200495.878527] /pci@640: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200495.975868] /pci@640: MSI queues at RA [0000083f52400000]
[200496.041525] PCI: Scanning PBM /pci@640
[200496.086870] pci_sun4v f039d504: PCI host bridge to bus 000d:00
[200496.157394] pci_bus 000d:00: root bus resource [io  0x834100000000-0x83410fffffff] (bus address [0x0000-0xfffffff])
[200496.286036] pci_bus 000d:00: root bus resource [mem 0x831000000000-0x83107effffff] (bus address [0x00000000-0x7effffff])
[200496.416034] pci_bus 000d:00: root bus resource [mem 0x831100000000-0x8317ffffffff] (bus address [0x100000000-0x7ffffffff])
[200496.550190] pci_bus 000d:00: root bus resource [bus 00-e2]
[200496.616653] PCI: scan_bus[/pci@640] bus no 0
[200496.668586]   * /pci@640/pci@1
[200496.705576]     create device, devfn: 8, type: pciex
[200496.765140]     class: 0x60400 device name: 000d:00:01.0
[200496.830252]     adding to system ...
[200496.874054] pci 000d:00:01.0: PME# supported from D0 D3hot D3cold
[200496.947745] pci 000d:00:01.0: PME# disabled
[200496.998421] PCI: dev header type: 1
[200497.039869] of_scan_pci_bridge(/pci@640/pci@1)
[200497.093793]     Bridge bus range [1 --> 226]
[200497.145959]     Bridge ranges[fff8383fff9a4a80] simba[0]
[200497.210518]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200497.319985]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200497.417254]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200497.524999]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200497.620765]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200497.729020]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200497.824782]     bus name: PCI Bus 000d:01
[200497.873780] PCI: scan_bus[/pci@640/pci@1] bus no 1
[200497.932213]   * /pci@640/pci@1/pci@0
[200497.975466]     create device, devfn: 0, type: pciex
[200498.035538]     class: 0x60400 device name: 000d:01:00.0
[200498.100619]     adding to system ...
[200498.144541] pci 000d:01:00.0: PME# supported from D0 D3hot D3cold
[200498.218232] pci 000d:01:00.0: PME# disabled
[200498.268960] PCI: dev header type: 1
[200498.311081] of_scan_pci_bridge(/pci@640/pci@1/pci@0)
[200498.371081]     Bridge bus range [2 --> 226]
[200498.422849]     Bridge ranges[fff8383fff9a3940] simba[0]
[200498.486050]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200498.594587]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200498.690349]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200498.797579]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200498.893586]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200499.000456]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200499.096219]     bus name: PCI Bus 000d:02
[200499.144647] PCI: scan_bus[/pci@640/pci@1/pci@0] bus no 2
[200499.208947]   * /pci@640/pci@1/pci@0/pci@8
[200499.259021]     create device, devfn: 40, type: pciex
[200499.320144]     class: 0x60400 device name: 000d:02:08.0
[200499.384843]     adding to system ...
[200499.428350] pci 000d:02:08.0: PME# supported from D0 D3hot D3cold
[200499.502039] pci 000d:02:08.0: PME# disabled
[200499.553395] PCI: dev header type: 1
[200499.594523] of_scan_pci_bridge(/pci@640/pci@1/pci@0/pci@8)
[200499.660835]     Bridge bus range [3 --> 226]
[200499.712646]     Bridge ranges[fff8383fff9a2600] simba[0]
[200499.775488]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200499.883872]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200499.977324]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200500.085707]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200500.181470]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200500.289854]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200500.385618]     bus name: PCI Bus 000d:03
[200500.433077] PCI: scan_bus[/pci@640/pci@1/pci@0/pci@8] bus no 3
[200500.504964]   * /pci@640/pci@1/pci@0/pci@8/SUNW,emlxs@0
[200500.568201]     create device, devfn: 0, type: scsi-fcp
[200500.631859]     class: 0xc0400 device name: 000d:03:00.0
[200500.694865]     parse addresses (80 bytes) @ fff8383fff9a1240
[200500.764332]   start: 831100000000, end: 831100001fff, i: 10
[200500.831799]   start: 831100004000, end: 831100007fff, i: 18
[200500.899914]   start: 834100000000, end: 8341000000ff, i: 20
[200500.967276]   start: 831000100000, end: 83100013ffff, i: 30
[200501.034838]     adding to system ...
[200501.076925] pci 000d:03:00.0: reg 0x10 [mem 0x831100000000-0x831100001fff 64bit] + pref
[200501.174211] pci 000d:03:00.0: reg 0x18 [mem 0x831100004000-0x831100007fff 64bit] + pref
[200501.271292] PCI: dev header type: 0
[200501.314406]   * /pci@640/pci@1/pci@0/pci@8/SUNW,emlxs@0,1
[200501.379748]     create device, devfn: 1, type: scsi-fcp
[200501.443053]     class: 0xc0400 device name: 000d:03:00.1
[200501.507259]     parse addresses (80 bytes) @ fff8383fff99e240
[200501.576726]   start: 831100002000, end: 831100003fff, i: 10
[200501.644699]   start: 831100008000, end: 83110000bfff, i: 18
[200501.712547]   start: 834100000100, end: 8341000001ff, i: 20
[200501.778692]   start: 831000140000, end: 83100017ffff, i: 30
[200501.846053]     adding to system ...
[200501.890452] pci 000d:03:00.1: reg 0x10 [mem 0x831100002000-0x831100003fff 64bit] + pref
[200501.987269] pci 000d:03:00.1: reg 0x18 [mem 0x831100008000-0x83110000bfff 64bit] + pref
[200502.084153] PCI: dev header type: 0
[200502.126289] PCI: Claiming 000d:00:01.0: Resource 13: 0000834100000000..0000834107ffffff [101]
[200502.229415] PCI: Claiming 000d:00:01.0: Resource 14: 0000831000100000..00008310400fffff [200]
[200502.332542] PCI: Claiming 000d:00:01.0: Resource 15: 0000831100000000..00008317efffffff [10220c]
[200502.440070] PCI: Claiming 000d:01:00.0: Resource 13: 0000834100000000..0000834107ffffff [101]
[200502.544452] PCI: Claiming 000d:01:00.0: Resource 14: 0000831000100000..00008310400fffff [200]
[200502.648373] PCI: Claiming 000d:01:00.0: Resource 15: 0000831100000000..00008317efffffff [10220c]
[200502.755557] PCI: Claiming 000d:02:08.0: Resource 13: 0000834100000000..0000834107ffffff [101]
[200502.858944] PCI: Claiming 000d:02:08.0: Resource 14: 0000831000100000..00008310400fffff [200]
[200502.960830] PCI: Claiming 000d:02:08.0: Resource 15: 0000831100000000..00008317efffffff [10220c]
[200503.067816] PCI: Claiming 000d:03:00.0: Resource 0: 0000831100000000..0000831100001fff [102204]
[200503.173047] PCI: Claiming 000d:03:00.0: Resource 2: 0000831100004000..0000831100007fff [102204]
[200503.278276] PCI: Claiming 000d:03:00.0: Resource 4: 0000834100000000..00008341000000ff [101]
[200503.380311] PCI: Claiming 000d:03:00.0: Resource 6: 0000831000100000..000083100013ffff [4c200]
[200503.483674] PCI: Claiming 000d:03:00.1: Resource 0: 0000831100002000..0000831100003fff [102204]
[200503.588200] PCI: Claiming 000d:03:00.1: Resource 2: 0000831100008000..000083110000bfff [102204]
[200503.693429] PCI: Claiming 000d:03:00.1: Resource 4: 0000834100000100..00008341000001ff [101]
[200503.796903] PCI: Claiming 000d:03:00.1: Resource 6: 0000831000140000..000083100017ffff [4c200]
[200503.900719] /pci@680: SUN4V PCI Bus Module
[200503.950220] /pci@680: On NUMA node -1
[200503.994443] /pci@680: PCI IO[83c000000000] MEM[838000000000] MEM64[838100000000]
[200504.081884] /pci@680: Unable to request IOMMU resource.
[200504.226082] /pci@680: MSI Queue first[0] num[56] count[512] devino[0x6]
[200504.306076] /pci@680: MSI first[0] num[512] mask[0x3ff] width[32]
[200504.379027] /pci@680: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200504.477945] /pci@680: MSI queues at RA [0000303f52600000]
[200504.543975] PCI: Scanning PBM /pci@680
[200504.587728] pci_sun4v f03ac32c: PCI host bridge to bus 000e:00
[200504.658251] pci_bus 000e:00: root bus resource [io  0x83c000000000-0x83c00fffffff] (bus address [0x0000-0xfffffff])
[200504.785701] pci_bus 000e:00: root bus resource [mem 0x838000000000-0x83807effffff] (bus address [0x00000000-0x7effffff])
[200504.917878] pci_bus 000e:00: root bus resource [mem 0x838100000000-0x8387ffffffff] (bus address [0x100000000-0x7ffffffff])
[200505.052528] pci_bus 000e:00: root bus resource [bus 00-e2]
[200505.117694] PCI: scan_bus[/pci@680] bus no 0
[200505.169280]   * /pci@680/pci@1
[200505.206429]     create device, devfn: 8, type: pciex
[200505.267315]     class: 0x60400 device name: 000e:00:01.0
[200505.331523]     adding to system ...
[200505.375217] pci 000e:00:01.0: PME# supported from D0 D3hot D3cold
[200505.448909] pci 000e:00:01.0: PME# disabled
[200505.500700] PCI: dev header type: 1
[200505.542271] of_scan_pci_bridge(/pci@680/pci@1)
[200505.596211]     Bridge bus range [1 --> 226]
[200505.647981]     Bridge ranges[fff8383fff9991c0] simba[0]
[200505.712378]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200505.821794]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200505.917558]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200506.027542]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200506.123317]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200506.231660]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200506.327427]     bus name: PCI Bus 000e:01
[200506.375857] PCI: scan_bus[/pci@680/pci@1] bus no 1
[200506.433754]   * /pci@680/pci@1/pci@0
[200506.477008]     create device, devfn: 0, type: pciex
[200506.537079]     class: 0x60400 device name: 000e:01:00.0
[200506.601287]     adding to system ...
[200506.644743] pci 000e:01:00.0: PME# supported from D0 D3hot D3cold
[200506.718435] pci 000e:01:00.0: PME# disabled
[200506.769156] PCI: dev header type: 1
[200506.811277] of_scan_pci_bridge(/pci@680/pci@1/pci@0)
[200506.870230]     Bridge bus range [2 --> 226]
[200506.921998]     Bridge ranges[fff8383fff998080] simba[0]
[200506.986210]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200507.095211]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200507.190975]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200507.298470]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200507.393303]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200507.501687]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200507.597517]     bus name: PCI Bus 000e:02
[200507.645945] PCI: scan_bus[/pci@680/pci@1/pci@0] bus no 2
[200507.709775]   * /pci@680/pci@1/pci@0/pci@4
[200507.759342]     create device, devfn: 20, type: pciex
[200507.820523]     class: 0x60400 device name: 000e:02:04.0
[200507.885135]     adding to system ...
[200507.928641] pci 000e:02:04.0: PME# supported from D0 D3hot D3cold
[200508.002331] pci 000e:02:04.0: PME# disabled
[200508.051996] PCI: dev header type: 1
[200508.093481] of_scan_pci_bridge(/pci@680/pci@1/pci@0/pci@4)
[200508.159946]     Bridge bus range [3 --> 226]
[200508.211755]     Bridge ranges[fff8383fff996d40] simba[0]
[200508.275965]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200508.384752]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200508.481028]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200508.590076]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200508.685844]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200508.794344]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200508.889519]     bus name: PCI Bus 000e:03
[200508.938461] PCI: scan_bus[/pci@680/pci@1/pci@0/pci@4] bus no 3
[200509.008991] PCI: Claiming 000e:00:01.0: Resource 13: 000083c000000000..000083c007ffffff [101]
[200509.113100] PCI: Claiming 000e:00:01.0: Resource 14: 0000838000100000..00008380400fffff [200]
[200509.216344] PCI: Claiming 000e:00:01.0: Resource 15: 0000838100000000..00008387efffffff [10220c]
[200509.323109] PCI: Claiming 000e:01:00.0: Resource 13: 000083c000000000..000083c007ffffff [101]
[200509.427334] PCI: Claiming 000e:01:00.0: Resource 14: 0000838000100000..00008380400fffff [200]
[200509.531393] PCI: Claiming 000e:01:00.0: Resource 15: 0000838100000000..00008387efffffff [10220c]
[200509.637676] PCI: Claiming 000e:02:04.0: Resource 13: 000083c000000000..000083c007ffffff [101]
[200509.741769] PCI: Claiming 000e:02:04.0: Resource 14: 0000838000100000..00008380400fffff [200]
[200509.844901] PCI: Claiming 000e:02:04.0: Resource 15: 0000838100000000..00008387efffffff [10220c]
[200509.952470] /pci@6c0: SUN4V PCI Bus Module
[200510.002089] /pci@6c0: On NUMA node -1
[200510.046314] /pci@6c0: PCI IO[83c100000000] MEM[839000000000] MEM64[839100000000]
[200510.133755] /pci@6c0: Unable to request IOMMU resource.
[200510.214205] /pci@6c0: Imported 13 TSB entries from OBP
[200510.339723] /pci@6c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[200510.418886] /pci@6c0: MSI first[0] num[512] mask[0x3ff] width[32]
[200510.492562] /pci@6c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200510.591481] /pci@6c0: MSI queues at RA [0000303f51800000]
[200510.656334] PCI: Scanning PBM /pci@6c0
[200510.701671] pci_sun4v f03bb154: PCI host bridge to bus 000f:00
[200510.772194] pci_bus 000f:00: root bus resource [io  0x83c100000000-0x83c10fffffff] (bus address [0x0000-0xfffffff])
[200510.898464] pci_bus 000f:00: root bus resource [mem 0x839000000000-0x83907effffff] (bus address [0x00000000-0x7effffff])
[200511.029993] pci_bus 000f:00: root bus resource [mem 0x839100000000-0x8397ffffffff] (bus address [0x100000000-0x7ffffffff])
[200511.163937] pci_bus 000f:00: root bus resource [bus 00-78]
[200511.230505] PCI: scan_bus[/pci@6c0] bus no 0
[200511.282092]   * /pci@6c0/pci@1
[200511.319068]     create device, devfn: 8, type: pciex
[200511.379262]     class: 0x60400 device name: 000f:00:01.0
[200511.443471]     adding to system ...
[200511.486921] pci 000f:00:01.0: PME# supported from D0 D3hot D3cold
[200511.559605] pci 000f:00:01.0: PME# disabled
[200511.610359] PCI: dev header type: 1
[200511.651470] of_scan_pci_bridge(/pci@6c0/pci@1)
[200511.705528]     Bridge bus range [1 --> 120]
[200511.757295]     Bridge ranges[fff8383fff993900] simba[0]
[200511.821508]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04002000]
[200511.929895]       Using flags[00000101] start[0000000000000000] size[0000000004002000]
[200512.025658]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:22000000]
[200512.134044]       Using flags[00000200] start[0000000000100000] size[0000000022000000]
[200512.229851]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:b0000000]
[200512.338235]       Using flags[0010220c] start[0000000100000000] size[00000003b0000000]
[200512.433999]     bus name: PCI Bus 000f:01
[200512.482429] PCI: scan_bus[/pci@6c0/pci@1] bus no 1
[200512.540325]   * /pci@6c0/pci@1/pci@0
[200512.583579]     create device, devfn: 0, type: pciex
[200512.643651]     class: 0x60400 device name: 000f:01:00.0
[200512.707923]     adding to system ...
[200512.751377] pci 000f:01:00.0: PME# supported from D0 D3hot D3cold
[200512.827170] pci 000f:01:00.0: PME# disabled
[200512.878411] PCI: dev header type: 1
[200512.921069] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0)
[200512.982469]     Bridge bus range [2 --> 120]
[200513.034851]     Bridge ranges[fff8383fff9926c0] simba[0]
[200513.098303]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04002000]
[200513.206686]       Using flags[00000101] start[0000000000000000] size[0000000004002000]
[200513.303659]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:22000000]
[200513.413599]       Using flags[00000200] start[0000000000100000] size[0000000022000000]
[200513.509362]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:b0000000]
[200513.617745]       Using flags[0010220c] start[0000000100000000] size[00000003b0000000]
[200513.715897]     bus name: PCI Bus 000f:02
[200513.764329] PCI: scan_bus[/pci@6c0/pci@1/pci@0] bus no 2
[200513.829949]   * /pci@6c0/pci@1/pci@0/pci@4
[200513.877703]     create device, devfn: 20, type: pciex
[200513.937801]     class: 0x60400 device name: 000f:02:04.0
[200514.003032]     adding to system ...
[200514.046536] pci 000f:02:04.0: PME# supported from D0 D3hot D3cold
[200514.119309] pci 000f:02:04.0: PME# disabled
[200514.169997] PCI: dev header type: 1
[200514.211851] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0/pci@4)
[200514.278651]     Bridge bus range [3 --> 114]
[200514.330458]     Bridge ranges[fff8383fff991380] simba[0]
[200514.394667]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04000000]
[200514.503051]       Using flags[00000101] start[0000000000000000] size[0000000004000000]
[200514.598815]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20000000]
[200514.707199]       Using flags[00000200] start[0000000000100000] size[0000000020000000]
[200514.803395]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:78000000]
[200514.911780]       Using flags[0010220c] start[0000000100000000] size[0000000378000000]
[200515.008158]     bus name: PCI Bus 000f:03
[200515.056587] PCI: scan_bus[/pci@6c0/pci@1/pci@0/pci@4] bus no 3
[200515.127106]   * /pci@6c0/pci@1/pci@0/pci@c
[200515.176046]     create device, devfn: 60, type: pciex
[200515.237974]     class: 0x60400 device name: 000f:02:0c.0
[200515.302182]     adding to system ...
[200515.345686] pci 000f:02:0c.0: PME# supported from D0 D3hot D3cold
[200515.419672] pci 000f:02:0c.0: PME# disabled
[200515.470357] PCI: dev header type: 1
[200515.511469] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0/pci@c)
[200515.577916]     Bridge bus range [115 --> 120]
[200515.632326]     Bridge ranges[fff8383fff98ffc0] simba[0]
[200515.696535]     RAW Range[81000000:00000000:04000000:81000000:00000000:04000000:00000000:00002000]
[200515.805357]       Using flags[00000101] start[0000000004000000] size[0000000000002000]
[200515.901513]     RAW Range[82000000:00000000:20100000:82000000:00000000:20100000:00000000:02000000]
[200516.010137]       Using flags[00000200] start[0000000020100000] size[0000000002000000]
[200516.106032]     RAW Range[c3000000:00000004:80000000:c3000000:00000004:80000000:00000000:30000000]
[200516.214114]       Using flags[0010220c] start[0000000480000000] size[0000000030000000]
[200516.309876]     bus name: PCI Bus 000f:73
[200516.357555] PCI: scan_bus[/pci@6c0/pci@1/pci@0/pci@c] bus no 115
[200516.431927]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0
[200516.487802]     create device, devfn: 0, type: pciex
[200516.547877]     class: 0x60400 device name: 000f:73:00.0
[200516.612085]     adding to system ...
[200516.655565] pci 000f:73:00.0: PME# supported from D0 D3hot D3cold
[200516.729256] pci 000f:73:00.0: PME# disabled
[200516.779995] PCI: dev header type: 1
[200516.822115] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0/pci@c/pci@0)
[200516.894737]     Bridge bus range [116 --> 120]
[200516.949112]     Bridge ranges[fff8383fff98ee80] simba[0]
[200517.013606]     RAW Range[81000000:00000000:04000000:81000000:00000000:04000000:00000000:00002000]
[200517.121282]       Using flags[00000101] start[0000000004000000] size[0000000000002000]
[200517.217947]     RAW Range[82000000:00000000:20100000:82000000:00000000:20100000:00000000:02000000]
[200517.326331]       Using flags[00000200] start[0000000020100000] size[0000000002000000]
[200517.423355]     RAW Range[c3000000:00000004:80000000:c3000000:00000004:80000000:00000000:30000000]
[200517.532510]       Using flags[0010220c] start[0000000480000000] size[0000000030000000]
[200517.629725]     bus name: PCI Bus 000f:74
[200517.678873] PCI: scan_bus[/pci@6c0/pci@1/pci@0/pci@c/pci@0] bus no 116
[200517.757804]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@4
[200517.818477]     create device, devfn: 20, type: pciex
[200517.879021]     class: 0x60400 device name: 000f:74:04.0
[200517.943353]     adding to system ...
[200517.986886] pci 000f:74:04.0: PME# supported from D0 D3hot D3cold
[200518.061825] pci 000f:74:04.0: PME# disabled
[200518.113164] PCI: dev header type: 1
[200518.154286] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@4)
[200518.233633]     Bridge bus range [117 --> 117]
[200518.288542]     Bridge ranges[fff8383fff98dc40] simba[0]
[200518.352804]     RAW Range[81000000:00000000:04000000:81000000:00000000:04000000:00000000:00001000]
[200518.461570]       Using flags[00000101] start[0000000004000000] size[0000000000001000]
[200518.558162]     RAW Range[c3000000:00000004:80000000:c3000000:00000004:80000000:00000000:10000000]
[200518.666546]       Using flags[0010220c] start[0000000480000000] size[0000000010000000]
[200518.762308]     bus name: PCI Bus 000f:75
[200518.810738] PCI: scan_bus[/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@4] bus no 117
[200518.895981]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@4/network@0
[200518.968685]     create device, devfn: 0, type: network
[200519.030922]     class: 0x20000 device name: 000f:75:00.0
[200519.094119]     parse addresses (60 bytes) @ fff8383fff98c780
[200519.163587]   start: 839480000000, end: 8394801fffff, i: 10
[200519.231317]   start: 83c104000000, end: 83c10400001f, i: 18
[200519.298680]   start: 839480200000, end: 839480203fff, i: 20
[200519.366041]     adding to system ...
[200519.409638] pci 000f:75:00.0: PME# supported from D0 D3hot D3cold
[200519.483644] pci 000f:75:00.0: PME# disabled
[200519.534770] pci 000f:75:00.0: reg 0x184: [mem 0x839480204000-0x839480207fff 64bit]
[200519.626482] pci 000f:75:00.0: reg 0x190: [mem 0x839480304000-0x839480307fff 64bit]
[200519.717118] pci 000f:75:00.0: reg 0x184 [mem 0x839480204000-0x839480303fff 64bit] + pref
[200519.814987] pci 000f:75:00.0: reg 0x190 [mem 0x839480304000-0x839480403fff 64bit] + pref
[200519.912939] PCI: dev header type: 0
[200519.955060]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@4/network@0,1
[200520.029867]     create device, devfn: 1, type: network
[200520.092103]     class: 0x20000 device name: 000f:75:00.1
[200520.155302]     parse addresses (60 bytes) @ fff8383fff98ab40
[200520.224767]   start: 839480600000, end: 8394807fffff, i: 10
[200520.292129]   start: 83c104000020, end: 83c10400003f, i: 18
[200520.359836]   start: 839480404000, end: 839480407fff, i: 20
[200520.427468]     adding to system ...
[200520.471063] pci 000f:75:00.1: PME# supported from D0 D3hot D3cold
[200520.545011] pci 000f:75:00.1: PME# disabled
[200520.596434] pci 000f:75:00.1: reg 0x184: [mem 0x839480408000-0x83948040bfff 64bit]
[200520.688644] pci 000f:75:00.1: reg 0x190: [mem 0x839480800000-0x839480803fff 64bit]
[200520.778308] pci 000f:75:00.1: reg 0x184 [mem 0x839480408000-0x839480507fff 64bit] + pref
[200520.878021] pci 000f:75:00.1: reg 0x190 [mem 0x839480800000-0x8394808fffff 64bit] + pref
[200520.976427] PCI: dev header type: 0
[200521.018744]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@6
[200521.081000]     create device, devfn: 30, type: pciex
[200521.142390]     class: 0x60400 device name: 000f:74:06.0
[200521.206676]     adding to system ...
[200521.250212] pci 000f:74:06.0: PME# supported from D0 D3hot D3cold
[200521.323937] pci 000f:74:06.0: PME# disabled
[200521.375945] PCI: dev header type: 1
[200521.417507] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@6)
[200521.496442]     Bridge bus range [118 --> 118]
[200521.550378]     Bridge ranges[fff8383fff989100] simba[0]
[200521.614514]     RAW Range[c3000000:00000004:90000000:c3000000:00000004:90000000:00000000:10000000]
[200521.723515]       Using flags[0010220c] start[0000000490000000] size[0000000010000000]
[200521.819493]     bus name: PCI Bus 000f:76
[200521.869139] PCI: scan_bus[/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@6] bus no 118
[200521.954763]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@6/usb@0
[200522.023731]     create device, devfn: 0, type: xchi
[200522.083224]     class: 0xc0330 device name: 000f:76:00.0
[200522.147493]     parse addresses (20 bytes) @ fff8383fff987f00
[200522.216961]   start: 839490000000, end: 839490001fff, i: 10
[200522.285002]     adding to system ...
[200522.328574] pci 000f:76:00.0: PME# supported from D0 D3hot D3cold
[200522.403025] pci 000f:76:00.0: PME# disabled
[200522.453747] pci 000f:76:00.0: reg 0x10 [mem 0x839490000000-0x839490001fff 64bit] + pref
[200522.548696] PCI: dev header type: 0
[200522.592263]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@7
[200522.654450]     create device, devfn: 38, type: pciex
[200522.715580]     class: 0x60400 device name: 000f:74:07.0
[200522.779789]     adding to system ...
[200522.823323] pci 000f:74:07.0: PME# supported from D0 D3hot D3cold
[200522.897014] pci 000f:74:07.0: PME# disabled
[200522.947712] PCI: dev header type: 1
[200522.989856] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@7)
[200523.068799]     Bridge bus range [119 --> 119]
[200523.122731]     Bridge ranges[fff8383fff986d40] simba[0]
[200523.187368]     RAW Range[82000000:00000000:20100000:82000000:00000000:20100000:00000000:01f00000]
[200523.296491]       Using flags[00000200] start[0000000020100000] size[0000000001f00000]
[200523.393370]     bus name: PCI Bus 000f:77
[200523.442338] PCI: scan_bus[/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@7] bus no 119
[200523.527860]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@7/display@0
[200523.600564]     create device, devfn: 0, type: display
[200523.663607]     class: 0x30000 device name: 000f:77:00.0
[200523.727839]     parse addresses (80 bytes) @ fff8383fff985c00
[200523.797331]   start: 839021000000, end: 839021ffffff, i: 10
[200523.865196]   start: 839020100000, end: 839020103fff, i: 14
[200523.931683]   start: 839020800000, end: 839020ffffff, i: 18
[200523.999047]   start: 839020110000, end: 83902011ffff, i: 30
[200524.067186]     adding to system ...
[200524.111497] PCI: dev header type: 0
[200524.153619]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@c
[200524.215939]     create device, devfn: 60, type: pciex
[200524.277233]     class: 0x60400 device name: 000f:74:0c.0
[200524.341441]     adding to system ...
[200524.384976] pci 000f:74:0c.0: PME# supported from D0 D3hot D3cold
[200524.459287] pci 000f:74:0c.0: PME# disabled
[200524.509984] PCI: dev header type: 1
[200524.551414] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@c)
[200524.630271]     Bridge bus range [120 --> 120]
[200524.684203]     Bridge ranges[fff8383fff984980] simba[0]
[200524.748412]     RAW Range[81000000:00000000:04001000:81000000:00000000:04001000:00000000:00001000]
[200524.856797]       Using flags[00000101] start[0000000004001000] size[0000000000001000]
[200524.952559]     RAW Range[82000000:00000000:22000000:82000000:00000000:22000000:00000000:00100000]
[200525.060943]       Using flags[00000200] start[0000000022000000] size[0000000000100000]
[200525.156708]     RAW Range[c3000000:00000004:a0000000:c3000000:00000004:a0000000:00000000:10000000]
[200525.265303]       Using flags[0010220c] start[00000004a0000000] size[0000000010000000]
[200525.362474]     bus name: PCI Bus 000f:78
[200525.410903] PCI: scan_bus[/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@c] bus no 120
[200525.495298]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@c/scsi@0
[200525.566269]     create device, devfn: 0, type: scsi-sas
[200525.629836]     class: 0x10700 device name: 000f:78:00.0
[200525.694044]     parse addresses (80 bytes) @ fff8383fff983480
[200525.765117]   start: 83c104001000, end: 83c1040010ff, i: 10
[200525.832856]   start: 8394a0000000, end: 8394a000ffff, i: 14
[200525.900218]   start: 8394a0040000, end: 8394a007ffff, i: 1c
[200525.968687]   start: 839022000000, end: 8390220fffff, i: 30
[200526.036749]     adding to system ...
[200526.080518] pci 000f:78:00.0: supports D1 D2
[200526.132267] pci 000f:78:00.0: reg 0x14 [mem 0x8394a0000000-0x8394a000ffff 64bit] + pref
[200526.228196] pci 000f:78:00.0: reg 0x1c [mem 0x8394a0040000-0x8394a007ffff 64bit] + pref
[200526.323885] PCI: dev header type: 0
[200526.366043] PCI: Claiming 000f:00:01.0: Resource 13: 000083c100000000..000083c104001fff [101]
[200526.469764] PCI: Claiming 000f:00:01.0: Resource 14: 0000839000100000..00008390220fffff [200]
[200526.574001] PCI: Claiming 000f:00:01.0: Resource 15: 0000839100000000..00008394afffffff [10220c]
[200526.680457] PCI: Claiming 000f:01:00.0: Resource 13: 000083c100000000..000083c104001fff [101]
[200526.783589] PCI: Claiming 000f:01:00.0: Resource 14: 0000839000100000..00008390220fffff [200]
[200526.887035] PCI: Claiming 000f:01:00.0: Resource 15: 0000839100000000..00008394afffffff [10220c]
[200526.993199] PCI: Claiming 000f:02:04.0: Resource 13: 000083c100000000..000083c103ffffff [101]
[200527.096577] PCI: Claiming 000f:02:04.0: Resource 14: 0000839000100000..00008390200fffff [200]
[200527.199703] PCI: Claiming 000f:02:04.0: Resource 15: 0000839100000000..0000839477ffffff [10220c]
[200527.305983] PCI: Claiming 000f:02:0c.0: Resource 13: 000083c104000000..000083c104001fff [101]
[200527.409108] PCI: Claiming 000f:02:0c.0: Resource 14: 0000839020100000..00008390220fffff [200]
[200527.512234] PCI: Claiming 000f:02:0c.0: Resource 15: 0000839480000000..00008394afffffff [10220c]
[200527.618516] PCI: Claiming 000f:73:00.0: Resource 13: 000083c104000000..000083c104001fff [101]
[200527.721097] PCI: Claiming 000f:73:00.0: Resource 14: 0000839020100000..00008390220fffff [200]
[200527.824221] PCI: Claiming 000f:73:00.0: Resource 15: 0000839480000000..00008394afffffff [10220c]
[200527.930597] PCI: Claiming 000f:74:04.0: Resource 13: 000083c104000000..000083c104000fff [101]
[200528.033723] PCI: Claiming 000f:74:04.0: Resource 14: 0000839480000000..000083948fffffff [10220c]
[200528.140004] PCI: Claiming 000f:74:06.0: Resource 14: 0000839490000000..000083949fffffff [10220c]
[200528.246286] PCI: Claiming 000f:74:07.0: Resource 14: 0000839020100000..0000839021ffffff [200]
[200528.348787] PCI: Claiming 000f:74:0c.0: Resource 13: 000083c104001000..000083c104001fff [101]
[200528.451913] PCI: Claiming 000f:74:0c.0: Resource 14: 0000839022000000..00008390220fffff [200]
[200528.555255] PCI: Claiming 000f:74:0c.0: Resource 15: 00008394a0000000..00008394afffffff [10220c]
[200528.662097] PCI: Claiming 000f:75:00.0: Resource 0: 0000839480000000..00008394801fffff [10220c]
[200528.768419] PCI: Claiming 000f:75:00.0: Resource 2: 000083c104000000..000083c10400001f [101]
[200528.870493] PCI: Claiming 000f:75:00.0: Resource 4: 0000839480200000..0000839480203fff [10220c]
[200528.975329] PCI: Claiming 000f:75:00.0: Resource 7: 0000839480204000..0000839480303fff [142204]
[200529.080685] PCI: Claiming 000f:75:00.0: Resource 10: 0000839480304000..0000839480403fff [142204]
[200529.187120] PCI: Claiming 000f:75:00.1: Resource 0: 0000839480600000..00008394807fffff [10220c]
[200529.292348] PCI: Claiming 000f:75:00.1: Resource 2: 000083c104000020..000083c10400003f [101]
[200529.394421] PCI: Claiming 000f:75:00.1: Resource 4: 0000839480404000..0000839480407fff [10220c]
[200529.499650] PCI: Claiming 000f:75:00.1: Resource 7: 0000839480408000..0000839480507fff [142204]
[200529.603975] PCI: Claiming 000f:75:00.1: Resource 10: 0000839480800000..00008394808fffff [142204]
[200529.711432] PCI: Claiming 000f:76:00.0: Resource 0: 0000839490000000..0000839490001fff [102204]
[200529.816661] PCI: Claiming 000f:77:00.0: Resource 0: 0000839021000000..0000839021ffffff [200]
[200529.919271] PCI: Claiming 000f:77:00.0: Resource 1: 0000839020100000..0000839020103fff [200]
[200530.021344] PCI: Claiming 000f:77:00.0: Resource 2: 0000839020800000..0000839020ffffff [200]
[200530.124522] PCI: Claiming 000f:77:00.0: Resource 6: 0000839020110000..000083902011ffff [4c200]
[200530.228700] PCI: Claiming 000f:78:00.0: Resource 0: 000083c104001000..000083c1040010ff [101]
[200530.331745] PCI: Claiming 000f:78:00.0: Resource 1: 00008394a0000000..00008394a000ffff [102204]
[200530.435544] PCI: Claiming 000f:78:00.0: Resource 3: 00008394a0040000..00008394a007ffff [102204]
[200530.541755] PCI: Claiming 000f:78:00.0: Resource 6: 0000839022000000..00008390220fffff [4c200]
[200530.716524] vgaarb: device added: PCI:000f:77:00.0,decodes=io+mem,owns=none,locks=none
[200530.812319] vgaarb: loaded
[200530.844977] vgaarb: bridge control possible 000f:77:00.0
[200530.919596] SCSI subsystem initialized
[200530.970492] libata version 3.00 loaded.
[200531.017027] usbcore: registered new interface driver usbfs
[200531.082076] usbcore: registered new interface driver hub
[200531.154568] usbcore: registered new device driver usb
[200531.227877] NetLabel: Initializing
[200531.268957] NetLabel:  domain hash size = 128
[200531.321600] NetLabel:  protocols = UNLABELED CIPSOv4
[200531.381637] NetLabel:  unlabeled traffic allowed by default
[200531.451030] SUN4V: Reboot data supported (maj=1,min=0).
[200531.514368] ds.c:v1.0 (Jul 11, 2007)
[200531.565807] Switched to clocksource stick
[200531.611252] ds-1: Registered pri service.
[200531.659840] ds-1: Registered var-config-backup service.
[200531.749056] NET: Registered protocol family 2
[200531.820363] TCP established hash table entries: 524288 (order: 9, 4194304 bytes)
[200531.913540] TCP bind hash table entries: 65536 (order: 7, 1048576 bytes)
[200531.995496] TCP: Hash tables configured (established 524288 bind 65536)
[200532.075768] TCP: reno registered
[200532.114949] UDP hash table entries: 65536 (order: 8, 2097152 bytes)
[200532.192480] UDP-Lite hash table entries: 65536 (order: 8, 2097152 bytes)
[200532.289153] NET: Registered protocol family 1
[200532.342035] pci 0000:05:00.0: calling quirk_usb_early_handoff+0x0/0x220
[200532.428245] pci 0000:05:00.0: xHCI BIOS handoff failed (BIOS bug ?) 00010401
[200532.518381] pci 0000:06:00.0: calling quirk_e100_interrupt+0x0/0x220
[200532.595232] pci 0000:06:00.1: calling quirk_e100_interrupt+0x0/0x220
[200532.673149] pci 000f:75:00.0: calling quirk_e100_interrupt+0x0/0x220
[200532.750334] pci 000f:75:00.1: calling quirk_e100_interrupt+0x0/0x220
[200532.827194] pci 000f:76:00.0: calling quirk_usb_early_handoff+0x0/0x220
[200532.913777] pci 000f:76:00.0: xHCI BIOS handoff failed (BIOS bug ?) 00010401
[200533.002036] PCI: CLS mismatch (64 != 512), using 64 bytes
[200533.067689] Trying to unpack rootfs image as initramfs...
[200533.409377] Freeing initrd memory: 7408K (fff8380004000000 - fff838000473c000)
[200533.523973] futex hash table entries: 262144 (order: 11, 16777216 bytes)
[200533.613134] Initialise system trusted keyring
[200533.669037] audit: initializing netlink subsys (disabled)
[200533.734722] audit: type=2000 audit(19.264:1): initialized
[200533.802056] HugeTLB registered 8 MB page size, pre-allocated 0 pages
[200533.889397] VFS: Disk quotas dquot_6.5.2
[200533.945860] VFS: Dquot-cache hash table entries: 1024 (order 0, 8192 bytes)
[200534.050181] SELinux:  Registering netfilter hooks
[200534.111100] alg: No test for stdrng (krng)
[200534.161243] Key type asymmetric registered
[200534.210449] Asymmetric key parser 'x509' registered
[200534.268203] bounce: pool size: 64 pages
[200534.317375] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
[200534.413612] io scheduler noop registered
[200534.461492] io scheduler deadline registered (default)
[200534.527458] io scheduler cfq registered
[200534.574596] f0290cf4: ttyS0 at I/O 0x0 (irq = 1, base_baud = 115200) is a SUN4V HCONS
[    0.000000] PROMLIB: Sun IEEE Boot Prom 'OBP 4.36.2 2014/10/24 08:15'
[    0.000000] PROMLIB: Root node compatible: sun4v
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 4.0.0-rc6+ (root@ca-qasparc24) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-4.0.9) (GCC) ) #1 SMP Tue Mar 31 17:08:36 EDT 2015
[    0.000000] debug: skip boot console de-registration.
[    0.000000] debug: ignoring loglevel setting.
[    0.000000] debug: ignoring loglevel setting.
[    0.000000] bootconsole [earlyprom0] enabled
[    0.000000] ARCH: SUN4V
[    0.000000] Ethernet address: 00:10:e0:35:15:f6
[    0.000000] MM: PAGE_OFFSET is 0xfff8000000000000 (max_phys_bits == 47)
[    0.000000] MM: VMALLOC [0x0000000100000000 --> 0x0006000000000000]
[    0.000000] MM: VMEMMAP [0x0006000000000000 --> 0x000c000000000000]
[    0.000000] Kernel: Using 3 locked TLB entries for main kernel image.
[    0.000000] Remapping the kernel... done.
[    0.000000] OF stdout device is: /virtual-devices@100/console@1
[    0.000000] PROM: Built device tree with 1478535 bytes of memory.
[    0.000000] MDESC: Size is 774368 bytes.
[    0.000000] PLATFORM: banner-name [SPARC T5-8]
[    0.000000] PLATFORM: name [ORCL,SPARC-T5-8]
[    0.000000] PLATFORM: hostid [863515f6]
[    0.000000] PLATFORM: serial# [003515f6]
[    0.000000] PLATFORM: stick-frequency [3b9aca00]
[    0.000000] PLATFORM: mac-address [10e03515f6]
[    0.000000] PLATFORM: watchdog-resolution [1000 ms]
[    0.000000] PLATFORM: watchdog-max-timeout [31536000000 ms]
[    0.000000] PLATFORM: max-cpus [1024]
[    0.000000] Allocated 81920 bytes for kernel page tables.
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000030400000-0xffffffffffffffff]
[    0.000000]   Normal   [mem 0x0000000000000000-0x0000383fffd11fff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000030400000-0x0000003fddeeffff]
[    0.000000]   node   0: [mem 0x0000003fddef6000-0x0000003fddef7fff]
[    0.000000]   node   1: [mem 0x0000080000000000-0x0000083fffffffff]
[    0.000000]   node   2: [mem 0x0000100000000000-0x0000103fffffffff]
[    0.000000]   node   3: [mem 0x0000180000000000-0x0000183fffffffff]
[    0.000000]   node   4: [mem 0x0000200000000000-0x0000203fffffffff]
[    0.000000]   node   5: [mem 0x0000280000000000-0x0000283fffffffff]
[    0.000000]   node   6: [mem 0x0000300000000000-0x0000303fffffffff]
[    0.000000]   node   7: [mem 0x0000380000000000-0x0000383fffcddfff]
[    0.000000]   node   7: [mem 0x0000383fffcee000-0x0000383fffd11fff]
[    0.000000] Initmem setup node 0 [mem 0x0000000030400000-0x0000003fddef7fff]
[    0.000000] On node 0 totalpages: 33385849
[    0.000000]   Normal zone: 293431 pages used for memmap
[    0.000000]   Normal zone: 33385849 pages, LIFO batch:15
[    0.000000] Initmem setup node 1 [mem 0x0000080000000000-0x0000083fffffffff]
[    0.000000] On node 1 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 2 [mem 0x0000100000000000-0x0000103fffffffff]
[    0.000000] On node 2 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 3 [mem 0x0000180000000000-0x0000183fffffffff]
[    0.000000] On node 3 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 4 [mem 0x0000200000000000-0x0000203fffffffff]
[    0.000000] On node 4 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 5 [mem 0x0000280000000000-0x0000283fffffffff]
[    0.000000] On node 5 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 6 [mem 0x0000300000000000-0x0000303fffffffff]
[    0.000000] On node 6 totalpages: 33554432
[    0.000000]   Normal zone: 294912 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:15
[    0.000000] Initmem setup node 7 [mem 0x0000380000000000-0x0000383fffd11fff]
[    0.000000] On node 7 totalpages: 33554049
[    0.000000]   Normal zone: 294909 pages used for memmap
[    0.000000]   Normal zone: 33554049 pages, LIFO batch:15
[    0.000000] Booting Linux...
[    0.000000] CPU CAPS: [flush,stbar,swap,muldiv,v9,blkinit,n2,mul32]
[    0.000000] CPU CAPS: [div32,v8plus,popc,vis,vis2,ASIBlkInit,fmaf,vis3]
[    0.000000] CPU CAPS: [hpc,ima,pause,cbcond,aes,des,kasumi,camellia]
[    0.000000] CPU CAPS: [md5,sha1,sha256,sha512,mpmul,montmul,montsqr,crc32c]
[    0.000000] PERCPU: Embedded 8 pages/cpu @fff8003f4d000000 s27776 r8192 d29568 u65536
[    0.000000] pcpu-alloc: s27776 r8192 d29568 u65536 alloc=1*4194304
[    0.000000] pcpu-alloc: [0] 0000 0001 0002 0003 0004 0005 0006 0007 0008 0009 0010 0011 0012 0013 0014 0015 0016 0017 0018 0019 0020 0021 0022 0023 0024 0025 0026 0027 0028 0029 0030 0031 0032 0033 0034 0035 0036 0037 0038 0039 0040 0041 0042 0043 0044 0045 0046 0047 0048 0049 0050 0051 0052 0053 0054 0055 0056 0057 0058 0059 0060 0061 0062 0063 
[    0.000000] pcpu-alloc: [0] 0064 0065 0066 0067 0068 0069 0070 0071 0072 0073 0074 0075 0076 0077 0078 0079 0080 0081 0082 0083 0084 0085 0086 0087 0088 0089 0090 0091 0092 0093 0094 0095 0096 0097 0098 0099 0100 0101 0102 0103 0104 0105 0106 0107 0108 0109 0110 0111 0112 0113 0114 0115 0116 0117 0118 0119 0120 0121 0122 0123 0124 0125 0126 0127 
[    0.000000] pcpu-alloc: [1] 0128 0129 0130 0131 0132 0133 0134 0135 0136 0137 0138 0139 0140 0141 0142 0143 0144 0145 0146 0147 0148 0149 0150 0151 0152 0153 0154 0155 0156 0157 0158 0159 0160 0161 0162 0163 0164 0165 0166 0167 0168 0169 0170 0171 0172 0173 0174 0175 0176 0177 0178 0179 0180 0181 0182 0183 0184 0185 0186 0187 0188 0189 0190 0191 
[    0.000000] pcpu-alloc: [1] 0192 0193 0194 0195 0196 0197 0198 0199 0200 0201 0202 0203 0204 0205 0206 0207 0208 0209 0210 0211 0212 0213 0214 0215 0216 0217 0218 0219 0220 0221 0222 0223 0224 0225 0226 0227 0228 0229 0230 0231 0232 0233 0234 0235 0236 0237 0238 0239 0240 0241 0242 0243 0244 0245 0246 0247 0248 0249 0250 0251 0252 0253 0254 0255 
[    0.000000] pcpu-alloc: [2] 0256 0257 0258 0259 0260 0261 0262 0263 0264 0265 0266 0267 0268 0269 0270 0271 0272 0273 0274 0275 0276 0277 0278 0279 0280 0281 0282 0283 0284 0285 0286 0287 0288 0289 0290 0291 0292 0293 0294 0295 0296 0297 0298 0299 0300 0301 0302 0303 0304 0305 0306 0307 0308 0309 0310 0311 0312 0313 0314 0315 0316 0317 0318 0319 
[    0.000000] pcpu-alloc: [2] 0320 0321 0322 0323 0324 0325 0326 0327 0328 0329 0330 0331 0332 0333 0334 0335 0336 0337 0338 0339 0340 0341 0342 0343 0344 0345 0346 0347 0348 0349 0350 0351 0352 0353 0354 0355 0356 0357 0358 0359 0360 0361 0362 0363 0364 0365 0366 0367 0368 0369 0370 0371 0372 0373 0374 0375 0376 0377 0378 0379 0380 0381 0382 0383 
[    0.000000] pcpu-alloc: [3] 0384 0385 0386 0387 0388 0389 0390 0391 0392 0393 0394 0395 0396 0397 0398 0399 0400 0401 0402 0403 0404 0405 0406 0407 0408 0409 0410 0411 0412 0413 0414 0415 0416 0417 0418 0419 0420 0421 0422 0423 0424 0425 0426 0427 0428 0429 0430 0431 0432 0433 0434 0435 0436 0437 0438 0439 0440 0441 0442 0443 0444 0445 0446 0447 
[    0.000000] pcpu-alloc: [3] 0448 0449 0450 0451 0452 0453 0454 0455 0456 0457 0458 0459 0460 0461 0462 0463 0464 0465 0466 0467 0468 0469 0470 0471 0472 0473 0474 0475 0476 0477 0478 0479 0480 0481 0482 0483 0484 0485 0486 0487 0488 0489 0490 0491 0492 0493 0494 0495 0496 0497 0498 0499 0500 0501 0502 0503 0504 0505 0506 0507 0508 0509 0510 0511 
[    0.000000] pcpu-alloc: [4] 0512 0513 0514 0515 0516 0517 0518 0519 0520 0521 0522 0523 0524 0525 0526 0527 0528 0529 0530 0531 0532 0533 0534 0535 0536 0537 0538 0539 0540 0541 0542 0543 0544 0545 0546 0547 0548 0549 0550 0551 0552 0553 0554 0555 0556 0557 0558 0559 0560 0561 0562 0563 0564 0565 0566 0567 0568 0569 0570 0571 0572 0573 0574 0575 
[    0.000000] pcpu-alloc: [4] 0576 0577 0578 0579 0580 0581 0582 0583 0584 0585 0586 0587 0588 0589 0590 0591 0592 0593 0594 0595 0596 0597 0598 0599 0600 0601 0602 0603 0604 0605 0606 0607 0608 0609 0610 0611 0612 0613 0614 0615 0616 0617 0618 0619 0620 0621 0622 0623 0624 0625 0626 0627 0628 0629 0630 0631 0632 0633 0634 0635 0636 0637 0638 0639 
[    0.000000] pcpu-alloc: [5] 0640 0641 0642 0643 0644 0645 0646 0647 0648 0649 0650 0651 0652 0653 0654 0655 0656 0657 0658 0659 0660 0661 0662 0663 0664 0665 0666 0667 0668 0669 0670 0671 0672 0673 0674 0675 0676 0677 0678 0679 0680 0681 0682 0683 0684 0685 0686 0687 0688 0689 0690 0691 0692 0693 0694 0695 0696 0697 0698 0699 0700 0701 0702 0703 
[    0.000000] pcpu-alloc: [5] 0704 0705 0706 0707 0708 0709 0710 0711 0712 0713 0714 0715 0716 0717 0718 0719 0720 0721 0722 0723 0724 0725 0726 0727 0728 0729 0730 0731 0732 0733 0734 0735 0736 0737 0738 0739 0740 0741 0742 0743 0744 0745 0746 0747 0748 0749 0750 0751 0752 0753 0754 0755 0756 0757 0758 0759 0760 0761 0762 0763 0764 0765 0766 0767 
[    0.000000] pcpu-alloc: [6] 0768 0769 0770 0771 0772 0773 0774 0775 0776 0777 0778 0779 0780 0781 0782 0783 0784 0785 0786 0787 0788 0789 0790 0791 0792 0793 0794 0795 0796 0797 0798 0799 0800 0801 0802 0803 0804 0805 0806 0807 0808 0809 0810 0811 0812 0813 0814 0815 0816 0817 0818 0819 0820 0821 0822 0823 0824 0825 0826 0827 0828 0829 0830 0831 
[    0.000000] pcpu-alloc: [6] 0832 0833 0834 0835 0836 0837 0838 0839 0840 0841 0842 0843 0844 0845 0846 0847 0848 0849 0850 0851 0852 0853 0854 0855 0856 0857 0858 0859 0860 0861 0862 0863 0864 0865 0866 0867 0868 0869 0870 0871 0872 0873 0874 0875 0876 0877 0878 0879 0880 0881 0882 0883 0884 0885 0886 0887 0888 0889 0890 0891 0892 0893 0894 0895 
[    0.000000] pcpu-alloc: [7] 0896 0897 0898 0899 0900 0901 0902 0903 0904 0905 0906 0907 0908 0909 0910 0911 0912 0913 0914 0915 0916 0917 0918 0919 0920 0921 0922 0923 0924 0925 0926 0927 0928 0929 0930 0931 0932 0933 0934 0935 0936 0937 0938 0939 0940 0941 0942 0943 0944 0945 0946 0947 0948 0949 0950 0951 0952 0953 0954 0955 0956 0957 0958 0959 
[    0.000000] pcpu-alloc: [7] 0960 0961 0962 0963 0964 0965 0966 0967 0968 0969 0970 0971 0972 0973 0974 0975 0976 0977 0978 0979 0980 0981 0982 0983 0984 0985 0986 0987 0988 0989 0990 0991 0992 0993 0994 0995 0996 0997 0998 0999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 
[    0.000000] SUN4V: Mondo queue sizes [cpu(131072) dev(16384) r(8192) nr(256)]
[    0.000000] Built 8 zonelists in Node order, mobility grouping on.  Total pages: 265908678
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: root=/dev/mapper/VolGroup-lv_root ro rd_NO_LUKS LANG=en_US.UTF-8 rd_NO_MD rd_LVM_LV=VolGroup/lv_swap SYSFONT=latarcyrheb-sun16 rd_LVM_LV=VolGroup/lv_root KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM keep_bootcon debug ignore_loglevel ofpci_debug=1 debug ignore_loglevel ofpci_debug=1
[    0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[    0.000000] log_buf_len total cpu_extra contributions: 4190208 bytes
[    0.000000] log_buf_len min size: 1048576 bytes
[    0.000000] log_buf_len: 8388608 bytes
[    0.000000] early log buf free: 1036816(98%)
[    0.000000] PID hash table entries: 4096 (order: 2, 32768 bytes)
[    0.000000] Sorting __ex_table...
[    0.000000] Memory: 2127126632K/2146131920K available (5648K kernel code, 766K rwdata, 2376K rodata, 536K init, 2002K bss, 19005288K reserved, 0K cma-reserved)
[    0.000000] Hierarchical RCU implementation.
[    0.000000] NR_IRQS:2048 nr_irqs:2048 1
[    0.000000] SUN4V: Using IRQ API major 3, cookie only virqs enabled
[200395.122618] clocksource: mult[800000] shift[23]
[200395.177376] clockevent: mult[80000000] shift[31]
[200395.245006] Console: colour dummy device 80x25
[200395.298706] console [tty0] enabled
[200395.421695] Calibrating delay using timer specific routine.. 2001.26 BogoMIPS (lpj=4002520)
[200395.521712] pid_max: default: 1048576 minimum: 8192
[200395.583482] Security Framework initialized
[200395.632976] SELinux:  Initializing.
[200395.675459] SELinux:  Starting in permissive mode
[200395.886802] Dentry cache hash table entries: 268435456 (order: 18, 2147483648 bytes)
[200397.637065] Inode-cache hash table entries: 134217728 (order: 17, 1073741824 bytes)
[200398.527080] Mount-cache hash table entries: 4194304 (order: 12, 33554432 bytes)
[200398.617835] Mountpoint-cache hash table entries: 4194304 (order: 12, 33554432 bytes)
[200398.766772] Initializing cgroup subsys blkio
[200398.818399] Initializing cgroup subsys memory
[200398.872064] Initializing cgroup subsys devices
[200398.925757] Initializing cgroup subsys freezer
[200398.979708] Initializing cgroup subsys net_cls
[200399.033398] Initializing cgroup subsys perf_event
[200399.089644] Initializing cgroup subsys hugetlb
[200399.144686] ftrace: allocating 20491 entries in 41 pages
[200400.649786] Brought up 1024 CPUs
[200400.755973] devtmpfs: initialized
[200400.796357] Performance events: 
[200400.834428] Testing NMI watchdog ... OK.
[200400.963421] Supported PMU type is 'niagara5'
[200401.075787] ldc.c:v1.1 (July 22, 2008)
[200401.171475] NET: Registered protocol family 16
[200401.306241] VIO: Adding device channel-devices
[200401.362388] VIO: Adding device vldc-port-0-0
[200401.416269] VIO: Adding device vldc-port-0-1
[200401.470141] VIO: Adding device vldc-port-0-2
[200401.524949] VIO: Adding device vldc-port-1-0
[200401.579506] VIO: Adding device vldc-port-2-0
[200401.633488] VIO: Adding device vldc-port-3-0
[200401.687360] VIO: Adding device vldc-port-3-1
[200401.743395] VIO: Adding device vldc-port-3-4
[200401.797264] VIO: Adding device vldc-port-3-3
[200401.851135] VIO: Adding device vlds-port-0-0
[200401.905049] VIO: Adding device ds-0
[200401.949454] VIO: Adding device ds-1
[200402.217296] pci_sun4v: Registered hvapi major[1] minor[0]
[200402.284815] /pci@300: SUN4V PCI Bus Module
[200402.334344] /pci@300: On NUMA node -1
[200402.378730] /pci@300: PCI IO[804000000000] MEM[800000000000] MEM64[800100000000]
[200402.467087] /pci@300: Unable to request IOMMU resource.
[200402.548127] /pci@300: Imported 26 TSB entries from OBP
[200402.674469] /pci@300: MSI Queue first[0] num[56] count[512] devino[0x6]
[200402.754475] /pci@300: MSI first[0] num[512] mask[0x3ff] width[32]
[200402.828741] /pci@300: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200402.927672] /pci@300: MSI queues at RA [0000083f52c00000]
[200402.993412] PCI: Scanning PBM /pci@300
[200403.038800] pci_sun4v f02dbcfc: PCI host bridge to bus 0000:00
[200403.109334] pci_bus 0000:00: root bus resource [io  0x804000000000-0x80400fffffff] (bus address [0x0000-0xfffffff])
[200403.235498] pci_bus 0000:00: root bus resource [mem 0x800000000000-0x80007effffff] (bus address [0x00000000-0x7effffff])
[200403.367043] pci_bus 0000:00: root bus resource [mem 0x800100000000-0x8007ffffffff] (bus address [0x100000000-0x7ffffffff])
[200403.500196] pci_bus 0000:00: root bus resource [bus 00-77]
[200403.566515] PCI: scan_bus[/pci@300] bus no 0
[200403.617182]   * /pci@300/pci@1
[200403.654367]     create device, devfn: 8, type: pciex
[200403.714432]     class: 0x60400 device name: 0000:00:01.0
[200403.778649]     adding to system ...
[200403.821236] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[200403.894943] pci 0000:00:01.0: PME# disabled
[200403.945610] PCI: dev header type: 1
[200403.986725] of_scan_pci_bridge(/pci@300/pci@1)
[200404.040420]     Bridge bus range [1 --> 119]
[200404.092141]     Bridge ranges[fff8383fffba8c00] simba[0]
[200404.155349]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04002000]
[200404.264260]       Using flags[00000101] start[0000000000000000] size[0000000004002000]
[200404.360042]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20100000]
[200404.468446]       Using flags[00000200] start[0000000000100000] size[0000000020100000]
[200404.564493]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:b0000000]
[200404.673493]       Using flags[0010220c] start[0000000100000000] size[00000003b0000000]
[200404.769131]     bus name: PCI Bus 0000:01
[200404.817571] PCI: scan_bus[/pci@300/pci@1] bus no 1
[200404.875475]   * /pci@300/pci@1/pci@0
[200404.918805]     create device, devfn: 0, type: pciex
[200404.978189]     class: 0x60400 device name: 0000:01:00.0
[200405.043384]     adding to system ...
[200405.086763] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[200405.160658] pci 0000:01:00.0: PME# disabled
[200405.212035] PCI: dev header type: 1
[200405.254162] of_scan_pci_bridge(/pci@300/pci@1/pci@0)
[200405.314162]     Bridge bus range [2 --> 119]
[200405.365890]     Bridge ranges[fff8383fffba79c0] simba[0]
[200405.427984]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04002000]
[200405.535103]       Using flags[00000101] start[0000000000000000] size[0000000004002000]
[200405.630911]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20100000]
[200405.740294]       Using flags[00000200] start[0000000000100000] size[0000000020100000]
[200405.834786]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:b0000000]
[200405.943782]       Using flags[0010220c] start[0000000100000000] size[00000003b0000000]
[200406.040022]     bus name: PCI Bus 0000:02
[200406.087590] PCI: scan_bus[/pci@300/pci@1/pci@0] bus no 2
[200406.150595]   * /pci@300/pci@1/pci@0/pci@4
[200406.200153]     create device, devfn: 20, type: pciex
[200406.261255]     class: 0x60400 device name: 0000:02:04.0
[200406.325463]     adding to system ...
[200406.368662] pci 0000:02:04.0: PME# supported from D0 D3hot D3cold
[200406.442349] pci 0000:02:04.0: PME# disabled
[200406.493015] PCI: dev header type: 1
[200406.534210] of_scan_pci_bridge(/pci@300/pci@1/pci@0/pci@4)
[200406.600734]     Bridge bus range [3 --> 7]
[200406.651009]     Bridge ranges[fff8383fffba6880] simba[0]
[200406.715234]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:00002000]
[200406.823888]       Using flags[00000101] start[0000000000000000] size[0000000000002000]
[200406.919927]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:00100000]
[200407.028769]       Using flags[00000200] start[0000000000100000] size[0000000000100000]
[200407.124533]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000000:30000000]
[200407.232972]       Using flags[0010220c] start[0000000100000000] size[0000000030000000]
[200407.328735]     bus name: PCI Bus 0000:03
[200407.377225] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@4] bus no 3
[200407.447744]   * /pci@300/pci@1/pci@0/pci@4/pci@0
[200407.503612]     create device, devfn: 0, type: pciex
[200407.563668]     class: 0x60400 device name: 0000:03:00.0
[200407.627875]     adding to system ...
[200407.671266] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[200407.745041] pci 0000:03:00.0: PME# disabled
[200407.795746] PCI: dev header type: 1
[200407.837878] of_scan_pci_bridge(/pci@300/pci@1/pci@0/pci@4/pci@0)
[200407.910501]     Bridge bus range [4 --> 7]
[200407.960135]     Bridge ranges[fff8383fffba5740] simba[0]
[200408.023339]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:00002000]
[200408.131763]       Using flags[00000101] start[0000000000000000] size[0000000000002000]
[200408.227527]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:00100000]
[200408.335911]       Using flags[00000200] start[0000000000100000] size[0000000000100000]
[200408.431674]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000000:30000000]
[200408.540058]       Using flags[0010220c] start[0000000100000000] size[0000000030000000]
[200408.635822]     bus name: PCI Bus 0000:04
[200408.684252] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@4/pci@0] bus no 4
[200408.762027]   * /pci@300/pci@1/pci@0/pci@4/pci@0/pci@6
[200408.826676]     create device, devfn: 30, type: pciex
[200408.887906]     class: 0x60400 device name: 0000:04:06.0
[200408.952922]     adding to system ...
[200408.996546] pci 0000:04:06.0: PME# supported from D0 D3hot D3cold
[200409.069292] pci 0000:04:06.0: PME# disabled
[200409.119970] PCI: dev header type: 1
[200409.161080] of_scan_pci_bridge(/pci@300/pci@1/pci@0/pci@4/pci@0/pci@6)
[200409.243216]     Bridge bus range [5 --> 5]
[200409.293540]     Bridge ranges[fff8383fffba4540] simba[0]
[200409.357752]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000000:10000000]
[200409.467707]       Using flags[0010220c] start[0000000100000000] size[0000000010000000]
[200409.563798]     bus name: PCI Bus 0000:05
[200409.614404] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@4/pci@0/pci@6] bus no 5
[200409.697225]   * /pci@300/pci@1/pci@0/pci@4/pci@0/pci@6/usb@0
[200409.766182]     create device, devfn: 0, type: xchi
[200409.826847]     class: 0xc0330 device name: 0000:05:00.0
[200409.891149]     parse addresses (20 bytes) @ fff8383fffba3340
[200409.960614]   start: 800100000000, end: 800100001fff, i: 10
[200410.027293]     adding to system ...
[200410.069229] pci 0000:05:00.0: PME# supported from D0 D3hot D3cold
[200410.143339] pci 0000:05:00.0: PME# disabled
[200410.193989] pci 0000:05:00.0: reg 0x10 [mem 0x800100000000-0x800100001fff 64bit] + pref
[200410.292619] PCI: dev header type: 0
[200410.334741]   * /pci@300/pci@1/pci@0/pci@4/pci@0/pci@8
[200410.396923]     create device, devfn: 40, type: pciex
[200410.458031]     class: 0x60400 device name: 0000:04:08.0
[200410.522237]     adding to system ...
[200410.565668] pci 0000:04:08.0: PME# supported from D0 D3hot D3cold
[200410.639356] pci 0000:04:08.0: PME# disabled
[200410.690026] PCI: dev header type: 1
[200410.731138] of_scan_pci_bridge(/pci@300/pci@1/pci@0/pci@4/pci@0/pci@8)
[200410.810748]     Bridge bus range [6 --> 6]
[200410.860425]     Bridge ranges[fff8383fffba0240] simba[0]
[200410.925473]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:00001000]
[200411.034022]       Using flags[00000101] start[0000000000000000] size[0000000000001000]
[200411.131444]     RAW Range[c3000000:00000001:10000000:c3000000:00000001:10000000:00000000:10000000]
[200411.239831]       Using flags[0010220c] start[0000000110000000] size[0000000010000000]
[200411.335965]     bus name: PCI Bus 0000:06
[200411.384395] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@4/pci@0/pci@8] bus no 6
[200411.467810]   * /pci@300/pci@1/pci@0/pci@4/pci@0/pci@8/network@0
[200411.541016]     create device, devfn: 0, type: network
[200411.603219]     class: 0x20000 device name: 0000:06:00.0
[200411.667428]     parse addresses (60 bytes) @ fff8383fffb9ed80
[200411.736466]   start: 800110000000, end: 8001101fffff, i: 10
[200411.803827]   start: 804000000000, end: 80400000001f, i: 18
[200411.872517]   start: 800110200000, end: 800110203fff, i: 20
[200411.940085]     adding to system ...
[200411.983567] pci 0000:06:00.0: PME# supported from D0 D3hot D3cold
[200412.057255] pci 0000:06:00.0: PME# disabled
[200412.108452] pci 0000:06:00.0: reg 0x184: [mem 0x800110204000-0x800110207fff 64bit]
[200412.199787] pci 0000:06:00.0: reg 0x190: [mem 0x800110304000-0x800110307fff 64bit]
[200412.290656] pci 0000:06:00.0: reg 0x184 [mem 0x800110204000-0x800110303fff 64bit] + pref
[200412.388524] pci 0000:06:00.0: reg 0x190 [mem 0x800110304000-0x800110403fff 64bit] + pref
[200412.486471] PCI: dev header type: 0
[200412.528593]   * /pci@300/pci@1/pci@0/pci@4/pci@0/pci@8/network@0,1
[200412.603394]     create device, devfn: 1, type: network
[200412.665596]     class: 0x20000 device name: 0000:06:00.1
[200412.729805]     parse addresses (60 bytes) @ fff8383fffb9d140
[200412.799273]   start: 800110600000, end: 8001107fffff, i: 10
[200412.867540]   start: 804000000020, end: 80400000003f, i: 18
[200412.935680]   start: 800110404000, end: 800110407fff, i: 20
[200413.003041]     adding to system ...
[200413.046523] pci 0000:06:00.1: PME# supported from D0 D3hot D3cold
[200413.122205] pci 0000:06:00.1: PME# disabled
[200413.172950] pci 0000:06:00.1: reg 0x184: [mem 0x800110408000-0x80011040bfff 64bit]
[200413.264617] pci 0000:06:00.1: reg 0x190: [mem 0x800110800000-0x800110803fff 64bit]
[200413.357343] pci 0000:06:00.1: reg 0x184 [mem 0x800110408000-0x800110507fff 64bit] + pref
[200413.455843] pci 0000:06:00.1: reg 0x190 [mem 0x800110800000-0x8001108fffff 64bit] + pref
[200413.554987] PCI: dev header type: 0
[200413.597110]   * /pci@300/pci@1/pci@0/pci@4/pci@0/pci@c
[200413.659291]     create device, devfn: 60, type: pciex
[200413.721226]     class: 0x60400 device name: 0000:04:0c.0
[200413.786724]     adding to system ...
[200413.830156] pci 0000:04:0c.0: PME# supported from D0 D3hot D3cold
[200413.903842] pci 0000:04:0c.0: PME# disabled
[200413.956818] PCI: dev header type: 1
[200413.998665] of_scan_pci_bridge(/pci@300/pci@1/pci@0/pci@4/pci@0/pci@c)
[200414.077598]     Bridge bus range [7 --> 7]
[200414.127633]     Bridge ranges[fff8383fffb9b6c0] simba[0]
[200414.192739]     RAW Range[81000000:00000000:00001000:81000000:00000000:00001000:00000000:00001000]
[200414.301599]       Using flags[00000101] start[0000000000001000] size[0000000000001000]
[200414.399545]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:00100000]
[200414.507929]       Using flags[00000200] start[0000000000100000] size[0000000000100000]
[200414.603694]     RAW Range[c3000000:00000001:20000000:c3000000:00000001:20000000:00000000:10000000]
[200414.712079]       Using flags[0010220c] start[0000000120000000] size[0000000010000000]
[200414.807843]     bus name: PCI Bus 0000:07
[200414.856274] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@4/pci@0/pci@c] bus no 7
[200414.939414]   * /pci@300/pci@1/pci@0/pci@4/pci@0/pci@c/scsi@0
[200415.008957]     create device, devfn: 0, type: scsi-sas
[200415.072457]     class: 0x10700 device name: 0000:07:00.0
[200415.136665]     parse addresses (80 bytes) @ fff8383fffb9a4c0
[200415.206134]   start: 804000001000, end: 8040000010ff, i: 10
[200415.273497]   start: 800120000000, end: 80012000ffff, i: 14
[200415.341338]   start: 800120040000, end: 80012007ffff, i: 1c
[200415.408799]   start: 800000100000, end: 8000001fffff, i: 30
[200415.476163]     adding to system ...
[200415.519683] pci 0000:07:00.0: supports D1 D2
[200415.571389] pci 0000:07:00.0: reg 0x14 [mem 0x800120000000-0x80012000ffff 64bit] + pref
[200415.668206] pci 0000:07:00.0: reg 0x1c [mem 0x800120040000-0x80012007ffff 64bit] + pref
[200415.764721] PCI: dev header type: 0
[200415.806844]   * /pci@300/pci@1/pci@0/pci@6
[200415.856405]     create device, devfn: 30, type: pciex
[200415.917507]     class: 0x60400 device name: 0000:02:06.0
[200415.981715]     adding to system ...
[200416.025470] pci 0000:02:06.0: PME# supported from D0 D3hot D3cold
[200416.099155] pci 0000:02:06.0: PME# disabled
[200416.149821] PCI: dev header type: 1
[200416.190932] of_scan_pci_bridge(/pci@300/pci@1/pci@0/pci@6)
[200416.257243]     Bridge bus range [8 --> 119]
[200416.309000]     Bridge ranges[fff8383fffb98140] simba[0]
[200416.373222]     RAW Range[81000000:00000000:00002000:81000000:00000000:00002000:00000000:04000000]
[200416.482211]       Using flags[00000101] start[0000000000002000] size[0000000004000000]
[200416.579503]     RAW Range[82000000:00000000:00200000:82000000:00000000:00200000:00000000:20000000]
[200416.687937]       Using flags[00000200] start[0000000000200000] size[0000000020000000]
[200416.784591]     RAW Range[c3000000:00000001:30000000:c3000000:00000001:30000000:00000003:78000000]
[200416.895287]       Using flags[0010220c] start[0000000130000000] size[0000000378000000]
[200416.991381]     bus name: PCI Bus 0000:08
[200417.039812] PCI: scan_bus[/pci@300/pci@1/pci@0/pci@6] bus no 8
[200417.111970] PCI: Claiming 0000:00:01.0: Resource 13: 0000804000000000..0000804004001fff [101]
[200417.215458] PCI: Claiming 0000:00:01.0: Resource 14: 0000800000100000..00008000201fffff [200]
[200417.319901] PCI: Claiming 0000:00:01.0: Resource 15: 0000800100000000..00008004afffffff [10220c]
[200417.425937] PCI: Claiming 0000:01:00.0: Resource 13: 0000804000000000..0000804004001fff [101]
[200417.529065] PCI: Claiming 0000:01:00.0: Resource 14: 0000800000100000..00008000201fffff [200]
[200417.633623] PCI: Claiming 0000:01:00.0: Resource 15: 0000800100000000..00008004afffffff [10220c]
[200417.739953] PCI: Claiming 0000:02:04.0: Resource 13: 0000804000000000..0000804000001fff [101]
[200417.842083] PCI: Claiming 0000:02:04.0: Resource 14: 0000800000100000..00008000001fffff [200]
[200417.945373] PCI: Claiming 0000:02:04.0: Resource 15: 0000800100000000..000080012fffffff [10220c]
[200418.051937] PCI: Claiming 0000:02:06.0: Resource 13: 0000804000002000..0000804004001fff [101]
[200418.156265] PCI: Claiming 0000:02:06.0: Resource 14: 0000800000200000..00008000201fffff [200]
[200418.259575] PCI: Claiming 0000:02:06.0: Resource 15: 0000800130000000..00008004a7ffffff [10220c]
[200418.365614] PCI: Claiming 0000:03:00.0: Resource 13: 0000804000000000..0000804000001fff [101]
[200418.467929] PCI: Claiming 0000:03:00.0: Resource 14: 0000800000100000..00008000001fffff [200]
[200418.571058] PCI: Claiming 0000:03:00.0: Resource 15: 0000800100000000..000080012fffffff [10220c]
[200418.677841] PCI: Claiming 0000:04:06.0: Resource 14: 0000800100000000..000080010fffffff [10220c]
[200418.783965] PCI: Claiming 0000:04:08.0: Resource 13: 0000804000000000..0000804000000fff [101]
[200418.887331] PCI: Claiming 0000:04:08.0: Resource 14: 0000800110000000..000080011fffffff [10220c]
[200418.992718] PCI: Claiming 0000:04:0c.0: Resource 13: 0000804000001000..0000804000001fff [101]
[200419.096342] PCI: Claiming 0000:04:0c.0: Resource 14: 0000800000100000..00008000001fffff [200]
[200419.199361] PCI: Claiming 0000:04:0c.0: Resource 15: 0000800120000000..000080012fffffff [10220c]
[200419.305642] PCI: Claiming 0000:05:00.0: Resource 0: 0000800100000000..0000800100001fff [102204]
[200419.410639] PCI: Claiming 0000:06:00.0: Resource 0: 0000800110000000..00008001101fffff [10220c]
[200419.516136] PCI: Claiming 0000:06:00.0: Resource 2: 0000804000000000..000080400000001f [101]
[200419.618255] PCI: Claiming 0000:06:00.0: Resource 4: 0000800110200000..0000800110203fff [10220c]
[200419.724612] PCI: Claiming 0000:06:00.0: Resource 7: 0000800110204000..0000800110303fff [142204]
[200419.827552] PCI: Claiming 0000:06:00.0: Resource 10: 0000800110304000..0000800110403fff [142204]
[200419.934319] PCI: Claiming 0000:06:00.1: Resource 0: 0000800110600000..00008001107fffff [10220c]
[200420.039547] PCI: Claiming 0000:06:00.1: Resource 2: 0000804000000020..000080400000003f [101]
[200420.139783] PCI: Claiming 0000:06:00.1: Resource 4: 0000800110404000..0000800110407fff [10220c]
[200420.245671] PCI: Claiming 0000:06:00.1: Resource 7: 0000800110408000..0000800110507fff [142204]
[200420.351862] PCI: Claiming 0000:06:00.1: Resource 10: 0000800110800000..00008001108fffff [142204]
[200420.458552] PCI: Claiming 0000:07:00.0: Resource 0: 0000804000001000..00008040000010ff [101]
[200420.560626] PCI: Claiming 0000:07:00.0: Resource 1: 0000800120000000..000080012000ffff [102204]
[200420.666834] PCI: Claiming 0000:07:00.0: Resource 3: 0000800120040000..000080012007ffff [102204]
[200420.770814] PCI: Claiming 0000:07:00.0: Resource 6: 0000800000100000..00008000001fffff [4c200]
[200420.875239] /pci@340: SUN4V PCI Bus Module
[200420.924723] /pci@340: On NUMA node -1
[200420.968947] /pci@340: PCI IO[804100000000] MEM[801000000000] MEM64[801100000000]
[200421.056388] /pci@340: Unable to request IOMMU resource.
[200421.200691] /pci@340: MSI Queue first[0] num[56] count[512] devino[0x6]
[200421.280688] /pci@340: MSI first[0] num[512] mask[0x3ff] width[32]
[200421.355646] /pci@340: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200421.454661] /pci@340: MSI queues at RA [0000083f52e00000]
[200421.521314] PCI: Scanning PBM /pci@340
[200421.567247] pci_sun4v f02eab24: PCI host bridge to bus 0001:00
[200421.636253] pci_bus 0001:00: root bus resource [io  0x804100000000-0x80410fffffff] (bus address [0x0000-0xfffffff])
[200421.761404] pci_bus 0001:00: root bus resource [mem 0x801000000000-0x80107effffff] (bus address [0x00000000-0x7effffff])
[200421.893649] pci_bus 0001:00: root bus resource [mem 0x801100000000-0x8017ffffffff] (bus address [0x100000000-0x7ffffffff])
[200422.028042] pci_bus 0001:00: root bus resource [bus 00-e2]
[200422.094874] PCI: scan_bus[/pci@340] bus no 0
[200422.146933]   * /pci@340/pci@1
[200422.183937]     create device, devfn: 8, type: pciex
[200422.244296]     class: 0x60400 device name: 0001:00:01.0
[200422.309002]     adding to system ...
[200422.352342] pci 0001:00:01.0: PME# supported from D0 D3hot D3cold
[200422.427370] pci 0001:00:01.0: PME# disabled
[200422.479800] PCI: dev header type: 1
[200422.521921] of_scan_pci_bridge(/pci@340/pci@1)
[200422.575611]     Bridge bus range [1 --> 226]
[200422.627322]     Bridge ranges[fff8383fffb94d00] simba[0]
[200422.691879]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200422.801254]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200422.897838]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200423.006820]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200423.102582]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200423.210968]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200423.306729]     bus name: PCI Bus 0001:01
[200423.355159] PCI: scan_bus[/pci@340/pci@1] bus no 1
[200423.413054]   * /pci@340/pci@1/pci@0
[200423.456302]     create device, devfn: 0, type: pciex
[200423.516354]     class: 0x60400 device name: 0001:01:00.0
[200423.580562]     adding to system ...
[200423.623929] pci 0001:01:00.0: PME# supported from D0 D3hot D3cold
[200423.697614] pci 0001:01:00.0: PME# disabled
[200423.748302] PCI: dev header type: 1
[200423.789414] of_scan_pci_bridge(/pci@340/pci@1/pci@0)
[200423.849803]     Bridge bus range [2 --> 226]
[200423.902145]     Bridge ranges[fff8383fffb93bc0] simba[0]
[200423.965343]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200424.074191]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200424.169954]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200424.279796]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200424.375559]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200424.483057]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200424.578820]     bus name: PCI Bus 0001:02
[200424.627249] PCI: scan_bus[/pci@340/pci@1/pci@0] bus no 2
[200424.690598]   * /pci@340/pci@1/pci@0/pci@6
[200424.740158]     create device, devfn: 30, type: pciex
[200424.801261]     class: 0x60400 device name: 0001:02:06.0
[200424.865467]     adding to system ...
[200424.909783] pci 0001:02:06.0: PME# supported from D0 D3hot D3cold
[200424.983470] pci 0001:02:06.0: PME# disabled
[200425.034135] PCI: dev header type: 1
[200425.075246] of_scan_pci_bridge(/pci@340/pci@1/pci@0/pci@6)
[200425.142085]     Bridge bus range [3 --> 226]
[200425.193840]     Bridge ranges[fff8383fffb92880] simba[0]
[200425.258064]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200425.366449]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200425.462211]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200425.570773]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200425.667815]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200425.776201]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200425.872614]     bus name: PCI Bus 0001:03
[200425.921043] PCI: scan_bus[/pci@340/pci@1/pci@0/pci@6] bus no 3
[200425.991872] PCI: Claiming 0001:00:01.0: Resource 13: 0000804100000000..0000804107ffffff [101]
[200426.096237] PCI: Claiming 0001:00:01.0: Resource 14: 0000801000100000..00008010400fffff [200]
[200426.199367] PCI: Claiming 0001:00:01.0: Resource 15: 0000801100000000..00008017efffffff [10220c]
[200426.307249] PCI: Claiming 0001:01:00.0: Resource 13: 0000804100000000..0000804107ffffff [101]
[200426.410631] PCI: Claiming 0001:01:00.0: Resource 14: 0000801000100000..00008010400fffff [200]
[200426.514111] PCI: Claiming 0001:01:00.0: Resource 15: 0000801100000000..00008017efffffff [10220c]
[200426.620392] PCI: Claiming 0001:02:06.0: Resource 13: 0000804100000000..0000804107ffffff [101]
[200426.724361] PCI: Claiming 0001:02:06.0: Resource 14: 0000801000100000..00008010400fffff [200]
[200426.828147] PCI: Claiming 0001:02:06.0: Resource 15: 0000801100000000..00008017efffffff [10220c]
[200426.935390] /pci@380: SUN4V PCI Bus Module
[200426.983864] /pci@380: On NUMA node -1
[200427.028089] /pci@380: PCI IO[80c000000000] MEM[808000000000] MEM64[808100000000]
[200427.115450] /pci@380: Unable to request IOMMU resource.
[200427.259781] /pci@380: MSI Queue first[0] num[56] count[512] devino[0x6]
[200427.339773] /pci@380: MSI first[0] num[512] mask[0x3ff] width[32]
[200427.413447] /pci@380: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200427.512370] /pci@380: MSI queues at RA [0000003f22e00000]
[200427.576123] PCI: Scanning PBM /pci@380
[200427.621588] pci_sun4v f02f994c: PCI host bridge to bus 0002:00
[200427.692273] pci_bus 0002:00: root bus resource [io  0x80c000000000-0x80c00fffffff] (bus address [0x0000-0xfffffff])
[200427.819046] pci_bus 0002:00: root bus resource [mem 0x808000000000-0x80807effffff] (bus address [0x00000000-0x7effffff])
[200427.949563] pci_bus 0002:00: root bus resource [mem 0x808100000000-0x8087ffffffff] (bus address [0x100000000-0x7ffffffff])
[200428.084593] pci_bus 0002:00: root bus resource [bus 00-e2]
[200428.150903] PCI: scan_bus[/pci@380] bus no 0
[200428.203427]   * /pci@380/pci@1
[200428.240473]     create device, devfn: 8, type: pciex
[200428.300553]     class: 0x60400 device name: 0002:00:01.0
[200428.364948]     adding to system ...
[200428.408401] pci 0002:00:01.0: PME# supported from D0 D3hot D3cold
[200428.482092] pci 0002:00:01.0: PME# disabled
[200428.533101] PCI: dev header type: 1
[200428.574691] of_scan_pci_bridge(/pci@380/pci@1)
[200428.628381]     Bridge bus range [1 --> 226]
[200428.679603]     Bridge ranges[fff8383fffb8f440] simba[0]
[200428.742847]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200428.851416]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200428.947181]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200429.055564]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200429.151327]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200429.259713]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200429.355476]     bus name: PCI Bus 0002:01
[200429.404388] PCI: scan_bus[/pci@380/pci@1] bus no 1
[200429.462528]   * /pci@380/pci@1/pci@0
[200429.505781]     create device, devfn: 0, type: pciex
[200429.565854]     class: 0x60400 device name: 0002:01:00.0
[200429.631061]     adding to system ...
[200429.674746] pci 0002:01:00.0: PME# supported from D0 D3hot D3cold
[200429.748738] pci 0002:01:00.0: PME# disabled
[200429.799466] PCI: dev header type: 1
[200429.841587] of_scan_pci_bridge(/pci@380/pci@1/pci@0)
[200429.902359]     Bridge bus range [2 --> 226]
[200429.954317]     Bridge ranges[fff8383fffb8e300] simba[0]
[200430.018991]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200430.127664]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200430.223695]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200430.331667]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200430.427668]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200430.535573]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200430.631350]     bus name: PCI Bus 0002:02
[200430.679778] PCI: scan_bus[/pci@380/pci@1/pci@0] bus no 2
[200430.744487]   * /pci@380/pci@1/pci@0/pci@a
[200430.794222]     create device, devfn: 50, type: pciex
[200430.855345]     class: 0x60400 device name: 0002:02:0a.0
[200430.919552]     adding to system ...
[200430.963972] pci 0002:02:0a.0: PME# supported from D0 D3hot D3cold
[200431.037244] pci 0002:02:0a.0: PME# disabled
[200431.087936] PCI: dev header type: 1
[200431.129062] of_scan_pci_bridge(/pci@380/pci@1/pci@0/pci@a)
[200431.196004]     Bridge bus range [3 --> 226]
[200431.247814]     Bridge ranges[fff8383fffb8cfc0] simba[0]
[200431.312298]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200431.420741]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200431.515387]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200431.623772]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200431.719536]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200431.828187]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200431.923756]     bus name: PCI Bus 0002:03
[200431.972186] PCI: scan_bus[/pci@380/pci@1/pci@0/pci@a] bus no 3
[200432.042143]   * /pci@380/pci@1/pci@0/pci@a/SUNW,qlc@0
[200432.103954]     create device, devfn: 0, type: scsi-fcp
[200432.167579]     class: 0xc0400 device name: 0002:03:00.0
[200432.232269]     parse addresses (60 bytes) @ fff8383fffb8bc40
[200432.301735]   start: 80c000000000, end: 80c0000000ff, i: 10
[200432.369859]   start: 808100000000, end: 808100003fff, i: 14
[200432.437220]   start: 808000100000, end: 80800013ffff, i: 30
[200432.503646]     adding to system ...
[200432.546462] pci 0002:03:00.0: reg 0x14 [mem 0x808100000000-0x808100003fff 64bit] + pref
[200432.642586] PCI: dev header type: 0
[200432.684974]   * /pci@380/pci@1/pci@0/pci@a/SUNW,qlc@0,1
[200432.748498]     create device, devfn: 1, type: scsi-fcp
[200432.811754]     class: 0xc0400 device name: 0002:03:00.1
[200432.876130]     parse addresses (60 bytes) @ fff8383fffb891c0
[200432.945595]   start: 80c000000100, end: 80c0000001ff, i: 10
[200433.014474]   start: 808100004000, end: 808100007fff, i: 14
[200433.082503]   start: 808000140000, end: 80800017ffff, i: 30
[200433.149864]     adding to system ...
[200433.193550] pci 0002:03:00.1: reg 0x14 [mem 0x808100004000-0x808100007fff 64bit] + pref
[200433.291050] PCI: dev header type: 0
[200433.333189] PCI: Claiming 0002:00:01.0: Resource 13: 000080c000000000..000080c007ffffff [101]
[200433.437658] PCI: Claiming 0002:00:01.0: Resource 14: 0000808000100000..00008080400fffff [200]
[200433.541256] PCI: Claiming 0002:00:01.0: Resource 15: 0000808100000000..00008087efffffff [10220c]
[200433.647536] PCI: Claiming 0002:01:00.0: Resource 13: 000080c000000000..000080c007ffffff [101]
[200433.751861] PCI: Claiming 0002:01:00.0: Resource 14: 0000808000100000..00008080400fffff [200]
[200433.854985] PCI: Claiming 0002:01:00.0: Resource 15: 0000808100000000..00008087efffffff [10220c]
[200433.962942] PCI: Claiming 0002:02:0a.0: Resource 13: 000080c000000000..000080c007ffffff [101]
[200434.066503] PCI: Claiming 0002:02:0a.0: Resource 14: 0000808000100000..00008080400fffff [200]
[200434.170624] PCI: Claiming 0002:02:0a.0: Resource 15: 0000808100000000..00008087efffffff [10220c]
[200434.278666] PCI: Claiming 0002:03:00.0: Resource 0: 000080c000000000..000080c0000000ff [101]
[200434.381761] PCI: Claiming 0002:03:00.0: Resource 1: 0000808100000000..0000808100003fff [102204]
[200434.487536] PCI: Claiming 0002:03:00.0: Resource 6: 0000808000100000..000080800013ffff [4c200]
[200434.593529] PCI: Claiming 0002:03:00.1: Resource 0: 000080c000000100..000080c0000001ff [101]
[200434.695603] PCI: Claiming 0002:03:00.1: Resource 1: 0000808100004000..0000808100007fff [102204]
[200434.801228] PCI: Claiming 0002:03:00.1: Resource 6: 0000808000140000..000080800017ffff [4c200]
[200434.905565] /pci@3c0: SUN4V PCI Bus Module
[200434.951961] /pci@3c0: On NUMA node -1
[200434.994986] /pci@3c0: PCI IO[80c100000000] MEM[809000000000] MEM64[809100000000]
[200435.082426] /pci@3c0: Unable to request IOMMU resource.
[200435.225085] /pci@3c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[200435.305079] /pci@3c0: MSI first[0] num[512] mask[0x3ff] width[32]
[200435.375593] /pci@3c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200435.474515] /pci@3c0: MSI queues at RA [0000383f50800000]
[200435.539774] PCI: Scanning PBM /pci@3c0
[200435.585491] pci_sun4v f0308774: PCI host bridge to bus 0003:00
[200435.655886] pci_bus 0003:00: root bus resource [io  0x80c100000000-0x80c10fffffff] (bus address [0x0000-0xfffffff])
[200435.783302] pci_bus 0003:00: root bus resource [mem 0x809000000000-0x80907effffff] (bus address [0x00000000-0x7effffff])
[200435.914994] pci_bus 0003:00: root bus resource [mem 0x809100000000-0x8097ffffffff] (bus address [0x100000000-0x7ffffffff])
[200436.048624] pci_bus 0003:00: root bus resource [bus 00-e2]
[200436.114936] PCI: scan_bus[/pci@3c0] bus no 0
[200436.166521]   * /pci@3c0/pci@1
[200436.203769]     create device, devfn: 8, type: pciex
[200436.262841]     class: 0x60400 device name: 0003:00:01.0
[200436.327049]     adding to system ...
[200436.370499] pci 0003:00:01.0: PME# supported from D0 D3hot D3cold
[200436.444188] pci 0003:00:01.0: PME# disabled
[200436.495397] PCI: dev header type: 1
[200436.536885] of_scan_pci_bridge(/pci@3c0/pci@1)
[200436.590575]     Bridge bus range [1 --> 226]
[200436.642506]     Bridge ranges[fff8383fffb84680] simba[0]
[200436.706719]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200436.815169]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200436.909722]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200437.018107]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200437.112011]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200437.221089]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200437.316853]     bus name: PCI Bus 0003:01
[200437.365284] PCI: scan_bus[/pci@3c0/pci@1] bus no 1
[200437.423180]   * /pci@3c0/pci@1/pci@0
[200437.466970]     create device, devfn: 0, type: pciex
[200437.527042]     class: 0x60400 device name: 0003:01:00.0
[200437.591250]     adding to system ...
[200437.634704] pci 0003:01:00.0: PME# supported from D0 D3hot D3cold
[200437.708394] pci 0003:01:00.0: PME# disabled
[200437.759126] PCI: dev header type: 1
[200437.801248] of_scan_pci_bridge(/pci@3c0/pci@1/pci@0)
[200437.861250]     Bridge bus range [2 --> 226]
[200437.913023]     Bridge ranges[fff8383fffb83540] simba[0]
[200437.978897]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200438.087302]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200438.183719]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200438.294420]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200438.388716]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200438.493123]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200438.588598]     bus name: PCI Bus 0003:02
[200438.637027] PCI: scan_bus[/pci@3c0/pci@1/pci@0] bus no 2
[200438.700928]   * /pci@3c0/pci@1/pci@0/pci@e
[200438.750492]     create device, devfn: 70, type: pciex
[200438.811615]     class: 0x60400 device name: 0003:02:0e.0
[200438.876706]     adding to system ...
[200438.920211] pci 0003:02:0e.0: PME# supported from D0 D3hot D3cold
[200438.994677] pci 0003:02:0e.0: PME# disabled
[200439.044489] PCI: dev header type: 1
[200439.085625] of_scan_pci_bridge(/pci@3c0/pci@1/pci@0/pci@e)
[200439.151952]     Bridge bus range [3 --> 226]
[200439.204028]     Bridge ranges[fff8383fffb82200] simba[0]
[200439.269809]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200439.378196]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200439.473958]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200439.582343]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200439.678496]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200439.786883]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200439.883725]     bus name: PCI Bus 0003:03
[200439.932155] PCI: scan_bus[/pci@3c0/pci@1/pci@0/pci@e] bus no 3
[200440.003763] PCI: Claiming 0003:00:01.0: Resource 13: 000080c100000000..000080c107ffffff [101]
[200440.105392] PCI: Claiming 0003:00:01.0: Resource 14: 0000809000100000..00008090400fffff [200]
[200440.209248] PCI: Claiming 0003:00:01.0: Resource 15: 0000809100000000..00008097efffffff [10220c]
[200440.316020] PCI: Claiming 0003:01:00.0: Resource 13: 000080c100000000..000080c107ffffff [101]
[200440.419149] PCI: Claiming 0003:01:00.0: Resource 14: 0000809000100000..00008090400fffff [200]
[200440.522275] PCI: Claiming 0003:01:00.0: Resource 15: 0000809100000000..00008097efffffff [10220c]
[200440.628846] PCI: Claiming 0003:02:0e.0: Resource 13: 000080c100000000..000080c107ffffff [101]
[200440.732481] PCI: Claiming 0003:02:0e.0: Resource 14: 0000809000100000..00008090400fffff [200]
[200440.835608] PCI: Claiming 0003:02:0e.0: Resource 15: 0000809100000000..00008097efffffff [10220c]
[200440.943236] /pci@400: SUN4V PCI Bus Module
[200440.992029] /pci@400: On NUMA node -1
[200441.036252] /pci@400: PCI IO[814000000000] MEM[810000000000] MEM64[810100000000]
[200441.123791] /pci@400: Unable to request IOMMU resource.
[200441.268337] /pci@400: MSI Queue first[0] num[56] count[512] devino[0x6]
[200441.348330] /pci@400: MSI first[0] num[512] mask[0x3ff] width[32]
[200441.422006] /pci@400: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200441.521500] /pci@400: MSI queues at RA [0000303f52200000]
[200441.586763] PCI: Scanning PBM /pci@400
[200441.632621] pci_sun4v f031759c: PCI host bridge to bus 0004:00
[200441.704991] pci_bus 0004:00: root bus resource [io  0x814000000000-0x81400fffffff] (bus address [0x0000-0xfffffff])
[200441.832151] pci_bus 0004:00: root bus resource [mem 0x810000000000-0x81007effffff] (bus address [0x00000000-0x7effffff])
[200441.965098] pci_bus 0004:00: root bus resource [mem 0x810100000000-0x8107ffffffff] (bus address [0x100000000-0x7ffffffff])
[200442.098947] pci_bus 0004:00: root bus resource [bus 00-72]
[200442.165858] PCI: scan_bus[/pci@400] bus no 0
[200442.217933]   * /pci@400/pci@1
[200442.254935]     create device, devfn: 8, type: pciex
[200442.315581]     class: 0x60400 device name: 0004:00:01.0
[200442.380401]     adding to system ...
[200442.422902] pci 0004:00:01.0: PME# supported from D0 D3hot D3cold
[200442.496592] pci 0004:00:01.0: PME# disabled
[200442.547268] PCI: dev header type: 1
[200442.589706] of_scan_pci_bridge(/pci@400/pci@1)
[200442.643823]     Bridge bus range [1 --> 114]
[200442.695592]     Bridge ranges[fff8383fffb7edc0] simba[0]
[200442.759317]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04000000]
[200442.865666]       Using flags[00000101] start[0000000000000000] size[0000000004000000]
[200442.961895]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20000000]
[200443.071048]       Using flags[00000200] start[0000000000100000] size[0000000020000000]
[200443.166811]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:80000000]
[200443.275987]       Using flags[0010220c] start[0000000100000000] size[0000000380000000]
[200443.372405]     bus name: PCI Bus 0004:01
[200443.420836] PCI: scan_bus[/pci@400/pci@1] bus no 1
[200443.478732]   * /pci@400/pci@1/pci@0
[200443.521985]     create device, devfn: 0, type: pciex
[200443.582057]     class: 0x60400 device name: 0004:01:00.0
[200443.646265]     adding to system ...
[200443.689716] pci 0004:01:00.0: PME# supported from D0 D3hot D3cold
[200443.763406] pci 0004:01:00.0: PME# disabled
[200443.814130] PCI: dev header type: 1
[200443.856251] of_scan_pci_bridge(/pci@400/pci@1/pci@0)
[200443.914593]     Bridge bus range [2 --> 114]
[200443.966362]     Bridge ranges[fff8383fffb7db80] simba[0]
[200444.030572]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04000000]
[200444.139277]       Using flags[00000101] start[0000000000000000] size[0000000004000000]
[200444.235040]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20000000]
[200444.343944]       Using flags[00000200] start[0000000000100000] size[0000000020000000]
[200444.439708]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:80000000]
[200444.548092]       Using flags[0010220c] start[0000000100000000] size[0000000380000000]
[200444.643856]     bus name: PCI Bus 0004:02
[200444.692686] PCI: scan_bus[/pci@400/pci@1/pci@0] bus no 2
[200444.756894]   * /pci@400/pci@1/pci@0/pci@c
[200444.806456]     create device, devfn: 60, type: pciex
[200444.867577]     class: 0x60400 device name: 0004:02:0c.0
[200444.931084]     adding to system ...
[200444.974586] pci 0004:02:0c.0: PME# supported from D0 D3hot D3cold
[200445.047529] pci 0004:02:0c.0: PME# disabled
[200445.098223] PCI: dev header type: 1
[200445.139745] of_scan_pci_bridge(/pci@400/pci@1/pci@0/pci@c)
[200445.206055]     Bridge bus range [3 --> 114]
[200445.258027]     Bridge ranges[fff8383fffb7c840] simba[0]
[200445.322607]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04000000]
[200445.431367]       Using flags[00000101] start[0000000000000000] size[0000000004000000]
[200445.527867]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20000000]
[200445.636459]       Using flags[00000200] start[0000000000100000] size[0000000020000000]
[200445.732418]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:78000000]
[200445.839487]       Using flags[0010220c] start[0000000100000000] size[0000000378000000]
[200445.936159]     bus name: PCI Bus 0004:03
[200445.986473] PCI: scan_bus[/pci@400/pci@1/pci@0/pci@c] bus no 3
[200446.057003] PCI: Claiming 0004:00:01.0: Resource 13: 0000814000000000..0000814003ffffff [101]
[200446.160128] PCI: Claiming 0004:00:01.0: Resource 14: 0000810000100000..00008100200fffff [200]
[200446.263608] PCI: Claiming 0004:00:01.0: Resource 15: 0000810100000000..000081047fffffff [10220c]
[200446.370539] PCI: Claiming 0004:01:00.0: Resource 13: 0000814000000000..0000814003ffffff [101]
[200446.473991] PCI: Claiming 0004:01:00.0: Resource 14: 0000810000100000..00008100200fffff [200]
[200446.575637] PCI: Claiming 0004:01:00.0: Resource 15: 0000810100000000..000081047fffffff [10220c]
[200446.681919] PCI: Claiming 0004:02:0c.0: Resource 13: 0000814000000000..0000814003ffffff [101]
[200446.785020] PCI: Claiming 0004:02:0c.0: Resource 14: 0000810000100000..00008100200fffff [200]
[200446.889254] PCI: Claiming 0004:02:0c.0: Resource 15: 0000810100000000..0000810477ffffff [10220c]
[200446.996108] /pci@440: SUN4V PCI Bus Module
[200447.044583] /pci@440: On NUMA node -1
[200447.088807] /pci@440: PCI IO[814100000000] MEM[811000000000] MEM64[811100000000]
[200447.176537] /pci@440: Unable to request IOMMU resource.
[200447.322372] /pci@440: MSI Queue first[0] num[56] count[512] devino[0x6]
[200447.403525] /pci@440: MSI first[0] num[512] mask[0x3ff] width[32]
[200447.477201] /pci@440: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200447.577059] /pci@440: MSI queues at RA [0000303f52400000]
[200447.642369] PCI: Scanning PBM /pci@440
[200447.687709] pci_sun4v f03263c4: PCI host bridge to bus 0005:00
[200447.758233] pci_bus 0005:00: root bus resource [io  0x814100000000-0x81410fffffff] (bus address [0x0000-0xfffffff])
[200447.884502] pci_bus 0005:00: root bus resource [mem 0x811000000000-0x81107effffff] (bus address [0x00000000-0x7effffff])
[200448.017300] pci_bus 0005:00: root bus resource [mem 0x811100000000-0x8117ffffffff] (bus address [0x100000000-0x7ffffffff])
[200448.149240] pci_bus 0005:00: root bus resource [bus 00-e2]
[200448.215990] PCI: scan_bus[/pci@440] bus no 0
[200448.267576]   * /pci@440/pci@1
[200448.303677]     create device, devfn: 8, type: pciex
[200448.364112]     class: 0x60400 device name: 0005:00:01.0
[200448.428379]     adding to system ...
[200448.471901] pci 0005:00:01.0: PME# supported from D0 D3hot D3cold
[200448.546155] pci 0005:00:01.0: PME# disabled
[200448.596828] PCI: dev header type: 1
[200448.638514] of_scan_pci_bridge(/pci@440/pci@1)
[200448.692204]     Bridge bus range [1 --> 226]
[200448.743972]     Bridge ranges[fff8383fffb79400] simba[0]
[200448.808272]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200448.917634]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200449.014030]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200449.122413]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200449.218197]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200449.325325]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200449.421584]     bus name: PCI Bus 0005:01
[200449.470014] PCI: scan_bus[/pci@440/pci@1] bus no 1
[200449.527909]   * /pci@440/pci@1/pci@0
[200449.571158]     create device, devfn: 0, type: pciex
[200449.631230]     class: 0x60400 device name: 0005:01:00.0
[200449.695438]     adding to system ...
[200449.738892] pci 0005:01:00.0: PME# supported from D0 D3hot D3cold
[200449.813098] pci 0005:01:00.0: PME# disabled
[200449.863818] PCI: dev header type: 1
[200449.905941] of_scan_pci_bridge(/pci@440/pci@1/pci@0)
[200449.964267]     Bridge bus range [2 --> 226]
[200450.017826]     Bridge ranges[fff8383fffb782c0] simba[0]
[200450.082037]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200450.188720]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200450.284184]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200450.392570]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200450.489338]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200450.597829]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200450.695152]     bus name: PCI Bus 0005:02
[200450.743580] PCI: scan_bus[/pci@440/pci@1/pci@0] bus no 2
[200450.807788]   * /pci@440/pci@1/pci@0/pci@c
[200450.857355]     create device, devfn: 60, type: pciex
[200450.918268]     class: 0x60400 device name: 0005:02:0c.0
[200450.982853]     adding to system ...
[200451.026723] pci 0005:02:0c.0: PME# supported from D0 D3hot D3cold
[200451.102169] pci 0005:02:0c.0: PME# disabled
[200451.152991] PCI: dev header type: 1
[200451.194101] of_scan_pci_bridge(/pci@440/pci@1/pci@0/pci@c)
[200451.260412]     Bridge bus range [3 --> 226]
[200451.312578]     Bridge ranges[fff8383fffb76f80] simba[0]
[200451.374972]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200451.482978]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200451.577848]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200451.683306]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200451.779068]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200451.887452]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200451.983215]     bus name: PCI Bus 0005:03
[200452.031645] PCI: scan_bus[/pci@440/pci@1/pci@0/pci@c] bus no 3
[200452.102173] PCI: Claiming 0005:00:01.0: Resource 13: 0000814100000000..0000814107ffffff [101]
[200452.206048] PCI: Claiming 0005:00:01.0: Resource 14: 0000811000100000..00008110400fffff [200]
[200452.309031] PCI: Claiming 0005:00:01.0: Resource 15: 0000811100000000..00008117efffffff [10220c]
[200452.416249] PCI: Claiming 0005:01:00.0: Resource 13: 0000814100000000..0000814107ffffff [101]
[200452.519789] PCI: Claiming 0005:01:00.0: Resource 14: 0000811000100000..00008110400fffff [200]
[200452.622235] PCI: Claiming 0005:01:00.0: Resource 15: 0000811100000000..00008117efffffff [10220c]
[200452.728516] PCI: Claiming 0005:02:0c.0: Resource 13: 0000814100000000..0000814107ffffff [101]
[200452.832413] PCI: Claiming 0005:02:0c.0: Resource 14: 0000811000100000..00008110400fffff [200]
[200452.935794] PCI: Claiming 0005:02:0c.0: Resource 15: 0000811100000000..00008117efffffff [10220c]
[200453.042556] /pci@480: SUN4V PCI Bus Module
[200453.092040] /pci@480: On NUMA node -1
[200453.136264] /pci@480: PCI IO[81c000000000] MEM[818000000000] MEM64[818100000000]
[200453.222193] /pci@480: Unable to request IOMMU resource.
[200453.366684] /pci@480: MSI Queue first[0] num[56] count[512] devino[0x6]
[200453.446975] /pci@480: MSI first[0] num[512] mask[0x3ff] width[32]
[200453.520650] /pci@480: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200453.619043] /pci@480: MSI queues at RA [0000283f52000000]
[200453.684638] PCI: Scanning PBM /pci@480
[200453.729975] pci_sun4v f03351ec: PCI host bridge to bus 0006:00
[200453.802032] pci_bus 0006:00: root bus resource [io  0x81c000000000-0x81c00fffffff] (bus address [0x0000-0xfffffff])
[200453.928505] pci_bus 0006:00: root bus resource [mem 0x818000000000-0x81807effffff] (bus address [0x00000000-0x7effffff])
[200454.060032] pci_bus 0006:00: root bus resource [mem 0x818100000000-0x8187ffffffff] (bus address [0x100000000-0x7ffffffff])
[200454.193662] pci_bus 0006:00: root bus resource [bus 00-e2]
[200454.259973] PCI: scan_bus[/pci@480] bus no 0
[200454.311558]   * /pci@480/pci@1
[200454.348538]     create device, devfn: 8, type: pciex
[200454.409765]     class: 0x60400 device name: 0006:00:01.0
[200454.473974]     adding to system ...
[200454.517521] pci 0006:00:01.0: PME# supported from D0 D3hot D3cold
[200454.591211] pci 0006:00:01.0: PME# disabled
[200454.644001] PCI: dev header type: 1
[200454.685113] of_scan_pci_bridge(/pci@480/pci@1)
[200454.738802]     Bridge bus range [1 --> 226]
[200454.790571]     Bridge ranges[fff8383fffb73b40] simba[0]
[200454.856482]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200454.965532]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200455.060807]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200455.168413]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200455.264176]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200455.370974]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200455.466738]     bus name: PCI Bus 0006:01
[200455.516030] PCI: scan_bus[/pci@480/pci@1] bus no 1
[200455.574556]   * /pci@480/pci@1/pci@0
[200455.618246]     create device, devfn: 0, type: pciex
[200455.678318]     class: 0x60400 device name: 0006:01:00.0
[200455.742859]     adding to system ...
[200455.786909] pci 0006:01:00.0: PME# supported from D0 D3hot D3cold
[200455.860599] pci 0006:01:00.0: PME# disabled
[200455.911321] PCI: dev header type: 1
[200455.953443] of_scan_pci_bridge(/pci@480/pci@1/pci@0)
[200456.013914]     Bridge bus range [2 --> 226]
[200456.065986]     Bridge ranges[fff8383fffb72a00] simba[0]
[200456.130197]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200456.238583]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200456.334345]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200456.442729]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200456.538493]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200456.646875]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200456.741622]     bus name: PCI Bus 0006:02
[200456.790051] PCI: scan_bus[/pci@480/pci@1/pci@0] bus no 2
[200456.854258]   * /pci@480/pci@1/pci@0/pci@4
[200456.903820]     create device, devfn: 20, type: pciex
[200456.964942]     class: 0x60400 device name: 0006:02:04.0
[200457.029149]     adding to system ...
[200457.073149] pci 0006:02:04.0: PME# supported from D0 D3hot D3cold
[200457.146840] pci 0006:02:04.0: PME# disabled
[200457.197531] PCI: dev header type: 1
[200457.238657] of_scan_pci_bridge(/pci@480/pci@1/pci@0/pci@4)
[200457.304967]     Bridge bus range [3 --> 226]
[200457.356777]     Bridge ranges[fff8383fffb716c0] simba[0]
[200457.420558]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200457.529678]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200457.625441]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200457.733824]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200457.828441]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200457.938482]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200458.034246]     bus name: PCI Bus 0006:03
[200458.082555] PCI: scan_bus[/pci@480/pci@1/pci@0/pci@4] bus no 3
[200458.153634] PCI: Claiming 0006:00:01.0: Resource 13: 000081c000000000..000081c007ffffff [101]
[200458.257409] PCI: Claiming 0006:00:01.0: Resource 14: 0000818000100000..00008180400fffff [200]
[200458.360752] PCI: Claiming 0006:00:01.0: Resource 15: 0000818100000000..00008187efffffff [10220c]
[200458.467369] PCI: Claiming 0006:01:00.0: Resource 13: 000081c000000000..000081c007ffffff [101]
[200458.570525] PCI: Claiming 0006:01:00.0: Resource 14: 0000818000100000..00008180400fffff [200]
[200458.673834] PCI: Claiming 0006:01:00.0: Resource 15: 0000818100000000..00008187efffffff [10220c]
[200458.781757] PCI: Claiming 0006:02:04.0: Resource 13: 000081c000000000..000081c007ffffff [101]
[200458.885499] PCI: Claiming 0006:02:04.0: Resource 14: 0000818000100000..00008180400fffff [200]
[200458.989539] PCI: Claiming 0006:02:04.0: Resource 15: 0000818100000000..00008187efffffff [10220c]
[200459.098223] /pci@4c0: SUN4V PCI Bus Module
[200459.147707] /pci@4c0: On NUMA node -1
[200459.192191] /pci@4c0: PCI IO[81c100000000] MEM[819000000000] MEM64[819100000000]
[200459.280439] /pci@4c0: Unable to request IOMMU resource.
[200459.425372] /pci@4c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[200459.505394] /pci@4c0: MSI first[0] num[512] mask[0x3ff] width[32]
[200459.580021] /pci@4c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200459.679185] /pci@4c0: MSI queues at RA [0000203f52400000]
[200459.745041] PCI: Scanning PBM /pci@4c0
[200459.790375] pci_sun4v f0344014: PCI host bridge to bus 0007:00
[200459.860898] pci_bus 0007:00: root bus resource [io  0x81c100000000-0x81c10fffffff] (bus address [0x0000-0xfffffff])
[200459.988693] pci_bus 0007:00: root bus resource [mem 0x819000000000-0x81907effffff] (bus address [0x00000000-0x7effffff])
[200460.120973] pci_bus 0007:00: root bus resource [mem 0x819100000000-0x8197ffffffff] (bus address [0x100000000-0x7ffffffff])
[200460.254604] pci_bus 0007:00: root bus resource [bus 00-e2]
[200460.320916] PCI: scan_bus[/pci@4c0] bus no 0
[200460.372501]   * /pci@4c0/pci@1
[200460.409497]     create device, devfn: 8, type: pciex
[200460.468568]     class: 0x60400 device name: 0007:00:01.0
[200460.532853]     adding to system ...
[200460.576303] pci 0007:00:01.0: PME# supported from D0 D3hot D3cold
[200460.650107] pci 0007:00:01.0: PME# disabled
[200460.701169] PCI: dev header type: 1
[200460.742281] of_scan_pci_bridge(/pci@4c0/pci@1)
[200460.796087]     Bridge bus range [1 --> 226]
[200460.847853]     Bridge ranges[fff8383fffb6e280] simba[0]
[200460.912356]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200461.021741]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200461.117801]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200461.226372]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200461.322134]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200461.430231]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200461.525993]     bus name: PCI Bus 0007:01
[200461.574423] PCI: scan_bus[/pci@4c0/pci@1] bus no 1
[200461.632530]   * /pci@4c0/pci@1/pci@0
[200461.675785]     create device, devfn: 0, type: pciex
[200461.735263]     class: 0x60400 device name: 0007:01:00.0
[200461.799496]     adding to system ...
[200461.842952] pci 0007:01:00.0: PME# supported from D0 D3hot D3cold
[200461.915993] pci 0007:01:00.0: PME# disabled
[200461.966722] PCI: dev header type: 1
[200462.008844] of_scan_pci_bridge(/pci@4c0/pci@1/pci@0)
[200462.068845]     Bridge bus range [2 --> 226]
[200462.120611]     Bridge ranges[fff8383fffb6d140] simba[0]
[200462.184822]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200462.293207]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200462.388970]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200462.497736]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200462.592878]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200462.701661]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200462.799070]     bus name: PCI Bus 0007:02
[200462.847499] PCI: scan_bus[/pci@4c0/pci@1/pci@0] bus no 2
[200462.911707]   * /pci@4c0/pci@1/pci@0/pci@8
[200462.961734]     create device, devfn: 40, type: pciex
[200463.023844]     class: 0x60400 device name: 0007:02:08.0
[200463.088415]     adding to system ...
[200463.131920] pci 0007:02:08.0: PME# supported from D0 D3hot D3cold
[200463.205611] pci 0007:02:08.0: PME# disabled
[200463.253771] PCI: dev header type: 1
[200463.294993] of_scan_pci_bridge(/pci@4c0/pci@1/pci@0/pci@8)
[200463.361593]     Bridge bus range [3 --> 226]
[200463.413408]     Bridge ranges[fff8383fffb6be00] simba[0]
[200463.478129]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200463.586306]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200463.681317]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200463.785377]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200463.881637]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200463.991411]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200464.087295]     bus name: PCI Bus 0007:03
[200464.135725] PCI: scan_bus[/pci@4c0/pci@1/pci@0/pci@8] bus no 3
[200464.205862] PCI: Claiming 0007:00:01.0: Resource 13: 000081c100000000..000081c107ffffff [101]
[200464.308990] PCI: Claiming 0007:00:01.0: Resource 14: 0000819000100000..00008190400fffff [200]
[200464.412117] PCI: Claiming 0007:00:01.0: Resource 15: 0000819100000000..00008197efffffff [10220c]
[200464.518397] PCI: Claiming 0007:01:00.0: Resource 13: 000081c100000000..000081c107ffffff [101]
[200464.621522] PCI: Claiming 0007:01:00.0: Resource 14: 0000819000100000..00008190400fffff [200]
[200464.724648] PCI: Claiming 0007:01:00.0: Resource 15: 0000819100000000..00008197efffffff [10220c]
[200464.831307] PCI: Claiming 0007:02:08.0: Resource 13: 000081c100000000..000081c107ffffff [101]
[200464.934695] PCI: Claiming 0007:02:08.0: Resource 14: 0000819000100000..00008190400fffff [200]
[200465.037964] PCI: Claiming 0007:02:08.0: Resource 15: 0000819100000000..00008197efffffff [10220c]
[200465.144367] /pci@500: SUN4V PCI Bus Module
[200465.193852] /pci@500: On NUMA node -1
[200465.239077] /pci@500: PCI IO[824000000000] MEM[820000000000] MEM64[820100000000]
[200465.326517] /pci@500: Unable to request IOMMU resource.
[200465.470981] /pci@500: MSI Queue first[0] num[56] count[512] devino[0x6]
[200465.551214] /pci@500: MSI first[0] num[512] mask[0x3ff] width[32]
[200465.625254] /pci@500: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200465.724174] /pci@500: MSI queues at RA [0000203f52600000]
[200465.789434] PCI: Scanning PBM /pci@500
[200465.834776] pci_sun4v f0352e3c: PCI host bridge to bus 0008:00
[200465.905301] pci_bus 0008:00: root bus resource [io  0x824000000000-0x82400fffffff] (bus address [0x0000-0xfffffff])
[200466.031839] pci_bus 0008:00: root bus resource [mem 0x820000000000-0x82007effffff] (bus address [0x00000000-0x7effffff])
[200466.163518] pci_bus 0008:00: root bus resource [mem 0x820100000000-0x8207ffffffff] (bus address [0x100000000-0x7ffffffff])
[200466.297151] pci_bus 0008:00: root bus resource [bus 00-e2]
[200466.363462] PCI: scan_bus[/pci@500] bus no 0
[200466.415048]   * /pci@500/pci@1
[200466.452176]     create device, devfn: 8, type: pciex
[200466.513054]     class: 0x60400 device name: 0008:00:01.0
[200466.577608]     adding to system ...
[200466.621057] pci 0008:00:01.0: PME# supported from D0 D3hot D3cold
[200466.694748] pci 0008:00:01.0: PME# disabled
[200466.745424] PCI: dev header type: 1
[200466.788676] of_scan_pci_bridge(/pci@500/pci@1)
[200466.842367]     Bridge bus range [1 --> 226]
[200466.894259]     Bridge ranges[fff8383fffb689c0] simba[0]
[200466.959267]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200467.068411]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200467.165551]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200467.275119]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200467.371680]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200467.480067]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200467.574578]     bus name: PCI Bus 0008:01
[200467.622605] PCI: scan_bus[/pci@500/pci@1] bus no 1
[200467.681012]   * /pci@500/pci@1/pci@0
[200467.724264]     create device, devfn: 0, type: pciex
[200467.785507]     class: 0x60400 device name: 0008:01:00.0
[200467.849715]     adding to system ...
[200467.893169] pci 0008:01:00.0: PME# supported from D0 D3hot D3cold
[200467.966858] pci 0008:01:00.0: PME# disabled
[200468.018178] PCI: dev header type: 1
[200468.060583] of_scan_pci_bridge(/pci@500/pci@1/pci@0)
[200468.120584]     Bridge bus range [2 --> 226]
[200468.172351]     Bridge ranges[fff8383fffb67880] simba[0]
[200468.236563]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200468.344947]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200468.441299]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200468.549768]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200468.645534]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200468.753918]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200468.848117]     bus name: PCI Bus 0008:02
[200468.896580] PCI: scan_bus[/pci@500/pci@1/pci@0] bus no 2
[200468.960789]   * /pci@500/pci@1/pci@0/pci@e
[200469.010355]     create device, devfn: 70, type: pciex
[200469.071729]     class: 0x60400 device name: 0008:02:0e.0
[200469.136062]     adding to system ...
[200469.178758] pci 0008:02:0e.0: PME# supported from D0 D3hot D3cold
[200469.252448] pci 0008:02:0e.0: PME# disabled
[200469.303138] PCI: dev header type: 1
[200469.344265] of_scan_pci_bridge(/pci@500/pci@1/pci@0/pci@e)
[200469.410575]     Bridge bus range [3 --> 226]
[200469.462384]     Bridge ranges[fff8383fffb66540] simba[0]
[200469.527569]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200469.633931]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200469.729694]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200469.837879]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200469.933643]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200470.042632]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200470.138396]     bus name: PCI Bus 0008:03
[200470.187151] PCI: scan_bus[/pci@500/pci@1/pci@0/pci@e] bus no 3
[200470.258366] PCI: Claiming 0008:00:01.0: Resource 13: 0000824000000000..0000824007ffffff [101]
[200470.362354] PCI: Claiming 0008:00:01.0: Resource 14: 0000820000100000..00008200400fffff [200]
[200470.465980] PCI: Claiming 0008:00:01.0: Resource 15: 0000820100000000..00008207efffffff [10220c]
[200470.569512] PCI: Claiming 0008:01:00.0: Resource 13: 0000824000000000..0000824007ffffff [101]
[200470.673415] PCI: Claiming 0008:01:00.0: Resource 14: 0000820000100000..00008200400fffff [200]
[200470.777417] PCI: Claiming 0008:01:00.0: Resource 15: 0000820100000000..00008207efffffff [10220c]
[200470.883243] PCI: Claiming 0008:02:0e.0: Resource 13: 0000824000000000..0000824007ffffff [101]
[200470.986748] PCI: Claiming 0008:02:0e.0: Resource 14: 0000820000100000..00008200400fffff [200]
[200471.089966] PCI: Claiming 0008:02:0e.0: Resource 15: 0000820100000000..00008207efffffff [10220c]
[200471.199466] /pci@540: SUN4V PCI Bus Module
[200471.247941] /pci@540: On NUMA node -1
[200471.292816] /pci@540: PCI IO[824100000000] MEM[821000000000] MEM64[821100000000]
[200471.381185] /pci@540: Unable to request IOMMU resource.
[200471.525601] /pci@540: MSI Queue first[0] num[56] count[512] devino[0x6]
[200471.606703] /pci@540: MSI first[0] num[512] mask[0x3ff] width[32]
[200471.680695] /pci@540: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200471.780514] /pci@540: MSI queues at RA [0000103f52200000]
[200471.845965] PCI: Scanning PBM /pci@540
[200471.889798] pci_sun4v f0361c64: PCI host bridge to bus 0009:00
[200471.959650] pci_bus 0009:00: root bus resource [io  0x824100000000-0x82410fffffff] (bus address [0x0000-0xfffffff])
[200472.086177] pci_bus 0009:00: root bus resource [mem 0x821000000000-0x82107effffff] (bus address [0x00000000-0x7effffff])
[200472.219730] pci_bus 0009:00: root bus resource [mem 0x821100000000-0x8217ffffffff] (bus address [0x100000000-0x7ffffffff])
[200472.355139] pci_bus 0009:00: root bus resource [bus 00-e2]
[200472.421450] PCI: scan_bus[/pci@540] bus no 0
[200472.473036]   * /pci@540/pci@1
[200472.510024]     create device, devfn: 8, type: pciex
[200472.569094]     class: 0x60400 device name: 0009:00:01.0
[200472.633303]     adding to system ...
[200472.676751] pci 0009:00:01.0: PME# supported from D0 D3hot D3cold
[200472.750442] pci 0009:00:01.0: PME# disabled
[200472.801120] PCI: dev header type: 1
[200472.842231] of_scan_pci_bridge(/pci@540/pci@1)
[200472.895920]     Bridge bus range [1 --> 226]
[200472.947691]     Bridge ranges[fff8383fffb63100] simba[0]
[200473.012933]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200473.120958]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200473.218027]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200473.327340]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200473.423103]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200473.532324]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200473.628940]     bus name: PCI Bus 0009:01
[200473.676499] PCI: scan_bus[/pci@540/pci@1] bus no 1
[200473.734513]   * /pci@540/pci@1/pci@0
[200473.778001]     create device, devfn: 0, type: pciex
[200473.838073]     class: 0x60400 device name: 0009:01:00.0
[200473.903118]     adding to system ...
[200473.946083] pci 0009:01:00.0: PME# supported from D0 D3hot D3cold
[200474.019772] pci 0009:01:00.0: PME# disabled
[200474.071026] PCI: dev header type: 1
[200474.113546] of_scan_pci_bridge(/pci@540/pci@1/pci@0)
[200474.173547]     Bridge bus range [2 --> 226]
[200474.225317]     Bridge ranges[fff8383fffb61fc0] simba[0]
[200474.289527]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200474.399499]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200474.495261]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200474.603985]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200474.699749]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200474.808132]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200474.903894]     bus name: PCI Bus 0009:02
[200474.952322] PCI: scan_bus[/pci@540/pci@1/pci@0] bus no 2
[200475.016531]   * /pci@540/pci@1/pci@0/pci@e
[200475.066094]     create device, devfn: 70, type: pciex
[200475.127217]     class: 0x60400 device name: 0009:02:0e.0
[200475.192109]     adding to system ...
[200475.235615] pci 0009:02:0e.0: PME# supported from D0 D3hot D3cold
[200475.309378] pci 0009:02:0e.0: PME# disabled
[200475.360071] PCI: dev header type: 1
[200475.401755] of_scan_pci_bridge(/pci@540/pci@1/pci@0/pci@e)
[200475.468069]     Bridge bus range [3 --> 226]
[200475.519880]     Bridge ranges[fff8383fffb60c80] simba[0]
[200475.584181]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200475.693694]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200475.789456]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200475.897454]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200475.993216]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200476.101687]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200476.197504]     bus name: PCI Bus 0009:03
[200476.245934] PCI: scan_bus[/pci@540/pci@1/pci@0/pci@e] bus no 3
[200476.317522] PCI: Claiming 0009:00:01.0: Resource 13: 0000824100000000..0000824107ffffff [101]
[200476.420071] PCI: Claiming 0009:00:01.0: Resource 14: 0000821000100000..00008210400fffff [200]
[200476.524736] PCI: Claiming 0009:00:01.0: Resource 15: 0000821100000000..00008217efffffff [10220c]
[200476.631512] PCI: Claiming 0009:01:00.0: Resource 13: 0000824100000000..0000824107ffffff [101]
[200476.735041] PCI: Claiming 0009:01:00.0: Resource 14: 0000821000100000..00008210400fffff [200]
[200476.838739] PCI: Claiming 0009:01:00.0: Resource 15: 0000821100000000..00008217efffffff [10220c]
[200476.945019] PCI: Claiming 0009:02:0e.0: Resource 13: 0000824100000000..0000824107ffffff [101]
[200477.048145] PCI: Claiming 0009:02:0e.0: Resource 14: 0000821000100000..00008210400fffff [200]
[200477.151271] PCI: Claiming 0009:02:0e.0: Resource 15: 0000821100000000..00008217efffffff [10220c]
[200477.258180] /pci@580: SUN4V PCI Bus Module
[200477.307665] /pci@580: On NUMA node -1
[200477.352629] /pci@580: PCI IO[82c000000000] MEM[828000000000] MEM64[828100000000]
[200477.440069] /pci@580: Unable to request IOMMU resource.
[200477.584484] /pci@580: MSI Queue first[0] num[56] count[512] devino[0x6]
[200477.664478] /pci@580: MSI first[0] num[512] mask[0x3ff] width[32]
[200477.738154] /pci@580: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200477.837810] /pci@580: MSI queues at RA [0000103f52400000]
[200477.903202] PCI: Scanning PBM /pci@580
[200477.949188] pci_sun4v f0370a8c: PCI host bridge to bus 000a:00
[200478.019910] pci_bus 000a:00: root bus resource [io  0x82c000000000-0x82c00fffffff] (bus address [0x0000-0xfffffff])
[200478.146178] pci_bus 000a:00: root bus resource [mem 0x828000000000-0x82807effffff] (bus address [0x00000000-0x7effffff])
[200478.278543] pci_bus 000a:00: root bus resource [mem 0x828100000000-0x8287ffffffff] (bus address [0x100000000-0x7ffffffff])
[200478.412815] pci_bus 000a:00: root bus resource [bus 00-e2]
[200478.479126] PCI: scan_bus[/pci@580] bus no 0
[200478.530711]   * /pci@580/pci@1
[200478.567834]     create device, devfn: 8, type: pciex
[200478.627915]     class: 0x60400 device name: 000a:00:01.0
[200478.692124]     adding to system ...
[200478.735574] pci 000a:00:01.0: PME# supported from D0 D3hot D3cold
[200478.809263] pci 000a:00:01.0: PME# disabled
[200478.859939] PCI: dev header type: 1
[200478.901049] of_scan_pci_bridge(/pci@580/pci@1)
[200478.954739]     Bridge bus range [1 --> 226]
[200479.006510]     Bridge ranges[fff8383fffb5d840] simba[0]
[200479.070800]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200479.177961]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200479.274502]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200479.380497]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200479.476491]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200479.584088]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200479.679335]     bus name: PCI Bus 000a:01
[200479.728010] PCI: scan_bus[/pci@580/pci@1] bus no 1
[200479.785906]   * /pci@580/pci@1/pci@0
[200479.829157]     create device, devfn: 0, type: pciex
[200479.888616]     class: 0x60400 device name: 000a:01:00.0
[200479.953152]     adding to system ...
[200479.995129] pci 000a:01:00.0: PME# supported from D0 D3hot D3cold
[200480.070138] pci 000a:01:00.0: PME# disabled
[200480.119986] PCI: dev header type: 1
[200480.162108] of_scan_pci_bridge(/pci@580/pci@1/pci@0)
[200480.222594]     Bridge bus range [2 --> 226]
[200480.275416]     Bridge ranges[fff8383fffb5c700] simba[0]
[200480.339762]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200480.448602]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200480.544763]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200480.653147]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200480.748911]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200480.857294]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200480.953462]     bus name: PCI Bus 000a:02
[200481.001890] PCI: scan_bus[/pci@580/pci@1/pci@0] bus no 2
[200481.065137]   * /pci@580/pci@1/pci@0/pci@a
[200481.114086]     create device, devfn: 50, type: pciex
[200481.175442]     class: 0x60400 device name: 000a:02:0a.0
[200481.239649]     adding to system ...
[200481.283156] pci 000a:02:0a.0: PME# supported from D0 D3hot D3cold
[200481.356846] pci 000a:02:0a.0: PME# disabled
[200481.407534] PCI: dev header type: 1
[200481.449760] of_scan_pci_bridge(/pci@580/pci@1/pci@0/pci@a)
[200481.516391]     Bridge bus range [3 --> 226]
[200481.568204]     Bridge ranges[fff8383fffb5b3c0] simba[0]
[200481.631949]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200481.740334]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200481.836096]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200481.944208]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200482.039971]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200482.149165]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200482.244928]     bus name: PCI Bus 000a:03
[200482.293871] PCI: scan_bus[/pci@580/pci@1/pci@0/pci@a] bus no 3
[200482.364946] PCI: Claiming 000a:00:01.0: Resource 13: 000082c000000000..000082c007ffffff [101]
[200482.468426] PCI: Claiming 000a:00:01.0: Resource 14: 0000828000100000..00008280400fffff [200]
[200482.571552] PCI: Claiming 000a:00:01.0: Resource 15: 0000828100000000..00008287efffffff [10220c]
[200482.675390] PCI: Claiming 000a:01:00.0: Resource 13: 000082c000000000..000082c007ffffff [101]
[200482.778739] PCI: Claiming 000a:01:00.0: Resource 14: 0000828000100000..00008280400fffff [200]
[200482.882416] PCI: Claiming 000a:01:00.0: Resource 15: 0000828100000000..00008287efffffff [10220c]
[200482.988696] PCI: Claiming 000a:02:0a.0: Resource 13: 000082c000000000..000082c007ffffff [101]
[200483.091821] PCI: Claiming 000a:02:0a.0: Resource 14: 0000828000100000..00008280400fffff [200]
[200483.195830] PCI: Claiming 000a:02:0a.0: Resource 15: 0000828100000000..00008287efffffff [10220c]
[200483.302227] /pci@5c0: SUN4V PCI Bus Module
[200483.351976] /pci@5c0: On NUMA node -1
[200483.396471] /pci@5c0: PCI IO[82c100000000] MEM[829000000000] MEM64[829100000000]
[200483.484448] /pci@5c0: Unable to request IOMMU resource.
[200483.628868] /pci@5c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[200483.709641] /pci@5c0: MSI first[0] num[512] mask[0x3ff] width[32]
[200483.783316] /pci@5c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200483.883234] /pci@5c0: MSI queues at RA [0000083f52000000]
[200483.948493] PCI: Scanning PBM /pci@5c0
[200483.995085] pci_sun4v f037f8b4: PCI host bridge to bus 000b:00
[200484.067886] pci_bus 000b:00: root bus resource [io  0x82c100000000-0x82c10fffffff] (bus address [0x0000-0xfffffff])
[200484.193513] pci_bus 000b:00: root bus resource [mem 0x829000000000-0x82907effffff] (bus address [0x00000000-0x7effffff])
[200484.326623] pci_bus 000b:00: root bus resource [mem 0x829100000000-0x8297ffffffff] (bus address [0x100000000-0x7ffffffff])
[200484.460571] pci_bus 000b:00: root bus resource [bus 00-72]
[200484.526090] PCI: scan_bus[/pci@5c0] bus no 0
[200484.577676]   * /pci@5c0/pci@1
[200484.613590]     create device, devfn: 8, type: pciex
[200484.671208]     class: 0x60400 device name: 000b:00:01.0
[200484.735888]     adding to system ...
[200484.779337] pci 000b:00:01.0: PME# supported from D0 D3hot D3cold
[200484.853832] pci 000b:00:01.0: PME# disabled
[200484.905005] PCI: dev header type: 1
[200484.946876] of_scan_pci_bridge(/pci@5c0/pci@1)
[200485.000566]     Bridge bus range [1 --> 114]
[200485.052332]     Bridge ranges[fff8383fffb57f80] simba[0]
[200485.117720]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04000000]
[200485.223199]       Using flags[00000101] start[0000000000000000] size[0000000004000000]
[200485.319589]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20000000]
[200485.429013]       Using flags[00000200] start[0000000000100000] size[0000000020000000]
[200485.524813]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:80000000]
[200485.635428]       Using flags[0010220c] start[0000000100000000] size[0000000380000000]
[200485.731261]     bus name: PCI Bus 000b:01
[200485.780341] PCI: scan_bus[/pci@5c0/pci@1] bus no 1
[200485.839309]   * /pci@5c0/pci@1/pci@0
[200485.882564]     create device, devfn: 0, type: pciex
[200485.942635]     class: 0x60400 device name: 000b:01:00.0
[200486.006842]     adding to system ...
[200486.050294] pci 000b:01:00.0: PME# supported from D0 D3hot D3cold
[200486.123983] pci 000b:01:00.0: PME# disabled
[200486.174705] PCI: dev header type: 1
[200486.216828] of_scan_pci_bridge(/pci@5c0/pci@1/pci@0)
[200486.276827]     Bridge bus range [2 --> 114]
[200486.328594]     Bridge ranges[fff8383fffb56d40] simba[0]
[200486.392805]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04000000]
[200486.499972]       Using flags[00000101] start[0000000000000000] size[0000000004000000]
[200486.594884]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20000000]
[200486.703435]       Using flags[00000200] start[0000000000100000] size[0000000020000000]
[200486.799199]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:80000000]
[200486.905074]       Using flags[0010220c] start[0000000100000000] size[0000000380000000]
[200487.000837]     bus name: PCI Bus 000b:02
[200487.049265] PCI: scan_bus[/pci@5c0/pci@1/pci@0] bus no 2
[200487.113473]   * /pci@5c0/pci@1/pci@0/pci@8
[200487.163134]     create device, devfn: 40, type: pciex
[200487.224433]     class: 0x60400 device name: 000b:02:08.0
[200487.288640]     adding to system ...
[200487.332169] pci 000b:02:08.0: PME# supported from D0 D3hot D3cold
[200487.406238] pci 000b:02:08.0: PME# disabled
[200487.456924] PCI: dev header type: 1
[200487.498036] of_scan_pci_bridge(/pci@5c0/pci@1/pci@0/pci@8)
[200487.564883]     Bridge bus range [3 --> 114]
[200487.616690]     Bridge ranges[fff8383fffaad780] simba[0]
[200487.680901]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04000000]
[200487.789284]       Using flags[00000101] start[0000000000000000] size[0000000004000000]
[200487.885047]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20000000]
[200487.993431]       Using flags[00000200] start[0000000000100000] size[0000000020000000]
[200488.089194]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:78000000]
[200488.197379]       Using flags[0010220c] start[0000000100000000] size[0000000378000000]
[200488.293142]     bus name: PCI Bus 000b:03
[200488.341573] PCI: scan_bus[/pci@5c0/pci@1/pci@0/pci@8] bus no 3
[200488.413864] PCI: Claiming 000b:00:01.0: Resource 13: 000082c100000000..000082c103ffffff [101]
[200488.517753] PCI: Claiming 000b:00:01.0: Resource 14: 0000829000100000..00008290200fffff [200]
[200488.618391] PCI: Claiming 000b:00:01.0: Resource 15: 0000829100000000..000082947fffffff [10220c]
[200488.724672] PCI: Claiming 000b:01:00.0: Resource 13: 000082c100000000..000082c103ffffff [101]
[200488.829758] PCI: Claiming 000b:01:00.0: Resource 14: 0000829000100000..00008290200fffff [200]
[200488.933921] PCI: Claiming 000b:01:00.0: Resource 15: 0000829100000000..000082947fffffff [10220c]
[200489.040202] PCI: Claiming 000b:02:08.0: Resource 13: 000082c100000000..000082c103ffffff [101]
[200489.144861] PCI: Claiming 000b:02:08.0: Resource 14: 0000829000100000..00008290200fffff [200]
[200489.248674] PCI: Claiming 000b:02:08.0: Resource 15: 0000829100000000..0000829477ffffff [10220c]
[200489.355575] /pci@600: SUN4V PCI Bus Module
[200489.405059] /pci@600: On NUMA node -1
[200489.449283] /pci@600: PCI IO[834000000000] MEM[830000000000] MEM64[830100000000]
[200489.535855] /pci@600: Unable to request IOMMU resource.
[200489.680491] /pci@600: MSI Queue first[0] num[56] count[512] devino[0x6]
[200489.760484] /pci@600: MSI first[0] num[512] mask[0x3ff] width[32]
[200489.834158] /pci@600: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200489.933078] /pci@600: MSI queues at RA [0000083f52200000]
[200489.998514] PCI: Scanning PBM /pci@600
[200490.043945] pci_sun4v f038e6dc: PCI host bridge to bus 000c:00
[200490.114685] pci_bus 000c:00: root bus resource [io  0x834000000000-0x83400fffffff] (bus address [0x0000-0xfffffff])
[200490.240959] pci_bus 000c:00: root bus resource [mem 0x830000000000-0x83007effffff] (bus address [0x00000000-0x7effffff])
[200490.372485] pci_bus 000c:00: root bus resource [mem 0x830100000000-0x8307ffffffff] (bus address [0x100000000-0x7ffffffff])
[200490.506175] pci_bus 000c:00: root bus resource [bus 00-e2]
[200490.571237] PCI: scan_bus[/pci@600] bus no 0
[200490.622822]   * /pci@600/pci@1
[200490.660406]     create device, devfn: 8, type: pciex
[200490.720507]     class: 0x60400 device name: 000c:00:01.0
[200490.784715]     adding to system ...
[200490.828167] pci 000c:00:01.0: PME# supported from D0 D3hot D3cold
[200490.902481] pci 000c:00:01.0: PME# disabled
[200490.953149] PCI: dev header type: 1
[200490.994661] of_scan_pci_bridge(/pci@600/pci@1)
[200491.048447]     Bridge bus range [1 --> 226]
[200491.100214]     Bridge ranges[fff8383fff9aa340] simba[0]
[200491.164426]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200491.272811]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200491.368575]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200491.476959]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200491.572722]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200491.682545]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200491.778835]     bus name: PCI Bus 000c:01
[200491.827265] PCI: scan_bus[/pci@600/pci@1] bus no 1
[200491.886208]   * /pci@600/pci@1/pci@0
[200491.929462]     create device, devfn: 0, type: pciex
[200491.989535]     class: 0x60400 device name: 000c:01:00.0
[200492.053743]     adding to system ...
[200492.097898] pci 000c:01:00.0: PME# supported from D0 D3hot D3cold
[200492.170593] pci 000c:01:00.0: PME# disabled
[200492.221816] PCI: dev header type: 1
[200492.263938] of_scan_pci_bridge(/pci@600/pci@1/pci@0)
[200492.325733]     Bridge bus range [2 --> 226]
[200492.377971]     Bridge ranges[fff8383fff9a9200] simba[0]
[200492.441692]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200492.550480]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200492.643801]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200492.754311]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200492.850006]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200492.958389]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200493.052006]     bus name: PCI Bus 000c:02
[200493.100435] PCI: scan_bus[/pci@600/pci@1/pci@0] bus no 2
[200493.164902]   * /pci@600/pci@1/pci@0/pci@8
[200493.214466]     create device, devfn: 40, type: pciex
[200493.275127]     class: 0x60400 device name: 000c:02:08.0
[200493.339334]     adding to system ...
[200493.382840] pci 000c:02:08.0: PME# supported from D0 D3hot D3cold
[200493.456530] pci 000c:02:08.0: PME# disabled
[200493.507222] PCI: dev header type: 1
[200493.548350] of_scan_pci_bridge(/pci@600/pci@1/pci@0/pci@8)
[200493.614661]     Bridge bus range [3 --> 226]
[200493.666470]     Bridge ranges[fff8383fff9a7ec0] simba[0]
[200493.730680]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200493.839346]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200493.933412]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200494.041796]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200494.138988]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200494.247915]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200494.343708]     bus name: PCI Bus 000c:03
[200494.392139] PCI: scan_bus[/pci@600/pci@1/pci@0/pci@8] bus no 3
[200494.462668] PCI: Claiming 000c:00:01.0: Resource 13: 0000834000000000..0000834007ffffff [101]
[200494.566079] PCI: Claiming 000c:00:01.0: Resource 14: 0000830000100000..00008300400fffff [200]
[200494.669461] PCI: Claiming 000c:00:01.0: Resource 15: 0000830100000000..00008307efffffff [10220c]
[200494.775743] PCI: Claiming 000c:01:00.0: Resource 13: 0000834000000000..0000834007ffffff [101]
[200494.880313] PCI: Claiming 000c:01:00.0: Resource 14: 0000830000100000..00008300400fffff [200]
[200494.981775] PCI: Claiming 000c:01:00.0: Resource 15: 0000830100000000..00008307efffffff [10220c]
[200495.088953] PCI: Claiming 000c:02:08.0: Resource 13: 0000834000000000..0000834007ffffff [101]
[200495.192414] PCI: Claiming 000c:02:08.0: Resource 14: 0000830000100000..00008300400fffff [200]
[200495.294610] PCI: Claiming 000c:02:08.0: Resource 15: 0000830100000000..00008307efffffff [10220c]
[200495.401015] /pci@640: SUN4V PCI Bus Module
[200495.450709] /pci@640: On NUMA node -1
[200495.494932] /pci@640: PCI IO[834100000000] MEM[831000000000] MEM64[831100000000]
[200495.582487] /pci@640: Unable to request IOMMU resource.
[200495.724218] /pci@640: MSI Queue first[0] num[56] count[512] devino[0x6]
[200495.804853] /pci@640: MSI first[0] num[512] mask[0x3ff] width[32]
[200495.878527] /pci@640: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200495.975868] /pci@640: MSI queues at RA [0000083f52400000]
[200496.041525] PCI: Scanning PBM /pci@640
[200496.086870] pci_sun4v f039d504: PCI host bridge to bus 000d:00
[200496.157394] pci_bus 000d:00: root bus resource [io  0x834100000000-0x83410fffffff] (bus address [0x0000-0xfffffff])
[200496.286036] pci_bus 000d:00: root bus resource [mem 0x831000000000-0x83107effffff] (bus address [0x00000000-0x7effffff])
[200496.416034] pci_bus 000d:00: root bus resource [mem 0x831100000000-0x8317ffffffff] (bus address [0x100000000-0x7ffffffff])
[200496.550190] pci_bus 000d:00: root bus resource [bus 00-e2]
[200496.616653] PCI: scan_bus[/pci@640] bus no 0
[200496.668586]   * /pci@640/pci@1
[200496.705576]     create device, devfn: 8, type: pciex
[200496.765140]     class: 0x60400 device name: 000d:00:01.0
[200496.830252]     adding to system ...
[200496.874054] pci 000d:00:01.0: PME# supported from D0 D3hot D3cold
[200496.947745] pci 000d:00:01.0: PME# disabled
[200496.998421] PCI: dev header type: 1
[200497.039869] of_scan_pci_bridge(/pci@640/pci@1)
[200497.093793]     Bridge bus range [1 --> 226]
[200497.145959]     Bridge ranges[fff8383fff9a4a80] simba[0]
[200497.210518]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200497.319985]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200497.417254]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200497.524999]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200497.620765]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200497.729020]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200497.824782]     bus name: PCI Bus 000d:01
[200497.873780] PCI: scan_bus[/pci@640/pci@1] bus no 1
[200497.932213]   * /pci@640/pci@1/pci@0
[200497.975466]     create device, devfn: 0, type: pciex
[200498.035538]     class: 0x60400 device name: 000d:01:00.0
[200498.100619]     adding to system ...
[200498.144541] pci 000d:01:00.0: PME# supported from D0 D3hot D3cold
[200498.218232] pci 000d:01:00.0: PME# disabled
[200498.268960] PCI: dev header type: 1
[200498.311081] of_scan_pci_bridge(/pci@640/pci@1/pci@0)
[200498.371081]     Bridge bus range [2 --> 226]
[200498.422849]     Bridge ranges[fff8383fff9a3940] simba[0]
[200498.486050]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200498.594587]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200498.690349]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200498.797579]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200498.893586]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200499.000456]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200499.096219]     bus name: PCI Bus 000d:02
[200499.144647] PCI: scan_bus[/pci@640/pci@1/pci@0] bus no 2
[200499.208947]   * /pci@640/pci@1/pci@0/pci@8
[200499.259021]     create device, devfn: 40, type: pciex
[200499.320144]     class: 0x60400 device name: 000d:02:08.0
[200499.384843]     adding to system ...
[200499.428350] pci 000d:02:08.0: PME# supported from D0 D3hot D3cold
[200499.502039] pci 000d:02:08.0: PME# disabled
[200499.553395] PCI: dev header type: 1
[200499.594523] of_scan_pci_bridge(/pci@640/pci@1/pci@0/pci@8)
[200499.660835]     Bridge bus range [3 --> 226]
[200499.712646]     Bridge ranges[fff8383fff9a2600] simba[0]
[200499.775488]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200499.883872]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200499.977324]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200500.085707]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200500.181470]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200500.289854]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200500.385618]     bus name: PCI Bus 000d:03
[200500.433077] PCI: scan_bus[/pci@640/pci@1/pci@0/pci@8] bus no 3
[200500.504964]   * /pci@640/pci@1/pci@0/pci@8/SUNW,emlxs@0
[200500.568201]     create device, devfn: 0, type: scsi-fcp
[200500.631859]     class: 0xc0400 device name: 000d:03:00.0
[200500.694865]     parse addresses (80 bytes) @ fff8383fff9a1240
[200500.764332]   start: 831100000000, end: 831100001fff, i: 10
[200500.831799]   start: 831100004000, end: 831100007fff, i: 18
[200500.899914]   start: 834100000000, end: 8341000000ff, i: 20
[200500.967276]   start: 831000100000, end: 83100013ffff, i: 30
[200501.034838]     adding to system ...
[200501.076925] pci 000d:03:00.0: reg 0x10 [mem 0x831100000000-0x831100001fff 64bit] + pref
[200501.174211] pci 000d:03:00.0: reg 0x18 [mem 0x831100004000-0x831100007fff 64bit] + pref
[200501.271292] PCI: dev header type: 0
[200501.314406]   * /pci@640/pci@1/pci@0/pci@8/SUNW,emlxs@0,1
[200501.379748]     create device, devfn: 1, type: scsi-fcp
[200501.443053]     class: 0xc0400 device name: 000d:03:00.1
[200501.507259]     parse addresses (80 bytes) @ fff8383fff99e240
[200501.576726]   start: 831100002000, end: 831100003fff, i: 10
[200501.644699]   start: 831100008000, end: 83110000bfff, i: 18
[200501.712547]   start: 834100000100, end: 8341000001ff, i: 20
[200501.778692]   start: 831000140000, end: 83100017ffff, i: 30
[200501.846053]     adding to system ...
[200501.890452] pci 000d:03:00.1: reg 0x10 [mem 0x831100002000-0x831100003fff 64bit] + pref
[200501.987269] pci 000d:03:00.1: reg 0x18 [mem 0x831100008000-0x83110000bfff 64bit] + pref
[200502.084153] PCI: dev header type: 0
[200502.126289] PCI: Claiming 000d:00:01.0: Resource 13: 0000834100000000..0000834107ffffff [101]
[200502.229415] PCI: Claiming 000d:00:01.0: Resource 14: 0000831000100000..00008310400fffff [200]
[200502.332542] PCI: Claiming 000d:00:01.0: Resource 15: 0000831100000000..00008317efffffff [10220c]
[200502.440070] PCI: Claiming 000d:01:00.0: Resource 13: 0000834100000000..0000834107ffffff [101]
[200502.544452] PCI: Claiming 000d:01:00.0: Resource 14: 0000831000100000..00008310400fffff [200]
[200502.648373] PCI: Claiming 000d:01:00.0: Resource 15: 0000831100000000..00008317efffffff [10220c]
[200502.755557] PCI: Claiming 000d:02:08.0: Resource 13: 0000834100000000..0000834107ffffff [101]
[200502.858944] PCI: Claiming 000d:02:08.0: Resource 14: 0000831000100000..00008310400fffff [200]
[200502.960830] PCI: Claiming 000d:02:08.0: Resource 15: 0000831100000000..00008317efffffff [10220c]
[200503.067816] PCI: Claiming 000d:03:00.0: Resource 0: 0000831100000000..0000831100001fff [102204]
[200503.173047] PCI: Claiming 000d:03:00.0: Resource 2: 0000831100004000..0000831100007fff [102204]
[200503.278276] PCI: Claiming 000d:03:00.0: Resource 4: 0000834100000000..00008341000000ff [101]
[200503.380311] PCI: Claiming 000d:03:00.0: Resource 6: 0000831000100000..000083100013ffff [4c200]
[200503.483674] PCI: Claiming 000d:03:00.1: Resource 0: 0000831100002000..0000831100003fff [102204]
[200503.588200] PCI: Claiming 000d:03:00.1: Resource 2: 0000831100008000..000083110000bfff [102204]
[200503.693429] PCI: Claiming 000d:03:00.1: Resource 4: 0000834100000100..00008341000001ff [101]
[200503.796903] PCI: Claiming 000d:03:00.1: Resource 6: 0000831000140000..000083100017ffff [4c200]
[200503.900719] /pci@680: SUN4V PCI Bus Module
[200503.950220] /pci@680: On NUMA node -1
[200503.994443] /pci@680: PCI IO[83c000000000] MEM[838000000000] MEM64[838100000000]
[200504.081884] /pci@680: Unable to request IOMMU resource.
[200504.226082] /pci@680: MSI Queue first[0] num[56] count[512] devino[0x6]
[200504.306076] /pci@680: MSI first[0] num[512] mask[0x3ff] width[32]
[200504.379027] /pci@680: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200504.477945] /pci@680: MSI queues at RA [0000303f52600000]
[200504.543975] PCI: Scanning PBM /pci@680
[200504.587728] pci_sun4v f03ac32c: PCI host bridge to bus 000e:00
[200504.658251] pci_bus 000e:00: root bus resource [io  0x83c000000000-0x83c00fffffff] (bus address [0x0000-0xfffffff])
[200504.785701] pci_bus 000e:00: root bus resource [mem 0x838000000000-0x83807effffff] (bus address [0x00000000-0x7effffff])
[200504.917878] pci_bus 000e:00: root bus resource [mem 0x838100000000-0x8387ffffffff] (bus address [0x100000000-0x7ffffffff])
[200505.052528] pci_bus 000e:00: root bus resource [bus 00-e2]
[200505.117694] PCI: scan_bus[/pci@680] bus no 0
[200505.169280]   * /pci@680/pci@1
[200505.206429]     create device, devfn: 8, type: pciex
[200505.267315]     class: 0x60400 device name: 000e:00:01.0
[200505.331523]     adding to system ...
[200505.375217] pci 000e:00:01.0: PME# supported from D0 D3hot D3cold
[200505.448909] pci 000e:00:01.0: PME# disabled
[200505.500700] PCI: dev header type: 1
[200505.542271] of_scan_pci_bridge(/pci@680/pci@1)
[200505.596211]     Bridge bus range [1 --> 226]
[200505.647981]     Bridge ranges[fff8383fff9991c0] simba[0]
[200505.712378]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200505.821794]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200505.917558]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200506.027542]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200506.123317]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200506.231660]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200506.327427]     bus name: PCI Bus 000e:01
[200506.375857] PCI: scan_bus[/pci@680/pci@1] bus no 1
[200506.433754]   * /pci@680/pci@1/pci@0
[200506.477008]     create device, devfn: 0, type: pciex
[200506.537079]     class: 0x60400 device name: 000e:01:00.0
[200506.601287]     adding to system ...
[200506.644743] pci 000e:01:00.0: PME# supported from D0 D3hot D3cold
[200506.718435] pci 000e:01:00.0: PME# disabled
[200506.769156] PCI: dev header type: 1
[200506.811277] of_scan_pci_bridge(/pci@680/pci@1/pci@0)
[200506.870230]     Bridge bus range [2 --> 226]
[200506.921998]     Bridge ranges[fff8383fff998080] simba[0]
[200506.986210]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200507.095211]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200507.190975]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200507.298470]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200507.393303]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200507.501687]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200507.597517]     bus name: PCI Bus 000e:02
[200507.645945] PCI: scan_bus[/pci@680/pci@1/pci@0] bus no 2
[200507.709775]   * /pci@680/pci@1/pci@0/pci@4
[200507.759342]     create device, devfn: 20, type: pciex
[200507.820523]     class: 0x60400 device name: 000e:02:04.0
[200507.885135]     adding to system ...
[200507.928641] pci 000e:02:04.0: PME# supported from D0 D3hot D3cold
[200508.002331] pci 000e:02:04.0: PME# disabled
[200508.051996] PCI: dev header type: 1
[200508.093481] of_scan_pci_bridge(/pci@680/pci@1/pci@0/pci@4)
[200508.159946]     Bridge bus range [3 --> 226]
[200508.211755]     Bridge ranges[fff8383fff996d40] simba[0]
[200508.275965]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:08000000]
[200508.384752]       Using flags[00000101] start[0000000000000000] size[0000000008000000]
[200508.481028]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:40000000]
[200508.590076]       Using flags[00000200] start[0000000000100000] size[0000000040000000]
[200508.685844]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000006:f0000000]
[200508.794344]       Using flags[0010220c] start[0000000100000000] size[00000006f0000000]
[200508.889519]     bus name: PCI Bus 000e:03
[200508.938461] PCI: scan_bus[/pci@680/pci@1/pci@0/pci@4] bus no 3
[200509.008991] PCI: Claiming 000e:00:01.0: Resource 13: 000083c000000000..000083c007ffffff [101]
[200509.113100] PCI: Claiming 000e:00:01.0: Resource 14: 0000838000100000..00008380400fffff [200]
[200509.216344] PCI: Claiming 000e:00:01.0: Resource 15: 0000838100000000..00008387efffffff [10220c]
[200509.323109] PCI: Claiming 000e:01:00.0: Resource 13: 000083c000000000..000083c007ffffff [101]
[200509.427334] PCI: Claiming 000e:01:00.0: Resource 14: 0000838000100000..00008380400fffff [200]
[200509.531393] PCI: Claiming 000e:01:00.0: Resource 15: 0000838100000000..00008387efffffff [10220c]
[200509.637676] PCI: Claiming 000e:02:04.0: Resource 13: 000083c000000000..000083c007ffffff [101]
[200509.741769] PCI: Claiming 000e:02:04.0: Resource 14: 0000838000100000..00008380400fffff [200]
[200509.844901] PCI: Claiming 000e:02:04.0: Resource 15: 0000838100000000..00008387efffffff [10220c]
[200509.952470] /pci@6c0: SUN4V PCI Bus Module
[200510.002089] /pci@6c0: On NUMA node -1
[200510.046314] /pci@6c0: PCI IO[83c100000000] MEM[839000000000] MEM64[839100000000]
[200510.133755] /pci@6c0: Unable to request IOMMU resource.
[200510.214205] /pci@6c0: Imported 13 TSB entries from OBP
[200510.339723] /pci@6c0: MSI Queue first[0] num[56] count[512] devino[0x6]
[200510.418886] /pci@6c0: MSI first[0] num[512] mask[0x3ff] width[32]
[200510.492562] /pci@6c0: MSI addr32[0x7f000000:0x800000] addr64[0xe00000003f000000:0x800000]
[200510.591481] /pci@6c0: MSI queues at RA [0000303f51800000]
[200510.656334] PCI: Scanning PBM /pci@6c0
[200510.701671] pci_sun4v f03bb154: PCI host bridge to bus 000f:00
[200510.772194] pci_bus 000f:00: root bus resource [io  0x83c100000000-0x83c10fffffff] (bus address [0x0000-0xfffffff])
[200510.898464] pci_bus 000f:00: root bus resource [mem 0x839000000000-0x83907effffff] (bus address [0x00000000-0x7effffff])
[200511.029993] pci_bus 000f:00: root bus resource [mem 0x839100000000-0x8397ffffffff] (bus address [0x100000000-0x7ffffffff])
[200511.163937] pci_bus 000f:00: root bus resource [bus 00-78]
[200511.230505] PCI: scan_bus[/pci@6c0] bus no 0
[200511.282092]   * /pci@6c0/pci@1
[200511.319068]     create device, devfn: 8, type: pciex
[200511.379262]     class: 0x60400 device name: 000f:00:01.0
[200511.443471]     adding to system ...
[200511.486921] pci 000f:00:01.0: PME# supported from D0 D3hot D3cold
[200511.559605] pci 000f:00:01.0: PME# disabled
[200511.610359] PCI: dev header type: 1
[200511.651470] of_scan_pci_bridge(/pci@6c0/pci@1)
[200511.705528]     Bridge bus range [1 --> 120]
[200511.757295]     Bridge ranges[fff8383fff993900] simba[0]
[200511.821508]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04002000]
[200511.929895]       Using flags[00000101] start[0000000000000000] size[0000000004002000]
[200512.025658]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:22000000]
[200512.134044]       Using flags[00000200] start[0000000000100000] size[0000000022000000]
[200512.229851]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:b0000000]
[200512.338235]       Using flags[0010220c] start[0000000100000000] size[00000003b0000000]
[200512.433999]     bus name: PCI Bus 000f:01
[200512.482429] PCI: scan_bus[/pci@6c0/pci@1] bus no 1
[200512.540325]   * /pci@6c0/pci@1/pci@0
[200512.583579]     create device, devfn: 0, type: pciex
[200512.643651]     class: 0x60400 device name: 000f:01:00.0
[200512.707923]     adding to system ...
[200512.751377] pci 000f:01:00.0: PME# supported from D0 D3hot D3cold
[200512.827170] pci 000f:01:00.0: PME# disabled
[200512.878411] PCI: dev header type: 1
[200512.921069] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0)
[200512.982469]     Bridge bus range [2 --> 120]
[200513.034851]     Bridge ranges[fff8383fff9926c0] simba[0]
[200513.098303]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04002000]
[200513.206686]       Using flags[00000101] start[0000000000000000] size[0000000004002000]
[200513.303659]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:22000000]
[200513.413599]       Using flags[00000200] start[0000000000100000] size[0000000022000000]
[200513.509362]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:b0000000]
[200513.617745]       Using flags[0010220c] start[0000000100000000] size[00000003b0000000]
[200513.715897]     bus name: PCI Bus 000f:02
[200513.764329] PCI: scan_bus[/pci@6c0/pci@1/pci@0] bus no 2
[200513.829949]   * /pci@6c0/pci@1/pci@0/pci@4
[200513.877703]     create device, devfn: 20, type: pciex
[200513.937801]     class: 0x60400 device name: 000f:02:04.0
[200514.003032]     adding to system ...
[200514.046536] pci 000f:02:04.0: PME# supported from D0 D3hot D3cold
[200514.119309] pci 000f:02:04.0: PME# disabled
[200514.169997] PCI: dev header type: 1
[200514.211851] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0/pci@4)
[200514.278651]     Bridge bus range [3 --> 114]
[200514.330458]     Bridge ranges[fff8383fff991380] simba[0]
[200514.394667]     RAW Range[81000000:00000000:00000000:81000000:00000000:00000000:00000000:04000000]
[200514.503051]       Using flags[00000101] start[0000000000000000] size[0000000004000000]
[200514.598815]     RAW Range[82000000:00000000:00100000:82000000:00000000:00100000:00000000:20000000]
[200514.707199]       Using flags[00000200] start[0000000000100000] size[0000000020000000]
[200514.803395]     RAW Range[c3000000:00000001:00000000:c3000000:00000001:00000000:00000003:78000000]
[200514.911780]       Using flags[0010220c] start[0000000100000000] size[0000000378000000]
[200515.008158]     bus name: PCI Bus 000f:03
[200515.056587] PCI: scan_bus[/pci@6c0/pci@1/pci@0/pci@4] bus no 3
[200515.127106]   * /pci@6c0/pci@1/pci@0/pci@c
[200515.176046]     create device, devfn: 60, type: pciex
[200515.237974]     class: 0x60400 device name: 000f:02:0c.0
[200515.302182]     adding to system ...
[200515.345686] pci 000f:02:0c.0: PME# supported from D0 D3hot D3cold
[200515.419672] pci 000f:02:0c.0: PME# disabled
[200515.470357] PCI: dev header type: 1
[200515.511469] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0/pci@c)
[200515.577916]     Bridge bus range [115 --> 120]
[200515.632326]     Bridge ranges[fff8383fff98ffc0] simba[0]
[200515.696535]     RAW Range[81000000:00000000:04000000:81000000:00000000:04000000:00000000:00002000]
[200515.805357]       Using flags[00000101] start[0000000004000000] size[0000000000002000]
[200515.901513]     RAW Range[82000000:00000000:20100000:82000000:00000000:20100000:00000000:02000000]
[200516.010137]       Using flags[00000200] start[0000000020100000] size[0000000002000000]
[200516.106032]     RAW Range[c3000000:00000004:80000000:c3000000:00000004:80000000:00000000:30000000]
[200516.214114]       Using flags[0010220c] start[0000000480000000] size[0000000030000000]
[200516.309876]     bus name: PCI Bus 000f:73
[200516.357555] PCI: scan_bus[/pci@6c0/pci@1/pci@0/pci@c] bus no 115
[200516.431927]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0
[200516.487802]     create device, devfn: 0, type: pciex
[200516.547877]     class: 0x60400 device name: 000f:73:00.0
[200516.612085]     adding to system ...
[200516.655565] pci 000f:73:00.0: PME# supported from D0 D3hot D3cold
[200516.729256] pci 000f:73:00.0: PME# disabled
[200516.779995] PCI: dev header type: 1
[200516.822115] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0/pci@c/pci@0)
[200516.894737]     Bridge bus range [116 --> 120]
[200516.949112]     Bridge ranges[fff8383fff98ee80] simba[0]
[200517.013606]     RAW Range[81000000:00000000:04000000:81000000:00000000:04000000:00000000:00002000]
[200517.121282]       Using flags[00000101] start[0000000004000000] size[0000000000002000]
[200517.217947]     RAW Range[82000000:00000000:20100000:82000000:00000000:20100000:00000000:02000000]
[200517.326331]       Using flags[00000200] start[0000000020100000] size[0000000002000000]
[200517.423355]     RAW Range[c3000000:00000004:80000000:c3000000:00000004:80000000:00000000:30000000]
[200517.532510]       Using flags[0010220c] start[0000000480000000] size[0000000030000000]
[200517.629725]     bus name: PCI Bus 000f:74
[200517.678873] PCI: scan_bus[/pci@6c0/pci@1/pci@0/pci@c/pci@0] bus no 116
[200517.757804]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@4
[200517.818477]     create device, devfn: 20, type: pciex
[200517.879021]     class: 0x60400 device name: 000f:74:04.0
[200517.943353]     adding to system ...
[200517.986886] pci 000f:74:04.0: PME# supported from D0 D3hot D3cold
[200518.061825] pci 000f:74:04.0: PME# disabled
[200518.113164] PCI: dev header type: 1
[200518.154286] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@4)
[200518.233633]     Bridge bus range [117 --> 117]
[200518.288542]     Bridge ranges[fff8383fff98dc40] simba[0]
[200518.352804]     RAW Range[81000000:00000000:04000000:81000000:00000000:04000000:00000000:00001000]
[200518.461570]       Using flags[00000101] start[0000000004000000] size[0000000000001000]
[200518.558162]     RAW Range[c3000000:00000004:80000000:c3000000:00000004:80000000:00000000:10000000]
[200518.666546]       Using flags[0010220c] start[0000000480000000] size[0000000010000000]
[200518.762308]     bus name: PCI Bus 000f:75
[200518.810738] PCI: scan_bus[/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@4] bus no 117
[200518.895981]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@4/network@0
[200518.968685]     create device, devfn: 0, type: network
[200519.030922]     class: 0x20000 device name: 000f:75:00.0
[200519.094119]     parse addresses (60 bytes) @ fff8383fff98c780
[200519.163587]   start: 839480000000, end: 8394801fffff, i: 10
[200519.231317]   start: 83c104000000, end: 83c10400001f, i: 18
[200519.298680]   start: 839480200000, end: 839480203fff, i: 20
[200519.366041]     adding to system ...
[200519.409638] pci 000f:75:00.0: PME# supported from D0 D3hot D3cold
[200519.483644] pci 000f:75:00.0: PME# disabled
[200519.534770] pci 000f:75:00.0: reg 0x184: [mem 0x839480204000-0x839480207fff 64bit]
[200519.626482] pci 000f:75:00.0: reg 0x190: [mem 0x839480304000-0x839480307fff 64bit]
[200519.717118] pci 000f:75:00.0: reg 0x184 [mem 0x839480204000-0x839480303fff 64bit] + pref
[200519.814987] pci 000f:75:00.0: reg 0x190 [mem 0x839480304000-0x839480403fff 64bit] + pref
[200519.912939] PCI: dev header type: 0
[200519.955060]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@4/network@0,1
[200520.029867]     create device, devfn: 1, type: network
[200520.092103]     class: 0x20000 device name: 000f:75:00.1
[200520.155302]     parse addresses (60 bytes) @ fff8383fff98ab40
[200520.224767]   start: 839480600000, end: 8394807fffff, i: 10
[200520.292129]   start: 83c104000020, end: 83c10400003f, i: 18
[200520.359836]   start: 839480404000, end: 839480407fff, i: 20
[200520.427468]     adding to system ...
[200520.471063] pci 000f:75:00.1: PME# supported from D0 D3hot D3cold
[200520.545011] pci 000f:75:00.1: PME# disabled
[200520.596434] pci 000f:75:00.1: reg 0x184: [mem 0x839480408000-0x83948040bfff 64bit]
[200520.688644] pci 000f:75:00.1: reg 0x190: [mem 0x839480800000-0x839480803fff 64bit]
[200520.778308] pci 000f:75:00.1: reg 0x184 [mem 0x839480408000-0x839480507fff 64bit] + pref
[200520.878021] pci 000f:75:00.1: reg 0x190 [mem 0x839480800000-0x8394808fffff 64bit] + pref
[200520.976427] PCI: dev header type: 0
[200521.018744]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@6
[200521.081000]     create device, devfn: 30, type: pciex
[200521.142390]     class: 0x60400 device name: 000f:74:06.0
[200521.206676]     adding to system ...
[200521.250212] pci 000f:74:06.0: PME# supported from D0 D3hot D3cold
[200521.323937] pci 000f:74:06.0: PME# disabled
[200521.375945] PCI: dev header type: 1
[200521.417507] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@6)
[200521.496442]     Bridge bus range [118 --> 118]
[200521.550378]     Bridge ranges[fff8383fff989100] simba[0]
[200521.614514]     RAW Range[c3000000:00000004:90000000:c3000000:00000004:90000000:00000000:10000000]
[200521.723515]       Using flags[0010220c] start[0000000490000000] size[0000000010000000]
[200521.819493]     bus name: PCI Bus 000f:76
[200521.869139] PCI: scan_bus[/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@6] bus no 118
[200521.954763]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@6/usb@0
[200522.023731]     create device, devfn: 0, type: xchi
[200522.083224]     class: 0xc0330 device name: 000f:76:00.0
[200522.147493]     parse addresses (20 bytes) @ fff8383fff987f00
[200522.216961]   start: 839490000000, end: 839490001fff, i: 10
[200522.285002]     adding to system ...
[200522.328574] pci 000f:76:00.0: PME# supported from D0 D3hot D3cold
[200522.403025] pci 000f:76:00.0: PME# disabled
[200522.453747] pci 000f:76:00.0: reg 0x10 [mem 0x839490000000-0x839490001fff 64bit] + pref
[200522.548696] PCI: dev header type: 0
[200522.592263]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@7
[200522.654450]     create device, devfn: 38, type: pciex
[200522.715580]     class: 0x60400 device name: 000f:74:07.0
[200522.779789]     adding to system ...
[200522.823323] pci 000f:74:07.0: PME# supported from D0 D3hot D3cold
[200522.897014] pci 000f:74:07.0: PME# disabled
[200522.947712] PCI: dev header type: 1
[200522.989856] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@7)
[200523.068799]     Bridge bus range [119 --> 119]
[200523.122731]     Bridge ranges[fff8383fff986d40] simba[0]
[200523.187368]     RAW Range[82000000:00000000:20100000:82000000:00000000:20100000:00000000:01f00000]
[200523.296491]       Using flags[00000200] start[0000000020100000] size[0000000001f00000]
[200523.393370]     bus name: PCI Bus 000f:77
[200523.442338] PCI: scan_bus[/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@7] bus no 119
[200523.527860]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@7/display@0
[200523.600564]     create device, devfn: 0, type: display
[200523.663607]     class: 0x30000 device name: 000f:77:00.0
[200523.727839]     parse addresses (80 bytes) @ fff8383fff985c00
[200523.797331]   start: 839021000000, end: 839021ffffff, i: 10
[200523.865196]   start: 839020100000, end: 839020103fff, i: 14
[200523.931683]   start: 839020800000, end: 839020ffffff, i: 18
[200523.999047]   start: 839020110000, end: 83902011ffff, i: 30
[200524.067186]     adding to system ...
[200524.111497] PCI: dev header type: 0
[200524.153619]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@c
[200524.215939]     create device, devfn: 60, type: pciex
[200524.277233]     class: 0x60400 device name: 000f:74:0c.0
[200524.341441]     adding to system ...
[200524.384976] pci 000f:74:0c.0: PME# supported from D0 D3hot D3cold
[200524.459287] pci 000f:74:0c.0: PME# disabled
[200524.509984] PCI: dev header type: 1
[200524.551414] of_scan_pci_bridge(/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@c)
[200524.630271]     Bridge bus range [120 --> 120]
[200524.684203]     Bridge ranges[fff8383fff984980] simba[0]
[200524.748412]     RAW Range[81000000:00000000:04001000:81000000:00000000:04001000:00000000:00001000]
[200524.856797]       Using flags[00000101] start[0000000004001000] size[0000000000001000]
[200524.952559]     RAW Range[82000000:00000000:22000000:82000000:00000000:22000000:00000000:00100000]
[200525.060943]       Using flags[00000200] start[0000000022000000] size[0000000000100000]
[200525.156708]     RAW Range[c3000000:00000004:a0000000:c3000000:00000004:a0000000:00000000:10000000]
[200525.265303]       Using flags[0010220c] start[00000004a0000000] size[0000000010000000]
[200525.362474]     bus name: PCI Bus 000f:78
[200525.410903] PCI: scan_bus[/pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@c] bus no 120
[200525.495298]   * /pci@6c0/pci@1/pci@0/pci@c/pci@0/pci@c/scsi@0
[200525.566269]     create device, devfn: 0, type: scsi-sas
[200525.629836]     class: 0x10700 device name: 000f:78:00.0
[200525.694044]     parse addresses (80 bytes) @ fff8383fff983480
[200525.765117]   start: 83c104001000, end: 83c1040010ff, i: 10
[200525.832856]   start: 8394a0000000, end: 8394a000ffff, i: 14
[200525.900218]   start: 8394a0040000, end: 8394a007ffff, i: 1c
[200525.968687]   start: 839022000000, end: 8390220fffff, i: 30
[200526.036749]     adding to system ...
[200526.080518] pci 000f:78:00.0: supports D1 D2
[200526.132267] pci 000f:78:00.0: reg 0x14 [mem 0x8394a0000000-0x8394a000ffff 64bit] + pref
[200526.228196] pci 000f:78:00.0: reg 0x1c [mem 0x8394a0040000-0x8394a007ffff 64bit] + pref
[200526.323885] PCI: dev header type: 0
[200526.366043] PCI: Claiming 000f:00:01.0: Resource 13: 000083c100000000..000083c104001fff [101]
[200526.469764] PCI: Claiming 000f:00:01.0: Resource 14: 0000839000100000..00008390220fffff [200]
[200526.574001] PCI: Claiming 000f:00:01.0: Resource 15: 0000839100000000..00008394afffffff [10220c]
[200526.680457] PCI: Claiming 000f:01:00.0: Resource 13: 000083c100000000..000083c104001fff [101]
[200526.783589] PCI: Claiming 000f:01:00.0: Resource 14: 0000839000100000..00008390220fffff [200]
[200526.887035] PCI: Claiming 000f:01:00.0: Resource 15: 0000839100000000..00008394afffffff [10220c]
[200526.993199] PCI: Claiming 000f:02:04.0: Resource 13: 000083c100000000..000083c103ffffff [101]
[200527.096577] PCI: Claiming 000f:02:04.0: Resource 14: 0000839000100000..00008390200fffff [200]
[200527.199703] PCI: Claiming 000f:02:04.0: Resource 15: 0000839100000000..0000839477ffffff [10220c]
[200527.305983] PCI: Claiming 000f:02:0c.0: Resource 13: 000083c104000000..000083c104001fff [101]
[200527.409108] PCI: Claiming 000f:02:0c.0: Resource 14: 0000839020100000..00008390220fffff [200]
[200527.512234] PCI: Claiming 000f:02:0c.0: Resource 15: 0000839480000000..00008394afffffff [10220c]
[200527.618516] PCI: Claiming 000f:73:00.0: Resource 13: 000083c104000000..000083c104001fff [101]
[200527.721097] PCI: Claiming 000f:73:00.0: Resource 14: 0000839020100000..00008390220fffff [200]
[200527.824221] PCI: Claiming 000f:73:00.0: Resource 15: 0000839480000000..00008394afffffff [10220c]
[200527.930597] PCI: Claiming 000f:74:04.0: Resource 13: 000083c104000000..000083c104000fff [101]
[200528.033723] PCI: Claiming 000f:74:04.0: Resource 14: 0000839480000000..000083948fffffff [10220c]
[200528.140004] PCI: Claiming 000f:74:06.0: Resource 14: 0000839490000000..000083949fffffff [10220c]
[200528.246286] PCI: Claiming 000f:74:07.0: Resource 14: 0000839020100000..0000839021ffffff [200]
[200528.348787] PCI: Claiming 000f:74:0c.0: Resource 13: 000083c104001000..000083c104001fff [101]
[200528.451913] PCI: Claiming 000f:74:0c.0: Resource 14: 0000839022000000..00008390220fffff [200]
[200528.555255] PCI: Claiming 000f:74:0c.0: Resource 15: 00008394a0000000..00008394afffffff [10220c]
[200528.662097] PCI: Claiming 000f:75:00.0: Resource 0: 0000839480000000..00008394801fffff [10220c]
[200528.768419] PCI: Claiming 000f:75:00.0: Resource 2: 000083c104000000..000083c10400001f [101]
[200528.870493] PCI: Claiming 000f:75:00.0: Resource 4: 0000839480200000..0000839480203fff [10220c]
[200528.975329] PCI: Claiming 000f:75:00.0: Resource 7: 0000839480204000..0000839480303fff [142204]
[200529.080685] PCI: Claiming 000f:75:00.0: Resource 10: 0000839480304000..0000839480403fff [142204]
[200529.187120] PCI: Claiming 000f:75:00.1: Resource 0: 0000839480600000..00008394807fffff [10220c]
[200529.292348] PCI: Claiming 000f:75:00.1: Resource 2: 000083c104000020..000083c10400003f [101]
[200529.394421] PCI: Claiming 000f:75:00.1: Resource 4: 0000839480404000..0000839480407fff [10220c]
[200529.499650] PCI: Claiming 000f:75:00.1: Resource 7: 0000839480408000..0000839480507fff [142204]
[200529.603975] PCI: Claiming 000f:75:00.1: Resource 10: 0000839480800000..00008394808fffff [142204]
[200529.711432] PCI: Claiming 000f:76:00.0: Resource 0: 0000839490000000..0000839490001fff [102204]
[200529.816661] PCI: Claiming 000f:77:00.0: Resource 0: 0000839021000000..0000839021ffffff [200]
[200529.919271] PCI: Claiming 000f:77:00.0: Resource 1: 0000839020100000..0000839020103fff [200]
[200530.021344] PCI: Claiming 000f:77:00.0: Resource 2: 0000839020800000..0000839020ffffff [200]
[200530.124522] PCI: Claiming 000f:77:00.0: Resource 6: 0000839020110000..000083902011ffff [4c200]
[200530.228700] PCI: Claiming 000f:78:00.0: Resource 0: 000083c104001000..000083c1040010ff [101]
[200530.331745] PCI: Claiming 000f:78:00.0: Resource 1: 00008394a0000000..00008394a000ffff [102204]
[200530.435544] PCI: Claiming 000f:78:00.0: Resource 3: 00008394a0040000..00008394a007ffff [102204]
[200530.541755] PCI: Claiming 000f:78:00.0: Resource 6: 0000839022000000..00008390220fffff [4c200]
[200530.716524] vgaarb: device added: PCI:000f:77:00.0,decodes=io+mem,owns=none,locks=none
[200530.812319] vgaarb: loaded
[200530.844977] vgaarb: bridge control possible 000f:77:00.0
[200530.919596] SCSI subsystem initialized
[200530.970492] libata version 3.00 loaded.
[200531.017027] usbcore: registered new interface driver usbfs
[200531.082076] usbcore: registered new interface driver hub
[200531.154568] usbcore: registered new device driver usb
[200531.227877] NetLabel: Initializing
[200531.268957] NetLabel:  domain hash size = 128
[200531.321600] NetLabel:  protocols = UNLABELED CIPSOv4
[200531.381637] NetLabel:  unlabeled traffic allowed by default
[200531.451030] SUN4V: Reboot data supported (maj=1,min=0).
[200531.514368] ds.c:v1.0 (Jul 11, 2007)
[200531.565807] Switched to clocksource stick
[200531.611252] ds-1: Registered pri service.
[200531.659840] ds-1: Registered var-config-backup service.
[200531.749056] NET: Registered protocol family 2
[200531.820363] TCP established hash table entries: 524288 (order: 9, 4194304 bytes)
[200531.913540] TCP bind hash table entries: 65536 (order: 7, 1048576 bytes)
[200531.995496] TCP: Hash tables configured (established 524288 bind 65536)
[200532.075768] TCP: reno registered
[200532.114949] UDP hash table entries: 65536 (order: 8, 2097152 bytes)
[200532.192480] UDP-Lite hash table entries: 65536 (order: 8, 2097152 bytes)
[200532.289153] NET: Registered protocol family 1
[200532.342035] pci 0000:05:00.0: calling quirk_usb_early_handoff+0x0/0x220
[200532.428245] pci 0000:05:00.0: xHCI BIOS handoff failed (BIOS bug ?) 00010401
[200532.518381] pci 0000:06:00.0: calling quirk_e100_interrupt+0x0/0x220
[200532.595232] pci 0000:06:00.1: calling quirk_e100_interrupt+0x0/0x220
[200532.673149] pci 000f:75:00.0: calling quirk_e100_interrupt+0x0/0x220
[200532.750334] pci 000f:75:00.1: calling quirk_e100_interrupt+0x0/0x220
[200532.827194] pci 000f:76:00.0: calling quirk_usb_early_handoff+0x0/0x220
[200532.913777] pci 000f:76:00.0: xHCI BIOS handoff failed (BIOS bug ?) 00010401
[200533.002036] PCI: CLS mismatch (64 != 512), using 64 bytes
[200533.067689] Trying to unpack rootfs image as initramfs...
[200533.409377] Freeing initrd memory: 7408K (fff8380004000000 - fff838000473c000)
[200533.523973] futex hash table entries: 262144 (order: 11, 16777216 bytes)
[200533.613134] Initialise system trusted keyring
[200533.669037] audit: initializing netlink subsys (disabled)
[200533.734722] audit: type=2000 audit(19.264:1): initialized
[200533.802056] HugeTLB registered 8 MB page size, pre-allocated 0 pages
[200533.889397] VFS: Disk quotas dquot_6.5.2
[200533.945860] VFS: Dquot-cache hash table entries: 1024 (order 0, 8192 bytes)
[200534.050181] SELinux:  Registering netfilter hooks
[200534.111100] alg: No test for stdrng (krng)
[200534.161243] Key type asymmetric registered
[200534.210449] Asymmetric key parser 'x509' registered
[200534.268203] bounce: pool size: 64 pages
[200534.317375] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
[200534.413612] io scheduler noop registered
[200534.461492] io scheduler deadline registered (default)
[200534.527458] io scheduler cfq registered
[200534.574596] f0290cf4: ttyS0 at I/O 0x0 (irq = 1, base_baud = 115200) is a SUN4V HCONS
[200559.285374] console [ttyHV0] enabled
[200559.285374] console [ttyHV0] enabled
[200559.340716] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[200559.340716] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[200559.521270] brd: module loaded
[200559.521270] brd: module loaded
[200559.733004] loop: module loaded
[200559.733004] loop: module loaded
[200559.782322] zram: Created 1 device(s)
[200559.782322] zram: Created 1 device(s)
[200559.840389] libphy: Fixed MDIO Bus: probed
[200559.840389] libphy: Fixed MDIO Bus: probed
[200559.899704] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[200559.899704] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[200559.992940] ehci-pci: EHCI PCI platform driver
[200559.992940] ehci-pci: EHCI PCI platform driver
[200560.056647] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[200560.056647] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[200560.146168] ohci-pci: OHCI PCI platform driver
[200560.146168] ohci-pci: OHCI PCI platform driver
[200560.210582] uhci_hcd: USB Universal Host Controller Interface driver
[200560.210582] uhci_hcd: USB Universal Host Controller Interface driver
[200560.302546] mousedev: PS/2 mouse device common for all mice
[200560.302546] mousedev: PS/2 mouse device common for all mice
[200560.384774] rtc-sun4v rtc-sun4v: rtc core: registered sun4v as rtc0
[200560.384774] rtc-sun4v rtc-sun4v: rtc core: registered sun4v as rtc0
[200560.476626] hidraw: raw HID events driver (C) Jiri Kosina
[200560.476626] hidraw: raw HID events driver (C) Jiri Kosina
[200560.554679] usbcore: registered new interface driver usbhid
[200560.554679] usbcore: registered new interface driver usbhid
[200560.634606] usbhid: USB HID core driver
[200560.634606] usbhid: USB HID core driver
[200560.691567] drop_monitor: Initializing network drop monitor service
[200560.691567] drop_monitor: Initializing network drop monitor service
[200560.782295] TCP: cubic registered
[200560.782295] TCP: cubic registered
[200560.830249] Initializing XFRM netlink socket
[200560.830249] Initializing XFRM netlink socket
[200560.892703] NET: Registered protocol family 17
[200560.892703] NET: Registered protocol family 17
[200560.957698] Key type dns_resolver registered
[200560.957698] Key type dns_resolver registered
[200561.019165] Loading compiled-in X.509 certificates
[200561.019165] Loading compiled-in X.509 certificates
[200561.090840] Loaded X.509 cert 'Magrathea: Glacier signing key: e853f296fa369d51abb57f7e884c3c168950ac2d'
[200561.090840] Loaded X.509 cert 'Magrathea: Glacier signing key: e853f296fa369d51abb57f7e884c3c168950ac2d'
[200561.226981] registered taskstats version 1
[200561.226981] registered taskstats version 1
[200561.285783] ima: No TPM chip found, activating TPM-bypass!
[200561.285783] ima: No TPM chip found, activating TPM-bypass!
[200561.375876] rtc-sun4v rtc-sun4v: setting system clock to 2015-03-31 22:23:37 UTC (1427840617)
[200561.375876] rtc-sun4v rtc-sun4v: setting system clock to 2015-03-31 22:23:37 UTC (1427840617)
[200561.536347] dracut: dracut-004-336.0.2.el6_5.2
[200561.536347] dracut: dracut-004-336.0.2.el6_5.2
[200561.615346] dracut: rd_NO_LUKS: removing cryptoluks activation
[200561.615346] dracut: rd_NO_LUKS: removing cryptoluks activation
[200561.711381] dm_mod: module verification failed: signature and/or required key missing - tainting kernel
[200561.711381] dm_mod: module verification failed: signature and/or required key missing - tainting kernel
[200561.860879] device-mapper: uevent: version 1.0.3
[200561.860879] device-mapper: uevent: version 1.0.3
[200561.934116] device-mapper: ioctl: 4.30.0-ioctl (2014-12-22) initialised: dm-devel@redhat.com
[200561.934116] device-mapper: ioctl: 4.30.0-ioctl (2014-12-22) initialised: dm-devel@redhat.com
/pre-udev/41ldom-pre-udev.sh: 3: grep: not found
[200562.080364] udev: starting version 147
[200562.080364] udev: starting version 147
[200562.334512] dracut: Starting plymouth daemon
[200562.334512] dracut: Starting plymouth daemon
[200562.538819] sha256_sparc64: Using sparc64 sha256 opcode optimized SHA-256/SHA-224 implementation
[200562.538819] sha256_sparc64: Using sparc64 sha256 opcode optimized SHA-256/SHA-224 implementation
[200562.663968] aes_sparc64: Using sparc64 aes opcodes optimized AES implementation
[200562.663968] aes_sparc64: Using sparc64 aes opcodes optimized AES implementation
[200565.496396] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.16-k.
[200565.496396] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.16-k.
[200565.612642] qla2xxx [0002:03:00.0]-001d: : Found an ISP2532 irq 11 iobase 0x0000808100000000.
[200565.612642] qla2xxx [0002:03:00.0]-001d: : Found an ISP2532 irq 11 iobase 0x0000808100000000.
[200565.737187] qla2xxx 0002:03:00.0: enabling Mem-Wr-Inval
[200565.737187] qla2xxx 0002:03:00.0: enabling Mem-Wr-Inval
[200568.682415] scsi host0: qla2xxx
[200568.682415] scsi host0: qla2xxx
[200568.743219] qla2xxx [0002:03:00.0]-00fb:0: QLogic QLE2562 - Sun StorageTek 8Gb FC PCIe HBA, dual port.
[200568.743219] qla2xxx [0002:03:00.0]-00fb:0: QLogic QLE2562 - Sun StorageTek 8Gb FC PCIe HBA, dual port.
[200568.875783] qla2xxx [0002:03:00.0]-00fc:0: ISP2532: PCIe (2.5GT/s x8) @ 0002:03:00.0 hdma- host#=0 fw=7.03.00 (90d5).
[200568.875783] qla2xxx [0002:03:00.0]-00fc:0: ISP2532: PCIe (2.5GT/s x8) @ 0002:03:00.0 hdma- host#=0 fw=7.03.00 (90d5).
[200568.955109] qla2xxx [0002:03:00.0]-500a:0: LOOP UP detected (8 Gbps).
[200568.955109] qla2xxx [0002:03:00.0]-500a:0: LOOP UP detected (8 Gbps).
[200569.118317] qla2xxx [0002:03:00.1]-001d: : Found an ISP2532 irq 12 iobase 0x0000808100004000.
[200569.118317] qla2xxx [0002:03:00.1]-001d: : Found an ISP2532 irq 12 iobase 0x0000808100004000.
[200569.243646] qla2xxx 0002:03:00.1: enabling Mem-Wr-Inval
[200569.243646] qla2xxx 0002:03:00.1: enabling Mem-Wr-Inval
[200569.435870] qla2xxx [0002:03:00.0]-2064:0: SNS scan failed -- assuming zero-entry result.
[200569.435870] qla2xxx [0002:03:00.0]-2064:0: SNS scan failed -- assuming zero-entry result.
[200572.190382] scsi host1: qla2xxx
[200572.190382] scsi host1: qla2xxx
[200572.251464] qla2xxx [0002:03:00.1]-00fb:1: QLogic QLE2562 - Sun StorageTek 8Gb FC PCIe HBA, dual port.
[200572.251464] qla2xxx [0002:03:00.1]-00fb:1: QLogic QLE2562 - Sun StorageTek 8Gb FC PCIe HBA, dual port.
[200572.383643] qla2xxx [0002:03:00.1]-00fc:1: ISP2532: PCIe (2.5GT/s x8) @ 0002:03:00.1 hdma- host#=1 fw=7.03.00 (90d5).
[200572.383643] qla2xxx [0002:03:00.1]-00fc:1: ISP2532: PCIe (2.5GT/s x8) @ 0002:03:00.1 hdma- host#=1 fw=7.03.00 (90d5).
[200577.272620] Emulex LightPulse Fibre Channel SCSI driver 10.4.8000.0.
[200577.272620] Emulex LightPulse Fibre Channel SCSI driver 10.4.8000.0.
[200577.363133] Copyright(c) 2004-2014 Emulex.  All rights reserved.
[200577.363133] Copyright(c) 2004-2014 Emulex.  All rights reserved.
[200577.449045] lpfc 000d:03:00.0: enabling Mem-Wr-Inval
[200577.449045] lpfc 000d:03:00.0: enabling Mem-Wr-Inval
[200577.522744] scsi host2: Emulex LPe12000-S PCIe Fibre Channel Adapter  on PCI bus 03 device 00 irq 35
[200577.522744] scsi host2: Emulex LPe12000-S PCIe Fibre Channel Adapter  on PCI bus 03 device 00 irq 35
[200580.118941] lpfc 000d:03:00.1: enabling Mem-Wr-Inval
[200580.118941] lpfc 000d:03:00.1: enabling Mem-Wr-Inval
[200580.192900] scsi host3: Emulex LPe12000-S PCIe Fibre Channel Adapter  on PCI bus 03 device 01 irq 36
[200580.192900] scsi host3: Emulex LPe12000-S PCIe Fibre Channel Adapter  on PCI bus 03 device 01 irq 36
[200582.864763] mpt2sas version 20.100.00.00 loaded
[200582.864763] mpt2sas version 20.100.00.00 loaded
[200582.931753] mpt2sas 0000:07:00.0: enabling bus mastering
[200582.931753] mpt2sas 0000:07:00.0: enabling bus mastering
[200583.008099] mpt2sas0: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (2127134576 kB)
[200583.008099] mpt2sas0: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (2127134576 kB)
[200583.410342] mpt2sas0: MSI-X vectors supported: 8, no of cores: 1024, max_msix_vectors: 8
[200583.410342] mpt2sas0: MSI-X vectors supported: 8, no of cores: 1024, max_msix_vectors: 8
[200583.534751] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 973
[200583.534751] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 973
[200583.608085] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 974
[200583.608085] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 974
[200583.681206] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 975
[200583.681206] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 975
[200583.755783] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 976
[200583.755783] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 976
[200583.829835] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 977
[200583.829835] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 977
[200583.904449] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 978
[200583.904449] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 978
[200583.979056] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 979
[200583.979056] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 979
[200584.053755] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 980
[200584.053755] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 980
[200584.127335] mpt2sas0: iomem(0x0000800120000000), mapped(0x0000800120000000), size(65536)
[200584.127335] mpt2sas0: iomem(0x0000800120000000), mapped(0x0000800120000000), size(65536)
[200584.242996] mpt2sas0: ioport(0x0000804000001000), size(256)
[200584.242996] mpt2sas0: ioport(0x0000804000001000), size(256)
[200584.758904] mpt2sas0: Allocated physical memory: size(4603 kB)
[200584.758904] mpt2sas0: Allocated physical memory: size(4603 kB)
[200584.842038] mpt2sas0: Current Controller Queue Depth(2811), Max Controller Queue Depth(3072)
[200584.842038] mpt2sas0: Current Controller Queue Depth(2811), Max Controller Queue Depth(3072)
[200584.963017] mpt2sas0: Scatter Gather Elements per IO(128)
[200584.963017] mpt2sas0: Scatter Gather Elements per IO(128)
[200585.271922] mpt2sas0: LSISAS2308: FWVersion(14.00.00.00), ChipRevision(0x05), BiosVersion(00.00.00.00)
[200585.271922] mpt2sas0: LSISAS2308: FWVersion(14.00.00.00), ChipRevision(0x05), BiosVersion(00.00.00.00)
[200585.404117] mpt2sas0: Protocol=([200585.404117] mpt2sas0: Protocol=(InitiatorInitiator), ), Capabilities=(Capabilities=(RaidRaid,TLR,TLR,EEDP,EEDP,Snapshot Buffer,Snapshot Buffer,Diag Trace Buffer,Diag Trace Buffer,Task Set Full,Task Set Full,NCQ,NCQ)
)
[200585.562205] scsi host4: Fusion MPT SAS Host
[200585.562205] scsi host4: Fusion MPT SAS Host
[200585.626329] mpt2sas0: sending port enable !!
[200585.626329] mpt2sas0: sending port enable !!
[200585.626881] mpt2sas1: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (2127134576 kB)
[200585.626881] mpt2sas1: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (2127134576 kB)
[200585.914340] mpt2sas1: MSI-X vectors supported: 8, no of cores: 1024, max_msix_vectors: 8
[200585.914340] mpt2sas1: MSI-X vectors supported: 8, no of cores: 1024, max_msix_vectors: 8
[200586.038435] mpt2sas1-msix0: PCI-MSI-X enabled: IRQ 981
[200586.038435] mpt2sas1-msix0: PCI-MSI-X enabled: IRQ 981
[200586.111770] mpt2sas1-msix1: PCI-MSI-X enabled: IRQ 982
[200586.111770] mpt2sas1-msix1: PCI-MSI-X enabled: IRQ 982
[200586.185213] mpt2sas1-msix2: PCI-MSI-X enabled: IRQ 983
[200586.185213] mpt2sas1-msix2: PCI-MSI-X enabled: IRQ 983
[200586.258659] mpt2sas1-msix3: PCI-MSI-X enabled: IRQ 984
[200586.258659] mpt2sas1-msix3: PCI-MSI-X enabled: IRQ 984
[200586.332101] mpt2sas1-msix4: PCI-MSI-X enabled: IRQ 985
[200586.332101] mpt2sas1-msix4: PCI-MSI-X enabled: IRQ 985
[200586.405545] mpt2sas1-msix5: PCI-MSI-X enabled: IRQ 986
[200586.405545] mpt2sas1-msix5: PCI-MSI-X enabled: IRQ 986
[200586.479077] mpt2sas1-msix6: PCI-MSI-X enabled: IRQ 987
[200586.479077] mpt2sas1-msix6: PCI-MSI-X enabled: IRQ 987
[200586.551616] mpt2sas1-msix7: PCI-MSI-X enabled: IRQ 988
[200586.551616] mpt2sas1-msix7: PCI-MSI-X enabled: IRQ 988
[200586.625060] mpt2sas1: iomem(0x00008394a0000000), mapped(0x00008394a0000000), size(65536)
[200586.625060] mpt2sas1: iomem(0x00008394a0000000), mapped(0x00008394a0000000), size(65536)
[200586.741165] mpt2sas1: ioport(0x000083c104001000), size(256)
[200586.741165] mpt2sas1: ioport(0x000083c104001000), size(256)
[200587.258737] mpt2sas1: Allocated physical memory: size(4603 kB)
[200587.258737] mpt2sas1: Allocated physical memory: size(4603 kB)
[200587.341869] mpt2sas1: Current Controller Queue Depth(2811), Max Controller Queue Depth(3072)
[200587.341869] mpt2sas1: Current Controller Queue Depth(2811), Max Controller Queue Depth(3072)
[200587.361806] mpt2sas0: host_add: handle(0x0001), sas_addr(0x508002000159c0d0), phys(8)
[200587.361806] mpt2sas0: host_add: handle(0x0001), sas_addr(0x508002000159c0d0), phys(8)
[200587.572112] mpt2sas1: Scatter Gather Elements per IO(128)
[200587.572112] mpt2sas1: Scatter Gather Elements per IO(128)
[200587.883348] mpt2sas1: LSISAS2308: FWVersion(14.00.00.00), ChipRevision(0x05), BiosVersion(00.00.00.00)
[200587.883348] mpt2sas1: LSISAS2308: FWVersion(14.00.00.00), ChipRevision(0x05), BiosVersion(00.00.00.00)
[200588.015539] mpt2sas1: Protocol=([200588.015539] mpt2sas1: Protocol=(InitiatorInitiator), ), Capabilities=(Capabilities=(RaidRaid,TLR,TLR,EEDP,EEDP,Snapshot Buffer,Snapshot Buffer,Diag Trace Buffer,Diag Trace Buffer,Task Set Full,Task Set Full,NCQ,NCQ)
)
[200588.173926] scsi host5: Fusion MPT SAS Host
[200588.173926] scsi host5: Fusion MPT SAS Host
[200588.237828] mpt2sas1: sending port enable !!
[200588.237828] mpt2sas1: sending port enable !!
[200589.818482] mpt2sas1: host_add: handle(0x0001), sas_addr(0x508002000159c0d1), phys(8)
[200589.818482] mpt2sas1: host_add: handle(0x0001), sas_addr(0x508002000159c0d1), phys(8)
[200593.466242] mpt2sas0: port enable: SUCCESS
[200593.466242] mpt2sas0: port enable: SUCCESS
[200593.533171] scsi 4:0:0:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[200593.533171] scsi 4:0:0:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[200593.603287] qla2xxx [0002:03:00.1]-8038:1: Cable is unplugged...
[200593.603287] qla2xxx [0002:03:00.1]-8038:1: Cable is unplugged...
[200593.734863] scsi 4:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0163295b1), phy(1), device_name(0x5000cca0163295b3)
[200593.734863] scsi 4:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0163295b1), phy(1), device_name(0x5000cca0163295b3)
[200593.887133] scsi 4:0:0:0: SSP: enclosure_logical_id(0x508002000159c0d0), slot(1)
[200593.887133] scsi 4:0:0:0: SSP: enclosure_logical_id(0x508002000159c0d0), slot(1)
[200594.001562] scsi 4:0:1:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[200594.001562] scsi 4:0:1:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[200594.115758] scsi 4:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca0162a4c1d), phy(2), device_name(0x5000cca0162a4c1f)
[200594.115758] scsi 4:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca0162a4c1d), phy(2), device_name(0x5000cca0162a4c1f)
[200594.265855] scsi 4:0:1:0: SSP: enclosure_logical_id(0x508002000159c0d0), slot(2)
[200594.265855] scsi 4:0:1:0: SSP: enclosure_logical_id(0x508002000159c0d0), slot(2)
[200594.321182] random: nonblocking pool is initialized
[200594.321182] random: nonblocking pool is initialized
[200595.946241] mpt2sas1: port enable: SUCCESS
[200595.946241] mpt2sas1: port enable: SUCCESS
[200596.012986] scsi 5:0:0:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[200596.012986] scsi 5:0:0:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[200596.127667] scsi 5:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0162f2e39), phy(0), device_name(0x5000cca0162f2e3b)
[200596.127667] scsi 5:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0162f2e39), phy(0), device_name(0x5000cca0162f2e3b)
[200596.277600] scsi 5:0:0:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(0)
[200596.277600] scsi 5:0:0:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(0)
[200596.394487] scsi 5:0:1:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[200596.394487] scsi 5:0:1:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[200596.511251] scsi 5:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca016322ee5), phy(1), device_name(0x5000cca016322ee7)
[200596.511251] scsi 5:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca016322ee5), phy(1), device_name(0x5000cca016322ee7)
[200596.661656] scsi 5:0:1:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(1)
[200596.661656] scsi 5:0:1:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(1)
[200596.774001] scsi 5:0:2:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[200596.774001] scsi 5:0:2:0: Direct-Access     HITACHI  H109030SESUN300G A31A PQ: 0 ANSI: 6
[200596.889589] scsi 5:0:2:0: SSP: handle(0x000b), sas_addr(0x5000cca016322f71), phy(2), device_name(0x5000cca016322f73)
[200596.889589] scsi 5:0:2:0: SSP: handle(0x000b), sas_addr(0x5000cca016322f71), phy(2), device_name(0x5000cca016322f73)
[200597.039816] scsi 5:0:2:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(2)
[200597.039816] scsi 5:0:2:0: SSP: enclosure_logical_id(0x508002000159c0d1), slot(2)
[200597.193189] sd 4:0:0:0: [sda] Enabling DIF Type 1 protection
[200597.193189] sd 4:0:0:0: [sda] Enabling DIF Type 1 protection
[200597.204660] sd 5:0:0:0: [sdc] Enabling DIF Type 1 protection
[200597.204660] sd 5:0:0:0: [sdc] Enabling DIF Type 1 protection
[200597.204667] sd 5:0:1:0: [sdd] Enabling DIF Type 1 protection
[200597.204667] sd 5:0:1:0: [sdd] Enabling DIF Type 1 protection
[200597.204668] sd 5:0:0:0: [sdc] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[200597.204668] sd 5:0:0:0: [sdc] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[200597.204671] sd 5:0:1:0: [sdd] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[200597.204671] sd 5:0:1:0: [sdd] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[200597.204785] sd 4:0:1:0: [sdb] Enabling DIF Type 1 protection
[200597.204785] sd 4:0:1:0: [sdb] Enabling DIF Type 1 protection
[200597.204790] sd 4:0:1:0: [sdb] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[200597.204790] sd 4:0:1:0: [sdb] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[200597.204792] sd 5:0:2:0: [sde] Enabling DIF Type 1 protection
[200597.204792] sd 5:0:2:0: [sde] Enabling DIF Type 1 protection
[200597.204796] sd 5:0:2:0: [sde] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[200597.204796] sd 5:0:2:0: [sde] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[200597.205665] sd 4:0:1:0: [sdb] Write Protect is off
[200597.205665] sd 4:0:1:0: [sdb] Write Protect is off
[200597.205669] sd 4:0:1:0: [sdb] Mode Sense: e7 00 10 08
[200597.205669] sd 4:0:1:0: [sdb] Mode Sense: e7 00 10 08
[200597.206152] sd 4:0:1:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA
[200597.206152] sd 4:0:1:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA
[200597.209352] sd 5:0:0:0: [sdc] Write Protect is off
[200597.209352] sd 5:0:0:0: [sdc] Write Protect is off
[200597.209356] sd 5:0:0:0: [sdc] Mode Sense: e7 00 10 08
[200597.209356] sd 5:0:0:0: [sdc] Mode Sense: e7 00 10 08
[200597.209359] sd 5:0:1:0: [sdd] Write Protect is off
[200597.209359] sd 5:0:1:0: [sdd] Write Protect is off
[200597.209362] sd 5:0:1:0: [sdd] Mode Sense: e7 00 10 08
[200597.209362] sd 5:0:1:0: [sdd] Mode Sense: e7 00 10 08
[200597.213399] sd 5:0:2:0: [sde] Write Protect is off
[200597.213399] sd 5:0:2:0: [sde] Write Protect is off
[200597.213403] sd 5:0:2:0: [sde] Mode Sense: e7 00 10 08
[200597.213403] sd 5:0:2:0: [sde] Mode Sense: e7 00 10 08
[200597.213591] sd 5:0:0:0: [sdc] Write cache: disabled, read cache: enabled, supports DPO and FUA
[200597.213591] sd 5:0:0:0: [sdc] Write cache: disabled, read cache: enabled, supports DPO and FUA
[200597.213608] sd 5:0:1:0: [sdd] Write cache: disabled, read cache: enabled, supports DPO and FUA
[200597.213608] sd 5:0:1:0: [sdd] Write cache: disabled, read cache: enabled, supports DPO and FUA
[200597.213795] sd 5:0:2:0: [sde] Write cache: disabled, read cache: enabled, supports DPO and FUA
[200597.213795] sd 5:0:2:0: [sde] Write cache: disabled, read cache: enabled, supports DPO and FUA
[200597.214327]  sdb: sdb1 sdb2 sdb3 sdb7
[200597.214327]  sdb: sdb1 sdb2 sdb3 sdb7
[200597.222315] sd 4:0:1:0: [sdb] Attached SCSI disk
[200597.222315] sd 4:0:1:0: [sdb] Attached SCSI disk
[200597.235604]  sdc: sdc1 sdc2 sdc3 sdc7
[200597.235604]  sdc: sdc1 sdc2 sdc3 sdc7
[200597.235897]  sdd: sdd1 sdd2 sdd3 sdd7
[200597.235897]  sdd: sdd1 sdd2 sdd3 sdd7
[200597.236193]  sde: sde1 sde2 sde3
[200597.236193]  sde: sde1 sde2 sde3
[200597.257408] sd 5:0:2:0: [sde] Attached SCSI disk
[200597.257408] sd 5:0:2:0: [sde] Attached SCSI disk
[200597.258223] sd 5:0:0:0: [sdc] Attached SCSI disk
[200597.258223] sd 5:0:0:0: [sdc] Attached SCSI disk
[200597.262974] sd 5:0:1:0: [sdd] Attached SCSI disk
[200597.262974] sd 5:0:1:0: [sdd] Attached SCSI disk
[200599.565628] sd 4:0:0:0: [sda] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[200599.565628] sd 4:0:0:0: [sda] 585937500 512-byte logical blocks: (300 GB/279 GiB)
[200599.674438] sd 4:0:0:0: [sda] Write Protect is off
[200599.674438] sd 4:0:0:0: [sda] Write Protect is off
[200599.743083] sd 4:0:0:0: [sda] Mode Sense: e7 00 10 08
[200599.743083] sd 4:0:0:0: [sda] Mode Sense: e7 00 10 08
[200599.816385] sd 4:0:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
[200599.816385] sd 4:0:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
[200599.946763]  sda: sda1 sda2 sda3
[200599.946763]  sda: sda1 sda2 sda3
[200600.000388] sd 4:0:0:0: [sda] Attached SCSI disk
[200600.000388] sd 4:0:0:0: [sda] Attached SCSI disk
[200600.308608] dracut: Scanning devices sda2 sde2  for LVM logical volumes VolGroup/lv_swap VolGroup/lv_root 
[200600.308608] dracut: Scanning devices sda2 sde2  for LVM logical volumes VolGroup/lv_swap VolGroup/lv_root 
[200600.874772] dracut: inactive '/dev/VolGroup/lv_root' [274.38 GiB] inherit
[200600.874772] dracut: inactive '/dev/VolGroup/lv_root' [274.38 GiB] inherit
[200600.971910] dracut: inactive '/dev/VolGroup/lv_swap' [4.00 GiB] inherit
[200600.971910] dracut: inactive '/dev/VolGroup/lv_swap' [4.00 GiB] inherit
[200601.067075] dracut: inactive '/dev/vg/root' [10.00 GiB] inherit
[200601.067075] dracut: inactive '/dev/vg/root' [10.00 GiB] inherit
[200601.152223] dracut: inactive '/dev/vg/swap' [2.00 GiB] inherit
[200601.152223] dracut: inactive '/dev/vg/swap' [2.00 GiB] inherit
[200601.235532] dracut: inactive '/dev/vg/tmpdir' [10.00 GiB] inherit
[200601.235532] dracut: inactive '/dev/vg/tmpdir' [10.00 GiB] inherit
[200601.325086] dracut: inactive '/dev/vg/mountpoint' [5.00 GiB] inherit
[200601.325086] dracut: inactive '/dev/vg/mountpoint' [5.00 GiB] inherit
[200601.762417] EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
[200601.762417] EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
[200601.927622] dracut: Mounted root filesystem /dev/mapper/VolGroup-lv_root
[200601.927622] dracut: Mounted root filesystem /dev/mapper/VolGroup-lv_root
[200602.237333] dracut: Loading SELinux policy
[200602.237333] dracut: Loading SELinux policy
[200602.456542] audit: type=1404 audit(1427840658.576:2): enforcing=1 old_enforcing=0 auid=4294967295 ses=4294967295
[200602.456542] audit: type=1404 audit(1427840658.576:2): enforcing=1 old_enforcing=0 auid=4294967295 ses=4294967295
[200602.760258] SELinux: 2048 avtab hash slots, 277818 rules.
[200602.760258] SELinux: 2048 avtab hash slots, 277818 rules.
[200602.942104] SELinux: 2048 avtab hash slots, 277818 rules.
[200602.942104] SELinux: 2048 avtab hash slots, 277818 rules.
[200603.339808] SELinux:  9 users, 12 roles, 3918 types, 217 bools[200603.339808] SELinux:  9 users, 12 roles, 3918 types, 217 bools, 1 sens, 1024 cats, 1 sens, 1024 cats

[200603.446067] SELinux:  81 classes, 277818 rules
[200603.446067] SELinux:  81 classes, 277818 rules
[200603.516056] SELinux:  Permission audit_access in class file not defined in policy.
[200603.516056] SELinux:  Permission audit_access in class file not defined in policy.
[200603.624426] SELinux:  Permission audit_access in class dir not defined in policy.
[200603.624426] SELinux:  Permission audit_access in class dir not defined in policy.
[200603.731469] SELinux:  Permission execmod in class dir not defined in policy.
[200603.731469] SELinux:  Permission execmod in class dir not defined in policy.
[200603.831874] SELinux:  Permission audit_access in class lnk_file not defined in policy.
[200603.831874] SELinux:  Permission audit_access in class lnk_file not defined in policy.
[200603.944791] SELinux:  Permission open in class lnk_file not defined in policy.
[200603.944791] SELinux:  Permission open in class lnk_file not defined in policy.
[200604.047638] SELinux:  Permission execmod in class lnk_file not defined in policy.
[200604.047638] SELinux:  Permission execmod in class lnk_file not defined in policy.
[200604.154900] SELinux:  Permission audit_access in class chr_file not defined in policy.
[200604.154900] SELinux:  Permission audit_access in class chr_file not defined in policy.
[200604.268137] SELinux:  Permission audit_access in class blk_file not defined in policy.
[200604.268137] SELinux:  Permission audit_access in class blk_file not defined in policy.
[200604.380786] SELinux:  Permission execmod in class blk_file not defined in policy.
[200604.380786] SELinux:  Permission execmod in class blk_file not defined in policy.
[200604.487358] SELinux:  Permission audit_access in class sock_file not defined in policy.
[200604.487358] SELinux:  Permission audit_access in class sock_file not defined in policy.
[200604.601231] SELinux:  Permission execmod in class sock_file not defined in policy.
[200604.601231] SELinux:  Permission execmod in class sock_file not defined in policy.
[200604.708981] SELinux:  Permission audit_access in class fifo_file not defined in policy.
[200604.708981] SELinux:  Permission audit_access in class fifo_file not defined in policy.
[200604.822957] SELinux:  Permission execmod in class fifo_file not defined in policy.
[200604.822957] SELinux:  Permission execmod in class fifo_file not defined in policy.
[200604.932408] SELinux:  Permission syslog in class capability2 not defined in policy.
[200604.932408] SELinux:  Permission syslog in class capability2 not defined in policy.
[200605.041287] SELinux:  Permission wake_alarm in class capability2 not defined in policy.
[200605.041287] SELinux:  Permission wake_alarm in class capability2 not defined in policy.
[200605.157277] SELinux:  Permission block_suspend in class capability2 not defined in policy.
[200605.157277] SELinux:  Permission block_suspend in class capability2 not defined in policy.
[200605.274180] SELinux:  Permission audit_read in class capability2 not defined in policy.
[200605.274180] SELinux:  Permission audit_read in class capability2 not defined in policy.
[200605.388691] SELinux:  Permission attach_queue in class tun_socket not defined in policy.
[200605.388691] SELinux:  Permission attach_queue in class tun_socket not defined in policy.
[200605.505231] SELinux:  Class binder not defined in policy.
[200605.505231] SELinux:  Class binder not defined in policy.
[200605.583054] SELinux: the above unknown classes and permissions will be allowed
[200605.583054] SELinux: the above unknown classes and permissions will be allowed
[200605.686736] SELinux:  Completing initialization.
[200605.686736] SELinux:  Completing initialization.
[200605.752808] SELinux:  Setting up existing superblocks.
[200605.752808] SELinux:  Setting up existing superblocks.
[200605.879190] audit: type=1403 audit(1427840662.000:3): policy loaded auid=4294967295 ses=4294967295
[200605.879190] audit: type=1403 audit(1427840662.000:3): policy loaded auid=4294967295 ses=4294967295
[200606.011910] dracut: 
[200606.011910] dracut: 
[200607.997918] dracut: Switching root
[200607.997918] dracut: Switching root
[200611.012103] udev: starting version 147
[200611.012103] udev: starting version 147
[200611.383846] sha1_sparc64: Using sparc64 sha1 opcode optimized SHA-1 implementation
[200611.383846] sha1_sparc64: Using sparc64 sha1 opcode optimized SHA-1 implementation
[200611.510618] sha512_sparc64: Using sparc64 sha512 opcode optimized SHA-512/SHA-384 implementation
[200611.510618] sha512_sparc64: Using sparc64 sha512 opcode optimized SHA-512/SHA-384 implementation
[200611.663550] md5_sparc64: Using sparc64 md5 opcode optimized MD5 implementation
[200611.663550] md5_sparc64: Using sparc64 md5 opcode optimized MD5 implementation
[200611.854999] des_sparc64: Using sparc64 des opcodes optimized DES implementation
[200611.854999] des_sparc64: Using sparc64 des opcodes optimized DES implementation
[200611.981020] camellia_sparc64: Using sparc64 camellia opcodes optimized CAMELLIA implementation
[200611.981020] camellia_sparc64: Using sparc64 camellia opcodes optimized CAMELLIA implementation
[200612.140958] crc32c_sparc64: Using sparc64 crc32c opcode optimized CRC32C implementation
[200612.140958] crc32c_sparc64: Using sparc64 crc32c opcode optimized CRC32C implementation
[200616.718836] xhci_hcd 0000:05:00.0: enabling bus mastering
[200616.718836] xhci_hcd 0000:05:00.0: enabling bus mastering
[200616.796231] xhci_hcd 0000:05:00.0: xHCI Host Controller
[200616.796231] xhci_hcd 0000:05:00.0: xHCI Host Controller
[200616.879859] xhci_hcd 0000:05:00.0: new USB bus registered, assigned bus number 1
[200616.879859] xhci_hcd 0000:05:00.0: new USB bus registered, assigned bus number 1
[200616.991091] xhci_hcd 0000:05:00.0: hcc params 0x014051cf hci version 0x100 quirks 0x00000010
[200616.991091] xhci_hcd 0000:05:00.0: hcc params 0x014051cf hci version 0x100 quirks 0x00000010
[200617.112174] xhci_hcd 0000:05:00.0: enabling Mem-Wr-Inval
[200617.112174] xhci_hcd 0000:05:00.0: enabling Mem-Wr-Inval
[200617.197853] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[200617.197853] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[200617.294480] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[200617.294480] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[200617.396714] usb usb1: Product: xHCI Host Controller
[200617.396714] usb usb1: Product: xHCI Host Controller
[200617.466939] usb usb1: Manufacturer: Linux 4.0.0-rc6+ xhci-hcd
[200617.466939] usb usb1: Manufacturer: Linux 4.0.0-rc6+ xhci-hcd
[200617.549270] usb usb1: SerialNumber: 0000:05:00.0
[200617.549270] usb usb1: SerialNumber: 0000:05:00.0
[200617.616531] hub 1-0:1.0: USB hub found
[200617.616531] hub 1-0:1.0: USB hub found
[200617.670356] hub 1-0:1.0: 4 ports detected
[200617.670356] hub 1-0:1.0: 4 ports detected
[200617.728273] xhci_hcd 0000:05:00.0: xHCI Host Controller
[200617.728273] xhci_hcd 0000:05:00.0: xHCI Host Controller
[200617.803316] xhci_hcd 0000:05:00.0: new USB bus registered, assigned bus number 2
[200617.803316] xhci_hcd 0000:05:00.0: new USB bus registered, assigned bus number 2
[200617.908705] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003
[200617.908705] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003
[200618.005327] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[200618.005327] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[200618.108183] usb usb2: Product: xHCI Host Controller
[200618.108183] usb usb2: Product: xHCI Host Controller
[200618.177942] usb usb2: Manufacturer: Linux 4.0.0-rc6+ xhci-hcd
[200618.177942] usb usb2: Manufacturer: Linux 4.0.0-rc6+ xhci-hcd
[200618.260500] usb usb2: SerialNumber: 0000:05:00.0
[200618.260500] usb usb2: SerialNumber: 0000:05:00.0
[200618.326860] hub 2-0:1.0: USB hub found
[200618.326860] hub 2-0:1.0: USB hub found
[200618.381517] hub 2-0:1.0: 4 ports detected
[200618.381517] hub 2-0:1.0: 4 ports detected
[200618.439871] xhci_hcd 000f:76:00.0: enabling bus mastering
[200618.439871] xhci_hcd 000f:76:00.0: enabling bus mastering
[200618.446262] usb 1-3: new high-speed USB device number 2 using xhci_hcd
[200618.446262] usb 1-3: new high-speed USB device number 2 using xhci_hcd
[200618.610432] xhci_hcd 000f:76:00.0: xHCI Host Controller
[200618.610432] xhci_hcd 000f:76:00.0: xHCI Host Controller
[200618.685300] xhci_hcd 000f:76:00.0: new USB bus registered, assigned bus number 3
[200618.685300] xhci_hcd 000f:76:00.0: new USB bus registered, assigned bus number 3
[200618.795983] xhci_hcd 000f:76:00.0: hcc params 0x014051cf hci version 0x100 quirks 0x00000010
[200618.795983] xhci_hcd 000f:76:00.0: hcc params 0x014051cf hci version 0x100 quirks 0x00000010
[200618.917183] xhci_hcd 000f:76:00.0: enabling Mem-Wr-Inval
[200618.917183] xhci_hcd 000f:76:00.0: enabling Mem-Wr-Inval
[200619.002685] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[200619.002685] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[200619.046655] usb 1-3: New USB device found, idVendor=090c, idProduct=1000
[200619.046655] usb 1-3: New USB device found, idVendor=090c, idProduct=1000
[200619.046657] usb 1-3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[200619.046657] usb 1-3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[200619.046659] usb 1-3: Product: USB DISK
[200619.046659] usb 1-3: Product: USB DISK
[200619.046661] usb 1-3: Manufacturer: SMI Corporation
[200619.046661] usb 1-3: Manufacturer: SMI Corporation
[200619.046663] usb 1-3: SerialNumber: 2011081500000723
[200619.046663] usb 1-3: SerialNumber: 2011081500000723
[200619.046812] usb 1-3: ep 0x81 - rounding interval to 128 microframes, ep desc says 255 microframes
[200619.046812] usb 1-3: ep 0x81 - rounding interval to 128 microframes, ep desc says 255 microframes
[200619.046824] usb 1-3: ep 0x2 - rounding interval to 128 microframes, ep desc says 255 microframes
[200619.046824] usb 1-3: ep 0x2 - rounding interval to 128 microframes, ep desc says 255 microframes
[200619.744557] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[200619.744557] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[200619.847410] usb usb3: Product: xHCI Host Controller
[200619.847410] usb usb3: Product: xHCI Host Controller
[200619.918776] usb usb3: Manufacturer: Linux 4.0.0-rc6+ xhci-hcd
[200619.918776] usb usb3: Manufacturer: Linux 4.0.0-rc6+ xhci-hcd
[200620.002300] usb usb3: SerialNumber: 000f:76:00.0
[200620.002300] usb usb3: SerialNumber: 000f:76:00.0
[200620.068681] hub 3-0:1.0: USB hub found
[200620.068681] hub 3-0:1.0: USB hub found
[200620.122430] hub 3-0:1.0: 4 ports detected
[200620.122430] hub 3-0:1.0: 4 ports detected
[200620.185354] xhci_hcd 000f:76:00.0: xHCI Host Controller
[200620.185354] xhci_hcd 000f:76:00.0: xHCI Host Controller
[200620.259790] xhci_hcd 000f:76:00.0: new USB bus registered, assigned bus number 4
[200620.259790] xhci_hcd 000f:76:00.0: new USB bus registered, assigned bus number 4
[200620.366372] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003
[200620.366372] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003
[200620.462993] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[200620.462993] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[200620.566105] usb usb4: Product: xHCI Host Controller
[200620.566105] usb usb4: Product: xHCI Host Controller
[200620.635872] usb usb4: Manufacturer: Linux 4.0.0-rc6+ xhci-hcd
[200620.635872] usb usb4: Manufacturer: Linux 4.0.0-rc6+ xhci-hcd
[200620.717884] usb usb4: SerialNumber: 000f:76:00.0
[200620.717884] usb usb4: SerialNumber: 000f:76:00.0
[200620.784590] hub 4-0:1.0: USB hub found
[200620.784590] hub 4-0:1.0: USB hub found
[200620.839225] hub 4-0:1.0: 4 ports detected
[200620.839225] hub 4-0:1.0: 4 ports detected
[200621.004401] pps_core: LinuxPPS API ver. 1 registered
[200621.004401] pps_core: LinuxPPS API ver. 1 registered
[200621.076343] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[200621.076343] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[200621.215095] PTP clock support registered
[200621.215095] PTP clock support registered
[200621.373940] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 4.0.1-k
[200621.373940] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 4.0.1-k
[200621.482854] ixgbe: Copyright (c) 1999-2014 Intel Corporation.
[200621.482854] ixgbe: Copyright (c) 1999-2014 Intel Corporation.
[200621.565857] PCI: Enabling device: (0000:06:00.0), cmd 2
[200621.565857] PCI: Enabling device: (0000:06:00.0), cmd 2
[200621.640511] ixgbe 0000:06:00.0: enabling bus mastering
[200621.640511] ixgbe 0000:06:00.0: enabling bus mastering
[200622.112132] ixgbe 0000:06:00.0: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[200622.112132] ixgbe 0000:06:00.0: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[200622.292660] ixgbe 0000:06:00.0: PCI Express bandwidth of 32GT/s available
[200622.292660] ixgbe 0000:06:00.0: PCI Express bandwidth of 32GT/s available
[200622.389284] ixgbe 0000:06:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[200622.389284] ixgbe 0000:06:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[200622.531530] ixgbe 0000:06:00.0: MAC: 3, PHY: 0, PBA No: 000000-000
[200622.531530] ixgbe 0000:06:00.0: MAC: 3, PHY: 0, PBA No: 000000-000
[200622.619564] ixgbe 0000:06:00.0: 00:10:e0:35:15:f6
[200622.619564] ixgbe 0000:06:00.0: 00:10:e0:35:15:f6
[200622.934285] ixgbe 0000:06:00.0: Intel(R) 10 Gigabit Network Connection
[200622.934285] ixgbe 0000:06:00.0: Intel(R) 10 Gigabit Network Connection
[200623.027305] PCI: Enabling device: (0000:06:00.1), cmd 2
[200623.027305] PCI: Enabling device: (0000:06:00.1), cmd 2
[200623.103894] ixgbe 0000:06:00.1: enabling bus mastering
[200623.103894] ixgbe 0000:06:00.1: enabling bus mastering
[200623.576120] ixgbe 0000:06:00.1: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[200623.576120] ixgbe 0000:06:00.1: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[200623.757065] ixgbe 0000:06:00.1: PCI Express bandwidth of 32GT/s available
[200623.757065] ixgbe 0000:06:00.1: PCI Express bandwidth of 32GT/s available
[200623.853910] ixgbe 0000:06:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[200623.853910] ixgbe 0000:06:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[200623.995655] ixgbe 0000:06:00.1: MAC: 3, PHY: 0, PBA No: 000000-000
[200623.995655] ixgbe 0000:06:00.1: MAC: 3, PHY: 0, PBA No: 000000-000
[200624.085998] ixgbe 0000:06:00.1: 00:10:e0:35:15:f7
[200624.085998] ixgbe 0000:06:00.1: 00:10:e0:35:15:f7
[200624.399586] ixgbe 0000:06:00.1: Intel(R) 10 Gigabit Network Connection
[200624.399586] ixgbe 0000:06:00.1: Intel(R) 10 Gigabit Network Connection
[200624.494269] PCI: Enabling device: (000f:75:00.0), cmd 2
[200624.494269] PCI: Enabling device: (000f:75:00.0), cmd 2
[200624.568949] ixgbe 000f:75:00.0: enabling bus mastering
[200624.568949] ixgbe 000f:75:00.0: enabling bus mastering
[200625.039966] ixgbe 000f:75:00.0: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[200625.039966] ixgbe 000f:75:00.0: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[200625.220457] ixgbe 000f:75:00.0: PCI Express bandwidth of 32GT/s available
[200625.220457] ixgbe 000f:75:00.0: PCI Express bandwidth of 32GT/s available
[200625.317079] ixgbe 000f:75:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[200625.317079] ixgbe 000f:75:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[200625.458980] ixgbe 000f:75:00.0: MAC: 3, PHY: 0, PBA No: 000000-000
[200625.458980] ixgbe 000f:75:00.0: MAC: 3, PHY: 0, PBA No: 000000-000
[200625.547010] ixgbe 000f:75:00.0: 00:10:e0:35:15:f8
[200625.547010] ixgbe 000f:75:00.0: 00:10:e0:35:15:f8
[200625.860614] ixgbe 000f:75:00.0: Intel(R) 10 Gigabit Network Connection
[200625.860614] ixgbe 000f:75:00.0: Intel(R) 10 Gigabit Network Connection
[200625.955544] PCI: Enabling device: (000f:75:00.1), cmd 2
[200625.955544] PCI: Enabling device: (000f:75:00.1), cmd 2
[200626.030316] ixgbe 000f:75:00.1: enabling bus mastering
[200626.030316] ixgbe 000f:75:00.1: enabling bus mastering
[200626.504155] ixgbe 000f:75:00.1: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[200626.504155] ixgbe 000f:75:00.1: Multiqueue Enabled: Rx Queue count = 63, Tx Queue count = 63
[200626.684350] ixgbe 000f:75:00.1: PCI Express bandwidth of 32GT/s available
[200626.684350] ixgbe 000f:75:00.1: PCI Express bandwidth of 32GT/s available
[200626.779948] ixgbe 000f:75:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[200626.779948] ixgbe 000f:75:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[200626.922142] ixgbe 000f:75:00.1: MAC: 3, PHY: 0, PBA No: 000000-000
[200626.922142] ixgbe 000f:75:00.1: MAC: 3, PHY: 0, PBA No: 000000-000
[200627.010169] ixgbe 000f:75:00.1: 00:10:e0:35:15:f9
[200627.010169] ixgbe 000f:75:00.1: 00:10:e0:35:15:f9
[200627.327780] ixgbe 000f:75:00.1: Intel(R) 10 Gigabit Network Connection
[200627.327780] ixgbe 000f:75:00.1: Intel(R) 10 Gigabit Network Connection
[200627.504988] sd 4:0:0:0: Attached scsi generic sg0 type 0
[200627.504988] sd 4:0:0:0: Attached scsi generic sg0 type 0
[200627.581551] sd 4:0:1:0: Attached scsi generic sg1 type 0
[200627.581551] sd 4:0:1:0: Attached scsi generic sg1 type 0
[200627.658626] sd 5:0:0:0: Attached scsi generic sg2 type 0
[200627.658626] sd 5:0:0:0: Attached scsi generic sg2 type 0
[200627.735061] sd 5:0:1:0: Attached scsi generic sg3 type 0
[200627.735061] sd 5:0:1:0: Attached scsi generic sg3 type 0
[200627.811856] sd 5:0:2:0: Attached scsi generic sg4 type 0
[200627.811856] sd 5:0:2:0: Attached scsi generic sg4 type 0
[200628.145195] usb-storage 1-3:1.0: USB Mass Storage device detected
[200628.145195] usb-storage 1-3:1.0: USB Mass Storage device detected
[200628.232805] scsi host6: usb-storage 1-3:1.0
[200628.232805] scsi host6: usb-storage 1-3:1.0
[200628.292484] usbcore: registered new interface driver usb-storage
[200628.292484] usbcore: registered new interface driver usb-storage
[200629.388114] scsi 6:0:0:0: Direct-Access     SMI      USB DISK         3000 PQ: 0 ANSI: 0 CCS
[200629.388114] scsi 6:0:0:0: Direct-Access     SMI      USB DISK         3000 PQ: 0 ANSI: 0 CCS
[200629.513364] sd 6:0:0:0: [sdf] 62652416 512-byte logical blocks: (32.0 GB/29.8 GiB)
[200629.513364] sd 6:0:0:0: [sdf] 62652416 512-byte logical blocks: (32.0 GB/29.8 GiB)
[200629.514349] sd 6:0:0:0: Attached scsi generic sg5 type 0
[200629.514349] sd 6:0:0:0: Attached scsi generic sg5 type 0
[200629.696780] sd 6:0:0:0: [sdf] Write Protect is off
[200629.696780] sd 6:0:0:0: [sdf] Write Protect is off
[200629.765206] sd 6:0:0:0: [sdf] Mode Sense: 43 00 00 00
[200629.765206] sd 6:0:0:0: [sdf] Mode Sense: 43 00 00 00
[200629.838269] sd 6:0:0:0: [sdf] No Caching mode page found
[200629.838269] sd 6:0:0:0: [sdf] No Caching mode page found
[200629.914052] sd 6:0:0:0: [sdf] Assuming drive cache: write through
[200629.914052] sd 6:0:0:0: [sdf] Assuming drive cache: write through
[200630.005949]  sdf: sdf1 sdf2 sdf3
[200630.005949]  sdf: sdf1 sdf2 sdf3
[200630.057129] sd 6:0:0:0: [sdf] Attached SCSI removable disk
[200630.057129] sd 6:0:0:0: [sdf] Attached SCSI removable disk
[200630.983195] EXT4-fs (dm-0): re-mounted. Opts: (null)
[200630.983195] EXT4-fs (dm-0): re-mounted. Opts: (null)
[200631.857932] kjournald starting.  Commit interval 5 seconds
[200631.857932] kjournald starting.  Commit interval 5 seconds
[200631.868889] EXT3-fs (sde1): using internal journal
[200631.868889] EXT3-fs (sde1): using internal journal
[200631.868892] EXT3-fs (sde1): mounted filesystem with ordered data mode
[200631.868892] EXT3-fs (sde1): mounted filesystem with ordered data mode
[200633.042803] Adding 4194296k swap on /dev/mapper/VolGroup-lv_swap.  Priority:-1 extents:1 across:4194296k FS
[200633.042803] Adding 4194296k swap on /dev/mapper/VolGroup-lv_swap.  Priority:-1 extents:1 across:4194296k FS
[200637.514319] NET: Registered protocol family 10
[200637.514319] NET: Registered protocol family 10
[200638.610883] pps pps0: new PPS source ptp0
[200638.610883] pps pps0: new PPS source ptp0
[200638.667612] ixgbe 0000:06:00.0: registered PHC device on eth0
[200638.667612] ixgbe 0000:06:00.0: registered PHC device on eth0
[200638.972994] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[200638.972994] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[200641.874406] audit: type=1305 audit(1427840697.996:4): audit_pid=11694 old=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:auditd_t:s0 res=1
[200641.874406] audit: type=1305 audit(1427840697.996:4): audit_pid=11694 old=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:auditd_t:s0 res=1
[200642.013477] ixgbe 0000:06:00.0 eth0: NIC Link is Up 1 Gbps, Flow Control: RX/TX
[200642.013477] ixgbe 0000:06:00.0 eth0: NIC Link is Up 1 Gbps, Flow Control: RX/TX

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-31 22:29                                       ` David Ahern
@ 2015-03-31 22:38                                         ` Yinghai Lu
  2015-03-31 22:42                                           ` David Ahern
  0 siblings, 1 reply; 39+ messages in thread
From: Yinghai Lu @ 2015-03-31 22:38 UTC (permalink / raw)
  To: David Ahern; +Cc: David Miller, Bjorn Helgaas, linux-pci, sparclinux, LKML

On Tue, Mar 31, 2015 at 3:29 PM, David Ahern <david.ahern@oracle.com> wrote:
>>
>> Please check attached three patches on top of current linus tree.
>>
>
> new log. Same as before -- PCI_DEBUG, ignore_loglevel ofpci_debug=1
>

Good, it is clean now.

Thanks

Yinghai

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-31 22:38                                         ` Yinghai Lu
@ 2015-03-31 22:42                                           ` David Ahern
  0 siblings, 0 replies; 39+ messages in thread
From: David Ahern @ 2015-03-31 22:42 UTC (permalink / raw)
  To: Yinghai Lu; +Cc: David Miller, Bjorn Helgaas, linux-pci, sparclinux, LKML

On 3/31/15 4:38 PM, Yinghai Lu wrote:
> On Tue, Mar 31, 2015 at 3:29 PM, David Ahern <david.ahern@oracle.com> wrote:
>>>
>>> Please check attached three patches on top of current linus tree.
>>>
>>
>> new log. Same as before -- PCI_DEBUG, ignore_loglevel ofpci_debug=1
>>
>
> Good, it is clean now.

Yes. You can add a Tested-by to all 3. These are all 4.0 material I hope 
with a mark for 3.19 stable?

Thanks, Yinghai.

David


^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-03-29 18:32           ` David Miller
@ 2015-04-03 15:45             ` Bjorn Helgaas
  2015-04-03 16:48               ` David Miller
  0 siblings, 1 reply; 39+ messages in thread
From: Bjorn Helgaas @ 2015-04-03 15:45 UTC (permalink / raw)
  To: David Miller
  Cc: bjorn, bjorn.helgaas, sparclinux, linux-pci, yinghai,
	david.ahern, linux-kernel

On Sun, Mar 29, 2015 at 11:32:50AM -0700, David Miller wrote:
> From: Bjorn Helgaas <bjorn.helgaas@gmail.com>
> Date: Sun, 29 Mar 2015 08:30:40 -0500
> 
> > Help me understand the sparc64 situation: are you saying that BAR
> > addresses, i.e., MMIO transactions from a CPU or a peer-to-peer DMA can be
> > 64 bits, but a DMA to main memory can only be 32 bits?
> > 
> > I assume this would work if we made dma_addr_t 64 bits on sparc64.  What
> > would be the cost of doing that?
> 
> The cost is 4 extra bytes in every datastructure, kernel wide, that
> stores DMA addresses.

That much is fairly obvious.  What I don't know is how much difference this
makes in the end.

> Don't use DMA addresses for PCI addresses.  They are absolutely not
> the same, especially when an IOMMU is always present because in that
> case all DMA addresses are virtual and exist in a different realm
> and set of constraints/restrictions.

I'm still trying to figure out a clear description of how a DMA address is
different from a PCI address.  If you capture a transaction with a PCI
analyzer, I don't think you can tell a DMA address from a PCI address
unless you know how bridge windows are programmed.  Even then, I'm not sure
you can tell a CPU-generated PCI address from a DMA address in a
device-generated peer-to-peer transaction.

Bjorn

^ permalink raw reply	[flat|nested] 39+ messages in thread

* Re: d63e2e1f3df breaks sparc/T5-8
  2015-04-03 15:45             ` Bjorn Helgaas
@ 2015-04-03 16:48               ` David Miller
  0 siblings, 0 replies; 39+ messages in thread
From: David Miller @ 2015-04-03 16:48 UTC (permalink / raw)
  To: bhelgaas
  Cc: bjorn, bjorn.helgaas, sparclinux, linux-pci, yinghai,
	david.ahern, linux-kernel

From: Bjorn Helgaas <bhelgaas@google.com>
Date: Fri, 3 Apr 2015 10:45:26 -0500

> On Sun, Mar 29, 2015 at 11:32:50AM -0700, David Miller wrote:
>> From: Bjorn Helgaas <bjorn.helgaas@gmail.com>
>> Date: Sun, 29 Mar 2015 08:30:40 -0500
>> 
>> > Help me understand the sparc64 situation: are you saying that BAR
>> > addresses, i.e., MMIO transactions from a CPU or a peer-to-peer DMA can be
>> > 64 bits, but a DMA to main memory can only be 32 bits?
>> > 
>> > I assume this would work if we made dma_addr_t 64 bits on sparc64.  What
>> > would be the cost of doing that?
>> 
>> The cost is 4 extra bytes in every datastructure, kernel wide, that
>> stores DMA addresses.
> 
> That much is fairly obvious.  What I don't know is how much difference this
> makes in the end.

Networking drivers, and perhaps block drivers too, have a data
structure for each entry in the send/receive rings for the device and
these can be huge.  And each ring entry stores one or more DMA
addresses.

Larger types mean more memory, but also more capacity cache misses in
critical code paths.

I'm really sorry if this isn't painfully obvious to you.

^ permalink raw reply	[flat|nested] 39+ messages in thread

end of thread, other threads:[~2015-04-03 16:49 UTC | newest]

Thread overview: 39+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-03-26 16:51 d63e2e1f3df breaks sparc/T5-8 David Ahern
2015-03-26 20:43 ` Yinghai Lu
2015-03-26 23:27   ` David Ahern
2015-03-27 21:01     ` Yinghai Lu
2015-03-27 21:50       ` David Miller
2015-03-27 22:51         ` Yinghai Lu
     [not found]         ` <CABhMZUVqgsYdT4wn2H8hsrh4f=6hT0G+sg=wwYSt33+jtvBS9A@mail.gmail.com>
2015-03-29 18:32           ` David Miller
2015-04-03 15:45             ` Bjorn Helgaas
2015-04-03 16:48               ` David Miller
2015-03-27 23:57       ` Yinghai Lu
2015-03-28  0:32         ` David Ahern
2015-03-28  0:36           ` David Ahern
2015-03-28  3:19             ` Yinghai Lu
2015-03-28  3:22               ` David Ahern
2015-03-28  3:27                 ` Yinghai Lu
2015-03-28  3:45               ` David Ahern
2015-03-28  5:26                 ` Yinghai Lu
2015-03-28 14:48                   ` David Ahern
2015-03-28 20:24                     ` Yinghai Lu
2015-03-29 14:47                       ` David Ahern
2015-03-29 20:07                         ` Yinghai Lu
2015-03-30 22:54                           ` David Ahern
2015-03-31  1:06                             ` Yinghai Lu
2015-03-31  4:10                               ` David Ahern
2015-03-31 16:53                                 ` Yinghai Lu
2015-03-31 17:04                                   ` David Ahern
2015-03-31 20:28                                     ` Yinghai Lu
2015-03-31 22:29                                       ` David Ahern
2015-03-31 22:38                                         ` Yinghai Lu
2015-03-31 22:42                                           ` David Ahern
2015-03-31 15:06                               ` David Miller
2015-03-31 18:16                                 ` Yinghai Lu
2015-03-31 18:19                                   ` David Miller
2015-03-31 18:25                                     ` Yinghai Lu
2015-03-28  1:05         ` Sam Ravnborg
2015-03-28  2:07           ` Yinghai Lu
2015-03-28  8:18             ` Sam Ravnborg
2015-03-28 18:16         ` David Miller
2015-03-28 20:19           ` Yinghai Lu

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).