3.16-rcX crashes on resume from Suspend-To-RAM

3.16-rcX crashes on resume from Suspend-To-RAM

[Markus Gutschke]

My Dell M4400 has been pretty well-supported by Linux a couple of
years now, but recent 3.16-rcX cause hard crashes when resuming from
Suspend-to-RAM.

This is tricky to debug, as device drivers are not yet restored by the
time that the crash happens. So, I can't use Page-UP to scroll the
screen and see the full crash information. I also cannot use the
netconsole; the ethernet device is still suspended. For similar
reasons, crash kernels don't seem to work either.

After about a day of false starts and a lengthy bi-secting session, I
finally narrowed things down to this change list:

eec15edbb0e14485998635ea7c62e30911b465f0 is the first bad commit
commit eec15edbb0e14485998635ea7c62e30911b465f0
Author: Zhang Rui <rui.zhang@intel.com>
Date:   Fri May 30 04:23:01 2014 +0200

    ACPI / PNP: use device ID list for PNPACPI device enumeration

    ACPI can be used to enumerate PNP devices, but the code does not
    handle this in the right way currently.  Namely, if an ACPI device
    object
     1. Has a _CRS method,
     2. Has an identification of
        "three capital characters followed by four hex digits",
     3. Is not in the excluded IDs list,
    it will be enumerated to PNP bus (that is, a PNP device object will
    be create for it).  This means that, actually, the PNP bus type is
    used as the default bus type for enumerating _HID devices in ACPI.

    However, more and more _HID devices need to be enumerated to the
    platform bus instead (that is, platform device objects need to be
    created for them).  As a result, the device ID list in acpi_platform.c
    is used to enforce creating platform device objects rather than PNP
    device objects for matching devices.  That list has been continuously
    growing recently, unfortunately, and it is pretty much guaranteed to
    grow even more in the future.

    To address that problem it is better to enumerate _HID devices
    as platform devices by default.  To this end, change the way of
    enumerating PNP devices by adding a PNP ACPI scan handler that
    will use a device ID list to create PNP devices for the ACPI
    device objects whose device IDs are present in that list.

    The initial device ID list in the PNP ACPI scan handler contains
    all of the pnp_device_id strings from all the existing PNP drivers,
    so this change should be transparent to the PNP core and all of the
    PNP drivers.  Still, in the future it should be possible to reduce
    its size by converting PNP drivers that need not be PNP for any
    technical reasons into platform drivers.

    Signed-off-by: Zhang Rui <rui.zhang@intel.com>
    [rjw: Rewrote the changelog, modified the PNP ACPI scan handler code]
    Signed-off-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>
    Reviewed-by: Mika Westerberg <mika.westerberg@linux.intel.com>

:040000 040000 b7c07232aa46ae7b6faf9a907fb7274a02e4680fc2e05b31a61dccd087c554adecc89a43a1ed81f7
M drivers
:040000 040000 4eda970292fffbeebe167f9210502527df4e8ab421e9e6fd84c780a34bf3d48b5e7618b551da3b1a
M include

I took a photo of the crash. It feels silly to do, but I couldn't
think of a better solution. You can find it at
https://drive.google.com/file/d/0B8SxqKDe4hyheTlTLXY2YThkMXM

As I mentioned earlier, a bunch of information has already scrolled
off the screen, but hopefully what is visible is somewhat helpful.

I will have only limited internet access the next couple of weeks. But
I wanted to make sure I at least got the result of the bisection out
to LKML. I will make every best effort to collect additional data, if
asked to do so; but some of it might be delayed for a little bit,
until I can get access to reasonably powerful hardware or reasonably
fast internet.


Markus

P.S.: Please keep me cc'd on all responses, as I am not subscribed to
the firehose that is LKML.

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Markus Gutschke]

Adding the reviewers of the faulty change list to the cc list for this
e-mail. I hope that is considered proper etiquette for the LKML.

On Tue, Jul 15, 2014 at 6:51 PM, Markus Gutschke <markus@gutschke.com> wrote:
> My Dell M4400 has been pretty well-supported by Linux a couple of
> years now, but recent 3.16-rcX cause hard crashes when resuming from
> Suspend-to-RAM.
>
> This is tricky to debug, as device drivers are not yet restored by the
> time that the crash happens. So, I can't use Page-UP to scroll the
> screen and see the full crash information. I also cannot use the
> netconsole; the ethernet device is still suspended. For similar
> reasons, crash kernels don't seem to work either.
>
> After about a day of false starts and a lengthy bi-secting session, I
> finally narrowed things down to this change list:
>
> eec15edbb0e14485998635ea7c62e30911b465f0 is the first bad commit
> commit eec15edbb0e14485998635ea7c62e30911b465f0
> Author: Zhang Rui <rui.zhang@intel.com>
> Date:   Fri May 30 04:23:01 2014 +0200
>
>     ACPI / PNP: use device ID list for PNPACPI device enumeration
>
>     ACPI can be used to enumerate PNP devices, but the code does not
>     handle this in the right way currently.  Namely, if an ACPI device
>     object
>      1. Has a _CRS method,
>      2. Has an identification of
>         "three capital characters followed by four hex digits",
>      3. Is not in the excluded IDs list,
>     it will be enumerated to PNP bus (that is, a PNP device object will
>     be create for it).  This means that, actually, the PNP bus type is
>     used as the default bus type for enumerating _HID devices in ACPI.
>
>     However, more and more _HID devices need to be enumerated to the
>     platform bus instead (that is, platform device objects need to be
>     created for them).  As a result, the device ID list in acpi_platform.c
>     is used to enforce creating platform device objects rather than PNP
>     device objects for matching devices.  That list has been continuously
>     growing recently, unfortunately, and it is pretty much guaranteed to
>     grow even more in the future.
>
>     To address that problem it is better to enumerate _HID devices
>     as platform devices by default.  To this end, change the way of
>     enumerating PNP devices by adding a PNP ACPI scan handler that
>     will use a device ID list to create PNP devices for the ACPI
>     device objects whose device IDs are present in that list.
>
>     The initial device ID list in the PNP ACPI scan handler contains
>     all of the pnp_device_id strings from all the existing PNP drivers,
>     so this change should be transparent to the PNP core and all of the
>     PNP drivers.  Still, in the future it should be possible to reduce
>     its size by converting PNP drivers that need not be PNP for any
>     technical reasons into platform drivers.
>
>     Signed-off-by: Zhang Rui <rui.zhang@intel.com>
>     [rjw: Rewrote the changelog, modified the PNP ACPI scan handler code]
>     Signed-off-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>
>     Reviewed-by: Mika Westerberg <mika.westerberg@linux.intel.com>
>
> :040000 040000 b7c07232aa46ae7b6faf9a907fb7274a02e4680fc2e05b31a61dccd087c554adecc89a43a1ed81f7
> M drivers
> :040000 040000 4eda970292fffbeebe167f9210502527df4e8ab421e9e6fd84c780a34bf3d48b5e7618b551da3b1a
> M include
>
> I took a photo of the crash. It feels silly to do, but I couldn't
> think of a better solution. You can find it at
> https://drive.google.com/file/d/0B8SxqKDe4hyheTlTLXY2YThkMXM
>
> As I mentioned earlier, a bunch of information has already scrolled
> off the screen, but hopefully what is visible is somewhat helpful.
>
> I will have only limited internet access the next couple of weeks. But
> I wanted to make sure I at least got the result of the bisection out
> to LKML. I will make every best effort to collect additional data, if
> asked to do so; but some of it might be delayed for a little bit,
> until I can get access to reasonably powerful hardware or reasonably
> fast internet.
>
>
> Markus
>
> P.S.: Please keep me cc'd on all responses, as I am not subscribed to
> the firehose that is LKML.

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Zhang Rui]

Hi, Markus,

Can you please attach
1. the acpidump output
2. dmesg output after boot in 3.16-rc
3. the output of 
   a) "grep . /sys/bus/pnp/devices/*/firmware_node/*"
   b) "grep . /sys/bus/pnp/devices/*/*"
   c) "grep . /sys/bus/platform/devices/*/firmware_node/*"
   d) "grep . /sys/bus/platform/devices/*/*"
   BOTH before and after this commit?

thanks,
rui

On Wed, 2014-07-16 at 23:50 -0700, Markus Gutschke wrote:
> Adding the reviewers of the faulty change list to the cc list for this
> e-mail. I hope that is considered proper etiquette for the LKML.
> 
> On Tue, Jul 15, 2014 at 6:51 PM, Markus Gutschke <markus@gutschke.com> wrote:
> > My Dell M4400 has been pretty well-supported by Linux a couple of
> > years now, but recent 3.16-rcX cause hard crashes when resuming from
> > Suspend-to-RAM.
> >
> > This is tricky to debug, as device drivers are not yet restored by the
> > time that the crash happens. So, I can't use Page-UP to scroll the
> > screen and see the full crash information. I also cannot use the
> > netconsole; the ethernet device is still suspended. For similar
> > reasons, crash kernels don't seem to work either.
> >
> > After about a day of false starts and a lengthy bi-secting session, I
> > finally narrowed things down to this change list:
> >
> > eec15edbb0e14485998635ea7c62e30911b465f0 is the first bad commit
> > commit eec15edbb0e14485998635ea7c62e30911b465f0
> > Author: Zhang Rui <rui.zhang@intel.com>
> > Date:   Fri May 30 04:23:01 2014 +0200
> >
> >     ACPI / PNP: use device ID list for PNPACPI device enumeration
> >
> >     ACPI can be used to enumerate PNP devices, but the code does not
> >     handle this in the right way currently.  Namely, if an ACPI device
> >     object
> >      1. Has a _CRS method,
> >      2. Has an identification of
> >         "three capital characters followed by four hex digits",
> >      3. Is not in the excluded IDs list,
> >     it will be enumerated to PNP bus (that is, a PNP device object will
> >     be create for it).  This means that, actually, the PNP bus type is
> >     used as the default bus type for enumerating _HID devices in ACPI.
> >
> >     However, more and more _HID devices need to be enumerated to the
> >     platform bus instead (that is, platform device objects need to be
> >     created for them).  As a result, the device ID list in acpi_platform.c
> >     is used to enforce creating platform device objects rather than PNP
> >     device objects for matching devices.  That list has been continuously
> >     growing recently, unfortunately, and it is pretty much guaranteed to
> >     grow even more in the future.
> >
> >     To address that problem it is better to enumerate _HID devices
> >     as platform devices by default.  To this end, change the way of
> >     enumerating PNP devices by adding a PNP ACPI scan handler that
> >     will use a device ID list to create PNP devices for the ACPI
> >     device objects whose device IDs are present in that list.
> >
> >     The initial device ID list in the PNP ACPI scan handler contains
> >     all of the pnp_device_id strings from all the existing PNP drivers,
> >     so this change should be transparent to the PNP core and all of the
> >     PNP drivers.  Still, in the future it should be possible to reduce
> >     its size by converting PNP drivers that need not be PNP for any
> >     technical reasons into platform drivers.
> >
> >     Signed-off-by: Zhang Rui <rui.zhang@intel.com>
> >     [rjw: Rewrote the changelog, modified the PNP ACPI scan handler code]
> >     Signed-off-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>
> >     Reviewed-by: Mika Westerberg <mika.westerberg@linux.intel.com>
> >
> > :040000 040000 b7c07232aa46ae7b6faf9a907fb7274a02e4680fc2e05b31a61dccd087c554adecc89a43a1ed81f7
> > M drivers
> > :040000 040000 4eda970292fffbeebe167f9210502527df4e8ab421e9e6fd84c780a34bf3d48b5e7618b551da3b1a
> > M include
> >
> > I took a photo of the crash. It feels silly to do, but I couldn't
> > think of a better solution. You can find it at
> > https://drive.google.com/file/d/0B8SxqKDe4hyheTlTLXY2YThkMXM
> >
> > As I mentioned earlier, a bunch of information has already scrolled
> > off the screen, but hopefully what is visible is somewhat helpful.
> >
> > I will have only limited internet access the next couple of weeks. But
> > I wanted to make sure I at least got the result of the bisection out
> > to LKML. I will make every best effort to collect additional data, if
> > asked to do so; but some of it might be delayed for a little bit,
> > until I can get access to reasonably powerful hardware or reasonably
> > fast internet.
> >
> >
> > Markus
> >
> > P.S.: Please keep me cc'd on all responses, as I am not subscribed to
> > the firehose that is LKML.

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Markus Gutschke]

Please note the crash in "dmesg" right after booting. This looks relevant:

https://medusa.gutschke.com/markus/acpi/after-dmesg.txt
https://medusa.gutschke.com/markus/acpi/acpidump.txt
https://medusa.gutschke.com/markus/acpi/before-platform-devices-firmware-node.txt
https://medusa.gutschke.com/markus/acpi/before-platform-devices.txt
https://medusa.gutschke.com/markus/acpi/before-pnp-devices-firmware-node.txt
https://medusa.gutschke.com/markus/acpi/before-pnp-devices.txt
https://medusa.gutschke.com/markus/acpi/after-platform-devices-firmware-node.txt
https://medusa.gutschke.com/markus/acpi/after-platform-devices.txt
https://medusa.gutschke.com/markus/acpi/after-pnp-devices-firmware-node.txt
https://medusa.gutschke.com/markus/acpi/after-pnp-devices.txt


Markus

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Zhang Rui]

[-- Attachment #1: Type: text/plain, Size: 1299 bytes --]

On Thu, 2014-07-17 at 10:27 -0700, Markus Gutschke wrote:
> Please note the crash in "dmesg" right after booting. This looks relevant:
> 
I think the crash log also exists in 3.15 kernel, can you please verify
this?

> https://medusa.gutschke.com/markus/acpi/after-dmesg.txt
> https://medusa.gutschke.com/markus/acpi/acpidump.txt
> https://medusa.gutschke.com/markus/acpi/before-platform-devices-firmware-node.txt
> https://medusa.gutschke.com/markus/acpi/before-platform-devices.txt
> https://medusa.gutschke.com/markus/acpi/before-pnp-devices-firmware-node.txt
> https://medusa.gutschke.com/markus/acpi/before-pnp-devices.txt
> https://medusa.gutschke.com/markus/acpi/after-platform-devices-firmware-node.txt
> https://medusa.gutschke.com/markus/acpi/after-platform-devices.txt
> https://medusa.gutschke.com/markus/acpi/after-pnp-devices-firmware-node.txt
> https://medusa.gutschke.com/markus/acpi/after-pnp-devices.txt

are you building the kernel with last commit
eec15edbb0e14485998635ea7c62e30911b465f0?

If yes, please rebuild your 3.16 kernel with last commit
b04c58b1ed26317bfb4b33d3a2d16377fc6acd0f, and re-attach the after-*
logs.

And please also apply the debug patch attached on top of commit
b04c58b1ed26317bfb4b33d3a2d16377fc6acd0f, and see if the problem still
exists.

thanks,
rui

[-- Attachment #2: 0001-debug-patch.patch --]
[-- Type: text/x-patch, Size: 638 bytes --]

>From 6e0b48c3075f9b1fcedd97c2f2454a585671dcd2 Mon Sep 17 00:00:00 2001
From: Zhang Rui <rui.zhang@intel.com>
Date: Tue, 22 Jul 2014 08:11:25 +0800
Subject: [PATCH] debug patch

---
 drivers/acpi/acpi_pnp.c | 3 +++
 1 file changed, 3 insertions(+)

diff --git a/drivers/acpi/acpi_pnp.c b/drivers/acpi/acpi_pnp.c
index 4ddb0dc..1c306b4 100644
--- a/drivers/acpi/acpi_pnp.c
+++ b/drivers/acpi/acpi_pnp.c
@@ -317,6 +317,9 @@ static const struct acpi_device_id acpi_pnp_device_ids[] = {
 	/* snd-opl3sa2-pnpbios */
 	{"YMH0021"},
 	{"NMX2210"},		/* Gateway Solo 2500 */
+	{"PNP0800"},
+	{"PNP0200"},
+	{"PNP0c04"},
 	{""},
 };
 
-- 
1.8.3.2

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Markus Gutschke]

Sorry for the delay. Remotely debugging kernels over a shared and
flaky 1MBps terrestrial wireless connection is quite a new experience
to me.

In any case, I was able to collect all the data that you asked for. I
then used "pm-suspend" to put the machine to sleep and asked a helper
to physically press the power button to wake the computer back up. My
helper told me that it crashed just as before, and they had to
power-cycle the machine to bring it back to life.

Please let me know, what other data I can get for you. And thank you
very much for putting up with my slow turn-around. I should have much
better response time again in about two to three weeks when I return
to civilization.

# Startup log file for stock 3.15 kernel
https://medusa.gutschke.com/markus/3.15-dmesg.txt

# Startup log file for b04c58b1ed26317bfb4b33d3a2d16377fc6acd0f
https://medusa.gutschke.com/markus/3.15-rc8-dmesg.txt

# /sys/* files for b04c58b1ed26317bfb4b33d3a2d16377fc6acd0f
https://medusa.gutschke.com/markus/3.15-rc8-platform-devices-firmware-node.txt
https://medusa.gutschke.com/markus/3.15-rc8-platform-devices.txt
https://medusa.gutschke.com/markus/3.15-rc8-pnp-devices-firmware-node.txt
https://medusa.gutschke.com/markus/3.15-rc8-pnp-devices.txt

# /sys/* files for b04c58b1ed26317bfb4b33d3a2d16377fc6acd0f with patch applied
https://medusa.gutschke.com/markus/3.15-rc8-patched-dmesg.txt
https://medusa.gutschke.com/markus/3.15-rc8-patched-platform-devices-firmware-node.txt
https://medusa.gutschke.com/markus/3.15-rc8-patched-platform-devices.txt
https://medusa.gutschke.com/markus/3.15-rc8-patched-pnp-devices-firmware-node.txt
https://medusa.gutschke.com/markus/3.15-rc8-patched-pnp-devices.txt

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Pavel Machek]

On Sat 2014-07-26 08:52:34, Markus Gutschke wrote:
> Sorry for the delay. Remotely debugging kernels over a shared and
> flaky 1MBps terrestrial wireless connection is quite a new experience
> to me.
> 
> In any case, I was able to collect all the data that you asked for. I
> then used "pm-suspend" to put the machine to sleep and asked a helper
> to physically press the power button to wake the computer back up. My
> helper told me that it crashed just as before, and they had to
> power-cycle the machine to bring it back to life.
> 
> Please let me know, what other data I can get for you. And thank you
> very much for putting up with my slow turn-around. I should have much
> better response time again in about two to three weeks when I return
> to civilization.

Was this solved, somehow?

If not, can we revert the patch that causes it?
								Pavel

-- 
(english) http://www.livejournal.com/~pavelmachek
(cesky, pictures) http://atrey.karlin.mff.cuni.cz/~pavel/picture/horses/blog.html

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Markus Gutschke]

Thanks for checking in. And no, I have not heard from Zhang since my
last e-mail. I suspect he is still working on finding a solution. But
you are of course right, reverting the patch in the meantime might be
a good idea. I would love to be able to suspend my laptop again. But I
defer to Zhang for the final decision. As long as it gets fixed
eventually, I can personally live with a few weeks of delay while
things get worked out. And of course, as offered before, I'll run
whatever tests Zhang asks me to do.


Markus

On Mon, Aug 4, 2014 at 7:16 AM, Pavel Machek <pavel@ucw.cz> wrote:
> On Sat 2014-07-26 08:52:34, Markus Gutschke wrote:
>> Sorry for the delay. Remotely debugging kernels over a shared and
>> flaky 1MBps terrestrial wireless connection is quite a new experience
>> to me.
>>
>> In any case, I was able to collect all the data that you asked for. I
>> then used "pm-suspend" to put the machine to sleep and asked a helper
>> to physically press the power button to wake the computer back up. My
>> helper told me that it crashed just as before, and they had to
>> power-cycle the machine to bring it back to life.
>>
>> Please let me know, what other data I can get for you. And thank you
>> very much for putting up with my slow turn-around. I should have much
>> better response time again in about two to three weeks when I return
>> to civilization.
>
> Was this solved, somehow?
>
> If not, can we revert the patch that causes it?
>                                                                 Pavel
>
> --
> (english) http://www.livejournal.com/~pavelmachek
> (cesky, pictures) http://atrey.karlin.mff.cuni.cz/~pavel/picture/horses/blog.html

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Rafael J. Wysocki]

On Monday, August 04, 2014 09:06:52 AM Markus Gutschke wrote:
> Thanks for checking in. And no, I have not heard from Zhang since my
> last e-mail. I suspect he is still working on finding a solution. But
> you are of course right, reverting the patch in the meantime might be
> a good idea.

It has too many dependencies.  Besides, reverting it now (at the beginning of
a merge window) won't be particularly useful anyway.

We need to fix it.

> I would love to be able to suspend my laptop again. But I
> defer to Zhang for the final decision. As long as it gets fixed
> eventually, I can personally live with a few weeks of delay while
> things get worked out. And of course, as offered before, I'll run
> whatever tests Zhang asks me to do.

We've created Bugzilla entry at https://bugzilla.kernel.org/show_bug.cgi?id=80911
for this bug, can you please attach your logs in there?

Rafael

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Zhang Rui]

Hi, Markus,

On Mon, 2014-08-04 at 09:06 -0700, Markus Gutschke wrote:
> Thanks for checking in. And no, I have not heard from Zhang since my
> last e-mail. I suspect he is still working on finding a solution.

Yes, I was trying to find out what differences commit
b04c58b1ed26317bfb4b33d3a2d16377fc6acd0f brings, and why it breaks
suspend. But so far, I didn't make any progress. Thus I do need your
help to do more test.

>  But
> you are of course right, reverting the patch in the meantime might be
> a good idea. I would love to be able to suspend my laptop again. But I
> defer to Zhang for the final decision. As long as it gets fixed
> eventually, I can personally live with a few weeks of delay while
> things get worked out. And of course, as offered before, I'll run
> whatever tests Zhang asks me to do.
> 
Great. Thanks for your help, please
1. make sure your kernel is built with CONFIG_PM_DEBUG and
CONFIG_PM_TRACE_RTC set.
2. in b04c58b1ed26317bfb4b33d3a2d16377fc6acd0f kernel, try "echo devices
> /sys/power/pm_test && echo mem > /sys/power/states", and wait for 10
seconds and see if the system can be resumed automatically.
3. if the test fails, please try a normal suspend, and reboot the kernel
ASAP after the hang, better in one minute, and then attach the dmesg
output after boot. Hopefully, we can find out which driver breaks your
machine by the suspend/resume trace feature. 

thanks,
rui

> Markus
> 
> On Mon, Aug 4, 2014 at 7:16 AM, Pavel Machek <pavel@ucw.cz> wrote:
> > On Sat 2014-07-26 08:52:34, Markus Gutschke wrote:
> >> Sorry for the delay. Remotely debugging kernels over a shared and
> >> flaky 1MBps terrestrial wireless connection is quite a new experience
> >> to me.
> >>
> >> In any case, I was able to collect all the data that you asked for. I
> >> then used "pm-suspend" to put the machine to sleep and asked a helper
> >> to physically press the power button to wake the computer back up. My
> >> helper told me that it crashed just as before, and they had to
> >> power-cycle the machine to bring it back to life.
> >>
> >> Please let me know, what other data I can get for you. And thank you
> >> very much for putting up with my slow turn-around. I should have much
> >> better response time again in about two to three weeks when I return
> >> to civilization.
> >
> > Was this solved, somehow?
> >
> > If not, can we revert the patch that causes it?
> >                                                                 Pavel
> >
> > --
> > (english) http://www.livejournal.com/~pavelmachek
> > (cesky, pictures) http://atrey.karlin.mff.cuni.cz/~pavel/picture/horses/blog.html

Re: 3.16 crashes on resume from Suspend-To-disk

[Janek Kozicki]

[-- Attachment #1: Type: text/plain, Size: 6590 bytes --]

Rafael J. Wysocki said:     (by the date of Tue, 05 Aug 2014 03:30:58 +0200)

> On Monday, August 04, 2014 09:06:52 AM Markus Gutschke wrote:
> > Thanks for checking in. And no, I have not heard from Zhang since my
> > last e-mail. I suspect he is still working on finding a solution. But
> > you are of course right, reverting the patch in the meantime might be
> > a good idea.
> 
> It has too many dependencies.  Besides, reverting it now (at the beginning of
> a merge window) won't be particularly useful anyway.
> 
> We need to fix it.


Hi, sorry for hijacking this thread, but apparently my other plead
for help got ignored in this very busy mailing list.

I have an up-to-date recently installed debian wheezy. I downloaded
https://www.kernel.org/pub/linux/kernel/v3.x/linux-3.16.tar.xz and compiled it using:

  cp /boot/config-`uname -r` ./.config
  make menuconfig
  fakeroot make-kpkg --initrd --append-to-version=-vanilla.1 kernel_image kernel_headers -j38
  dpkg -i linux-image-3.16.0-vanilla.1_3.16.0-vanilla.1-10.00.Custom_amd64.deb linux-headers-3.16.0-vanilla.1_3.16.0-vanilla.1-10.00.Custom_amd64.deb

where .config was taken from debian /boot/config-3.14-0.bpo.1-amd64

my PC has 64GB of RAM, 32 Xeon E5-2687W cores and motherboard SuperMicro MBD-X9DRI

I just did 25 tries of suspend/resume cycle. I tried 4 different
methods of hibernation, you will find a full summary of my tries
(including how many failures for each method) in attached script
SLEEP.sh which I always used to perform hibernation.

The failure was always a reboot after resume had almost succeeded. In
cases when there was a success there was a following ---[cut here]--- part:

Aug  4 17:58:28 absurd kernel: [  660.993238] ------------[ cut here ]------------
Aug  4 17:58:28 absurd kernel: [  660.993247] WARNING: CPU: 10 PID: 11371 at drivers/base/firmware_class.c:1105 _request_firmware+0x9ab/0x9d0()
Aug  4 17:58:28 absurd kernel: [  660.993291] Modules linked in: parport_pc ppdev lp parport bnep rfcomm bluetooth rfkill pci_stub vboxpci(O) vboxnetadp(O) vboxnetflt(O) vboxdrv(O) binfmt_misc nfsd auth_rpcgss oid_registry nfs_acl nfs fscache lockd sunrpc loop hid_logitech_dj raid1 usb_storage snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel nvidia(PO) kvm joydev hid_generic snd_hda_codec_ca0132 crct10dif_pclmul iTCO_wdt crc32_pclmul iTCO_vendor_support usbhid ghash_clmulni_intel hid mxm_wmi evdev aesni_intel snd_hda_intel aes_x86_64 ablk_helper cryptd glue_helper lrw snd_hda_controller gf128mul snd_hda_codec pcspkr snd_hwdep sb_edac snd_pcm edac_core snd_seq i2c_i801 snd_seq_device snd_timer snd lpc_ich mei_me mfd_core soundcore mei ioatdma ipmi_si ipmi_msghandler tpm_tis tpm processor wmi thermal_sys button ext4 mbcache crc16 jbd2 sr_mod cdrom sg sd_mod crc_t10dif crct10dif_common dm_mod md_mod crc32c_intel isci ahci libsas libahci libata scsi_transport_sas scsi_mod igb usbcore i2c_a
Aug  4 17:58:28 absurd kernel: lgo_bit usb_common i2c_core dca ptp pps_core [last unloaded: ehci_hcd]
Aug  4 17:58:28 absurd kernel: [  660.993309] CPU: 10 PID: 11371 Comm: kworker/u66:1 Tainted: P        W  O  3.16.0-vanilla.1 #1
Aug  4 17:58:28 absurd kernel: [  660.993310] Hardware name: Supermicro X9DR3-F/X9DR3-F, BIOS 3.0a 07/31/2013
Aug  4 17:58:28 absurd kernel: [  660.993316] Workqueue: events_unbound async_run_entry_fn
Aug  4 17:58:28 absurd kernel: [  660.993318]  0000000000000000 0000000000000009 ffffffff814fd161 0000000000000000
Aug  4 17:58:28 absurd kernel: [  660.993319]  ffffffff810664f6 ffffffffa03ff09b ffff881056e35ae0 ffff881055168100
Aug  4 17:58:28 absurd kernel: [  660.993321]  ffff880882a2fc90 ffff88105796b000 ffffffff813a7d3b ffff881055182200
Aug  4 17:58:28 absurd kernel: [  660.993321] Call Trace:
Aug  4 17:58:28 absurd kernel: [  660.993329]  [<ffffffff814fd161>] ? dump_stack+0x41/0x51
Aug  4 17:58:28 absurd kernel: [  660.993334]  [<ffffffff810664f6>] ? warn_slowpath_common+0x86/0xb0
Aug  4 17:58:28 absurd kernel: [  660.993337]  [<ffffffff813a7d3b>] ? _request_firmware+0x9ab/0x9d0
Aug  4 17:58:28 absurd kernel: [  660.993339]  [<ffffffff813a7e45>] ? request_firmware+0x35/0x60
Aug  4 17:58:28 absurd kernel: [  660.993343]  [<ffffffffa03fe03f>] ? ca0132_init+0x1bf/0x10d0 [snd_hda_codec_ca0132]
Aug  4 17:58:28 absurd kernel: [  660.993350]  [<ffffffffa02cfe21>] ? snd_hda_codec_read+0x51/0xa0 [snd_hda_codec]
Aug  4 17:58:28 absurd kernel: [  660.993354]  [<ffffffffa02cff17>] ? hda_set_power_state+0xa7/0x160 [snd_hda_codec]
Aug  4 17:58:28 absurd kernel: [  660.993359]  [<ffffffff81089d70>] ? update_rmtp+0x60/0x60
Aug  4 17:58:28 absurd kernel: [  660.993363]  [<ffffffffa02cf951>] ? hda_call_codec_resume+0x1a1/0x1c0 [snd_hda_codec]
Aug  4 17:58:28 absurd kernel: [  660.993366]  [<ffffffffa02d1776>] ? snd_hda_resume+0x76/0xa0 [snd_hda_codec]
Aug  4 17:58:28 absurd kernel: [  660.993370]  [<ffffffffa03ab070>] ? azx_init_chip+0xf0/0x1f0 [snd_hda_controller]
Aug  4 17:58:28 absurd kernel: [  660.993373]  [<ffffffffa0334c91>] ? azx_resume+0xb1/0x180 [snd_hda_intel]
Aug  4 17:58:28 absurd kernel: [  660.993377]  [<ffffffff812d9b10>] ? pci_pm_default_resume+0x30/0x30
Aug  4 17:58:28 absurd kernel: [  660.993380]  [<ffffffff813a128b>] ? dpm_run_callback+0x4b/0xc0
Aug  4 17:58:28 absurd kernel: [  660.993382]  [<ffffffff813a1cd3>] ? device_resume+0x93/0x1d0
Aug  4 17:58:28 absurd kernel: [  660.993384]  [<ffffffff813a1e24>] ? async_resume+0x14/0x40
Aug  4 17:58:28 absurd kernel: [  660.993385]  [<ffffffff8108d02d>] ? async_run_entry_fn+0x2d/0x120
Aug  4 17:58:28 absurd kernel: [  660.993388]  [<ffffffff81080adb>] ? process_one_work+0x16b/0x400
Aug  4 17:58:28 absurd kernel: [  660.993390]  [<ffffffff81081184>] ? worker_thread+0x114/0x510
Aug  4 17:58:28 absurd kernel: [  660.993393]  [<ffffffff814ff3f8>] ? __schedule+0x2c8/0x760
Aug  4 17:58:28 absurd kernel: [  660.993395]  [<ffffffff81081070>] ? rescuer_thread+0x2c0/0x2c0
Aug  4 17:58:28 absurd kernel: [  660.993397]  [<ffffffff810876cc>] ? kthread+0xbc/0xe0
Aug  4 17:58:28 absurd kernel: [  660.993398]  [<ffffffff81087610>] ? flush_kthread_worker+0x80/0x80
Aug  4 17:58:28 absurd kernel: [  660.993400]  [<ffffffff81502f3c>] ? ret_from_fork+0x7c/0xb0
Aug  4 17:58:28 absurd kernel: [  660.993401]  [<ffffffff81087610>] ? flush_kthread_worker+0x80/0x80
Aug  4 17:58:28 absurd kernel: [  660.993402] ---[ end trace db395c2b3c06720c ]---


To start debugging this my first question is: how can I
retrieve some useful logs from a failed resume attempt?

best regards
-- 
Janek Kozicki                               http://janek.kozicki.pl/  |

[-- Attachment #2: SLEEP.sh --]
[-- Type: application/x-shellscript, Size: 1365 bytes --]

Re: 3.16 crashes on resume from Suspend-To-disk

[Janek Kozicki]

Rafael J. Wysocki said:     (by the date of Tue, 05 Aug 2014 03:30:58 +0200)

> On Monday, August 04, 2014 09:06:52 AM Markus Gutschke wrote:
> > Thanks for checking in. And no, I have not heard from Zhang since my
> > last e-mail. I suspect he is still working on finding a solution. But
> > you are of course right, reverting the patch in the meantime might be
> > a good idea.
> 
> It has too many dependencies.  Besides, reverting it now (at the beginning of
> a merge window) won't be particularly useful anyway.
> 
> We need to fix it.


Hi, sorry for hijacking this thread, but apparently my other plead
for help got ignored in this very busy mailing list.

I have an up-to-date recently installed debian wheezy. I downloaded
https://www.kernel.org/pub/linux/kernel/v3.x/linux-3.16.tar.xz and compiled it using:
  cp /boot/config-`uname -r` ./.config
  make menuconfig
  fakeroot make-kpkg --initrd --append-to-version=-vanilla.1 kernel_image kernel_headers -j38
  dpkg -i linux-image-3.16.0-vanilla.1_3.16.0-vanilla.1-10.00.Custom_amd64.deb linux-headers-3.16.0-vanilla.1_3.16.0-vanilla.1-10.00.Custom_amd64.deb

where .config was taken from debian /boot/config-3.14-0.bpo.1-amd64

my PC has 64GB of RAM, 32 Xeon E5-2687W cores and motherboard SuperMicro MBD-X9DRI

I just did 25 tries of suspend/resume cycle. I tried 4 different
methods of hibernation:

1. /usr/sbin/hibernate                  # 7 successess, 1 failure
2. /usr/sbin/s2disk                     # 8 successess, 2 failures
3. echo platform > /sys/power/disk      # 0 successess, 5 failures
   echo disk > /sys/power/state
4. echo shutdown > /sys/power/disk      # 2 successess, 3 failures
   echo disk > /sys/power/state



The failure was always a reboot after resume had almost succeeded. In
cases when there was a success there was a following ---[cut here]--- part:

Aug  4 17:58:28 absurd kernel: [  660.993238] ------------[ cut here ]------------
Aug  4 17:58:28 absurd kernel: [  660.993247] WARNING: CPU: 10 PID: 11371 at drivers/base/firmware_class.c:1105 _request_firmware+0x9ab/0x9d0()
Aug  4 17:58:28 absurd kernel: [  660.993291] Modules linked in: parport_pc ppdev lp parport bnep rfcomm bluetooth rfkill pci_stub vboxpci(O) vboxnetadp(O) vboxnetflt(O) vboxdrv(O) binfmt_misc nfsd auth_rpcgss oid_registry nfs_acl nfs fscache lockd sunrpc loop hid_logitech_dj raid1 usb_storage snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel nvidia(PO) kvm joydev hid_generic snd_hda_codec_ca0132 crct10dif_pclmul iTCO_wdt crc32_pclmul iTCO_vendor_support usbhid ghash_clmulni_intel hid mxm_wmi evdev aesni_intel snd_hda_intel aes_x86_64 ablk_helper cryptd glue_helper lrw snd_hda_controller gf128mul snd_hda_codec pcspkr snd_hwdep sb_edac snd_pcm edac_core snd_seq i2c_i801 snd_seq_device snd_timer snd lpc_ich mei_me mfd_core soundcore mei ioatdma ipmi_si ipmi_msghandler tpm_tis tpm processor wmi thermal_sys button ext4 mbcache crc16 jbd2 sr_mod cdrom sg sd_mod crc_t10dif crct10dif_common dm_mod md_mod crc32c_intel isci ahci libsas libahci libata scsi_transport_sas scsi_mod igb usbcore i2c_a
Aug  4 17:58:28 absurd kernel: lgo_bit usb_common i2c_core dca ptp pps_core [last unloaded: ehci_hcd]
Aug  4 17:58:28 absurd kernel: [  660.993309] CPU: 10 PID: 11371 Comm: kworker/u66:1 Tainted: P        W  O  3.16.0-vanilla.1 #1
Aug  4 17:58:28 absurd kernel: [  660.993310] Hardware name: Supermicro X9DR3-F/X9DR3-F, BIOS 3.0a 07/31/2013
Aug  4 17:58:28 absurd kernel: [  660.993316] Workqueue: events_unbound async_run_entry_fn
Aug  4 17:58:28 absurd kernel: [  660.993318]  0000000000000000 0000000000000009 ffffffff814fd161 0000000000000000
Aug  4 17:58:28 absurd kernel: [  660.993319]  ffffffff810664f6 ffffffffa03ff09b ffff881056e35ae0 ffff881055168100
Aug  4 17:58:28 absurd kernel: [  660.993321]  ffff880882a2fc90 ffff88105796b000 ffffffff813a7d3b ffff881055182200
Aug  4 17:58:28 absurd kernel: [  660.993321] Call Trace:
Aug  4 17:58:28 absurd kernel: [  660.993329]  [<ffffffff814fd161>] ? dump_stack+0x41/0x51
Aug  4 17:58:28 absurd kernel: [  660.993334]  [<ffffffff810664f6>] ? warn_slowpath_common+0x86/0xb0
Aug  4 17:58:28 absurd kernel: [  660.993337]  [<ffffffff813a7d3b>] ? _request_firmware+0x9ab/0x9d0
Aug  4 17:58:28 absurd kernel: [  660.993339]  [<ffffffff813a7e45>] ? request_firmware+0x35/0x60
Aug  4 17:58:28 absurd kernel: [  660.993343]  [<ffffffffa03fe03f>] ? ca0132_init+0x1bf/0x10d0 [snd_hda_codec_ca0132]
Aug  4 17:58:28 absurd kernel: [  660.993350]  [<ffffffffa02cfe21>] ? snd_hda_codec_read+0x51/0xa0 [snd_hda_codec]
Aug  4 17:58:28 absurd kernel: [  660.993354]  [<ffffffffa02cff17>] ? hda_set_power_state+0xa7/0x160 [snd_hda_codec]
Aug  4 17:58:28 absurd kernel: [  660.993359]  [<ffffffff81089d70>] ? update_rmtp+0x60/0x60
Aug  4 17:58:28 absurd kernel: [  660.993363]  [<ffffffffa02cf951>] ? hda_call_codec_resume+0x1a1/0x1c0 [snd_hda_codec]
Aug  4 17:58:28 absurd kernel: [  660.993366]  [<ffffffffa02d1776>] ? snd_hda_resume+0x76/0xa0 [snd_hda_codec]
Aug  4 17:58:28 absurd kernel: [  660.993370]  [<ffffffffa03ab070>] ? azx_init_chip+0xf0/0x1f0 [snd_hda_controller]
Aug  4 17:58:28 absurd kernel: [  660.993373]  [<ffffffffa0334c91>] ? azx_resume+0xb1/0x180 [snd_hda_intel]
Aug  4 17:58:28 absurd kernel: [  660.993377]  [<ffffffff812d9b10>] ? pci_pm_default_resume+0x30/0x30
Aug  4 17:58:28 absurd kernel: [  660.993380]  [<ffffffff813a128b>] ? dpm_run_callback+0x4b/0xc0
Aug  4 17:58:28 absurd kernel: [  660.993382]  [<ffffffff813a1cd3>] ? device_resume+0x93/0x1d0
Aug  4 17:58:28 absurd kernel: [  660.993384]  [<ffffffff813a1e24>] ? async_resume+0x14/0x40
Aug  4 17:58:28 absurd kernel: [  660.993385]  [<ffffffff8108d02d>] ? async_run_entry_fn+0x2d/0x120
Aug  4 17:58:28 absurd kernel: [  660.993388]  [<ffffffff81080adb>] ? process_one_work+0x16b/0x400
Aug  4 17:58:28 absurd kernel: [  660.993390]  [<ffffffff81081184>] ? worker_thread+0x114/0x510
Aug  4 17:58:28 absurd kernel: [  660.993393]  [<ffffffff814ff3f8>] ? __schedule+0x2c8/0x760
Aug  4 17:58:28 absurd kernel: [  660.993395]  [<ffffffff81081070>] ? rescuer_thread+0x2c0/0x2c0
Aug  4 17:58:28 absurd kernel: [  660.993397]  [<ffffffff810876cc>] ? kthread+0xbc/0xe0
Aug  4 17:58:28 absurd kernel: [  660.993398]  [<ffffffff81087610>] ? flush_kthread_worker+0x80/0x80
Aug  4 17:58:28 absurd kernel: [  660.993400]  [<ffffffff81502f3c>] ? ret_from_fork+0x7c/0xb0
Aug  4 17:58:28 absurd kernel: [  660.993401]  [<ffffffff81087610>] ? flush_kthread_worker+0x80/0x80
Aug  4 17:58:28 absurd kernel: [  660.993402] ---[ end trace db395c2b3c06720c ]---


To start debugging this my first question is: how can I
retrieve some useful logs from a failed resume attempt?

best regards
-- 
Janek Kozicki                               http://janek.kozicki.pl/  |

Re: 3.16 crashes on resume from Suspend-To-disk

[Rafael J. Wysocki]

On Tuesday, August 05, 2014 07:07:09 PM Janek Kozicki wrote:
> Rafael J. Wysocki said:     (by the date of Tue, 05 Aug 2014 03:30:58 +0200)
> 
> > On Monday, August 04, 2014 09:06:52 AM Markus Gutschke wrote:
> > > Thanks for checking in. And no, I have not heard from Zhang since my
> > > last e-mail. I suspect he is still working on finding a solution. But
> > > you are of course right, reverting the patch in the meantime might be
> > > a good idea.
> > 
> > It has too many dependencies.  Besides, reverting it now (at the beginning of
> > a merge window) won't be particularly useful anyway.
> > 
> > We need to fix it.
> 
> 
> Hi, sorry for hijacking this thread, but apparently my other plead
> for help got ignored in this very busy mailing list.
> 
> I have an up-to-date recently installed debian wheezy. I downloaded
> https://www.kernel.org/pub/linux/kernel/v3.x/linux-3.16.tar.xz and compiled it using:
>   cp /boot/config-`uname -r` ./.config
>   make menuconfig
>   fakeroot make-kpkg --initrd --append-to-version=-vanilla.1 kernel_image kernel_headers -j38
>   dpkg -i linux-image-3.16.0-vanilla.1_3.16.0-vanilla.1-10.00.Custom_amd64.deb linux-headers-3.16.0-vanilla.1_3.16.0-vanilla.1-10.00.Custom_amd64.deb
> 
> where .config was taken from debian /boot/config-3.14-0.bpo.1-amd64
> 
> my PC has 64GB of RAM, 32 Xeon E5-2687W cores and motherboard SuperMicro MBD-X9DRI
> 
> I just did 25 tries of suspend/resume cycle. I tried 4 different
> methods of hibernation:
> 
> 1. /usr/sbin/hibernate                  # 7 successess, 1 failure
> 2. /usr/sbin/s2disk                     # 8 successess, 2 failures
> 3. echo platform > /sys/power/disk      # 0 successess, 5 failures
>    echo disk > /sys/power/state
> 4. echo shutdown > /sys/power/disk      # 2 successess, 3 failures
>    echo disk > /sys/power/state
> 
> 
> 
> The failure was always a reboot after resume had almost succeeded. In
> cases when there was a success there was a following ---[cut here]--- part:

This is warning is from _request_firmware() and is triggered by the snd-hda-intel
driver (audio).

Why don't you file a bug at bugzilla.kernel.org against hibernation/suspend and
put that information into it?

> Aug  4 17:58:28 absurd kernel: [  660.993238] ------------[ cut here ]------------
> Aug  4 17:58:28 absurd kernel: [  660.993247] WARNING: CPU: 10 PID: 11371 at drivers/base/firmware_class.c:1105 _request_firmware+0x9ab/0x9d0()
> Aug  4 17:58:28 absurd kernel: [  660.993291] Modules linked in: parport_pc ppdev lp parport bnep rfcomm bluetooth rfkill pci_stub vboxpci(O) vboxnetadp(O) vboxnetflt(O) vboxdrv(O) binfmt_misc nfsd auth_rpcgss oid_registry nfs_acl nfs fscache lockd sunrpc loop hid_logitech_dj raid1 usb_storage snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel nvidia(PO) kvm joydev hid_generic snd_hda_codec_ca0132 crct10dif_pclmul iTCO_wdt crc32_pclmul iTCO_vendor_support usbhid ghash_clmulni_intel hid mxm_wmi evdev aesni_intel snd_hda_intel aes_x86_64 ablk_helper cryptd glue_helper lrw snd_hda_controller gf128mul snd_hda_codec pcspkr snd_hwdep sb_edac snd_pcm edac_core snd_seq i2c_i801 snd_seq_device snd_timer snd lpc_ich mei_me mfd_core soundcore mei ioatdma ipmi_si ipmi_msghandler tpm_tis tpm processor wmi thermal_sys button ext4 mbcache crc16 jbd2 sr_mod cdrom sg sd_mod crc_t10dif crct10dif_common dm_mod md_mod crc32c_intel isci ahci libsas libahci libata scsi_transport_sas scsi_mod igb usbcore i2c_a
> Aug  4 17:58:28 absurd kernel: lgo_bit usb_common i2c_core dca ptp pps_core [last unloaded: ehci_hcd]
> Aug  4 17:58:28 absurd kernel: [  660.993309] CPU: 10 PID: 11371 Comm: kworker/u66:1 Tainted: P        W  O  3.16.0-vanilla.1 #1
> Aug  4 17:58:28 absurd kernel: [  660.993310] Hardware name: Supermicro X9DR3-F/X9DR3-F, BIOS 3.0a 07/31/2013
> Aug  4 17:58:28 absurd kernel: [  660.993316] Workqueue: events_unbound async_run_entry_fn
> Aug  4 17:58:28 absurd kernel: [  660.993318]  0000000000000000 0000000000000009 ffffffff814fd161 0000000000000000
> Aug  4 17:58:28 absurd kernel: [  660.993319]  ffffffff810664f6 ffffffffa03ff09b ffff881056e35ae0 ffff881055168100
> Aug  4 17:58:28 absurd kernel: [  660.993321]  ffff880882a2fc90 ffff88105796b000 ffffffff813a7d3b ffff881055182200
> Aug  4 17:58:28 absurd kernel: [  660.993321] Call Trace:
> Aug  4 17:58:28 absurd kernel: [  660.993329]  [<ffffffff814fd161>] ? dump_stack+0x41/0x51
> Aug  4 17:58:28 absurd kernel: [  660.993334]  [<ffffffff810664f6>] ? warn_slowpath_common+0x86/0xb0
> Aug  4 17:58:28 absurd kernel: [  660.993337]  [<ffffffff813a7d3b>] ? _request_firmware+0x9ab/0x9d0
> Aug  4 17:58:28 absurd kernel: [  660.993339]  [<ffffffff813a7e45>] ? request_firmware+0x35/0x60
> Aug  4 17:58:28 absurd kernel: [  660.993343]  [<ffffffffa03fe03f>] ? ca0132_init+0x1bf/0x10d0 [snd_hda_codec_ca0132]
> Aug  4 17:58:28 absurd kernel: [  660.993350]  [<ffffffffa02cfe21>] ? snd_hda_codec_read+0x51/0xa0 [snd_hda_codec]
> Aug  4 17:58:28 absurd kernel: [  660.993354]  [<ffffffffa02cff17>] ? hda_set_power_state+0xa7/0x160 [snd_hda_codec]
> Aug  4 17:58:28 absurd kernel: [  660.993359]  [<ffffffff81089d70>] ? update_rmtp+0x60/0x60
> Aug  4 17:58:28 absurd kernel: [  660.993363]  [<ffffffffa02cf951>] ? hda_call_codec_resume+0x1a1/0x1c0 [snd_hda_codec]
> Aug  4 17:58:28 absurd kernel: [  660.993366]  [<ffffffffa02d1776>] ? snd_hda_resume+0x76/0xa0 [snd_hda_codec]
> Aug  4 17:58:28 absurd kernel: [  660.993370]  [<ffffffffa03ab070>] ? azx_init_chip+0xf0/0x1f0 [snd_hda_controller]
> Aug  4 17:58:28 absurd kernel: [  660.993373]  [<ffffffffa0334c91>] ? azx_resume+0xb1/0x180 [snd_hda_intel]
> Aug  4 17:58:28 absurd kernel: [  660.993377]  [<ffffffff812d9b10>] ? pci_pm_default_resume+0x30/0x30
> Aug  4 17:58:28 absurd kernel: [  660.993380]  [<ffffffff813a128b>] ? dpm_run_callback+0x4b/0xc0
> Aug  4 17:58:28 absurd kernel: [  660.993382]  [<ffffffff813a1cd3>] ? device_resume+0x93/0x1d0
> Aug  4 17:58:28 absurd kernel: [  660.993384]  [<ffffffff813a1e24>] ? async_resume+0x14/0x40
> Aug  4 17:58:28 absurd kernel: [  660.993385]  [<ffffffff8108d02d>] ? async_run_entry_fn+0x2d/0x120
> Aug  4 17:58:28 absurd kernel: [  660.993388]  [<ffffffff81080adb>] ? process_one_work+0x16b/0x400
> Aug  4 17:58:28 absurd kernel: [  660.993390]  [<ffffffff81081184>] ? worker_thread+0x114/0x510
> Aug  4 17:58:28 absurd kernel: [  660.993393]  [<ffffffff814ff3f8>] ? __schedule+0x2c8/0x760
> Aug  4 17:58:28 absurd kernel: [  660.993395]  [<ffffffff81081070>] ? rescuer_thread+0x2c0/0x2c0
> Aug  4 17:58:28 absurd kernel: [  660.993397]  [<ffffffff810876cc>] ? kthread+0xbc/0xe0
> Aug  4 17:58:28 absurd kernel: [  660.993398]  [<ffffffff81087610>] ? flush_kthread_worker+0x80/0x80
> Aug  4 17:58:28 absurd kernel: [  660.993400]  [<ffffffff81502f3c>] ? ret_from_fork+0x7c/0xb0
> Aug  4 17:58:28 absurd kernel: [  660.993401]  [<ffffffff81087610>] ? flush_kthread_worker+0x80/0x80
> Aug  4 17:58:28 absurd kernel: [  660.993402] ---[ end trace db395c2b3c06720c ]---
> 
> 
> To start debugging this my first question is: how can I
> retrieve some useful logs from a failed resume attempt?

It is documented to some extent in

Documentation/power/s2ram.txt
Documentation/power/basic-pm-debugging.txt

Some of the information in there is outdated, but the rest should still work.

Rafael

Re: 3.16 crashes on resume from Suspend-To-disk

[Pavel Machek]

On Tue 2014-08-05 11:58:34, Janek Kozicki wrote:
> Rafael J. Wysocki said:     (by the date of Tue, 05 Aug 2014 03:30:58 +0200)
> 
> > On Monday, August 04, 2014 09:06:52 AM Markus Gutschke wrote:
> > > Thanks for checking in. And no, I have not heard from Zhang since my
> > > last e-mail. I suspect he is still working on finding a solution. But
> > > you are of course right, reverting the patch in the meantime might be
> > > a good idea.
> > 
> > It has too many dependencies.  Besides, reverting it now (at the beginning of
> > a merge window) won't be particularly useful anyway.
> > 
> > We need to fix it.
> 
> 
> Hi, sorry for hijacking this thread, but apparently my other plead
> for help got ignored in this very busy mailing list.
> 
> I have an up-to-date recently installed debian wheezy. I downloaded
> https://www.kernel.org/pub/linux/kernel/v3.x/linux-3.16.tar.xz and compiled it using:
> 
>   cp /boot/config-`uname -r` ./.config
>   make menuconfig
>   fakeroot make-kpkg --initrd --append-to-version=-vanilla.1 kernel_image kernel_headers -j38
>   dpkg -i linux-image-3.16.0-vanilla.1_3.16.0-vanilla.1-10.00.Custom_amd64.deb linux-headers-3.16.0-vanilla.1_3.16.0-vanilla.1-10.00.Custom_amd64.deb
> 
> where .config was taken from debian /boot/config-3.14-0.bpo.1-amd64
> 
> my PC has 64GB of RAM, 32 Xeon E5-2687W cores and motherboard SuperMicro MBD-X9DRI
> 
> I just did 25 tries of suspend/resume cycle. I tried 4 different
> methods of hibernation, you will find a full summary of my tries
> (including how many failures for each method) in attached script
> SLEEP.sh which I always used to perform hibernation.
> 
> The failure was always a reboot after resume had almost succeeded. In
> cases when there was a success there was a following ---[cut
>here]--- part:

The Intel audio driver seems to be requesting firmware... Can you
rmmod snd_hda_codec_ca0132 and similar modules, and retry hibernation?
										Pavel

-- 
(english) http://www.livejournal.com/~pavelmachek
(cesky, pictures) http://atrey.karlin.mff.cuni.cz/~pavel/picture/horses/blog.html

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Markus Gutschke]

I tried removing snd_hda_intel, but it didn't make any difference.

I then followed your instructions to turn on tracing, but I am more
puzzled than I was before. The crash reliably happens, every time I
suspend/resume without first having tracing turned on. But as soon as
I enter "echo devices >/sys/power/pm_test" to enable tracing things
change. Upon suspending, the machine now happily resumes itself again
a few seconds later. No crash whatsoever.

Is this the expected behavior? Anything else you want me to do?


Markus

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Rafael J. Wysocki]

On Wednesday, August 06, 2014 11:31:07 AM Markus Gutschke wrote:
> I tried removing snd_hda_intel, but it didn't make any difference.
> 
> I then followed your instructions to turn on tracing, but I am more
> puzzled than I was before. The crash reliably happens, every time I
> suspend/resume without first having tracing turned on. But as soon as
> I enter "echo devices >/sys/power/pm_test" to enable tracing things
> change. Upon suspending, the machine now happily resumes itself again
> a few seconds later. No crash whatsoever.
> 
> Is this the expected behavior? Anything else you want me to do?

Yes, it is.  This means that suspending/resuming devices works correctly.

Please try

# echo platform > /sys/power/pm_test

and see if that triggers the crash.

If it doesn't, please try

# echo processors > /sys/power/pm_test

and if that doesn't trigger the crash,

# echo core > /sys/power/pm_test

(this is described in Documentation/power/basic-pm-debugging.txt in the kernel
source tree, BTW).

Rafael

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Markus Gutschke]

"platform" does in fact appear to cause a crash (at least, I can't
reach the machine anymore, after having suspended).

I am still on the road and have to do this remotely, and I cannot get
hold of my helper right now. I'll try again later tonight or maybe the
next day(s) and will get back to you with more data.


Markus

Re: 3.16 crashes on resume from Suspend-To-disk

[Takashi Iwai]

At Wed, 06 Aug 2014 01:15 +0200,
Rafael J. Wysocki wrote:
> 
> On Tuesday, August 05, 2014 07:07:09 PM Janek Kozicki wrote:
> > Rafael J. Wysocki said:     (by the date of Tue, 05 Aug 2014 03:30:58 +0200)
> > 
> > > On Monday, August 04, 2014 09:06:52 AM Markus Gutschke wrote:
> > > > Thanks for checking in. And no, I have not heard from Zhang since my
> > > > last e-mail. I suspect he is still working on finding a solution. But
> > > > you are of course right, reverting the patch in the meantime might be
> > > > a good idea.
> > > 
> > > It has too many dependencies.  Besides, reverting it now (at the beginning of
> > > a merge window) won't be particularly useful anyway.
> > > 
> > > We need to fix it.
> > 
> > 
> > Hi, sorry for hijacking this thread, but apparently my other plead
> > for help got ignored in this very busy mailing list.
> > 
> > I have an up-to-date recently installed debian wheezy. I downloaded
> > https://www.kernel.org/pub/linux/kernel/v3.x/linux-3.16.tar.xz and compiled it using:
> >   cp /boot/config-`uname -r` ./.config
> >   make menuconfig
> >   fakeroot make-kpkg --initrd --append-to-version=-vanilla.1 kernel_image kernel_headers -j38
> >   dpkg -i linux-image-3.16.0-vanilla.1_3.16.0-vanilla.1-10.00.Custom_amd64.deb linux-headers-3.16.0-vanilla.1_3.16.0-vanilla.1-10.00.Custom_amd64.deb
> > 
> > where .config was taken from debian /boot/config-3.14-0.bpo.1-amd64
> > 
> > my PC has 64GB of RAM, 32 Xeon E5-2687W cores and motherboard SuperMicro MBD-X9DRI
> > 
> > I just did 25 tries of suspend/resume cycle. I tried 4 different
> > methods of hibernation:
> > 
> > 1. /usr/sbin/hibernate                  # 7 successess, 1 failure
> > 2. /usr/sbin/s2disk                     # 8 successess, 2 failures
> > 3. echo platform > /sys/power/disk      # 0 successess, 5 failures
> >    echo disk > /sys/power/state
> > 4. echo shutdown > /sys/power/disk      # 2 successess, 3 failures
> >    echo disk > /sys/power/state
> > 
> > 
> > 
> > The failure was always a reboot after resume had almost succeeded. In
> > cases when there was a success there was a following ---[cut here]--- part:
> 
> This is warning is from _request_firmware() and is triggered by the snd-hda-intel
> driver (audio).
> 
> Why don't you file a bug at bugzilla.kernel.org against hibernation/suspend and
> put that information into it?

.... or involve the relevant maintainer :)

I can't tell exactly because of lack of the whole kernel message, but
if my guess is correct,  the problem is that the machine has no
firmware installed.  Usually, the firmware is cached in the firmware
core code and reused in the resume code path.  If the prior
request_firmware() failed, however, the succeeding request_firmware()
at resume will go into the actual f/w loading code, thus it triggers
such a warning.

A quick patch below is an untested fix.  Let me know if this really
fixes the issue.


thanks,

Takashi

---
diff --git a/sound/pci/hda/patch_ca0132.c b/sound/pci/hda/patch_ca0132.c
index 4f3aba78f720..5d8455e2dacd 100644
--- a/sound/pci/hda/patch_ca0132.c
+++ b/sound/pci/hda/patch_ca0132.c
@@ -4376,6 +4376,9 @@ static void ca0132_download_dsp(struct hda_codec *codec)
 	return; /* NOP */
 #endif
 
+	if (spec->dsp_state == DSP_DOWNLOAD_FAILED)
+		return; /* don't retry failures */
+
 	chipio_enable_clocks(codec);
 	spec->dsp_state = DSP_DOWNLOADING;
 	if (!ca0132_download_dsp_images(codec))
@@ -4552,7 +4555,8 @@ static int ca0132_init(struct hda_codec *codec)
 	struct auto_pin_cfg *cfg = &spec->autocfg;
 	int i;
 
-	spec->dsp_state = DSP_DOWNLOAD_INIT;
+	if (spec->dsp_state != DSP_DOWNLOAD_FAILED)
+		spec->dsp_state = DSP_DOWNLOAD_INIT;
 	spec->curr_chip_addx = INVALID_CHIP_ADDRESS;
 
 	snd_hda_power_up(codec);
@@ -4663,6 +4667,7 @@ static int patch_ca0132(struct hda_codec *codec)
 	codec->spec = spec;
 	spec->codec = codec;
 
+	spec->dsp_state = DSP_DOWNLOAD_INIT;
 	spec->num_mixers = 1;
 	spec->mixers[0] = ca0132_mixer;
 

Re: 3.16 crashes on resume from Suspend-To-disk

[Janek Kozicki]

Pavel Machek said:     (by the date of Wed, 6 Aug 2014 14:25:48 +0200)

> On Tue 2014-08-05 11:58:34, Janek Kozicki wrote:
> > Rafael J. Wysocki said:     (by the date of Tue, 05 Aug 2014 03:30:58 +0200)
> > 
> > > On Monday, August 04, 2014 09:06:52 AM Markus Gutschke wrote:
> > > > Thanks for checking in. And no, I have not heard from Zhang since my
> > > > last e-mail. I suspect he is still working on finding a solution. But
> > > > you are of course right, reverting the patch in the meantime might be
> > > > a good idea.
> > > 
> > > It has too many dependencies.  Besides, reverting it now (at the beginning of
> > > a merge window) won't be particularly useful anyway.
> > > 
> > > We need to fix it.
> > 
> > 
> > Hi, sorry for hijacking this thread, but apparently my other plead
> > for help got ignored in this very busy mailing list.
> > 
> > I have an up-to-date recently installed debian wheezy. I downloaded
> > https://www.kernel.org/pub/linux/kernel/v3.x/linux-3.16.tar.xz and compiled it using:
> > 
> >   cp /boot/config-`uname -r` ./.config
> >   make menuconfig
> >   fakeroot make-kpkg --initrd --append-to-version=-vanilla.1 kernel_image kernel_headers -j38
> >   dpkg -i linux-image-3.16.0-vanilla.1_3.16.0-vanilla.1-10.00.Custom_amd64.deb linux-headers-3.16.0-vanilla.1_3.16.0-vanilla.1-10.00.Custom_amd64.deb
> > 
> > where .config was taken from debian /boot/config-3.14-0.bpo.1-amd64
> > 
> > my PC has 64GB of RAM, 32 Xeon E5-2687W cores and motherboard SuperMicro MBD-X9DRI
> > 
> > I just did 25 tries of suspend/resume cycle. I tried 4 different
> > methods of hibernation, you will find a full summary of my tries
> > (including how many failures for each method) in attached script
> > SLEEP.sh which I always used to perform hibernation.
> > 
> > The failure was always a reboot after resume had almost succeeded. In
> > cases when there was a success there was a following ---[cut
> >here]--- part:
> 
> The Intel audio driver seems to be requesting firmware... Can you
> rmmod snd_hda_codec_ca0132 and similar modules, and retry
> hibernation? 

Thanks a lot for your reply,

I did rmmod everything related to snd_hda_codec_ca0132 and then it
hanged during the suspend! There was something written on text
console, but I wasn't fast enough to photograph it. And I don't know
if it's written on the disk somewhere.

Now I'm following instructions from Rafael Wysocki and Takashi Iwai.
I hope these will help me getting out some useful debugging info.

-- 
Janek Kozicki                               http://janek.kozicki.pl/  |

Re: 3.16 crashes on resume from Suspend-To-disk, Intel pci_bus problem?

[Janek Kozicki]

Full reply, along with CONFIG_PM_TRACE_RTC=y results is below.


Takashi Iwai said:     (by the date of Thu, 07 Aug 2014 11:34:26
+0200)

> At Wed, 06 Aug 2014 01:15 +0200,
> Rafael J. Wysocki wrote:
> > 
> > On Tuesday, August 05, 2014 07:07:09 PM Janek Kozicki wrote:
> > > Rafael J. Wysocki said:     (by the date of Tue, 05 Aug 2014 03:30:58 +0200)
> > > 
> > > > On Monday, August 04, 2014 09:06:52 AM Markus Gutschke wrote:
> > > > > Thanks for checking in. And no, I have not heard from Zhang since my
> > > > > last e-mail. I suspect he is still working on finding a solution. But
> > > > > you are of course right, reverting the patch in the meantime might be
> > > > > a good idea.
> > > > 
> > > > It has too many dependencies.  Besides, reverting it now (at the beginning of
> > > > a merge window) won't be particularly useful anyway.
> > > > 
> > > > We need to fix it.
> > > 
> > > 
> > > Hi, sorry for hijacking this thread, but apparently my other plead
> > > for help got ignored in this very busy mailing list.
> > > 
> > > I have an up-to-date recently installed debian wheezy. I downloaded
> > > https://www.kernel.org/pub/linux/kernel/v3.x/linux-3.16.tar.xz and compiled it using:
> > >   cp /boot/config-`uname -r` ./.config
> > >   make menuconfig
> > >   fakeroot make-kpkg --initrd --append-to-version=-vanilla.1 kernel_image kernel_headers -j38
> > >   dpkg -i linux-image-3.16.0-vanilla.1_3.16.0-vanilla.1-10.00.Custom_amd64.deb linux-headers-3.16.0-vanilla.1_3.16.0-vanilla.1-10.00.Custom_amd64.deb
> > > 
> > > where .config was taken from debian /boot/config-3.14-0.bpo.1-amd64
> > > 
> > > my PC has 64GB of RAM, 32 Xeon E5-2687W cores and motherboard SuperMicro MBD-X9DRI
> > > 
> > > I just did 25 tries of suspend/resume cycle. I tried 4 different
> > > methods of hibernation:
> > > 
> > > 1. /usr/sbin/hibernate                  # 7 successess, 1 failure
> > > 2. /usr/sbin/s2disk                     # 8 successess, 2 failures
> > > 3. echo platform > /sys/power/disk      # 0 successess, 5 failures
> > >    echo disk > /sys/power/state
> > > 4. echo shutdown > /sys/power/disk      # 2 successess, 3 failures
> > >    echo disk > /sys/power/state
> > > 
> > > 
> > > 
> > > The failure was always a reboot after resume had almost succeeded. In
> > > cases when there was a success there was a following ---[cut here]--- part:
> > 
> > This is warning is from _request_firmware() and is triggered by the snd-hda-intel
> > driver (audio).
> > 
> > Why don't you file a bug at bugzilla.kernel.org against hibernation/suspend and
> > put that information into it?
> 
> .... or involve the relevant maintainer :)
> 
> I can't tell exactly because of lack of the whole kernel message, but
> if my guess is correct,  the problem is that the machine has no
> firmware installed.  Usually, the firmware is cached in the firmware
> core code and reused in the resume code path.  If the prior
> request_firmware() failed, however, the succeeding request_firmware()
> at resume will go into the actual f/w loading code, thus it triggers
> such a warning.
> 
> A quick patch below is an untested fix.  Let me know if this really
> fixes the issue.
> 
> 
> thanks,
> 
> Takashi
> 
> ---
> diff --git a/sound/pci/hda/patch_ca0132.c b/sound/pci/hda/patch_ca0132.c
> index 4f3aba78f720..5d8455e2dacd 100644
> --- a/sound/pci/hda/patch_ca0132.c
> +++ b/sound/pci/hda/patch_ca0132.c
> @@ -4376,6 +4376,9 @@ static void ca0132_download_dsp(struct hda_codec *codec)
>  	return; /* NOP */
>  #endif
>  
> +	if (spec->dsp_state == DSP_DOWNLOAD_FAILED)
> +		return; /* don't retry failures */
> +
>  	chipio_enable_clocks(codec);
>  	spec->dsp_state = DSP_DOWNLOADING;
>  	if (!ca0132_download_dsp_images(codec))
> @@ -4552,7 +4555,8 @@ static int ca0132_init(struct hda_codec *codec)
>  	struct auto_pin_cfg *cfg = &spec->autocfg;
>  	int i;
>  
> -	spec->dsp_state = DSP_DOWNLOAD_INIT;
> +	if (spec->dsp_state != DSP_DOWNLOAD_FAILED)
> +		spec->dsp_state = DSP_DOWNLOAD_INIT;
>  	spec->curr_chip_addx = INVALID_CHIP_ADDRESS;
>  
>  	snd_hda_power_up(codec);
> @@ -4663,6 +4667,7 @@ static int patch_ca0132(struct hda_codec *codec)
>  	codec->spec = spec;
>  	spec->codec = codec;
>  
> +	spec->dsp_state = DSP_DOWNLOAD_INIT;
>  	spec->num_mixers = 1;
>  	spec->mixers[0] = ca0132_mixer;
>  
> --


OK, so I did full testing using instructions in both files Rafael suggested:
  Documentation/power/s2ram.txt
  Documentation/power/basic-pm-debugging.txt

Unfortunately the above patch proposed by Takashi didn't work.

I did about a dozen of hibernate/resume attempts, always with:
  /bin/sync
  echo 1 > /sys/power/pm_trace
  echo reboot > /sys/power/disk
  echo disk > /sys/power/state

then after resume failed I recorded following magic number(s) from realtime clock:

[    2.254602] registered taskstats version 1
[    2.256077]   Magic number: 0:670:380
[    2.256080]   hash matches drivers/base/power/main.c:812
[    2.256123] pci_bus 0000:ff: hash matches
[    2.256405] rtc_cmos 00:05: setting system clock to 1980-05-21 12:22:50 UTC (327759770)

[    2.266756]   Magic number: 13:317:739
[    2.266784] pci 0000:ff:0d.1: hash matches
[    2.266831] acpi LNXCPU:68: hash matches
[    2.266846] acpi LNXCPU:3b: hash matches
[    2.267101] rtc_cmos 00:05: setting system clock to 2013-01-01 15:44:17 UTC (1357055057)

[    2.257216]   Magic number: 13:317:739
[    2.257266] pci 0000:ff:0d.1: hash matches
[    2.257302] acpi LNXCPU:68: hash matches
[    2.257324] acpi LNXCPU:3b: hash matches
[    2.257573] rtc_cmos 00:05: setting system clock to 2013-01-01 15:43:44 UTC (1357055024)

[    2.261415]   Magic number: 0:670:380
[    2.261418]   hash matches drivers/base/power/main.c:812
[    2.261462] pci_bus 0000:ff: hash matches
[    2.261725] rtc_cmos 00:05: setting system clock to 1980-05-21 12:22:43 UTC (327759763)

[    2.256938]   Magic number: 0:670:380
[    2.256941]   hash matches drivers/base/power/main.c:812
[    2.256983] pci_bus 0000:ff: hash matches
[    2.257266] rtc_cmos 00:05: setting system clock to 1980-05-21 12:22:43 UTC (327759763)

[    2.265434]   Magic number: 0:670:380
[    2.265438]   hash matches drivers/base/power/main.c:812
[    2.265486] pci_bus 0000:ff: hash matches
[    2.265752] rtc_cmos 00:05: setting system clock to 1980-05-21 12:22:44 UTC (327759764)

[    2.265628]   Magic number: 0:670:380
[    2.265632]   hash matches drivers/base/power/main.c:812
[    2.265683] pci_bus 0000:ff: hash matches
[    2.265980] rtc_cmos 00:05: setting system clock to 1980-05-21 12:22:45 UTC (327759765)

[    2.256348]   Magic number: 0:670:380
[    2.256351]   hash matches drivers/base/power/main.c:812
[    2.256392] pci_bus 0000:ff: hash matches
[    2.256669] rtc_cmos 00:05: setting system clock to 1980-05-21 12:22:43 UTC (327759763)

[    2.266391]   Magic number: 13:317:739
[    2.266437] pci 0000:ff:0d.1: hash matches
[    2.266470] acpi LNXCPU:68: hash matches
[    2.266486] acpi LNXCPU:3b: hash matches
[    2.266720] rtc_cmos 00:05: setting system clock to 2013-01-01 15:43:54 UTC (1357055034)

[    2.266580]   Magic number: 13:317:739
[    2.266625] pci 0000:ff:0d.1: hash matches
[    2.266658] acpi LNXCPU:68: hash matches
[    2.266675] acpi LNXCPU:3b: hash matches
[    2.266898] rtc_cmos 00:05: setting system clock to 2013-01-01 15:43:45 UTC (1357055025)

###############
The info from `cat /sys/power/pm_trace_dev_match` varied between:
  pci
  acpi
  acpi

and just this:
  pci_bus


In case if you need some other info, here's a full dmesg from one of
reboots after a failed resume. But read below this pasted text for
more information.

############### paste start:
Magic number below
this is effect of following:
  /bin/sync
  echo 1 > /sys/power/pm_trace
  echo reboot > /sys/power/disk
  echo disk > /sys/power/state

# cat /sys/power/pm_trace_dev_match
pci
acpi
acpi

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.16.0-vanilla.3+trtc (root@absurd) (gcc version 4.7.2 (Debian 4.7.2-5) ) #2 SMP Fri Aug 8 15:21:04 CEST 2014
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.16.0-vanilla.3+trtc root=UUID=1b1cb5fb-b820-4281-badb-fe60995879cf ro resume=/dev/disk/by-uuid/04e6765a-fe0c-44e7-9165-219563f6171e quiet
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009abff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009ac00-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007df5cfff] usable
[    0.000000] BIOS-e820: [mem 0x000000007df5d000-0x000000007e0c7fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000007e0c8000-0x000000007e2d7fff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000007e2d8000-0x000000007f352fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000007f353000-0x000000007f7fffff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x0000000080000000-0x000000008fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed3ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000107fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.7 present.
[    0.000000] DMI: Supermicro X9DR3-F/X9DR3-F, BIOS 3.0a 07/31/2013
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] AGP: No AGP bridge found
[    0.000000] e820: last_pfn = 0x1080000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 000000000000 mask 3FF000000000 write-back
[    0.000000]   1 base 001000000000 mask 3FFF80000000 write-back
[    0.000000]   2 base 000080000000 mask 3FFF80000000 uncachable
[    0.000000]   3 disabled
[    0.000000]   4 disabled
[    0.000000]   5 disabled
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000]   8 disabled
[    0.000000]   9 disabled
[    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
[    0.000000] e820: update [mem 0x80000000-0xffffffff] usable ==> reserved
[    0.000000] e820: last_pfn = 0x7df5d max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fdbb0-0x000fdbbf] mapped at [ffff8800000fdbb0]
[    0.000000] Base memory trampoline at [ffff880000093000] 93000 size 28672
[    0.000000] Using GB pages for direct mapping
[    0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[    0.000000]  [mem 0x00000000-0x000fffff] page 4k
[    0.000000] BRK [0x01a8b000, 0x01a8bfff] PGTABLE
[    0.000000] BRK [0x01a8c000, 0x01a8cfff] PGTABLE
[    0.000000] BRK [0x01a8d000, 0x01a8dfff] PGTABLE
[    0.000000] init_memory_mapping: [mem 0x107fe00000-0x107fffffff]
[    0.000000]  [mem 0x107fe00000-0x107fffffff] page 1G
[    0.000000] init_memory_mapping: [mem 0x107c000000-0x107fdfffff]
[    0.000000]  [mem 0x107c000000-0x107fdfffff] page 1G
[    0.000000] init_memory_mapping: [mem 0x1000000000-0x107bffffff]
[    0.000000]  [mem 0x1000000000-0x107bffffff] page 1G
[    0.000000] init_memory_mapping: [mem 0x00100000-0x7df5cfff]
[    0.000000]  [mem 0x00100000-0x001fffff] page 4k
[    0.000000]  [mem 0x00200000-0x7ddfffff] page 2M
[    0.000000]  [mem 0x7de00000-0x7df5cfff] page 4k
[    0.000000] init_memory_mapping: [mem 0x100000000-0xfffffffff]
[    0.000000]  [mem 0x100000000-0xfffffffff] page 1G
[    0.000000] RAMDISK: [mem 0x36350000-0x3719ffff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F04A0 000024 (v02 ALASKA)
[    0.000000] ACPI: XSDT 0x000000007E1F0090 00009C (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FACP 0x000000007E1FD058 00010C (v05 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: DSDT 0x000000007E1F01C0 00CE96 (v02 ALASKA A M I    00000015 INTL 20051117)
[    0.000000] ACPI: FACS 0x000000007E2CF080 000040
[    0.000000] ACPI: APIC 0x000000007E1FD168 000224 (v03 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FPDT 0x000000007E1FD390 000044 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: MCFG 0x000000007E1FD3D8 00003C (v01 ALASKA OEMMCFG. 01072009 MSFT 00000097)
[    0.000000] ACPI: SRAT 0x000000007E1FD418 0004B0 (v01 A M I  AMI SRAT 00000001 AMI. 00000000)
[    0.000000] ACPI: SLIT 0x000000007E1FD8C8 000030 (v01 A M I  AMI SLIT 00000000 AMI. 00000000)
[    0.000000] ACPI: HPET 0x000000007E1FD8F8 000038 (v01 ALASKA A M I    01072009 AMI. 00000005)
[    0.000000] ACPI: PRAD 0x000000007E1FD930 0000BE (v02 PRADID PRADTID  00000001 MSFT 03000001)
[    0.000000] ACPI: SPMI 0x000000007E1FD9F0 000040 (v05 A M I  OEMSPMI  00000000 AMI. 00000000)
[    0.000000] ACPI: SSDT 0x000000007E1FDA30 0D0CB0 (v02 INTEL  CpuPm    00004000 INTL 20051117)
[    0.000000] ACPI: EINJ 0x000000007E2CE6E0 000130 (v01 AMI    AMI EINJ 00000000      00000000)
[    0.000000] ACPI: ERST 0x000000007E2CE810 000230 (v01 AMIER  AMI ERST 00000000      00000000)
[    0.000000] ACPI: HEST 0x000000007E2CEA40 0000A8 (v01 AMI    AMI HEST 00000000      00000000)
[    0.000000] ACPI: BERT 0x000000007E2CEAE8 000030 (v01 AMI    AMI BERT 00000000      00000000)
[    0.000000] ACPI: DMAR 0x000000007E2CEB18 000160 (v01 A M I  OEMDMAR  00000001 INTL 00000001)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x10 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x11 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x12 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x13 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x14 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x15 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x16 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x17 -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x30 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x31 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x32 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x33 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x34 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x35 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x36 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x37 -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x87fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x880000000-0x107fffffff]
[    0.000000] NUMA: Initialized distance table, cnt=2
[    0.000000] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x87fffffff] -> [mem 0x00000000-0x87fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00000000-0x87fffffff]
[    0.000000]   NODE_DATA [mem 0x87fffb000-0x87fffffff]
[    0.000000] Initmem setup node 1 [mem 0x880000000-0x107fffffff]
[    0.000000]   NODE_DATA [mem 0x107fff8000-0x107fffcfff]
[    0.000000]  [ffffea0000000000-ffffea001dbfffff] PMD -> [ffff88085fe00000-ffff88087bdfffff] on node 0
[    0.000000]  [ffffea001dc00000-ffffea0039bfffff] PMD -> [ffff88105f600000-ffff88107b5fffff] on node 1
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x107fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x00099fff]
[    0.000000]   node   0: [mem 0x00100000-0x7df5cfff]
[    0.000000]   node   0: [mem 0x100000000-0x87fffffff]
[    0.000000]   node   1: [mem 0x880000000-0x107fffffff]
[    0.000000] On node 0 totalpages: 8380150
[    0.000000]   DMA zone: 56 pages used for memmap
[    0.000000]   DMA zone: 22 pages reserved
[    0.000000]   DMA zone: 3993 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 6998 pages used for memmap
[    0.000000]   DMA32 zone: 511837 pages, LIFO batch:31
[    0.000000]   Normal zone: 107520 pages used for memmap
[    0.000000]   Normal zone: 7864320 pages, LIFO batch:31
[    0.000000] On node 1 totalpages: 8388608
[    0.000000]   Normal zone: 114688 pages used for memmap
[    0.000000]   Normal zone: 8388608 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x10] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x12] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x14] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x16] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x30] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x32] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x34] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x36] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x11] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x13] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x15] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x17] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x31] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x33] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x35] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x37] enabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0a] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0c] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0e] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x10] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x12] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x14] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x16] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x18] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x1a] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x1c] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x1e] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x09] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0b] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0d] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0f] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x11] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x13] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x15] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x17] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x19] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x1b] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x1d] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x1f] high edge lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec01000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x03] address[0xfec40000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 3, version 32, address 0xfec40000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ2 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 32 CPUs, 0 hotplug CPUs
[    0.000000] nr_irqs_gsi: 88
[    0.000000] PM: Registered nosave memory: [mem 0x0009a000-0x0009afff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009b000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x7df5d000-0x7e0c7fff]
[    0.000000] PM: Registered nosave memory: [mem 0x7e0c8000-0x7e2d7fff]
[    0.000000] PM: Registered nosave memory: [mem 0x7e2d8000-0x7f352fff]
[    0.000000] PM: Registered nosave memory: [mem 0x7f353000-0x7f7fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x7f800000-0x7fffffff]
[    0.000000] PM: Registered nosave memory: [mem 0x80000000-0x8fffffff]
[    0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed3ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed40000-0xfeffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff]
[    0.000000] e820: [mem 0x90000000-0xfed1bfff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:32 nr_node_ids:2
[    0.000000] PERCPU: Embedded 28 pages/cpu @ffff88087fc00000 s85696 r8192 d20800 u131072
[    0.000000] pcpu-alloc: s85696 r8192 d20800 u131072 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 16 17 18 19 20 21 22 23 
[    0.000000] pcpu-alloc: [1] 08 09 10 11 12 13 14 15 24 25 26 27 28 29 30 31 
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 16539474
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.16.0-vanilla.3+trtc root=UUID=1b1cb5fb-b820-4281-badb-fe60995879cf ro resume=/dev/disk/by-uuid/04e6765a-fe0c-44e7-9165-219563f6171e quiet
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340
[    0.000000] AGP: Checking aperture...
[    0.000000] AGP: No AGP bridge found
[    0.000000] Calgary: detecting Calgary via BIOS EBDA area
[    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.000000] Memory: 66061904K/67075032K available (5152K kernel code, 736K rwdata, 1712K rodata, 1004K init, 828K bss, 1013128K reserved)
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU dyntick-idle grace-period acceleration is enabled.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=32.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=32
[    0.000000] NR_IRQS:33024 nr_irqs:1752 16
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] allocated 268435456 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] mempolicy: Disabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] hpet clockevent registered
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 3400.211 MHz processor
[    0.000032] Calibrating delay loop (skipped), value calculated using timer frequency.. 6800.42 BogoMIPS (lpj=13600844)
[    0.000034] pid_max: default: 32768 minimum: 301
[    0.000047] ACPI: Core revision 20140424
[    0.037829] ACPI: All ACPI Tables successfully acquired
[    0.038122] Security Framework initialized
[    0.038125] AppArmor: AppArmor disabled by boot time parameter
[    0.038126] Yama: becoming mindful.
[    0.041144] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
[    0.053414] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.058855] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.058905] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.059412] Initializing cgroup subsys memory
[    0.059436] Initializing cgroup subsys devices
[    0.059442] Initializing cgroup subsys freezer
[    0.059444] Initializing cgroup subsys net_cls
[    0.059447] Initializing cgroup subsys blkio
[    0.059450] Initializing cgroup subsys perf_event
[    0.059483] CPU: Physical Processor ID: 0
[    0.059483] CPU: Processor Core ID: 1
[    0.060157] mce: CPU supports 27 MCE banks
[    0.060188] CPU0: Thermal monitoring enabled (TM1)
[    0.060213] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[    0.060213] Last level dTLB entries: 4KB 512, 2MB 0, 4MB 0, 1GB 4
[    0.060213] tlb_flushall_shift: 6
[    0.060311] Freeing SMP alternatives memory: 20K (ffffffff819b5000 - ffffffff819ba000)
[    0.061195] dmar: Host address width 46
[    0.061197] dmar: DRHD base: 0x000000fbffe000 flags: 0x0
[    0.061207] dmar: IOMMU 0: reg_base_addr fbffe000 ver 1:0 cap d2078c106f0466 ecap f020de
[    0.061208] dmar: DRHD base: 0x000000dfffc000 flags: 0x1
[    0.061213] dmar: IOMMU 1: reg_base_addr dfffc000 ver 1:0 cap d2078c106f0466 ecap f020de
[    0.061214] dmar: RMRR base: 0x0000007f223000 end: 0x0000007f231fff
[    0.061215] dmar: ATSR flags: 0x0
[    0.061216] dmar: RHSA base: 0x000000fbffe000 proximity domain: 0x1
[    0.061217] dmar: RHSA base: 0x000000dfffc000 proximity domain: 0x0
[    0.061344] IOAPIC id 3 under DRHD base  0xfbffe000 IOMMU 0
[    0.061345] IOAPIC id 0 under DRHD base  0xdfffc000 IOMMU 1
[    0.061346] IOAPIC id 2 under DRHD base  0xdfffc000 IOMMU 1
[    0.061346] HPET id 0 under DRHD base 0xdfffc000
[    0.061347] Queued invalidation will be enabled to support x2apic and Intr-remapping.
[    0.061972] Enabled IRQ remapping in x2apic mode
[    0.061973] Enabling x2apic
[    0.061973] Enabled x2apic
[    0.061977] Switched APIC routing to cluster x2apic.
[    0.062615] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.102277] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2687W v2 @ 3.40GHz (fam: 06, model: 3e, stepping: 04)
[    0.102285] TSC deadline timer enabled
[    0.102307] Performance Events: PEBS fmt1+, 16-deep LBR, IvyBridge events, full-width counters, Intel PMU driver.
[    0.102323] ... version:                3
[    0.102324] ... bit width:              48
[    0.102324] ... generic registers:      4
[    0.102325] ... value mask:             0000ffffffffffff
[    0.102326] ... max period:             0000ffffffffffff
[    0.102326] ... fixed-purpose events:   3
[    0.102327] ... event mask:             000000070000000f
[    0.103052] x86: Booting SMP configuration:
[    0.103053] .... node  #0, CPUs:        #1
[    0.120033] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[    0.120174]   #2  #3  #4  #5  #6  #7
[    0.203643] .... node  #1, CPUs:    #8  #9 #10 #11 #12 #13 #14 #15
[    0.417933] .... node  #0, CPUs:   #16 #17 #18 #19 #20 #21 #22 #23
[    0.529233] .... node  #1, CPUs:   #24 #25 #26 #27 #28 #29 #30 #31
[    0.645726] x86: Booted up 2 nodes, 32 CPUs
[    0.645729] smpboot: Total of 32 processors activated (217640.16 BogoMIPS)
[    0.699463] devtmpfs: initialized
[    0.699618] memory block size : 2048MB
[    0.701294] PM: Registering ACPI NVS region [mem 0x7e0c8000-0x7e2d7fff] (2162688 bytes)
[    0.701351] PM: Registering ACPI NVS region [mem 0x7f353000-0x7f7fffff] (4902912 bytes)
[    0.701847] pinctrl core: initialized pinctrl subsystem
[    0.701893] RTC time: 15:43:43, date: 01/01/13
[    0.702014] NET: Registered protocol family 16
[    0.702135] cpuidle: using governor ladder
[    0.702137] cpuidle: using governor menu
[    0.702179] ACPI: bus type PCI registered
[    0.702181] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.702338] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[    0.702339] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
[    0.702698] PCI: Using configuration type 1 for base access
[    0.727825] ACPI: Added _OSI(Module Device)
[    0.727827] ACPI: Added _OSI(Processor Device)
[    0.727827] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.727828] ACPI: Added _OSI(Processor Aggregator Device)
[    0.737485] ACPI: Executed 1 blocks of module-level executable AML code
[    0.889922] \_SB_:_OSC invalid UUID
[    0.889923] _OSC request data:1 1f 
[    0.893079] ACPI: Interpreter enabled
[    0.893086] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20140424/hwxface-580)
[    0.893088] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S3_] (20140424/hwxface-580)
[    0.893095] ACPI: (supports S0 S1 S4 S5)
[    0.893096] ACPI: Using IOAPIC for interrupt routing
[    0.893151] HEST: Table parsing has been initialized.
[    0.893153] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.906368] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    0.906372] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.906480] acpi PNP0A08:00: _OSC: platform does not support [AER]
[    0.906576] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    0.906872] PCI host bridge to bus 0000:00
[    0.906874] pci_bus 0000:00: root bus resource [bus 00-7e]
[    0.906876] pci_bus 0000:00: root bus resource [io  0x0000-0x03af]
[    0.906877] pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7]
[    0.906878] pci_bus 0000:00: root bus resource [io  0x03b0-0x03df]
[    0.906879] pci_bus 0000:00: root bus resource [io  0x0d00-0x9fff]
[    0.906880] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
[    0.906881] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000dffff]
[    0.906882] pci_bus 0000:00: root bus resource [mem 0xfed0e000-0xfed0ffff]
[    0.906883] pci_bus 0000:00: root bus resource [mem 0x80000000-0xdfffffff]
[    0.906892] pci 0000:00:00.0: [8086:0e00] type 00 class 0x060000
[    0.906951] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    0.907020] pci 0000:00:01.0: [8086:0e02] type 01 class 0x060400
[    0.907088] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    0.907128] pci 0000:00:01.0: System wakeup disabled by ACPI
[    0.907163] pci 0000:00:01.1: [8086:0e03] type 01 class 0x060400
[    0.907228] pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
[    0.907268] pci 0000:00:01.1: System wakeup disabled by ACPI
[    0.907305] pci 0000:00:02.0: [8086:0e04] type 01 class 0x060400
[    0.907370] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[    0.907412] pci 0000:00:02.0: System wakeup disabled by ACPI
[    0.907447] pci 0000:00:03.0: [8086:0e08] type 01 class 0x060400
[    0.907514] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    0.907555] pci 0000:00:03.0: System wakeup disabled by ACPI
[    0.907591] pci 0000:00:03.2: [8086:0e0a] type 01 class 0x060400
[    0.907656] pci 0000:00:03.2: PME# supported from D0 D3hot D3cold
[    0.907694] pci 0000:00:03.2: System wakeup disabled by ACPI
[    0.907729] pci 0000:00:04.0: [8086:0e20] type 00 class 0x088000
[    0.907742] pci 0000:00:04.0: reg 0x10: [mem 0xdf31c000-0xdf31ffff 64bit]
[    0.907852] pci 0000:00:04.1: [8086:0e21] type 00 class 0x088000
[    0.907865] pci 0000:00:04.1: reg 0x10: [mem 0xdf318000-0xdf31bfff 64bit]
[    0.907975] pci 0000:00:04.2: [8086:0e22] type 00 class 0x088000
[    0.907988] pci 0000:00:04.2: reg 0x10: [mem 0xdf314000-0xdf317fff 64bit]
[    0.908102] pci 0000:00:04.3: [8086:0e23] type 00 class 0x088000
[    0.908114] pci 0000:00:04.3: reg 0x10: [mem 0xdf310000-0xdf313fff 64bit]
[    0.908228] pci 0000:00:04.4: [8086:0e24] type 00 class 0x088000
[    0.908240] pci 0000:00:04.4: reg 0x10: [mem 0xdf30c000-0xdf30ffff 64bit]
[    0.908352] pci 0000:00:04.5: [8086:0e25] type 00 class 0x088000
[    0.908365] pci 0000:00:04.5: reg 0x10: [mem 0xdf308000-0xdf30bfff 64bit]
[    0.908477] pci 0000:00:04.6: [8086:0e26] type 00 class 0x088000
[    0.908489] pci 0000:00:04.6: reg 0x10: [mem 0xdf304000-0xdf307fff 64bit]
[    0.908600] pci 0000:00:04.7: [8086:0e27] type 00 class 0x088000
[    0.908612] pci 0000:00:04.7: reg 0x10: [mem 0xdf300000-0xdf303fff 64bit]
[    0.908722] pci 0000:00:05.0: [8086:0e28] type 00 class 0x088000
[    0.908824] pci 0000:00:05.2: [8086:0e2a] type 00 class 0x088000
[    0.908927] pci 0000:00:05.4: [8086:0e2c] type 00 class 0x080020
[    0.908936] pci 0000:00:05.4: reg 0x10: [mem 0xdf328000-0xdf328fff]
[    0.909059] pci 0000:00:11.0: [8086:1d3e] type 01 class 0x060400
[    0.909152] pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
[    0.909233] pci 0000:00:16.0: [8086:1d3a] type 00 class 0x078000
[    0.909250] pci 0000:00:16.0: reg 0x10: [mem 0xdf327000-0xdf32700f 64bit]
[    0.909306] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[    0.909374] pci 0000:00:16.1: [8086:1d3b] type 00 class 0x078000
[    0.909391] pci 0000:00:16.1: reg 0x10: [mem 0xdf326000-0xdf32600f 64bit]
[    0.909447] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
[    0.909524] pci 0000:00:1a.0: [8086:1d2d] type 00 class 0x0c0320
[    0.909542] pci 0000:00:1a.0: reg 0x10: [mem 0xdf324000-0xdf3243ff]
[    0.909622] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[    0.909660] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    0.909699] pci 0000:00:1d.0: [8086:1d26] type 00 class 0x0c0320
[    0.909720] pci 0000:00:1d.0: reg 0x10: [mem 0xdf323000-0xdf3233ff]
[    0.909800] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[    0.909839] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    0.909873] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401
[    0.909947] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    0.909982] pci 0000:00:1f.0: [8086:1d41] type 00 class 0x060100
[    0.910141] pci 0000:00:1f.2: [8086:1d02] type 00 class 0x010601
[    0.910157] pci 0000:00:1f.2: reg 0x10: [io  0x9070-0x9077]
[    0.910163] pci 0000:00:1f.2: reg 0x14: [io  0x9060-0x9063]
[    0.910169] pci 0000:00:1f.2: reg 0x18: [io  0x9050-0x9057]
[    0.910176] pci 0000:00:1f.2: reg 0x1c: [io  0x9040-0x9043]
[    0.910182] pci 0000:00:1f.2: reg 0x20: [io  0x9020-0x903f]
[    0.910189] pci 0000:00:1f.2: reg 0x24: [mem 0xdf322000-0xdf3227ff]
[    0.910227] pci 0000:00:1f.2: PME# supported from D3hot
[    0.910294] pci 0000:00:1f.3: [8086:1d22] type 00 class 0x0c0500
[    0.910306] pci 0000:00:1f.3: reg 0x10: [mem 0xdf321000-0xdf3210ff 64bit]
[    0.910324] pci 0000:00:1f.3: reg 0x20: [io  0x9000-0x901f]
[    0.910401] pci 0000:00:1f.6: [8086:1d24] type 00 class 0x118000
[    0.910419] pci 0000:00:1f.6: reg 0x10: [mem 0xdf320000-0xdf320fff 64bit]
[    0.910579] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.910653] pci 0000:02:00.0: [8086:1521] type 00 class 0x020000
[    0.910662] pci 0000:02:00.0: reg 0x10: [mem 0xdf220000-0xdf23ffff]
[    0.910674] pci 0000:02:00.0: reg 0x18: [io  0x8020-0x803f]
[    0.910681] pci 0000:02:00.0: reg 0x1c: [mem 0xdf244000-0xdf247fff]
[    0.910739] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[    0.910766] pci 0000:02:00.0: reg 0x184: [mem 0xdaa60000-0xdaa63fff 64bit pref]
[    0.910777] pci 0000:02:00.0: reg 0x190: [mem 0xdaa40000-0xdaa43fff 64bit pref]
[    0.910829] pci 0000:02:00.1: [8086:1521] type 00 class 0x020000
[    0.910839] pci 0000:02:00.1: reg 0x10: [mem 0xdf200000-0xdf21ffff]
[    0.910849] pci 0000:02:00.1: reg 0x18: [io  0x8000-0x801f]
[    0.910855] pci 0000:02:00.1: reg 0x1c: [mem 0xdf240000-0xdf243fff]
[    0.910915] pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
[    0.910938] pci 0000:02:00.1: reg 0x184: [mem 0xdaa20000-0xdaa23fff 64bit pref]
[    0.910950] pci 0000:02:00.1: reg 0x190: [mem 0xdaa00000-0xdaa03fff 64bit pref]
[    0.911099] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    0.911101] pci 0000:00:01.1:   bridge window [io  0x8000-0x8fff]
[    0.911104] pci 0000:00:01.1:   bridge window [mem 0xdf200000-0xdf2fffff]
[    0.911108] pci 0000:00:01.1:   bridge window [mem 0xdaa00000-0xdaafffff 64bit pref]
[    0.911164] pci 0000:04:00.0: [10de:1004] type 00 class 0x030000
[    0.911173] pci 0000:04:00.0: reg 0x10: [mem 0xde000000-0xdeffffff]
[    0.911181] pci 0000:04:00.0: reg 0x14: [mem 0xd0000000-0xd7ffffff 64bit pref]
[    0.911190] pci 0000:04:00.0: reg 0x1c: [mem 0xd8000000-0xd9ffffff 64bit pref]
[    0.911195] pci 0000:04:00.0: reg 0x24: [io  0x7000-0x707f]
[    0.911201] pci 0000:04:00.0: reg 0x30: [mem 0xdf000000-0xdf07ffff pref]
[    0.911278] pci 0000:04:00.1: [10de:0e1a] type 00 class 0x040300
[    0.911287] pci 0000:04:00.1: reg 0x10: [mem 0xdf080000-0xdf083fff]
[    0.917746] pci 0000:00:02.0: PCI bridge to [bus 04]
[    0.917752] pci 0000:00:02.0:   bridge window [io  0x7000-0x7fff]
[    0.917768] pci 0000:00:02.0:   bridge window [mem 0xde000000-0xdf0fffff]
[    0.917773] pci 0000:00:02.0:   bridge window [mem 0xd0000000-0xd9ffffff 64bit pref]
[    0.917819] pci 0000:00:03.0: PCI bridge to [bus 05]
[    0.917867] pci 0000:00:03.2: PCI bridge to [bus 06]
[    0.917946] pci 0000:07:00.0: [8086:1d6b] type 00 class 0x010700
[    0.917965] pci 0000:07:00.0: reg 0x10: [mem 0xda87c000-0xda87ffff 64bit pref]
[    0.917978] pci 0000:07:00.0: reg 0x18: [mem 0xda400000-0xda7fffff 64bit pref]
[    0.917988] pci 0000:07:00.0: reg 0x20: [io  0x6000-0x60ff]
[    0.918093] pci 0000:07:00.0: reg 0x164: [mem 0xda800000-0xda803fff 64bit pref]
[    0.918174] pci 0000:00:11.0: PCI bridge to [bus 07]
[    0.918178] pci 0000:00:11.0:   bridge window [io  0x6000-0x6fff]
[    0.918182] pci 0000:00:11.0:   bridge window [mem 0xdf100000-0xdf1fffff]
[    0.918188] pci 0000:00:11.0:   bridge window [mem 0xda400000-0xda8fffff 64bit pref]
[    0.918253] pci 0000:00:1e.0: PCI bridge to [bus 08] (subtractive decode)
[    0.918262] pci 0000:00:1e.0:   bridge window [io  0x0000-0x03af] (subtractive decode)
[    0.918264] pci 0000:00:1e.0:   bridge window [io  0x03e0-0x0cf7] (subtractive decode)
[    0.918266] pci 0000:00:1e.0:   bridge window [io  0x03b0-0x03df] (subtractive decode)
[    0.918268] pci 0000:00:1e.0:   bridge window [io  0x0d00-0x9fff] (subtractive decode)
[    0.918269] pci 0000:00:1e.0:   bridge window [mem 0x000a0000-0x000bffff] (subtractive decode)
[    0.918270] pci 0000:00:1e.0:   bridge window [mem 0x000c0000-0x000dffff] (subtractive decode)
[    0.918271] pci 0000:00:1e.0:   bridge window [mem 0xfed0e000-0xfed0ffff] (subtractive decode)
[    0.918272] pci 0000:00:1e.0:   bridge window [mem 0x80000000-0xdfffffff] (subtractive decode)
[    0.918304] pci_bus 0000:00: on NUMA node 0
[    0.918638] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus 7f])
[    0.918641] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.918658] acpi PNP0A03:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    0.918704] PCI host bridge to bus 0000:7f
[    0.918706] pci_bus 0000:7f: root bus resource [bus 7f]
[    0.918712] pci 0000:7f:08.0: [8086:0e80] type 00 class 0x088000
[    0.918755] pci 0000:7f:09.0: [8086:0e90] type 00 class 0x088000
[    0.918797] pci 0000:7f:0a.0: [8086:0ec0] type 00 class 0x088000
[    0.918836] pci 0000:7f:0a.1: [8086:0ec1] type 00 class 0x088000
[    0.918871] pci 0000:7f:0a.2: [8086:0ec2] type 00 class 0x088000
[    0.918913] pci 0000:7f:0a.3: [8086:0ec3] type 00 class 0x088000
[    0.918948] pci 0000:7f:0b.0: [8086:0e1e] type 00 class 0x088000
[    0.918984] pci 0000:7f:0b.3: [8086:0e1f] type 00 class 0x088000
[    0.919019] pci 0000:7f:0c.0: [8086:0ee0] type 00 class 0x088000
[    0.919056] pci 0000:7f:0c.1: [8086:0ee2] type 00 class 0x088000
[    0.919089] pci 0000:7f:0c.2: [8086:0ee4] type 00 class 0x088000
[    0.919122] pci 0000:7f:0c.3: [8086:0ee6] type 00 class 0x088000
[    0.919154] pci 0000:7f:0c.4: [8086:0ee8] type 00 class 0x088000
[    0.919188] pci 0000:7f:0d.0: [8086:0ee1] type 00 class 0x088000
[    0.919220] pci 0000:7f:0d.1: [8086:0ee3] type 00 class 0x088000
[    0.919255] pci 0000:7f:0d.2: [8086:0ee5] type 00 class 0x088000
[    0.919286] pci 0000:7f:0d.3: [8086:0ee7] type 00 class 0x088000
[    0.919319] pci 0000:7f:0d.4: [8086:0ee9] type 00 class 0x088000
[    0.919352] pci 0000:7f:0e.0: [8086:0ea0] type 00 class 0x088000
[    0.919393] pci 0000:7f:0e.1: [8086:0e30] type 00 class 0x110100
[    0.919431] pci 0000:7f:0f.0: [8086:0ea8] type 00 class 0x088000
[    0.919478] pci 0000:7f:0f.1: [8086:0e71] type 00 class 0x088000
[    0.919526] pci 0000:7f:0f.2: [8086:0eaa] type 00 class 0x088000
[    0.919572] pci 0000:7f:0f.3: [8086:0eab] type 00 class 0x088000
[    0.919616] pci 0000:7f:0f.4: [8086:0eac] type 00 class 0x088000
[    0.919660] pci 0000:7f:0f.5: [8086:0ead] type 00 class 0x088000
[    0.919704] pci 0000:7f:10.0: [8086:0eb0] type 00 class 0x088000
[    0.919749] pci 0000:7f:10.1: [8086:0eb1] type 00 class 0x088000
[    0.919794] pci 0000:7f:10.2: [8086:0eb2] type 00 class 0x088000
[    0.919837] pci 0000:7f:10.3: [8086:0eb3] type 00 class 0x088000
[    0.919884] pci 0000:7f:10.4: [8086:0eb4] type 00 class 0x088000
[    0.919933] pci 0000:7f:10.5: [8086:0eb5] type 00 class 0x088000
[    0.919982] pci 0000:7f:10.6: [8086:0eb6] type 00 class 0x088000
[    0.920035] pci 0000:7f:10.7: [8086:0eb7] type 00 class 0x088000
[    0.920082] pci 0000:7f:13.0: [8086:0e1d] type 00 class 0x088000
[    0.920117] pci 0000:7f:13.1: [8086:0e34] type 00 class 0x110100
[    0.920152] pci 0000:7f:13.4: [8086:0e81] type 00 class 0x088000
[    0.920190] pci 0000:7f:13.5: [8086:0e36] type 00 class 0x110100
[    0.920226] pci 0000:7f:16.0: [8086:0ec8] type 00 class 0x088000
[    0.920264] pci 0000:7f:16.1: [8086:0ec9] type 00 class 0x088000
[    0.920299] pci 0000:7f:16.2: [8086:0eca] type 00 class 0x088000
[    0.920342] pci_bus 0000:7f: on NUMA node 0
[    0.920431] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    0.920433] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.920537] acpi PNP0A08:01: _OSC: platform does not support [AER]
[    0.920631] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    0.920821] PCI host bridge to bus 0000:80
[    0.920823] pci_bus 0000:80: root bus resource [bus 80-fe]
[    0.920824] pci_bus 0000:80: root bus resource [io  0xa000-0xffff]
[    0.920825] pci_bus 0000:80: root bus resource [mem 0xe0000000-0xfbffffff]
[    0.920837] pci 0000:80:01.0: [8086:0e02] type 01 class 0x060400
[    0.920913] pci 0000:80:01.0: PME# supported from D0 D3hot D3cold
[    0.920944] pci 0000:80:01.0: System wakeup disabled by ACPI
[    0.920985] pci 0000:80:02.0: [8086:0e04] type 01 class 0x060400
[    0.921060] pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
[    0.921089] pci 0000:80:02.0: System wakeup disabled by ACPI
[    0.921128] pci 0000:80:03.0: [8086:0e08] type 01 class 0x060400
[    0.921205] pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
[    0.921234] pci 0000:80:03.0: System wakeup disabled by ACPI
[    0.921272] pci 0000:80:04.0: [8086:0e20] type 00 class 0x088000
[    0.921287] pci 0000:80:04.0: reg 0x10: [mem 0xfbf1c000-0xfbf1ffff 64bit]
[    0.921393] pci 0000:80:04.1: [8086:0e21] type 00 class 0x088000
[    0.921407] pci 0000:80:04.1: reg 0x10: [mem 0xfbf18000-0xfbf1bfff 64bit]
[    0.921519] pci 0000:80:04.2: [8086:0e22] type 00 class 0x088000
[    0.921533] pci 0000:80:04.2: reg 0x10: [mem 0xfbf14000-0xfbf17fff 64bit]
[    0.921644] pci 0000:80:04.3: [8086:0e23] type 00 class 0x088000
[    0.921658] pci 0000:80:04.3: reg 0x10: [mem 0xfbf10000-0xfbf13fff 64bit]
[    0.921776] pci 0000:80:04.4: [8086:0e24] type 00 class 0x088000
[    0.921790] pci 0000:80:04.4: reg 0x10: [mem 0xfbf0c000-0xfbf0ffff 64bit]
[    0.921903] pci 0000:80:04.5: [8086:0e25] type 00 class 0x088000
[    0.921916] pci 0000:80:04.5: reg 0x10: [mem 0xfbf08000-0xfbf0bfff 64bit]
[    0.922029] pci 0000:80:04.6: [8086:0e26] type 00 class 0x088000
[    0.922043] pci 0000:80:04.6: reg 0x10: [mem 0xfbf04000-0xfbf07fff 64bit]
[    0.922154] pci 0000:80:04.7: [8086:0e27] type 00 class 0x088000
[    0.922168] pci 0000:80:04.7: reg 0x10: [mem 0xfbf00000-0xfbf03fff 64bit]
[    0.922281] pci 0000:80:05.0: [8086:0e28] type 00 class 0x088000
[    0.922377] pci 0000:80:05.2: [8086:0e2a] type 00 class 0x088000
[    0.922472] pci 0000:80:05.4: [8086:0e2c] type 00 class 0x080020
[    0.922482] pci 0000:80:05.4: reg 0x10: [mem 0xfbf20000-0xfbf20fff]
[    0.922639] pci 0000:80:01.0: PCI bridge to [bus 81]
[    0.922692] pci 0000:80:02.0: PCI bridge to [bus 82]
[    0.922757] pci 0000:83:00.0: [1102:0012] type 00 class 0x040300
[    0.922773] pci 0000:83:00.0: reg 0x10: [mem 0xfbe04000-0xfbe07fff 64bit]
[    0.922784] pci 0000:83:00.0: reg 0x18: [mem 0xfbe00000-0xfbe03fff 64bit]
[    0.922849] pci 0000:83:00.0: supports D2
[    0.922996] pci 0000:80:03.0: PCI bridge to [bus 83]
[    0.923000] pci 0000:80:03.0:   bridge window [mem 0xfbe00000-0xfbefffff]
[    0.923026] pci_bus 0000:80: on NUMA node 1
[    0.923077] ACPI: PCI Root Bridge [UNC1] (domain 0000 [bus ff])
[    0.923079] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.923095] acpi PNP0A03:01: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    0.923140] PCI host bridge to bus 0000:ff
[    0.923142] pci_bus 0000:ff: root bus resource [bus ff]
[    0.923148] pci 0000:ff:08.0: [8086:0e80] type 00 class 0x088000
[    0.923196] pci 0000:ff:09.0: [8086:0e90] type 00 class 0x088000
[    0.923247] pci 0000:ff:0a.0: [8086:0ec0] type 00 class 0x088000
[    0.923288] pci 0000:ff:0a.1: [8086:0ec1] type 00 class 0x088000
[    0.923329] pci 0000:ff:0a.2: [8086:0ec2] type 00 class 0x088000
[    0.923369] pci 0000:ff:0a.3: [8086:0ec3] type 00 class 0x088000
[    0.923412] pci 0000:ff:0b.0: [8086:0e1e] type 00 class 0x088000
[    0.923453] pci 0000:ff:0b.3: [8086:0e1f] type 00 class 0x088000
[    0.923494] pci 0000:ff:0c.0: [8086:0ee0] type 00 class 0x088000
[    0.923536] pci 0000:ff:0c.1: [8086:0ee2] type 00 class 0x088000
[    0.923576] pci 0000:ff:0c.2: [8086:0ee4] type 00 class 0x088000
[    0.923618] pci 0000:ff:0c.3: [8086:0ee6] type 00 class 0x088000
[    0.923657] pci 0000:ff:0c.4: [8086:0ee8] type 00 class 0x088000
[    0.923700] pci 0000:ff:0d.0: [8086:0ee1] type 00 class 0x088000
[    0.923740] pci 0000:ff:0d.1: [8086:0ee3] type 00 class 0x088000
[    0.923786] pci 0000:ff:0d.2: [8086:0ee5] type 00 class 0x088000
[    0.923825] pci 0000:ff:0d.3: [8086:0ee7] type 00 class 0x088000
[    0.923866] pci 0000:ff:0d.4: [8086:0ee9] type 00 class 0x088000
[    0.923907] pci 0000:ff:0e.0: [8086:0ea0] type 00 class 0x088000
[    0.923958] pci 0000:ff:0e.1: [8086:0e30] type 00 class 0x110100
[    0.924012] pci 0000:ff:0f.0: [8086:0ea8] type 00 class 0x088000
[    0.924071] pci 0000:ff:0f.1: [8086:0e71] type 00 class 0x088000
[    0.924131] pci 0000:ff:0f.2: [8086:0eaa] type 00 class 0x088000
[    0.924187] pci 0000:ff:0f.3: [8086:0eab] type 00 class 0x088000
[    0.924244] pci 0000:ff:0f.4: [8086:0eac] type 00 class 0x088000
[    0.924305] pci 0000:ff:0f.5: [8086:0ead] type 00 class 0x088000
[    0.924368] pci 0000:ff:10.0: [8086:0eb0] type 00 class 0x088000
[    0.924428] pci 0000:ff:10.1: [8086:0eb1] type 00 class 0x088000
[    0.924487] pci 0000:ff:10.2: [8086:0eb2] type 00 class 0x088000
[    0.924546] pci 0000:ff:10.3: [8086:0eb3] type 00 class 0x088000
[    0.924601] pci 0000:ff:10.4: [8086:0eb4] type 00 class 0x088000
[    0.924661] pci 0000:ff:10.5: [8086:0eb5] type 00 class 0x088000
[    0.924716] pci 0000:ff:10.6: [8086:0eb6] type 00 class 0x088000
[    0.924775] pci 0000:ff:10.7: [8086:0eb7] type 00 class 0x088000
[    0.924832] pci 0000:ff:13.0: [8086:0e1d] type 00 class 0x088000
[    0.924875] pci 0000:ff:13.1: [8086:0e34] type 00 class 0x110100
[    0.924920] pci 0000:ff:13.4: [8086:0e81] type 00 class 0x088000
[    0.924962] pci 0000:ff:13.5: [8086:0e36] type 00 class 0x110100
[    0.925009] pci 0000:ff:16.0: [8086:0ec8] type 00 class 0x088000
[    0.925053] pci 0000:ff:16.1: [8086:0ec9] type 00 class 0x088000
[    0.925099] pci 0000:ff:16.2: [8086:0eca] type 00 class 0x088000
[    0.925149] pci_bus 0000:ff: on NUMA node 1
[    0.925205] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15)
[    0.925244] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15)
[    0.925278] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    0.925312] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    0.925345] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) *0
[    0.925380] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 14 15) *0
[    0.925414] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 12 14 15) *0
[    0.925447] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *7 10 11 12 14 15)
[    0.927356] ACPI: Enabled 4 GPEs in block 00 to 3F
[    0.927508] vgaarb: device added: PCI:0000:04:00.0,decodes=io+mem,owns=io+mem,locks=none
[    0.927532] vgaarb: loaded
[    0.927532] vgaarb: bridge control possible 0000:04:00.0
[    0.927592] PCI: Using ACPI for IRQ routing
[    0.931483] PCI: pci_cache_line_size set to 64 bytes
[    0.931634] e820: reserve RAM buffer [mem 0x0009ac00-0x0009ffff]
[    0.931636] e820: reserve RAM buffer [mem 0x7df5d000-0x7fffffff]
[    0.931767] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    0.931770] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    0.934895] Switched to clocksource hpet
[    0.937027] pnp: PnP ACPI init
[    0.937047] ACPI: bus type PNP registered
[    0.937221] system 00:00: [mem 0xfc000000-0xfcffffff] has been reserved
[    0.937223] system 00:00: [mem 0xfd000000-0xfdffffff] has been reserved
[    0.937224] system 00:00: [mem 0xfe000000-0xfeafffff] has been reserved
[    0.937226] system 00:00: [mem 0xfeb00000-0xfebfffff] has been reserved
[    0.937228] system 00:00: [mem 0xfed00400-0xfed3ffff] could not be reserved
[    0.937229] system 00:00: [mem 0xfed45000-0xfedfffff] has been reserved
[    0.937232] system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.937347] system 00:01: [mem 0xdfffc000-0xdfffdfff] could not be reserved
[    0.937348] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.937502] system 00:02: [io  0x0a00-0x0a7f] has been reserved
[    0.937504] system 00:02: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.937618] pnp 00:03: [dma 0 disabled]
[    0.937665] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.937940] pnp 00:04: [dma 0 disabled]
[    0.937995] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.938046] pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.938125] system 00:06: [io  0x04d0-0x04d1] has been reserved
[    0.938127] system 00:06: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.938241] pnp 00:07: Plug and Play ACPI device, IDs IPI0001 (active)
[    0.938406] system 00:08: [io  0x0400-0x0453] could not be reserved
[    0.938407] system 00:08: [io  0x0458-0x047f] has been reserved
[    0.938409] system 00:08: [io  0x1180-0x119f] has been reserved
[    0.938410] system 00:08: [io  0x0500-0x057f] has been reserved
[    0.938412] system 00:08: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    0.938413] system 00:08: [mem 0xfec00000-0xfecfffff] could not be reserved
[    0.938415] system 00:08: [mem 0xfed08000-0xfed08fff] has been reserved
[    0.938416] system 00:08: [mem 0xff000000-0xffffffff] has been reserved
[    0.938418] system 00:08: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.938492] system 00:09: [io  0x0454-0x0457] has been reserved
[    0.938493] system 00:09: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active)
[    0.938656] system 00:0a: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.938733] system 00:0b: [mem 0xfbffe000-0xfbffffff] could not be reserved
[    0.938734] system 00:0b: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.939149] pnp: PnP ACPI: found 12 devices
[    0.939150] ACPI: bus type PNP unregistered
[    0.945562] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.945572] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    0.945574] pci 0000:00:01.1:   bridge window [io  0x8000-0x8fff]
[    0.945577] pci 0000:00:01.1:   bridge window [mem 0xdf200000-0xdf2fffff]
[    0.945580] pci 0000:00:01.1:   bridge window [mem 0xdaa00000-0xdaafffff 64bit pref]
[    0.945585] pci 0000:00:02.0: PCI bridge to [bus 04]
[    0.945587] pci 0000:00:02.0:   bridge window [io  0x7000-0x7fff]
[    0.945590] pci 0000:00:02.0:   bridge window [mem 0xde000000-0xdf0fffff]
[    0.945593] pci 0000:00:02.0:   bridge window [mem 0xd0000000-0xd9ffffff 64bit pref]
[    0.945598] pci 0000:00:03.0: PCI bridge to [bus 05]
[    0.945606] pci 0000:00:03.2: PCI bridge to [bus 06]
[    0.945615] pci 0000:00:11.0: PCI bridge to [bus 07]
[    0.945617] pci 0000:00:11.0:   bridge window [io  0x6000-0x6fff]
[    0.945622] pci 0000:00:11.0:   bridge window [mem 0xdf100000-0xdf1fffff]
[    0.945626] pci 0000:00:11.0:   bridge window [mem 0xda400000-0xda8fffff 64bit pref]
[    0.945632] pci 0000:00:1e.0: PCI bridge to [bus 08]
[    0.945642] pci_bus 0000:00: resource 4 [io  0x0000-0x03af]
[    0.945643] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7]
[    0.945644] pci_bus 0000:00: resource 6 [io  0x03b0-0x03df]
[    0.945645] pci_bus 0000:00: resource 7 [io  0x0d00-0x9fff]
[    0.945646] pci_bus 0000:00: resource 8 [mem 0x000a0000-0x000bffff]
[    0.945647] pci_bus 0000:00: resource 9 [mem 0x000c0000-0x000dffff]
[    0.945649] pci_bus 0000:00: resource 10 [mem 0xfed0e000-0xfed0ffff]
[    0.945650] pci_bus 0000:00: resource 11 [mem 0x80000000-0xdfffffff]
[    0.945651] pci_bus 0000:02: resource 0 [io  0x8000-0x8fff]
[    0.945652] pci_bus 0000:02: resource 1 [mem 0xdf200000-0xdf2fffff]
[    0.945653] pci_bus 0000:02: resource 2 [mem 0xdaa00000-0xdaafffff 64bit pref]
[    0.945655] pci_bus 0000:04: resource 0 [io  0x7000-0x7fff]
[    0.945656] pci_bus 0000:04: resource 1 [mem 0xde000000-0xdf0fffff]
[    0.945657] pci_bus 0000:04: resource 2 [mem 0xd0000000-0xd9ffffff 64bit pref]
[    0.945658] pci_bus 0000:07: resource 0 [io  0x6000-0x6fff]
[    0.945659] pci_bus 0000:07: resource 1 [mem 0xdf100000-0xdf1fffff]
[    0.945660] pci_bus 0000:07: resource 2 [mem 0xda400000-0xda8fffff 64bit pref]
[    0.945662] pci_bus 0000:08: resource 4 [io  0x0000-0x03af]
[    0.945663] pci_bus 0000:08: resource 5 [io  0x03e0-0x0cf7]
[    0.945664] pci_bus 0000:08: resource 6 [io  0x03b0-0x03df]
[    0.945665] pci_bus 0000:08: resource 7 [io  0x0d00-0x9fff]
[    0.945666] pci_bus 0000:08: resource 8 [mem 0x000a0000-0x000bffff]
[    0.945667] pci_bus 0000:08: resource 9 [mem 0x000c0000-0x000dffff]
[    0.945668] pci_bus 0000:08: resource 10 [mem 0xfed0e000-0xfed0ffff]
[    0.945669] pci_bus 0000:08: resource 11 [mem 0x80000000-0xdfffffff]
[    0.945689] pci 0000:80:01.0: PCI bridge to [bus 81]
[    0.945697] pci 0000:80:02.0: PCI bridge to [bus 82]
[    0.945705] pci 0000:80:03.0: PCI bridge to [bus 83]
[    0.945708] pci 0000:80:03.0:   bridge window [mem 0xfbe00000-0xfbefffff]
[    0.945714] pci_bus 0000:80: resource 4 [io  0xa000-0xffff]
[    0.945715] pci_bus 0000:80: resource 5 [mem 0xe0000000-0xfbffffff]
[    0.945716] pci_bus 0000:83: resource 1 [mem 0xfbe00000-0xfbefffff]
[    0.945989] NET: Registered protocol family 2
[    0.946853] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.947506] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.947661] TCP: Hash tables configured (established 524288 bind 65536)
[    0.947689] TCP: reno registered
[    0.947742] UDP hash table entries: 32768 (order: 8, 1048576 bytes)
[    0.947930] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes)
[    0.948351] NET: Registered protocol family 1
[    0.986924] pci 0000:04:00.0: Boot video device
[    0.987023] PCI: CLS 64 bytes, default 64
[    0.987079] Unpacking initramfs...
[    1.182109] Freeing initrd memory: 14656K (ffff880036350000 - ffff8800371a0000)
[    1.182489] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    1.182491] software IO TLB [mem 0x79f5d000-0x7df5d000] (64MB) mapped at [ffff880079f5d000-ffff88007df5cfff]
[    1.184461] RAPL PMU detected, hw unit 2^-16 Joules, API unit is 2^-32 Joules, 3 fixed counters 163840 ms ovfl timer
[    1.184581] microcode: CPU0 sig=0x306e4, pf=0x1, revision=0x416
[    1.184594] microcode: CPU1 sig=0x306e4, pf=0x1, revision=0x416
[    1.184608] microcode: CPU2 sig=0x306e4, pf=0x1, revision=0x416
[    1.184630] microcode: CPU3 sig=0x306e4, pf=0x1, revision=0x416
[    1.184637] microcode: CPU4 sig=0x306e4, pf=0x1, revision=0x416
[    1.184644] microcode: CPU5 sig=0x306e4, pf=0x1, revision=0x416
[    1.184651] microcode: CPU6 sig=0x306e4, pf=0x1, revision=0x416
[    1.184658] microcode: CPU7 sig=0x306e4, pf=0x1, revision=0x416
[    1.184665] microcode: CPU8 sig=0x306e4, pf=0x1, revision=0x416
[    1.184672] microcode: CPU9 sig=0x306e4, pf=0x1, revision=0x416
[    1.184676] microcode: CPU10 sig=0x306e4, pf=0x1, revision=0x416
[    1.184691] microcode: CPU11 sig=0x306e4, pf=0x1, revision=0x416
[    1.184698] microcode: CPU12 sig=0x306e4, pf=0x1, revision=0x416
[    1.184704] microcode: CPU13 sig=0x306e4, pf=0x1, revision=0x416
[    1.184711] microcode: CPU14 sig=0x306e4, pf=0x1, revision=0x416
[    1.184718] microcode: CPU15 sig=0x306e4, pf=0x1, revision=0x416
[    1.184727] microcode: CPU16 sig=0x306e4, pf=0x1, revision=0x416
[    1.184737] microcode: CPU17 sig=0x306e4, pf=0x1, revision=0x416
[    1.184749] microcode: CPU18 sig=0x306e4, pf=0x1, revision=0x416
[    1.184760] microcode: CPU19 sig=0x306e4, pf=0x1, revision=0x416
[    1.184782] microcode: CPU20 sig=0x306e4, pf=0x1, revision=0x416
[    1.184788] microcode: CPU21 sig=0x306e4, pf=0x1, revision=0x416
[    1.184793] microcode: CPU22 sig=0x306e4, pf=0x1, revision=0x416
[    1.184799] microcode: CPU23 sig=0x306e4, pf=0x1, revision=0x416
[    1.184805] microcode: CPU24 sig=0x306e4, pf=0x1, revision=0x416
[    1.184810] microcode: CPU25 sig=0x306e4, pf=0x1, revision=0x416
[    1.184816] microcode: CPU26 sig=0x306e4, pf=0x1, revision=0x416
[    1.184822] microcode: CPU27 sig=0x306e4, pf=0x1, revision=0x416
[    1.184837] microcode: CPU28 sig=0x306e4, pf=0x1, revision=0x416
[    1.184843] microcode: CPU29 sig=0x306e4, pf=0x1, revision=0x416
[    1.184848] microcode: CPU30 sig=0x306e4, pf=0x1, revision=0x416
[    1.184854] microcode: CPU31 sig=0x306e4, pf=0x1, revision=0x416
[    1.184903] microcode: Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    1.185508] futex hash table entries: 8192 (order: 7, 524288 bytes)
[    1.185647] audit: initializing netlink subsys (disabled)
[    1.185675] audit: type=2000 audit(1357055024.048:1): initialized
[    1.186565] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    1.187206] VFS: Disk quotas dquot_6.5.2
[    1.187270] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.187392] msgmni has been set to 32768
[    1.187780] alg: No test for stdrng (krng)
[    1.187871] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[    1.188012] io scheduler noop registered
[    1.188014] io scheduler deadline registered
[    1.188132] io scheduler cfq registered (default)
[    1.188463] pcieport 0000:00:01.0: irq 90 for MSI/MSI-X
[    1.188671] pcieport 0000:00:01.1: irq 91 for MSI/MSI-X
[    1.188877] pcieport 0000:00:02.0: irq 92 for MSI/MSI-X
[    1.189080] pcieport 0000:00:03.0: irq 93 for MSI/MSI-X
[    1.189276] pcieport 0000:00:03.2: irq 94 for MSI/MSI-X
[    1.189476] pcieport 0000:00:11.0: irq 95 for MSI/MSI-X
[    1.189718] pcieport 0000:80:01.0: irq 96 for MSI/MSI-X
[    1.189839] pcieport 0000:80:02.0: irq 97 for MSI/MSI-X
[    1.189950] pcieport 0000:80:03.0: irq 98 for MSI/MSI-X
[    1.190044] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    1.190047] pcie_pme 0000:00:01.0:pcie01: service driver pcie_pme loaded
[    1.190067] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    1.190069] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    1.190070] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    1.190073] pcie_pme 0000:00:01.1:pcie01: service driver pcie_pme loaded
[    1.190093] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    1.190094] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    1.190096] pci 0000:04:00.1: Signaling PME through PCIe PME interrupt
[    1.190098] pcie_pme 0000:00:02.0:pcie01: service driver pcie_pme loaded
[    1.190119] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    1.190122] pcie_pme 0000:00:03.0:pcie01: service driver pcie_pme loaded
[    1.190141] pcieport 0000:00:03.2: Signaling PME through PCIe PME interrupt
[    1.190144] pcie_pme 0000:00:03.2:pcie01: service driver pcie_pme loaded
[    1.190164] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    1.190166] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    1.190169] pcie_pme 0000:00:11.0:pcie01: service driver pcie_pme loaded
[    1.190187] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    1.190189] pcie_pme 0000:80:01.0:pcie01: service driver pcie_pme loaded
[    1.190206] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    1.190209] pcie_pme 0000:80:02.0:pcie01: service driver pcie_pme loaded
[    1.190226] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    1.190227] pci 0000:83:00.0: Signaling PME through PCIe PME interrupt
[    1.190230] pcie_pme 0000:80:03.0:pcie01: service driver pcie_pme loaded
[    1.190265] ioapic: probe of 0000:00:05.4 failed with error -22
[    1.190274] ioapic: probe of 0000:80:05.4 failed with error -22
[    1.190285] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    1.190303] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    1.190350] intel_idle: MWAIT substates: 0x1120
[    1.190351] intel_idle: v0.4 model 0x3E
[    1.190352] intel_idle: lapic_timer_reliable_states 0xffffffff
[    1.191312] ERST: Error Record Serialization Table (ERST) support is initialized.
[    1.191316] pstore: Registered erst as persistent store backend
[    1.191408] GHES: APEI firmware first mode is enabled by WHEA _OSC.
[    1.191488] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    1.211905] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    1.232339] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    1.232680] Linux agpgart interface v0.103
[    1.232932] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    2.178126] tsc: Refined TSC clocksource calibration: 3399.999 MHz
[    2.259815] i8042: No controller found
[    2.259944] mousedev: PS/2 mouse device common for all mice
[    2.259976] rtc_cmos 00:05: RTC can wake from S4
[    2.260097] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0
[    2.260126] rtc_cmos 00:05: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[    2.260137] Intel P-state driver initializing.
[    2.260150] Intel pstate controlling: cpu 0
[    2.260167] Intel pstate controlling: cpu 1
[    2.260182] Intel pstate controlling: cpu 2
[    2.260196] Intel pstate controlling: cpu 3
[    2.260209] Intel pstate controlling: cpu 4
[    2.260224] Intel pstate controlling: cpu 5
[    2.260237] Intel pstate controlling: cpu 6
[    2.260251] Intel pstate controlling: cpu 7
[    2.260265] Intel pstate controlling: cpu 8
[    2.260279] Intel pstate controlling: cpu 9
[    2.260293] Intel pstate controlling: cpu 10
[    2.260303] Intel pstate controlling: cpu 11
[    2.260316] Intel pstate controlling: cpu 12
[    2.260330] Intel pstate controlling: cpu 13
[    2.260343] Intel pstate controlling: cpu 14
[    2.260356] Intel pstate controlling: cpu 15
[    2.260371] Intel pstate controlling: cpu 16
[    2.260384] Intel pstate controlling: cpu 17
[    2.260399] Intel pstate controlling: cpu 18
[    2.260412] Intel pstate controlling: cpu 19
[    2.260426] Intel pstate controlling: cpu 20
[    2.260440] Intel pstate controlling: cpu 21
[    2.260453] Intel pstate controlling: cpu 22
[    2.260467] Intel pstate controlling: cpu 23
[    2.260490] Intel pstate controlling: cpu 24
[    2.260520] Intel pstate controlling: cpu 25
[    2.260534] Intel pstate controlling: cpu 26
[    2.260548] Intel pstate controlling: cpu 27
[    2.260564] Intel pstate controlling: cpu 28
[    2.260577] Intel pstate controlling: cpu 29
[    2.260591] Intel pstate controlling: cpu 30
[    2.260606] Intel pstate controlling: cpu 31
[    2.260663] AMD IOMMUv2 driver by Joerg Roedel <joerg.roedel@amd.com>
[    2.260665] AMD IOMMUv2 functionality not available on this system
[    2.260852] TCP: cubic registered
[    2.261421] NET: Registered protocol family 10
[    2.262277] mip6: Mobile IPv6
[    2.262286] NET: Registered protocol family 17
[    2.262301] mpls_gso: MPLS GSO support
[    2.264895] registered taskstats version 1
[    2.266580]   Magic number: 13:317:739
[    2.266625] pci 0000:ff:0d.1: hash matches
[    2.266658] acpi LNXCPU:68: hash matches
[    2.266675] acpi LNXCPU:3b: hash matches
[    2.266898] rtc_cmos 00:05: setting system clock to 2013-01-01 15:43:45 UTC (1357055025)
[    2.267002] PM: Checking hibernation image partition /dev/disk/by-uuid/04e6765a-fe0c-44e7-9165-219563f6171e
[    2.267005] PM: Hibernation image not present or could not be loaded.
[    2.268311] Freeing unused kernel memory: 1004K (ffffffff818ba000 - ffffffff819b5000)
[    2.268313] Write protecting the kernel read-only data: 8192k
[    2.271697] Freeing unused kernel memory: 980K (ffff88000150b000 - ffff880001600000)
[    2.272804] Freeing unused kernel memory: 336K (ffff8800017ac000 - ffff880001800000)
[    2.357628] udevd[228]: starting version 175
[    2.389953] pps_core: LinuxPPS API ver. 1 registered
[    2.389956] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    2.390412] PTP clock support registered
[    2.390730] dca service started, version 1.12.1
[    2.393106] ACPI: bus type USB registered
[    2.393132] usbcore: registered new interface driver usbfs
[    2.393141] usbcore: registered new interface driver hub
[    2.393187] usbcore: registered new device driver usb
[    2.394176] SCSI subsystem initialized
[    2.394494] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    2.394500] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.0.5-k
[    2.394503] igb: Copyright (c) 2007-2014 Intel Corporation.
[    2.394903] igb 0000:02:00.0: irq 99 for MSI/MSI-X
[    2.394913] igb 0000:02:00.0: irq 100 for MSI/MSI-X
[    2.394922] igb 0000:02:00.0: irq 101 for MSI/MSI-X
[    2.394928] igb 0000:02:00.0: irq 102 for MSI/MSI-X
[    2.394935] igb 0000:02:00.0: irq 103 for MSI/MSI-X
[    2.394941] igb 0000:02:00.0: irq 104 for MSI/MSI-X
[    2.394949] igb 0000:02:00.0: irq 105 for MSI/MSI-X
[    2.394956] igb 0000:02:00.0: irq 106 for MSI/MSI-X
[    2.394956] ehci-pci: EHCI PCI platform driver
[    2.394963] igb 0000:02:00.0: irq 107 for MSI/MSI-X
[    2.395109] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    2.395115] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    2.395131] ehci-pci 0000:00:1a.0: debug port 2
[    2.395991] libata version 3.00 loaded.
[    2.397783] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    2.397797] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    2.397800] isci 0000:07:00.0: OEM parameter table found in OROM
[    2.397801] isci 0000:07:00.0: OEM SAS parameters (version: 1.0) loaded (platform)
[    2.398049] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    2.399035] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
[    2.399055] ehci-pci 0000:00:1a.0: irq 16, io mem 0xdf324000
[    2.400285] scsi0 : isci
[    2.400748] isci 0000:07:00.0: irq 108 for MSI/MSI-X
[    2.400755] isci 0000:07:00.0: irq 109 for MSI/MSI-X
[    2.410011] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    2.410036] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    2.410037] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.410039] usb usb1: Product: EHCI Host Controller
[    2.410040] usb usb1: Manufacturer: Linux 3.16.0-vanilla.3+trtc ehci_hcd
[    2.410041] usb usb1: SerialNumber: 0000:00:1a.0
[    2.410191] hub 1-0:1.0: USB hub found
[    2.410198] hub 1-0:1.0: 2 ports detected
[    2.410450] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    2.410456] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    2.410468] ehci-pci 0000:00:1d.0: debug port 2
[    2.414345] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
[    2.414362] ehci-pci 0000:00:1d.0: irq 23, io mem 0xdf323000
[    2.424304] igb 0000:02:00.0: irq 99 for MSI/MSI-X
[    2.424310] igb 0000:02:00.0: irq 100 for MSI/MSI-X
[    2.424315] igb 0000:02:00.0: irq 101 for MSI/MSI-X
[    2.424319] igb 0000:02:00.0: irq 102 for MSI/MSI-X
[    2.424323] igb 0000:02:00.0: irq 103 for MSI/MSI-X
[    2.424327] igb 0000:02:00.0: irq 104 for MSI/MSI-X
[    2.424331] igb 0000:02:00.0: irq 105 for MSI/MSI-X
[    2.424336] igb 0000:02:00.0: irq 106 for MSI/MSI-X
[    2.424340] igb 0000:02:00.0: irq 107 for MSI/MSI-X
[    2.425985] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    2.426018] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    2.426020] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.426021] usb usb2: Product: EHCI Host Controller
[    2.426022] usb usb2: Manufacturer: Linux 3.16.0-vanilla.3+trtc ehci_hcd
[    2.426023] usb usb2: SerialNumber: 0000:00:1d.0
[    2.426114] hub 2-0:1.0: USB hub found
[    2.426118] hub 2-0:1.0: 2 ports detected
[    2.426362] ahci 0000:00:1f.2: version 3.0
[    2.426499] ahci 0000:00:1f.2: irq 110 for MSI/MSI-X
[    2.446700] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    2.446702] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    2.476609] igb 0000:02:00.0: added PHC on eth0
[    2.476611] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    2.476612] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:25:90:e0:6a:de
[    2.476685] igb 0000:02:00.0: eth0: PBA No: 106100-000
[    2.476686] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    2.476989] igb 0000:02:00.1: irq 111 for MSI/MSI-X
[    2.476994] igb 0000:02:00.1: irq 112 for MSI/MSI-X
[    2.477003] igb 0000:02:00.1: irq 113 for MSI/MSI-X
[    2.477008] igb 0000:02:00.1: irq 114 for MSI/MSI-X
[    2.477013] igb 0000:02:00.1: irq 115 for MSI/MSI-X
[    2.477017] igb 0000:02:00.1: irq 116 for MSI/MSI-X
[    2.477022] igb 0000:02:00.1: irq 117 for MSI/MSI-X
[    2.477028] igb 0000:02:00.1: irq 118 for MSI/MSI-X
[    2.477032] igb 0000:02:00.1: irq 119 for MSI/MSI-X
[    2.486611] scsi1 : ahci
[    2.486705] scsi2 : ahci
[    2.486792] scsi3 : ahci
[    2.486877] scsi4 : ahci
[    2.486962] scsi5 : ahci
[    2.487043] scsi6 : ahci
[    2.487080] ata1: SATA max UDMA/133 abar m2048@0xdf322000 port 0xdf322100 irq 110
[    2.487082] ata2: SATA max UDMA/133 abar m2048@0xdf322000 port 0xdf322180 irq 110
[    2.487084] ata3: SATA max UDMA/133 abar m2048@0xdf322000 port 0xdf322200 irq 110
[    2.487085] ata4: SATA max UDMA/133 abar m2048@0xdf322000 port 0xdf322280 irq 110
[    2.487087] ata5: SATA max UDMA/133 abar m2048@0xdf322000 port 0xdf322300 irq 110
[    2.487088] ata6: SATA max UDMA/133 abar m2048@0xdf322000 port 0xdf322380 irq 110
[    2.508059] igb 0000:02:00.1: irq 111 for MSI/MSI-X
[    2.508065] igb 0000:02:00.1: irq 112 for MSI/MSI-X
[    2.508070] igb 0000:02:00.1: irq 113 for MSI/MSI-X
[    2.508074] igb 0000:02:00.1: irq 114 for MSI/MSI-X
[    2.508079] igb 0000:02:00.1: irq 115 for MSI/MSI-X
[    2.508083] igb 0000:02:00.1: irq 116 for MSI/MSI-X
[    2.508087] igb 0000:02:00.1: irq 117 for MSI/MSI-X
[    2.508092] igb 0000:02:00.1: irq 118 for MSI/MSI-X
[    2.508096] igb 0000:02:00.1: irq 119 for MSI/MSI-X
[    2.563214] igb 0000:02:00.1: added PHC on eth1
[    2.563218] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    2.563220] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:25:90:e0:6a:df
[    2.563306] igb 0000:02:00.1: eth1: PBA No: 106100-000
[    2.563307] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    2.721877] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    2.805778] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    2.805821] ata5: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    2.805844] ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    2.805882] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    2.805906] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    2.805929] ata3: SATA link down (SStatus 0 SControl 300)
[    2.806120] ata1.00: ATA-8: INTEL SSDSC2BB480G4, D2010355, max UDMA/133
[    2.806122] ata1.00: 937703088 sectors, multi 1: LBA48 NCQ (depth 31/32)
[    2.806411] ata1.00: configured for UDMA/133
[    2.806454] ata4.00: ATAPI: ASUS    BW-16D1HT, 1.01, max UDMA/100
[    2.806504] scsi 1:0:0:0: Direct-Access     ATA      INTEL SSDSC2BB48 0355 PQ: 0 ANSI: 5
[    2.807114] ata5.00: ATA-8: ST3500620AS, SD25, max UDMA/133
[    2.807116] ata5.00: 976773168 sectors, multi 16: LBA48 NCQ (depth 31/32)
[    2.807171] ata4.00: configured for UDMA/100
[    2.808857] ata5.00: configured for UDMA/133
[    2.811443] ata6.00: ATA-8: WDC WD20EARS-00S8B1, 80.00A80, max UDMA/133
[    2.811445] ata6.00: 3907029168 sectors, multi 16: LBA48 NCQ (depth 31/32), AA
[    2.811551] sd 1:0:0:0: [sda] 937703088 512-byte logical blocks: (480 GB/447 GiB)
[    2.811707] sd 1:0:0:0: [sda] Write Protect is off
[    2.811709] sd 1:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    2.811737] sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.812328]  sda: sda1 sda2 sda3 sda4
[    2.812751] sd 1:0:0:0: [sda] Attached SCSI disk
[    2.817223] ata2.00: ATA-8: ADATA SX900, 5.0.7a, max UDMA/133
[    2.817224] ata2.00: 1000215216 sectors, multi 16: LBA48 NCQ (depth 31/32), AA
[    2.817280] ata6.00: configured for UDMA/133
[    2.827044] ata2.00: configured for UDMA/133
[    2.827119] scsi 2:0:0:0: Direct-Access     ATA      ADATA SX900      7a   PQ: 0 ANSI: 5
[    2.827273] sd 2:0:0:0: [sdb] 1000215216 512-byte logical blocks: (512 GB/476 GiB)
[    2.827299] sd 2:0:0:0: [sdb] Write Protect is off
[    2.827301] sd 2:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    2.827309] sd 2:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.827607] scsi 4:0:0:0: CD-ROM            ASUS     BW-16D1HT        1.01 PQ: 0 ANSI: 5
[    2.827608]  sdb: sdb1 sdb2
[    2.827783] sd 2:0:0:0: [sdb] Attached SCSI disk
[    2.829487] sd 1:0:0:0: Attached scsi generic sg0 type 0
[    2.829528] sd 2:0:0:0: Attached scsi generic sg1 type 0
[    2.834036] scsi 4:0:0:0: Attached scsi generic sg2 type 5
[    2.834122] scsi 5:0:0:0: Direct-Access     ATA      ST3500620AS      SD25 PQ: 0 ANSI: 5
[    2.834242] sd 5:0:0:0: [sdc] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[    2.834264] sd 5:0:0:0: Attached scsi generic sg3 type 0
[    2.834272] sd 5:0:0:0: [sdc] Write Protect is off
[    2.834274] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[    2.834282] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.834345] scsi 6:0:0:0: Direct-Access     ATA      WDC WD20EARS-00S 0A80 PQ: 0 ANSI: 5
[    2.834485] sd 6:0:0:0: [sdd] 3907029168 512-byte logical blocks: (2.00 TB/1.81 TiB)
[    2.834502] sd 6:0:0:0: [sdd] Write Protect is off
[    2.834504] sd 6:0:0:0: [sdd] Mode Sense: 00 3a 00 00
[    2.834512] sd 6:0:0:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.834542] sd 6:0:0:0: Attached scsi generic sg4 type 0
[    2.836390] sr0: scsi3-mmc drive: 24x/48x writer dvd-ram cd/rw xa/form2 cdda tray
[    2.836392] cdrom: Uniform CD-ROM driver Revision: 3.20
[    2.836479] sr 4:0:0:0: Attached scsi CD-ROM sr0
[    2.840663]  sdc: sdc1 sdc2
[    2.840812] sd 5:0:0:0: [sdc] Attached SCSI disk
[    2.854078] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    2.854080] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    2.854235] hub 1-1:1.0: USB hub found
[    2.854327] hub 1-1:1.0: 6 ports detected
[    2.869574]  sdd: sdd1
[    2.869704] sd 6:0:0:0: [sdd] Attached SCSI disk
[    2.965727] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    3.101933] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    3.101935] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    3.102080] hub 2-1:1.0: USB hub found
[    3.102183] hub 2-1:1.0: 8 ports detected
[    3.173642] usb 1-1.6: new full-speed USB device number 3 using ehci-pci
[    3.177649] Switched to clocksource tsc
[    3.266959] usb 1-1.6: New USB device found, idVendor=0557, idProduct=2221
[    3.266960] usb 1-1.6: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    3.266961] usb 1-1.6: Product: Hermon USB hidmouse Device
[    3.266962] usb 1-1.6: Manufacturer: Winbond Electronics Corp
[    3.268540] hidraw: raw HID events driver (C) Jiri Kosina
[    3.269887] usbcore: registered new interface driver usbhid
[    3.269888] usbhid: USB HID core driver
[    3.271008] input: Winbond Electronics Corp Hermon USB hidmouse Device as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6:1.0/0003:0557:2221.0001/input/input0
[    3.271075] hid-generic 0003:0557:2221.0001: input,hidraw0: USB HID v1.00 Mouse [Winbond Electronics Corp Hermon USB hidmouse Device] on usb-0000:00:1a.0-1.6/input0
[    3.271164] input: Winbond Electronics Corp Hermon USB hidmouse Device as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6:1.1/0003:0557:2221.0002/input/input1
[    3.271202] hid-generic 0003:0557:2221.0002: input,hidraw1: USB HID v1.00 Keyboard [Winbond Electronics Corp Hermon USB hidmouse Device] on usb-0000:00:1a.0-1.6/input1
[    3.301705] md: md0 stopped.
[    3.302475] md: bind<sdb1>
[    3.302626] md: bind<sda4>
[    3.303400] md: raid1 personality registered for level 1
[    3.303661] md/raid1:md0: active with 2 out of 2 mirrors
[    3.303807] created bitmap (3 pages) for device md0
[    3.303983] md0: bitmap initialized from disk: read 1 pages, set 0 of 5187 bits
[    3.304409] md0: detected capacity change from 0 to 348032532480
[    3.305217]  md0: unknown partition table
[    3.373524] usb 2-1.1: new high-speed USB device number 3 using ehci-pci
[    3.466591] usb 2-1.1: New USB device found, idVendor=0bc2, idProduct=3312
[    3.466593] usb 2-1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    3.466594] usb 2-1.1: Product: Expansion Desk
[    3.466595] usb 2-1.1: Manufacturer: Seagate 
[    3.466596] usb 2-1.1: SerialNumber: NA4M6A1L
[    3.468109] usb-storage 2-1.1:1.0: USB Mass Storage device detected
[    3.468226] scsi7 : usb-storage 2-1.1:1.0
[    3.468285] usbcore: registered new interface driver usb-storage
[    3.506615] device-mapper: uevent: version 1.0.3
[    3.506691] device-mapper: ioctl: 4.27.0-ioctl (2013-10-30) initialised: dm-devel@redhat.com
[    3.509249] random: nonblocking pool is initialized
[    3.510899] PM: Starting manual resume from disk
[    3.510902] PM: Hibernation image partition 8:2 present
[    3.510902] PM: Looking for hibernation image.
[    3.511068] PM: Image not found (code -22)
[    3.511069] PM: Hibernation image not present or could not be loaded.
[    3.513816] PM: Marking nosave pages: [mem 0x0009a000-0x000fffff]
[    3.513879] PM: Marking nosave pages: [mem 0x7df5d000-0xffffffff]
[    3.514942] PM: Basic memory bitmaps created
[    3.537427] usb 2-1.2: new low-speed USB device number 4 using ehci-pci
[    3.640238] usb 2-1.2: New USB device found, idVendor=0665, idProduct=5161
[    3.640299] usb 2-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    3.640360] usb 2-1.2: Product: USB to Serial
[    3.640415] usb 2-1.2: Manufacturer: INNO TECH
[    3.640470] usb 2-1.2: SerialNumber: 20100826
[    3.644463] PM: Basic memory bitmaps freed
[    3.645914] hid-generic 0003:0665:5161.0003: hiddev0,hidraw2: USB HID v1.00 Device [INNO TECH USB to Serial] on usb-0000:00:1d.0-1.2/input0
[    3.653002] EXT4-fs (sda1): INFO: recovery required on readonly filesystem
[    3.653004] EXT4-fs (sda1): write access will be enabled during recovery
[    3.656618] EXT4-fs (sda1): recovery complete
[    3.656819] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[    3.717325] usb 2-1.3: new high-speed USB device number 5 using ehci-pci
[    3.809921] usb 2-1.3: New USB device found, idVendor=1a40, idProduct=0101
[    3.809924] usb 2-1.3: New USB device strings: Mfr=0, Product=1, SerialNumber=0
[    3.809927] usb 2-1.3: Product: USB 2.0 Hub
[    3.810252] hub 2-1.3:1.0: USB hub found
[    3.810490] hub 2-1.3:1.0: 4 ports detected
[    3.813367] udevd[939]: starting version 175
[    3.879777] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input2
[    3.879784] ACPI: Power Button [PWRB]
[    3.879878] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3
[    3.879881] ACPI: Power Button [PWRF]
[    3.886690] wmi: Mapper loaded
[    3.910097] ipmi message handler version 39.2
[    3.911371] IPMI System Interface driver.
[    3.911527] ipmi_si: probing via ACPI
[    3.911540] ipmi_si 00:07: [io  0x0ca2] regsize 1 spacing 1 irq 0
[    3.911541] ipmi_si: Adding ACPI-specified kcs state machine
[    3.911560] ipmi_si: probing via SMBIOS
[    3.911561] ipmi_si: SMBIOS: mem 0x0 regsize 1 spacing 1 irq 0
[    3.911562] ipmi_si: Adding SMBIOS-specified kcs state machine
[    3.911564] ipmi_si: probing via SPMI
[    3.911565] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[    3.911565] ipmi_si: Adding SPMI-specified kcs state machine duplicate interface
[    3.911567] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x0, irq 0
[    3.918423] ioatdma: Intel(R) QuickData Technology Driver 4.00
[    3.919403] ioatdma 0000:00:04.0: irq 120 for MSI/MSI-X
[    3.919810] igb 0000:02:00.0: DCA enabled
[    3.920104] igb 0000:02:00.1: DCA enabled
[    3.920832] ioatdma 0000:00:04.1: irq 121 for MSI/MSI-X
[    3.922193] ioatdma 0000:00:04.2: irq 122 for MSI/MSI-X
[    3.923285] ioatdma 0000:00:04.3: irq 123 for MSI/MSI-X
[    3.923737] ioatdma 0000:00:04.4: irq 124 for MSI/MSI-X
[    3.924702] ioatdma 0000:00:04.5: irq 125 for MSI/MSI-X
[    3.925554] ioatdma 0000:00:04.6: irq 126 for MSI/MSI-X
[    3.926034] ioatdma 0000:00:04.7: irq 127 for MSI/MSI-X
[    3.926367] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[    3.927135] ioatdma 0000:80:04.0: irq 128 for MSI/MSI-X
[    3.927291] i801_smbus 0000:00:1f.3: SMBus using PCI Interrupt
[    3.928162] ioatdma 0000:80:04.1: irq 129 for MSI/MSI-X
[    3.929353] ioatdma 0000:80:04.2: irq 130 for MSI/MSI-X
[    3.930277] ioatdma 0000:80:04.3: irq 131 for MSI/MSI-X
[    3.931252] ioatdma 0000:80:04.4: irq 132 for MSI/MSI-X
[    3.932131] EDAC MC: Ver: 3.0.0
[    3.932135] ioatdma 0000:80:04.5: irq 133 for MSI/MSI-X
[    3.932994] ioatdma 0000:80:04.6: irq 134 for MSI/MSI-X
[    3.933859] ioatdma 0000:80:04.7: irq 135 for MSI/MSI-X
[    3.933902] EDAC sbridge: Seeking for: dev 0e.0 PCI ID 8086:0ea0
[    3.933913] EDAC sbridge: Seeking for: dev 0e.0 PCI ID 8086:0ea0
[    3.933928] EDAC sbridge: Seeking for: dev 0e.0 PCI ID 8086:0ea0
[    3.933931] EDAC sbridge: Seeking for: dev 0f.0 PCI ID 8086:0ea8
[    3.933936] EDAC sbridge: Seeking for: dev 0f.0 PCI ID 8086:0ea8
[    3.933940] EDAC sbridge: Seeking for: dev 0f.0 PCI ID 8086:0ea8
[    3.933942] EDAC sbridge: Seeking for: dev 0f.1 PCI ID 8086:0e71
[    3.933946] EDAC sbridge: Seeking for: dev 0f.1 PCI ID 8086:0e71
[    3.933951] EDAC sbridge: Seeking for: dev 0f.1 PCI ID 8086:0e71
[    3.933953] EDAC sbridge: Seeking for: dev 0f.2 PCI ID 8086:0eaa
[    3.933957] EDAC sbridge: Seeking for: dev 0f.2 PCI ID 8086:0eaa
[    3.933962] EDAC sbridge: Seeking for: dev 0f.2 PCI ID 8086:0eaa
[    3.933963] EDAC sbridge: Seeking for: dev 0f.3 PCI ID 8086:0eab
[    3.933968] EDAC sbridge: Seeking for: dev 0f.3 PCI ID 8086:0eab
[    3.933973] EDAC sbridge: Seeking for: dev 0f.3 PCI ID 8086:0eab
[    3.933975] EDAC sbridge: Seeking for: dev 0f.4 PCI ID 8086:0eac
[    3.933979] EDAC sbridge: Seeking for: dev 0f.4 PCI ID 8086:0eac
[    3.933984] EDAC sbridge: Seeking for: dev 0f.4 PCI ID 8086:0eac
[    3.933987] EDAC sbridge: Seeking for: dev 0f.5 PCI ID 8086:0ead
[    3.934009] EDAC sbridge: Seeking for: dev 0f.5 PCI ID 8086:0ead
[    3.934017] EDAC sbridge: Seeking for: dev 0f.5 PCI ID 8086:0ead
[    3.934019] EDAC sbridge: Seeking for: dev 16.0 PCI ID 8086:0ec8
[    3.934024] EDAC sbridge: Seeking for: dev 16.0 PCI ID 8086:0ec8
[    3.934028] EDAC sbridge: Seeking for: dev 16.0 PCI ID 8086:0ec8
[    3.934030] EDAC sbridge: Seeking for: dev 16.1 PCI ID 8086:0ec9
[    3.934034] EDAC sbridge: Seeking for: dev 16.1 PCI ID 8086:0ec9
[    3.934039] EDAC sbridge: Seeking for: dev 16.1 PCI ID 8086:0ec9
[    3.934042] EDAC sbridge: Seeking for: dev 16.2 PCI ID 8086:0eca
[    3.934046] EDAC sbridge: Seeking for: dev 16.2 PCI ID 8086:0eca
[    3.934052] EDAC sbridge: Seeking for: dev 16.2 PCI ID 8086:0eca
[    3.934054] EDAC sbridge: Seeking for: dev 1c.0 PCI ID 8086:0e60
[    3.934059] EDAC sbridge: Seeking for: dev 1d.2 PCI ID 8086:0e6a
[    3.934066] EDAC sbridge: Seeking for: dev 1d.3 PCI ID 8086:0e6b
[    3.934072] EDAC sbridge: Seeking for: dev 11.0 PCI ID 8086:0eb8
[    3.934077] EDAC sbridge: Seeking for: dev 11.4 PCI ID 8086:0ebc
[    3.934296] EDAC MC0: Giving out device to module sbridge_edac.c controller Ivy Bridge Socket#0: DEV 0000:7f:0e.0 (POLLED)
[    3.934475] EDAC MC1: Giving out device to module sbridge_edac.c controller Ivy Bridge Socket#1: DEV 0000:ff:0e.0 (POLLED)
[    3.934477] EDAC sbridge: Driver loaded.
[    3.940570] snd_hda_intel 0000:04:00.1: Disabling MSI
[    3.940581] snd_hda_intel 0000:04:00.1: Handle VGA-switcheroo audio client
[    3.940698] snd_hda_intel 0000:83:00.0: Disabling MSI
[    3.940701] snd_hda_intel 0000:83:00.0: Force to non-snoop mode
[    3.942465] input: PC Speaker as /devices/platform/pcspkr/input/input4
[    3.950340] sound hdaudioC1D1: autoconfig: line_outs=1 (0xd/0x0/0x0/0x0/0x0) type:line
[    3.950342] sound hdaudioC1D1:    speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[    3.950343] sound hdaudioC1D1:    hp_outs=1 (0x10/0x0/0x0/0x0/0x0)
[    3.950344] sound hdaudioC1D1:    mono: mono_out=0x0
[    3.950345] sound hdaudioC1D1:    dig-out=0xc/0x0
[    3.950346] sound hdaudioC1D1:    inputs:
[    3.950347] sound hdaudioC1D1:      Mic=0x12
[    3.950348] sound hdaudioC1D1:    dig-in=0xe
[    3.952322] snd_hda_intel 0000:83:00.0: Direct firmware load failed with error -2
[    3.952324] snd_hda_intel 0000:83:00.0: Falling back to user helper
[    3.957179] AVX version of gcm_enc/dec engaged.
[    3.958755] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[    3.962615] iTCO_vendor_support: vendor-support=0
[    3.963236] alg: No test for crc32 (crc32-pclmul)
[    3.963756] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[    3.963810] iTCO_wdt: Found a Patsburg TCO device (Version=2, TCOBASE=0x0460)
[    3.964069] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
[    3.966034] nvidia: module license 'NVIDIA' taints kernel.
[    3.966036] Disabling lock debugging due to kernel taint
[    3.972736] vgaarb: device changed decodes: PCI:0000:04:00.0,olddecodes=io+mem,decodes=none:owns=none
[    3.972898] NVRM: loading NVIDIA UNIX x86_64 Kernel Module  331.79  Sun May 18 03:55:59 PDT 2014
[    4.001774] input: HDA Creative Mic as /devices/pci0000:80/0000:80:03.0/0000:83:00.0/sound/card1/input5
[    4.001846] input: HDA Creative Front Headphone as /devices/pci0000:80/0000:80:03.0/0000:83:00.0/sound/card1/input6
[    4.017569] ipmi_si 00:07: Found new BMC (man_id: 0x002a7c, prod_id: 0x0628, dev_id: 0x20)
[    4.017576] ipmi_si 00:07: IPMI kcs interface initialized
[    4.081170] usb 2-1.3.1: new high-speed USB device number 6 using ehci-pci
[    4.173552] usb 2-1.3.1: New USB device found, idVendor=1a40, idProduct=0101
[    4.173554] usb 2-1.3.1: New USB device strings: Mfr=0, Product=1, SerialNumber=0
[    4.173556] usb 2-1.3.1: Product: USB 2.0 Hub
[    4.173699] hub 2-1.3.1:1.0: USB hub found
[    4.173800] hub 2-1.3.1:1.0: 4 ports detected
[    4.261001] usb 2-1.3.3: new full-speed USB device number 7 using ehci-pci
[    4.372934] usb 2-1.3.3: New USB device found, idVendor=046d, idProduct=c52b
[    4.372935] usb 2-1.3.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    4.372936] usb 2-1.3.3: Product: USB Receiver
[    4.372937] usb 2-1.3.3: Manufacturer: Logitech
[    4.394995] logitech-djreceiver 0003:046D:C52B.0006: hiddev0,hidraw3: USB HID v1.11 Device [Logitech USB Receiver] on usb-0000:00:1d.0-1.3.3/input2
[    4.401024] input: HDA NVidia HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:02.0/0000:04:00.1/sound/card0/input7
[    4.401077] input: HDA NVidia HDMI/DP,pcm=7 as /devices/pci0000:00/0000:00:02.0/0000:04:00.1/sound/card0/input8
[    4.401191] input: HDA NVidia HDMI/DP,pcm=8 as /devices/pci0000:00/0000:00:02.0/0000:04:00.1/sound/card0/input9
[    4.401293] input: HDA NVidia HDMI/DP,pcm=9 as /devices/pci0000:00/0000:00:02.0/0000:04:00.1/sound/card0/input10
[    4.450293] input: Logitech Unifying Device. Wireless PID:101b as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.3/2-1.3.3/2-1.3.3:1.2/0003:046D:C52B.0006/0003:046D:C52B.0007/input/input11
[    4.450398] logitech-djdevice 0003:046D:C52B.0007: input,hidraw4: USB HID v1.11 Mouse [Logitech Unifying Device. Wireless PID:101b] on usb-0000:00:1d.0-1.3.3:1
[    4.452327] input: Logitech Unifying Device. Wireless PID:2011 as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.3/2-1.3.3/2-1.3.3:1.2/0003:046D:C52B.0006/0003:046D:C52B.0008/input/input12
[    4.452411] logitech-djdevice 0003:046D:C52B.0008: input,hidraw5: USB HID v1.11 Keyboard [Logitech Unifying Device. Wireless PID:2011] on usb-0000:00:1d.0-1.3.3:2
[    4.465665] scsi 7:0:0:0: Direct-Access     Seagate  Expansion Desk   0737 PQ: 0 ANSI: 6
[    4.465854] sd 7:0:0:0: Attached scsi generic sg5 type 0
[    4.466385] sd 7:0:0:0: [sde] 488378645 4096-byte logical blocks: (2.00 TB/1.81 TiB)
[    4.467136] sd 7:0:0:0: [sde] Write Protect is off
[    4.467139] sd 7:0:0:0: [sde] Mode Sense: 2b 00 10 08
[    4.467760] sd 7:0:0:0: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[    4.468382] sd 7:0:0:0: [sde] 488378645 4096-byte logical blocks: (2.00 TB/1.81 TiB)
[    7.173981]  sde: sde1
[    7.196809] sd 7:0:0:0: [sde] 488378645 4096-byte logical blocks: (2.00 TB/1.81 TiB)
[    7.204553] sd 7:0:0:0: [sde] Attached SCSI disk
[    7.401333] Adding 85983228k swap on /dev/sda2.  Priority:-1 extents:1 across:85983228k SS
[    7.404914] EXT4-fs (sda1): re-mounted. Opts: (null)
[    7.561248] EXT4-fs (sda1): re-mounted. Opts: commit=600,errors=remount-ro
[    7.574487] loop: module loaded
[   27.180555] EXT4-fs (dm-2): mounted filesystem with ordered data mode. Opts: commit=600
[   27.183554] EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: commit=600
[   27.188019] EXT4-fs (dm-1): mounted filesystem with ordered data mode. Opts: commit=600
[   27.609340] RPC: Registered named UNIX socket transport module.
[   27.609343] RPC: Registered udp transport module.
[   27.609345] RPC: Registered tcp transport module.
[   27.609346] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   27.613399] FS-Cache: Loaded
[   27.617661] FS-Cache: Netfs 'nfs' registered for caching
[   27.623695] Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
[   27.877453] vboxdrv: Found 32 processor cores.
[   27.878004] vboxdrv: fAsync=0 offMin=0x26a offMax=0x3822
[   27.878117] vboxdrv: TSC mode is 'synchronous', kernel timer mode is 'normal'.
[   27.878118] vboxdrv: Successfully loaded version 4.3.12_Debian (interface 0x001a0007).
[   27.909277] vboxpci: IOMMU not found (not registered)
[   27.920900] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[   27.921046] NFSD: starting 90-second grace period (net ffffffff8188f400)
[   27.942025] Bluetooth: Core ver 2.19
[   27.942037] NET: Registered protocol family 31
[   27.942038] Bluetooth: HCI device and connection manager initialized
[   27.942047] Bluetooth: HCI socket layer initialized
[   27.942048] Bluetooth: L2CAP socket layer initialized
[   27.942054] Bluetooth: SCO socket layer initialized
[   27.943783] Bluetooth: RFCOMM TTY layer initialized
[   27.943791] Bluetooth: RFCOMM socket layer initialized
[   27.943795] Bluetooth: RFCOMM ver 1.11
[   27.946445] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[   27.946447] Bluetooth: BNEP filters: protocol multicast
[   27.946450] Bluetooth: BNEP socket layer initialized
[   27.958772] lp: driver loaded but no devices found
[   27.960637] ppdev: user-space parallel port driver
[   28.079176] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   28.175329] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   28.258773] nvidia 0000:04:00.0: irq 136 for MSI/MSI-X
[   31.277439] igb 0000:02:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   31.277592] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready

############### paste END.


Now I tried to identify the problem. There are two magic numbers
recorded in realtime clock:

pci     0000:ff:0d.1: hash matches
pci_bus 0000:ff: hash matches

The 0000:ff: is strange, like no particular piece of hardware driver is wrong, but whole bus?

The 0000:ff:0d.1 from lspci is a following thing:

ff:0d.1 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee3] (rev 04)
        Subsystem: Super Micro Computer Inc Device [15d9:0628]
        Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-


So that's the best I could do so far. Currently I am waiting for more
instructions from you on how to proceed.

PS: I am pretty sure that my hardware is not broken.
-- 
Janek Kozicki                               http://janek.kozicki.pl/  |

Re: 3.16 crashes on resume from Suspend-To-disk, Intel pci_bus problem?

[Janek Kozicki]

In case if you need this, below is full lspci output:

00:00.0 Host bridge [0600]: Intel Corporation Ivytown DMI2 [8086:0e00] (rev 04)
	Subsystem: Intel Corporation Ivytown DMI2 [8086:0e00]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin A routed to IRQ 0
	Capabilities: [90] Express (v2) Root Port (Slot-), MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 2.5GT/s, Width x4, ASPM L1, Latency L0 <512ns, L1 <16us
			ClockPM- Surprise+ LLActRep+ BwNot+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		RootCtl: ErrCorrectable+ ErrNon-Fatal+ ErrFatal+ PMEIntEna- CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [100 v1] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [144 v1] Vendor Specific Information: ID=0004 Rev=1 Len=03c <?>
	Capabilities: [1d0 v1] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [280 v1] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>

00:01.0 PCI bridge [0604]: Intel Corporation Device [8086:0e02] (rev 04) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
	I/O behind bridge: 0000f000-00000fff
	Memory behind bridge: fff00000-000fffff
	Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [40] Subsystem: Intel Corporation Device [8086:0e02]
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
		Address: fee002d8  Data: 0000
		Masking: 00000002  Pending: 00000000
	Capabilities: [90] Express (v2) Root Port (Slot+), MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 5GT/s, Width x4, ASPM L1, Latency L0 unlimited, L1 <16us
			ClockPM- Surprise+ LLActRep+ BwNot+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x0, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
			Slot #1, PowerLimit 25.000W; Interlock- NoCompl-
		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
			Control: AttnInd Off, PwrInd Off, Power+ Interlock-
		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock-
			Changed: MRL- PresDet- LinkState-
		RootCtl: ErrCorrectable+ ErrNon-Fatal+ ErrFatal+ PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [100 v1] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110 v1] Access Control Services
		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
		ACSCtl:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
	Capabilities: [148 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [1d0 v1] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250 v1] #19
	Capabilities: [280 v1] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Kernel driver in use: pcieport

00:01.1 PCI bridge [0604]: Intel Corporation Device [8086:0e03] (rev 04) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=00, secondary=02, subordinate=03, sec-latency=0
	I/O behind bridge: 00008000-00008fff
	Memory behind bridge: df200000-df2fffff
	Prefetchable memory behind bridge: 00000000daa00000-00000000daafffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [40] Subsystem: Intel Corporation Device [8086:0e03]
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
		Address: fee002f8  Data: 0000
		Masking: 00000002  Pending: 00000000
	Capabilities: [90] Express (v2) Root Port (Slot+), MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 256 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x4, ASPM L1, Latency L0 unlimited, L1 <16us
			ClockPM- Surprise+ LLActRep+ BwNot+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt-
		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
			Slot #1, PowerLimit 25.000W; Interlock- NoCompl-
		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
			Control: AttnInd Off, PwrInd Off, Power+ Interlock-
		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
			Changed: MRL- PresDet- LinkState-
		RootCtl: ErrCorrectable+ ErrNon-Fatal+ ErrFatal+ PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- ARIFwd+
		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [100 v1] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110 v1] Access Control Services
		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
		ACSCtl:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
	Capabilities: [148 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [1d0 v1] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250 v1] #19
	Capabilities: [280 v1] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Kernel driver in use: pcieport

00:02.0 PCI bridge [0604]: Intel Corporation Ivytown PCI Express Root Port 2a [8086:0e04] (rev 04) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
	I/O behind bridge: 00007000-00007fff
	Memory behind bridge: de000000-df0fffff
	Prefetchable memory behind bridge: 00000000d0000000-00000000d9ffffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA- VGA+ MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [40] Subsystem: Intel Corporation Ivytown PCI Express Root Port 2a [8086:0e04]
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
		Address: fee00338  Data: 0000
		Masking: 00000002  Pending: 00000000
	Capabilities: [90] Express (v2) Root Port (Slot+), MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 256 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x16, ASPM L1, Latency L0 unlimited, L1 <16us
			ClockPM- Surprise+ LLActRep+ BwNot+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x16, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt-
		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
			Slot #1, PowerLimit 75.000W; Interlock- NoCompl-
		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
			Control: AttnInd Off, PwrInd Off, Power+ Interlock-
		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
			Changed: MRL- PresDet+ LinkState+
		RootCtl: ErrCorrectable+ ErrNon-Fatal+ ErrFatal+ PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
			 EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [100 v1] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110 v1] Access Control Services
		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
		ACSCtl:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
	Capabilities: [148 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [1d0 v1] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250 v1] #19
	Capabilities: [280 v1] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Kernel driver in use: pcieport

00:03.0 PCI bridge [0604]: Intel Corporation Ivytown PCI Express Root Port 3a [8086:0e08] (rev 04) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=00, secondary=05, subordinate=05, sec-latency=0
	I/O behind bridge: 0000f000-00000fff
	Memory behind bridge: fff00000-000fffff
	Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [40] Subsystem: Intel Corporation Ivytown PCI Express Root Port 3a [8086:0e08]
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
		Address: fee00378  Data: 0000
		Masking: 00000002  Pending: 00000000
	Capabilities: [90] Express (v2) Root Port (Slot+), MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag+ RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x8, ASPM L1, Latency L0 unlimited, L1 <16us
			ClockPM- Surprise+ LLActRep+ BwNot+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x0, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
			Slot #1, PowerLimit 25.000W; Interlock- NoCompl-
		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
			Control: AttnInd Off, PwrInd Off, Power+ Interlock-
		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock-
			Changed: MRL- PresDet- LinkState-
		RootCtl: ErrCorrectable+ ErrNon-Fatal+ ErrFatal+ PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [100 v1] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110 v1] Access Control Services
		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
		ACSCtl:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
	Capabilities: [148 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [1d0 v1] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250 v1] #19
	Capabilities: [280 v1] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Kernel driver in use: pcieport

00:03.2 PCI bridge [0604]: Intel Corporation Ivytown PCI Express Root Port 3c [8086:0e0a] (rev 04) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=00, secondary=06, subordinate=06, sec-latency=0
	I/O behind bridge: 0000f000-00000fff
	Memory behind bridge: fff00000-000fffff
	Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [40] Subsystem: Intel Corporation Ivytown PCI Express Root Port 3c [8086:0e0a]
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
		Address: fee00398  Data: 0000
		Masking: 00000002  Pending: 00000000
	Capabilities: [90] Express (v2) Root Port (Slot+), MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x8, ASPM L1, Latency L0 unlimited, L1 <16us
			ClockPM- Surprise+ LLActRep+ BwNot+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x0, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
			Slot #1, PowerLimit 25.000W; Interlock- NoCompl-
		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
			Control: AttnInd Off, PwrInd Off, Power+ Interlock-
		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock-
			Changed: MRL- PresDet- LinkState-
		RootCtl: ErrCorrectable+ ErrNon-Fatal+ ErrFatal+ PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [100 v1] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110 v1] Access Control Services
		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
		ACSCtl:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
	Capabilities: [148 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [1d0 v1] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250 v1] #19
	Capabilities: [280 v1] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Kernel driver in use: pcieport

00:04.0 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 0 [8086:0e20] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 11
	Region 0: Memory at df31c000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

00:04.1 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 1 [8086:0e21] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin B routed to IRQ 10
	Region 0: Memory at df318000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

00:04.2 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 2 [8086:0e22] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin C routed to IRQ 5
	Region 0: Memory at df314000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

00:04.3 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 3 [8086:0e23] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin D routed to IRQ 11
	Region 0: Memory at df310000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

00:04.4 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 4 [8086:0e24] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 11
	Region 0: Memory at df30c000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

00:04.5 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 5 [8086:0e25] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin B routed to IRQ 10
	Region 0: Memory at df308000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

00:04.6 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 6 [8086:0e26] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin C routed to IRQ 5
	Region 0: Memory at df304000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

00:04.7 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 7 [8086:0e27] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin D routed to IRQ 11
	Region 0: Memory at df300000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

00:05.0 System peripheral [0880]: Intel Corporation Ivytown VTd/Memory Map/Misc [8086:0e28] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-

00:05.2 System peripheral [0880]: Intel Corporation Ivytown IIO RAS [8086:0e2a] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-

00:05.4 PIC [0800]: Intel Corporation Ivytown IOAPIC [8086:0e2c] (rev 04) (prog-if 20 [IO(X)-APIC])
	Subsystem: Intel Corporation Ivytown IOAPIC [8086:0e2c]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Region 0: Memory at df328000 (32-bit, non-prefetchable)
	Capabilities: [44] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-

00:11.0 PCI bridge [0604]: Intel Corporation C600/X79 series chipset PCI Express Virtual Root Port [8086:1d3e] (rev 06) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=00, secondary=07, subordinate=07, sec-latency=0
	I/O behind bridge: 00006000-00006fff
	Memory behind bridge: df100000-df1fffff
	Prefetchable memory behind bridge: 00000000da400000-00000000da8fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [40] Express (v2) Root Port (Slot-), MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #17, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		RootCtl: ErrCorrectable+ ErrNon-Fatal+ ErrFatal+ PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis- ARIFwd+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- ARIFwd+
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [80] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [88] Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Capabilities: [90] MSI: Enable+ Count=1/1 Maskable- 64bit-
		Address: fee003b8  Data: 0000
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [138 v1] Access Control Services
		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans+
		ACSCtl:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
	Kernel driver in use: pcieport

00:16.0 Communication controller [0780]: Intel Corporation C600/X79 series chipset MEI Controller #1 [8086:1d3a] (rev 05)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin A routed to IRQ 11
	Region 0: Memory at df327000 (64-bit, non-prefetchable)
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000

00:16.1 Communication controller [0780]: Intel Corporation C600/X79 series chipset MEI Controller #2 [8086:1d3b] (rev 05)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin B routed to IRQ 10
	Region 0: Memory at df326000 (64-bit, non-prefetchable)
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000

00:1a.0 USB controller [0c03]: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #2 [8086:1d2d] (rev 06) (prog-if 20 [EHCI])
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin A routed to IRQ 11
	Region 0: Memory at df324000 (32-bit, non-prefetchable)
	Capabilities: [50] Power Management version 2
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Debug port: BAR=1 offset=00a0
	Capabilities: [98] PCI Advanced Features
		AFCap: TP+ FLR+
		AFCtrl: FLR-
		AFStatus: TP-
	Kernel driver in use: ehci-pci

00:1d.0 USB controller [0c03]: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #1 [8086:1d26] (rev 06) (prog-if 20 [EHCI])
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin A routed to IRQ 7
	Region 0: Memory at df323000 (32-bit, non-prefetchable)
	Capabilities: [50] Power Management version 2
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Debug port: BAR=1 offset=00a0
	Capabilities: [98] PCI Advanced Features
		AFCap: TP+ FLR+
		AFCtrl: FLR-
		AFStatus: TP-
	Kernel driver in use: ehci-pci

00:1e.0 PCI bridge [0604]: Intel Corporation 82801 PCI Bridge [8086:244e] (rev a6) (prog-if 01 [Subtractive decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Bus: primary=00, secondary=08, subordinate=08, sec-latency=64
	I/O behind bridge: 0000f000-00000fff
	Memory behind bridge: fff00000-000fffff
	Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
	Secondary status: 66MHz- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [50] Subsystem: Super Micro Computer Inc Device [15d9:0628]

00:1f.0 ISA bridge [0601]: Intel Corporation C600/X79 series chipset LPC Controller [8086:1d41] (rev 06)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Capabilities: [e0] Vendor Specific Information: Len=0c <?>
	Kernel driver in use: lpc_ich

00:1f.2 SATA controller [0106]: Intel Corporation C600/X79 series chipset 6-Port SATA AHCI Controller [8086:1d02] (rev 06) (prog-if 01 [AHCI 1.0])
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin B routed to IRQ 11
	Region 0: I/O ports at 9070
	Region 1: I/O ports at 9060
	Region 2: I/O ports at 9050
	Region 3: I/O ports at 9040
	Region 4: I/O ports at 9020
	Region 5: Memory at df322000 (32-bit, non-prefetchable)
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
		Address: fee00658  Data: 0000
	Capabilities: [70] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot+,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [a8] SATA HBA v1.0 BAR4 Offset=00000004
	Capabilities: [b0] PCI Advanced Features
		AFCap: TP+ FLR+
		AFCtrl: FLR-
		AFStatus: TP-
	Kernel driver in use: ahci

00:1f.3 SMBus [0c05]: Intel Corporation C600/X79 series chipset SMBus Host Controller [8086:1d22] (rev 06)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin C routed to IRQ 5
	Region 0: Memory at df321000 (64-bit, non-prefetchable)
	Region 4: I/O ports at 9000
	Kernel driver in use: i801_smbus

00:1f.6 Signal processing controller [1180]: Intel Corporation C600/X79 series chipset Thermal Management Controller [8086:1d24] (rev 06)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin C routed to IRQ 5
	Region 0: Memory at df320000 (64-bit, non-prefetchable)
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-

02:00.0 Ethernet controller [0200]: Intel Corporation I350 Gigabit Network Connection [8086:1521] (rev 01)
	Subsystem: Super Micro Computer Inc Device [15d9:1521]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 11
	Region 0: Memory at df220000 (32-bit, non-prefetchable)
	Region 2: I/O ports at 8020
	Region 3: Memory at df244000 (32-bit, non-prefetchable)
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME-
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
		Address: 0000000000000000  Data: 0000
		Masking: 00000000  Pending: 00000000
	Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
		Vector table: BAR=3 offset=00000000
		PBA: BAR=3 offset=00002000
	Capabilities: [a0] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
			MaxPayload 256 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
		LnkCap:	Port #2, Speed 5GT/s, Width x4, ASPM L0s L1, Latency L0 <4us, L1 <32us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [100 v2] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
	Capabilities: [140 v1] Device Serial Number 00-25-90-ff-ff-e0-6a-de
	Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
		ARICap:	MFVC- ACS-, Next Function: 1
		ARICtl:	MFVC- ACS-, Function Group: 0
	Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
		IOVCap:	Migration-, Interrupt Message Number: 000
		IOVCtl:	Enable- Migration- Interrupt- MSE- ARIHierarchy+
		IOVSta:	Migration-
		Initial VFs: 8, Total VFs: 8, Number of VFs: 0, Function Dependency Link: 00
		VF offset: 128, stride: 4, Device ID: 1520
		Supported Page Size: 00000553, System Page Size: 00000001
		Region 0: Memory at 00000000daa60000 (64-bit, prefetchable)
		Region 3: Memory at 00000000daa40000 (64-bit, prefetchable)
		VF Migration: offset: 00000000, BIR: 0
	Capabilities: [1a0 v1] Transaction Processing Hints
		Device specific mode supported
		Steering table in TPH capability structure
	Capabilities: [1c0 v1] Latency Tolerance Reporting
		Max snoop latency: 0ns
		Max no snoop latency: 0ns
	Capabilities: [1d0 v1] Access Control Services
		ACSCap:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
		ACSCtl:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
	Kernel driver in use: igb

02:00.1 Ethernet controller [0200]: Intel Corporation I350 Gigabit Network Connection [8086:1521] (rev 01)
	Subsystem: Super Micro Computer Inc Device [15d9:1521]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin B routed to IRQ 10
	Region 0: Memory at df200000 (32-bit, non-prefetchable)
	Region 2: I/O ports at 8000
	Region 3: Memory at df240000 (32-bit, non-prefetchable)
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME-
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
		Address: 0000000000000000  Data: 0000
		Masking: 00000000  Pending: 00000000
	Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
		Vector table: BAR=3 offset=00000000
		PBA: BAR=3 offset=00002000
	Capabilities: [a0] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
			MaxPayload 256 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
		LnkCap:	Port #2, Speed 5GT/s, Width x4, ASPM L0s L1, Latency L0 <4us, L1 <32us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [100 v2] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
	Capabilities: [140 v1] Device Serial Number 00-25-90-ff-ff-e0-6a-de
	Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
		ARICap:	MFVC- ACS-, Next Function: 0
		ARICtl:	MFVC- ACS-, Function Group: 0
	Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
		IOVCap:	Migration-, Interrupt Message Number: 000
		IOVCtl:	Enable- Migration- Interrupt- MSE- ARIHierarchy-
		IOVSta:	Migration-
		Initial VFs: 8, Total VFs: 8, Number of VFs: 0, Function Dependency Link: 01
		VF offset: 128, stride: 4, Device ID: 1520
		Supported Page Size: 00000553, System Page Size: 00000001
		Region 0: Memory at 00000000daa20000 (64-bit, prefetchable)
		Region 3: Memory at 00000000daa00000 (64-bit, prefetchable)
		VF Migration: offset: 00000000, BIR: 0
	Capabilities: [1a0 v1] Transaction Processing Hints
		Device specific mode supported
		Steering table in TPH capability structure
	Capabilities: [1d0 v1] Access Control Services
		ACSCap:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
		ACSCtl:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
	Kernel driver in use: igb

04:00.0 VGA compatible controller [0300]: NVIDIA Corporation Device [10de:1004] (rev a1) (prog-if 00 [VGA controller])
	Subsystem: ASUSTeK Computer Inc. Device [1043:8469]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin A routed to IRQ 11
	Region 0: Memory at de000000 (32-bit, non-prefetchable)
	Region 1: Memory at d0000000 (64-bit, prefetchable)
	Region 3: Memory at d8000000 (64-bit, prefetchable)
	Region 5: I/O ports at 7000
	Capabilities: [60] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [68] MSI: Enable+ Count=1/1 Maskable- 64bit+
		Address: 00000000fee00a18  Data: 0000
	Capabilities: [78] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s unlimited, L1 <64us
			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 256 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x16, ASPM L0s L1, Latency L0 <512ns, L1 <4us
			ClockPM+ Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM+ AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x16, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Range AB, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
			 EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
	Capabilities: [100 v1] Virtual Channel
		Caps:	LPEVC=0 RefClk=100ns PATEntryBits=1
		Arb:	Fixed- WRR32- WRR64- WRR128-
		Ctrl:	ArbSelect=Fixed
		Status:	InProgress-
		VC0:	Caps:	PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
			Arb:	Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
			Ctrl:	Enable+ ID=0 ArbSelect=Fixed TC/VC=01
			Status:	NegoPending- InProgress-
	Capabilities: [128 v1] Power Budgeting <?>
	Capabilities: [420 v2] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [600 v1] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
	Capabilities: [900 v1] #19
	Kernel driver in use: nvidia

04:00.1 Audio device [0403]: NVIDIA Corporation Device [10de:0e1a] (rev a1)
	Subsystem: ASUSTeK Computer Inc. Device [1043:8469]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin B routed to IRQ 10
	Region 0: Memory at df080000 (32-bit, non-prefetchable)
	Capabilities: [60] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [78] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s unlimited, L1 <64us
			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 256 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x16, ASPM L0s L1, Latency L0 <512ns, L1 <4us
			ClockPM+ Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM L0s L1 Enabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM+ AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x16, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Range AB, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Kernel driver in use: snd_hda_intel

07:00.0 Serial Attached SCSI controller [0107]: Intel Corporation C602 chipset 4-Port SATA Storage Control Unit [8086:1d6b] (rev 06)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 11
	Region 0: Memory at da87c000 (64-bit, prefetchable)
	Region 2: Memory at da400000 (64-bit, prefetchable)
	Region 4: I/O ports at 6000
	Capabilities: [98] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [c4] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 1024 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited
			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
			MaxPayload 128 bytes, MaxReadReq 1024 bytes
		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [a0] MSI-X: Enable+ Count=2 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [138 v1] Alternative Routing-ID Interpretation (ARI)
		ARICap:	MFVC- ACS-, Next Function: 1
		ARICtl:	MFVC- ACS-, Function Group: 0
	Capabilities: [180 v1] Transaction Processing Hints
		Device specific mode supported
		No steering table available
	Capabilities: [140 v1] Single Root I/O Virtualization (SR-IOV)
		IOVCap:	Migration-, Interrupt Message Number: 000
		IOVCtl:	Enable- Migration- Interrupt- MSE- ARIHierarchy+
		IOVSta:	Migration-
		Initial VFs: 31, Total VFs: 31, Number of VFs: 0, Function Dependency Link: 00
		VF offset: 8, stride: 1, Device ID: 1d5b
		Supported Page Size: 00000553, System Page Size: 00000001
		Region 0: Memory at 00000000da800000 (64-bit, prefetchable)
		VF Migration: offset: 00000000, BIR: 0
	Kernel driver in use: isci

7f:08.0 System peripheral [0880]: Intel Corporation Ivytown QPI Link 0 [8086:0e80] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:09.0 System peripheral [0880]: Intel Corporation Ivytown QPI Link 1 [8086:0e90] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0a.0 System peripheral [0880]: Intel Corporation Ivytown Power Control Unit 0 [8086:0ec0] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0a.1 System peripheral [0880]: Intel Corporation Ivytown Power Control Unit 1 [8086:0ec1] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0a.2 System peripheral [0880]: Intel Corporation Ivytown Power Control Unit 2 [8086:0ec2] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0a.3 System peripheral [0880]: Intel Corporation Ivytown Power Control Unit 3 [8086:0ec3] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0b.0 System peripheral [0880]: Intel Corporation Ivytown Semaphore and Scratchpad Configuration Registers [8086:0e1e] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0b.3 System peripheral [0880]: Intel Corporation Ivytown Semaphore and Scratchpad Configuration Registers [8086:0e1f] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0c.0 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee0] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0c.1 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee2] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0c.2 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee4] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0c.3 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee6] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0c.4 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee8] (rev 04)
	Subsystem: Intel Corporation Device [8086:0000]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0d.0 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee1] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0d.1 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee3] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0d.2 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee5] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0d.3 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee7] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0d.4 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee9] (rev 04)
	Subsystem: Intel Corporation Device [8086:0000]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0e.0 System peripheral [0880]: Intel Corporation Ivytown Home Agent 0 [8086:0ea0] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:0e.1 Performance counters [1101]: Intel Corporation Ivytown Home Agent 0 [8086:0e30] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Kernel driver in use: ivt_uncore

7f:0f.0 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 0 Target Address/Thermal Registers [8086:0ea8] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
	Kernel driver in use: sbridge_edac

7f:0f.1 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 0 RAS Registers [8086:0e71] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

7f:0f.2 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 0 Channel Target Address Decoder Registers [8086:0eaa] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

7f:0f.3 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 0 Channel Target Address Decoder Registers [8086:0eab] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

7f:0f.4 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 0 Channel Target Address Decoder Registers [8086:0eac] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

7f:0f.5 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 0 Channel Target Address Decoder Registers [8086:0ead] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

7f:10.0 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 1 Channel 0-3 Thermal Control 0 [8086:0eb0] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
	Kernel driver in use: ivt_uncore

7f:10.1 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 1 Channel 0-3 Thermal Control 1 [8086:0eb1] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
	Kernel driver in use: ivt_uncore

7f:10.2 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 1 Channel 0-3 ERROR Registers 0 [8086:0eb2] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

7f:10.3 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 1 Channel 0-3 ERROR Registers 1 [8086:0eb3] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

7f:10.4 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 1 Channel 0-3 Thermal Control 2 [8086:0eb4] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
	Kernel driver in use: ivt_uncore

7f:10.5 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 1 Channel 0-3 Thermal Control 3 [8086:0eb5] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
	Kernel driver in use: ivt_uncore

7f:10.6 System peripheral [0880]: Intel Corporation Device [8086:0eb6] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

7f:10.7 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 1 Channel 0-3 ERROR Registers 2 [8086:0eb7] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

7f:13.0 System peripheral [0880]: Intel Corporation Ivytown R2PCIe [8086:0e1d] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:13.1 Performance counters [1101]: Intel Corporation Ivytown PCI Express Ring Performance Monitoring [8086:0e34] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Kernel driver in use: ivt_uncore

7f:13.4 System peripheral [0880]: Intel Corporation Ivytown QPI Ring Registers [8086:0e81] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:13.5 Performance counters [1101]: Intel Corporation Ivytown QPI Ring Performance Ring Monitoring [8086:0e36] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Kernel driver in use: ivt_uncore

7f:16.0 System peripheral [0880]: Intel Corporation Ivytown System Address Decoder [8086:0ec8] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:16.1 System peripheral [0880]: Intel Corporation Ivytown Broadcast Registers [8086:0ec9] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

7f:16.2 System peripheral [0880]: Intel Corporation Ivytown Broadcast Registers [8086:0eca] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

80:01.0 PCI bridge [0604]: Intel Corporation Device [8086:0e02] (rev 04) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=80, secondary=81, subordinate=81, sec-latency=0
	I/O behind bridge: 0000f000-00000fff
	Memory behind bridge: fff00000-000fffff
	Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [40] Subsystem: Intel Corporation Device [8086:0e02]
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
		Address: fee00038  Data: 0000
		Masking: 00000002  Pending: 00000000
	Capabilities: [90] Express (v2) Root Port (Slot-), MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x8, ASPM L1, Latency L0 unlimited, L1 <16us
			ClockPM- Surprise+ LLActRep+ BwNot+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x0, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		RootCtl: ErrCorrectable+ ErrNon-Fatal+ ErrFatal+ PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [100 v1] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110 v1] Access Control Services
		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
		ACSCtl:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
	Capabilities: [148 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [1d0 v1] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250 v1] #19
	Capabilities: [280 v1] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Kernel driver in use: pcieport

80:02.0 PCI bridge [0604]: Intel Corporation Ivytown PCI Express Root Port 2a [8086:0e04] (rev 04) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=80, secondary=82, subordinate=82, sec-latency=0
	I/O behind bridge: 0000f000-00000fff
	Memory behind bridge: fff00000-000fffff
	Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [40] Subsystem: Intel Corporation Ivytown PCI Express Root Port 2a [8086:0e04]
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
		Address: fee00078  Data: 0000
		Masking: 00000002  Pending: 00000000
	Capabilities: [90] Express (v2) Root Port (Slot-), MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x16, ASPM L1, Latency L0 unlimited, L1 <16us
			ClockPM- Surprise+ LLActRep+ BwNot+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x0, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		RootCtl: ErrCorrectable+ ErrNon-Fatal+ ErrFatal+ PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [100 v1] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110 v1] Access Control Services
		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
		ACSCtl:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
	Capabilities: [148 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [1d0 v1] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250 v1] #19
	Capabilities: [280 v1] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Kernel driver in use: pcieport

80:03.0 PCI bridge [0604]: Intel Corporation Ivytown PCI Express Root Port 3a [8086:0e08] (rev 04) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Bus: primary=80, secondary=83, subordinate=83, sec-latency=0
	I/O behind bridge: 0000f000-00000fff
	Memory behind bridge: fbe00000-fbefffff
	Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [40] Subsystem: Intel Corporation Ivytown PCI Express Root Port 3a [8086:0e08]
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
		Address: fee000b8  Data: 0000
		Masking: 00000002  Pending: 00000000
	Capabilities: [90] Express (v2) Root Port (Slot-), MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag+ RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x16, ASPM L1, Latency L0 unlimited, L1 <16us
			ClockPM- Surprise+ LLActRep+ BwNot+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt-
		RootCtl: ErrCorrectable+ ErrNon-Fatal+ ErrFatal+ PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range BCD, TimeoutDis+ ARIFwd+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [100 v1] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110 v1] Access Control Services
		ACSCap:	SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
		ACSCtl:	SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
	Capabilities: [148 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [1d0 v1] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250 v1] #19
	Capabilities: [280 v1] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Kernel driver in use: pcieport

80:04.0 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 0 [8086:0e20] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 11
	Region 0: Memory at fbf1c000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

80:04.1 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 1 [8086:0e21] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin B routed to IRQ 10
	Region 0: Memory at fbf18000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

80:04.2 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 2 [8086:0e22] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin C routed to IRQ 5
	Region 0: Memory at fbf14000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

80:04.3 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 3 [8086:0e23] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin D routed to IRQ 11
	Region 0: Memory at fbf10000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

80:04.4 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 4 [8086:0e24] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 11
	Region 0: Memory at fbf0c000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

80:04.5 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 5 [8086:0e25] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin B routed to IRQ 10
	Region 0: Memory at fbf08000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

80:04.6 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 6 [8086:0e26] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin C routed to IRQ 5
	Region 0: Memory at fbf04000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

80:04.7 System peripheral [0880]: Intel Corporation Ivytown Crystal Beach DMA Channel 7 [8086:0e27] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin D routed to IRQ 11
	Region 0: Memory at fbf00000 (64-bit, non-prefetchable)
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [90] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: ioatdma

80:05.0 System peripheral [0880]: Intel Corporation Ivytown VTd/Memory Map/Misc [8086:0e28] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-

80:05.2 System peripheral [0880]: Intel Corporation Ivytown IIO RAS [8086:0e2a] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-

80:05.4 PIC [0800]: Intel Corporation Ivytown IOAPIC [8086:0e2c] (rev 04) (prog-if 20 [IO(X)-APIC])
	Subsystem: Intel Corporation Ivytown IOAPIC [8086:0e2c]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Region 0: Memory at fbf20000 (32-bit, non-prefetchable)
	Capabilities: [44] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
	Capabilities: [e0] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-

83:00.0 Audio device [0403]: Creative Labs Device [1102:0012] (rev 01)
	Subsystem: Creative Labs Device [1102:0023]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 11
	Region 0: Memory at fbe04000 (64-bit, non-prefetchable)
	Region 2: Memory at fbe00000 (64-bit, non-prefetchable)
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI- D1- D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
		Address: 0000000000000000  Data: 0000
		Masking: 00000000  Pending: 00000000
	Capabilities: [70] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <512ns, L1 <16us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
	Capabilities: [140 v1] Virtual Channel
		Caps:	LPEVC=0 RefClk=100ns PATEntryBits=1
		Arb:	Fixed- WRR32- WRR64- WRR128-
		Ctrl:	ArbSelect=Fixed
		Status:	InProgress-
		VC0:	Caps:	PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
			Arb:	Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
			Ctrl:	Enable+ ID=0 ArbSelect=Fixed TC/VC=01
			Status:	NegoPending- InProgress-
		VC1:	Caps:	PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
			Arb:	Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
			Ctrl:	Enable- ID=1 ArbSelect=Fixed TC/VC=00
			Status:	NegoPending- InProgress-
	Capabilities: [170 v1] Device Serial Number 00-00-00-00-00-00-00-00
	Capabilities: [180 v1] Power Budgeting <?>
	Kernel driver in use: snd_hda_intel

ff:08.0 System peripheral [0880]: Intel Corporation Ivytown QPI Link 0 [8086:0e80] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:09.0 System peripheral [0880]: Intel Corporation Ivytown QPI Link 1 [8086:0e90] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0a.0 System peripheral [0880]: Intel Corporation Ivytown Power Control Unit 0 [8086:0ec0] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0a.1 System peripheral [0880]: Intel Corporation Ivytown Power Control Unit 1 [8086:0ec1] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0a.2 System peripheral [0880]: Intel Corporation Ivytown Power Control Unit 2 [8086:0ec2] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0a.3 System peripheral [0880]: Intel Corporation Ivytown Power Control Unit 3 [8086:0ec3] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0b.0 System peripheral [0880]: Intel Corporation Ivytown Semaphore and Scratchpad Configuration Registers [8086:0e1e] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0b.3 System peripheral [0880]: Intel Corporation Ivytown Semaphore and Scratchpad Configuration Registers [8086:0e1f] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0c.0 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee0] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0c.1 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee2] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0c.2 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee4] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0c.3 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee6] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0c.4 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee8] (rev 04)
	Subsystem: Intel Corporation Device [8086:0000]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0d.0 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee1] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0d.1 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee3] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0d.2 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee5] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0d.3 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee7] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0d.4 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee9] (rev 04)
	Subsystem: Intel Corporation Device [8086:0000]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0e.0 System peripheral [0880]: Intel Corporation Ivytown Home Agent 0 [8086:0ea0] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:0e.1 Performance counters [1101]: Intel Corporation Ivytown Home Agent 0 [8086:0e30] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Kernel driver in use: ivt_uncore

ff:0f.0 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 0 Target Address/Thermal Registers [8086:0ea8] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

ff:0f.1 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 0 RAS Registers [8086:0e71] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

ff:0f.2 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 0 Channel Target Address Decoder Registers [8086:0eaa] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

ff:0f.3 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 0 Channel Target Address Decoder Registers [8086:0eab] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

ff:0f.4 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 0 Channel Target Address Decoder Registers [8086:0eac] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

ff:0f.5 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 0 Channel Target Address Decoder Registers [8086:0ead] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

ff:10.0 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 1 Channel 0-3 Thermal Control 0 [8086:0eb0] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
	Kernel driver in use: ivt_uncore

ff:10.1 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 1 Channel 0-3 Thermal Control 1 [8086:0eb1] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
	Kernel driver in use: ivt_uncore

ff:10.2 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 1 Channel 0-3 ERROR Registers 0 [8086:0eb2] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

ff:10.3 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 1 Channel 0-3 ERROR Registers 1 [8086:0eb3] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

ff:10.4 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 1 Channel 0-3 Thermal Control 2 [8086:0eb4] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
	Kernel driver in use: ivt_uncore

ff:10.5 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 1 Channel 0-3 Thermal Control 3 [8086:0eb5] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
	Kernel driver in use: ivt_uncore

ff:10.6 System peripheral [0880]: Intel Corporation Device [8086:0eb6] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

ff:10.7 System peripheral [0880]: Intel Corporation Ivytown Integrated Memory Controller 1 Channel 0-3 ERROR Registers 2 [8086:0eb7] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [40] Express (v1) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag- RBE- FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-

ff:13.0 System peripheral [0880]: Intel Corporation Ivytown R2PCIe [8086:0e1d] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:13.1 Performance counters [1101]: Intel Corporation Ivytown PCI Express Ring Performance Monitoring [8086:0e34] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Kernel driver in use: ivt_uncore

ff:13.4 System peripheral [0880]: Intel Corporation Ivytown QPI Ring Registers [8086:0e81] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:13.5 Performance counters [1101]: Intel Corporation Ivytown QPI Ring Performance Ring Monitoring [8086:0e36] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Kernel driver in use: ivt_uncore

ff:16.0 System peripheral [0880]: Intel Corporation Ivytown System Address Decoder [8086:0ec8] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:16.1 System peripheral [0880]: Intel Corporation Ivytown Broadcast Registers [8086:0ec9] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

ff:16.2 System peripheral [0880]: Intel Corporation Ivytown Broadcast Registers [8086:0eca] (rev 04)
	Subsystem: Super Micro Computer Inc Device [15d9:0628]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-



-- 
# Janek Kozicki                              http://janek.kozicki.pl/

Re: 3.16 crashes on resume from Suspend-To-disk, Intel pci_bus problem?

[Takashi Iwai]

At Fri, 8 Aug 2014 18:25:59 +0200,
Janek Kozicki wrote:
> 
> Full reply, along with CONFIG_PM_TRACE_RTC=y results is below.
(snip)
>
> Now I tried to identify the problem. There are two magic numbers
> recorded in realtime clock:
> 
> pci     0000:ff:0d.1: hash matches
> pci_bus 0000:ff: hash matches
> 
> The 0000:ff: is strange, like no particular piece of hardware driver is wrong, but whole bus?
> 
> The 0000:ff:0d.1 from lspci is a following thing:
> 
> ff:0d.1 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee3] (rev 04)
>         Subsystem: Super Micro Computer Inc Device [15d9:0628]
>         Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
>         Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
> 
> 
> So that's the best I could do so far. Currently I am waiting for more
> instructions from you on how to proceed.
> 
> PS: I am pretty sure that my hardware is not broken.

So, the PM hang problem still exists although the kernel WARNING is
gone after the patch, right?  Then the kernel WARNING was a red
herring.  It should be fixed, but it wasn't the real cause of the
hang.

I'll apply the patch to sound git tree in anyway, as it look like a
right fix for kernel WARNING.


Takashi

Re: 3.16 crashes on resume from Suspend-To-disk, Intel pci_bus problem?

[Janek Kozicki]

Takashi Iwai said:     (by the date of Sat, 09 Aug 2014 10:59:13 +0200)

> At Fri, 8 Aug 2014 18:25:59 +0200,
> Janek Kozicki wrote:
> > 
> > Full reply, along with CONFIG_PM_TRACE_RTC=y results is below.
> (snip)
> >
> > Now I tried to identify the problem. There are two magic numbers
> > recorded in realtime clock:
> > 
> > pci     0000:ff:0d.1: hash matches
> > pci_bus 0000:ff: hash matches
> > 
> > The 0000:ff: is strange, like no particular piece of hardware driver is wrong, but whole bus?
> > 
> > The 0000:ff:0d.1 from lspci is a following thing:
> > 
> > ff:0d.1 System peripheral [0880]: Intel Corporation Ivytown Unicast Registers [8086:0ee3] (rev 04)
> >         Subsystem: Super Micro Computer Inc Device [15d9:0628]
> >         Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
> >         Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
> > 
> > 
> > So that's the best I could do so far. Currently I am waiting for more
> > instructions from you on how to proceed.
> > 
> > PS: I am pretty sure that my hardware is not broken.
> 
> So, the PM hang problem still exists although the kernel WARNING is
> gone after the patch, right?

yes, exactly. Though it's not a hang, but a reboot.

>  Then the kernel WARNING was a red
> herring.  It should be fixed, but it wasn't the real cause of the
> hang.
> 
> I'll apply the patch to sound git tree in anyway, as it look like a
> right fix for kernel WARNING.

thanks a lot :-)

I hope to that this reboot in last stage of resume can be fixed :)


PS: it appears that my email account has problems dealing with so much
email traffic. I will monitor archives online in this thread, and
please reply both to mailing list and my email.
-- 
Janek Kozicki                               http://janek.kozicki.pl/  |

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Markus Gutschke]

[-- Attachment #1: Type: text/plain, Size: 454 bytes --]

I am back and have physical access to the machine now.

I re-ran the test just to be sure, and I can confirm that "platform"
does in fact result in a crash.

Furthermore, I ran the test that Rui asked for. I suspended, resumed,
and upon crashing power-cycled the machine ASAP. "dmesg" suggests that
the problem is with LNXSYBUS:00 That doesn't tell me much, but
hopefully it makes sense to you guys.

Let me know, what else you want me to test.


Markus

[-- Attachment #2: dmesg.txt --]
[-- Type: text/plain, Size: 66917 bytes --]

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.15.0-rc8-gutschke (root@medusa) (gcc version 4.8.2 (Ubuntu 4.8.2-19ubuntu1) ) #16 SMP Fri Jul 25 17:39:40 PDT 2014
[    0.000000] Command line: BOOT_IMAGE=/vmlinuz-3.15.0-rc8-gutschke root=/dev/mapper/ubuntu--vg-root ro quiet splash crashkernel=384M-:128M
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000df451bff] usable
[    0.000000] BIOS-e820: [mem 0x00000000df451c00-0x00000000dfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000f8000000-0x00000000fbffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec0ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed18000-0x00000000fed1bfff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed20000-0x00000000fed8ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000feda0000-0x00000000feda5fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee0ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffe60000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000021fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.4 present.
[    0.000000] DMI: Dell Inc. Precision M4400                 /0R906R, BIOS A18 10/30/2009
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] No AGP bridge found
[    0.000000] e820: last_pfn = 0x220000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-CFFFF write-protect
[    0.000000]   D0000-EFFFF uncachable
[    0.000000]   F0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 000000000 mask 800000000 write-back
[    0.000000]   1 base 0E0000000 mask FE0000000 uncachable
[    0.000000]   2 disabled
[    0.000000]   3 disabled
[    0.000000]   4 disabled
[    0.000000]   5 disabled
[    0.000000]   6 disabled
[    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
[    0.000000] original variable MTRRs
[    0.000000] reg 0, base: 0GB, range: 32GB, type WB
[    0.000000] reg 1, base: 3584MB, range: 512MB, type UC
[    0.000000] total RAM covered: 32256M
[    0.000000] Found optimal setting for mtrr clean up
[    0.000000]  gran_size: 64K 	chunk_size: 1G 	num_reg: 5  	lose cover RAM: 0G
[    0.000000] New variable MTRRs
[    0.000000] reg 0, base: 0GB, range: 4GB, type WB
[    0.000000] reg 1, base: 3584MB, range: 512MB, type UC
[    0.000000] reg 2, base: 4GB, range: 4GB, type WB
[    0.000000] reg 3, base: 8GB, range: 8GB, type WB
[    0.000000] reg 4, base: 16GB, range: 16GB, type WB
[    0.000000] e820: update [mem 0xe0000000-0xffffffff] usable ==> reserved
[    0.000000] e820: last_pfn = 0xdf451 max_arch_pfn = 0x400000000
[    0.000000] Scanning 1 areas for low memory corruption
[    0.000000] Base memory trampoline at [ffff880000099000] 99000 size 24576
[    0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[    0.000000]  [mem 0x00000000-0x000fffff] page 4k
[    0.000000] BRK [0x01fe9000, 0x01fe9fff] PGTABLE
[    0.000000] BRK [0x01fea000, 0x01feafff] PGTABLE
[    0.000000] BRK [0x01feb000, 0x01febfff] PGTABLE
[    0.000000] init_memory_mapping: [mem 0x21fe00000-0x21fffffff]
[    0.000000]  [mem 0x21fe00000-0x21fffffff] page 2M
[    0.000000] BRK [0x01fec000, 0x01fecfff] PGTABLE
[    0.000000] init_memory_mapping: [mem 0x21c000000-0x21fdfffff]
[    0.000000]  [mem 0x21c000000-0x21fdfffff] page 2M
[    0.000000] init_memory_mapping: [mem 0x200000000-0x21bffffff]
[    0.000000]  [mem 0x200000000-0x21bffffff] page 2M
[    0.000000] init_memory_mapping: [mem 0x00100000-0xdf450fff]
[    0.000000]  [mem 0x00100000-0x001fffff] page 4k
[    0.000000]  [mem 0x00200000-0xdf3fffff] page 2M
[    0.000000]  [mem 0xdf400000-0xdf450fff] page 4k
[    0.000000] init_memory_mapping: [mem 0x100000000-0x1ffffffff]
[    0.000000]  [mem 0x100000000-0x1ffffffff] page 2M
[    0.000000] BRK [0x01fed000, 0x01fedfff] PGTABLE
[    0.000000] BRK [0x01fee000, 0x01feefff] PGTABLE
[    0.000000] RAMDISK: [mem 0x34a32000-0x36510fff]
[    0.000000] ACPI: RSDP 0x00000000000FB9B0 000024 (v02 DELL  )
[    0.000000] ACPI: XSDT 0x00000000DF454600 00006C (v01 DELL   M09      27D90A1E ASL  00000061)
[    0.000000] ACPI: FACP 0x00000000DF45449C 0000F4 (v04 DELL   M09      27D90A1E ASL  00000061)
[    0.000000] ACPI BIOS Warning (bug): 32/64X length mismatch in FADT/Gpe0Block: 128/64 (20140214/tbfadt-603)
[    0.000000] ACPI: DSDT 0x00000000DF454C00 005E58 (v02 INT430 SYSFexxx 00001001 INTL 20050624)
[    0.000000] ACPI: FACS 0x00000000DF463400 000040
[    0.000000] ACPI: HPET 0x00000000DF454700 000038 (v01 DELL   M09      00000001 ASL  00000061)
[    0.000000] ACPI: DMAR 0x00000000DF462C00 0000B0 (v01 DELL   M09      27D90A1E ASL  00000061)
[    0.000000] ACPI: APIC 0x00000000DF454800 000078 (v01 DELL   M09      27D90A1E ASL  00000047)
[    0.000000] ACPI: ASF! 0x00000000DF454400 00006A (v32 DELL   M09      27D90A1E ASL  00000061)
[    0.000000] ACPI: MCFG 0x00000000DF4547C0 00003E (v16 DELL   M09      27D90A1E ASL  00000061)
[    0.000000] ACPI: TCPA 0x00000000DF454B00 000032 (v01                 00000000 ASL  00000000)
[    0.000000] ACPI: SLIC 0x00000000DF45489C 000176 (v01 DELL   M09      27D90A1E ASL  00000061)
[    0.000000] ACPI: SSDT 0x00000000DF452AEB 00066C (v01 PmRef  CpuPm    00003000 INTL 20050624)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000021fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00000000-0x21fffffff]
[    0.000000]   NODE_DATA [mem 0x21fff5000-0x21fff9fff]
[    0.000000] Reserving 128MB of memory at 704MB for crashkernel (System RAM: 8179MB)
[    0.000000]  [ffffea0000000000-ffffea00087fffff] PMD -> [ffff880217600000-ffff88021f5fffff] on node 0
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x21fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0009efff]
[    0.000000]   node   0: [mem 0x00100000-0xdf450fff]
[    0.000000]   node   0: [mem 0x100000000-0x21fffffff]
[    0.000000] On node 0 totalpages: 2094063
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 21 pages reserved
[    0.000000]   DMA zone: 3998 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 14226 pages used for memmap
[    0.000000]   DMA32 zone: 910417 pages, LIFO batch:31
[    0.000000]   Normal zone: 18432 pages used for memmap
[    0.000000]   Normal zone: 1179648 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x1008
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ2 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.000000] smpboot: Allowing 4 CPUs, 2 hotplug CPUs
[    0.000000] nr_irqs_gsi: 40
[    0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xdf451000-0xdf451fff]
[    0.000000] PM: Registered nosave memory: [mem 0xdf452000-0xdfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xe0000000-0xf7ffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xf8000000-0xfbffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfc000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec0ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec10000-0xfed17fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed18000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfed8ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed90000-0xfed9ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfeda0000-0xfeda5fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfeda6000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee0ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee10000-0xffe5ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffe60000-0xffffffff]
[    0.000000] e820: [mem 0xe0000000-0xf7ffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:4 nr_node_ids:1
[    0.000000] PERCPU: Embedded 29 pages/cpu @ffff88021fc00000 s86592 r8192 d24000 u524288
[    0.000000] pcpu-alloc: s86592 r8192 d24000 u524288 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 0 1 2 3 
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 2061320
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/vmlinuz-3.15.0-rc8-gutschke root=/dev/mapper/ubuntu--vg-root ro quiet splash crashkernel=384M-:128M
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] xsave: enabled xstate_bv 0x3, cntxt size 0x240
[    0.000000] Checking aperture...
[    0.000000] No AGP bridge found
[    0.000000] Calgary: detecting Calgary via BIOS EBDA area
[    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.000000] Memory: 8003384K/8376252K available (7460K kernel code, 1181K rwdata, 3552K rodata, 1340K init, 1440K bss, 372868K reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU dyntick-idle grace-period acceleration is enabled.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4.
[    0.000000] 	Offload RCU callbacks from all CPUs
[    0.000000] 	Offload RCU callbacks from CPUs: 0-3.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[    0.000000] NR_IRQS:16640 nr_irqs:712 16
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] allocated 33554432 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] hpet clockevent registered
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2660.211 MHz processor
[    0.004013] Calibrating delay loop (skipped), value calculated using timer frequency.. 5320.42 BogoMIPS (lpj=10640844)
[    0.004017] pid_max: default: 32768 minimum: 301
[    0.004028] ACPI: Core revision 20140214
[    0.008961] ACPI: All ACPI Tables successfully acquired
[    0.012026] Security Framework initialized
[    0.012046] AppArmor: AppArmor initialized
[    0.012047] Yama: becoming mindful.
[    0.012738] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[    0.016902] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.018855] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes)
[    0.018867] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes)
[    0.019225] Initializing cgroup subsys memory
[    0.019234] Initializing cgroup subsys devices
[    0.019237] Initializing cgroup subsys freezer
[    0.019239] Initializing cgroup subsys net_cls
[    0.019241] Initializing cgroup subsys blkio
[    0.019243] Initializing cgroup subsys perf_event
[    0.019245] Initializing cgroup subsys net_prio
[    0.019246] Initializing cgroup subsys hugetlb
[    0.019268] CPU: Physical Processor ID: 0
[    0.019269] CPU: Processor Core ID: 0
[    0.019272] mce: CPU supports 6 MCE banks
[    0.019279] CPU0: Thermal monitoring enabled (TM2)
[    0.019287] Last level iTLB entries: 4KB 128, 2MB 4, 4MB 4
[    0.019287] Last level dTLB entries: 4KB 256, 2MB 0, 4MB 32, 1GB 0
[    0.019287] tlb_flushall_shift: -1
[    0.019381] Freeing SMP alternatives memory: 28K (ffffffff81e78000 - ffffffff81e7f000)
[    0.020793] ftrace: allocating 28891 entries in 113 pages
[    0.028084] dmar: Host address width 36
[    0.028087] dmar: DRHD base: 0x000000fed10000 flags: 0x0
[    0.028092] dmar: IOMMU 0: reg_base_addr fed10000 ver 1:0 cap c9008020e30260 ecap 1000
[    0.028094] dmar: DRHD base: 0x000000fed13000 flags: 0x1
[    0.028098] dmar: IOMMU 1: reg_base_addr fed13000 ver 1:0 cap c9008020630260 ecap 1000
[    0.028099] dmar: RMRR base: 0x000000dfbe7000 end: 0x000000dfbfffff
[    0.028612] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.070362] smpboot: CPU0: Intel(R) Core(TM)2 Duo CPU     T9550  @ 2.66GHz (fam: 06, model: 17, stepping: 0a)
[    0.072000] Performance Events: PEBS fmt0+, 4-deep LBR, Core2 events, Intel PMU driver.
[    0.072000] ... version:                2
[    0.072000] ... bit width:              40
[    0.072000] ... generic registers:      2
[    0.072000] ... value mask:             000000ffffffffff
[    0.072000] ... max period:             000000007fffffff
[    0.072000] ... fixed-purpose events:   3
[    0.072000] ... event mask:             0000000700000003
[    0.072000] x86: Booting SMP configuration:
[    0.072000] .... node  #0, CPUs:      #1
[    0.083081] x86: Booted up 1 node, 2 CPUs
[    0.083084] smpboot: Total of 2 processors activated (10640.84 BogoMIPS)
[    0.083190] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[    0.084117] devtmpfs: initialized
[    0.091481] evm: security.selinux
[    0.091483] evm: security.SMACK64
[    0.091484] evm: security.ima
[    0.091485] evm: security.capability
[    0.092533] pinctrl core: initialized pinctrl subsystem
[    0.092620] regulator-dummy: no parameters
[    0.092656] RTC time: 10:07:10, date: 08/09/14
[    0.092698] NET: Registered protocol family 16
[    0.092839] cpuidle: using governor ladder
[    0.092840] cpuidle: using governor menu
[    0.092874] ACPI: bus type PCI registered
[    0.092876] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.092937] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xf8000000-0xfbffffff] (base 0xf8000000)
[    0.092939] PCI: MMCONFIG at [mem 0xf8000000-0xfbffffff] reserved in E820
[    0.096536] PCI: Using configuration type 1 for base access
[    0.096543] dmi type 0xB1 record - unknown flag
[    0.100079] ACPI: Added _OSI(Module Device)
[    0.100081] ACPI: Added _OSI(Processor Device)
[    0.100083] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.100084] ACPI: Added _OSI(Processor Aggregator Device)
[    0.102393] [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored
[    0.109163] ACPI: SSDT 0x00000000DF453157 0002C3 (v01 PmRef  BspIst   00003000 INTL 20050624)
[    0.109370] ACPI: Dynamic OEM Table Load:
[    0.109372] ACPI: SSDT 0x0000000000000000 0002C3 (v01 PmRef  BspIst   00003000 INTL 20050624)
[    0.109456] ACPI: SSDT 0x00000000DF4535F1 0005C6 (v01 PmRef  BspCst   00003001 INTL 20050624)
[    0.109725] ACPI: Dynamic OEM Table Load:
[    0.109727] ACPI: SSDT 0x0000000000000000 0005C6 (v01 PmRef  BspCst   00003001 INTL 20050624)
[    0.109907] ACPI: SSDT 0x00000000DF45341A 0001D7 (v01 PmRef  ApIst    00003000 INTL 20050624)
[    0.110120] ACPI: Dynamic OEM Table Load:
[    0.110122] ACPI: SSDT 0x0000000000000000 0001D7 (v01 PmRef  ApIst    00003000 INTL 20050624)
[    0.110174] ACPI: SSDT 0x00000000DF453BB7 00008D (v01 PmRef  ApCst    00003000 INTL 20050624)
[    0.110182] ACPI: Dynamic OEM Table Load:
[    0.110182] ACPI: SSDT 0x0000000000000000 00008D (v01 PmRef  ApCst    00003000 INTL 20050624)
[    0.112078] ACPI: Interpreter enabled
[    0.112078] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20140214/hwxface-580)
[    0.112078] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20140214/hwxface-580)
[    0.112087] ACPI: (supports S0 S3 S4 S5)
[    0.112089] ACPI: Using IOAPIC for interrupt routing
[    0.112109] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.228123] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.228129] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.228133] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.251178] acpi PNP0A03:00: [Firmware Info]: MMCONFIG for domain 0000 [bus 00-3f] only partially covers this bridge
[    0.251333] PCI host bridge to bus 0000:00
[    0.251336] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.251338] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7]
[    0.251339] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff]
[    0.251341] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
[    0.251343] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000dffff]
[    0.251345] pci_bus 0000:00: root bus resource [mem 0xe0000000-0xf7ffffff]
[    0.251347] pci_bus 0000:00: root bus resource [mem 0xfc000000-0xfebfffff]
[    0.251349] pci_bus 0000:00: root bus resource [mem 0xfec10000-0xfecfffff]
[    0.251351] pci_bus 0000:00: root bus resource [mem 0xfed1c000-0xfed1ffff]
[    0.251352] pci_bus 0000:00: root bus resource [mem 0xfed90000-0xfed9ffff]
[    0.251354] pci_bus 0000:00: root bus resource [mem 0xfed40000-0xfed44fff]
[    0.251356] pci_bus 0000:00: root bus resource [mem 0xfeda7000-0xfedfffff]
[    0.251358] pci_bus 0000:00: root bus resource [mem 0xfee10000-0xff9fffff]
[    0.251360] pci_bus 0000:00: root bus resource [mem 0xffc00000-0xffdfffff]
[    0.251368] pci 0000:00:00.0: [8086:2a40] type 00 class 0x060000
[    0.251387] DMAR: Forcing write-buffer flush capability
[    0.251388] DMAR: Disabling IOMMU for graphics on this chipset
[    0.251466] pci 0000:00:01.0: [8086:2a41] type 01 class 0x060400
[    0.251505] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    0.251619] pci 0000:00:19.0: [8086:10f5] type 00 class 0x020000
[    0.251645] pci 0000:00:19.0: reg 0x10: [mem 0xf6fe0000-0xf6ffffff]
[    0.251655] pci 0000:00:19.0: reg 0x14: [mem 0xf6fdb000-0xf6fdbfff]
[    0.251666] pci 0000:00:19.0: reg 0x18: [io  0xefe0-0xefff]
[    0.251753] pci 0000:00:19.0: PME# supported from D0 D3hot D3cold
[    0.251837] pci 0000:00:1a.0: [8086:2937] type 00 class 0x0c0300
[    0.251892] pci 0000:00:1a.0: reg 0x20: [io  0x6f60-0x6f7f]
[    0.255866] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    0.255914] pci 0000:00:1a.1: [8086:2938] type 00 class 0x0c0300
[    0.255969] pci 0000:00:1a.1: reg 0x20: [io  0x6f80-0x6f9f]
[    0.259894] pci 0000:00:1a.1: System wakeup disabled by ACPI
[    0.259943] pci 0000:00:1a.2: [8086:2939] type 00 class 0x0c0300
[    0.259998] pci 0000:00:1a.2: reg 0x20: [io  0x6fa0-0x6fbf]
[    0.264037] pci 0000:00:1a.2: System wakeup disabled by ACPI
[    0.264098] pci 0000:00:1a.7: [8086:293c] type 00 class 0x0c0320
[    0.264123] pci 0000:00:1a.7: reg 0x10: [mem 0xfed1c400-0xfed1c7ff]
[    0.264230] pci 0000:00:1a.7: PME# supported from D0 D3hot D3cold
[    0.268053] pci 0000:00:1a.7: System wakeup disabled by ACPI
[    0.268112] pci 0000:00:1b.0: [8086:293e] type 00 class 0x040300
[    0.268133] pci 0000:00:1b.0: reg 0x10: [mem 0xf6fdc000-0xf6fdffff 64bit]
[    0.268236] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
[    0.268280] pci 0000:00:1b.0: System wakeup disabled by ACPI
[    0.268328] pci 0000:00:1c.0: [8086:2940] type 01 class 0x060400
[    0.268435] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    0.268481] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    0.268530] pci 0000:00:1c.2: [8086:2944] type 01 class 0x060400
[    0.268636] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold
[    0.268682] pci 0000:00:1c.2: System wakeup disabled by ACPI
[    0.268729] pci 0000:00:1c.3: [8086:2946] type 01 class 0x060400
[    0.268834] pci 0000:00:1c.3: PME# supported from D0 D3hot D3cold
[    0.268880] pci 0000:00:1c.3: System wakeup disabled by ACPI
[    0.268931] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300
[    0.268987] pci 0000:00:1d.0: reg 0x20: [io  0x6f00-0x6f1f]
[    0.272474] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    0.272522] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300
[    0.272577] pci 0000:00:1d.1: reg 0x20: [io  0x6f20-0x6f3f]
[    0.280474] pci 0000:00:1d.1: System wakeup disabled by ACPI
[    0.280522] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300
[    0.280577] pci 0000:00:1d.2: reg 0x20: [io  0x6f40-0x6f5f]
[    0.282834] pci 0000:00:1d.2: System wakeup disabled by ACPI
[    0.282834] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320
[    0.282834] pci 0000:00:1d.7: reg 0x10: [mem 0xfed1c000-0xfed1c3ff]
[    0.282834] pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
[    0.286079] pci 0000:00:1d.7: System wakeup disabled by ACPI
[    0.286127] pci 0000:00:1e.0: [8086:2448] type 01 class 0x060401
[    0.286230] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    0.286280] pci 0000:00:1f.0: [8086:2917] type 00 class 0x060100
[    0.286494] pci 0000:00:1f.2: [8086:2929] type 00 class 0x010601
[    0.286521] pci 0000:00:1f.2: reg 0x10: [io  0x6e70-0x6e77]
[    0.286532] pci 0000:00:1f.2: reg 0x14: [io  0x6e78-0x6e7b]
[    0.286543] pci 0000:00:1f.2: reg 0x18: [io  0x6e80-0x6e87]
[    0.286554] pci 0000:00:1f.2: reg 0x1c: [io  0x6e88-0x6e8b]
[    0.286565] pci 0000:00:1f.2: reg 0x20: [io  0x6ea0-0x6ebf]
[    0.286576] pci 0000:00:1f.2: reg 0x24: [mem 0xfed1c800-0xfed1cfff]
[    0.286643] pci 0000:00:1f.2: PME# supported from D3hot
[    0.286725] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500
[    0.286746] pci 0000:00:1f.3: reg 0x10: [mem 0xf6fdaf00-0xf6fdafff 64bit]
[    0.286775] pci 0000:00:1f.3: reg 0x20: [io  0x1100-0x111f]
[    0.286948] pci 0000:01:00.0: [10de:065c] type 00 class 0x030000
[    0.286982] pci 0000:01:00.0: reg 0x10: [mem 0xf5000000-0xf5ffffff]
[    0.287003] pci 0000:01:00.0: reg 0x14: [mem 0xe0000000-0xefffffff 64bit pref]
[    0.287024] pci 0000:01:00.0: reg 0x1c: [mem 0xf2000000-0xf3ffffff 64bit]
[    0.287040] pci 0000:01:00.0: reg 0x24: [io  0xdf00-0xdf7f]
[    0.287063] pci 0000:01:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    0.287267] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.287270] pci 0000:00:01.0:   bridge window [io  0xd000-0xdfff]
[    0.287273] pci 0000:00:01.0:   bridge window [mem 0xf2000000-0xf6efffff]
[    0.287277] pci 0000:00:01.0:   bridge window [mem 0xe0000000-0xefffffff 64bit pref]
[    0.287383] pci 0000:0b:00.0: [168c:002a] type 00 class 0x028000
[    0.287416] pci 0000:0b:00.0: reg 0x10: [mem 0xf1ff0000-0xf1ffffff 64bit]
[    0.287591] pci 0000:0b:00.0: supports D1
[    0.287592] pci 0000:0b:00.0: PME# supported from D0 D1 D3hot
[    0.287667] pci 0000:0b:00.0: disabling ASPM on pre-1.1 PCIe device.  You can enable it with 'pcie_aspm=force'
[    0.287680] pci 0000:00:1c.0: PCI bridge to [bus 0b]
[    0.287687] pci 0000:00:1c.0:   bridge window [mem 0xf1f00000-0xf1ffffff]
[    0.287770] pci 0000:00:1c.2: PCI bridge to [bus 0c]
[    0.287872] acpiphp: Slot [1] registered
[    0.287878] pci 0000:00:1c.3: PCI bridge to [bus 0d-0e]
[    0.287882] pci 0000:00:1c.3:   bridge window [io  0xc000-0xcfff]
[    0.287887] pci 0000:00:1c.3:   bridge window [mem 0xf1c00000-0xf1efffff]
[    0.287894] pci 0000:00:1c.3:   bridge window [mem 0xf0000000-0xf01fffff 64bit pref]
[    0.287962] pci 0000:03:01.0: [1180:0476] type 02 class 0x060700
[    0.287981] pci 0000:03:01.0: proprietary Ricoh MMC controller disabled (via cardbus function)
[    0.287982] pci 0000:03:01.0: MMC cards are now supported by standard SDHCI controller
[    0.287997] pci 0000:03:01.0: reg 0x10: [mem 0x00000000-0x00000fff]
[    0.288033] pci 0000:03:01.0: supports D1 D2
[    0.288035] pci 0000:03:01.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.288099] pci 0000:03:01.1: [1180:0832] type 00 class 0x0c0010
[    0.288120] pci 0000:03:01.1: reg 0x10: [mem 0xf1bff800-0xf1bfffff]
[    0.288210] pci 0000:03:01.1: supports D1 D2
[    0.288212] pci 0000:03:01.1: PME# supported from D0 D1 D2 D3hot D3cold
[    0.288271] pci 0000:03:01.2: [1180:0822] type 00 class 0x080501
[    0.288292] pci 0000:03:01.2: reg 0x10: [mem 0xf1bff600-0xf1bff6ff]
[    0.288381] pci 0000:03:01.2: supports D1 D2
[    0.288383] pci 0000:03:01.2: PME# supported from D0 D1 D2 D3hot D3cold
[    0.288487] pci 0000:00:1e.0: PCI bridge to [bus 03-04] (subtractive decode)
[    0.288495] pci 0000:00:1e.0:   bridge window [mem 0xf1b00000-0xf1bfffff]
[    0.288502] pci 0000:00:1e.0:   bridge window [io  0x0000-0x0cf7] (subtractive decode)
[    0.288504] pci 0000:00:1e.0:   bridge window [io  0x0d00-0xffff] (subtractive decode)
[    0.288506] pci 0000:00:1e.0:   bridge window [mem 0x000a0000-0x000bffff] (subtractive decode)
[    0.288508] pci 0000:00:1e.0:   bridge window [mem 0x000d0000-0x000dffff] (subtractive decode)
[    0.288510] pci 0000:00:1e.0:   bridge window [mem 0xe0000000-0xf7ffffff] (subtractive decode)
[    0.288512] pci 0000:00:1e.0:   bridge window [mem 0xfc000000-0xfebfffff] (subtractive decode)
[    0.288513] pci 0000:00:1e.0:   bridge window [mem 0xfec10000-0xfecfffff] (subtractive decode)
[    0.288516] pci 0000:00:1e.0:   bridge window [mem 0xfed1c000-0xfed1ffff] (subtractive decode)
[    0.288518] pci 0000:00:1e.0:   bridge window [mem 0xfed90000-0xfed9ffff] (subtractive decode)
[    0.288520] pci 0000:00:1e.0:   bridge window [mem 0xfed40000-0xfed44fff] (subtractive decode)
[    0.288522] pci 0000:00:1e.0:   bridge window [mem 0xfeda7000-0xfedfffff] (subtractive decode)
[    0.288524] pci 0000:00:1e.0:   bridge window [mem 0xfee10000-0xff9fffff] (subtractive decode)
[    0.288525] pci 0000:00:1e.0:   bridge window [mem 0xffc00000-0xffdfffff] (subtractive decode)
[    0.288579] pci 0000:03:01.0: max busn 07 is outside [bus 03-04]
[    0.288581] pci_bus 0000:04: busn_res: [bus 04] end is updated to 04
[    0.304101] ACPI: PCI Interrupt Link [LNKA] (IRQs 10 11) *3
[    0.304166] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 7) *4
[    0.304229] ACPI: PCI Interrupt Link [LNKC] (IRQs 10 11) *4
[    0.304293] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 7 *10 11)
[    0.304356] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 *10 11 12 14 15)
[    0.304422] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 *7 10 11 12 14 15)
[    0.304487] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 *11 12 14 15)
[    0.304545] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled.
[    0.307015] ACPI: Enabled 2 GPEs in block 00 to 3F
[    0.307037] ACPI : EC: GPE = 0x11, I/O: command/status = 0x934, data = 0x930
[    0.308026] vgaarb: device added: PCI:0000:01:00.0,decodes=io+mem,owns=io+mem,locks=none
[    0.308028] vgaarb: loaded
[    0.308029] vgaarb: bridge control possible 0000:01:00.0
[    0.308224] SCSI subsystem initialized
[    0.308234] libata version 3.00 loaded.
[    0.308234] ACPI: bus type USB registered
[    0.308234] usbcore: registered new interface driver usbfs
[    0.308234] usbcore: registered new interface driver hub
[    0.308234] usbcore: registered new device driver usb
[    0.308234] PCI: Using ACPI for IRQ routing
[    0.313289] PCI: pci_cache_line_size set to 64 bytes
[    0.313375] e820: reserve RAM buffer [mem 0x0009f000-0x0009ffff]
[    0.313377] e820: reserve RAM buffer [mem 0xdf451c00-0xdfffffff]
[    0.313481] NetLabel: Initializing
[    0.313483] NetLabel:  domain hash size = 128
[    0.313484] NetLabel:  protocols = UNLABELED CIPSOv4
[    0.313498] NetLabel:  unlabeled traffic allowed by default
[    0.313510] HPET: 4 timers in total, 0 timers will be used for per-cpu timer
[    0.313510] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0
[    0.313510] hpet0: 4 comparators, 64-bit 14.318180 MHz counter
[    0.314062] Switched to clocksource hpet
[    0.319228] AppArmor: AppArmor Filesystem Enabled
[    0.319264] pnp: PnP ACPI init
[    0.319283] ACPI: bus type PNP registered
[    0.319381] pnp 00:00: Plug and Play ACPI device, IDs PNP0f13 (active)
[    0.319418] pnp 00:01: Plug and Play ACPI device, IDs PNP0303 (active)
[    0.319459] pnp 00:02: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.319494] pnp 00:03: Plug and Play ACPI device, IDs PNP0800 (active)
[    0.319563] system 00:04: [io  0x0c80-0x0caf] has been reserved
[    0.319566] system 00:04: [io  0x0cc0-0x0cff] could not be reserved
[    0.319569] system 00:04: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.319583] pnp 00:05: [dma 4]
[    0.319606] pnp 00:05: Plug and Play ACPI device, IDs PNP0200 (active)
[    0.319643] pnp 00:06: Plug and Play ACPI device, IDs PNP0c04 (active)
[    0.319709] system 00:07: [mem 0xfed00000-0xfed003ff] has been reserved
[    0.319712] system 00:07: Plug and Play ACPI device, IDs PNP0103 PNP0c01 (active)
[    0.332097] system 00:08: [io  0x0cb0-0x0cbb] has been reserved
[    0.332100] system 00:08: [mem 0xfed40000-0xfed44fff] has been reserved
[    0.332103] system 00:08: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.334760] system 00:09: [io  0x0900-0x092f] has been reserved
[    0.334762] system 00:09: [io  0x0931-0x0933] has been reserved
[    0.334764] system 00:09: [io  0x0935-0x097f] has been reserved
[    0.334766] system 00:09: [io  0x04d0-0x04d1] has been reserved
[    0.334769] system 00:09: [io  0x1000-0x1005] has been reserved
[    0.334771] system 00:09: [io  0x1008-0x100f] has been reserved
[    0.334774] system 00:09: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.334827] system 00:0a: [io  0xf400-0xf4fe] has been reserved
[    0.334830] system 00:0a: [io  0x1006-0x1007] has been reserved
[    0.334832] system 00:0a: [io  0x100a-0x1059] could not be reserved
[    0.334834] system 00:0a: [io  0x1080-0x10bf] has been reserved
[    0.334836] system 00:0a: [io  0x1100-0x111f] has been reserved
[    0.334838] system 00:0a: [io  0x1010-0x102f] could not be reserved
[    0.334841] system 00:0a: [io  0x0809] has been reserved
[    0.334843] system 00:0a: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.349233] system 00:0b: [mem 0x00000000-0x0009efff] could not be reserved
[    0.349236] system 00:0b: [mem 0x0009f000-0x0009ffff] could not be reserved
[    0.349239] system 00:0b: [mem 0x000c0000-0x000cffff] could not be reserved
[    0.349241] system 00:0b: [mem 0x000e0000-0x000fffff] could not be reserved
[    0.349243] system 00:0b: [mem 0x00100000-0xdf451bff] could not be reserved
[    0.349245] system 00:0b: [mem 0xdf451c00-0xdfefffff] has been reserved
[    0.349247] system 00:0b: [mem 0xdff00000-0xdfffffff] has been reserved
[    0.349250] system 00:0b: [mem 0xffe00000-0xffffffff] could not be reserved
[    0.349252] system 00:0b: [mem 0xffa00000-0xffbfffff] has been reserved
[    0.349254] system 00:0b: [mem 0xfec00000-0xfec0ffff] could not be reserved
[    0.349256] system 00:0b: [mem 0xfee00000-0xfee0ffff] has been reserved
[    0.349259] system 00:0b: [mem 0xfed20000-0xfed3ffff] has been reserved
[    0.349261] system 00:0b: [mem 0xfed45000-0xfed8ffff] has been reserved
[    0.349263] system 00:0b: [mem 0xfeda0000-0xfeda3fff] has been reserved
[    0.349265] system 00:0b: [mem 0xfeda4000-0xfeda4fff] has been reserved
[    0.349267] system 00:0b: [mem 0xfeda5000-0xfeda5fff] has been reserved
[    0.349269] system 00:0b: [mem 0xfeda6000-0xfeda6fff] has been reserved
[    0.349272] system 00:0b: [mem 0xfed1c800-0xfed1cfff] has been reserved
[    0.349274] system 00:0b: [mem 0xfed18000-0xfed1bfff] has been reserved
[    0.349276] system 00:0b: [mem 0xf8000000-0xfbffffff] has been reserved
[    0.349279] system 00:0b: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.351302] pnp: PnP ACPI: found 12 devices
[    0.351304] ACPI: bus type PNP unregistered
[    0.358341] pci 0000:00:1c.0: bridge window [io  0x1000-0x0fff] to [bus 0b] add_size 1000
[    0.358345] pci 0000:00:1c.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 0b] add_size 200000
[    0.358355] pci 0000:00:1c.2: bridge window [io  0x1000-0x0fff] to [bus 0c] add_size 1000
[    0.358358] pci 0000:00:1c.2: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 0c] add_size 200000
[    0.358360] pci 0000:00:1c.2: bridge window [mem 0x00100000-0x000fffff] to [bus 0c] add_size 200000
[    0.358384] pci 0000:03:01.0: res[13]=[io  0x0100-0x00ff] get_res_add_size add_size 100
[    0.358386] pci 0000:03:01.0: res[14]=[io  0x0100-0x00ff] get_res_add_size add_size 100
[    0.358389] pci 0000:00:1e.0: bridge window [io  0x1000-0x0fff] to [bus 03-04] add_size 1000
[    0.358391] pci 0000:03:01.0: res[15]=[mem 0x04000000-0x03ffffff pref] get_res_add_size add_size 4000000
[    0.358394] pci 0000:00:1e.0: bridge window [mem 0x04000000-0x03ffffff pref] to [bus 03-04] add_size 4000000
[    0.358402] pci 0000:00:1e.0: res[15]=[mem 0x04000000-0x03ffffff pref] get_res_add_size add_size 4000000
[    0.358404] pci 0000:00:1c.0: res[15]=[mem 0x00100000-0x000fffff 64bit pref] get_res_add_size add_size 200000
[    0.358407] pci 0000:00:1c.2: res[14]=[mem 0x00100000-0x000fffff] get_res_add_size add_size 200000
[    0.358409] pci 0000:00:1c.2: res[15]=[mem 0x00100000-0x000fffff 64bit pref] get_res_add_size add_size 200000
[    0.358411] pci 0000:00:1c.0: res[13]=[io  0x1000-0x0fff] get_res_add_size add_size 1000
[    0.358413] pci 0000:00:1c.2: res[13]=[io  0x1000-0x0fff] get_res_add_size add_size 1000
[    0.358415] pci 0000:00:1e.0: res[13]=[io  0x1000-0x0fff] get_res_add_size add_size 1000
[    0.358423] pci 0000:00:1e.0: BAR 15: can't assign mem pref (size 0x4000000)
[    0.358429] pci 0000:00:1c.0: BAR 15: assigned [mem 0xf0200000-0xf03fffff 64bit pref]
[    0.358432] pci 0000:00:1c.2: BAR 14: assigned [mem 0xf0400000-0xf05fffff]
[    0.358437] pci 0000:00:1c.2: BAR 15: assigned [mem 0xf0600000-0xf07fffff 64bit pref]
[    0.358440] pci 0000:00:1c.0: BAR 13: assigned [io  0x2000-0x2fff]
[    0.358443] pci 0000:00:1c.2: BAR 13: assigned [io  0x3000-0x3fff]
[    0.358445] pci 0000:00:1e.0: BAR 13: assigned [io  0x4000-0x4fff]
[    0.358452] pci 0000:00:1e.0: BAR 15: can't assign mem pref (size 0x4000000)
[    0.358455] pci 0000:00:1c.2: BAR 14: assigned [mem 0xf0200000-0xf03fffff]
[    0.358460] pci 0000:00:1c.2: BAR 15: assigned [mem 0xf0400000-0xf05fffff 64bit pref]
[    0.358466] pci 0000:00:1c.0: BAR 15: assigned [mem 0xf0600000-0xf07fffff 64bit pref]
[    0.358469] pci 0000:01:00.0: BAR 6: assigned [mem 0xf4000000-0xf407ffff pref]
[    0.358472] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.358474] pci 0000:00:01.0:   bridge window [io  0xd000-0xdfff]
[    0.358477] pci 0000:00:01.0:   bridge window [mem 0xf2000000-0xf6efffff]
[    0.358480] pci 0000:00:01.0:   bridge window [mem 0xe0000000-0xefffffff 64bit pref]
[    0.358484] pci 0000:00:1c.0: PCI bridge to [bus 0b]
[    0.358487] pci 0000:00:1c.0:   bridge window [io  0x2000-0x2fff]
[    0.358492] pci 0000:00:1c.0:   bridge window [mem 0xf1f00000-0xf1ffffff]
[    0.358497] pci 0000:00:1c.0:   bridge window [mem 0xf0600000-0xf07fffff 64bit pref]
[    0.358504] pci 0000:00:1c.2: PCI bridge to [bus 0c]
[    0.358507] pci 0000:00:1c.2:   bridge window [io  0x3000-0x3fff]
[    0.358512] pci 0000:00:1c.2:   bridge window [mem 0xf0200000-0xf03fffff]
[    0.358517] pci 0000:00:1c.2:   bridge window [mem 0xf0400000-0xf05fffff 64bit pref]
[    0.358524] pci 0000:00:1c.3: PCI bridge to [bus 0d-0e]
[    0.358527] pci 0000:00:1c.3:   bridge window [io  0xc000-0xcfff]
[    0.358532] pci 0000:00:1c.3:   bridge window [mem 0xf1c00000-0xf1efffff]
[    0.358537] pci 0000:00:1c.3:   bridge window [mem 0xf0000000-0xf01fffff 64bit pref]
[    0.358545] pci 0000:03:01.0: res[15]=[mem 0x04000000-0x03ffffff pref] get_res_add_size add_size 4000000
[    0.358547] pci 0000:03:01.0: res[16]=[mem 0x04000000-0x03ffffff] get_res_add_size add_size 4000000
[    0.358549] pci 0000:03:01.0: res[13]=[io  0x0100-0x00ff] get_res_add_size add_size 100
[    0.358551] pci 0000:03:01.0: res[14]=[io  0x0100-0x00ff] get_res_add_size add_size 100
[    0.358555] pci 0000:03:01.0: BAR 0: assigned [mem 0xfc000000-0xfc000fff]
[    0.358565] pci 0000:03:01.0: BAR 15: can't assign mem pref (size 0x4000000)
[    0.358573] pci 0000:03:01.0: BAR 16: can't assign mem (size 0x4000000)
[    0.358575] pci 0000:03:01.0: BAR 13: assigned [io  0x4000-0x40ff]
[    0.358577] pci 0000:03:01.0: BAR 14: assigned [io  0x4400-0x44ff]
[    0.358581] pci 0000:03:01.0: BAR 0: assigned [mem 0xfc000000-0xfc000fff]
[    0.358591] pci 0000:03:01.0: BAR 16: can't assign mem (size 0x4000000)
[    0.358599] pci 0000:03:01.0: BAR 15: can't assign mem pref (size 0x4000000)
[    0.358601] pci 0000:03:01.0: CardBus bridge to [bus 04]
[    0.358602] pci 0000:03:01.0:   bridge window [io  0x4000-0x40ff]
[    0.358607] pci 0000:03:01.0:   bridge window [io  0x4400-0x44ff]
[    0.358611] pci 0000:00:1e.0: PCI bridge to [bus 03-04]
[    0.358614] pci 0000:00:1e.0:   bridge window [io  0x4000-0x4fff]
[    0.358620] pci 0000:00:1e.0:   bridge window [mem 0xf1b00000-0xf1bfffff]
[    0.358630] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7]
[    0.358632] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff]
[    0.358634] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff]
[    0.358636] pci_bus 0000:00: resource 7 [mem 0x000d0000-0x000dffff]
[    0.358638] pci_bus 0000:00: resource 8 [mem 0xe0000000-0xf7ffffff]
[    0.358640] pci_bus 0000:00: resource 9 [mem 0xfc000000-0xfebfffff]
[    0.358641] pci_bus 0000:00: resource 10 [mem 0xfec10000-0xfecfffff]
[    0.358643] pci_bus 0000:00: resource 11 [mem 0xfed1c000-0xfed1ffff]
[    0.358645] pci_bus 0000:00: resource 12 [mem 0xfed90000-0xfed9ffff]
[    0.358647] pci_bus 0000:00: resource 13 [mem 0xfed40000-0xfed44fff]
[    0.358648] pci_bus 0000:00: resource 14 [mem 0xfeda7000-0xfedfffff]
[    0.358650] pci_bus 0000:00: resource 15 [mem 0xfee10000-0xff9fffff]
[    0.358652] pci_bus 0000:00: resource 16 [mem 0xffc00000-0xffdfffff]
[    0.358654] pci_bus 0000:01: resource 0 [io  0xd000-0xdfff]
[    0.358656] pci_bus 0000:01: resource 1 [mem 0xf2000000-0xf6efffff]
[    0.358657] pci_bus 0000:01: resource 2 [mem 0xe0000000-0xefffffff 64bit pref]
[    0.358659] pci_bus 0000:0b: resource 0 [io  0x2000-0x2fff]
[    0.358661] pci_bus 0000:0b: resource 1 [mem 0xf1f00000-0xf1ffffff]
[    0.358663] pci_bus 0000:0b: resource 2 [mem 0xf0600000-0xf07fffff 64bit pref]
[    0.358665] pci_bus 0000:0c: resource 0 [io  0x3000-0x3fff]
[    0.358667] pci_bus 0000:0c: resource 1 [mem 0xf0200000-0xf03fffff]
[    0.358669] pci_bus 0000:0c: resource 2 [mem 0xf0400000-0xf05fffff 64bit pref]
[    0.358671] pci_bus 0000:0d: resource 0 [io  0xc000-0xcfff]
[    0.358672] pci_bus 0000:0d: resource 1 [mem 0xf1c00000-0xf1efffff]
[    0.358674] pci_bus 0000:0d: resource 2 [mem 0xf0000000-0xf01fffff 64bit pref]
[    0.358676] pci_bus 0000:03: resource 0 [io  0x4000-0x4fff]
[    0.358678] pci_bus 0000:03: resource 1 [mem 0xf1b00000-0xf1bfffff]
[    0.358680] pci_bus 0000:03: resource 4 [io  0x0000-0x0cf7]
[    0.358682] pci_bus 0000:03: resource 5 [io  0x0d00-0xffff]
[    0.358684] pci_bus 0000:03: resource 6 [mem 0x000a0000-0x000bffff]
[    0.358686] pci_bus 0000:03: resource 7 [mem 0x000d0000-0x000dffff]
[    0.358687] pci_bus 0000:03: resource 8 [mem 0xe0000000-0xf7ffffff]
[    0.358689] pci_bus 0000:03: resource 9 [mem 0xfc000000-0xfebfffff]
[    0.358691] pci_bus 0000:03: resource 10 [mem 0xfec10000-0xfecfffff]
[    0.358693] pci_bus 0000:03: resource 11 [mem 0xfed1c000-0xfed1ffff]
[    0.358695] pci_bus 0000:03: resource 12 [mem 0xfed90000-0xfed9ffff]
[    0.358696] pci_bus 0000:03: resource 13 [mem 0xfed40000-0xfed44fff]
[    0.358698] pci_bus 0000:03: resource 14 [mem 0xfeda7000-0xfedfffff]
[    0.358700] pci_bus 0000:03: resource 15 [mem 0xfee10000-0xff9fffff]
[    0.358702] pci_bus 0000:03: resource 16 [mem 0xffc00000-0xffdfffff]
[    0.358704] pci_bus 0000:04: resource 0 [io  0x4000-0x40ff]
[    0.358705] pci_bus 0000:04: resource 1 [io  0x4400-0x44ff]
[    0.358733] NET: Registered protocol family 2
[    0.358922] TCP established hash table entries: 65536 (order: 7, 524288 bytes)
[    0.359212] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.359634] TCP: Hash tables configured (established 65536 bind 65536)
[    0.359679] TCP: reno registered
[    0.359691] UDP hash table entries: 4096 (order: 5, 131072 bytes)
[    0.359755] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes)
[    0.359851] NET: Registered protocol family 1
[    0.361916] pci 0000:01:00.0: Boot video device
[    0.361937] PCI: CLS 64 bytes, default 64
[    0.361991] Trying to unpack rootfs image as initramfs...
[    0.830711] Freeing initrd memory: 27516K (ffff880034a32000 - ffff880036511000)
[    0.830828] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    0.830831] software IO TLB [mem 0xdb451000-0xdf451000] (64MB) mapped at [ffff8800db451000-ffff8800df450fff]
[    0.831023] microcode: CPU0 sig=0x1067a, pf=0x80, revision=0xa07
[    0.831030] microcode: CPU1 sig=0x1067a, pf=0x80, revision=0xa07
[    0.831114] microcode: Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    0.831133] Scanning for low memory corruption every 60 seconds
[    0.831427] futex hash table entries: 1024 (order: 4, 65536 bytes)
[    0.831465] Initialise system trusted keyring
[    0.831487] audit: initializing netlink subsys (disabled)
[    0.831512] audit: type=2000 audit(1407578830.828:1): initialized
[    0.858035] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    0.859899] zbud: loaded
[    0.860072] VFS: Disk quotas dquot_6.5.2
[    0.860117] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.860661] fuse init (API version 7.23)
[    0.860760] msgmni has been set to 15685
[    0.860820] Key type big_key registered
[    0.861230] Key type asymmetric registered
[    0.861232] Asymmetric key parser 'x509' registered
[    0.861271] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[    0.861307] io scheduler noop registered
[    0.861309] io scheduler deadline registered (default)
[    0.861345] io scheduler cfq registered
[    0.861429] pcieport 0000:00:01.0: device [8086:2a41] has invalid IRQ; check vendor BIOS
[    0.861617] pcieport 0000:00:01.0: irq 40 for MSI/MSI-X
[    0.861663] pcieport 0000:00:1c.0: device [8086:2940] has invalid IRQ; check vendor BIOS
[    0.861803] pcieport 0000:00:1c.0: irq 41 for MSI/MSI-X
[    0.861883] pcieport 0000:00:1c.2: device [8086:2944] has invalid IRQ; check vendor BIOS
[    0.862022] pcieport 0000:00:1c.2: irq 42 for MSI/MSI-X
[    0.862098] pcieport 0000:00:1c.3: device [8086:2946] has invalid IRQ; check vendor BIOS
[    0.862236] pcieport 0000:00:1c.3: irq 43 for MSI/MSI-X
[    0.862337] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    0.862353] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    0.862415] intel_idle: does not run on family 6 model 23
[    0.862423] ipmi message handler version 39.2
[    0.862538] ACPI: AC Adapter [AC] (on-line)
[    0.862647] input: Lid Switch as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0D:00/input/input0
[    0.864837] ACPI: Lid Switch [LID]
[    0.864884] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input1
[    0.864888] ACPI: Power Button [PBTN]
[    0.864931] input: Sleep Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0E:00/input/input2
[    0.864933] ACPI: Sleep Button [SBTN]
[    0.865056] Monitor-Mwait will be used to enter C-1 state
[    0.865070] Monitor-Mwait will be used to enter C-2 state
[    0.865084] Monitor-Mwait will be used to enter C-3 state
[    0.865094] tsc: Marking TSC unstable due to TSC halts in idle
[    0.865107] ACPI: acpi_idle registered with cpuidle
[    0.875222] thermal LNXTHERM:00: registered as thermal_zone0
[    0.875224] ACPI: Thermal Zone [THM] (63 C)
[    0.875252] GHES: HEST is not enabled!
[    0.875371] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    0.878059] hpet: probe of PNP0103:00 failed with error -22
[    0.878073] Linux agpgart interface v0.103
[    0.879905] brd: module loaded
[    0.880771] loop: module loaded
[    0.881210] libphy: Fixed MDIO Bus: probed
[    0.881326] tun: Universal TUN/TAP device driver, 1.6
[    0.881328] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
[    0.881377] PPP generic driver version 2.4.2
[    0.881429] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    0.881433] ehci-pci: EHCI PCI platform driver
[    0.881612] ehci-pci 0000:00:1a.7: EHCI Host Controller
[    0.881619] ehci-pci 0000:00:1a.7: new USB bus registered, assigned bus number 1
[    0.881634] ehci-pci 0000:00:1a.7: debug port 1
[    0.885582] ehci-pci 0000:00:1a.7: cache line size of 64 is not supported
[    0.885598] ehci-pci 0000:00:1a.7: irq 22, io mem 0xfed1c400
[    0.896222] ehci-pci 0000:00:1a.7: USB 2.0 started, EHCI 1.00
[    0.896296] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    0.896300] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.896303] usb usb1: Product: EHCI Host Controller
[    0.896306] usb usb1: Manufacturer: Linux 3.15.0-rc8-gutschke ehci_hcd
[    0.896309] usb usb1: SerialNumber: 0000:00:1a.7
[    0.896500] hub 1-0:1.0: USB hub found
[    0.896508] hub 1-0:1.0: 6 ports detected
[    0.897016] ehci-pci 0000:00:1d.7: EHCI Host Controller
[    0.897024] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2
[    0.897037] ehci-pci 0000:00:1d.7: debug port 1
[    0.900935] ehci-pci 0000:00:1d.7: cache line size of 64 is not supported
[    0.900955] ehci-pci 0000:00:1d.7: irq 20, io mem 0xfed1c000
[    0.912042] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00
[    0.912104] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    0.912108] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.912111] usb usb2: Product: EHCI Host Controller
[    0.912114] usb usb2: Manufacturer: Linux 3.15.0-rc8-gutschke ehci_hcd
[    0.912117] usb usb2: SerialNumber: 0000:00:1d.7
[    0.912280] hub 2-0:1.0: USB hub found
[    0.912287] hub 2-0:1.0: 6 ports detected
[    0.912696] ehci-platform: EHCI generic platform driver
[    0.912705] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    0.912708] ohci-pci: OHCI PCI platform driver
[    0.912719] ohci-platform: OHCI generic platform driver
[    0.912727] uhci_hcd: USB Universal Host Controller Interface driver
[    0.912868] uhci_hcd 0000:00:1a.0: UHCI Host Controller
[    0.912876] uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 3
[    0.912883] uhci_hcd 0000:00:1a.0: detected 2 ports
[    0.912904] uhci_hcd 0000:00:1a.0: irq 20, io base 0x00006f60
[    0.912955] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001
[    0.912957] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.912959] usb usb3: Product: UHCI Host Controller
[    0.912961] usb usb3: Manufacturer: Linux 3.15.0-rc8-gutschke uhci_hcd
[    0.912963] usb usb3: SerialNumber: 0000:00:1a.0
[    0.913102] hub 3-0:1.0: USB hub found
[    0.913109] hub 3-0:1.0: 2 ports detected
[    0.913358] uhci_hcd 0000:00:1a.1: UHCI Host Controller
[    0.913364] uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 4
[    0.913371] uhci_hcd 0000:00:1a.1: detected 2 ports
[    0.913399] uhci_hcd 0000:00:1a.1: irq 21, io base 0x00006f80
[    0.913447] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001
[    0.913449] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.913451] usb usb4: Product: UHCI Host Controller
[    0.913453] usb usb4: Manufacturer: Linux 3.15.0-rc8-gutschke uhci_hcd
[    0.913454] usb usb4: SerialNumber: 0000:00:1a.1
[    0.913596] hub 4-0:1.0: USB hub found
[    0.913605] hub 4-0:1.0: 2 ports detected
[    0.913841] uhci_hcd 0000:00:1a.2: UHCI Host Controller
[    0.913847] uhci_hcd 0000:00:1a.2: new USB bus registered, assigned bus number 5
[    0.913854] uhci_hcd 0000:00:1a.2: detected 2 ports
[    0.913874] uhci_hcd 0000:00:1a.2: irq 22, io base 0x00006fa0
[    0.913921] usb usb5: New USB device found, idVendor=1d6b, idProduct=0001
[    0.913924] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.913925] usb usb5: Product: UHCI Host Controller
[    0.913927] usb usb5: Manufacturer: Linux 3.15.0-rc8-gutschke uhci_hcd
[    0.913929] usb usb5: SerialNumber: 0000:00:1a.2
[    0.914074] hub 5-0:1.0: USB hub found
[    0.914081] hub 5-0:1.0: 2 ports detected
[    0.914330] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[    0.914369] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 6
[    0.914376] uhci_hcd 0000:00:1d.0: detected 2 ports
[    0.914395] uhci_hcd 0000:00:1d.0: irq 20, io base 0x00006f00
[    0.914443] usb usb6: New USB device found, idVendor=1d6b, idProduct=0001
[    0.914445] usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.914447] usb usb6: Product: UHCI Host Controller
[    0.914449] usb usb6: Manufacturer: Linux 3.15.0-rc8-gutschke uhci_hcd
[    0.914451] usb usb6: SerialNumber: 0000:00:1d.0
[    0.914650] hub 6-0:1.0: USB hub found
[    0.914657] hub 6-0:1.0: 2 ports detected
[    0.914897] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[    0.914902] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 7
[    0.914909] uhci_hcd 0000:00:1d.1: detected 2 ports
[    0.914929] uhci_hcd 0000:00:1d.1: irq 21, io base 0x00006f20
[    0.914978] usb usb7: New USB device found, idVendor=1d6b, idProduct=0001
[    0.914981] usb usb7: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.914982] usb usb7: Product: UHCI Host Controller
[    0.914984] usb usb7: Manufacturer: Linux 3.15.0-rc8-gutschke uhci_hcd
[    0.914986] usb usb7: SerialNumber: 0000:00:1d.1
[    0.915103] hub 7-0:1.0: USB hub found
[    0.915110] hub 7-0:1.0: 2 ports detected
[    0.915349] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[    0.915355] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 8
[    0.915361] uhci_hcd 0000:00:1d.2: detected 2 ports
[    0.915381] uhci_hcd 0000:00:1d.2: irq 22, io base 0x00006f40
[    0.915432] usb usb8: New USB device found, idVendor=1d6b, idProduct=0001
[    0.915434] usb usb8: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.915436] usb usb8: Product: UHCI Host Controller
[    0.915438] usb usb8: Manufacturer: Linux 3.15.0-rc8-gutschke uhci_hcd
[    0.915439] usb usb8: SerialNumber: 0000:00:1d.2
[    0.915565] hub 8-0:1.0: USB hub found
[    0.915574] hub 8-0:1.0: 2 ports detected
[    0.915754] usbcore: registered new interface driver usb-storage
[    0.915788] i8042: PNP: PS/2 Controller [PNP0303:KBC,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
[    0.916773] i8042: Warning: Keylock active
[    0.920313] serio: i8042 KBD port at 0x60,0x64 irq 1
[    0.920317] serio: i8042 AUX port at 0x60,0x64 irq 12
[    0.920514] mousedev: PS/2 mouse device common for all mice
[    0.920768] rtc_cmos 00:02: RTC can wake from S4
[    0.920913] rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0
[    0.920952] rtc_cmos 00:02: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[    0.920997] device-mapper: uevent: version 1.0.3
[    0.921086] device-mapper: ioctl: 4.27.0-ioctl (2013-10-30) initialised: dm-devel@redhat.com
[    0.921094] ledtrig-cpu: registered to indicate activity on CPUs
[    0.921173] TCP: cubic registered
[    0.921292] NET: Registered protocol family 10
[    0.921549] NET: Registered protocol family 17
[    0.921556] Key type dns_resolver registered
[    0.921816] Loading compiled-in X.509 certificates
[    0.922810] Loaded X.509 cert 'Magrathea: Glacier signing key: 1f7322863f9c67802852826209b2fed3e28297d7'
[    0.922829] registered taskstats version 1
[    0.924090] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input3
[    0.925322] Key type trusted registered
[    0.927228] Key type encrypted registered
[    0.929674] AppArmor: AppArmor sha1 policy hashing enabled
[    0.929677] ima: No TPM chip found, activating TPM-bypass!
[    0.930093]   Magic number: 10:810:122
[    0.930185] acpi LNXSYBUS:00: hash matches
[    0.930250] rtc_cmos 00:02: setting system clock to 2014-08-09 10:07:11 UTC (1407578831)
[    0.934477] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[    0.934479] EDD information not available.
[    0.934534] PM: Hibernation image not present or could not be loaded.
[    0.955379] ACPI: Battery Slot [BAT0] (battery present)
[    0.955419] ACPI: Battery Slot [BAT1] (battery absent)
[    0.956806] Freeing unused kernel memory: 1340K (ffffffff81d29000 - ffffffff81e78000)
[    0.956808] Write protecting the kernel read-only data: 12288k
[    0.958916] Freeing unused kernel memory: 720K (ffff88000174c000 - ffff880001800000)
[    0.960333] Freeing unused kernel memory: 544K (ffff880001b78000 - ffff880001c00000)
[    0.973126] systemd-udevd[108]: starting version 204
[    0.996704] pps_core: LinuxPPS API ver. 1 registered
[    0.996707] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.998038] PTP clock support registered
[    1.002431] e1000e: Intel(R) PRO/1000 Network Driver - 2.3.2-k
[    1.002433] e1000e: Copyright(c) 1999 - 2014 Intel Corporation.
[    1.002694] e1000e 0000:00:19.0: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode
[    1.002719] e1000e 0000:00:19.0: irq 44 for MSI/MSI-X
[    1.008302] ACPI: Video Device [VID] (multi-head: yes  rom: no  post: no)
[    1.035155] acpi device:37: registered as cooling_device2
[    1.035688] input: Video Bus as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A03:00/device:35/LNXVIDEO:00/input/input5
[    1.037556] sdhci: Secure Digital Host Controller Interface driver
[    1.037558] sdhci: Copyright(c) Pierre Ossman
[    1.039118] sdhci-pci 0000:03:01.2: SDHCI controller found [1180:0822] (rev 21)
[    1.040256] mmc0: no vqmmc regulator found
[    1.040258] mmc0: no vmmc regulator found
[    1.041336] mmc0: SDHCI controller on PCI [0000:03:01.2] using DMA
[    1.104081] firewire_ohci 0000:03:01.1: added OHCI v1.10 device as card 0, 4 IR + 4 IT contexts, quirks 0x11
[    1.191147] mmc0: new high speed SD card at address ef7c
[    1.193176] mmcblk0: mmc0:ef7c SD02G 1.83 GiB 
[    1.194077]  mmcblk0: p1
[    1.212410] e1000e 0000:00:19.0 eth0: (PCI Express:2.5GT/s:Width x1) 00:24:e8:c2:e8:0d
[    1.212413] e1000e 0000:00:19.0 eth0: Intel(R) PRO/1000 Network Connection
[    1.212463] e1000e 0000:00:19.0 eth0: MAC: 7, PHY: 8, PBA No: 5002FF-0FF
[    1.212489] ahci 0000:00:1f.2: version 3.0
[    1.212704] ahci 0000:00:1f.2: irq 45 for MSI/MSI-X
[    1.212744] ahci 0000:00:1f.2: SSS flag set, parallel bus scan disabled
[    1.212778] ahci 0000:00:1f.2: AHCI 0001.0200 32 slots 4 ports 3 Gbps 0x33 impl SATA mode
[    1.212781] ahci 0000:00:1f.2: flags: 64bit ncq sntf stag pm led clo pmp pio slum part ccc ems sxs 
[    1.236808] scsi0 : ahci
[    1.236965] scsi1 : ahci
[    1.237107] scsi2 : ahci
[    1.237212] scsi3 : ahci
[    1.237316] scsi4 : ahci
[    1.237433] scsi5 : ahci
[    1.237492] ata1: SATA max UDMA/133 abar m2048@0xfed1c800 port 0xfed1c900 irq 45
[    1.237495] ata2: SATA max UDMA/133 abar m2048@0xfed1c800 port 0xfed1c980 irq 45
[    1.237496] ata3: DUMMY
[    1.237498] ata4: DUMMY
[    1.237500] ata5: SATA max UDMA/133 abar m2048@0xfed1c800 port 0xfed1cb00 irq 45
[    1.237503] ata6: SATA max UDMA/133 abar m2048@0xfed1c800 port 0xfed1cb80 irq 45
[    1.468061] usb 1-6: new high-speed USB device number 3 using ehci-pci
[    1.604111] firewire_core 0000:03:01.1: created device fw0: GUID 464fc000145efa21, S400
[    1.676441] usb 1-6: New USB device found, idVendor=0c45, idProduct=63f1
[    1.676445] usb 1-6: New USB device strings: Mfr=2, Product=1, SerialNumber=0
[    1.676448] usb 1-6: Product: Integrated_Webcam_2M
[    1.676451] usb 1-6: Manufacturer: CN0K113P7248799C08PP
[    1.728226] ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    1.823362] ata1.00: ATA-9: ST1000LM014-1EJ164, SM14, max UDMA/133
[    1.823366] ata1.00: 1953525168 sectors, multi 8: LBA48 NCQ (depth 31/32), AA
[    1.867727] ata1.00: configured for UDMA/133
[    1.867826] scsi 0:0:0:0: Direct-Access     ATA      ST1000LM014-1EJ1 SM14 PQ: 0 ANSI: 5
[    1.868105] sd 0:0:0:0: Attached scsi generic sg0 type 0
[    1.868117] sd 0:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB)
[    1.868125] sd 0:0:0:0: [sda] 4096-byte physical blocks
[    1.868184] sd 0:0:0:0: [sda] Write Protect is off
[    1.868187] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    1.868205] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    1.886995]  sda: sda1 sda2 < sda5 >
[    1.887390] sd 0:0:0:0: [sda] Attached SCSI disk
[    1.916251] usb 5-1: new full-speed USB device number 2 using uhci_hcd
[    2.096941] usb 5-1: New USB device found, idVendor=0a5c, idProduct=5800
[    2.096945] usb 5-1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    2.096948] usb 5-1: Product: 5880
[    2.096951] usb 5-1: Manufacturer: Broadcom Corp
[    2.096954] usb 5-1: SerialNumber: 0123456789ABCD
[    2.097105] usb 5-1: config 0 descriptor??
[    2.355664] input: DualPoint Stick as /devices/platform/i8042/serio1/input/input7
[    2.364057] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    2.365134] ata2.00: ATA-8: ST750LX003-1AC154, SM12, max UDMA/133
[    2.365138] ata2.00: 1465149168 sectors, multi 8: LBA48 NCQ (depth 31/32)
[    2.367326] ata2.00: configured for UDMA/133
[    2.367464] scsi 1:0:0:0: Direct-Access     ATA      ST750LX003-1AC15 SM12 PQ: 0 ANSI: 5
[    2.367715] sd 1:0:0:0: Attached scsi generic sg1 type 0
[    2.367801] sd 1:0:0:0: [sdb] 1465149168 512-byte logical blocks: (750 GB/698 GiB)
[    2.367803] sd 1:0:0:0: [sdb] 4096-byte physical blocks
[    2.367946] sd 1:0:0:0: [sdb] Write Protect is off
[    2.367949] sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    2.367990] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.368665]  sdb: sdb1
[    2.368989] sd 1:0:0:0: [sdb] Attached SCSI disk
[    2.373296] input: AlpsPS/2 ALPS DualPoint TouchPad as /devices/platform/i8042/serio1/input/input6
[    2.684229] ata5: SATA link down (SStatus 0 SControl 300)
[    3.004227] ata6: SATA link down (SStatus 0 SControl 300)
[    3.087647] random: nonblocking pool is initialized
[    4.301796] EXT4-fs (mmcblk0p1): mounting ext3 file system using the ext4 subsystem
[    4.314390] EXT4-fs (mmcblk0p1): mounted filesystem with ordered data mode. Opts: (null)
[    6.572815] EXT4-fs (dm-1): INFO: recovery required on readonly filesystem
[    6.572818] EXT4-fs (dm-1): write access will be enabled during recovery
[    6.861465] EXT4-fs (dm-1): orphan cleanup on readonly fs
[    6.861617] EXT4-fs (dm-1): 8 orphan inodes deleted
[    6.861619] EXT4-fs (dm-1): recovery complete
[    6.879962] EXT4-fs (dm-1): mounted filesystem with ordered data mode. Opts: (null)
[   15.404926] Adding 8372220k swap on /dev/mapper/ubuntu--vg-swap_1.  Priority:-1 extents:1 across:8372220k FS
[   15.532086] EXT4-fs (dm-1): re-mounted. Opts: errors=remount-ro
[   15.561362] systemd-udevd[420]: starting version 204
[   15.773612] lp: driver loaded but no devices found
[   15.788949] wmi: Mapper loaded
[   15.793303] ppdev: user-space parallel port driver
[   15.811530] cfg80211: Calling CRDA to update world regulatory domain
[   15.812194] [drm] Initialized drm 1.1.0 20060810
[   15.876461] yenta_cardbus 0000:03:01.0: CardBus bridge found [1028:0250]
[   15.876494] yenta_cardbus 0000:03:01.0: CardBus bridge to [bus 04]
[   15.876496] yenta_cardbus 0000:03:01.0:   bridge window [io  0x4000-0x40ff]
[   15.876504] yenta_cardbus 0000:03:01.0:   bridge window [io  0x4400-0x44ff]
[   15.876509] yenta_cardbus 0000:03:01.0:   bridge window [mem 0xf0800000-0xf0bfffff]
[   15.876513] yenta_cardbus 0000:03:01.0:   bridge window [mem 0xf0c00000-0xf0ffffff]
[   16.008820] yenta_cardbus 0000:03:01.0: ISA IRQ mask 0x0cb8, PCI irq 19
[   16.008825] yenta_cardbus 0000:03:01.0: Socket status: 30000006
[   16.008831] yenta_cardbus 0000:03:01.0: pcmcia: parent PCI bridge window: [io  0x4000-0x4fff]
[   16.008833] yenta_cardbus 0000:03:01.0: pcmcia: parent PCI bridge window: [mem 0xf1b00000-0xf1bfffff]
[   16.008836] pcmcia_socket pcmcia_socket0: cs: memory probe 0xf1b00000-0xf1bfffff:
[   16.008843]  excluding 0xf1bf0000-0xf1bfffff
[   16.056935] audit: type=1400 audit(1407578846.624:2): apparmor="STATUS" operation="profile_load" name="/sbin/dhclient" pid=522 comm="apparmor_parser"
[   16.056941] audit: type=1400 audit(1407578846.624:3): apparmor="STATUS" operation="profile_load" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=522 comm="apparmor_parser"
[   16.056945] audit: type=1400 audit(1407578846.624:4): apparmor="STATUS" operation="profile_load" name="/usr/lib/connman/scripts/dhclient-script" pid=522 comm="apparmor_parser"
[   16.057472] audit: type=1400 audit(1407578846.624:5): apparmor="STATUS" operation="profile_replace" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=522 comm="apparmor_parser"
[   16.057477] audit: type=1400 audit(1407578846.624:6): apparmor="STATUS" operation="profile_replace" name="/usr/lib/connman/scripts/dhclient-script" pid=522 comm="apparmor_parser"
[   16.057661] audit: type=1400 audit(1407578846.624:7): apparmor="STATUS" operation="profile_replace" name="/usr/lib/connman/scripts/dhclient-script" pid=522 comm="apparmor_parser"
[   16.060613] audit: type=1400 audit(1407578846.628:8): apparmor="STATUS" operation="profile_load" name="/usr/sbin/ntpd" pid=523 comm="apparmor_parser"
[   16.062588] Linux video capture interface: v2.00
[   16.145345] uvcvideo: Found UVC 1.00 device Integrated_Webcam_2M (0c45:63f1)
[   16.172445] input: Integrated_Webcam_2M as /devices/pci0000:00/0000:00:1a.7/usb1/1-6/1-6:1.0/input/input8
[   16.173871] usbcore: registered new interface driver uvcvideo
[   16.173873] USB Video Class driver (1.1.1)
[   16.483571] input: Dell WMI hotkeys as /devices/virtual/input/input9
[   16.603944] ath: EEPROM regdomain: 0x6a
[   16.603947] ath: EEPROM indicates we should expect a direct regpair map
[   16.603949] ath: Country alpha2 being used: 00
[   16.603951] ath: Regpair used: 0x6a
[   16.617259] gpio_ich: GPIO from 195 to 255 on gpio_ich
[   16.630522] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)
[   16.637756] EXT4-fs (sda1): mounting ext2 file system using the ext4 subsystem
[   16.641527] pcmcia_socket pcmcia_socket0: cs: memory probe 0x0c0000-0x0fffff:
[   16.641536]  excluding 0xc0000-0xcffff 0xe0000-0xfffff
[   16.641559] pcmcia_socket pcmcia_socket0: cs: memory probe 0xa0000000-0xa0ffffff:
[   16.641571]  excluding 0xa0000000-0xa0ffffff
[   16.641585] pcmcia_socket pcmcia_socket0: cs: memory probe 0x60000000-0x60ffffff:
[   16.641597]  excluding 0x60000000-0x60ffffff
[   16.645996] cfg80211: World regulatory domain updated:
[   16.645999] cfg80211:  DFS Master region: unset
[   16.646001] cfg80211:   (start_freq - end_freq @ bandwidth), (max_antenna_gain, max_eirp), (dfs_cac_time)
[   16.646004] cfg80211:   (2402000 KHz - 2472000 KHz @ 40000 KHz), (300 mBi, 2000 mBm), (N/A)
[   16.646006] cfg80211:   (2457000 KHz - 2482000 KHz @ 40000 KHz), (300 mBi, 2000 mBm), (N/A)
[   16.646008] cfg80211:   (2474000 KHz - 2494000 KHz @ 20000 KHz), (300 mBi, 2000 mBm), (N/A)
[   16.646010] cfg80211:   (5170000 KHz - 5250000 KHz @ 40000 KHz), (300 mBi, 2000 mBm), (N/A)
[   16.646011] cfg80211:   (5735000 KHz - 5835000 KHz @ 40000 KHz), (300 mBi, 2000 mBm), (N/A)
[   16.662363] EXT4-fs (sda1): mounted filesystem without journal. Opts: (null)
[   16.912453] snd_hda_intel 0000:00:1b.0: irq 46 for MSI/MSI-X
[   16.955177] sound hdaudioC0D0: autoconfig: line_outs=1 (0xf/0x0/0x0/0x0/0x0) type:line
[   16.955181] sound hdaudioC0D0:    speaker_outs=1 (0xd/0x0/0x0/0x0/0x0)
[   16.955183] sound hdaudioC0D0:    hp_outs=1 (0xa/0x0/0x0/0x0/0x0)
[   16.955185] sound hdaudioC0D0:    mono: mono_out=0x0
[   16.955187] sound hdaudioC0D0:    inputs:
[   16.955189] sound hdaudioC0D0:      Dock Mic=0xe
[   16.955191] sound hdaudioC0D0:      Internal Mic=0x18
[   16.955192] sound hdaudioC0D0:      Mic=0xb
[   16.968912] input: HDA Intel Dock Mic as /devices/pci0000:00/0000:00:1b.0/sound/card0/input10
[   16.968990] input: HDA Intel Mic as /devices/pci0000:00/0000:00:1b.0/sound/card0/input11
[   16.969059] input: HDA Intel Dock Line Out as /devices/pci0000:00/0000:00:1b.0/sound/card0/input12
[   16.969127] input: HDA Intel Headphone as /devices/pci0000:00/0000:00:1b.0/sound/card0/input13
[   17.014461] ieee80211 phy0: Selected rate control algorithm 'minstrel_ht'
[   17.014819] ieee80211 phy0: Atheros AR9280 Rev:2 mem=0xffffc90004ec0000, irq=16
[   17.640383] nvidia: module license 'NVIDIA' taints kernel.
[   17.640388] Disabling lock debugging due to kernel taint
[   17.651566] nvidia: module verification failed: signature and/or  required key missing - tainting kernel
[   17.658892] vgaarb: device changed decodes: PCI:0000:01:00.0,olddecodes=io+mem,decodes=none:owns=none
[   17.659844] [drm] Initialized nvidia-drm 0.0.0 20130102 for 0000:01:00.0 on minor 0
[   17.659852] NVRM: loading NVIDIA UNIX x86_64 Kernel Module  331.38  Wed Jan  8 19:32:30 PST 2014
[   17.689065] init: udev-fallback-graphics main process (807) terminated with status 1
[   20.122428] EXT4-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro

Re: 3.16 crashes on resume from Suspend-To-disk, Intel pci_bus problem?

[Janek Kozicki]

> PS: it appears that my email account has problems dealing with so much
> email traffic. I will monitor archives online in this thread, and
> please reply both to mailing list and my email.

I resubscribed the mailing list using another account:
janek.listy.mailowe (at) gmail ! com  I hope this one will work.
(also it's my current From: address)

I hope that all of you received my message with full debug info, I see it in
archives fortunately:

http://lkml.iu.edu//hypermail/linux/kernel/1408.1/00372.html

best regards
Janek Kozicki

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Zhang Rui]

On Sat, 2014-08-09 at 03:14 -0700, Markus Gutschke wrote:
> I am back and have physical access to the machine now.
> 
great!

> I re-ran the test just to be sure, and I can confirm that "platform"
> does in fact result in a crash.
> 
what about "devices"?
I mean

# echo devices > /sys/power/pm_test

and see if that triggers the crash.

> Furthermore, I ran the test that Rui asked for. I suspended, resumed,
> and upon crashing power-cycled the machine ASAP. "dmesg" suggests that
> the problem is with LNXSYBUS:00 That doesn't tell me much, but
> hopefully it makes sense to you guys.
> 
[    0.930093]   Magic number: 10:810:122
[    0.930185] acpi LNXSYBUS:00: hash matches

This looks weird, ACPI will do nothing for LNXSYBUS devices during
resume.
Rafael, any thought on this?

thanks,
rui

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Markus Gutschke]

As I said earlier in this thread, echo'ing "devices" into "pm_test"
does not result in a crash; but doing so for "platform" does.

Markus

On Aug 12, 2014 1:26 AM, "Zhang Rui" <rui.zhang@intel.com> wrote:
>
> On Sat, 2014-08-09 at 03:14 -0700, Markus Gutschke wrote:
> > I am back and have physical access to the machine now.
> >
> great!
>
> > I re-ran the test just to be sure, and I can confirm that "platform"
> > does in fact result in a crash.
> >
> what about "devices"?
> I mean
>
> # echo devices > /sys/power/pm_test
>
> and see if that triggers the crash.
>
> > Furthermore, I ran the test that Rui asked for. I suspended, resumed,
> > and upon crashing power-cycled the machine ASAP. "dmesg" suggests that
> > the problem is with LNXSYBUS:00 That doesn't tell me much, but
> > hopefully it makes sense to you guys.
> >
> [    0.930093]   Magic number: 10:810:122
> [    0.930185] acpi LNXSYBUS:00: hash matches
>
> This looks weird, ACPI will do nothing for LNXSYBUS devices during
> resume.
> Rafael, any thought on this?
>
> thanks,
> rui
>

Re: 3.16 crashes on resume from Suspend-To-disk

[Janek Kozicki]

Rafael J. Wysocki said:     (by the date of Wed, 06 Aug 2014 01:15 +0200)

> Why don't you file a bug at bugzilla.kernel.org against hibernation/suspend and
> put that information into it?

I just did: https://bugzilla.kernel.org/show_bug.cgi?id=82291

I hope you can help me with that, if there's any more debugging to do please let me know.

best regards
Janek Kozicki

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Markus Gutschke]

Just wondering if any of you had any other ideas of what I could try
to help debug this problem?

Thanks,


Markus

On Tue, Aug 12, 2014 at 9:11 AM, Markus Gutschke <markus@gutschke.com> wrote:
> As I said earlier in this thread, echo'ing "devices" into "pm_test"
> does not result in a crash; but doing so for "platform" does.
>
> Markus
>
> On Aug 12, 2014 1:26 AM, "Zhang Rui" <rui.zhang@intel.com> wrote:
>>
>> On Sat, 2014-08-09 at 03:14 -0700, Markus Gutschke wrote:
>> > I am back and have physical access to the machine now.
>> >
>> great!
>>
>> > I re-ran the test just to be sure, and I can confirm that "platform"
>> > does in fact result in a crash.
>> >
>> what about "devices"?
>> I mean
>>
>> # echo devices > /sys/power/pm_test
>>
>> and see if that triggers the crash.
>>
>> > Furthermore, I ran the test that Rui asked for. I suspended, resumed,
>> > and upon crashing power-cycled the machine ASAP. "dmesg" suggests that
>> > the problem is with LNXSYBUS:00 That doesn't tell me much, but
>> > hopefully it makes sense to you guys.
>> >
>> [    0.930093]   Magic number: 10:810:122
>> [    0.930185] acpi LNXSYBUS:00: hash matches
>>
>> This looks weird, ACPI will do nothing for LNXSYBUS devices during
>> resume.
>> Rafael, any thought on this?
>>
>> thanks,
>> rui
>>

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Rafael J. Wysocki]

On Friday, August 15, 2014 10:17:42 AM Markus Gutschke wrote:
> Just wondering if any of you had any other ideas of what I could try
> to help debug this problem?

My theory is that there is a device in your system that we don't have a driver
for, but it had been enumerated as a PNP device before the change that triggered
the problem for you and we turned it off during suspend as part of the default
ACPI PNP device handling.

The reason why you're seeing a crash with the "platform" test level is most
likely that the _WAK control method does something unusual on your system.

The LNXSYBUS:00 thing from dmesg probably is a red herring.

I need the output of acpidump from the affected system, but please attach it
to the bug entry at https://bugzilla.kernel.org/show_bug.cgi?id=80911 that
Rui has created for this issue.

Also please check the list of PNP devices under

/sys/bus/pnp/devices/

before and after the commit you have found by bisection and let me know if
there are any differences.


> On Tue, Aug 12, 2014 at 9:11 AM, Markus Gutschke <markus@gutschke.com> wrote:
> > As I said earlier in this thread, echo'ing "devices" into "pm_test"
> > does not result in a crash; but doing so for "platform" does.
> >
> > Markus
> >
> > On Aug 12, 2014 1:26 AM, "Zhang Rui" <rui.zhang@intel.com> wrote:
> >>
> >> On Sat, 2014-08-09 at 03:14 -0700, Markus Gutschke wrote:
> >> > I am back and have physical access to the machine now.
> >> >
> >> great!
> >>
> >> > I re-ran the test just to be sure, and I can confirm that "platform"
> >> > does in fact result in a crash.
> >> >
> >> what about "devices"?
> >> I mean
> >>
> >> # echo devices > /sys/power/pm_test
> >>
> >> and see if that triggers the crash.
> >>
> >> > Furthermore, I ran the test that Rui asked for. I suspended, resumed,
> >> > and upon crashing power-cycled the machine ASAP. "dmesg" suggests that
> >> > the problem is with LNXSYBUS:00 That doesn't tell me much, but
> >> > hopefully it makes sense to you guys.
> >> >
> >> [    0.930093]   Magic number: 10:810:122
> >> [    0.930185] acpi LNXSYBUS:00: hash matches
> >>
> >> This looks weird, ACPI will do nothing for LNXSYBUS devices during
> >> resume.
> >> Rafael, any thought on this?
> >>
> >> thanks,
> >> rui
> >>

-- 
I speak only for myself.
Rafael J. Wysocki, Intel Open Source Technology Center.

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Markus Gutschke]

[-- Attachment #1: Type: text/plain, Size: 3282 bytes --]

I collected all the data that you asked for and attached it to the
bug: https://bugzilla.kernel.org/show_bug.cgi?id=80911

Yes, both acpidump output and the list of PNP devices changes when I
update the kernel. I was hoping to give you a brief "diff" output for
the changes; but there are too many changes for that to make much
sense. In any case, you can see it by running:

  diff -u last-good/dirtree_\!sys\!devices\!pnp0.txt
first-bad/dirtree_\!sys\!devices\!pnp0.txt

I included a README.txt that describes the contents of all the files.
I hope this makes some sense and I hope it is sufficiently complete
for you to make progress in debugging why my machine is unhappy.
Please don't hesitate to ask, if you think I can provide other data
and/or run other tests.


Markus


On Fri, Aug 15, 2014 at 5:46 PM, Rafael J. Wysocki <rjw@rjwysocki.net> wrote:
> On Friday, August 15, 2014 10:17:42 AM Markus Gutschke wrote:
>> Just wondering if any of you had any other ideas of what I could try
>> to help debug this problem?
>
> My theory is that there is a device in your system that we don't have a driver
> for, but it had been enumerated as a PNP device before the change that triggered
> the problem for you and we turned it off during suspend as part of the default
> ACPI PNP device handling.
>
> The reason why you're seeing a crash with the "platform" test level is most
> likely that the _WAK control method does something unusual on your system.
>
> The LNXSYBUS:00 thing from dmesg probably is a red herring.
>
> I need the output of acpidump from the affected system, but please attach it
> to the bug entry at https://bugzilla.kernel.org/show_bug.cgi?id=80911 that
> Rui has created for this issue.
>
> Also please check the list of PNP devices under
>
> /sys/bus/pnp/devices/
>
> before and after the commit you have found by bisection and let me know if
> there are any differences.
>
>
>> On Tue, Aug 12, 2014 at 9:11 AM, Markus Gutschke <markus@gutschke.com> wrote:
>> > As I said earlier in this thread, echo'ing "devices" into "pm_test"
>> > does not result in a crash; but doing so for "platform" does.
>> >
>> > Markus
>> >
>> > On Aug 12, 2014 1:26 AM, "Zhang Rui" <rui.zhang@intel.com> wrote:
>> >>
>> >> On Sat, 2014-08-09 at 03:14 -0700, Markus Gutschke wrote:
>> >> > I am back and have physical access to the machine now.
>> >> >
>> >> great!
>> >>
>> >> > I re-ran the test just to be sure, and I can confirm that "platform"
>> >> > does in fact result in a crash.
>> >> >
>> >> what about "devices"?
>> >> I mean
>> >>
>> >> # echo devices > /sys/power/pm_test
>> >>
>> >> and see if that triggers the crash.
>> >>
>> >> > Furthermore, I ran the test that Rui asked for. I suspended, resumed,
>> >> > and upon crashing power-cycled the machine ASAP. "dmesg" suggests that
>> >> > the problem is with LNXSYBUS:00 That doesn't tell me much, but
>> >> > hopefully it makes sense to you guys.
>> >> >
>> >> [    0.930093]   Magic number: 10:810:122
>> >> [    0.930185] acpi LNXSYBUS:00: hash matches
>> >>
>> >> This looks weird, ACPI will do nothing for LNXSYBUS devices during
>> >> resume.
>> >> Rafael, any thought on this?
>> >>
>> >> thanks,
>> >> rui
>> >>
>
> --
> I speak only for myself.
> Rafael J. Wysocki, Intel Open Source Technology Center.

[-- Attachment #2: README.txt --]
[-- Type: text/plain, Size: 1386 bytes --]

This archive contains debugging information retrieved for the following kernel
versions:

455c6fdbd219161bd09b1165f11699d6d73de11c: Linux 3.14
1860e379875dfe7271c649058aeddffe5afd9d0d: Linux 3.15
aca0a4eb4e325914ddb22a8ed06fcb0222da2a26: Last good commit
eec15edbb0e14485998635ea7c62e30911b465f0: First bad commit
b04c58b1ed26317bfb4b33d3a2d16377fc6acd0f: Still bad (merge branch "acpi-enumeration")
b04c58b1ed26317bfb4b33d3a2d16377fc6acd0f.PATCHED: Patched with a debug patch provided by Rui

After eec15edbb0e14485998635ea7c62e30911b465f0, the kernel can no longer resume
from suspend. The crash looks like what is shown in "crash.png".

Even for defective kernels, "echo devices >/sys/power/pm_test" completes successfully,
whereas "echo platform >/sys/power/pm_test" triggers the crash.

CONFIG_PM_TRACE_RTC suggests that the bug is caused by LNXSYBUS:00:, but that might be
incorrect.

Please note that "dmesg" shows an early stack trace during boot. This might or might
not be related.

Please also not that the output from "acpidump" changes between kernel versions.

I also included the output from
  grep . /sys/bus/pnp/devices/*/firmware_node/*
  grep . /sys/bus/pnp/devices/*/*
  grep . /sys/bus/platform/devices/*/firmware_node/*
  grep . /sys/bus/platform/devices/*/*
for each of the kernels.

And the directory tree underneath /sys/bus/pnp/devices/ -> /sys/devices/pnp0/.

Re: 3.16-rcX crashes on resume from Suspend-To-RAM

[Zhang Rui]

[-- Attachment #1: Type: text/plain, Size: 3010 bytes --]

On Sat, 2014-08-16 at 02:46 +0200, Rafael J. Wysocki wrote:
> On Friday, August 15, 2014 10:17:42 AM Markus Gutschke wrote:
> > Just wondering if any of you had any other ideas of what I could try
> > to help debug this problem?
> 
> My theory is that there is a device in your system that we don't have a driver
> for, but it had been enumerated as a PNP device before the change that triggered
> the problem for you and we turned it off during suspend as part of the default
> ACPI PNP device handling.

I had the same assumption before, thus I checked the difference of
platform devices and pnp devices, and found that there are three devices
enumerated to platform bus instead of PNP bus after the ACPI enumeration
rework patches. They are PNP0800, PNP0200 and PNP0C04 devices, thus I
made a debug patch to add those ids to the acpi_pnp scan handler id list
so that they will stay in PNP bus. But the problem still exists after
applying the debug patch.
> 
> The reason why you're seeing a crash with the "platform" test level is most
> likely that the _WAK control method does something unusual on your system.
> 
an easy way to check this is to apply the debug patch attached and
re-test "platform" test level.

thanks,
rui
> The LNXSYBUS:00 thing from dmesg probably is a red herring.
> 
> I need the output of acpidump from the affected system, but please attach it
> to the bug entry at https://bugzilla.kernel.org/show_bug.cgi?id=80911 that
> Rui has created for this issue.
> 
> Also please check the list of PNP devices under
> 
> /sys/bus/pnp/devices/
> 
> before and after the commit you have found by bisection and let me know if
> there are any differences.
> 
> 
> > On Tue, Aug 12, 2014 at 9:11 AM, Markus Gutschke <markus@gutschke.com> wrote:
> > > As I said earlier in this thread, echo'ing "devices" into "pm_test"
> > > does not result in a crash; but doing so for "platform" does.
> > >
> > > Markus
> > >
> > > On Aug 12, 2014 1:26 AM, "Zhang Rui" <rui.zhang@intel.com> wrote:
> > >>
> > >> On Sat, 2014-08-09 at 03:14 -0700, Markus Gutschke wrote:
> > >> > I am back and have physical access to the machine now.
> > >> >
> > >> great!
> > >>
> > >> > I re-ran the test just to be sure, and I can confirm that "platform"
> > >> > does in fact result in a crash.
> > >> >
> > >> what about "devices"?
> > >> I mean
> > >>
> > >> # echo devices > /sys/power/pm_test
> > >>
> > >> and see if that triggers the crash.
> > >>
> > >> > Furthermore, I ran the test that Rui asked for. I suspended, resumed,
> > >> > and upon crashing power-cycled the machine ASAP. "dmesg" suggests that
> > >> > the problem is with LNXSYBUS:00 That doesn't tell me much, but
> > >> > hopefully it makes sense to you guys.
> > >> >
> > >> [    0.930093]   Magic number: 10:810:122
> > >> [    0.930185] acpi LNXSYBUS:00: hash matches
> > >>
> > >> This looks weird, ACPI will do nothing for LNXSYBUS devices during
> > >> resume.
> > >> Rafael, any thought on this?
> > >>
> > >> thanks,
> > >> rui
> > >>
> 


[-- Attachment #2: 0001-80911-Debug-patch-to-skip-_WAK-in-platform-pm_test-m.patch --]
[-- Type: text/x-patch, Size: 1144 bytes --]

>From 1a51cb80cf581a0aa228dd82aaf45f4e250d0d59 Mon Sep 17 00:00:00 2001
From: Zhang Rui <rui.zhang@intel.com>
Date: Mon, 18 Aug 2014 09:09:07 +0800
Subject: [PATCH] 80911: Debug patch to skip _WAK in platform pm_test mode

---
 kernel/power/suspend.c | 9 +++++----
 1 file changed, 5 insertions(+), 4 deletions(-)

diff --git a/kernel/power/suspend.c b/kernel/power/suspend.c
index 6dadb25..402f0ca 100644
--- a/kernel/power/suspend.c
+++ b/kernel/power/suspend.c
@@ -270,11 +270,12 @@ static int suspend_enter(suspend_state_t state, bool *wakeup)
 		printk(KERN_ERR "PM: Some devices failed to power down\n");
 		goto Platform_finish;
 	}
-	error = platform_suspend_prepare_late(state);
-	if (error)
-		goto Platform_wake;
 
 	if (suspend_test(TEST_PLATFORM))
+		goto Platform_test;
+
+	error = platform_suspend_prepare_late(state);
+	if (error)
 		goto Platform_wake;
 
 	/*
@@ -319,8 +320,8 @@ static int suspend_enter(suspend_state_t state, bool *wakeup)
 
  Platform_wake:
 	platform_suspend_wake(state);
+ Platform_test:
 	dpm_resume_start(PMSG_RESUME);
-
  Platform_finish:
 	platform_suspend_finish(state);
 	return error;
-- 
1.8.3.2