Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620

All of lore.kernel.org
 help / color / mirror / Atom feed

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
       [not found] <20220902135242.2447.409509F4@e16-tech.com>
@ 2022-09-05  6:57 ` Thomas Zimmermann
  2022-09-07  4:16   ` Wang Yugui
  0 siblings, 1 reply; 21+ messages in thread
From: Thomas Zimmermann @ 2022-09-05  6:57 UTC (permalink / raw)
  To: Wang Yugui; +Cc: dri-devel


[-- Attachment #1.1: Type: text/plain, Size: 2282 bytes --]

Hi

Am 02.09.22 um 07:52 schrieb Wang Yugui:
> Hi,
> 
> mgag200 broken on kernel-6.0-rc3 on DELL/T620.
> 
> See the attachementment file for the graph output.

Thanks for reporting the bug. We recently refactored some code of the 
driver. Can you bisect to the change that introduced the problem?

Best regards
Thomas

> 
> [root@T620 ~]# dmesg  |grep -i 'vga\|mga'
> [    0.588940] Console: colour VGA+ 80x25
> [    4.918214] pci 0000:0a:00.0: vgaarb: setting as boot VGA device
> [    4.919028] pci 0000:0a:00.0: vgaarb: bridge control possible
> [    4.919028] pci 0000:0a:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
> [    4.941058] vgaarb: loaded
> [    9.385485] mgag200 0000:0a:00.0: vgaarb: deactivate vga console
> [    9.510688] [drm] Initialized mgag200 1.0.0 20110418 for 0000:0a:00.0 on minor 0
> [    9.523145] fbcon: mgag200drmfb (fb0) is primary device
> [    9.641543] mgag200 0000:0a:00.0: [drm] fb0: mgag200drmfb frame buffer device
> 
> 
> more info:
> 1, This DELL/T620 works well with kernel 5.15.63,
>      so this is not a  hardware error.
> 
> 2, DELL/T640 works well with kernel 6.0-rc and 5.15.63.
>      both DELL/T620 and DELL/T640 use the driver 'mgag200'.
> 
> [root@T640 ~]#  dmesg  |grep -i 'vga\|mga'
> [   10.161500] pci 0000:03:00.0: vgaarb: setting as boot VGA device
> [   10.162463] pci 0000:03:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
> [   10.176527] pci 0000:03:00.0: vgaarb: bridge control possible
> [   10.182465] vgaarb: loaded
> [   11.832839] fb0: EFI VGA frame buffer device
> [   21.303826] mgag200 0000:03:00.0: vgaarb: deactivate vga console
> [   21.319498] [drm] Initialized mgag200 1.0.0 20110418 for 0000:03:00.0 on minor 0
> [   21.330223] fbcon: mgag200drmfb (fb0) is primary device
> [   21.332140] mgag200 0000:03:00.0: [drm] drm_plane_enable_fb_damage_clips() not called
> [   21.741629] mgag200 0000:03:00.0: [drm] fb0: mgag200drmfb frame buffer device
> 
> Best Regards
> Wang Yugui (wangyugui@e16-tech.com)
> 2022/09/02
> 

-- 
Thomas Zimmermann
Graphics Driver Developer
SUSE Software Solutions Germany GmbH
Maxfeldstr. 5, 90409 Nürnberg, Germany
(HRB 36809, AG Nürnberg)
Geschäftsführer: Ivo Totev

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 840 bytes --]

^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-05  6:57 ` mgag200 broken on kernel-6.0-rc3 on DELL/T620 Thomas Zimmermann
@ 2022-09-07  4:16   ` Wang Yugui
  2022-09-07  6:47     ` Thomas Zimmermann
  2022-09-13  8:34     ` Thomas Zimmermann
  0 siblings, 2 replies; 21+ messages in thread
From: Wang Yugui @ 2022-09-07  4:16 UTC (permalink / raw)
  To: Thomas Zimmermann; +Cc: dri-devel

Hi,

> Am 02.09.22 um 07:52 schrieb Wang Yugui:
> > Hi,
> >
> > mgag200 broken on kernel-6.0-rc3 on DELL/T620.
> >
> > See the attachementment file for the graph output.
> 
> Thanks for reporting the bug. We recently refactored some code of the driver. Can you bisect to the change that introduced the problem?

5.19.3 works well on this DELL/T620.

so this problem should be a regression of 6.0.

other bisect seem difficult for me.

Best Regards
Wang Yugui (wangyugui@e16-tech.com)
2022/09/07


> 
> Best regards
> Thomas
> 
> >
> > [root@T620 ~]# dmesg  |grep -i 'vga\|mga'
> > [    0.588940] Console: colour VGA+ 80x25
> > [    4.918214] pci 0000:0a:00.0: vgaarb: setting as boot VGA device
> > [    4.919028] pci 0000:0a:00.0: vgaarb: bridge control possible
> > [    4.919028] pci 0000:0a:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
> > [    4.941058] vgaarb: loaded
> > [    9.385485] mgag200 0000:0a:00.0: vgaarb: deactivate vga console
> > [    9.510688] [drm] Initialized mgag200 1.0.0 20110418 for 0000:0a:00.0 on minor 0
> > [    9.523145] fbcon: mgag200drmfb (fb0) is primary device
> > [    9.641543] mgag200 0000:0a:00.0: [drm] fb0: mgag200drmfb frame buffer device
> >
> >
> > more info:
> > 1, This DELL/T620 works well with kernel 5.15.63,
> >      so this is not a  hardware error.
> >
> > 2, DELL/T640 works well with kernel 6.0-rc and 5.15.63.
> >      both DELL/T620 and DELL/T640 use the driver 'mgag200'.
> >
> > [root@T640 ~]#  dmesg  |grep -i 'vga\|mga'
> > [   10.161500] pci 0000:03:00.0: vgaarb: setting as boot VGA device
> > [   10.162463] pci 0000:03:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
> > [   10.176527] pci 0000:03:00.0: vgaarb: bridge control possible
> > [   10.182465] vgaarb: loaded
> > [   11.832839] fb0: EFI VGA frame buffer device
> > [   21.303826] mgag200 0000:03:00.0: vgaarb: deactivate vga console
> > [   21.319498] [drm] Initialized mgag200 1.0.0 20110418 for 0000:03:00.0 on minor 0
> > [   21.330223] fbcon: mgag200drmfb (fb0) is primary device
> > [   21.332140] mgag200 0000:03:00.0: [drm] drm_plane_enable_fb_damage_clips() not called
> > [   21.741629] mgag200 0000:03:00.0: [drm] fb0: mgag200drmfb frame buffer device
> >
> > Best Regards
> > Wang Yugui (wangyugui@e16-tech.com)
> > 2022/09/02
> > 
> -- Thomas Zimmermann
> Graphics Driver Developer
> SUSE Software Solutions Germany GmbH
> Maxfeldstr. 5, 90409 Nürnberg, Germany
> (HRB 36809, AG Nürnberg)
> Gesch?ftsführer: Ivo Totev



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-07  4:16   ` Wang Yugui
@ 2022-09-07  6:47     ` Thomas Zimmermann
  2022-09-07  7:38       ` Wang Yugui
  2022-09-13  8:34     ` Thomas Zimmermann
  1 sibling, 1 reply; 21+ messages in thread
From: Thomas Zimmermann @ 2022-09-07  6:47 UTC (permalink / raw)
  To: Wang Yugui; +Cc: dri-devel


[-- Attachment #1.1: Type: text/plain, Size: 2999 bytes --]

Hi

Am 07.09.22 um 06:16 schrieb Wang Yugui:
> Hi,
> 
>> Am 02.09.22 um 07:52 schrieb Wang Yugui:
>>> Hi,
>>>
>>> mgag200 broken on kernel-6.0-rc3 on DELL/T620.
>>>
>>> See the attachementment file for the graph output.
>>
>> Thanks for reporting the bug. We recently refactored some code of the driver. Can you bisect to the change that introduced the problem?
> 
> 5.19.3 works well on this DELL/T620.
> 
> so this problem should be a regression of 6.0.
> 
> other bisect seem difficult for me.

OK, thank you. Can you provide the dmesg log of the broken machine and 
the output of 'sudo lspci -vn' please?

Best regards
Thomas

> 
> Best Regards
> Wang Yugui (wangyugui@e16-tech.com)
> 2022/09/07
> 
> 
>>
>> Best regards
>> Thomas
>>
>>>
>>> [root@T620 ~]# dmesg  |grep -i 'vga\|mga'
>>> [    0.588940] Console: colour VGA+ 80x25
>>> [    4.918214] pci 0000:0a:00.0: vgaarb: setting as boot VGA device
>>> [    4.919028] pci 0000:0a:00.0: vgaarb: bridge control possible
>>> [    4.919028] pci 0000:0a:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
>>> [    4.941058] vgaarb: loaded
>>> [    9.385485] mgag200 0000:0a:00.0: vgaarb: deactivate vga console
>>> [    9.510688] [drm] Initialized mgag200 1.0.0 20110418 for 0000:0a:00.0 on minor 0
>>> [    9.523145] fbcon: mgag200drmfb (fb0) is primary device
>>> [    9.641543] mgag200 0000:0a:00.0: [drm] fb0: mgag200drmfb frame buffer device
>>>
>>>
>>> more info:
>>> 1, This DELL/T620 works well with kernel 5.15.63,
>>>       so this is not a  hardware error.
>>>
>>> 2, DELL/T640 works well with kernel 6.0-rc and 5.15.63.
>>>       both DELL/T620 and DELL/T640 use the driver 'mgag200'.
>>>
>>> [root@T640 ~]#  dmesg  |grep -i 'vga\|mga'
>>> [   10.161500] pci 0000:03:00.0: vgaarb: setting as boot VGA device
>>> [   10.162463] pci 0000:03:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
>>> [   10.176527] pci 0000:03:00.0: vgaarb: bridge control possible
>>> [   10.182465] vgaarb: loaded
>>> [   11.832839] fb0: EFI VGA frame buffer device
>>> [   21.303826] mgag200 0000:03:00.0: vgaarb: deactivate vga console
>>> [   21.319498] [drm] Initialized mgag200 1.0.0 20110418 for 0000:03:00.0 on minor 0
>>> [   21.330223] fbcon: mgag200drmfb (fb0) is primary device
>>> [   21.332140] mgag200 0000:03:00.0: [drm] drm_plane_enable_fb_damage_clips() not called
>>> [   21.741629] mgag200 0000:03:00.0: [drm] fb0: mgag200drmfb frame buffer device
>>>
>>> Best Regards
>>> Wang Yugui (wangyugui@e16-tech.com)
>>> 2022/09/02
>>>
>> -- Thomas Zimmermann
>> Graphics Driver Developer
>> SUSE Software Solutions Germany GmbH
>> Maxfeldstr. 5, 90409 Nürnberg, Germany
>> (HRB 36809, AG Nürnberg)
>> Gesch?ftsführer: Ivo Totev
> 
> 

-- 
Thomas Zimmermann
Graphics Driver Developer
SUSE Software Solutions Germany GmbH
Maxfeldstr. 5, 90409 Nürnberg, Germany
(HRB 36809, AG Nürnberg)
Geschäftsführer: Ivo Totev

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 840 bytes --]

^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-07  6:47     ` Thomas Zimmermann
@ 2022-09-07  7:38       ` Wang Yugui
  2022-09-07  7:55         ` Thomas Zimmermann
  0 siblings, 1 reply; 21+ messages in thread
From: Wang Yugui @ 2022-09-07  7:38 UTC (permalink / raw)
  To: Thomas Zimmermann; +Cc: dri-devel

[-- Attachment #1: Type: text/plain, Size: 3202 bytes --]

Hi,


> Hi
> 
> Am 07.09.22 um 06:16 schrieb Wang Yugui:
> > Hi,
> >
> >> Am 02.09.22 um 07:52 schrieb Wang Yugui:
> >>> Hi,
> >>>
> >>> mgag200 broken on kernel-6.0-rc3 on DELL/T620.
> >>>
> >>> See the attachementment file for the graph output.
> >>
> >> Thanks for reporting the bug. We recently refactored some code of the driver. Can you bisect to the change that introduced the problem?
> >
> > 5.19.3 works well on this DELL/T620.
> >
> > so this problem should be a regression of 6.0.
> >
> > other bisect seem difficult for me.
> 
> OK, thank you. Can you provide the dmesg log of the broken machine and the output of 'sudo lspci -vn' please?

please see the attachment file for the output of 'lspci -vn'.

Best Regards
Wang Yugui (wangyugui@e16-tech.com)
2022/09/07


> 
> Best regards
> Thomas
> 
> >
> > Best Regards
> > Wang Yugui (wangyugui@e16-tech.com)
> > 2022/09/07
> >
> >
> >>
> >> Best regards
> >> Thomas
> >>
> >>>
> >>> [root@T620 ~]# dmesg  |grep -i 'vga\|mga'
> >>> [    0.588940] Console: colour VGA+ 80x25
> >>> [    4.918214] pci 0000:0a:00.0: vgaarb: setting as boot VGA device
> >>> [    4.919028] pci 0000:0a:00.0: vgaarb: bridge control possible
> >>> [    4.919028] pci 0000:0a:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
> >>> [    4.941058] vgaarb: loaded
> >>> [    9.385485] mgag200 0000:0a:00.0: vgaarb: deactivate vga console
> >>> [    9.510688] [drm] Initialized mgag200 1.0.0 20110418 for 0000:0a:00.0 on minor 0
> >>> [    9.523145] fbcon: mgag200drmfb (fb0) is primary device
> >>> [    9.641543] mgag200 0000:0a:00.0: [drm] fb0: mgag200drmfb frame buffer device
> >>>
> >>>
> >>> more info:
> >>> 1, This DELL/T620 works well with kernel 5.15.63,
> >>>       so this is not a  hardware error.
> >>>
> >>> 2, DELL/T640 works well with kernel 6.0-rc and 5.15.63.
> >>>       both DELL/T620 and DELL/T640 use the driver 'mgag200'.
> >>>
> >>> [root@T640 ~]#  dmesg  |grep -i 'vga\|mga'
> >>> [   10.161500] pci 0000:03:00.0: vgaarb: setting as boot VGA device
> >>> [   10.162463] pci 0000:03:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
> >>> [   10.176527] pci 0000:03:00.0: vgaarb: bridge control possible
> >>> [   10.182465] vgaarb: loaded
> >>> [   11.832839] fb0: EFI VGA frame buffer device
> >>> [   21.303826] mgag200 0000:03:00.0: vgaarb: deactivate vga console
> >>> [   21.319498] [drm] Initialized mgag200 1.0.0 20110418 for 0000:03:00.0 on minor 0
> >>> [   21.330223] fbcon: mgag200drmfb (fb0) is primary device
> >>> [   21.332140] mgag200 0000:03:00.0: [drm] drm_plane_enable_fb_damage_clips() not called
> >>> [   21.741629] mgag200 0000:03:00.0: [drm] fb0: mgag200drmfb frame buffer device
> >>>
> >>> Best Regards
> >>> Wang Yugui (wangyugui@e16-tech.com)
> >>> 2022/09/02
> >>>
> >> -- Thomas Zimmermann
> >> Graphics Driver Developer
> >> SUSE Software Solutions Germany GmbH
> >> Maxfeldstr. 5, 90409 Nürnberg, Germany
> >> (HRB 36809, AG Nürnberg)
> >> Gesch?ftsführer: Ivo Totev
> >
> > 
> -- Thomas Zimmermann
> Graphics Driver Developer
> SUSE Software Solutions Germany GmbH
> Maxfeldstr. 5, 90409 Nürnberg, Germany
> (HRB 36809, AG Nürnberg)
> Gesch?ftsführer: Ivo Totev


[-- Attachment #2: lspci-vn.txt --]
[-- Type: application/octet-stream, Size: 29317 bytes --]

00:00.0 0600: 8086:0e00 (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 0
	Capabilities: [90] Express Root Port (Slot-), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [144] Vendor Specific Information: ID=0004 Rev=1 Len=03c <?>
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>

00:01.0 0604: 8086:0e02 (rev 04) (prog-if 00 [Normal decode])
	DeviceName: SLOT 1
	Flags: bus master, fast devsel, latency 0, IRQ 25, NUMA node 0
	Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: [disabled]
	Prefetchable memory behind bridge: [disabled]
	Capabilities: [40] Subsystem: 1028:04cf
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] Secondary PCI Express
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Kernel driver in use: pcieport

00:02.0 0604: 8086:0e04 (rev 04) (prog-if 00 [Normal decode])
	DeviceName: SLOT 4
	Flags: bus master, fast devsel, latency 0, IRQ 26, NUMA node 0
	Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
	I/O behind bridge: 0000f000-0000ffff [size=4K]
	Memory behind bridge: dc000000-dcffffff [size=16M]
	Prefetchable memory behind bridge: [disabled]
	Capabilities: [40] Subsystem: 1028:04cf
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] Secondary PCI Express
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Kernel driver in use: pcieport

00:03.0 0604: 8086:0e08 (rev 04) (prog-if 00 [Normal decode])
	DeviceName: SLOT 2
	Flags: bus master, fast devsel, latency 0, IRQ 27, NUMA node 0
	Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: [disabled]
	Prefetchable memory behind bridge: [disabled]
	Capabilities: [40] Subsystem: 1028:04cf
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] Secondary PCI Express
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Kernel driver in use: pcieport

00:05.0 0880: 8086:0e28 (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:05.2 0880: 8086:0e2a (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:11.0 0604: 8086:1d3e (rev 05) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 28, NUMA node 0
	Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: [disabled]
	Prefetchable memory behind bridge: [disabled]
	Capabilities: [40] Express Root Port (Slot-), MSI 00
	Capabilities: [80] Power Management version 3
	Capabilities: [88] Subsystem: 1028:04cf
	Capabilities: [90] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [138] Access Control Services
	Kernel driver in use: pcieport

00:16.0 0780: 8086:1d3a (rev 05)
	Subsystem: 1028:04cf
	Flags: bus master, fast devsel, latency 0, NUMA node 0
	Memory at df8fb000 (64-bit, non-prefetchable) [size=16]
	Capabilities: [50] Power Management version 3
	Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+
	Kernel modules: mei_me

00:16.1 0780: 8086:1d3b (rev 05)
	Subsystem: 1028:04cf
	Flags: bus master, fast devsel, latency 0, NUMA node 0
	Memory at df8fc000 (64-bit, non-prefetchable) [size=16]
	Capabilities: [50] Power Management version 3
	Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+

00:1a.0 0c03: 8086:1d2d (rev 05) (prog-if 20 [EHCI])
	Subsystem: 1028:04cf
	Flags: bus master, medium devsel, latency 0, IRQ 23, NUMA node 0
	Memory at df8fd000 (32-bit, non-prefetchable) [size=1K]
	Capabilities: [50] Power Management version 2
	Capabilities: [58] Debug port: BAR=1 offset=00a0
	Capabilities: [98] PCI Advanced Features
	Kernel driver in use: ehci-pci

00:1c.0 0604: 8086:1d10 (rev b5) (prog-if 00 [Normal decode])
	DeviceName: SLOT 3
	Flags: bus master, fast devsel, latency 0, IRQ 29, NUMA node 0
	Bus: primary=00, secondary=05, subordinate=05, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: [disabled]
	Prefetchable memory behind bridge: [disabled]
	Capabilities: [40] Express Root Port (Slot+), MSI 00
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: 1028:04cf
	Capabilities: [a0] Power Management version 2
	Capabilities: [100] Advanced Error Reporting
	Kernel driver in use: pcieport

00:1c.4 0604: 8086:1d18 (rev b5) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 30, NUMA node 0
	Bus: primary=00, secondary=06, subordinate=06, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: dd000000-ddffffff [size=16M]
	Prefetchable memory behind bridge: [disabled]
	Capabilities: [40] Express Root Port (Slot-), MSI 00
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: 1028:04cf
	Capabilities: [a0] Power Management version 2
	Capabilities: [100] Advanced Error Reporting
	Kernel driver in use: pcieport

00:1c.7 0604: 8086:1d1e (rev b5) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 31, NUMA node 0
	Bus: primary=00, secondary=07, subordinate=0b, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: de000000-df7fffff [size=24M]
	Prefetchable memory behind bridge: 00000000d8000000-00000000d8ffffff [size=16M]
	Capabilities: [40] Express Root Port (Slot-), MSI 00
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: 1028:04cf
	Capabilities: [a0] Power Management version 2
	Capabilities: [100] Advanced Error Reporting
	Kernel driver in use: pcieport

00:1d.0 0c03: 8086:1d26 (rev 05) (prog-if 20 [EHCI])
	Subsystem: 1028:04cf
	Flags: bus master, medium devsel, latency 0, IRQ 22, NUMA node 0
	Memory at df8fe000 (32-bit, non-prefetchable) [size=1K]
	Capabilities: [50] Power Management version 2
	Capabilities: [58] Debug port: BAR=1 offset=00a0
	Capabilities: [98] PCI Advanced Features
	Kernel driver in use: ehci-pci

00:1e.0 0604: 8086:244e (rev a5) (prog-if 01 [Subtractive decode])
	Flags: bus master, fast devsel, latency 0, NUMA node 0
	Bus: primary=00, secondary=0c, subordinate=0c, sec-latency=32
	I/O behind bridge: [disabled]
	Memory behind bridge: [disabled]
	Prefetchable memory behind bridge: [disabled]
	Capabilities: [50] Subsystem: 1028:04cf

00:1f.0 0601: 8086:1d41 (rev 05)
	Subsystem: 1028:04cf
	Flags: bus master, medium devsel, latency 0, NUMA node 0
	Capabilities: [e0] Vendor Specific Information: Len=0c <?>
	Kernel driver in use: lpc_ich
	Kernel modules: lpc_ich

00:1f.2 0106: 8086:1d02 (rev 05) (prog-if 01 [AHCI 1.0])
	Subsystem: 1028:04cf
	Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 60, NUMA node 0
	I/O ports at ece8 [size=8]
	I/O ports at ecf8 [size=4]
	I/O ports at ecf0 [size=8]
	I/O ports at ecfc [size=4]
	I/O ports at ecc0 [size=32]
	Memory at df8ff000 (32-bit, non-prefetchable) [size=2K]
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [70] Power Management version 3
	Capabilities: [a8] SATA HBA v1.0
	Capabilities: [b0] PCI Advanced Features
	Kernel driver in use: ahci
	Kernel modules: ahci

02:00.0 0107: 1000:0072 (rev 03)
	Subsystem: 1028:1f1c
	Flags: bus master, fast devsel, latency 0, IRQ 48, NUMA node 0
	I/O ports at fc00 [size=256]
	Memory at dcff0000 (64-bit, non-prefetchable) [size=64K]
	Memory at dcf80000 (64-bit, non-prefetchable) [size=256K]
	Expansion ROM at dc000000 [disabled] [size=1M]
	Capabilities: [50] Power Management version 3
	Capabilities: [68] Express Endpoint, MSI 00
	Capabilities: [d0] Vital Product Data
	Capabilities: [a8] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [c0] MSI-X: Enable+ Count=15 Masked-
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [138] Power Budgeting <?>
	Kernel driver in use: mpt3sas
	Kernel modules: mpt3sas

06:00.0 0200: 8086:1521 (rev 01)
	DeviceName: NIC1
	Subsystem: 1028:04cf
	Flags: bus master, fast devsel, latency 0, IRQ 16, NUMA node 0
	Memory at ddd00000 (32-bit, non-prefetchable) [size=1M]
	Memory at ddff8000 (32-bit, non-prefetchable) [size=16K]
	Expansion ROM at dd000000 [disabled] [size=1M]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
	Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
	Capabilities: [a0] Express Endpoint, MSI 00
	Capabilities: [e0] Vital Product Data
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [140] Device Serial Number 90-b1-1c-ff-ff-3b-ee-2d
	Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [1a0] Transaction Processing Hints
	Capabilities: [1c0] Latency Tolerance Reporting
	Capabilities: [1d0] Access Control Services
	Kernel driver in use: igb
	Kernel modules: igb

06:00.1 0200: 8086:1521 (rev 01)
	DeviceName: NIC2
	Subsystem: 1028:04cf
	Flags: bus master, fast devsel, latency 0, IRQ 17, NUMA node 0
	Memory at dde00000 (32-bit, non-prefetchable) [size=1M]
	Memory at ddffc000 (32-bit, non-prefetchable) [size=16K]
	Expansion ROM at dd100000 [disabled] [size=1M]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
	Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
	Capabilities: [a0] Express Endpoint, MSI 00
	Capabilities: [e0] Vital Product Data
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [140] Device Serial Number 90-b1-1c-ff-ff-3b-ee-2d
	Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [1a0] Transaction Processing Hints
	Capabilities: [1d0] Access Control Services
	Kernel driver in use: igb
	Kernel modules: igb

07:00.0 0604: 1912:0013 (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 32, NUMA node 0
	BIST result: 00
	Bus: primary=07, secondary=08, subordinate=0b, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: de000000-df7fffff [size=24M]
	Prefetchable memory behind bridge: 00000000d8000000-00000000d8ffffff [size=16M]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [70] Express Upstream Port, MSI 00
	Capabilities: [b0] Subsystem: 1912:0013
	Capabilities: [100] Advanced Error Reporting
	Kernel driver in use: pcieport

08:00.0 0604: 1912:0013 (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 33, NUMA node 0
	BIST result: 00
	Bus: primary=08, secondary=09, subordinate=0a, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: de000000-deffffff [size=16M]
	Prefetchable memory behind bridge: 00000000d8000000-00000000d8ffffff [size=16M]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [70] Express Downstream Port (Slot-), MSI 00
	Capabilities: [b0] Subsystem: 1912:0013
	Capabilities: [100] Advanced Error Reporting
	Kernel driver in use: pcieport

08:01.0 0604: 1912:0013 (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 34, NUMA node 0
	BIST result: 00
	Bus: primary=08, secondary=0b, subordinate=0b, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: df700000-df7fffff [size=1M]
	Prefetchable memory behind bridge: [disabled]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [70] Express Downstream Port (Slot-), MSI 00
	Capabilities: [b0] Subsystem: 1912:0013
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [150] Access Control Services
	Kernel driver in use: pcieport

09:00.0 0604: 1912:0012 (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, NUMA node 0
	BIST result: 00
	Bus: primary=09, secondary=0a, subordinate=0a, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: de000000-deffffff [size=16M]
	Prefetchable memory behind bridge: 00000000d8000000-00000000d8ffffff [size=16M]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [70] Express PCI-Express to PCI/PCI-X Bridge, MSI 00
	Capabilities: [b0] Subsystem: 1912:0012
	Capabilities: [100] Advanced Error Reporting

0a:00.0 0300: 102b:0534 (prog-if 00 [VGA controller])
	DeviceName: Embedded Video                          
	Subsystem: 1028:04cf
	Flags: bus master, medium devsel, latency 64, IRQ 19, NUMA node 0
	Memory at d8000000 (32-bit, prefetchable) [size=16M]
	Memory at deffc000 (32-bit, non-prefetchable) [size=16K]
	Memory at de000000 (32-bit, non-prefetchable) [size=8M]
	Expansion ROM at 000c0000 [virtual] [disabled] [size=128K]
	Capabilities: [dc] Power Management version 1
	Kernel driver in use: mgag200
	Kernel modules: mgag200

3f:08.0 0880: 8086:0e80 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:09.0 0880: 8086:0e90 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0a.0 0880: 8086:0ec0 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0a.1 0880: 8086:0ec1 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0a.2 0880: 8086:0ec2 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0a.3 0880: 8086:0ec3 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0b.0 0880: 8086:0e1e (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0b.3 0880: 8086:0e1f (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0c.0 0880: 8086:0ee0 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0c.1 0880: 8086:0ee2 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0c.2 0880: 8086:0ee4 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0c.3 0880: 8086:0ee6 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0c.4 0880: 8086:0ee8 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0d.0 0880: 8086:0ee1 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0d.1 0880: 8086:0ee3 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0d.2 0880: 8086:0ee5 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0d.3 0880: 8086:0ee7 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0d.4 0880: 8086:0ee9 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:0e.0 0880: 8086:0ea0 (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 0

3f:0e.1 1101: 8086:0e30 (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 0
	Kernel driver in use: ivbep_uncore

3f:0f.0 0880: 8086:0ea8 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3f:0f.1 0880: 8086:0e71 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3f:0f.2 0880: 8086:0eaa (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3f:0f.3 0880: 8086:0eab (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3f:0f.4 0880: 8086:0eac (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3f:0f.5 0880: 8086:0ead (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3f:10.0 0880: 8086:0eb0 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: ivbep_uncore

3f:10.1 0880: 8086:0eb1 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: ivbep_uncore

3f:10.2 0880: 8086:0eb2 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3f:10.3 0880: 8086:0eb3 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3f:10.4 0880: 8086:0eb4 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: ivbep_uncore

3f:10.5 0880: 8086:0eb5 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: ivbep_uncore

3f:10.7 0880: 8086:0eb7 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3f:13.0 0880: 8086:0e1d (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:13.1 1101: 8086:0e34 (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 0
	Kernel driver in use: ivbep_uncore

3f:13.4 0880: 8086:0e81 (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 0

3f:13.5 1101: 8086:0e36 (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 0
	Kernel driver in use: ivbep_uncore

3f:16.0 0880: 8086:0ec8 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:16.1 0880: 8086:0ec9 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

3f:16.2 0880: 8086:0eca (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

40:01.0 0604: 8086:0e02 (rev 04) (prog-if 00 [Normal decode])
	DeviceName: SLOT 6
	Flags: bus master, fast devsel, latency 0, IRQ 36, NUMA node 1
	Bus: primary=40, secondary=41, subordinate=41, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: d4000000-d47fffff [size=8M]
	Prefetchable memory behind bridge: 00000000d0000000-00000000d27fffff [size=40M]
	Capabilities: [40] Subsystem: 1028:04cf
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] Secondary PCI Express
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Kernel driver in use: pcieport

40:02.0 0604: 8086:0e04 (rev 04) (prog-if 00 [Normal decode])
	DeviceName: SLOT 7
	Flags: bus master, fast devsel, latency 0, IRQ 37, NUMA node 1
	Bus: primary=40, secondary=42, subordinate=42, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: [disabled]
	Prefetchable memory behind bridge: [disabled]
	Capabilities: [40] Subsystem: 1028:04cf
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] Secondary PCI Express
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Kernel driver in use: pcieport

40:03.0 0604: 8086:0e08 (rev 04) (prog-if 00 [Normal decode])
	DeviceName: SLOT 5
	Flags: bus master, fast devsel, latency 0, IRQ 38, NUMA node 1
	Bus: primary=40, secondary=43, subordinate=43, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: d4800000-d57fffff [size=16M]
	Prefetchable memory behind bridge: [disabled]
	Capabilities: [40] Subsystem: 1028:04cf
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] Secondary PCI Express
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Kernel driver in use: pcieport

40:05.0 0880: 8086:0e28 (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

40:05.2 0880: 8086:0e2a (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

41:00.0 0200: 14e4:168e (rev 10)
	Subsystem: 14e4:1006
	Flags: bus master, fast devsel, latency 0, IRQ 51, NUMA node 1
	Memory at d0000000 (64-bit, prefetchable) [size=8M]
	Memory at d0800000 (64-bit, prefetchable) [size=8M]
	Memory at d27e0000 (64-bit, prefetchable) [size=64K]
	Expansion ROM at d4000000 [disabled] [size=512K]
	Capabilities: [48] Power Management version 3
	Capabilities: [50] Vital Product Data
	Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [a0] MSI-X: Enable+ Count=32 Masked-
	Capabilities: [ac] Express Endpoint, MSI 00
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [13c] Device Serial Number 00-0e-1e-ff-fe-9a-98-80
	Capabilities: [150] Power Budgeting <?>
	Capabilities: [160] Virtual Channel
	Capabilities: [1b8] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [220] Physical Resizable BAR
	Capabilities: [300] Secondary PCI Express
	Kernel driver in use: bnx2x
	Kernel modules: bnx2x

41:00.1 0200: 14e4:168e (rev 10)
	Subsystem: 14e4:1006
	Flags: bus master, fast devsel, latency 0, IRQ 83, NUMA node 1
	Memory at d1000000 (64-bit, prefetchable) [size=8M]
	Memory at d1800000 (64-bit, prefetchable) [size=8M]
	Memory at d27f0000 (64-bit, prefetchable) [size=64K]
	Expansion ROM at d4080000 [disabled] [size=512K]
	Capabilities: [48] Power Management version 3
	Capabilities: [50] Vital Product Data
	Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [a0] MSI-X: Enable+ Count=32 Masked-
	Capabilities: [ac] Express Endpoint, MSI 00
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [13c] Device Serial Number 00-0e-1e-ff-fe-9a-98-80
	Capabilities: [150] Power Budgeting <?>
	Capabilities: [160] Virtual Channel
	Capabilities: [1b8] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [220] Physical Resizable BAR
	Kernel driver in use: bnx2x
	Kernel modules: bnx2x

43:00.0 0108: 144d:a804 (prog-if 02 [NVM Express])
	Subsystem: 144d:a801
	Flags: bus master, fast devsel, latency 0, IRQ 49, NUMA node 1
	Memory at d57fc000 (64-bit, non-prefetchable) [size=16K]
	Expansion ROM at d4800000 [disabled] [size=128K]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable- Count=1/32 Maskable- 64bit+
	Capabilities: [70] Express Endpoint, MSI 00
	Capabilities: [b0] MSI-X: Enable+ Count=33 Masked-
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [148] Device Serial Number 00-00-00-00-00-00-00-00
	Capabilities: [158] Power Budgeting <?>
	Capabilities: [168] Secondary PCI Express
	Capabilities: [188] Latency Tolerance Reporting
	Capabilities: [190] L1 PM Substates
	Kernel driver in use: nvme
	Kernel modules: nvme

7f:08.0 0880: 8086:0e80 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:09.0 0880: 8086:0e90 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0a.0 0880: 8086:0ec0 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0a.1 0880: 8086:0ec1 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0a.2 0880: 8086:0ec2 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0a.3 0880: 8086:0ec3 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0b.0 0880: 8086:0e1e (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0b.3 0880: 8086:0e1f (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0c.0 0880: 8086:0ee0 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0c.1 0880: 8086:0ee2 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0c.2 0880: 8086:0ee4 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0c.3 0880: 8086:0ee6 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0c.4 0880: 8086:0ee8 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0d.0 0880: 8086:0ee1 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0d.1 0880: 8086:0ee3 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0d.2 0880: 8086:0ee5 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0d.3 0880: 8086:0ee7 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0d.4 0880: 8086:0ee9 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:0e.0 0880: 8086:0ea0 (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 1

7f:0e.1 1101: 8086:0e30 (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 1
	Kernel driver in use: ivbep_uncore

7f:0f.0 0880: 8086:0ea8 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:0f.1 0880: 8086:0e71 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:0f.2 0880: 8086:0eaa (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:0f.3 0880: 8086:0eab (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:0f.4 0880: 8086:0eac (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:0f.5 0880: 8086:0ead (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:10.0 0880: 8086:0eb0 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: ivbep_uncore

7f:10.1 0880: 8086:0eb1 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: ivbep_uncore

7f:10.2 0880: 8086:0eb2 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:10.3 0880: 8086:0eb3 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:10.4 0880: 8086:0eb4 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: ivbep_uncore

7f:10.5 0880: 8086:0eb5 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: ivbep_uncore

7f:10.7 0880: 8086:0eb7 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:13.0 0880: 8086:0e1d (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:13.1 1101: 8086:0e34 (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 1
	Kernel driver in use: ivbep_uncore

7f:13.4 0880: 8086:0e81 (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 1

7f:13.5 1101: 8086:0e36 (rev 04)
	Subsystem: 1028:04cf
	Flags: fast devsel, NUMA node 1
	Kernel driver in use: ivbep_uncore

7f:16.0 0880: 8086:0ec8 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:16.1 0880: 8086:0ec9 (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

7f:16.2 0880: 8086:0eca (rev 04)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1


^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-07  7:38       ` Wang Yugui
@ 2022-09-07  7:55         ` Thomas Zimmermann
  2022-09-07  8:47           ` Wang Yugui
  0 siblings, 1 reply; 21+ messages in thread
From: Thomas Zimmermann @ 2022-09-07  7:55 UTC (permalink / raw)
  To: Wang Yugui; +Cc: dri-devel


[-- Attachment #1.1: Type: text/plain, Size: 3795 bytes --]

Hi

Am 07.09.22 um 09:38 schrieb Wang Yugui:
> Hi,
> 
> 
>> Hi
>>
>> Am 07.09.22 um 06:16 schrieb Wang Yugui:
>>> Hi,
>>>
>>>> Am 02.09.22 um 07:52 schrieb Wang Yugui:
>>>>> Hi,
>>>>>
>>>>> mgag200 broken on kernel-6.0-rc3 on DELL/T620.
>>>>>
>>>>> See the attachementment file for the graph output.
>>>>
>>>> Thanks for reporting the bug. We recently refactored some code of the driver. Can you bisect to the change that introduced the problem?
>>>
>>> 5.19.3 works well on this DELL/T620.
>>>
>>> so this problem should be a regression of 6.0.
>>>
>>> other bisect seem difficult for me.
>>
>> OK, thank you. Can you provide the dmesg log of the broken machine and the output of 'sudo lspci -vn' please?
> 
> please see the attachment file for the output of 'lspci -vn'.

  0a:00.0 0300: 102b:0534 (prog-if 00 [VGA controller])

It's the G200ER. I'll try to find related code that we recently changed. 
I might get back to you for testing a patch. Thanks so far.

Best regards
Thomas

> 
> Best Regards
> Wang Yugui (wangyugui@e16-tech.com)
> 2022/09/07
> 
> 
>>
>> Best regards
>> Thomas
>>
>>>
>>> Best Regards
>>> Wang Yugui (wangyugui@e16-tech.com)
>>> 2022/09/07
>>>
>>>
>>>>
>>>> Best regards
>>>> Thomas
>>>>
>>>>>
>>>>> [root@T620 ~]# dmesg  |grep -i 'vga\|mga'
>>>>> [    0.588940] Console: colour VGA+ 80x25
>>>>> [    4.918214] pci 0000:0a:00.0: vgaarb: setting as boot VGA device
>>>>> [    4.919028] pci 0000:0a:00.0: vgaarb: bridge control possible
>>>>> [    4.919028] pci 0000:0a:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
>>>>> [    4.941058] vgaarb: loaded
>>>>> [    9.385485] mgag200 0000:0a:00.0: vgaarb: deactivate vga console
>>>>> [    9.510688] [drm] Initialized mgag200 1.0.0 20110418 for 0000:0a:00.0 on minor 0
>>>>> [    9.523145] fbcon: mgag200drmfb (fb0) is primary device
>>>>> [    9.641543] mgag200 0000:0a:00.0: [drm] fb0: mgag200drmfb frame buffer device
>>>>>
>>>>>
>>>>> more info:
>>>>> 1, This DELL/T620 works well with kernel 5.15.63,
>>>>>        so this is not a  hardware error.
>>>>>
>>>>> 2, DELL/T640 works well with kernel 6.0-rc and 5.15.63.
>>>>>        both DELL/T620 and DELL/T640 use the driver 'mgag200'.
>>>>>
>>>>> [root@T640 ~]#  dmesg  |grep -i 'vga\|mga'
>>>>> [   10.161500] pci 0000:03:00.0: vgaarb: setting as boot VGA device
>>>>> [   10.162463] pci 0000:03:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
>>>>> [   10.176527] pci 0000:03:00.0: vgaarb: bridge control possible
>>>>> [   10.182465] vgaarb: loaded
>>>>> [   11.832839] fb0: EFI VGA frame buffer device
>>>>> [   21.303826] mgag200 0000:03:00.0: vgaarb: deactivate vga console
>>>>> [   21.319498] [drm] Initialized mgag200 1.0.0 20110418 for 0000:03:00.0 on minor 0
>>>>> [   21.330223] fbcon: mgag200drmfb (fb0) is primary device
>>>>> [   21.332140] mgag200 0000:03:00.0: [drm] drm_plane_enable_fb_damage_clips() not called
>>>>> [   21.741629] mgag200 0000:03:00.0: [drm] fb0: mgag200drmfb frame buffer device
>>>>>
>>>>> Best Regards
>>>>> Wang Yugui (wangyugui@e16-tech.com)
>>>>> 2022/09/02
>>>>>
>>>> -- Thomas Zimmermann
>>>> Graphics Driver Developer
>>>> SUSE Software Solutions Germany GmbH
>>>> Maxfeldstr. 5, 90409 Nürnberg, Germany
>>>> (HRB 36809, AG Nürnberg)
>>>> Gesch?ftsführer: Ivo Totev
>>>
>>>
>> -- Thomas Zimmermann
>> Graphics Driver Developer
>> SUSE Software Solutions Germany GmbH
>> Maxfeldstr. 5, 90409 Nürnberg, Germany
>> (HRB 36809, AG Nürnberg)
>> Gesch?ftsführer: Ivo Totev
> 

-- 
Thomas Zimmermann
Graphics Driver Developer
SUSE Software Solutions Germany GmbH
Maxfeldstr. 5, 90409 Nürnberg, Germany
(HRB 36809, AG Nürnberg)
Geschäftsführer: Ivo Totev

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 840 bytes --]

^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-07  7:55         ` Thomas Zimmermann
@ 2022-09-07  8:47           ` Wang Yugui
  2022-09-07  9:18             ` Thomas Zimmermann
  0 siblings, 1 reply; 21+ messages in thread
From: Wang Yugui @ 2022-09-07  8:47 UTC (permalink / raw)
  To: Thomas Zimmermann; +Cc: dri-devel

[-- Attachment #1: Type: text/plain, Size: 1337 bytes --]

Hi,

> Am 07.09.22 um 09:38 schrieb Wang Yugui:
> > Hi,
> >
> >
> >> Hi
> >>
> >> Am 07.09.22 um 06:16 schrieb Wang Yugui:
> >>> Hi,
> >>>
> >>>> Am 02.09.22 um 07:52 schrieb Wang Yugui:
> >>>>> Hi,
> >>>>>
> >>>>> mgag200 broken on kernel-6.0-rc3 on DELL/T620.
> >>>>>
> >>>>> See the attachementment file for the graph output.
> >>>>
> >>>> Thanks for reporting the bug. We recently refactored some code of the driver. Can you bisect to the change that introduced the problem?
> >>>
> >>> 5.19.3 works well on this DELL/T620.
> >>>
> >>> so this problem should be a regression of 6.0.
> >>>
> >>> other bisect seem difficult for me.
> >>
> >> OK, thank you. Can you provide the dmesg log of the broken machine and the output of 'sudo lspci -vn' please?
> >
> > please see the attachment file for the output of 'lspci -vn'.
> 
>   0a:00.0 0300: 102b:0534 (prog-if 00 [VGA controller])
> 
> It's the G200ER. I'll try to find related code that we recently changed. I might get back to you for testing a patch. Thanks so far.

the patch based on kernel 6.0(rc4) will be easy to build and test here.

By the way, this problem happen on DELL/T630 too.
but it does not happen on DELL/T640.

please see the attachment file for the output of 'lspci -vn' on
DELL/T630 and DELL/T640.

Best Regards
Wang Yugui (wangyugui@e16-tech.com)
2022/09/07


[-- Attachment #2: lspci-vn.T630.tx --]
[-- Type: application/octet-stream, Size: 46207 bytes --]

00:00.0 0600: 8086:6f00 (rev 01)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [90] Express Root Port (Slot-), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [144] Vendor Specific Information: ID=0004 Rev=1 Len=03c <?>
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>

00:01.0 0604: 8086:6f02 (rev 01) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 25, NUMA node 0
	Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
	I/O behind bridge: 00003000-00003fff
	Memory behind bridge: 96000000-961fffff
	Capabilities: [40] Subsystem: 8086:0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport

00:02.0 0604: 8086:6f04 (rev 01) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 26, NUMA node 0
	Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
	Memory behind bridge: 96300000-964fffff
	Prefetchable memory behind bridge: 0000000090000000-0000000093ffffff
	Capabilities: [40] Subsystem: 8086:0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport

00:03.0 0604: 8086:6f08 (rev 01) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 27, NUMA node 0
	Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
	I/O behind bridge: 00002000-00002fff
	Memory behind bridge: 95e00000-95ffffff
	Capabilities: [40] Subsystem: 8086:0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport

00:04.0 0880: 8086:6f20 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 518, NUMA node 0
	Memory at 3bffff1c000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

00:04.1 0880: 8086:6f21 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 520, NUMA node 0
	Memory at 3bffff18000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

00:04.2 0880: 8086:6f22 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 518, NUMA node 0
	Memory at 3bffff14000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

00:04.3 0880: 8086:6f23 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 520, NUMA node 0
	Memory at 3bffff10000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

00:04.4 0880: 8086:6f24 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 518, NUMA node 0
	Memory at 3bffff0c000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

00:04.5 0880: 8086:6f25 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 520, NUMA node 0
	Memory at 3bffff08000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

00:04.6 0880: 8086:6f26 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 518, NUMA node 0
	Memory at 3bffff04000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

00:04.7 0880: 8086:6f27 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 520, NUMA node 0
	Memory at 3bffff00000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

00:05.0 0880: 8086:6f28 (rev 01)
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:05.1 0880: 8086:6f29 (rev 01)
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [100] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>
	Capabilities: [110] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>
	Capabilities: [120] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>
	Capabilities: [130] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>

00:05.2 0880: 8086:6f2a (rev 01)
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:05.4 0800: 8086:6f2c (rev 01) (prog-if 20 [IO(X)-APIC])
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, NUMA node 0
	Memory at 96214000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3

00:11.0 ff00: 8086:8d7c (rev 05)
	Subsystem: 1028:0602
	Flags: bus master, fast devsel, latency 0, NUMA node 0
	Expansion ROM at 96220000 [disabled] [size=64K]
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [80] Power Management version 3

00:11.4 0106: 8086:8d62 (rev 05) (prog-if 01 [AHCI 1.0])
	Subsystem: 1028:0602
	Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 316, NUMA node 0
	I/O ports at 4078 [size=8]
	I/O ports at 408c [size=4]
	I/O ports at 4070 [size=8]
	I/O ports at 4088 [size=4]
	I/O ports at 4040 [size=32]
	Memory at 96211000 (32-bit, non-prefetchable) [size=2K]
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [70] Power Management version 3
	Capabilities: [a8] SATA HBA v1.0
	Kernel driver in use: ahci
	Kernel modules: ahci

00:14.0 0c03: 8086:8d31 (rev 05) (prog-if 30 [XHCI])
	Subsystem: 1028:0602
	Flags: bus master, medium devsel, latency 0, IRQ 39, NUMA node 0
	Memory at 96200000 (64-bit, non-prefetchable) [size=64K]
	Capabilities: [70] Power Management version 2
	Capabilities: [80] MSI: Enable+ Count=1/8 Maskable- 64bit+
	Kernel driver in use: xhci_hcd

00:16.0 0780: 8086:8d3a (rev 05)
	Subsystem: 1028:0602
	Flags: bus master, fast devsel, latency 0, IRQ 255, NUMA node 0
	Memory at 3bffff23000 (64-bit, non-prefetchable) [size=16]
	Capabilities: [50] Power Management version 3
	Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+
	Kernel modules: mei_me

00:16.1 0780: 8086:8d3b (rev 05)
	Subsystem: 1028:0602
	Flags: bus master, fast devsel, latency 0, IRQ 255, NUMA node 0
	Memory at 3bffff22000 (64-bit, non-prefetchable) [size=16]
	Capabilities: [50] Power Management version 3
	Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+

00:1a.0 0c03: 8086:8d2d (rev 05) (prog-if 20 [EHCI])
	Subsystem: 1028:0602
	Flags: bus master, medium devsel, latency 0, IRQ 18, NUMA node 0
	Memory at 96213000 (32-bit, non-prefetchable) [size=1K]
	Capabilities: [50] Power Management version 2
	Capabilities: [58] Debug port: BAR=1 offset=00a0
	Capabilities: [98] PCI Advanced Features
	Kernel driver in use: ehci-pci

00:1c.0 0604: 8086:8d10 (rev d5) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 28, NUMA node 0
	Bus: primary=00, secondary=05, subordinate=05, sec-latency=0
	Capabilities: [40] Express Root Port (Slot-), MSI 00
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: 1028:0602
	Capabilities: [a0] Power Management version 3
	Kernel driver in use: pcieport

00:1c.1 0604: 8086:8d12 (rev d5) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 29, NUMA node 0
	Bus: primary=00, secondary=06, subordinate=0a, sec-latency=0
	Memory behind bridge: 95000000-959fffff
	Prefetchable memory behind bridge: 0000000094000000-0000000094ffffff
	Capabilities: [40] Express Root Port (Slot+), MSI 00
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: 1028:0602
	Capabilities: [a0] Power Management version 3
	Capabilities: [100] Advanced Error Reporting
	Kernel driver in use: pcieport

00:1c.2 0604: 8086:8d14 (rev d5) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 30, NUMA node 0
	Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
	Memory behind bridge: 95b00000-95dfffff
	Capabilities: [40] Express Root Port (Slot+), MSI 00
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: 1028:0602
	Capabilities: [a0] Power Management version 3
	Capabilities: [100] Advanced Error Reporting
	Kernel driver in use: pcieport

00:1c.4 0604: 8086:8d18 (rev d5) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 31, NUMA node 0
	Bus: primary=00, secondary=0b, subordinate=0b, sec-latency=0
	Memory behind bridge: 95a00000-95afffff
	Capabilities: [40] Express Root Port (Slot+), MSI 00
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: 1028:0602
	Capabilities: [a0] Power Management version 3
	Capabilities: [100] Advanced Error Reporting
	Kernel driver in use: pcieport

00:1d.0 0c03: 8086:8d26 (rev 05) (prog-if 20 [EHCI])
	Subsystem: 1028:0602
	Flags: bus master, medium devsel, latency 0, IRQ 18, NUMA node 0
	Memory at 96212000 (32-bit, non-prefetchable) [size=1K]
	Capabilities: [50] Power Management version 2
	Capabilities: [58] Debug port: BAR=1 offset=00a0
	Capabilities: [98] PCI Advanced Features
	Kernel driver in use: ehci-pci

00:1f.0 0601: 8086:8d44 (rev 05)
	Subsystem: 1028:0602
	Flags: bus master, medium devsel, latency 0, NUMA node 0
	Capabilities: [e0] Vendor Specific Information: Len=0c <?>
	Kernel driver in use: lpc_ich
	Kernel modules: lpc_ich

00:1f.2 0106: 8086:8d02 (rev 05) (prog-if 01 [AHCI 1.0])
	Subsystem: 1028:0602
	Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 375, NUMA node 0
	I/O ports at 4068 [size=8]
	I/O ports at 4084 [size=4]
	I/O ports at 4060 [size=8]
	I/O ports at 4080 [size=4]
	I/O ports at 4020 [size=32]
	Memory at 96210000 (32-bit, non-prefetchable) [size=2K]
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [70] Power Management version 3
	Capabilities: [a8] SATA HBA v1.0
	Kernel driver in use: ahci
	Kernel modules: ahci

01:00.0 0200: 8086:1521 (rev 01)
	Subsystem: 1028:0602
	Flags: bus master, fast devsel, latency 0, IRQ 18, NUMA node 0
	Memory at 95c00000 (32-bit, non-prefetchable) [size=1M]
	Memory at 95d04000 (32-bit, non-prefetchable) [size=16K]
	Expansion ROM at <ignored> [disabled]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
	Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
	Capabilities: [a0] Express Endpoint, MSI 00
	Capabilities: [e0] Vital Product Data
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [140] Device Serial Number 44-a8-42-ff-ff-29-8b-57
	Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [1a0] Transaction Processing Hints
	Capabilities: [1c0] Latency Tolerance Reporting
	Capabilities: [1d0] Access Control Services
	Kernel driver in use: igb
	Kernel modules: igb

01:00.1 0200: 8086:1521 (rev 01)
	Subsystem: 1028:0602
	Flags: bus master, fast devsel, latency 0, IRQ 19, NUMA node 0
	Memory at 95b00000 (32-bit, non-prefetchable) [size=1M]
	Memory at 95d00000 (32-bit, non-prefetchable) [size=16K]
	Expansion ROM at <ignored> [disabled]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
	Capabilities: [70] MSI-X: Enable+ Count=10 Masked-
	Capabilities: [a0] Express Endpoint, MSI 00
	Capabilities: [e0] Vital Product Data
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [140] Device Serial Number 44-a8-42-ff-ff-29-8b-57
	Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [1a0] Transaction Processing Hints
	Capabilities: [1d0] Access Control Services
	Kernel driver in use: igb
	Kernel modules: igb

02:00.0 0104: 1000:005d (rev 02)
	Subsystem: 1028:1f41
	Flags: bus master, fast devsel, latency 0, IRQ 41, NUMA node 0
	I/O ports at 2000 [size=256]
	Memory at 95f00000 (64-bit, non-prefetchable) [size=64K]
	Memory at 95e00000 (64-bit, non-prefetchable) [size=1M]
	Expansion ROM at <ignored> [disabled]
	Capabilities: [50] Power Management version 3
	Capabilities: [68] Express Endpoint, MSI 00
	Capabilities: [a8] MSI: Enable- Count=1/1 Maskable+ 64bit+
	Capabilities: [c0] MSI-X: Enable+ Count=97 Masked-
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [1e0] #19
	Capabilities: [1c0] Power Budgeting <?>
	Capabilities: [148] Alternative Routing-ID Interpretation (ARI)
	Kernel driver in use: megaraid_sas
	Kernel modules: megaraid_sas

03:00.0 0104: 1000:005d (rev 02)
	Subsystem: 1028:1f42
	Flags: bus master, fast devsel, latency 0, IRQ 317, NUMA node 0
	I/O ports at 3000 [size=256]
	Memory at 96100000 (64-bit, non-prefetchable) [size=64K]
	Memory at 96000000 (64-bit, non-prefetchable) [size=1M]
	Expansion ROM at <ignored> [disabled]
	Capabilities: [50] Power Management version 3
	Capabilities: [68] Express Endpoint, MSI 00
	Capabilities: [a8] MSI: Enable- Count=1/1 Maskable+ 64bit+
	Capabilities: [c0] MSI-X: Enable+ Count=97 Masked-
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [1e0] #19
	Capabilities: [1c0] Power Budgeting <?>
	Capabilities: [148] Alternative Routing-ID Interpretation (ARI)
	Kernel driver in use: megaraid_sas
	Kernel modules: megaraid_sas

04:00.0 0207: 15b3:1013
	Subsystem: 15b3:0034
	Flags: bus master, fast devsel, latency 0, IRQ 376, NUMA node 0
	Memory at 92000000 (64-bit, prefetchable) [size=32M]
	Expansion ROM at 96300000 [disabled] [size=1M]
	Capabilities: [60] Express Endpoint, MSI 00
	Capabilities: [48] Vital Product Data
	Capabilities: [9c] MSI-X: Enable+ Count=64 Masked-
	Capabilities: [c0] Vendor Specific Information: Len=18 <?>
	Capabilities: [40] Power Management version 3
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [1c0] #19
	Capabilities: [230] Access Control Services
	Kernel driver in use: mlx5_core
	Kernel modules: mlx5_core

04:00.1 0200: 15b3:1013
	Subsystem: 15b3:0034
	Flags: bus master, fast devsel, latency 0, IRQ 460, NUMA node 0
	Memory at 90000000 (64-bit, prefetchable) [size=32M]
	Expansion ROM at 96400000 [disabled] [size=1M]
	Capabilities: [60] Express Endpoint, MSI 00
	Capabilities: [48] Vital Product Data
	Capabilities: [9c] MSI-X: Enable+ Count=64 Masked-
	Capabilities: [c0] Vendor Specific Information: Len=18 <?>
	Capabilities: [40] Power Management version 3
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [230] Access Control Services
	Kernel driver in use: mlx5_core
	Kernel modules: mlx5_core

06:00.0 0604: 1912:001d (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 32, NUMA node 0
	BIST result: 00
	Bus: primary=06, secondary=07, subordinate=0a, sec-latency=0
	Memory behind bridge: 95000000-959fffff
	Prefetchable memory behind bridge: 0000000094000000-0000000094ffffff
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [70] Express Upstream Port, MSI 00
	Capabilities: [b0] Subsystem: 1912:001d
	Capabilities: [100] Advanced Error Reporting
	Kernel driver in use: pcieport

07:00.0 0604: 1912:001d (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 33, NUMA node 0
	BIST result: 00
	Bus: primary=07, secondary=08, subordinate=09, sec-latency=0
	Memory behind bridge: 95000000-958fffff
	Prefetchable memory behind bridge: 0000000094000000-0000000094ffffff
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [70] Express Downstream Port (Slot-), MSI 00
	Capabilities: [b0] Subsystem: 1912:001d
	Capabilities: [100] Advanced Error Reporting
	Kernel driver in use: pcieport

08:00.0 0604: 1912:001a (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, NUMA node 0
	BIST result: 00
	Bus: primary=08, secondary=09, subordinate=09, sec-latency=0
	Memory behind bridge: 95000000-958fffff
	Prefetchable memory behind bridge: 0000000094000000-0000000094ffffff
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [70] Express PCI-Express to PCI/PCI-X Bridge, MSI 00
	Capabilities: [b0] Subsystem: 1912:001a
	Capabilities: [100] Advanced Error Reporting

09:00.0 0300: 102b:0534 (rev 01) (prog-if 00 [VGA controller])
	Subsystem: 1028:0602
	Flags: bus master, medium devsel, latency 64, IRQ 17, NUMA node 0
	Memory at 94000000 (32-bit, prefetchable) [size=16M]
	Memory at 95800000 (32-bit, non-prefetchable) [size=16K]
	Memory at 95000000 (32-bit, non-prefetchable) [size=8M]
	[virtual] Expansion ROM at 000c0000 [disabled] [size=128K]
	Capabilities: [dc] Power Management version 1
	Kernel driver in use: mgag200
	Kernel modules: mgag200

0b:00.0 0108: 144d:a820 (rev 03) (prog-if 02 [NVM Express])
	Subsystem: 1028:1fa4
	Flags: bus master, fast devsel, latency 0, IRQ 16, NUMA node 0
	Memory at 95a00000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [c0] Power Management version 3
	Capabilities: [c8] MSI: Enable- Count=1/32 Maskable+ 64bit+
	Capabilities: [e0] MSI-X: Enable+ Count=129 Masked-
	Capabilities: [70] Express Endpoint, MSI 00
	Capabilities: [40] Vendor Specific Information: Len=24 <?>
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [180] #19
	Capabilities: [150] Vendor Specific Information: ID=0001 Rev=1 Len=02c <?>
	Kernel driver in use: nvme
	Kernel modules: nvme

7f:08.0 0880: 8086:6f80 (rev 01)
	Subsystem: 8086:6f80
	Flags: fast devsel

7f:08.2 1101: 8086:6f32 (rev 01)
	Subsystem: 8086:6f32
	Flags: fast devsel
	Kernel driver in use: bdx_uncore

7f:08.3 0880: 8086:6f83 (rev 01)
	Subsystem: 8086:6f83
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=0 Len=0f0 <?>

7f:09.0 0880: 8086:6f90 (rev 01)
	Subsystem: 8086:6f90
	Flags: fast devsel

7f:09.2 1101: 8086:6f33 (rev 01)
	Subsystem: 8086:6f33
	Flags: fast devsel
	Kernel driver in use: bdx_uncore

7f:09.3 0880: 8086:6f93 (rev 01)
	Subsystem: 8086:6f93
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=0 Len=0f0 <?>

7f:0b.0 0880: 8086:6f81 (rev 01)
	Subsystem: 8086:6f81
	Flags: fast devsel

7f:0b.1 1101: 8086:6f36 (rev 01)
	Subsystem: 8086:6f36
	Flags: fast devsel
	Kernel driver in use: bdx_uncore

7f:0b.2 1101: 8086:6f37 (rev 01)
	Subsystem: 8086:6f37
	Flags: fast devsel
	Kernel driver in use: bdx_uncore

7f:0b.3 0880: 8086:6f76 (rev 01)
	Flags: fast devsel

7f:0c.0 0880: 8086:6fe0 (rev 01)
	Subsystem: 8086:6fe0
	Flags: fast devsel

7f:0c.1 0880: 8086:6fe1 (rev 01)
	Subsystem: 8086:6fe1
	Flags: fast devsel

7f:0c.2 0880: 8086:6fe2 (rev 01)
	Subsystem: 8086:6fe2
	Flags: fast devsel

7f:0c.3 0880: 8086:6fe3 (rev 01)
	Subsystem: 8086:6fe3
	Flags: fast devsel

7f:0c.4 0880: 8086:6fe4 (rev 01)
	Subsystem: 8086:6fe4
	Flags: fast devsel

7f:0c.5 0880: 8086:6fe5 (rev 01)
	Subsystem: 8086:6fe5
	Flags: fast devsel

7f:0c.6 0880: 8086:6fe6 (rev 01)
	Subsystem: 8086:6fe6
	Flags: fast devsel

7f:0c.7 0880: 8086:6fe7 (rev 01)
	Subsystem: 8086:6fe7
	Flags: fast devsel

7f:0d.0 0880: 8086:6fe8 (rev 01)
	Subsystem: 8086:6fe8
	Flags: fast devsel

7f:0d.1 0880: 8086:6fe9 (rev 01)
	Subsystem: 8086:6fe9
	Flags: fast devsel

7f:0d.2 0880: 8086:6fea (rev 01)
	Subsystem: 8086:6fea
	Flags: fast devsel

7f:0d.3 0880: 8086:6feb (rev 01)
	Subsystem: 8086:6feb
	Flags: fast devsel

7f:0d.4 0880: 8086:6fec (rev 01)
	Subsystem: 8086:6fec
	Flags: fast devsel

7f:0d.5 0880: 8086:6fed (rev 01)
	Subsystem: 8086:6fed
	Flags: fast devsel

7f:0f.0 0880: 8086:6ff8 (rev 01)
	Subsystem: 8086:6ff8
	Flags: fast devsel

7f:0f.1 0880: 8086:6ff9 (rev 01)
	Subsystem: 8086:6ff9
	Flags: fast devsel

7f:0f.2 0880: 8086:6ffa (rev 01)
	Subsystem: 8086:6ffa
	Flags: fast devsel

7f:0f.3 0880: 8086:6ffb (rev 01)
	Subsystem: 8086:6ffb
	Flags: fast devsel

7f:0f.4 0880: 8086:6ffc (rev 01)
	Subsystem: 8086:6fe0
	Flags: fast devsel

7f:0f.5 0880: 8086:6ffd (rev 01)
	Subsystem: 8086:6fe0
	Flags: fast devsel

7f:0f.6 0880: 8086:6ffe (rev 01)
	Subsystem: 8086:6fe0
	Flags: fast devsel

7f:10.0 0880: 8086:6f1d (rev 01)
	Subsystem: 8086:6f1d
	Flags: fast devsel

7f:10.1 1101: 8086:6f34 (rev 01)
	Subsystem: 8086:6f34
	Flags: fast devsel
	Kernel driver in use: bdx_uncore

7f:10.5 0880: 8086:6f1e (rev 01)
	Subsystem: 8086:6f1e
	Flags: fast devsel

7f:10.6 1101: 8086:6f7d (rev 01)
	Subsystem: 8086:6f7d
	Flags: fast devsel

7f:10.7 0880: 8086:6f1f (rev 01)
	Subsystem: 8086:6f1f
	Flags: fast devsel

7f:12.0 0880: 8086:6fa0 (rev 01)
	Subsystem: 8086:6fa0
	Flags: fast devsel

7f:12.1 1101: 8086:6f30 (rev 01)
	Subsystem: 8086:6f30
	Flags: fast devsel
	Kernel driver in use: bdx_uncore

7f:12.2 0880: 8086:6f70 (rev 01)
	Subsystem: 8086:6f70
	Flags: fast devsel

7f:12.4 0880: 8086:6f60 (rev 01)
	Subsystem: 8086:6f60
	Flags: fast devsel

7f:12.5 1101: 8086:6f38 (rev 01)
	Subsystem: 8086:6f38
	Flags: fast devsel
	Kernel driver in use: bdx_uncore

7f:12.6 0880: 8086:6f78 (rev 01)
	Subsystem: 8086:6f78
	Flags: fast devsel

7f:13.0 0880: 8086:6fa8 (rev 01)
	Subsystem: 8086:6fa8
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:13.1 0880: 8086:6f71 (rev 01)
	Subsystem: 8086:6f71
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:13.2 0880: 8086:6faa (rev 01)
	Subsystem: 8086:6faa
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:13.3 0880: 8086:6fab (rev 01)
	Subsystem: 8086:6fab
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:13.6 0880: 8086:6fae (rev 01)
	Flags: fast devsel

7f:13.7 0880: 8086:6faf (rev 01)
	Flags: fast devsel

7f:14.0 0880: 8086:6fb0 (rev 01)
	Subsystem: 8086:6fb0
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: bdx_uncore

7f:14.1 0880: 8086:6fb1 (rev 01)
	Subsystem: 8086:6fb1
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: bdx_uncore

7f:14.2 0880: 8086:6fb2 (rev 01)
	Subsystem: 8086:6fb2
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:14.3 0880: 8086:6fb3 (rev 01)
	Subsystem: 8086:6fb3
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:14.4 0880: 8086:6fbc (rev 01)
	Flags: fast devsel

7f:14.5 0880: 8086:6fbd (rev 01)
	Flags: fast devsel

7f:14.6 0880: 8086:6fbe (rev 01)
	Flags: fast devsel

7f:14.7 0880: 8086:6fbf (rev 01)
	Flags: fast devsel

7f:16.0 0880: 8086:6f68 (rev 01)
	Subsystem: 8086:6f68
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:16.1 0880: 8086:6f79 (rev 01)
	Subsystem: 8086:6f79
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:16.2 0880: 8086:6f6a (rev 01)
	Subsystem: 8086:6f6a
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:16.3 0880: 8086:6f6b (rev 01)
	Subsystem: 8086:6f6b
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:16.6 0880: 8086:6f6e (rev 01)
	Flags: fast devsel

7f:16.7 0880: 8086:6f6f (rev 01)
	Flags: fast devsel

7f:17.0 0880: 8086:6fd0 (rev 01)
	Subsystem: 8086:6fd0
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: bdx_uncore

7f:17.1 0880: 8086:6fd1 (rev 01)
	Subsystem: 8086:6fd1
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: bdx_uncore

7f:17.2 0880: 8086:6fd2 (rev 01)
	Subsystem: 8086:6fd2
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:17.3 0880: 8086:6fd3 (rev 01)
	Subsystem: 8086:6fd3
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

7f:17.4 0880: 8086:6fb8 (rev 01)
	Flags: fast devsel

7f:17.5 0880: 8086:6fb9 (rev 01)
	Flags: fast devsel

7f:17.6 0880: 8086:6fba (rev 01)
	Flags: fast devsel

7f:17.7 0880: 8086:6fbb (rev 01)
	Flags: fast devsel

7f:1e.0 0880: 8086:6f98 (rev 01)
	Subsystem: 8086:6f98
	Flags: fast devsel

7f:1e.1 0880: 8086:6f99 (rev 01)
	Subsystem: 8086:6f99
	Flags: fast devsel

7f:1e.2 0880: 8086:6f9a (rev 01)
	Subsystem: 8086:6f9a
	Flags: fast devsel

7f:1e.3 0880: 8086:6fc0 (rev 01)
	Subsystem: 8086:6fc0
	Flags: fast devsel
	Memory at <ignored> (low-1M, prefetchable) [disabled]

7f:1e.4 0880: 8086:6f9c (rev 01)
	Subsystem: 8086:6f9c
	Flags: fast devsel

7f:1f.0 0880: 8086:6f88 (rev 01)
	Flags: fast devsel

7f:1f.2 0880: 8086:6f8a (rev 01)
	Flags: fast devsel

80:00.0 0604: 8086:6f01 (rev 01) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 35, NUMA node 1
	Bus: primary=80, secondary=81, subordinate=81, sec-latency=0
	Capabilities: [40] Subsystem: 8086:0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport

80:01.0 0604: 8086:6f02 (rev 01) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 36, NUMA node 1
	Bus: primary=80, secondary=82, subordinate=82, sec-latency=0
	Memory behind bridge: c8500000-c85fffff
	Prefetchable memory behind bridge: 00000000c8000000-00000000c80fffff
	Capabilities: [40] Subsystem: 8086:0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport

80:02.0 0604: 8086:6f04 (rev 01) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 37, NUMA node 1
	Bus: primary=80, secondary=83, subordinate=83, sec-latency=0
	Capabilities: [40] Subsystem: 8086:0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport

80:03.0 0604: 8086:6f08 (rev 01) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 38, NUMA node 1
	Bus: primary=80, secondary=84, subordinate=84, sec-latency=0
	I/O behind bridge: 00008000-00008fff
	Memory behind bridge: c8300000-c83fffff
	Prefetchable memory behind bridge: 00000000c8100000-00000000c82fffff
	Capabilities: [40] Subsystem: 8086:0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport

80:04.0 0880: 8086:6f20 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 528, NUMA node 1
	Memory at 3fffff1c000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

80:04.1 0880: 8086:6f21 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 530, NUMA node 1
	Memory at 3fffff18000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

80:04.2 0880: 8086:6f22 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 528, NUMA node 1
	Memory at 3fffff14000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

80:04.3 0880: 8086:6f23 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 530, NUMA node 1
	Memory at 3fffff10000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

80:04.4 0880: 8086:6f24 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 528, NUMA node 1
	Memory at 3fffff0c000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

80:04.5 0880: 8086:6f25 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 530, NUMA node 1
	Memory at 3fffff08000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

80:04.6 0880: 8086:6f26 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 528, NUMA node 1
	Memory at 3fffff04000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

80:04.7 0880: 8086:6f27 (rev 01)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 530, NUMA node 1
	Memory at 3fffff00000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
	Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3
	Kernel driver in use: ioatdma
	Kernel modules: ioatdma

80:05.0 0880: 8086:6f28 (rev 01)
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

80:05.1 0880: 8086:6f29 (rev 01)
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [100] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>
	Capabilities: [110] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>
	Capabilities: [120] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>
	Capabilities: [130] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>

80:05.2 0880: 8086:6f2a (rev 01)
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

80:05.4 0800: 8086:6f2c (rev 01) (prog-if 20 [IO(X)-APIC])
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, NUMA node 1
	Memory at c8400000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3

82:00.0 0200: 14e4:16d1 (rev 01)
	Subsystem: 14e4:4041
	Flags: bus master, fast devsel, latency 0, IRQ 157, NUMA node 1
	Memory at c8020000 (64-bit, prefetchable) [size=64K]
	Memory at c8030000 (64-bit, prefetchable) [size=64K]
	Memory at c8042000 (64-bit, prefetchable) [size=8K]
	Expansion ROM at c8500000 [disabled] [size=512K]
	Capabilities: [48] Power Management version 3
	Capabilities: [50] Vital Product Data
	Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [a0] MSI-X: Enable+ Count=74 Masked-
	Capabilities: [ac] Express Endpoint, MSI 00
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [13c] Device Serial Number 00-0a-f7-ff-fe-94-f5-10
	Capabilities: [150] Power Budgeting <?>
	Capabilities: [160] Virtual Channel
	Capabilities: [180] Vendor Specific Information: ID=0000 Rev=0 Len=020 <?>
	Capabilities: [1b0] Latency Tolerance Reporting
	Capabilities: [1b8] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [230] Transaction Processing Hints
	Capabilities: [300] #19
	Capabilities: [200] Precision Time Measurement
	Kernel driver in use: bnxt_en
	Kernel modules: bnxt_en

82:00.1 0200: 14e4:16d1 (rev 01)
	Subsystem: 14e4:4041
	Flags: bus master, fast devsel, latency 0, IRQ 232, NUMA node 1
	Memory at c8000000 (64-bit, prefetchable) [size=64K]
	Memory at c8010000 (64-bit, prefetchable) [size=64K]
	Memory at c8040000 (64-bit, prefetchable) [size=8K]
	Expansion ROM at c8580000 [disabled] [size=512K]
	Capabilities: [48] Power Management version 3
	Capabilities: [50] Vital Product Data
	Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [a0] MSI-X: Enable+ Count=74 Masked-
	Capabilities: [ac] Express Endpoint, MSI 00
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [13c] Device Serial Number 00-0a-f7-ff-fe-94-f5-10
	Capabilities: [150] Power Budgeting <?>
	Capabilities: [180] Vendor Specific Information: ID=0000 Rev=0 Len=020 <?>
	Capabilities: [1b8] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [230] Transaction Processing Hints
	Kernel driver in use: bnxt_en
	Kernel modules: bnxt_en

84:00.0 0104: 1000:0014 (rev 01)
	Subsystem: 1d49:0604
	Flags: bus master, fast devsel, latency 0, IRQ 377, NUMA node 1
	Memory at c8100000 (64-bit, prefetchable) [size=1M]
	Memory at c8200000 (64-bit, prefetchable) [size=1M]
	Memory at c8300000 (32-bit, non-prefetchable) [size=1M]
	I/O ports at 8000 [size=256]
	Expansion ROM at <ignored> [disabled]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
	Capabilities: [70] Express Endpoint, MSI 00
	Capabilities: [b0] MSI-X: Enable+ Count=17 Masked-
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [148] Power Budgeting <?>
	Capabilities: [158] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [168] #19
	Capabilities: [254] #16
	Capabilities: [284] Vendor Specific Information: ID=0002 Rev=1 Len=100 <?>
	Capabilities: [384] Vendor Specific Information: ID=0001 Rev=1 Len=038 <?>
	Capabilities: [3bc] #15
	Kernel driver in use: megaraid_sas
	Kernel modules: megaraid_sas

ff:08.0 0880: 8086:6f80 (rev 01)
	Subsystem: 8086:6f80
	Flags: fast devsel

ff:08.2 1101: 8086:6f32 (rev 01)
	Subsystem: 8086:6f32
	Flags: fast devsel
	Kernel driver in use: bdx_uncore

ff:08.3 0880: 8086:6f83 (rev 01)
	Subsystem: 8086:6f83
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=0 Len=0f0 <?>

ff:09.0 0880: 8086:6f90 (rev 01)
	Subsystem: 8086:6f90
	Flags: fast devsel

ff:09.2 1101: 8086:6f33 (rev 01)
	Subsystem: 8086:6f33
	Flags: fast devsel
	Kernel driver in use: bdx_uncore

ff:09.3 0880: 8086:6f93 (rev 01)
	Subsystem: 8086:6f93
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=0 Len=0f0 <?>

ff:0b.0 0880: 8086:6f81 (rev 01)
	Subsystem: 8086:6f81
	Flags: fast devsel

ff:0b.1 1101: 8086:6f36 (rev 01)
	Subsystem: 8086:6f36
	Flags: fast devsel
	Kernel driver in use: bdx_uncore

ff:0b.2 1101: 8086:6f37 (rev 01)
	Subsystem: 8086:6f37
	Flags: fast devsel
	Kernel driver in use: bdx_uncore

ff:0b.3 0880: 8086:6f76 (rev 01)
	Flags: fast devsel

ff:0c.0 0880: 8086:6fe0 (rev 01)
	Subsystem: 8086:6fe0
	Flags: fast devsel

ff:0c.1 0880: 8086:6fe1 (rev 01)
	Subsystem: 8086:6fe1
	Flags: fast devsel

ff:0c.2 0880: 8086:6fe2 (rev 01)
	Subsystem: 8086:6fe2
	Flags: fast devsel

ff:0c.3 0880: 8086:6fe3 (rev 01)
	Subsystem: 8086:6fe3
	Flags: fast devsel

ff:0c.4 0880: 8086:6fe4 (rev 01)
	Subsystem: 8086:6fe4
	Flags: fast devsel

ff:0c.5 0880: 8086:6fe5 (rev 01)
	Subsystem: 8086:6fe5
	Flags: fast devsel

ff:0c.6 0880: 8086:6fe6 (rev 01)
	Subsystem: 8086:6fe6
	Flags: fast devsel

ff:0c.7 0880: 8086:6fe7 (rev 01)
	Subsystem: 8086:6fe7
	Flags: fast devsel

ff:0d.0 0880: 8086:6fe8 (rev 01)
	Subsystem: 8086:6fe8
	Flags: fast devsel

ff:0d.1 0880: 8086:6fe9 (rev 01)
	Subsystem: 8086:6fe9
	Flags: fast devsel

ff:0d.2 0880: 8086:6fea (rev 01)
	Subsystem: 8086:6fea
	Flags: fast devsel

ff:0d.3 0880: 8086:6feb (rev 01)
	Subsystem: 8086:6feb
	Flags: fast devsel

ff:0d.4 0880: 8086:6fec (rev 01)
	Subsystem: 8086:6fec
	Flags: fast devsel

ff:0d.5 0880: 8086:6fed (rev 01)
	Subsystem: 8086:6fed
	Flags: fast devsel

ff:0f.0 0880: 8086:6ff8 (rev 01)
	Subsystem: 8086:6ff8
	Flags: fast devsel

ff:0f.1 0880: 8086:6ff9 (rev 01)
	Subsystem: 8086:6ff9
	Flags: fast devsel

ff:0f.2 0880: 8086:6ffa (rev 01)
	Subsystem: 8086:6ffa
	Flags: fast devsel

ff:0f.3 0880: 8086:6ffb (rev 01)
	Subsystem: 8086:6ffb
	Flags: fast devsel

ff:0f.4 0880: 8086:6ffc (rev 01)
	Subsystem: 8086:6fe0
	Flags: fast devsel

ff:0f.5 0880: 8086:6ffd (rev 01)
	Subsystem: 8086:6fe0
	Flags: fast devsel

ff:0f.6 0880: 8086:6ffe (rev 01)
	Subsystem: 8086:6fe0
	Flags: fast devsel

ff:10.0 0880: 8086:6f1d (rev 01)
	Subsystem: 8086:6f1d
	Flags: fast devsel

ff:10.1 1101: 8086:6f34 (rev 01)
	Subsystem: 8086:6f34
	Flags: fast devsel
	Kernel driver in use: bdx_uncore

ff:10.5 0880: 8086:6f1e (rev 01)
	Subsystem: 8086:6f1e
	Flags: fast devsel

ff:10.6 1101: 8086:6f7d (rev 01)
	Subsystem: 8086:6f7d
	Flags: fast devsel

ff:10.7 0880: 8086:6f1f (rev 01)
	Subsystem: 8086:6f1f
	Flags: fast devsel

ff:12.0 0880: 8086:6fa0 (rev 01)
	Subsystem: 8086:6fa0
	Flags: fast devsel

ff:12.1 1101: 8086:6f30 (rev 01)
	Subsystem: 8086:6f30
	Flags: fast devsel
	Kernel driver in use: bdx_uncore

ff:12.2 0880: 8086:6f70 (rev 01)
	Subsystem: 8086:6f70
	Flags: fast devsel

ff:12.4 0880: 8086:6f60 (rev 01)
	Subsystem: 8086:6f60
	Flags: fast devsel

ff:12.5 1101: 8086:6f38 (rev 01)
	Subsystem: 8086:6f38
	Flags: fast devsel
	Kernel driver in use: bdx_uncore

ff:12.6 0880: 8086:6f78 (rev 01)
	Subsystem: 8086:6f78
	Flags: fast devsel

ff:13.0 0880: 8086:6fa8 (rev 01)
	Subsystem: 8086:6fa8
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

ff:13.1 0880: 8086:6f71 (rev 01)
	Subsystem: 8086:6f71
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

ff:13.2 0880: 8086:6faa (rev 01)
	Subsystem: 8086:6faa
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

ff:13.3 0880: 8086:6fab (rev 01)
	Subsystem: 8086:6fab
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

ff:13.6 0880: 8086:6fae (rev 01)
	Flags: fast devsel

ff:13.7 0880: 8086:6faf (rev 01)
	Flags: fast devsel

ff:14.0 0880: 8086:6fb0 (rev 01)
	Subsystem: 8086:6fb0
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: bdx_uncore

ff:14.1 0880: 8086:6fb1 (rev 01)
	Subsystem: 8086:6fb1
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: bdx_uncore

ff:14.2 0880: 8086:6fb2 (rev 01)
	Subsystem: 8086:6fb2
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

ff:14.3 0880: 8086:6fb3 (rev 01)
	Subsystem: 8086:6fb3
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

ff:14.4 0880: 8086:6fbc (rev 01)
	Flags: fast devsel

ff:14.5 0880: 8086:6fbd (rev 01)
	Flags: fast devsel

ff:14.6 0880: 8086:6fbe (rev 01)
	Flags: fast devsel

ff:14.7 0880: 8086:6fbf (rev 01)
	Flags: fast devsel

ff:16.0 0880: 8086:6f68 (rev 01)
	Subsystem: 8086:6f68
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

ff:16.1 0880: 8086:6f79 (rev 01)
	Subsystem: 8086:6f79
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

ff:16.2 0880: 8086:6f6a (rev 01)
	Subsystem: 8086:6f6a
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

ff:16.3 0880: 8086:6f6b (rev 01)
	Subsystem: 8086:6f6b
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

ff:16.6 0880: 8086:6f6e (rev 01)
	Flags: fast devsel

ff:16.7 0880: 8086:6f6f (rev 01)
	Flags: fast devsel

ff:17.0 0880: 8086:6fd0 (rev 01)
	Subsystem: 8086:6fd0
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: bdx_uncore

ff:17.1 0880: 8086:6fd1 (rev 01)
	Subsystem: 8086:6fd1
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: bdx_uncore

ff:17.2 0880: 8086:6fd2 (rev 01)
	Subsystem: 8086:6fd2
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

ff:17.3 0880: 8086:6fd3 (rev 01)
	Subsystem: 8086:6fd3
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

ff:17.4 0880: 8086:6fb8 (rev 01)
	Flags: fast devsel

ff:17.5 0880: 8086:6fb9 (rev 01)
	Flags: fast devsel

ff:17.6 0880: 8086:6fba (rev 01)
	Flags: fast devsel

ff:17.7 0880: 8086:6fbb (rev 01)
	Flags: fast devsel

ff:1e.0 0880: 8086:6f98 (rev 01)
	Subsystem: 8086:6f98
	Flags: fast devsel

ff:1e.1 0880: 8086:6f99 (rev 01)
	Subsystem: 8086:6f99
	Flags: fast devsel

ff:1e.2 0880: 8086:6f9a (rev 01)
	Subsystem: 8086:6f9a
	Flags: fast devsel

ff:1e.3 0880: 8086:6fc0 (rev 01)
	Subsystem: 8086:6fc0
	Flags: fast devsel
	Memory at <ignored> (low-1M, prefetchable) [disabled]

ff:1e.4 0880: 8086:6f9c (rev 01)
	Subsystem: 8086:6f9c
	Flags: fast devsel

ff:1f.0 0880: 8086:6f88 (rev 01)
	Flags: fast devsel

ff:1f.2 0880: 8086:6f8a (rev 01)
	Flags: fast devsel


[-- Attachment #3: lspci-vn.T640.txt --]
[-- Type: application/octet-stream, Size: 51544 bytes --]

00:00.0 0600: 8086:2020 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [90] Express Root Port (Slot-), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [144] Vendor Specific Information: ID=0004 Rev=1 Len=03c <?>
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [298] Vendor Specific Information: ID=0007 Rev=0 Len=024 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>

00:05.0 0880: 8086:2024 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:05.2 0880: 8086:2025 (rev 07)
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:05.4 0800: 8086:2026 (rev 07) (prog-if 20 [IO(X)-APIC])
	Subsystem: 8086:2026
	Flags: bus master, fast devsel, latency 0, NUMA node 0
	Memory at 92f20000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3

00:08.0 0880: 8086:2014 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:08.1 1101: 8086:2015 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

00:08.2 0880: 8086:2016 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:11.0 ff00: 8086:a1ec (rev 09)
	Subsystem: 1028:07e5
	Flags: bus master, fast devsel, latency 0, NUMA node 0
	Capabilities: [80] Power Management version 3

00:11.5 0106: 8086:a1d2 (rev 09) (prog-if 01 [AHCI 1.0])
	Subsystem: 1028:07e5
	Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 129, NUMA node 0
	Memory at 92f16000 (32-bit, non-prefetchable) [size=8K]
	Memory at 92f1f000 (32-bit, non-prefetchable) [size=256]
	I/O ports at 2068 [size=8]
	I/O ports at 2074 [size=4]
	I/O ports at 2040 [size=32]
	Memory at 92e80000 (32-bit, non-prefetchable) [size=512K]
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [70] Power Management version 3
	Capabilities: [a8] SATA HBA v1.0
	Kernel driver in use: ahci
	Kernel modules: ahci

00:14.0 0c03: 8086:a1af (rev 09) (prog-if 30 [XHCI])
	Subsystem: 1028:07e5
	Flags: bus master, medium devsel, latency 0, IRQ 35, NUMA node 0
	Memory at 92f00000 (64-bit, non-prefetchable) [size=64K]
	Capabilities: [70] Power Management version 2
	Capabilities: [80] MSI: Enable+ Count=1/8 Maskable- 64bit+
	Kernel driver in use: xhci_hcd

00:14.2 1180: 8086:a1b1 (rev 09)
	Subsystem: 1028:07e5
	Flags: bus master, fast devsel, latency 0, IRQ 18, NUMA node 0
	Memory at 92f1c000 (64-bit, non-prefetchable) [size=4K]
	Capabilities: [50] Power Management version 3
	Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
	Kernel driver in use: intel_pch_thermal
	Kernel modules: intel_pch_thermal

00:16.0 0780: 8086:a1ba (rev 09)
	Subsystem: 1028:07e5
	Flags: bus master, fast devsel, latency 0, IRQ 255, NUMA node 0
	Memory at 92f1b000 (64-bit, non-prefetchable) [size=4K]
	Capabilities: [50] Power Management version 3
	Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+
	Kernel modules: mei_me

00:16.1 0780: 8086:a1bb (rev 09)
	Subsystem: 1028:07e5
	Flags: bus master, fast devsel, latency 0, IRQ 255, NUMA node 0
	Memory at 92f1a000 (64-bit, non-prefetchable) [size=4K]
	Capabilities: [50] Power Management version 3
	Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+

00:16.4 0780: 8086:a1be (rev 09)
	Subsystem: 1028:07e5
	Flags: bus master, fast devsel, latency 0, IRQ 255, NUMA node 0
	Memory at 92f19000 (64-bit, non-prefetchable) [size=4K]
	Capabilities: [50] Power Management version 3
	Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+

00:17.0 0106: 8086:a182 (rev 09) (prog-if 01 [AHCI 1.0])
	Subsystem: 1028:07e5
	Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 444, NUMA node 0
	Memory at 92f14000 (32-bit, non-prefetchable) [size=8K]
	Memory at 92f1e000 (32-bit, non-prefetchable) [size=256]
	I/O ports at 2060 [size=8]
	I/O ports at 2070 [size=4]
	I/O ports at 2020 [size=32]
	Memory at 92e00000 (32-bit, non-prefetchable) [size=512K]
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [70] Power Management version 3
	Capabilities: [a8] SATA HBA v1.0
	Kernel driver in use: ahci
	Kernel modules: ahci

00:1c.0 0604: 8086:a190 (rev f9) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 24, NUMA node 0
	Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
	Memory behind bridge: 92a00000-92dfffff
	Capabilities: [40] Express Root Port (Slot-), MSI 00
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: 1028:07e5
	Capabilities: [a0] Power Management version 3
	Kernel driver in use: pcieport

00:1c.4 0604: 8086:a194 (rev f9) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 25, NUMA node 0
	Bus: primary=00, secondary=02, subordinate=03, sec-latency=0
	Memory behind bridge: 92000000-928fffff
	Prefetchable memory behind bridge: 0000000091000000-0000000091ffffff
	Capabilities: [40] Express Root Port (Slot+), MSI 00
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: 1028:07e5
	Capabilities: [a0] Power Management version 3
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [140] Access Control Services
	Kernel driver in use: pcieport

00:1f.0 0601: 8086:a1c1 (rev 09)
	Subsystem: 1028:07e5
	Flags: bus master, medium devsel, latency 0, NUMA node 0
	Kernel modules: lpc_ich

00:1f.2 0580: 8086:a1a1 (rev 09)
	Subsystem: 1028:07e5
	Flags: bus master, fast devsel, latency 0, NUMA node 0
	Memory at 92f10000 (32-bit, non-prefetchable) [size=16K]

00:1f.4 0c05: 8086:a1a3 (rev 09)
	Subsystem: 1028:07e5
	Flags: medium devsel, IRQ 16, NUMA node 0
	Memory at 92f18000 (64-bit, non-prefetchable) [size=256]
	I/O ports at 2000 [size=32]
	Kernel driver in use: i801_smbus
	Kernel modules: i2c_i801

00:1f.5 0c80: 8086:a1a4 (rev 09)
	Subsystem: 1028:07e5
	Flags: bus master, fast devsel, latency 0, NUMA node 0
	Memory at fe010000 (32-bit, non-prefetchable) [size=4K]

02:00.0 0604: 1556:be00 (rev 02) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 16, NUMA node 0
	Bus: primary=02, secondary=03, subordinate=03, sec-latency=0
	Memory behind bridge: 92000000-928fffff
	Prefetchable memory behind bridge: 0000000091000000-0000000091ffffff
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [78] Power Management version 3
	Capabilities: [80] Express PCI-Express to PCI/PCI-X Bridge, MSI 00
	Capabilities: [100] Virtual Channel
	Capabilities: [800] Advanced Error Reporting

03:00.0 0300: 102b:0536 (rev 04) (prog-if 00 [VGA controller])
	Subsystem: 1028:07e5
	Flags: bus master, 66MHz, medium devsel, latency 64, IRQ 16, NUMA node 0
	Memory at 91000000 (32-bit, prefetchable) [size=16M]
	Memory at 92808000 (32-bit, non-prefetchable) [size=16K]
	Memory at 92000000 (32-bit, non-prefetchable) [size=8M]
	[virtual] Expansion ROM at 000c0000 [disabled] [size=128K]
	Capabilities: [dc] Power Management version 3
	Kernel driver in use: mgag200
	Kernel modules: mgag200

17:00.0 0604: 8086:2030 (rev 07) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 27, NUMA node 0
	Bus: primary=17, secondary=18, subordinate=18, sec-latency=0
	Memory behind bridge: 9de00000-9defffff
	Prefetchable memory behind bridge: 000000009d800000-000000009dafffff
	Capabilities: [40] Subsystem: 8086:0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot-), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [298] Vendor Specific Information: ID=0007 Rev=0 Len=024 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport

17:02.0 0604: 8086:2032 (rev 07) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 28, NUMA node 0
	Bus: primary=17, secondary=19, subordinate=19, sec-latency=0
	I/O behind bridge: 00004000-00004fff
	Memory behind bridge: 9db00000-9dcfffff
	Capabilities: [40] Subsystem: 8086:0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot-), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [298] Vendor Specific Information: ID=0007 Rev=0 Len=024 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport

17:05.0 0880: 8086:2034 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

17:05.2 0880: 8086:2035 (rev 07)
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

17:05.4 0800: 8086:2036 (rev 07) (prog-if 20 [IO(X)-APIC])
	Subsystem: 8086:2036
	Flags: bus master, fast devsel, latency 0, NUMA node 0
	Memory at 9dd00000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3

17:08.0 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:08.1 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:08.2 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:08.3 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:08.4 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:08.5 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:08.6 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:08.7 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:09.0 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:09.1 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:09.2 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:09.3 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:09.4 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:09.5 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:09.6 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:09.7 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0a.0 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0a.1 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0a.2 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0a.3 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0a.4 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0a.5 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0a.6 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0a.7 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0b.0 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0b.1 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0b.2 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0b.3 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0e.0 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0e.1 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0e.2 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0e.3 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0e.4 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0e.5 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0e.6 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0e.7 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0f.0 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0f.1 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0f.2 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0f.3 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0f.4 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0f.5 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0f.6 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:0f.7 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:10.0 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:10.1 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:10.2 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:10.3 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:10.4 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:10.5 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:10.6 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:10.7 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:11.0 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:11.1 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:11.2 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:11.3 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:1d.0 0880: 8086:2054 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:1d.1 0880: 8086:2055 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:1d.2 0880: 8086:2056 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:1d.3 0880: 8086:2057 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:1e.0 0880: 8086:2080 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:1e.1 0880: 8086:2081 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:1e.2 0880: 8086:2082 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:1e.3 0880: 8086:2083 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:1e.4 0880: 8086:2084 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:1e.5 0880: 8086:2085 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

17:1e.6 0880: 8086:2086 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

18:00.0 0200: 14e4:16d8 (rev 01)
	Subsystem: 1028:07e5
	Flags: bus master, fast devsel, latency 0, IRQ 118, NUMA node 0
	Memory at 9da10000 (64-bit, prefetchable) [size=64K]
	Memory at 9d900000 (64-bit, prefetchable) [size=1M]
	Memory at 9da22000 (64-bit, prefetchable) [size=8K]
	Expansion ROM at 9de00000 [disabled] [size=256K]
	Capabilities: [48] Power Management version 3
	Capabilities: [50] Vital Product Data
	Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [a0] MSI-X: Enable+ Count=74 Masked-
	Capabilities: [ac] Express Endpoint, MSI 00
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [13c] Device Serial Number 58-8a-5a-ff-fe-ec-12-dc
	Capabilities: [150] Power Budgeting <?>
	Capabilities: [160] Virtual Channel
	Capabilities: [180] Vendor Specific Information: ID=0000 Rev=0 Len=020 <?>
	Capabilities: [1b0] Latency Tolerance Reporting
	Capabilities: [1b8] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [230] Transaction Processing Hints
	Capabilities: [300] #19
	Capabilities: [200] Precision Time Measurement
	Kernel driver in use: bnxt_en
	Kernel modules: bnxt_en

18:00.1 0200: 14e4:16d8 (rev 01)
	Subsystem: 1028:07e5
	Flags: bus master, fast devsel, latency 0, IRQ 213, NUMA node 0
	Memory at 9da00000 (64-bit, prefetchable) [size=64K]
	Memory at 9d800000 (64-bit, prefetchable) [size=1M]
	Memory at 9da20000 (64-bit, prefetchable) [size=8K]
	Expansion ROM at 9de40000 [disabled] [size=256K]
	Capabilities: [48] Power Management version 3
	Capabilities: [50] Vital Product Data
	Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [a0] MSI-X: Enable+ Count=74 Masked-
	Capabilities: [ac] Express Endpoint, MSI 00
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [13c] Device Serial Number 58-8a-5a-ff-fe-ec-12-dc
	Capabilities: [150] Power Budgeting <?>
	Capabilities: [180] Vendor Specific Information: ID=0000 Rev=0 Len=020 <?>
	Capabilities: [1b8] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [230] Transaction Processing Hints
	Kernel driver in use: bnxt_en
	Kernel modules: bnxt_en

19:00.0 0104: 1000:005d (rev 02)
	Subsystem: 1028:1f42
	Flags: bus master, fast devsel, latency 0, IRQ 36, NUMA node 0
	I/O ports at 4000 [size=256]
	Memory at 9dc00000 (64-bit, non-prefetchable) [size=64K]
	Memory at 9db00000 (64-bit, non-prefetchable) [size=1M]
	Expansion ROM at <ignored> [disabled]
	Capabilities: [50] Power Management version 3
	Capabilities: [68] Express Endpoint, MSI 00
	Capabilities: [a8] MSI: Enable- Count=1/1 Maskable+ 64bit+
	Capabilities: [c0] MSI-X: Enable+ Count=97 Masked-
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [1e0] #19
	Capabilities: [1c0] Power Budgeting <?>
	Capabilities: [148] Alternative Routing-ID Interpretation (ARI)
	Kernel driver in use: megaraid_sas
	Kernel modules: megaraid_sas

3a:05.0 0880: 8086:2034 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:05.2 0880: 8086:2035 (rev 07)
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:05.4 0800: 8086:2036 (rev 07) (prog-if 20 [IO(X)-APIC])
	Subsystem: 8086:2036
	Flags: bus master, fast devsel, latency 0, NUMA node 0
	Memory at ab000000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3

3a:08.0 0880: 8086:2066 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

3a:09.0 0880: 8086:2066 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

3a:0a.0 0880: 8086:2040 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0a.1 0880: 8086:2041 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0a.2 0880: 8086:2042 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

3a:0a.3 0880: 8086:2043 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0a.4 0880: 8086:2044 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0a.5 0880: 8086:2045 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0a.6 0880: 8086:2046 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

3a:0a.7 0880: 8086:2047 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0b.0 0880: 8086:2048 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0b.1 0880: 8086:2049 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0b.2 0880: 8086:204a (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

3a:0b.3 0880: 8086:204b (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0c.0 0880: 8086:2040 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0c.1 0880: 8086:2041 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0c.2 0880: 8086:2042 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

3a:0c.3 0880: 8086:2043 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0c.4 0880: 8086:2044 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0c.5 0880: 8086:2045 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0c.6 0880: 8086:2046 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

3a:0c.7 0880: 8086:2047 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0d.0 0880: 8086:2048 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0d.1 0880: 8086:2049 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

3a:0d.2 0880: 8086:204a (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

3a:0d.3 0880: 8086:204b (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

5d:00.0 0604: 8086:2030 (rev 07) (prog-if 00 [Normal decode])
	Physical Slot: 1
	Flags: bus master, fast devsel, latency 0, IRQ 30, NUMA node 0
	Bus: primary=5d, secondary=5e, subordinate=5e, sec-latency=0
	Memory behind bridge: baa00000-baafffff
	Prefetchable memory behind bridge: 00000000b8800000-00000000ba8fffff
	Capabilities: [40] Subsystem: 8086:0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [298] Vendor Specific Information: ID=0007 Rev=0 Len=024 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport

5d:05.0 0880: 8086:2034 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

5d:05.2 0880: 8086:2035 (rev 07)
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

5d:05.4 0800: 8086:2036 (rev 07) (prog-if 20 [IO(X)-APIC])
	Subsystem: 8086:2036
	Flags: bus master, fast devsel, latency 0, NUMA node 0
	Memory at ba900000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3

5d:0e.0 1101: 8086:2058 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

5d:0e.1 0880: 8086:2059 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=0 Len=0f0 <?>

5d:0f.0 1101: 8086:2058 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

5d:0f.1 0880: 8086:2059 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=0 Len=0f0 <?>

5d:10.0 1101: 8086:2058 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

5d:10.1 0880: 8086:2059 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=0 Len=0f0 <?>

5d:12.0 1101: 8086:204c (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

5d:12.1 1101: 8086:204d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Kernel driver in use: skx_uncore

5d:12.2 0880: 8086:204e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Kernel driver in use: skx_uncore

5d:12.4 1101: 8086:204c (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

5d:12.5 1101: 8086:204d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Kernel driver in use: skx_uncore

5d:15.0 0880: 8086:2018 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

5d:15.1 1101: 8086:2088 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Kernel driver in use: skx_uncore

5d:16.0 0880: 8086:2018 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

5d:16.1 1101: 8086:2088 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Kernel driver in use: skx_uncore

5d:16.4 0880: 8086:2018 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

5d:16.5 1101: 8086:2088 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

5d:17.0 0880: 8086:2018 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0

5d:17.1 1101: 8086:2088 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 0
	Kernel driver in use: skx_uncore

5e:00.0 0200: 14e4:168e (rev 10)
	Subsystem: 14e4:1006
	Flags: bus master, fast devsel, latency 0, IRQ 119, NUMA node 0
	Memory at b9800000 (64-bit, prefetchable) [size=8M]
	Memory at ba000000 (64-bit, prefetchable) [size=8M]
	Memory at ba810000 (64-bit, prefetchable) [size=64K]
	Expansion ROM at baa00000 [disabled] [size=512K]
	Capabilities: [48] Power Management version 3
	Capabilities: [50] Vital Product Data
	Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [a0] MSI-X: Enable+ Count=32 Masked-
	Capabilities: [ac] Express Endpoint, MSI 00
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [13c] Device Serial Number 00-0e-1e-ff-fe-9a-b2-80
	Capabilities: [150] Power Budgeting <?>
	Capabilities: [160] Virtual Channel
	Capabilities: [1b8] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [220] #15
	Capabilities: [300] #19
	Kernel driver in use: bnx2x
	Kernel modules: bnx2x

5e:00.1 0200: 14e4:168e (rev 10)
	Subsystem: 14e4:1006
	Flags: bus master, fast devsel, latency 0, IRQ 306, NUMA node 0
	Memory at b8800000 (64-bit, prefetchable) [size=8M]
	Memory at b9000000 (64-bit, prefetchable) [size=8M]
	Memory at ba800000 (64-bit, prefetchable) [size=64K]
	Expansion ROM at baa80000 [disabled] [size=512K]
	Capabilities: [48] Power Management version 3
	Capabilities: [50] Vital Product Data
	Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [a0] MSI-X: Enable+ Count=32 Masked-
	Capabilities: [ac] Express Endpoint, MSI 00
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [13c] Device Serial Number 00-0e-1e-ff-fe-9a-b2-80
	Capabilities: [150] Power Budgeting <?>
	Capabilities: [160] Virtual Channel
	Capabilities: [1b8] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [220] #15
	Kernel driver in use: bnx2x
	Kernel modules: bnx2x

80:05.0 0880: 8086:2024 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

80:05.2 0880: 8086:2025 (rev 07)
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

80:05.4 0800: 8086:2026 (rev 07) (prog-if 20 [IO(X)-APIC])
	Subsystem: 8086:2026
	Flags: bus master, fast devsel, latency 0, NUMA node 1
	Memory at c6000000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3

80:08.0 0880: 8086:2014 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

80:08.1 1101: 8086:2015 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

80:08.2 0880: 8086:2016 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

88:02.0 0604: 8086:2032 (rev 07) (prog-if 00 [Normal decode])
	Physical Slot: 4
	Flags: bus master, fast devsel, latency 0, IRQ 32, NUMA node 1
	Bus: primary=88, secondary=89, subordinate=89, sec-latency=0
	Memory behind bridge: d3800000-d38fffff
	Prefetchable memory behind bridge: 00000000d4000000-00000000d60fffff
	Capabilities: [40] Subsystem: 8086:0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [298] Vendor Specific Information: ID=0007 Rev=0 Len=024 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport

88:05.0 0880: 8086:2034 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

88:05.2 0880: 8086:2035 (rev 07)
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

88:05.4 0800: 8086:2036 (rev 07) (prog-if 20 [IO(X)-APIC])
	Subsystem: 8086:2036
	Flags: bus master, fast devsel, latency 0, NUMA node 1
	Memory at d6100000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3

88:08.0 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:08.1 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:08.2 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:08.3 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:08.4 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:08.5 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:08.6 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:08.7 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:09.0 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:09.1 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:09.2 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:09.3 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:09.4 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:09.5 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:09.6 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:09.7 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0a.0 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0a.1 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0a.2 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0a.3 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0a.4 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0a.5 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0a.6 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0a.7 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0b.0 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0b.1 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0b.2 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0b.3 0880: 8086:208d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0e.0 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0e.1 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0e.2 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0e.3 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0e.4 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0e.5 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0e.6 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0e.7 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0f.0 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0f.1 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0f.2 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0f.3 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0f.4 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0f.5 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0f.6 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:0f.7 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:10.0 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:10.1 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:10.2 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:10.3 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:10.4 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:10.5 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:10.6 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:10.7 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:11.0 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:11.1 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:11.2 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:11.3 0880: 8086:208e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:1d.0 0880: 8086:2054 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:1d.1 0880: 8086:2055 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:1d.2 0880: 8086:2056 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:1d.3 0880: 8086:2057 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:1e.0 0880: 8086:2080 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:1e.1 0880: 8086:2081 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:1e.2 0880: 8086:2082 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:1e.3 0880: 8086:2083 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:1e.4 0880: 8086:2084 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:1e.5 0880: 8086:2085 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

88:1e.6 0880: 8086:2086 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

89:00.0 0200: 8086:1583 (rev 02)
	Subsystem: 8086:0006
	Flags: bus master, fast devsel, latency 0, IRQ 128, NUMA node 1
	Memory at d5000000 (64-bit, prefetchable) [size=16M]
	Memory at d6008000 (64-bit, prefetchable) [size=32K]
	Expansion ROM at d3800000 [disabled] [size=512K]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
	Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
	Capabilities: [a0] Express Endpoint, MSI 00
	Capabilities: [e0] Vital Product Data
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [140] Device Serial Number 30-3c-13-ff-ff-1e-f2-f8
	Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
	Capabilities: [1a0] Transaction Processing Hints
	Capabilities: [1b0] Access Control Services
	Capabilities: [1d0] #19
	Kernel driver in use: i40e
	Kernel modules: i40e

89:00.1 0200: 8086:1583 (rev 02)
	Subsystem: 8086:0000
	Flags: bus master, fast devsel, latency 0, IRQ 128, NUMA node 1
	Memory at d4000000 (64-bit, prefetchable) [size=16M]
	Memory at d6000000 (64-bit, prefetchable) [size=32K]
	Expansion ROM at d3880000 [disabled] [size=512K]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
	Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
	Capabilities: [a0] Express Endpoint, MSI 00
	Capabilities: [e0] Vital Product Data
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [140] Device Serial Number 30-3c-13-ff-ff-1e-f2-f8
	Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
	Capabilities: [1a0] Transaction Processing Hints
	Capabilities: [1b0] Access Control Services
	Kernel driver in use: i40e
	Kernel modules: i40e

b0:00.0 0604: 8086:2030 (rev 07) (prog-if 00 [Normal decode])
	Physical Slot: 8
	Flags: bus master, fast devsel, latency 0, IRQ 34, NUMA node 1
	Bus: primary=b0, secondary=b1, subordinate=b1, sec-latency=0
	Memory behind bridge: e1000000-e11fffff
	Prefetchable memory behind bridge: 00000000e2000000-00000000e5ffffff
	Capabilities: [40] Subsystem: 8086:0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [298] Vendor Specific Information: ID=0007 Rev=0 Len=024 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport

b0:05.0 0880: 8086:2034 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:05.2 0880: 8086:2035 (rev 07)
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:05.4 0800: 8086:2036 (rev 07) (prog-if 20 [IO(X)-APIC])
	Subsystem: 8086:2036
	Flags: bus master, fast devsel, latency 0, NUMA node 1
	Memory at e6000000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3

b0:08.0 0880: 8086:2066 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

b0:09.0 0880: 8086:2066 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

b0:0a.0 0880: 8086:2040 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0a.1 0880: 8086:2041 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0a.2 0880: 8086:2042 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

b0:0a.3 0880: 8086:2043 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0a.4 0880: 8086:2044 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0a.5 0880: 8086:2045 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0a.6 0880: 8086:2046 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

b0:0a.7 0880: 8086:2047 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0b.0 0880: 8086:2048 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0b.1 0880: 8086:2049 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0b.2 0880: 8086:204a (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

b0:0b.3 0880: 8086:204b (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0c.0 0880: 8086:2040 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0c.1 0880: 8086:2041 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0c.2 0880: 8086:2042 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

b0:0c.3 0880: 8086:2043 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0c.4 0880: 8086:2044 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0c.5 0880: 8086:2045 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0c.6 0880: 8086:2046 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

b0:0c.7 0880: 8086:2047 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0d.0 0880: 8086:2048 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0d.1 0880: 8086:2049 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b0:0d.2 0880: 8086:204a (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

b0:0d.3 0880: 8086:204b (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b1:00.0 0207: 15b3:101b
	Subsystem: 15b3:0008
	Flags: bus master, fast devsel, latency 0, IRQ 130, NUMA node 1
	Memory at e4000000 (64-bit, prefetchable) [size=32M]
	Expansion ROM at e1000000 [disabled] [size=1M]
	Capabilities: [60] Express Endpoint, MSI 00
	Capabilities: [48] Vital Product Data
	Capabilities: [9c] MSI-X: Enable+ Count=64 Masked-
	Capabilities: [c0] Vendor Specific Information: Len=18 <?>
	Capabilities: [40] Power Management version 3
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [1c0] #19
	Capabilities: [230] Access Control Services
	Capabilities: [320] #27
	Capabilities: [370] #26
	Capabilities: [420] #25
	Kernel driver in use: mlx5_core
	Kernel modules: mlx5_core

b1:00.1 0200: 15b3:101b
	Subsystem: 15b3:0008
	Flags: bus master, fast devsel, latency 0, IRQ 379, NUMA node 1
	Memory at e2000000 (64-bit, prefetchable) [size=32M]
	Expansion ROM at e1100000 [disabled] [size=1M]
	Capabilities: [60] Express Endpoint, MSI 00
	Capabilities: [48] Vital Product Data
	Capabilities: [9c] MSI-X: Enable+ Count=64 Masked-
	Capabilities: [c0] Vendor Specific Information: Len=18 <?>
	Capabilities: [40] Power Management version 3
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [230] Access Control Services
	Capabilities: [420] #25
	Kernel driver in use: mlx5_core
	Kernel modules: mlx5_core

d8:05.0 0880: 8086:2034 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

d8:05.2 0880: 8086:2035 (rev 07)
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

d8:05.4 0800: 8086:2036 (rev 07) (prog-if 20 [IO(X)-APIC])
	Subsystem: 8086:2036
	Flags: bus master, fast devsel, latency 0, NUMA node 1
	Memory at ee800000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3

d8:0e.0 1101: 8086:2058 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

d8:0e.1 0880: 8086:2059 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=0 Len=0f0 <?>

d8:0f.0 1101: 8086:2058 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

d8:0f.1 0880: 8086:2059 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=0 Len=0f0 <?>

d8:10.0 1101: 8086:2058 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Kernel driver in use: skx_uncore

d8:10.1 0880: 8086:2059 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=0 Len=0f0 <?>

d8:12.0 1101: 8086:204c (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

d8:12.1 1101: 8086:204d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Kernel driver in use: skx_uncore

d8:12.2 0880: 8086:204e (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Kernel driver in use: skx_uncore

d8:12.4 1101: 8086:204c (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

d8:12.5 1101: 8086:204d (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Kernel driver in use: skx_uncore

d8:15.0 0880: 8086:2018 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

d8:15.1 1101: 8086:2088 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Kernel driver in use: skx_uncore

d8:16.0 0880: 8086:2018 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

d8:16.1 1101: 8086:2088 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Kernel driver in use: skx_uncore

d8:16.4 0880: 8086:2018 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

d8:16.5 1101: 8086:2088 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

d8:17.0 0880: 8086:2018 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1

d8:17.1 1101: 8086:2088 (rev 07)
	Subsystem: 8086:0000
	Flags: fast devsel, NUMA node 1
	Kernel driver in use: skx_uncore


^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-07  8:47           ` Wang Yugui
@ 2022-09-07  9:18             ` Thomas Zimmermann
  0 siblings, 0 replies; 21+ messages in thread
From: Thomas Zimmermann @ 2022-09-07  9:18 UTC (permalink / raw)
  To: Wang Yugui; +Cc: dri-devel


[-- Attachment #1.1: Type: text/plain, Size: 1925 bytes --]

Hi

Am 07.09.22 um 10:47 schrieb Wang Yugui:
> Hi,
> 
>> Am 07.09.22 um 09:38 schrieb Wang Yugui:
>>> Hi,
>>>
>>>
>>>> Hi
>>>>
>>>> Am 07.09.22 um 06:16 schrieb Wang Yugui:
>>>>> Hi,
>>>>>
>>>>>> Am 02.09.22 um 07:52 schrieb Wang Yugui:
>>>>>>> Hi,
>>>>>>>
>>>>>>> mgag200 broken on kernel-6.0-rc3 on DELL/T620.
>>>>>>>
>>>>>>> See the attachementment file for the graph output.
>>>>>>
>>>>>> Thanks for reporting the bug. We recently refactored some code of the driver. Can you bisect to the change that introduced the problem?
>>>>>
>>>>> 5.19.3 works well on this DELL/T620.
>>>>>
>>>>> so this problem should be a regression of 6.0.
>>>>>
>>>>> other bisect seem difficult for me.
>>>>
>>>> OK, thank you. Can you provide the dmesg log of the broken machine and the output of 'sudo lspci -vn' please?
>>>
>>> please see the attachment file for the output of 'lspci -vn'.
>>
>>    0a:00.0 0300: 102b:0534 (prog-if 00 [VGA controller])
>>
>> It's the G200ER. I'll try to find related code that we recently changed. I might get back to you for testing a patch. Thanks so far.
> 
> the patch based on kernel 6.0(rc4) will be easy to build and test here.
> 
> By the way, this problem happen on DELL/T630 too.
> but it does not happen on DELL/T640.
> 
> please see the attachment file for the output of 'lspci -vn' on
> DELL/T630 and DELL/T640.

Thanks a lot, again. According to these files, the T630 also has a 
G200ER, but the T640 has a G200EW3. As I said, we recently refactored 
the driver. The G200ER is somehow different now. I'll get back to you as 
soon as I find something.

Best regards
Thomas

> 
> Best Regards
> Wang Yugui (wangyugui@e16-tech.com)
> 2022/09/07
> 

-- 
Thomas Zimmermann
Graphics Driver Developer
SUSE Software Solutions Germany GmbH
Maxfeldstr. 5, 90409 Nürnberg, Germany
(HRB 36809, AG Nürnberg)
Geschäftsführer: Ivo Totev

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 840 bytes --]

^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-07  4:16   ` Wang Yugui
  2022-09-07  6:47     ` Thomas Zimmermann
@ 2022-09-13  8:34     ` Thomas Zimmermann
  2022-09-13 14:25       ` Wang Yugui
  1 sibling, 1 reply; 21+ messages in thread
From: Thomas Zimmermann @ 2022-09-13  8:34 UTC (permalink / raw)
  To: Wang Yugui; +Cc: dri-devel


[-- Attachment #1.1: Type: text/plain, Size: 3203 bytes --]

Hi

Am 07.09.22 um 06:16 schrieb Wang Yugui:
> Hi,
> 
>> Am 02.09.22 um 07:52 schrieb Wang Yugui:
>>> Hi,
>>>
>>> mgag200 broken on kernel-6.0-rc3 on DELL/T620.
>>>
>>> See the attachementment file for the graph output.
>>
>> Thanks for reporting the bug. We recently refactored some code of the driver. Can you bisect to the change that introduced the problem?
> 
> 5.19.3 works well on this DELL/T620.
> 
> so this problem should be a regression of 6.0.
> 
> other bisect seem difficult for me.

I looked for changes between 5.19 and 6.0-rc3 that could affect G200ER 
specifically, but could not find anything. It would help if I'd know the 
first broken commit. Is there any chance that you get the git bisecting 
to work?

The commands should be

   git bisect reset
   git bisect start v6.0-rc3 v5.19

Best regards
Thomas

> 
> Best Regards
> Wang Yugui (wangyugui@e16-tech.com)
> 2022/09/07
> 
> 
>>
>> Best regards
>> Thomas
>>
>>>
>>> [root@T620 ~]# dmesg  |grep -i 'vga\|mga'
>>> [    0.588940] Console: colour VGA+ 80x25
>>> [    4.918214] pci 0000:0a:00.0: vgaarb: setting as boot VGA device
>>> [    4.919028] pci 0000:0a:00.0: vgaarb: bridge control possible
>>> [    4.919028] pci 0000:0a:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
>>> [    4.941058] vgaarb: loaded
>>> [    9.385485] mgag200 0000:0a:00.0: vgaarb: deactivate vga console
>>> [    9.510688] [drm] Initialized mgag200 1.0.0 20110418 for 0000:0a:00.0 on minor 0
>>> [    9.523145] fbcon: mgag200drmfb (fb0) is primary device
>>> [    9.641543] mgag200 0000:0a:00.0: [drm] fb0: mgag200drmfb frame buffer device
>>>
>>>
>>> more info:
>>> 1, This DELL/T620 works well with kernel 5.15.63,
>>>       so this is not a  hardware error.
>>>
>>> 2, DELL/T640 works well with kernel 6.0-rc and 5.15.63.
>>>       both DELL/T620 and DELL/T640 use the driver 'mgag200'.
>>>
>>> [root@T640 ~]#  dmesg  |grep -i 'vga\|mga'
>>> [   10.161500] pci 0000:03:00.0: vgaarb: setting as boot VGA device
>>> [   10.162463] pci 0000:03:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
>>> [   10.176527] pci 0000:03:00.0: vgaarb: bridge control possible
>>> [   10.182465] vgaarb: loaded
>>> [   11.832839] fb0: EFI VGA frame buffer device
>>> [   21.303826] mgag200 0000:03:00.0: vgaarb: deactivate vga console
>>> [   21.319498] [drm] Initialized mgag200 1.0.0 20110418 for 0000:03:00.0 on minor 0
>>> [   21.330223] fbcon: mgag200drmfb (fb0) is primary device
>>> [   21.332140] mgag200 0000:03:00.0: [drm] drm_plane_enable_fb_damage_clips() not called
>>> [   21.741629] mgag200 0000:03:00.0: [drm] fb0: mgag200drmfb frame buffer device
>>>
>>> Best Regards
>>> Wang Yugui (wangyugui@e16-tech.com)
>>> 2022/09/02
>>>
>> -- Thomas Zimmermann
>> Graphics Driver Developer
>> SUSE Software Solutions Germany GmbH
>> Maxfeldstr. 5, 90409 Nürnberg, Germany
>> (HRB 36809, AG Nürnberg)
>> Gesch?ftsführer: Ivo Totev
> 
> 

-- 
Thomas Zimmermann
Graphics Driver Developer
SUSE Software Solutions Germany GmbH
Maxfeldstr. 5, 90409 Nürnberg, Germany
(HRB 36809, AG Nürnberg)
Geschäftsführer: Ivo Totev

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 840 bytes --]

^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-13  8:34     ` Thomas Zimmermann
@ 2022-09-13 14:25       ` Wang Yugui
  2022-09-13 14:44         ` Thomas Zimmermann
  0 siblings, 1 reply; 21+ messages in thread
From: Wang Yugui @ 2022-09-13 14:25 UTC (permalink / raw)
  To: Thomas Zimmermann; +Cc: dri-devel

Hi,

> Hi
> 
> Am 07.09.22 um 06:16 schrieb Wang Yugui:
> > Hi,
> >
> >> Am 02.09.22 um 07:52 schrieb Wang Yugui:
> >>> Hi,
> >>>
> >>> mgag200 broken on kernel-6.0-rc3 on DELL/T620.
> >>>
> >>> See the attachementment file for the graph output.
> >>
> >> Thanks for reporting the bug. We recently refactored some code of the driver. Can you bisect to the change that introduced the problem?
> >
> > 5.19.3 works well on this DELL/T620.
> >
> > so this problem should be a regression of 6.0.
> >
> > other bisect seem difficult for me.
> 
> I looked for changes between 5.19 and 6.0-rc3 that could affect G200ER specifically, but could not find anything. It would help if I'd know the first broken commit. Is there any chance that you get the git bisecting to work?
> 
> The commands should be
> 
>    git bisect reset
>    git bisect start v6.0-rc3 v5.19

A dirty patch(below) works well.  but we need a final fix.

# git diff
diff --git a/drivers/gpu/drm/mgag200/mgag200_mode.c b/drivers/gpu/drm/mgag200/mgag200_mode.c
index 225cca2ed60e..cd976baa2f44 100644
--- a/drivers/gpu/drm/mgag200/mgag200_mode.c
+++ b/drivers/gpu/drm/mgag200/mgag200_mode.c
@@ -1070,7 +1070,7 @@ int mgag200_modeset_init(struct mga_device *mdev, resource_size_t vram_available

        dev->mode_config.max_width = MGAG200_MAX_FB_WIDTH;
        dev->mode_config.max_height = MGAG200_MAX_FB_HEIGHT;
-       dev->mode_config.preferred_depth = 24;
+       dev->mode_config.preferred_depth = 16;
        dev->mode_config.fb_base = mdev->vram_res->start;
        dev->mode_config.funcs = &mgag200_mode_config_funcs;

I firstly tried to build whole kernel base on
c577b2f43e80 drm/mgag200: Enable atomic gamma lut update
d45e32c9d98c drm/mgag200: Call mgag200_device_probe_vram() from
per-model init

both failed to boot, so failed to test mgag200 driver.

so I tried to revert patch of mgag200 driver in batch of 2 or 3, the I
noticed the patch 'Subject: drm/mgag200: Remove special case for G200SE
with <2 MiB' and then tried this dirty fix.

Best Regards
Wang Yugui (wangyugui@e16-tech.com)
2022/09/13


> 
> Best regards
> Thomas
> 
> >
> > Best Regards
> > Wang Yugui (wangyugui@e16-tech.com)
> > 2022/09/07
> >
> >
> >>
> >> Best regards
> >> Thomas
> >>
> >>>
> >>> [root@T620 ~]# dmesg  |grep -i 'vga\|mga'
> >>> [    0.588940] Console: colour VGA+ 80x25
> >>> [    4.918214] pci 0000:0a:00.0: vgaarb: setting as boot VGA device
> >>> [    4.919028] pci 0000:0a:00.0: vgaarb: bridge control possible
> >>> [    4.919028] pci 0000:0a:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
> >>> [    4.941058] vgaarb: loaded
> >>> [    9.385485] mgag200 0000:0a:00.0: vgaarb: deactivate vga console
> >>> [    9.510688] [drm] Initialized mgag200 1.0.0 20110418 for 0000:0a:00.0 on minor 0
> >>> [    9.523145] fbcon: mgag200drmfb (fb0) is primary device
> >>> [    9.641543] mgag200 0000:0a:00.0: [drm] fb0: mgag200drmfb frame buffer device
> >>>
> >>>
> >>> more info:
> >>> 1, This DELL/T620 works well with kernel 5.15.63,
> >>>       so this is not a  hardware error.
> >>>
> >>> 2, DELL/T640 works well with kernel 6.0-rc and 5.15.63.
> >>>       both DELL/T620 and DELL/T640 use the driver 'mgag200'.
> >>>
> >>> [root@T640 ~]#  dmesg  |grep -i 'vga\|mga'
> >>> [   10.161500] pci 0000:03:00.0: vgaarb: setting as boot VGA device
> >>> [   10.162463] pci 0000:03:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
> >>> [   10.176527] pci 0000:03:00.0: vgaarb: bridge control possible
> >>> [   10.182465] vgaarb: loaded
> >>> [   11.832839] fb0: EFI VGA frame buffer device
> >>> [   21.303826] mgag200 0000:03:00.0: vgaarb: deactivate vga console
> >>> [   21.319498] [drm] Initialized mgag200 1.0.0 20110418 for 0000:03:00.0 on minor 0
> >>> [   21.330223] fbcon: mgag200drmfb (fb0) is primary device
> >>> [   21.332140] mgag200 0000:03:00.0: [drm] drm_plane_enable_fb_damage_clips() not called
> >>> [   21.741629] mgag200 0000:03:00.0: [drm] fb0: mgag200drmfb frame buffer device
> >>>
> >>> Best Regards
> >>> Wang Yugui (wangyugui@e16-tech.com)
> >>> 2022/09/02
> >>>
> >> -- Thomas Zimmermann
> >> Graphics Driver Developer
> >> SUSE Software Solutions Germany GmbH
> >> Maxfeldstr. 5, 90409 Nürnberg, Germany
> >> (HRB 36809, AG Nürnberg)
> >> Gesch?ftsführer: Ivo Totev
> >
> > 
> -- Thomas Zimmermann
> Graphics Driver Developer
> SUSE Software Solutions Germany GmbH
> Maxfeldstr. 5, 90409 Nürnberg, Germany
> (HRB 36809, AG Nürnberg)
> Gesch?ftsführer: Ivo Totev



^ permalink raw reply related	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-13 14:25       ` Wang Yugui
@ 2022-09-13 14:44         ` Thomas Zimmermann
  2022-09-13 15:15           ` Wang Yugui
  0 siblings, 1 reply; 21+ messages in thread
From: Thomas Zimmermann @ 2022-09-13 14:44 UTC (permalink / raw)
  To: Wang Yugui; +Cc: dri-devel


[-- Attachment #1.1: Type: text/plain, Size: 5197 bytes --]

Hi

Am 13.09.22 um 16:25 schrieb Wang Yugui:
> Hi,
> 
>> Hi
>>
>> Am 07.09.22 um 06:16 schrieb Wang Yugui:
>>> Hi,
>>>
>>>> Am 02.09.22 um 07:52 schrieb Wang Yugui:
>>>>> Hi,
>>>>>
>>>>> mgag200 broken on kernel-6.0-rc3 on DELL/T620.
>>>>>
>>>>> See the attachementment file for the graph output.
>>>>
>>>> Thanks for reporting the bug. We recently refactored some code of the driver. Can you bisect to the change that introduced the problem?
>>>
>>> 5.19.3 works well on this DELL/T620.
>>>
>>> so this problem should be a regression of 6.0.
>>>
>>> other bisect seem difficult for me.
>>
>> I looked for changes between 5.19 and 6.0-rc3 that could affect G200ER specifically, but could not find anything. It would help if I'd know the first broken commit. Is there any chance that you get the git bisecting to work?
>>
>> The commands should be
>>
>>     git bisect reset
>>     git bisect start v6.0-rc3 v5.19
> 
> A dirty patch(below) works well.  but we need a final fix.
> 
> # git diff
> diff --git a/drivers/gpu/drm/mgag200/mgag200_mode.c b/drivers/gpu/drm/mgag200/mgag200_mode.c
> index 225cca2ed60e..cd976baa2f44 100644
> --- a/drivers/gpu/drm/mgag200/mgag200_mode.c
> +++ b/drivers/gpu/drm/mgag200/mgag200_mode.c
> @@ -1070,7 +1070,7 @@ int mgag200_modeset_init(struct mga_device *mdev, resource_size_t vram_available
> 
>          dev->mode_config.max_width = MGAG200_MAX_FB_WIDTH;
>          dev->mode_config.max_height = MGAG200_MAX_FB_HEIGHT;
> -       dev->mode_config.preferred_depth = 24;
> +       dev->mode_config.preferred_depth = 16;
>          dev->mode_config.fb_base = mdev->vram_res->start;
>          dev->mode_config.funcs = &mgag200_mode_config_funcs;
> 
> I firstly tried to build whole kernel base on
> c577b2f43e80 drm/mgag200: Enable atomic gamma lut update
> d45e32c9d98c drm/mgag200: Call mgag200_device_probe_vram() from
> per-model init
> 
> both failed to boot, so failed to test mgag200 driver.
> 
> so I tried to revert patch of mgag200 driver in batch of 2 or 3, the I
> noticed the patch 'Subject: drm/mgag200: Remove special case for G200SE
> with <2 MiB' and then tried this dirty fix.

Oh, great work! Thank you. From looking at the screenshot that you 
provided, it seems as if the 24-bit mode setting is broken. I'm not sure 
why the G200SE workaround applies to a G200ER, but we'll see.

Best regards
Thomas

> 
> Best Regards
> Wang Yugui (wangyugui@e16-tech.com)
> 2022/09/13
> 
> 
>>
>> Best regards
>> Thomas
>>
>>>
>>> Best Regards
>>> Wang Yugui (wangyugui@e16-tech.com)
>>> 2022/09/07
>>>
>>>
>>>>
>>>> Best regards
>>>> Thomas
>>>>
>>>>>
>>>>> [root@T620 ~]# dmesg  |grep -i 'vga\|mga'
>>>>> [    0.588940] Console: colour VGA+ 80x25
>>>>> [    4.918214] pci 0000:0a:00.0: vgaarb: setting as boot VGA device
>>>>> [    4.919028] pci 0000:0a:00.0: vgaarb: bridge control possible
>>>>> [    4.919028] pci 0000:0a:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
>>>>> [    4.941058] vgaarb: loaded
>>>>> [    9.385485] mgag200 0000:0a:00.0: vgaarb: deactivate vga console
>>>>> [    9.510688] [drm] Initialized mgag200 1.0.0 20110418 for 0000:0a:00.0 on minor 0
>>>>> [    9.523145] fbcon: mgag200drmfb (fb0) is primary device
>>>>> [    9.641543] mgag200 0000:0a:00.0: [drm] fb0: mgag200drmfb frame buffer device
>>>>>
>>>>>
>>>>> more info:
>>>>> 1, This DELL/T620 works well with kernel 5.15.63,
>>>>>        so this is not a  hardware error.
>>>>>
>>>>> 2, DELL/T640 works well with kernel 6.0-rc and 5.15.63.
>>>>>        both DELL/T620 and DELL/T640 use the driver 'mgag200'.
>>>>>
>>>>> [root@T640 ~]#  dmesg  |grep -i 'vga\|mga'
>>>>> [   10.161500] pci 0000:03:00.0: vgaarb: setting as boot VGA device
>>>>> [   10.162463] pci 0000:03:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
>>>>> [   10.176527] pci 0000:03:00.0: vgaarb: bridge control possible
>>>>> [   10.182465] vgaarb: loaded
>>>>> [   11.832839] fb0: EFI VGA frame buffer device
>>>>> [   21.303826] mgag200 0000:03:00.0: vgaarb: deactivate vga console
>>>>> [   21.319498] [drm] Initialized mgag200 1.0.0 20110418 for 0000:03:00.0 on minor 0
>>>>> [   21.330223] fbcon: mgag200drmfb (fb0) is primary device
>>>>> [   21.332140] mgag200 0000:03:00.0: [drm] drm_plane_enable_fb_damage_clips() not called
>>>>> [   21.741629] mgag200 0000:03:00.0: [drm] fb0: mgag200drmfb frame buffer device
>>>>>
>>>>> Best Regards
>>>>> Wang Yugui (wangyugui@e16-tech.com)
>>>>> 2022/09/02
>>>>>
>>>> -- Thomas Zimmermann
>>>> Graphics Driver Developer
>>>> SUSE Software Solutions Germany GmbH
>>>> Maxfeldstr. 5, 90409 Nürnberg, Germany
>>>> (HRB 36809, AG Nürnberg)
>>>> Gesch?ftsführer: Ivo Totev
>>>
>>>
>> -- Thomas Zimmermann
>> Graphics Driver Developer
>> SUSE Software Solutions Germany GmbH
>> Maxfeldstr. 5, 90409 Nürnberg, Germany
>> (HRB 36809, AG Nürnberg)
>> Gesch?ftsführer: Ivo Totev
> 
> 

-- 
Thomas Zimmermann
Graphics Driver Developer
SUSE Software Solutions Germany GmbH
Maxfeldstr. 5, 90409 Nürnberg, Germany
(HRB 36809, AG Nürnberg)
Geschäftsführer: Ivo Totev

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 840 bytes --]

^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-13 14:44         ` Thomas Zimmermann
@ 2022-09-13 15:15           ` Wang Yugui
  2022-09-14  7:59             ` Thomas Zimmermann
  0 siblings, 1 reply; 21+ messages in thread
From: Wang Yugui @ 2022-09-13 15:15 UTC (permalink / raw)
  To: Thomas Zimmermann; +Cc: dri-devel

Hi,

> Hi
> 
> Am 13.09.22 um 16:25 schrieb Wang Yugui:
> > Hi,
> >
> >> Hi
> >>
> >> Am 07.09.22 um 06:16 schrieb Wang Yugui:
> >>> Hi,
> >>>
> >>>> Am 02.09.22 um 07:52 schrieb Wang Yugui:
> >>>>> Hi,
> >>>>>
> >>>>> mgag200 broken on kernel-6.0-rc3 on DELL/T620.
> >>>>>
> >>>>> See the attachementment file for the graph output.
> >>>>
> >>>> Thanks for reporting the bug. We recently refactored some code of the driver. Can you bisect to the change that introduced the problem?
> >>>
> >>> 5.19.3 works well on this DELL/T620.
> >>>
> >>> so this problem should be a regression of 6.0.
> >>>
> >>> other bisect seem difficult for me.
> >>
> >> I looked for changes between 5.19 and 6.0-rc3 that could affect G200ER specifically, but could not find anything. It would help if I'd know the first broken commit. Is there any chance that you get the git bisecting to work?
> >>
> >> The commands should be
> >>
> >>     git bisect reset
> >>     git bisect start v6.0-rc3 v5.19
> >
> > A dirty patch(below) works well.  but we need a final fix.
> >
> > # git diff
> > diff --git a/drivers/gpu/drm/mgag200/mgag200_mode.c b/drivers/gpu/drm/mgag200/mgag200_mode.c
> > index 225cca2ed60e..cd976baa2f44 100644
> > --- a/drivers/gpu/drm/mgag200/mgag200_mode.c
> > +++ b/drivers/gpu/drm/mgag200/mgag200_mode.c
> > @@ -1070,7 +1070,7 @@ int mgag200_modeset_init(struct mga_device *mdev, resource_size_t vram_available
> >
> >          dev->mode_config.max_width = MGAG200_MAX_FB_WIDTH;
> >          dev->mode_config.max_height = MGAG200_MAX_FB_HEIGHT;
> > -       dev->mode_config.preferred_depth = 24;
> > +       dev->mode_config.preferred_depth = 16;
> >          dev->mode_config.fb_base = mdev->vram_res->start;
> >          dev->mode_config.funcs = &mgag200_mode_config_funcs;
> >
> > I firstly tried to build whole kernel base on
> > c577b2f43e80 drm/mgag200: Enable atomic gamma lut update
> > d45e32c9d98c drm/mgag200: Call mgag200_device_probe_vram() from
> > per-model init
> >
> > both failed to boot, so failed to test mgag200 driver.
> >
> > so I tried to revert patch of mgag200 driver in batch of 2 or 3, the I
> > noticed the patch 'Subject: drm/mgag200: Remove special case for G200SE
> > with <2 MiB' and then tried this dirty fix.
> 
> Oh, great work! Thank you. From looking at the screenshot that you provided, it seems as if the 24-bit mode setting is broken. I'm not sure why the G200SE workaround applies to a G200ER, but we'll see.

I tested 'preferred_depth = 32' too. it works on T630 too.

so both 16 and 32 work, but 24 failed on DELL/T630.

diff --git a/drivers/gpu/drm/mgag200/mgag200_mode.c
b/drivers/gpu/drm/mgag200/mgag200_mode.c
index 225cca2ed60e..563e3ab05fbc 100644
--- a/drivers/gpu/drm/mgag200/mgag200_mode.c
+++ b/drivers/gpu/drm/mgag200/mgag200_mode.c
@@ -1070,7 +1070,7 @@ int mgag200_modeset_init(struct mga_device *mdev, resource_size_t vram_available

        dev->mode_config.max_width = MGAG200_MAX_FB_WIDTH;
        dev->mode_config.max_height = MGAG200_MAX_FB_HEIGHT;
-       dev->mode_config.preferred_depth = 24;
+       dev->mode_config.preferred_depth = 32;
        dev->mode_config.fb_base = mdev->vram_res->start;
        dev->mode_config.funcs = &mgag200_mode_config_funcs;

Best Regards
Wang Yugui (wangyugui@e16-tech.com)
2022/09/13




^ permalink raw reply related	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-13 15:15           ` Wang Yugui
@ 2022-09-14  7:59             ` Thomas Zimmermann
  2022-09-14  8:29               ` Wang Yugui
  0 siblings, 1 reply; 21+ messages in thread
From: Thomas Zimmermann @ 2022-09-14  7:59 UTC (permalink / raw)
  To: Wang Yugui; +Cc: dri-devel


[-- Attachment #1.1: Type: text/plain, Size: 1915 bytes --]

Hi

Am 13.09.22 um 17:15 schrieb Wang Yugui:
[...]
>>>
>>> so I tried to revert patch of mgag200 driver in batch of 2 or 3, the I
>>> noticed the patch 'Subject: drm/mgag200: Remove special case for G200SE
>>> with <2 MiB' and then tried this dirty fix.
>>
>> Oh, great work! Thank you. From looking at the screenshot that you provided, it seems as if the 24-bit mode setting is broken. I'm not sure why the G200SE workaround applies to a G200ER, but we'll see.
> 
> I tested 'preferred_depth = 32' too. it works on T630 too.
> 
> so both 16 and 32 work, but 24 failed on DELL/T630.

I tried on my test machine with a 5.19 kernel and found that 32-bit and 
24-bit pixels work, but 16-bit looks incorrect.

What are the results if you boot your kernel 5.19.3 with the parameter 
video=1024x768-24? This should enable 24-bit pixels.

How does video=1024x768-16 look with the 5.19 kernel?

Best regards
Thomas

> 
> diff --git a/drivers/gpu/drm/mgag200/mgag200_mode.c
> b/drivers/gpu/drm/mgag200/mgag200_mode.c
> index 225cca2ed60e..563e3ab05fbc 100644
> --- a/drivers/gpu/drm/mgag200/mgag200_mode.c
> +++ b/drivers/gpu/drm/mgag200/mgag200_mode.c
> @@ -1070,7 +1070,7 @@ int mgag200_modeset_init(struct mga_device *mdev, resource_size_t vram_available
> 
>          dev->mode_config.max_width = MGAG200_MAX_FB_WIDTH;
>          dev->mode_config.max_height = MGAG200_MAX_FB_HEIGHT;
> -       dev->mode_config.preferred_depth = 24;
> +       dev->mode_config.preferred_depth = 32;
>          dev->mode_config.fb_base = mdev->vram_res->start;
>          dev->mode_config.funcs = &mgag200_mode_config_funcs;
> 
> Best Regards
> Wang Yugui (wangyugui@e16-tech.com)
> 2022/09/13
> 
> 
> 

-- 
Thomas Zimmermann
Graphics Driver Developer
SUSE Software Solutions Germany GmbH
Maxfeldstr. 5, 90409 Nürnberg, Germany
(HRB 36809, AG Nürnberg)
Geschäftsführer: Ivo Totev

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 840 bytes --]

^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-14  7:59             ` Thomas Zimmermann
@ 2022-09-14  8:29               ` Wang Yugui
  2022-09-14 14:36                 ` Thomas Zimmermann
  0 siblings, 1 reply; 21+ messages in thread
From: Wang Yugui @ 2022-09-14  8:29 UTC (permalink / raw)
  To: Thomas Zimmermann; +Cc: dri-devel

Hi,


> Hi
> 
> Am 13.09.22 um 17:15 schrieb Wang Yugui:
> [...]
> >>>
> >>> so I tried to revert patch of mgag200 driver in batch of 2 or 3, the I
> >>> noticed the patch 'Subject: drm/mgag200: Remove special case for G200SE
> >>> with <2 MiB' and then tried this dirty fix.
> >>
> >> Oh, great work! Thank you. From looking at the screenshot that you provided, it seems as if the 24-bit mode setting is broken. I'm not sure why the G200SE workaround applies to a G200ER, but we'll see.
> >
> > I tested 'preferred_depth = 32' too. it works on T630 too.
> >
> > so both 16 and 32 work, but 24 failed on DELL/T630.
> 
> I tried on my test machine with a 5.19 kernel and found that 32-bit and 24-bit pixels work, but 16-bit looks incorrect.
> 
> What are the results if you boot your kernel 5.19.3 with the parameter video=1024x768-24? This should enable 24-bit pixels.
> 
> How does video=1024x768-16 look with the 5.19 kernel?

test result here
kernel 5.19.3 & video=1024x768-24
	dell/T620/centos-8.5	broken
	dell/T630/centos-7.9	broken

kernel 5.19.3 & video=1024x768-32
	dell/T620/centos-8.5	OK
	dell/T630/centos-7.9	OK

Both DELL/T620 and DELL/T630 have the lastest BIOS/iDRAC installed.

Best Regards
Wang Yugui (wangyugui@e16-tech.com)
2022/09/14



> 
> Best regards
> Thomas
> 
> >
> > diff --git a/drivers/gpu/drm/mgag200/mgag200_mode.c
> > b/drivers/gpu/drm/mgag200/mgag200_mode.c
> > index 225cca2ed60e..563e3ab05fbc 100644
> > --- a/drivers/gpu/drm/mgag200/mgag200_mode.c
> > +++ b/drivers/gpu/drm/mgag200/mgag200_mode.c
> > @@ -1070,7 +1070,7 @@ int mgag200_modeset_init(struct mga_device *mdev, resource_size_t vram_available
> >
> >          dev->mode_config.max_width = MGAG200_MAX_FB_WIDTH;
> >          dev->mode_config.max_height = MGAG200_MAX_FB_HEIGHT;
> > -       dev->mode_config.preferred_depth = 24;
> > +       dev->mode_config.preferred_depth = 32;
> >          dev->mode_config.fb_base = mdev->vram_res->start;
> >          dev->mode_config.funcs = &mgag200_mode_config_funcs;
> >
> > Best Regards
> > Wang Yugui (wangyugui@e16-tech.com)
> > 2022/09/13
> >
> >
> > 
> -- Thomas Zimmermann
> Graphics Driver Developer
> SUSE Software Solutions Germany GmbH
> Maxfeldstr. 5, 90409 Nürnberg, Germany
> (HRB 36809, AG Nürnberg)
> Gesch?ftsführer: Ivo Totev



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-14  8:29               ` Wang Yugui
@ 2022-09-14 14:36                 ` Thomas Zimmermann
  2022-09-14 14:58                   ` Wang Yugui
  0 siblings, 1 reply; 21+ messages in thread
From: Thomas Zimmermann @ 2022-09-14 14:36 UTC (permalink / raw)
  To: Wang Yugui; +Cc: Jocelyn Falempe, dri-devel


[-- Attachment #1.1: Type: text/plain, Size: 3189 bytes --]

(cc: Jocelyn)

Hi

Am 14.09.22 um 10:29 schrieb Wang Yugui:
> Hi,
> 
> 
>> Hi
>>
>> Am 13.09.22 um 17:15 schrieb Wang Yugui:
>> [...]
>>>>>
>>>>> so I tried to revert patch of mgag200 driver in batch of 2 or 3, the I
>>>>> noticed the patch 'Subject: drm/mgag200: Remove special case for G200SE
>>>>> with <2 MiB' and then tried this dirty fix.
>>>>
>>>> Oh, great work! Thank you. From looking at the screenshot that you provided, it seems as if the 24-bit mode setting is broken. I'm not sure why the G200SE workaround applies to a G200ER, but we'll see.
>>>
>>> I tested 'preferred_depth = 32' too. it works on T630 too.
>>>
>>> so both 16 and 32 work, but 24 failed on DELL/T630.
>>
>> I tried on my test machine with a 5.19 kernel and found that 32-bit and 24-bit pixels work, but 16-bit looks incorrect.
>>
>> What are the results if you boot your kernel 5.19.3 with the parameter video=1024x768-24? This should enable 24-bit pixels.
>>
>> How does video=1024x768-16 look with the 5.19 kernel?
> 
> test result here
> kernel 5.19.3 & video=1024x768-24
> 	dell/T620/centos-8.5	broken
> 	dell/T630/centos-7.9	broken

I assume that Centos 7 and 8 have fairly old kernels? So it's been a 
long-standing bug.

24-bit works on my G200HE and G200 test machines. Maybe the G200ER has a 
bug.

When I try 16-bit depth, the display works, but is way too dark. No 
fiddling with the LUT tables fixes this. It's 90s hardware, so it should 
support 16-bit framebuffers well, but there's no obvious bug to be seen.

I guess, we could remove 16 and 24 bit support for now if nothing else 
helps.

Best regards
Thomas

> 
> kernel 5.19.3 & video=1024x768-32
> 	dell/T620/centos-8.5	OK
> 	dell/T630/centos-7.9	OK



> 
> Both DELL/T620 and DELL/T630 have the lastest BIOS/iDRAC installed.
> 
> Best Regards
> Wang Yugui (wangyugui@e16-tech.com)
> 2022/09/14
> 
> 
> 
>>
>> Best regards
>> Thomas
>>
>>>
>>> diff --git a/drivers/gpu/drm/mgag200/mgag200_mode.c
>>> b/drivers/gpu/drm/mgag200/mgag200_mode.c
>>> index 225cca2ed60e..563e3ab05fbc 100644
>>> --- a/drivers/gpu/drm/mgag200/mgag200_mode.c
>>> +++ b/drivers/gpu/drm/mgag200/mgag200_mode.c
>>> @@ -1070,7 +1070,7 @@ int mgag200_modeset_init(struct mga_device *mdev, resource_size_t vram_available
>>>
>>>           dev->mode_config.max_width = MGAG200_MAX_FB_WIDTH;
>>>           dev->mode_config.max_height = MGAG200_MAX_FB_HEIGHT;
>>> -       dev->mode_config.preferred_depth = 24;
>>> +       dev->mode_config.preferred_depth = 32;
>>>           dev->mode_config.fb_base = mdev->vram_res->start;
>>>           dev->mode_config.funcs = &mgag200_mode_config_funcs;
>>>
>>> Best Regards
>>> Wang Yugui (wangyugui@e16-tech.com)
>>> 2022/09/13
>>>
>>>
>>>
>> -- Thomas Zimmermann
>> Graphics Driver Developer
>> SUSE Software Solutions Germany GmbH
>> Maxfeldstr. 5, 90409 Nürnberg, Germany
>> (HRB 36809, AG Nürnberg)
>> Gesch?ftsführer: Ivo Totev
> 
> 

-- 
Thomas Zimmermann
Graphics Driver Developer
SUSE Software Solutions Germany GmbH
Maxfeldstr. 5, 90409 Nürnberg, Germany
(HRB 36809, AG Nürnberg)
Geschäftsführer: Ivo Totev

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 840 bytes --]

^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-14 14:36                 ` Thomas Zimmermann
@ 2022-09-14 14:58                   ` Wang Yugui
  2022-09-14 15:41                     ` Thomas Zimmermann
  2022-09-15 12:54                     ` Thomas Zimmermann
  0 siblings, 2 replies; 21+ messages in thread
From: Wang Yugui @ 2022-09-14 14:58 UTC (permalink / raw)
  To: Thomas Zimmermann; +Cc: Jocelyn Falempe, dri-devel

Hi,

> (cc: Jocelyn)
> 
> Hi
> 
> Am 14.09.22 um 10:29 schrieb Wang Yugui:
> > Hi,
> >
> >
> >> Hi
> >>
> >> Am 13.09.22 um 17:15 schrieb Wang Yugui:
> >> [...]
> >>>>>
> >>>>> so I tried to revert patch of mgag200 driver in batch of 2 or 3, the I
> >>>>> noticed the patch 'Subject: drm/mgag200: Remove special case for G200SE
> >>>>> with <2 MiB' and then tried this dirty fix.
> >>>>
> >>>> Oh, great work! Thank you. From looking at the screenshot that you provided, it seems as if the 24-bit mode setting is broken. I'm not sure why the G200SE workaround applies to a G200ER, but we'll see.
> >>>
> >>> I tested 'preferred_depth = 32' too. it works on T630 too.
> >>>
> >>> so both 16 and 32 work, but 24 failed on DELL/T630.
> >>
> >> I tried on my test machine with a 5.19 kernel and found that 32-bit and 24-bit pixels work, but 16-bit looks incorrect.
> >>
> >> What are the results if you boot your kernel 5.19.3 with the parameter video=1024x768-24? This should enable 24-bit pixels.
> >>
> >> How does video=1024x768-16 look with the 5.19 kernel?
> >
> > test result here
> > kernel 5.19.3 & video=1024x768-24
> > 	dell/T620/centos-8.5	broken
> > 	dell/T630/centos-7.9	broken
> 
> I assume that Centos 7 and 8 have fairly old kernels? So it's been a long-standing bug.

We install kernel 5.19.3/5.15.67 into Centos 7 and 8.
default it work well.  broken just when 'video=1024x768-24', so it may
not a long-standing bug.

> 24-bit works on my G200HE and G200 test machines. Maybe the G200ER has a bug.
> 
> When I try 16-bit depth, the display works, but is way too dark. No fiddling with the LUT tables fixes this. It's 90s hardware, so it should support 16-bit framebuffers well, but there's no obvious bug to be seen.
> 
> I guess, we could remove 16 and 24 bit support for now if nothing else helps.


maybe better if we revert 73f54d5d9682 (drm/mgag200: Remove special case
for G200SE with <2 MiB)

because there is no test result on device G200_SE

static unsigned int mgag200_preferred_depth(struct mga_device *mdev)
{
       if (IS_G200_SE(mdev) && mdev->vram_fb_available < (2048*1024))
               return 16;
       else
               return 32;
}

Best Regards
Wang Yugui (wangyugui@e16-tech.com)
2022/09/14


^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-14 14:58                   ` Wang Yugui
@ 2022-09-14 15:41                     ` Thomas Zimmermann
  2022-09-14 16:25                       ` Wang Yugui
  2022-09-15 12:54                     ` Thomas Zimmermann
  1 sibling, 1 reply; 21+ messages in thread
From: Thomas Zimmermann @ 2022-09-14 15:41 UTC (permalink / raw)
  To: Wang Yugui; +Cc: Jocelyn Falempe, dri-devel


[-- Attachment #1.1: Type: text/plain, Size: 2810 bytes --]

Hi

Am 14.09.22 um 16:58 schrieb Wang Yugui:
> Hi,
> 
>> (cc: Jocelyn)
>>
>> Hi
>>
>> Am 14.09.22 um 10:29 schrieb Wang Yugui:
>>> Hi,
>>>
>>>
>>>> Hi
>>>>
>>>> Am 13.09.22 um 17:15 schrieb Wang Yugui:
>>>> [...]
>>>>>>>
>>>>>>> so I tried to revert patch of mgag200 driver in batch of 2 or 3, the I
>>>>>>> noticed the patch 'Subject: drm/mgag200: Remove special case for G200SE
>>>>>>> with <2 MiB' and then tried this dirty fix.
>>>>>>
>>>>>> Oh, great work! Thank you. From looking at the screenshot that you provided, it seems as if the 24-bit mode setting is broken. I'm not sure why the G200SE workaround applies to a G200ER, but we'll see.
>>>>>
>>>>> I tested 'preferred_depth = 32' too. it works on T630 too.
>>>>>
>>>>> so both 16 and 32 work, but 24 failed on DELL/T630.
>>>>
>>>> I tried on my test machine with a 5.19 kernel and found that 32-bit and 24-bit pixels work, but 16-bit looks incorrect.
>>>>
>>>> What are the results if you boot your kernel 5.19.3 with the parameter video=1024x768-24? This should enable 24-bit pixels.
>>>>
>>>> How does video=1024x768-16 look with the 5.19 kernel?
>>>
>>> test result here
>>> kernel 5.19.3 & video=1024x768-24
>>> 	dell/T620/centos-8.5	broken
>>> 	dell/T630/centos-7.9	broken
>>
>> I assume that Centos 7 and 8 have fairly old kernels? So it's been a long-standing bug.
> 
> We install kernel 5.19.3/5.15.67 into Centos 7 and 8.
> default it work well.  broken just when 'video=1024x768-24', so it may
> not a long-standing bug.

I don't quite understand. Does 'video=1024x768-24' work with 5.15.67?

> 
>> 24-bit works on my G200HE and G200 test machines. Maybe the G200ER has a bug.
>>
>> When I try 16-bit depth, the display works, but is way too dark. No fiddling with the LUT tables fixes this. It's 90s hardware, so it should support 16-bit framebuffers well, but there's no obvious bug to be seen.
>>
>> I guess, we could remove 16 and 24 bit support for now if nothing else helps.
> 
> 
> maybe better if we revert 73f54d5d9682 (drm/mgag200: Remove special case
> for G200SE with <2 MiB)
> 
> because there is no test result on device G200_SE

We cannot revert it directly, but tomorrow I'll send you a patch that 
should restore the old behavior.

Best regards
Thomas

> 
> static unsigned int mgag200_preferred_depth(struct mga_device *mdev)
> {
>         if (IS_G200_SE(mdev) && mdev->vram_fb_available < (2048*1024))
>                 return 16;
>         else
>                 return 32;
> }
> 
> Best Regards
> Wang Yugui (wangyugui@e16-tech.com)
> 2022/09/14
> 

-- 
Thomas Zimmermann
Graphics Driver Developer
SUSE Software Solutions Germany GmbH
Maxfeldstr. 5, 90409 Nürnberg, Germany
(HRB 36809, AG Nürnberg)
Geschäftsführer: Ivo Totev

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 840 bytes --]

^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-14 15:41                     ` Thomas Zimmermann
@ 2022-09-14 16:25                       ` Wang Yugui
  0 siblings, 0 replies; 21+ messages in thread
From: Wang Yugui @ 2022-09-14 16:25 UTC (permalink / raw)
  To: Thomas Zimmermann; +Cc: Jocelyn Falempe, dri-devel

Hi,


> Hi
> 
> Am 14.09.22 um 16:58 schrieb Wang Yugui:
> > Hi,
> >
> >> (cc: Jocelyn)
> >>
> >> Hi
> >>
> >> Am 14.09.22 um 10:29 schrieb Wang Yugui:
> >>> Hi,
> >>>
> >>>
> >>>> Hi
> >>>>
> >>>> Am 13.09.22 um 17:15 schrieb Wang Yugui:
> >>>> [...]
> >>>>>>>
> >>>>>>> so I tried to revert patch of mgag200 driver in batch of 2 or 3, the I
> >>>>>>> noticed the patch 'Subject: drm/mgag200: Remove special case for G200SE
> >>>>>>> with <2 MiB' and then tried this dirty fix.
> >>>>>>
> >>>>>> Oh, great work! Thank you. From looking at the screenshot that you provided, it seems as if the 24-bit mode setting is broken. I'm not sure why the G200SE workaround applies to a G200ER, but we'll see.
> >>>>>
> >>>>> I tested 'preferred_depth = 32' too. it works on T630 too.
> >>>>>
> >>>>> so both 16 and 32 work, but 24 failed on DELL/T630.
> >>>>
> >>>> I tried on my test machine with a 5.19 kernel and found that 32-bit and 24-bit pixels work, but 16-bit looks incorrect.
> >>>>
> >>>> What are the results if you boot your kernel 5.19.3 with the parameter video=1024x768-24? This should enable 24-bit pixels.
> >>>>
> >>>> How does video=1024x768-16 look with the 5.19 kernel?
> >>>
> >>> test result here
> >>> kernel 5.19.3 & video=1024x768-24
> >>> 	dell/T620/centos-8.5	broken
> >>> 	dell/T630/centos-7.9	broken
> >>
> >> I assume that Centos 7 and 8 have fairly old kernels? So it's been a long-standing bug.
> >
> > We install kernel 5.19.3/5.15.67 into Centos 7 and 8.
> > default it work well.  broken just when 'video=1024x768-24', so it may
> > not a long-standing bug.
> 
> I don't quite understand. Does 'video=1024x768-24' work with 5.15.67?

kernel 5.15.67 with 'video=1024x768-24' is broken on DELL/T630.

kernel 5.15.67 without 'video=1024x768-24' works well on DELL/T630.

Best Regards
Wang Yugui (wangyugui@e16-tech.com)
2022/09/15


^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-14 14:58                   ` Wang Yugui
  2022-09-14 15:41                     ` Thomas Zimmermann
@ 2022-09-15 12:54                     ` Thomas Zimmermann
  2022-09-15 14:41                       ` Wang Yugui
  1 sibling, 1 reply; 21+ messages in thread
From: Thomas Zimmermann @ 2022-09-15 12:54 UTC (permalink / raw)
  To: Wang Yugui; +Cc: Jocelyn Falempe, dri-devel


[-- Attachment #1.1.1: Type: text/plain, Size: 1300 bytes --]

Hi

Am 14.09.22 um 16:58 schrieb Wang Yugui:
[...]
>> 24-bit works on my G200HE and G200 test machines. Maybe the G200ER has a bug.
>>
>> When I try 16-bit depth, the display works, but is way too dark. No fiddling with the LUT tables fixes this. It's 90s hardware, so it should support 16-bit framebuffers well, but there's no obvious bug to be seen.
>>
>> I guess, we could remove 16 and 24 bit support for now if nothing else helps.
> 
> 
> maybe better if we revert 73f54d5d9682 (drm/mgag200: Remove special case
> for G200SE with <2 MiB)

Could you please test the attached patch on the 6.0-rc3 kernel? It 
should force the driver to a correct color format if no kernel 
parameters are given.

Best regards
Thomas

> 
> because there is no test result on device G200_SE
> 
> static unsigned int mgag200_preferred_depth(struct mga_device *mdev)
> {
>         if (IS_G200_SE(mdev) && mdev->vram_fb_available < (2048*1024))
>                 return 16;
>         else
>                 return 32;
> }
> 
> Best Regards
> Wang Yugui (wangyugui@e16-tech.com)
> 2022/09/14
> 

-- 
Thomas Zimmermann
Graphics Driver Developer
SUSE Software Solutions Germany GmbH
Maxfeldstr. 5, 90409 Nürnberg, Germany
(HRB 36809, AG Nürnberg)
Geschäftsführer: Ivo Totev

[-- Attachment #1.1.2: 0001-drm-mgag200-Force-32-bpp-on-the-console.patch --]
[-- Type: text/x-patch, Size: 1278 bytes --]

From c2717324c074c83f553cf7af14aa1db9f5a4c6f5 Mon Sep 17 00:00:00 2001
From: Thomas Zimmermann <tzimmermann@suse.de>
Date: Thu, 15 Sep 2022 14:09:03 +0200
Subject: [PATCH] drm/mgag200: Force 32 bpp on the console

G200ER does not seem to support 24 bpp, so force the console to use
32 bpp.

Reported-by: Wang Yugui <wangyugui@e16-tech.com>
Signed-off-by: Thomas Zimmermann <tzimmermann@suse.de>
Fixes: 73f54d5d9682 ("drm/mgag200: Remove special case for G200SE with <2 MiB")
Cc: Thomas Zimmermann <tzimmermann@suse.de>
Cc: Jocelyn Falempe <jfalempe@redhat.com>
Cc: Dave Airlie <airlied@redhat.com>
Cc: dri-devel@lists.freedesktop.org
---
 drivers/gpu/drm/mgag200/mgag200_drv.c | 6 +++++-
 1 file changed, 5 insertions(+), 1 deletion(-)

diff --git a/drivers/gpu/drm/mgag200/mgag200_drv.c b/drivers/gpu/drm/mgag200/mgag200_drv.c
index 251a1bb648cc..a222bf76804f 100644
--- a/drivers/gpu/drm/mgag200/mgag200_drv.c
+++ b/drivers/gpu/drm/mgag200/mgag200_drv.c
@@ -262,7 +262,11 @@ mgag200_pci_probe(struct pci_dev *pdev, const struct pci_device_id *ent)
 	if (ret)
 		return ret;
 
-	drm_fbdev_generic_setup(dev, 0);
+	/*
+	 * FIXME: A 24-bit color depth does not work with 24 bpp on
+	 * G200ER. Force 32 bpp.
+	 */
+	drm_fbdev_generic_setup(dev, 32);
 
 	return 0;
 }
-- 
2.37.3


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 840 bytes --]

^ permalink raw reply related	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-15 12:54                     ` Thomas Zimmermann
@ 2022-09-15 14:41                       ` Wang Yugui
  2022-09-20  7:57                         ` Thomas Zimmermann
  0 siblings, 1 reply; 21+ messages in thread
From: Wang Yugui @ 2022-09-15 14:41 UTC (permalink / raw)
  To: Thomas Zimmermann; +Cc: Jocelyn Falempe, dri-devel

Hi,

> Hi
> 
> Am 14.09.22 um 16:58 schrieb Wang Yugui:
> [...]
> >> 24-bit works on my G200HE and G200 test machines. Maybe the G200ER has a bug.
> >>
> >> When I try 16-bit depth, the display works, but is way too dark. No fiddling with the LUT tables fixes this. It's 90s hardware, so it should support 16-bit framebuffers well, but there's no obvious bug to be seen.
> >>
> >> I guess, we could remove 16 and 24 bit support for now if nothing else helps.
> >
> >
> > maybe better if we revert 73f54d5d9682 (drm/mgag200: Remove special case
> > for G200SE with <2 MiB)
> 
> Could you please test the attached patch on the 6.0-rc3 kernel? It should force the driver to a correct color format if no kernel parameters are given.
> 

This patch works well.

test case detail:
  kernel parm video is not given
  server DELL/T620
  kernel is 6.0-rc5

Best Regards
Wang Yugui (wangyugui@e16-tech.com)
2022/09/15


> Best regards
> Thomas
> 
> >
> > because there is no test result on device G200_SE
> >
> > static unsigned int mgag200_preferred_depth(struct mga_device *mdev)
> > {
> >         if (IS_G200_SE(mdev) && mdev->vram_fb_available < (2048*1024))
> >                 return 16;
> >         else
> >                 return 32;
> > }
> >
> > Best Regards
> > Wang Yugui (wangyugui@e16-tech.com)
> > 2022/09/14
> > 
> -- Thomas Zimmermann
> Graphics Driver Developer
> SUSE Software Solutions Germany GmbH
> Maxfeldstr. 5, 90409 Nürnberg, Germany
> (HRB 36809, AG Nürnberg)
> Gesch?ftsführer: Ivo Totev



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-15 14:41                       ` Wang Yugui
@ 2022-09-20  7:57                         ` Thomas Zimmermann
  2022-09-20  9:02                           ` Wang Yugui
  0 siblings, 1 reply; 21+ messages in thread
From: Thomas Zimmermann @ 2022-09-20  7:57 UTC (permalink / raw)
  To: Wang Yugui; +Cc: Jocelyn Falempe, dri-devel


[-- Attachment #1.1: Type: text/plain, Size: 2134 bytes --]

Hi

Am 15.09.22 um 16:41 schrieb Wang Yugui:
> Hi,
> 
>> Hi
>>
>> Am 14.09.22 um 16:58 schrieb Wang Yugui:
>> [...]
>>>> 24-bit works on my G200HE and G200 test machines. Maybe the G200ER has a bug.
>>>>
>>>> When I try 16-bit depth, the display works, but is way too dark. No fiddling with the LUT tables fixes this. It's 90s hardware, so it should support 16-bit framebuffers well, but there's no obvious bug to be seen.
>>>>
>>>> I guess, we could remove 16 and 24 bit support for now if nothing else helps.
>>>
>>>
>>> maybe better if we revert 73f54d5d9682 (drm/mgag200: Remove special case
>>> for G200SE with <2 MiB)
>>
>> Could you please test the attached patch on the 6.0-rc3 kernel? It should force the driver to a correct color format if no kernel parameters are given.
>>
> 
> This patch works well.

I have meanwhile added the patch to drm-misc-fixes. We want to add a 
workaround for your machine to the driver. Can you please send me the 
output of

   sudo dmidecode -s system-manufacturer

and

   sudo dmidecode -s system-product-name

Best regards
Thomas

> 
> test case detail:
>    kernel parm video is not given
>    server DELL/T620
>    kernel is 6.0-rc5
> 
> Best Regards
> Wang Yugui (wangyugui@e16-tech.com)
> 2022/09/15
> 
> 
>> Best regards
>> Thomas
>>
>>>
>>> because there is no test result on device G200_SE
>>>
>>> static unsigned int mgag200_preferred_depth(struct mga_device *mdev)
>>> {
>>>          if (IS_G200_SE(mdev) && mdev->vram_fb_available < (2048*1024))
>>>                  return 16;
>>>          else
>>>                  return 32;
>>> }
>>>
>>> Best Regards
>>> Wang Yugui (wangyugui@e16-tech.com)
>>> 2022/09/14
>>>
>> -- Thomas Zimmermann
>> Graphics Driver Developer
>> SUSE Software Solutions Germany GmbH
>> Maxfeldstr. 5, 90409 Nürnberg, Germany
>> (HRB 36809, AG Nürnberg)
>> Gesch?ftsführer: Ivo Totev
> 
> 

-- 
Thomas Zimmermann
Graphics Driver Developer
SUSE Software Solutions Germany GmbH
Maxfeldstr. 5, 90409 Nürnberg, Germany
(HRB 36809, AG Nürnberg)
Geschäftsführer: Ivo Totev

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 840 bytes --]

^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: mgag200 broken on kernel-6.0-rc3 on DELL/T620
  2022-09-20  7:57                         ` Thomas Zimmermann
@ 2022-09-20  9:02                           ` Wang Yugui
  0 siblings, 0 replies; 21+ messages in thread
From: Wang Yugui @ 2022-09-20  9:02 UTC (permalink / raw)
  To: Thomas Zimmermann; +Cc: Jocelyn Falempe, dri-devel

Hi,

> Hi
> 
> Am 15.09.22 um 16:41 schrieb Wang Yugui:
> > Hi,
> >
> >> Hi
> >>
> >> Am 14.09.22 um 16:58 schrieb Wang Yugui:
> >> [...]
> >>>> 24-bit works on my G200HE and G200 test machines. Maybe the G200ER has a bug.
> >>>>
> >>>> When I try 16-bit depth, the display works, but is way too dark. No fiddling with the LUT tables fixes this. It's 90s hardware, so it should support 16-bit framebuffers well, but there's no obvious bug to be seen.
> >>>>
> >>>> I guess, we could remove 16 and 24 bit support for now if nothing else helps.
> >>>
> >>>
> >>> maybe better if we revert 73f54d5d9682 (drm/mgag200: Remove special case
> >>> for G200SE with <2 MiB)
> >>
> >> Could you please test the attached patch on the 6.0-rc3 kernel? It should force the driver to a correct color format if no kernel parameters are given.
> >>
> >
> > This patch works well.
> 
> I have meanwhile added the patch to drm-misc-fixes. We want to add a workaround for your machine to the driver. Can you please send me the output of
> 
>    sudo dmidecode -s system-manufacturer
> 
> and
> 
>    sudo dmidecode -s system-product-name
> 


DELL/T630
[root@T630 ~]# dmidecode -s system-manufacturer
Dell Inc.
[root@T630 ~]# dmidecode -s system-product-name
PowerEdge T630


DELL/T620
[root@T620 ~]# dmidecode -s system-manufacturer
Dell Inc.
[root@T620 ~]# dmidecode -s system-product-name
PowerEdge T620

Best Regards
Wang Yugui (wangyugui@e16-tech.com)
2022/09/20

> Best regards
> Thomas
> 
> >
> > test case detail:
> >    kernel parm video is not given
> >    server DELL/T620
> >    kernel is 6.0-rc5
> >
> > Best Regards
> > Wang Yugui (wangyugui@e16-tech.com)
> > 2022/09/15
> >
> >
> >> Best regards
> >> Thomas
> >>
> >>>
> >>> because there is no test result on device G200_SE
> >>>
> >>> static unsigned int mgag200_preferred_depth(struct mga_device *mdev)
> >>> {
> >>>          if (IS_G200_SE(mdev) && mdev->vram_fb_available < (2048*1024))
> >>>                  return 16;
> >>>          else
> >>>                  return 32;
> >>> }
> >>>
> >>> Best Regards
> >>> Wang Yugui (wangyugui@e16-tech.com)
> >>> 2022/09/14
> >>>
> >> -- Thomas Zimmermann
> >> Graphics Driver Developer
> >> SUSE Software Solutions Germany GmbH
> >> Maxfeldstr. 5, 90409 Nürnberg, Germany
> >> (HRB 36809, AG Nürnberg)
> >> Gesch?ftsführer: Ivo Totev
> >
> > 
> -- Thomas Zimmermann
> Graphics Driver Developer
> SUSE Software Solutions Germany GmbH
> Maxfeldstr. 5, 90409 Nürnberg, Germany
> (HRB 36809, AG Nürnberg)
> Gesch?ftsführer: Ivo Totev



^ permalink raw reply	[flat|nested] 21+ messages in thread

end of thread, other threads:[~2022-09-20  9:03 UTC | newest]

Thread overview: 21+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
     [not found] <20220902135242.2447.409509F4@e16-tech.com>
2022-09-05  6:57 ` mgag200 broken on kernel-6.0-rc3 on DELL/T620 Thomas Zimmermann
2022-09-07  4:16   ` Wang Yugui
2022-09-07  6:47     ` Thomas Zimmermann
2022-09-07  7:38       ` Wang Yugui
2022-09-07  7:55         ` Thomas Zimmermann
2022-09-07  8:47           ` Wang Yugui
2022-09-07  9:18             ` Thomas Zimmermann
2022-09-13  8:34     ` Thomas Zimmermann
2022-09-13 14:25       ` Wang Yugui
2022-09-13 14:44         ` Thomas Zimmermann
2022-09-13 15:15           ` Wang Yugui
2022-09-14  7:59             ` Thomas Zimmermann
2022-09-14  8:29               ` Wang Yugui
2022-09-14 14:36                 ` Thomas Zimmermann
2022-09-14 14:58                   ` Wang Yugui
2022-09-14 15:41                     ` Thomas Zimmermann
2022-09-14 16:25                       ` Wang Yugui
2022-09-15 12:54                     ` Thomas Zimmermann
2022-09-15 14:41                       ` Wang Yugui
2022-09-20  7:57                         ` Thomas Zimmermann
2022-09-20  9:02                           ` Wang Yugui

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.