From: Bjorn Helgaas <helgaas@kernel.org>
To: "Jason A. Donenfeld" <Jason@zx2c4.com>
Cc: linux-pci@vger.kernel.org, Alexandru Gagniuc <mr.nuke.me@gmail.com>
Subject: Re: spammy dmesg about fluctuating pcie bandwidth on 5.9
Date: Wed, 7 Oct 2020 12:02:00 -0500 [thread overview]
Message-ID: <20201007170200.GA3251244@bjorn-Precision-5520> (raw)
In-Reply-To: <CAHmME9r_cNx04yuUN+TPPY=xDHuDxRrLb8KqR7C69YtXMajAJg@mail.gmail.com>
[+cc Alex]
On Wed, Oct 07, 2020 at 06:09:06PM +0200, Jason A. Donenfeld wrote:
> Hi,
>
> Since 5.9 I've been seeing lots of the below in my logs. I'm wondering
> if this is a case of "ASPM finally working properly," or if I'm
> actually running into aberrant behavior that I should look into
> further. I run with `pcie_aspm=force pcie_aspm.policy=powersave` on my
> command line. But I wasn't seeing these messages in 5.8.
I'm sorry that you need to use "pcie_aspm=force
pcie_aspm.policy=powersave". Someday maybe we'll get enough of ASPM
fixed so we won't need junk like that. I don't think we're there yet.
Do you build with CONFIG_PCIEASPM_POWERSAVE=y? Do you need
"pcie_aspm=force" because the firmware tells us not to use ASPM?
Re: the messages below, they come from Link Bandwidth Management
interrupts. These *should* only happen because of a
software-initiated link retrain or because hardware changed the link
speed or width because the link was unreliable. ASPM shouldn't cause
these.
So it's possible you have an unreliable slot, but I doubt it because
you said v5.8 works fine, and also the Link Bandwidth interrupts
should only happen if something *changed*, but all the messages below
look the same to me.
Something is also wrong with them -- there's no such thing as a "x63"
link. But maybe these are copy/paste errors? I don't know where the
"b.4" comes from either. Oh, that probably belongs with
"0000:00:1b.4" but got separated by copy/paste.
Obviously you can stop the messages by unsetting CONFIG_PCIE_BW.
The code (drivers/pci/pcie/bw_notification.c) is pretty
straightforward and I don't see an obvious problem, but maybe Alex
will.
> [79960.801929] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [79981.679813] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80002.001267] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80023.842169] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80045.763841] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80068.083577] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80090.351526] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80112.750350] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80134.749255] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80155.763411] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80178.457760] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80200.804896] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80223.311729] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80245.791343] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80267.870825] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80289.713123] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80311.978655] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80334.701124] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80355.658151] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80377.844362] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80400.538230] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80422.575182] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80445.282519] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80467.714932] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80490.148981] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80509.719262] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80531.764821] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80553.767613] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80574.943252] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80597.579091] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80619.711966] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80641.901453] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80664.592372] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80686.622715] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80709.291964] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80731.844729] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80754.541540] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80777.075171] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80799.794398] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80822.489116] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80844.934930] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80865.739007] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80888.219031] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80910.753669] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80932.989664] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80954.833210] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80977.477922] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [80998.699385] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81020.726597] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81042.750936] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81065.257417] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81087.767519] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81110.493829] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81132.617088] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81154.700420] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81177.363880] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81199.946937] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81221.794056] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81243.043378] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81265.709152] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81287.630090] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81309.763332] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81318.920797] EXT4-fs (dm-2): mounted filesystem with ordered data
> mode. Opts: (null)
> [81332.457364] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81354.404894] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81376.669492] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81398.964385] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81421.657484] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81444.243407] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81466.243845] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81486.750420] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81508.936351] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81531.285200] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81553.791276] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81575.793924] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81597.844229] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81620.550927] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81643.227381] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81665.900018] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81688.617113] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81710.952986] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81730.963752] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81753.669690] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81776.056524] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81798.212865] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81820.906623] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81842.002407] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81864.319510] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81887.016001] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81909.719258] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81931.279258] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81953.922625] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81974.239845] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [81996.957939] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82019.066339] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82041.651293] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82064.344822] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82085.977719] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82108.451266] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82131.141927] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82153.867813] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82175.818802] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82197.678494] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82219.947803] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82241.784890] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82264.480971] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82287.199484] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82309.863960] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82331.783480] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82354.189336] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82376.876548] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82398.800816] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82420.979857] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82443.678685] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82466.211265] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82486.823160] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82509.539779] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82531.808332] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82553.836533] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82576.049885] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82597.995713] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82620.691143] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82642.050409] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82663.891937] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82686.238435] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82708.929312] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82731.008511] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82753.730734] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82775.711219] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82798.370968] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82820.741946] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82842.931577] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82865.620923] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82888.350976] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82911.034043] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82933.743876] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82956.247764] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [82978.767434] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83000.796754] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83022.660145] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83045.353526] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83068.163036] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83090.793322] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83113.489363] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83135.812852] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83158.399350] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83181.118694] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83203.805756] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83225.945483] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83248.525805] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83271.217918] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83293.938688] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83316.177679] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83337.141733] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83359.831741] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83381.940645] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83404.657248] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83426.927612] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83449.646961] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83472.336930] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83493.830913] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83514.470154] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83536.790704] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83559.247431] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83581.943573] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83604.555801] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83626.769373] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83649.489632] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83672.182965] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83694.872527] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83717.082388] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83739.808368] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83762.122494] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83784.758621] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83807.488464] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83830.201485] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83852.894547] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83875.491085] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83898.078276] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83920.793717] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83942.740521] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83964.587599] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [83987.170436] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [84009.893456] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [84032.606254] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [84055.329572] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [84077.823293] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [84100.519811] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [84123.296376] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [84145.935520] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [84168.659294] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [84190.605264] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [84213.215194] pcieport 0000:04:00.0: 8.000 Gb/s available PCIe
> bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:1b
> .4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [84235.938442] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
> [84258.658162] pcieport 0000:04:00.0: 31.504 Gb/s available PCIe
> bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:1
> b.4 (capable of 1984.941 Gb/s with 32.0 GT/s PCIe x63 link)
next prev parent reply other threads:[~2020-10-07 17:02 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-10-07 16:09 spammy dmesg about fluctuating pcie bandwidth on 5.9 Jason A. Donenfeld
2020-10-07 16:46 ` Keith Busch
2020-10-07 17:02 ` Bjorn Helgaas [this message]
2020-10-09 14:32 ` Alex G.
2020-10-09 15:05 ` Bjorn Helgaas
[not found] <CAHmME9qa4NQCj8w-Apd2TnbtMjbox0jA6T347Bf_wEkJrzSz0g@mail.gmail.com>
2020-10-12 22:03 ` Bjorn Helgaas
2020-10-14 10:31 ` Jason A. Donenfeld
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20201007170200.GA3251244@bjorn-Precision-5520 \
--to=helgaas@kernel.org \
--cc=Jason@zx2c4.com \
--cc=linux-pci@vger.kernel.org \
--cc=mr.nuke.me@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).