[Intel-wired-lan] [ixgbe] regression: jumbo frames not working

[Intel-wired-lan] [ixgbe] regression: jumbo frames not working

[Ian Kumlien]

Hi,

Since upgrading to kenel 6.3, I've hit an issue...

I historically use 9k jumboframes on my network as such:
3: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP
group default qlen 1000

But now the largest frame i can send is 2030 bytes (ie ping -s 2002)...

I don't see any warning from the XDP subsystem so I almost assume
that's not it...
_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan

Re: [Intel-wired-lan] [ixgbe] regression: jumbo frames not working

[Jesse Brandeburg]

[-- Attachment #1.1: Type: text/plain, Size: 908 bytes --]

On Fri, Apr 28, 2023 at 2:13 PM Ian Kumlien <ian.kumlien@gmail.com> wrote:

> Hi,
>
> Since upgrading to kenel 6.3, I've hit an issue...
>
> I historically use 9k jumboframes on my network as such:
> 3: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP
> group default qlen 1000


Thanks for the report! Our team is investigating, hopefully we will be able
to reproduce and get back to you this week.

A detail that would help is lspci -nn -d ::0200 to get a list of the
adapter type you’re using in case it’s relevant.


>
> But now the largest frame i can send is 2030 bytes (ie ping -s 2002)...
>
> I don't see any warning from the XDP subsystem so I almost assume
> that's not it...
> _______________________________________________
> Intel-wired-lan mailing list
> Intel-wired-lan@osuosl.org
> https://lists.osuosl.org/mailman/listinfo/intel-wired-lan
>

[-- Attachment #1.2: Type: text/html, Size: 1660 bytes --]

[-- Attachment #2: Type: text/plain, Size: 162 bytes --]

_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan

Re: [Intel-wired-lan] [ixgbe] regression: jumbo frames not working

[Ian Kumlien]

On Sun, Apr 30, 2023 at 6:29 PM Jesse Brandeburg
<jesse.brandeburg@gmail.com> wrote:
>
>
>
> On Fri, Apr 28, 2023 at 2:13 PM Ian Kumlien <ian.kumlien@gmail.com> wrote:
>>
>> Hi,
>>
>> Since upgrading to kenel 6.3, I've hit an issue...
>>
>> I historically use 9k jumboframes on my network as such:
>> 3: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP
>> group default qlen 1000
>
>
> Thanks for the report! Our team is investigating, hopefully we will be able to reproduce and get back to you this week.
>
> A detail that would help is lspci -nn -d ::0200 to get a list of the adapter type you’re using in case it’s relevant.

06:00.0 Ethernet controller [0200]: Intel Corporation Ethernet
Connection X553 1GbE [8086:15e4] (rev 11)
06:00.1 Ethernet controller [0200]: Intel Corporation Ethernet
Connection X553 1GbE [8086:15e4] (rev 11)
07:00.0 Ethernet controller [0200]: Intel Corporation Ethernet
Connection X553 1GbE [8086:15e4] (rev 11)
07:00.1 Ethernet controller [0200]: Intel Corporation Ethernet
Connection X553 1GbE [8086:15e4] (rev 11)

ethtool -i eno1
driver: ixgbe
version: 6.3.0
firmware-version: 0x80000877
expansion-rom-version:
bus-info: 0000:06:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes

>> But now the largest frame i can send is 2030 bytes (ie ping -s 2002)...
>>
>> I don't see any warning from the XDP subsystem so I almost assume
>> that's not it...
>> _______________________________________________
>> Intel-wired-lan mailing list
>> Intel-wired-lan@osuosl.org
>> https://lists.osuosl.org/mailman/listinfo/intel-wired-lan
_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan

Re: [Intel-wired-lan] [ixgbe] regression: jumbo frames not working

[Linux regression tracking #adding (Thorsten Leemhuis)]

[CCing the regression list, as it should be in the loop for regressions:
https://docs.kernel.org/admin-guide/reporting-regressions.html]

[TLDR: I'm adding this report to the list of tracked Linux kernel
regressions; the text you find below is based on a few templates
paragraphs you might have encountered already in similar form.
See link in footer if these mails annoy you.]

On 28.04.23 23:13, Ian Kumlien wrote:
> 
> Since upgrading to kenel 6.3, I've hit an issue...
> 
> I historically use 9k jumboframes on my network as such:
> 3: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP
> group default qlen 1000
> 
> But now the largest frame i can send is 2030 bytes (ie ping -s 2002)...
> 
> I don't see any warning from the XDP subsystem so I almost assume
> that's not it...

Thanks for the report. To be sure the issue doesn't fall through the
cracks unnoticed, I'm adding it to regzbot, the Linux kernel regression
tracking bot:

#regzbot ^introduced v6.2..v6.3
#regzbot title net: ixgbe: jumbo frames stopped working
#regzbot ignore-activity

This isn't a regression? This issue or a fix for it are already
discussed somewhere else? It was fixed already? You want to clarify when
the regression started to happen? Or point out I got the title or
something else totally wrong? Then just reply and tell me -- ideally
while also telling regzbot about it, as explained by the page listed in
the footer of this mail.

Developers: When fixing the issue, remember to add 'Link:' tags pointing
to the report (the parent of this mail). See page linked in footer for
details.

Ciao, Thorsten (wearing his 'the Linux kernel's regression tracker' hat)
--
Everything you wanna know about Linux kernel regression tracking:
https://linux-regtracking.leemhuis.info/about/#tldr
That page also explains what to do if mails like this annoy you.

Re: [Intel-wired-lan] [ixgbe] regression: jumbo frames not working

[Linux regression tracking #adding (Thorsten Leemhuis)]

[CCing the regression list, as it should be in the loop for regressions:
https://docs.kernel.org/admin-guide/reporting-regressions.html]

[TLDR: I'm adding this report to the list of tracked Linux kernel
regressions; the text you find below is based on a few templates
paragraphs you might have encountered already in similar form.
See link in footer if these mails annoy you.]

On 28.04.23 23:13, Ian Kumlien wrote:
> 
> Since upgrading to kenel 6.3, I've hit an issue...
> 
> I historically use 9k jumboframes on my network as such:
> 3: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP
> group default qlen 1000
> 
> But now the largest frame i can send is 2030 bytes (ie ping -s 2002)...
> 
> I don't see any warning from the XDP subsystem so I almost assume
> that's not it...

Thanks for the report. To be sure the issue doesn't fall through the
cracks unnoticed, I'm adding it to regzbot, the Linux kernel regression
tracking bot:

#regzbot ^introduced v6.2..v6.3
#regzbot title net: ixgbe: jumbo frames stopped working
#regzbot ignore-activity

This isn't a regression? This issue or a fix for it are already
discussed somewhere else? It was fixed already? You want to clarify when
the regression started to happen? Or point out I got the title or
something else totally wrong? Then just reply and tell me -- ideally
while also telling regzbot about it, as explained by the page listed in
the footer of this mail.

Developers: When fixing the issue, remember to add 'Link:' tags pointing
to the report (the parent of this mail). See page linked in footer for
details.

Ciao, Thorsten (wearing his 'the Linux kernel's regression tracker' hat)
--
Everything you wanna know about Linux kernel regression tracking:
https://linux-regtracking.leemhuis.info/about/#tldr
That page also explains what to do if mails like this annoy you.
_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan

Re: [Intel-wired-lan] [ixgbe] regression: jumbo frames not working

[Piotr Skajewski]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset=Y, Size: 1834 bytes --]

On Sun, Arp 30, 2023 at 7:01 PM Ian Kumlien <ian.kumlien@gmail.com> wrote:
> On Sun, Apr 30, 2023 at 6:29 PM Jesse Brandeburg
> <jesse.brandeburg@gmail.com> wrote:
>>
>>
>>
>> On Fri, Apr 28, 2023 at 2:13 PM Ian Kumlien <ian.kumlien@gmail.com> wrote:
>>>
>>> Hi,
>>>
>>> Since upgrading to kenel 6.3, I've hit an issue...
>>>
>>> I historically use 9k jumboframes on my network as such:
>>> 3: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP
>>> group default qlen 1000
>>
>>
>> Thanks for the report! Our team is investigating, hopefully we will be able to reproduce and get back to you this week.
>>
>> A detail that would help is lspci -nn -d ::0200 to get a list of the adapter type you're using in case it's relevant.
> 
> 06:00.0 Ethernet controller [0200]: Intel Corporation Ethernet
> Connection X553 1GbE [8086:15e4] (rev 11)
> 06:00.1 Ethernet controller [0200]: Intel Corporation Ethernet
> Connection X553 1GbE [8086:15e4] (rev 11)
> 07:00.0 Ethernet controller [0200]: Intel Corporation Ethernet
> Connection X553 1GbE [8086:15e4] (rev 11)
> 07:00.1 Ethernet controller [0200]: Intel Corporation Ethernet
> Connection X553 1GbE [8086:15e4] (rev 11)
> 
> ethtool -i eno1
> driver: ixgbe
> version: 6.3.0
> firmware-version: 0x80000877
> expansion-rom-version:
> bus-info: 0000:06:00.0
> supports-statistics: yes
> supports-test: yes
> supports-eeprom-access: yes
> supports-register-dump: yes
> supports-priv-flags: yes
> 
>>> But now the largest frame i can send is 2030 bytes (ie ping -s 2002)...
>>>
>>> I don't see any warning from the XDP subsystem so I almost assume
>>> that's not it...

After test we don't see any discrepancies in how jumbo frames work between mentioned kernels.
Please add more details about configuration you are using and steps how to reproduce this issue.


Thanks,
Piotr

[-- Attachment #2: Type: text/plain, Size: 162 bytes --]

_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan

Re: [Intel-wired-lan] [ixgbe] regression: jumbo frames not working

[Ian Kumlien]

Sorry... It seems like my cisco switch booted with jumbo-frames
disabled after a power outage...
The conf says it should be enabled - but somehow it wasn't :/

On Fri, May 5, 2023 at 4:23 PM Piotr Skajewski
<piotrx.skajewski@intel.com> wrote:
>
> On Sun, Arp 30, 2023 at 7:01 PM Ian Kumlien <ian.kumlien@gmail.com> wrote:
> > On Sun, Apr 30, 2023 at 6:29 PM Jesse Brandeburg
> > <jesse.brandeburg@gmail.com> wrote:
> >>
> >>
> >>
> >> On Fri, Apr 28, 2023 at 2:13 PM Ian Kumlien <ian.kumlien@gmail.com> wrote:
> >>>
> >>> Hi,
> >>>
> >>> Since upgrading to kenel 6.3, I've hit an issue...
> >>>
> >>> I historically use 9k jumboframes on my network as such:
> >>> 3: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP
> >>> group default qlen 1000
> >>
> >>
> >> Thanks for the report! Our team is investigating, hopefully we will be able to reproduce and get back to you this week.
> >>
> >> A detail that would help is lspci -nn -d ::0200 to get a list of the adapter type you're using in case it's relevant.
> >
> > 06:00.0 Ethernet controller [0200]: Intel Corporation Ethernet
> > Connection X553 1GbE [8086:15e4] (rev 11)
> > 06:00.1 Ethernet controller [0200]: Intel Corporation Ethernet
> > Connection X553 1GbE [8086:15e4] (rev 11)
> > 07:00.0 Ethernet controller [0200]: Intel Corporation Ethernet
> > Connection X553 1GbE [8086:15e4] (rev 11)
> > 07:00.1 Ethernet controller [0200]: Intel Corporation Ethernet
> > Connection X553 1GbE [8086:15e4] (rev 11)
> >
> > ethtool -i eno1
> > driver: ixgbe
> > version: 6.3.0
> > firmware-version: 0x80000877
> > expansion-rom-version:
> > bus-info: 0000:06:00.0
> > supports-statistics: yes
> > supports-test: yes
> > supports-eeprom-access: yes
> > supports-register-dump: yes
> > supports-priv-flags: yes
> >
> >>> But now the largest frame i can send is 2030 bytes (ie ping -s 2002)...
> >>>
> >>> I don't see any warning from the XDP subsystem so I almost assume
> >>> that's not it...
>
> After test we don't see any discrepancies in how jumbo frames work between mentioned kernels.
> Please add more details about configuration you are using and steps how to reproduce this issue.
>
>
> Thanks,
> Piotr
_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan

Re: [Intel-wired-lan] [ixgbe] regression: jumbo frames not working

[Ian Kumlien]

As a side note, I don't understand how the switch booted with jumbo
frames off - the config stated that they should be on....
So, some kind of failover... sorry for the noise..

On Fri, May 5, 2023 at 7:50 PM Ian Kumlien <ian.kumlien@gmail.com> wrote:
>
> Sorry... It seems like my cisco switch booted with jumbo-frames
> disabled after a power outage...
> The conf says it should be enabled - but somehow it wasn't :/
>
> On Fri, May 5, 2023 at 4:23 PM Piotr Skajewski
> <piotrx.skajewski@intel.com> wrote:
> >
> > On Sun, Arp 30, 2023 at 7:01 PM Ian Kumlien <ian.kumlien@gmail.com> wrote:
> > > On Sun, Apr 30, 2023 at 6:29 PM Jesse Brandeburg
> > > <jesse.brandeburg@gmail.com> wrote:
> > >>
> > >>
> > >>
> > >> On Fri, Apr 28, 2023 at 2:13 PM Ian Kumlien <ian.kumlien@gmail.com> wrote:
> > >>>
> > >>> Hi,
> > >>>
> > >>> Since upgrading to kenel 6.3, I've hit an issue...
> > >>>
> > >>> I historically use 9k jumboframes on my network as such:
> > >>> 3: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP
> > >>> group default qlen 1000
> > >>
> > >>
> > >> Thanks for the report! Our team is investigating, hopefully we will be able to reproduce and get back to you this week.
> > >>
> > >> A detail that would help is lspci -nn -d ::0200 to get a list of the adapter type you're using in case it's relevant.
> > >
> > > 06:00.0 Ethernet controller [0200]: Intel Corporation Ethernet
> > > Connection X553 1GbE [8086:15e4] (rev 11)
> > > 06:00.1 Ethernet controller [0200]: Intel Corporation Ethernet
> > > Connection X553 1GbE [8086:15e4] (rev 11)
> > > 07:00.0 Ethernet controller [0200]: Intel Corporation Ethernet
> > > Connection X553 1GbE [8086:15e4] (rev 11)
> > > 07:00.1 Ethernet controller [0200]: Intel Corporation Ethernet
> > > Connection X553 1GbE [8086:15e4] (rev 11)
> > >
> > > ethtool -i eno1
> > > driver: ixgbe
> > > version: 6.3.0
> > > firmware-version: 0x80000877
> > > expansion-rom-version:
> > > bus-info: 0000:06:00.0
> > > supports-statistics: yes
> > > supports-test: yes
> > > supports-eeprom-access: yes
> > > supports-register-dump: yes
> > > supports-priv-flags: yes
> > >
> > >>> But now the largest frame i can send is 2030 bytes (ie ping -s 2002)...
> > >>>
> > >>> I don't see any warning from the XDP subsystem so I almost assume
> > >>> that's not it...
> >
> > After test we don't see any discrepancies in how jumbo frames work between mentioned kernels.
> > Please add more details about configuration you are using and steps how to reproduce this issue.
> >
> >
> > Thanks,
> > Piotr
_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan

Re: [Intel-wired-lan] [ixgbe] regression: jumbo frames not working

[Jesse Brandeburg]

[-- Attachment #1.1: Type: text/plain, Size: 677 bytes --]

On Fri, May 5, 2023 at 1:28 PM Ian Kumlien <ian.kumlien@gmail.com> wrote:

> As a side note, I don't understand how the switch booted with jumbo
> frames off - the config stated that they should be on....
> So, some kind of failover... sorry for the noise..
>
> On Fri, May 5, 2023 at 7:50 PM Ian Kumlien <ian.kumlien@gmail.com> wrote:
> >
> > Sorry... It seems like my cisco switch booted with jumbo-frames
> > disabled after a power outage...
> > The conf says it should be enabled - but somehow it wasn't :/



Thanks for letting us know!
#regzbot resolve: not a regression. The reporter found the cause to be a
network config issue after a power outage.

[-- Attachment #1.2: Type: text/html, Size: 1181 bytes --]

[-- Attachment #2: Type: text/plain, Size: 162 bytes --]

_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan

Re: [Intel-wired-lan] [ixgbe] regression: jumbo frames not working

[Linux regression tracking #update (Thorsten Leemhuis)]

On 06.05.23 20:33, Jesse Brandeburg wrote:
> On Fri, May 5, 2023 at 1:28 PM Ian Kumlien <ian.kumlien@gmail.com
> <mailto:ian.kumlien@gmail.com>> wrote:
> 
>     As a side note, I don't understand how the switch booted with jumbo
>     frames off - the config stated that they should be on....
>     So, some kind of failover... sorry for the noise..
> 
>     On Fri, May 5, 2023 at 7:50 PM Ian Kumlien <ian.kumlien@gmail.com
>     <mailto:ian.kumlien@gmail.com>> wrote:
>     >
>     > Sorry... It seems like my cisco switch booted with jumbo-frames
>     > disabled after a power outage...
>     > The conf says it should be enabled - but somehow it wasn't :/
> 
> 
> 
> Thanks for letting us know!
> #regzbot resolve: not a regression. The reporter found the cause to be a
> network config issue after a power outage. 

Jesse, many thx for this, but this didn't work, as regzbot expects
commands to be in a separate paragraph to avoid catching things not
meant for it. So let me realize your intention:

#regzbot resolve: not a regression. The reporter found the cause to be a
network config issue after a power outage.

Ciao, Thorsten (wearing his 'the Linux kernel's regression tracker' hat)
--
Everything you wanna know about Linux kernel regression tracking:
https://linux-regtracking.leemhuis.info/about/#tldr
That page also explains what to do if mails like this annoy you.
_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan