* Re: Linux kernel commit breaks IPMI on iface downing [not found] <CAJPaPGU2_68J4BZanm+Lw3O+WTiwO3swegh5grP5Bn-XprLOwg@mail.gmail.com> @ 2015-08-14 1:30 ` Michael Chan 2015-08-14 9:22 ` Sébastien Bocahu 0 siblings, 1 reply; 6+ messages in thread From: Michael Chan @ 2015-08-14 1:30 UTC (permalink / raw) To: Sébastien Bocahu, harish.patil; +Cc: davem, netdev +netdev and Harish who is the current maintainer of bnx2 at qlogic. The patch in question effectively just removes the bnx2_set_power_state() call during "ip link set down". If there is IPMI, the firmware should know the link needs to stay up when the driver resets the device during bnx2_close(). This should be a very common scenario. Please provide the firmware versions to Harish with ethtool -i. Perhaps upgrading the firmware can resolve this issue. On Thu, 2015-08-13 at 15:47 +0200, Sébastien Bocahu wrote: > Hi, > > Being unable to install Debian Jessie via IPMI on mainstream Dell R410 > servers that used to be well supported by Debian Wheezy, I tracked the > problem down to a specific commit in the Linux kernel, specifically in > the bnx2 driver. > The issue is that "ip link set eth0 down" takes the Ethernet part of > the BMC down (shared NIC for BMC+eth0), cutting off the IPMI session. > The BMC gets back only after power cycling. > > Hardware: Dell R410 w/ a Broadcom 5716 NIC: > Ethernet controller: Broadcom Corporation NetXtreme II BCM5716 Gigabit > Ethernet (rev 20) ) > Part number: BCM95716C1 > Vendor specific: 6.4.5 (Firmware has been updated to the latest > version available by Dell's support website) > > I built many kernels to track which change caused the issue and it > seems that's : > 25bfb1dd4ba3b2d9a49ce9d9b0cd7be1840e15ed (bnx2: Add pci shutdown handler.) > > Before, 'ip link set eth0 down' would just cause 2/3s of packet loss > but IPMI would still be working afterwards. > > I'm available for more informations and/or testing if needed. > > Thanks ! > > > ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Linux kernel commit breaks IPMI on iface downing 2015-08-14 1:30 ` Linux kernel commit breaks IPMI on iface downing Michael Chan @ 2015-08-14 9:22 ` Sébastien Bocahu 2015-09-04 7:55 ` Sébastien Bocahu 0 siblings, 1 reply; 6+ messages in thread From: Sébastien Bocahu @ 2015-08-14 9:22 UTC (permalink / raw) To: Michael Chan; +Cc: harish.patil, davem, netdev The BNX2 firmware has already been updated to the latest version available from Dell. root@debian:~# ethtool -i eth0 | grep firmware firmware-version: 6.4.5 bc 5.2.3 NCSI 2.0.11 2015-08-14 3:30 GMT+02:00 Michael Chan <mchan@broadcom.com>: > +netdev and Harish who is the current maintainer of bnx2 at qlogic. > > The patch in question effectively just removes the > bnx2_set_power_state() call during "ip link set down". If there is > IPMI, the firmware should know the link needs to stay up when the driver > resets the device during bnx2_close(). This should be a very common > scenario. Please provide the firmware versions to Harish with ethtool > -i. Perhaps upgrading the firmware can resolve this issue. > > On Thu, 2015-08-13 at 15:47 +0200, Sébastien Bocahu wrote: >> Hi, >> >> Being unable to install Debian Jessie via IPMI on mainstream Dell R410 >> servers that used to be well supported by Debian Wheezy, I tracked the >> problem down to a specific commit in the Linux kernel, specifically in >> the bnx2 driver. >> The issue is that "ip link set eth0 down" takes the Ethernet part of >> the BMC down (shared NIC for BMC+eth0), cutting off the IPMI session. >> The BMC gets back only after power cycling. >> >> Hardware: Dell R410 w/ a Broadcom 5716 NIC: >> Ethernet controller: Broadcom Corporation NetXtreme II BCM5716 Gigabit >> Ethernet (rev 20) ) >> Part number: BCM95716C1 >> Vendor specific: 6.4.5 (Firmware has been updated to the latest >> version available by Dell's support website) >> >> I built many kernels to track which change caused the issue and it >> seems that's : >> 25bfb1dd4ba3b2d9a49ce9d9b0cd7be1840e15ed (bnx2: Add pci shutdown handler.) >> >> Before, 'ip link set eth0 down' would just cause 2/3s of packet loss >> but IPMI would still be working afterwards. >> >> I'm available for more informations and/or testing if needed. >> >> Thanks ! >> >> >> > > -- Sébastien Bocahu IT infrastructure manager 4, Rue Montrochet - 69002 - Lyon, France +33 (0)437651704 - Phone ReportLinker.com ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Linux kernel commit breaks IPMI on iface downing 2015-08-14 9:22 ` Sébastien Bocahu @ 2015-09-04 7:55 ` Sébastien Bocahu 2015-09-04 8:29 ` Michael Chan 0 siblings, 1 reply; 6+ messages in thread From: Sébastien Bocahu @ 2015-09-04 7:55 UTC (permalink / raw) To: Michael Chan; +Cc: harish.patil, davem, netdev Hi, Any chance this behaviour gets fixed, with either a new firmware or a workaround in the kernel ? thanks ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Linux kernel commit breaks IPMI on iface downing 2015-09-04 7:55 ` Sébastien Bocahu @ 2015-09-04 8:29 ` Michael Chan 2015-09-09 1:33 ` Harish Patil 0 siblings, 1 reply; 6+ messages in thread From: Michael Chan @ 2015-09-04 8:29 UTC (permalink / raw) To: Sébastien Bocahu; +Cc: harish.patil, davem, netdev On Fri, 2015-09-04 at 09:55 +0200, Sébastien Bocahu wrote: > Hi, > > Any chance this behaviour gets fixed, with either a new firmware or a > workaround in the kernel ? > As I said earlier, when we call bnx2_shutdown_chip(), we inform the firmware that the driver is shutting down. The firmware should know that there is IPMI firmware and the link needs to stay up. In the older driver, we would also call bnx2_set_power_state() which would send some additional messages to the firmware before putting the device in D3hot. May be these messages are required by the firmware to keep the link up. Harish, please check with your firmware team. Thanks. ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Linux kernel commit breaks IPMI on iface downing 2015-09-04 8:29 ` Michael Chan @ 2015-09-09 1:33 ` Harish Patil 2016-08-02 7:58 ` Chen-Yu Tsai 0 siblings, 1 reply; 6+ messages in thread From: Harish Patil @ 2015-09-09 1:33 UTC (permalink / raw) To: Michael Chan, Sébastien Bocahu; +Cc: David Miller, netdev, Ameen Rahman >On Fri, 2015-09-04 at 09:55 +0200, Sébastien Bocahu wrote: >> Hi, >> >> Any chance this behaviour gets fixed, with either a new firmware or a >> workaround in the kernel ? >> > >As I said earlier, when we call bnx2_shutdown_chip(), we inform the >firmware that the driver is shutting down. The firmware should know >that there is IPMI firmware and the link needs to stay up. > >In the older driver, we would also call bnx2_set_power_state() which >would send some additional messages to the firmware before putting the >device in D3hot. May be these messages are required by the firmware to >keep the link up. Harish, please check with your firmware team. >Thanks. > > > > Hi Michael/Sebastien, ACK. Sure, I will look into it and get back. Thanks, Harish ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Linux kernel commit breaks IPMI on iface downing 2015-09-09 1:33 ` Harish Patil @ 2016-08-02 7:58 ` Chen-Yu Tsai 0 siblings, 0 replies; 6+ messages in thread From: Chen-Yu Tsai @ 2016-08-02 7:58 UTC (permalink / raw) To: Harish Patil Cc: Michael Chan, Sébastien Bocahu, David Miller, netdev, Ameen Rahman Hi, On Wed, Sep 9, 2015 at 9:33 AM, Harish Patil <harish.patil@qlogic.com> wrote: > >>On Fri, 2015-09-04 at 09:55 +0200, Sébastien Bocahu wrote: >>> Hi, >>> >>> Any chance this behaviour gets fixed, with either a new firmware or a >>> workaround in the kernel ? >>> >> >>As I said earlier, when we call bnx2_shutdown_chip(), we inform the >>firmware that the driver is shutting down. The firmware should know >>that there is IPMI firmware and the link needs to stay up. >> >>In the older driver, we would also call bnx2_set_power_state() which >>would send some additional messages to the firmware before putting the >>device in D3hot. May be these messages are required by the firmware to >>keep the link up. Harish, please check with your firmware team. >>Thanks. >> >> >> >> > > Hi Michael/Sebastien, > ACK. Sure, I will look into it and get back. Sorry to resurrect such an old thread. I'm still having problems with this. We have a whole bunch of Dell PowerEdge R210 II servers at our datacenter. These have the NetXtreme II BCM 5716 controller. Most still have the factory firmware (6.2.12) while a few have been updated to the latest firmware released by Dell (7.12.19). With both versions, IPMI over LAN becomes unusable as soon as Ubuntu's installer reconfigures the network. It only returns after installation is complete and the system is reboot, after the firmware is reloaded. This means if anything were to fail during an automated installation, the system would no longer be controllable remotely. For us this is a huge inconvenience, as we have hundreds of them. If any go down due to bad installation scripts or entering a wrong command, someone has to literally go there and reboot the machine. I also tested with Ubuntu 16.04.1, running Ubuntu's 4.4.0-31-generic kernel. IPMI over LAN is unusable as soon as "ip link set XXX down" is run, and recovers in 1 second after "ip link set XXX up" is run, or when the system is restarted. So in addition to IPMI not working on iface down, there might be a problem with how the installer works, resulting in the prolonged outage. Regards ChenYu ^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2016-08-02 7:59 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
[not found] <CAJPaPGU2_68J4BZanm+Lw3O+WTiwO3swegh5grP5Bn-XprLOwg@mail.gmail.com>
2015-08-14 1:30 ` Linux kernel commit breaks IPMI on iface downing Michael Chan
2015-08-14 9:22 ` Sébastien Bocahu
2015-09-04 7:55 ` Sébastien Bocahu
2015-09-04 8:29 ` Michael Chan
2015-09-09 1:33 ` Harish Patil
2016-08-02 7:58 ` Chen-Yu Tsai
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).