From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S937473AbcLUBmG (ORCPT ); Tue, 20 Dec 2016 20:42:06 -0500 Received: from szxga01-in.huawei.com ([58.251.152.64]:28449 "EHLO szxga01-in.huawei.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S933880AbcLUBlx (ORCPT ); Tue, 20 Dec 2016 20:41:53 -0500 Subject: Re: [PATCH net-next] ixgbevf: fix 'Etherleak' in ixgbevf To: Alexander Duyck References: <1481802034-77729-1-git-send-email-chenweilong@huawei.com> <5c942aba-f7fb-ede6-b6a2-e591025f53a5@huawei.com> CC: Jeff Kirsher , intel-wired-lan , Netdev , "linux-kernel@vger.kernel.org" , From: Weilong Chen Message-ID: Date: Wed, 21 Dec 2016 09:40:14 +0800 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [10.177.216.125] X-CFilter-Loop: Reflected Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Thanks for you explanation, it's very professional. My test is like this: The Nessus is deployed on a windows server, the peer is a X86_64 linux host which run several VMs on it. The nic is Intel 82599 and SRIOV is enabled. VFs are passthroughed to the VMs. No DPDK. The Nessus server send small ICMP echo request packets to the VM, and then check the reply, and report the error: "11197 - Multiple Ethernet Driver Frame Padding Information Disclosure (Etherleak)" "Padding observed in one frame : 0x00: 00 00 00 00 00 00 00 00 00 00 00 00 00 57 37 28 .............W7( 0x10: 76 v Padding observed in another frame : 0x00: 00 00 00 00 00 00 00 00 00 00 00 00 00 D3 4D 75 ..............Mu 0x10: 28 (" I only have Nessus's windows version, so can't test on linux. Maybe the windows server does not pad small packets to 60 bytes on the receive path. On 2016/12/21 0:36, Alexander Duyck wrote: > The limit of 17 is just based on the hardware. Specifically the > olinfo field in the Tx descriptor has a minimum length of 17 has a > requirement. The hardware itself is supposed to be capable of padding > short frames that are supposed to be transmitted. The drivers are > supposed to pad short frames on receive to get them up to 60 bytes. > > When you are seeing this issue are you sending frames from the VF to > one of the local interfaces on the same port or to an external > interface? Also are you receiving on another linux ixgbevf driver or > are you receiving the packet using a different driver interface such > as DPDK? I'm just wanting to verify this as it is possible that the > memory leak you are seeing is on the receiver and not on the source if > you are transmitting to a local VF or the PF as the receiver will have > to pad the frame in such a case to get it up to 60 bytes. > > - Alex > > On Tue, Dec 20, 2016 at 3:50 AM, Weilong Chen wrote: >> Hi, >> >> Thanks for you reply. >> We test you patch, but the problem is still there, it seems do not work. >> >> I'm not sure why ixgbe use the limit 17. The kenel use ETH_ZLEN (60) with >> out FCS. A lot of drivers such as e1000 use it. Any explaination? >> >> Thanks. >> >> >> On 2016/12/16 0:13, Alexander Duyck wrote: >>> >>> On Thu, Dec 15, 2016 at 3:40 AM, Weilong Chen >>> wrote: >>>> >>>> Nessus report the vf appears to leak memory in network packets. >>>> Fix this by padding all small packets manually. >>>> >>>> And the CVE-2003-0001. >>>> >>>> https://ofirarkin.files.wordpress.com/2008/11/atstake_etherleak_report.pdf >>>> >>>> Signed-off-by: Weilong Chen >>>> --- >>>> drivers/net/ethernet/intel/ixgbevf/ixgbevf_main.c | 7 +++++++ >>>> 1 file changed, 7 insertions(+) >>>> >>>> diff --git a/drivers/net/ethernet/intel/ixgbevf/ixgbevf_main.c >>>> b/drivers/net/ethernet/intel/ixgbevf/ixgbevf_main.c >>>> index 6d4bef5..137a154 100644 >>>> --- a/drivers/net/ethernet/intel/ixgbevf/ixgbevf_main.c >>>> +++ b/drivers/net/ethernet/intel/ixgbevf/ixgbevf_main.c >>>> @@ -3654,6 +3654,13 @@ static int ixgbevf_xmit_frame(struct sk_buff *skb, >>>> struct net_device *netdev) >>>> return NETDEV_TX_OK; >>>> } >>>> >>>> + /* On PCI/PCI-X HW, if packet size is less than ETH_ZLEN, >>>> + * packets may get corrupted during padding by HW. >>>> + * To WA this issue, pad all small packets manually. >>>> + */ >>>> + if (eth_skb_pad(skb)) >>>> + return NETDEV_TX_OK; >>>> + >>> >>> >>> So the patch description for this probably isn't correct. It looks >>> like the problem isn't leaking data it is the fact that the frames >>> aren't being padded to prevent malicious events. The only issue is >>> the patch is padding by a bit too much. I would recommend replacing >>> this with the following from ixgbe: >>> >>> /* >>> * The minimum packet size for olinfo paylen is 17 so pad the skb >>> * in order to meet this minimum size requirement. >>> */ >>> if (skb_put_padto(skb, 17)) >>> return NETDEV_TX_OK; >>> >>> >>>> tx_ring = adapter->tx_ring[skb->queue_mapping]; >>>> >>>> /* need: 1 descriptor per page * >>>> PAGE_SIZE/IXGBE_MAX_DATA_PER_TXD, >>>> -- >>>> 1.7.12 >>>> >>> >>> . >>> >> > > . > From mboxrd@z Thu Jan 1 00:00:00 1970 From: Weilong Chen Date: Wed, 21 Dec 2016 09:40:14 +0800 Subject: [Intel-wired-lan] [PATCH net-next] ixgbevf: fix 'Etherleak' in ixgbevf In-Reply-To: References: <1481802034-77729-1-git-send-email-chenweilong@huawei.com> <5c942aba-f7fb-ede6-b6a2-e591025f53a5@huawei.com> Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit To: intel-wired-lan@osuosl.org List-ID: Thanks for you explanation, it's very professional. My test is like this: The Nessus is deployed on a windows server, the peer is a X86_64 linux host which run several VMs on it. The nic is Intel 82599 and SRIOV is enabled. VFs are passthroughed to the VMs. No DPDK. The Nessus server send small ICMP echo request packets to the VM, and then check the reply, and report the error: "11197 - Multiple Ethernet Driver Frame Padding Information Disclosure (Etherleak)" "Padding observed in one frame : 0x00: 00 00 00 00 00 00 00 00 00 00 00 00 00 57 37 28 .............W7( 0x10: 76 v Padding observed in another frame : 0x00: 00 00 00 00 00 00 00 00 00 00 00 00 00 D3 4D 75 ..............Mu 0x10: 28 (" I only have Nessus's windows version, so can't test on linux. Maybe the windows server does not pad small packets to 60 bytes on the receive path. On 2016/12/21 0:36, Alexander Duyck wrote: > The limit of 17 is just based on the hardware. Specifically the > olinfo field in the Tx descriptor has a minimum length of 17 has a > requirement. The hardware itself is supposed to be capable of padding > short frames that are supposed to be transmitted. The drivers are > supposed to pad short frames on receive to get them up to 60 bytes. > > When you are seeing this issue are you sending frames from the VF to > one of the local interfaces on the same port or to an external > interface? Also are you receiving on another linux ixgbevf driver or > are you receiving the packet using a different driver interface such > as DPDK? I'm just wanting to verify this as it is possible that the > memory leak you are seeing is on the receiver and not on the source if > you are transmitting to a local VF or the PF as the receiver will have > to pad the frame in such a case to get it up to 60 bytes. > > - Alex > > On Tue, Dec 20, 2016 at 3:50 AM, Weilong Chen wrote: >> Hi, >> >> Thanks for you reply. >> We test you patch, but the problem is still there, it seems do not work. >> >> I'm not sure why ixgbe use the limit 17. The kenel use ETH_ZLEN (60) with >> out FCS. A lot of drivers such as e1000 use it. Any explaination? >> >> Thanks. >> >> >> On 2016/12/16 0:13, Alexander Duyck wrote: >>> >>> On Thu, Dec 15, 2016 at 3:40 AM, Weilong Chen >>> wrote: >>>> >>>> Nessus report the vf appears to leak memory in network packets. >>>> Fix this by padding all small packets manually. >>>> >>>> And the CVE-2003-0001. >>>> >>>> https://ofirarkin.files.wordpress.com/2008/11/atstake_etherleak_report.pdf >>>> >>>> Signed-off-by: Weilong Chen >>>> --- >>>> drivers/net/ethernet/intel/ixgbevf/ixgbevf_main.c | 7 +++++++ >>>> 1 file changed, 7 insertions(+) >>>> >>>> diff --git a/drivers/net/ethernet/intel/ixgbevf/ixgbevf_main.c >>>> b/drivers/net/ethernet/intel/ixgbevf/ixgbevf_main.c >>>> index 6d4bef5..137a154 100644 >>>> --- a/drivers/net/ethernet/intel/ixgbevf/ixgbevf_main.c >>>> +++ b/drivers/net/ethernet/intel/ixgbevf/ixgbevf_main.c >>>> @@ -3654,6 +3654,13 @@ static int ixgbevf_xmit_frame(struct sk_buff *skb, >>>> struct net_device *netdev) >>>> return NETDEV_TX_OK; >>>> } >>>> >>>> + /* On PCI/PCI-X HW, if packet size is less than ETH_ZLEN, >>>> + * packets may get corrupted during padding by HW. >>>> + * To WA this issue, pad all small packets manually. >>>> + */ >>>> + if (eth_skb_pad(skb)) >>>> + return NETDEV_TX_OK; >>>> + >>> >>> >>> So the patch description for this probably isn't correct. It looks >>> like the problem isn't leaking data it is the fact that the frames >>> aren't being padded to prevent malicious events. The only issue is >>> the patch is padding by a bit too much. I would recommend replacing >>> this with the following from ixgbe: >>> >>> /* >>> * The minimum packet size for olinfo paylen is 17 so pad the skb >>> * in order to meet this minimum size requirement. >>> */ >>> if (skb_put_padto(skb, 17)) >>> return NETDEV_TX_OK; >>> >>> >>>> tx_ring = adapter->tx_ring[skb->queue_mapping]; >>>> >>>> /* need: 1 descriptor per page * >>>> PAGE_SIZE/IXGBE_MAX_DATA_PER_TXD, >>>> -- >>>> 1.7.12 >>>> >>> >>> . >>> >> > > . >