From mboxrd@z Thu Jan 1 00:00:00 1970 From: jacob jacob Subject: Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM) Date: Tue, 24 Mar 2015 10:13:44 -0400 Message-ID: References: <550A85B3.4070703@redhat.com> <550ADAD2.8070506@redhat.com> <550FBE70.40201@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Cc: Shannon Nelson , Bandan Das , Alex Williamson , QEMU Developers , kvm-devel , netdev@vger.kernel.org To: Stefan Assmann Return-path: Received: from mail-we0-f175.google.com ([74.125.82.175]:34234 "EHLO mail-we0-f175.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752179AbbCXONp (ORCPT ); Tue, 24 Mar 2015 10:13:45 -0400 In-Reply-To: <550FBE70.40201@redhat.com> Sender: netdev-owner@vger.kernel.org List-ID: After update to latest firmware and using version 1.2.37 of i40e driver, things are looking better with PCI passthrough. ]# ethtool -i eth3 driver: i40e version: 1.2.37 firmware-version: f4.33.31377 a1.2 n4.42 e1930 bus-info: 0000:00:07.0 supports-statistics: yes supports-test: yes supports-eeprom-access: yes supports-register-dump: yes supports-priv-flags: yes There are still issues running dpdk 1.8.0 from the VM using the pci passthrough devices and looks like it puts the devices in a bad state. i40e driver will not bind after this happens and a host reboot is required to recover. I'll post further updates as i make progress. Thanks for all the help. On Mon, Mar 23, 2015 at 3:19 AM, Stefan Assmann wrote: > On 20.03.2015 21:55, jacob jacob wrote: >> On Thu, Mar 19, 2015 at 10:18 AM, Stefan Assmann wrote: >>> On 19.03.2015 15:04, jacob jacob wrote: >>>> Hi Stefan, >>>> have you been able to get PCI passthrough working without any issues >>>> after the upgrade? >>> >>> My XL710 fails to transfer regular TCP traffic (netperf). If that works >>> for you then you're already one step ahead of me. Afraid I can't help >>> you there. >> >> I have data transfer working when trying the test runs on the host >> itself. Are you seeing problems when directly trying the TCP traffic >> from the host itself? > > Correct. > >> The issues that i am seeing are specific to the case when the devices >> are passed via PCI passthrough into the VM. >> >> Any ideas whether this would be a kvm/qemu or i40e driver issue? >> (Updating to the latest firmware and using latest i40e driver didn't >> seem to help.) > > Hard to say, that's probably something for Intel to look into. > > Stefan From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:59908) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1YaPaa-0007O5-BU for qemu-devel@nongnu.org; Tue, 24 Mar 2015 10:13:53 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1YaPaT-0000tY-RG for qemu-devel@nongnu.org; Tue, 24 Mar 2015 10:13:52 -0400 Received: from mail-wi0-x235.google.com ([2a00:1450:400c:c05::235]:36563) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1YaPaT-0000tG-LF for qemu-devel@nongnu.org; Tue, 24 Mar 2015 10:13:45 -0400 Received: by wibg7 with SMTP id g7so75920979wib.1 for ; Tue, 24 Mar 2015 07:13:44 -0700 (PDT) MIME-Version: 1.0 In-Reply-To: <550FBE70.40201@redhat.com> References: <550A85B3.4070703@redhat.com> <550ADAD2.8070506@redhat.com> <550FBE70.40201@redhat.com> Date: Tue, 24 Mar 2015 10:13:44 -0400 Message-ID: From: jacob jacob Content-Type: text/plain; charset=UTF-8 Subject: Re: [Qemu-devel] PCI passthrough of 40G ethernet interface (Openstack/KVM) List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Stefan Assmann Cc: kvm-devel , netdev@vger.kernel.org, Shannon Nelson , Alex Williamson , QEMU Developers , Bandan Das After update to latest firmware and using version 1.2.37 of i40e driver, things are looking better with PCI passthrough. ]# ethtool -i eth3 driver: i40e version: 1.2.37 firmware-version: f4.33.31377 a1.2 n4.42 e1930 bus-info: 0000:00:07.0 supports-statistics: yes supports-test: yes supports-eeprom-access: yes supports-register-dump: yes supports-priv-flags: yes There are still issues running dpdk 1.8.0 from the VM using the pci passthrough devices and looks like it puts the devices in a bad state. i40e driver will not bind after this happens and a host reboot is required to recover. I'll post further updates as i make progress. Thanks for all the help. On Mon, Mar 23, 2015 at 3:19 AM, Stefan Assmann wrote: > On 20.03.2015 21:55, jacob jacob wrote: >> On Thu, Mar 19, 2015 at 10:18 AM, Stefan Assmann wrote: >>> On 19.03.2015 15:04, jacob jacob wrote: >>>> Hi Stefan, >>>> have you been able to get PCI passthrough working without any issues >>>> after the upgrade? >>> >>> My XL710 fails to transfer regular TCP traffic (netperf). If that works >>> for you then you're already one step ahead of me. Afraid I can't help >>> you there. >> >> I have data transfer working when trying the test runs on the host >> itself. Are you seeing problems when directly trying the TCP traffic >> from the host itself? > > Correct. > >> The issues that i am seeing are specific to the case when the devices >> are passed via PCI passthrough into the VM. >> >> Any ideas whether this would be a kvm/qemu or i40e driver issue? >> (Updating to the latest firmware and using latest i40e driver didn't >> seem to help.) > > Hard to say, that's probably something for Intel to look into. > > Stefan