Re: [dpdk-dev] Not able to start IAVF PMD with dpdk 20.11.3

["Dey, Souvik" <sodey@rbbn.com>]

Hi Wu, 
Thanks for the update. I got rid of the vfio-pci probe issue by enabling "modprobe vfio enable_unsafe_noiommu_mode=1". This was required as I am trying inside a VM where VT-d is not enabled. Now once I bind the interfaces( VF) to the vfio-pci instead of uio_pci_generic , the links are coming up fine and I am able to rx/tx packets out of the VF. Thanks once again for the quick help on this. 

Just one follow up question. Are we saying we cannot use uio_pci_generic  module for the E810 VFs ? is it a bug, do we have any fixes for the same already upstreamed ? 

--
Regards,
Souvik

-----Original Message-----
From: dev <dev-bounces@dpdk.org> On Behalf Of Dey, Souvik
Sent: Friday, September 24, 2021 1:57 AM
To: Wu, Jingjing <jingjing.wu@intel.com>; dev@dpdk.org; Xing, Beilei <beilei.xing@intel.com>
Subject: [EXTERNAL] Re: [dpdk-dev] Not able to start IAVF PMD with dpdk 20.11.3

With vfio_pci , I am getting the following error and bind itself is failing, due to probe fail with EINVAL.
[root@connexip swe]# ./dpdk-devbind.py -b vfio_pci 08:00.0
Error: bind failed for 0000:08:00.0 - Cannot open /sys/bus/pci/drivers/vfio_pci/bind
Sep 24 01:50:29 connexip kernel: [  323.376403] vfio-pci: probe of 0000:08:00.0 failed with error -22 Sep 24 01:50:29 connexip kernel: [  323.376440] vfio-pci: probe of 0000:08:00.0 failed with error -22

I am using kernel 4.19.194 from debian buster.

From: Wu, Jingjing <jingjing.wu@intel.com>
Sent: Thursday, September 23, 2021 8:41 PM
To: Dey, Souvik <sodey@rbbn.com>; dev@dpdk.org; Xing, Beilei <beilei.xing@intel.com>
Subject: [EXTERNAL] RE: Not able to start IAVF PMD with dpdk 20.11.3

Could you have a try to switch from  uio_pci_generic to vfio_pci?

From: Dey, Souvik <sodey@rbbn.com<mailto:sodey@rbbn.com>>
Sent: Thursday, September 23, 2021 11:29 PM
To: dev@dpdk.org<mailto:dev@dpdk.org>; Xing, Beilei <beilei.xing@intel.com<mailto:beilei.xing@intel.com>>; Wu, Jingjing <jingjing.wu@intel.com<mailto:jingjing.wu@intel.com>>
Subject: Not able to start IAVF PMD with dpdk 20.11.3

Hi All,
     Trying to test E810 Sr-IOV based nic card with 20.11.3 dpdk. I am running the host kernel driver and only the VF is attached to the VM where I am running dpdk. But when I attaching the VF to the testpmd it is throwing the below error. Is there are way to move forward here ?

[root@connexip linuxadmin]# ./dpdk-testpmd -c 0xf -n 4 -a 08:00.0 -- -i --rxq=16 --txq=16
EAL: Detected 4 lcore(s)
EAL: Detected 1 NUMA nodes
EAL: Detected static linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: No available hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
EAL: Probe PCI driver: net_iavf (8086:1889) device: 0000:08:00.0 (socket 0)
EAL: Error reading from file descriptor 27: Input/output error
EAL: No legacy callbacks, legacy socket not created Interactive-mode selected
testpmd: create a new mbuf pool <mb_pool_0>: n=171456, size=2176, socket=0
testpmd: preferred mempool ops selected: ring_mp_mc

Warning! port-topology=paired and odd forward ports number, the last port will pair with itself.

Configuring Port 0 (socket 0)
EAL: Error reading from file descriptor 27: Input/output error
iavf_execute_vf_cmd(): No response for cmd 28
iavf_disable_vlan_strip(): Failed to execute command of OP_DISABLE_VLAN_STRIPPING
iavf_execute_vf_cmd(): No response for cmd 24
iavf_configure_rss_lut(): Failed to execute command of OP_CONFIG_RSS_LUT
iavf_dev_configure(): configure rss failed
Port0 dev_configure = -1
Fail to configure port 0
EAL: Error - exiting with code: 1
  Cause: Start ports failed
[root@connexip linuxadmin]#


I do see the matching list for driver but is this required even if I use kernel driver on the host and only IAVF PMD on the guest ?

DPDK
Kernel Driver
OS Default DDP
COMMS DDP
Wireless DDP
Firmware
20.11
1.3.2
1.3.20
1.3.24
N/A
2.3
21.02
1.4.11
1.3.24
1.3.28
1.3.4
2.4



Host details:
Red Hat Enterprise Linux release 8.2 (Ootpa) [root@localhost ~]# modinfo ice
filename:       /lib/modules/4.18.0-193.19.1.el8_2.x86_64/kernel/drivers/net/ethernet/intel/ice/ice.ko.xz
firmware:       intel/ice/ddp/ice.pkg (ice-1.3.4.0.pkg)
version:        0.8.1-k
license:        GPL v2
description:    Intel(R) Ethernet Connection E800 Series Linux Driver
author:         Intel Corporation, linux.nics@intel.com<mailto:linux.nics@intel.com>
rhelversion:    8.2
Using vfio-pci to connect the VF to the VM.

Guest Details:
OS : debian buster
Dpdk : 20.11.3
Interface bound to uio_pci_generic
[root@connexip linuxadmin]# /opt/sonus/bin/np/swe/dpdk-devbind.py --status

Network devices using DPDK-compatible driver ============================================
0000:01:00.0 'Virtio network device 1041' drv=uio_pci_generic unused=virtio_pci
0000:08:00.0 'Ethernet Adaptive Virtual Function 1889' drv=uio_pci_generic unused=i40evf
0000:09:00.0 'Ethernet Adaptive Virtual Function 1889' drv=uio_pci_generic unused=i40evf

Network devices using kernel driver
===================================
0000:02:00.0 'Virtio network device 1041' if=ha0 drv=virtio-pci unused=virtio_pci,uio_pci_generic *Active*


Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. and its Affiliates that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments.

Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. and its Affiliates that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments.

Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. and its Affiliates that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments.