PMD for Cisco VIC Ethernet NIC - Request for guidelines for submission

PMD for Cisco VIC Ethernet NIC - Request for guidelines for submission

[Sujith Sankar (ssujith)]

Hi all,

We have been working on development of poll-mode driver for Cisco VIC
Ethernet NIC and integration of it with DPDK.  We would like to submit
this poll-mode driver (ENIC PMD) to the DPDK community so that it could be
part of the DPDK tree.

Could someone please provide the guidelines and steps to do this?  As of
now, ENIC PMD is being tested with DPDK 1.6.0r2.  Is it alright to submit
a patch for DPDK 1.6.0r2?

One aspect of ENIC PMD is that it works with VFIO-PCI and not UIO.  Hope
this is acceptable.  The following thread in dpdk-dev influenced this
decision.
http://dpdk.org/ml/archives/dev/2013-July/000373.html

ENIC PMD uses one interrupt per interface and it is used by the NIC for
signalling the driver in case of any error.  Since this does not come in
the fast path, it should be acceptable, isn¹t it?

Please give your suggestions and comments.

Thanks,
-Sujith

Re: PMD for Cisco VIC Ethernet NIC - Request for guidelines for submission

[Burakov, Anatoly]

Hi Sujith,

> One aspect of ENIC PMD is that it works with VFIO-PCI and not UIO.  Hope
> this is acceptable.  The following thread in dpdk-dev influenced this decision.
> http://dpdk.org/ml/archives/dev/2013-July/000373.html

You may find this [1] patchset interesting. Basically, it adds native support for VFIO to do the binding and unbinding in DPDK. Whether it fits your purposes depends on your code, but hopefully you'll be able to simplify your code.

[1] http://dpdk.org/ml/archives/dev/2014-May/002568.html

Best regards,
Anatoly Burakov
DPDK SW Engineer

Re: PMD for Cisco VIC Ethernet NIC - Request for guidelines for submission

[Sujith Sankar (ssujith)]

Thank you Anatoly !
I¹ll take a look at it and get back in case of questions.

-Sujith

On 28/05/14 2:22 pm, "Burakov, Anatoly" <anatoly.burakov-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org> wrote:

>Hi Sujith,
>
>> One aspect of ENIC PMD is that it works with VFIO-PCI and not UIO.  Hope
>> this is acceptable.  The following thread in dpdk-dev influenced this
>>decision.
>> http://dpdk.org/ml/archives/dev/2013-July/000373.html
>
>You may find this [1] patchset interesting. Basically, it adds native
>support for VFIO to do the binding and unbinding in DPDK. Whether it fits
>your purposes depends on your code, but hopefully you'll be able to
>simplify your code.
>
>[1] http://dpdk.org/ml/archives/dev/2014-May/002568.html
>
>Best regards,
>Anatoly Burakov
>DPDK SW Engineer
>
>
>

[PATCH 0/2] Fixed/Simplified Ring PMD

[Pablo de Lara]

Ring PMD library and unit test was modified last release,
causing the unit test to need ring ethdevs to be created
from the command line. This patch simplifies the test
and make it functional with devices created with EAL option vdev.

Also, ring ethdev creation from vdev has been changed, so now
only one device is created for each vdev argument (up to 3 devices
were created). 


Pablo de Lara (2):
  ring_pmd: Removed extra devices creation when passing vdev parameter
  app/test: Simplified ring pmd test

 app/test/test_pmd_ring.c           |  202 +++++++++++++-----------------------
 lib/librte_pmd_ring/rte_eth_ring.c |    3 +-
 2 files changed, 73 insertions(+), 132 deletions(-)

Re: [PATCH 0/2] Fixed/Simplified Ring PMD

[Neil Horman]

On Wed, Jul 09, 2014 at 03:35:34PM +0100, Pablo de Lara wrote:
> Ring PMD library and unit test was modified last release,
> causing the unit test to need ring ethdevs to be created
> from the command line. This patch simplifies the test
> and make it functional with devices created with EAL option vdev.
> 
> Also, ring ethdev creation from vdev has been changed, so now
> only one device is created for each vdev argument (up to 3 devices
> were created). 
> 
> 
> Pablo de Lara (2):
>   ring_pmd: Removed extra devices creation when passing vdev parameter
>   app/test: Simplified ring pmd test
> 
>  app/test/test_pmd_ring.c           |  202 +++++++++++++-----------------------
>  lib/librte_pmd_ring/rte_eth_ring.c |    3 +-
>  2 files changed, 73 insertions(+), 132 deletions(-)
> 
> 


Series
Acked-by: Neil Horman <nhorman-2XuSBdqkA4R54TAoqtyWWQ@public.gmane.org>

Nice work Pablo.
Neil

Re: PMD for Cisco VIC Ethernet NIC - Request for guidelines for submission

[Hobywan Kenoby]

Hi Sujith,
It was exciting to see open source code coming from Cisco ensuring a DPDK application can run on any platform and with any card....I haven't seen your patch yet. What happened?
HK
 

 

> Date : Wed, 28 May 2014 08:06> From : dev
[mailto:dev-bounces-VfR2kkLFssw@public.gmane.org] 

> To :
dev-VfR2kkLFssw@public.gmane.org

> Subject :
[dpdk-dev] PMD for Cisco VIC Ethernet NIC - Request for guidelines

> for submission

> 

> 

> Hi all,

> 

> We have been working on development of poll-mode
driver for Cisco VIC

> Ethernet NIC and integration of it with DPDK.  We would like to submit this

> poll-mode driver (ENIC PMD) to the DPDK community so
that it could be part

> of the DPDK tree.

> 

> Could someone please provide the guidelines and
steps to do this?  As of

> now, ENIC PMD is being tested with DPDK
1.6.0r2.  Is it alright to submit a

> patch for DPDK 1.6.0r2?

> 

> One aspect of ENIC PMD is that it works with
VFIO-PCI and not UIO.  Hope

> this is acceptable. 
The following thread in dpdk-dev influenced this

> decision.

> http://dpdk.org/ml/archives/dev/2013-July/000373.html

> 

> ENIC PMD uses one interrupt per interface and it is
used by the NIC for

> signalling the driver in case of any error.  Since this does not come in

> the fast path, it should be acceptable, isn¹t it?

> 

> Please give your suggestions and comments.

> 

> Thanks,

> -Sujith
 		 	   		  

Re: PMD for Cisco VIC Ethernet NIC - Request for guidelines for submission

[Sujith Sankar (ssujith)]

Hi Hobywan,
Thanks for the email !

We’ve been working on performance benchmarking.  Also, we felt that it would be better to push the driver after Anatoly’s patch (vfio-pci) got in so that we could make the necessary modification before submission.
Now that 1.7.0 is out, we are hopeful of submitting the patch soon.

Thanks,
-Sujith

From: Hobywan Kenoby <hobywank@hotmail.com<mailto:hobywank@hotmail.com>>
Date: Thursday, 10 July 2014 1:37 am
To: "Sujith Sankar (ssujith)" <ssujith@cisco.com<mailto:ssujith@cisco.com>>, "dev@dpdk.org<mailto:dev@dpdk.org>" <dev@dpdk.org<mailto:dev@dpdk.org>>
Subject: RE: [dpdk-dev] PMD for Cisco VIC Ethernet NIC - Request for guidelines for submission

Hi Sujith,

It was exciting to see open source code coming from Cisco ensuring a DPDK application can run on any platform and with any card....
I haven't seen your patch yet. What happened?

HK





> Date : Wed, 28 May 2014 08:06

> From : dev [mailto:dev-bounces@dpdk.org]

> To : dev@dpdk.org<mailto:dev@dpdk.org>

> Subject : [dpdk-dev] PMD for Cisco VIC Ethernet NIC - Request for guidelines

> for submission

>

>

> Hi all,

>

> We have been working on development of poll-mode driver for Cisco VIC

> Ethernet NIC and integration of it with DPDK.  We would like to submit this

> poll-mode driver (ENIC PMD) to the DPDK community so that it could be part

> of the DPDK tree.

>

> Could someone please provide the guidelines and steps to do this?  As of

> now, ENIC PMD is being tested with DPDK 1.6.0r2.  Is it alright to submit a

> patch for DPDK 1.6.0r2?

>

> One aspect of ENIC PMD is that it works with VFIO-PCI and not UIO.  Hope

> this is acceptable.  The following thread in dpdk-dev influenced this

> decision.

> http://dpdk.org/ml/archives/dev/2013-July/000373.html

>

> ENIC PMD uses one interrupt per interface and it is used by the NIC for

> signalling the driver in case of any error.  Since this does not come in

> the fast path, it should be acceptable, isn¹t it?

>

> Please give your suggestions and comments.

>

> Thanks,

> -Sujith

Re: PMD for Cisco VIC Ethernet NIC - Request for guidelines for submission

[Hobywan Kenoby]

Hi Sujith,

It makes sens, using VFIO makes a far cleaner implementation. 
You worked on the performance, could you share some measurements ? Did you introduce vectorization functions as Intel did a while ago? There are allways tradeoffs between pps and latency, do you include documentation to configure the card for one or the other?
HK
From: ssujith-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org
To: hobywank-PkbjNfxxIARBDgjK7y7TUQ@public.gmane.org; dev-VfR2kkLFssw@public.gmane.org
Subject: Re: [dpdk-dev] PMD for Cisco VIC Ethernet NIC - Request for guidelines for submission
Date: Fri, 11 Jul 2014 07:46:08 +0000






Hi Hobywan,
Thanks for the email !



We’ve been working on performance benchmarking.  Also, we felt that it would be better to push the driver after Anatoly’s patch (vfio-pci) got in so that we could make the necessary modification before submission.  
Now that 1.7.0 is out, we are hopeful of submitting the patch soon.



Thanks,
-Sujith





From: Hobywan Kenoby <hobywank-PkbjNfxxIARBDgjK7y7TUQ@public.gmane.org>

Date: Thursday, 10 July 2014 1:37 am

To: "Sujith Sankar (ssujith)" <ssujith-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>, "dev-VfR2kkLFssw@public.gmane.org" <dev@dpdk.org>

Subject: RE: [dpdk-dev] PMD for Cisco VIC Ethernet NIC - Request for guidelines for submission







Hi Sujith,



It was exciting to see open source code coming from Cisco ensuring a DPDK application can run on any platform and with any card....
I haven't seen your patch yet. What happened?



HK

 
 
> Date : Wed, 28 May 2014 08:06
> From : dev [mailto:dev-bounces-VfR2kkLFssw@public.gmane.org] 
> To :
dev-VfR2kkLFssw@public.gmane.org
> Subject : [dpdk-dev] PMD for Cisco VIC Ethernet NIC - Request for guidelines
> for submission
> 
> 
> Hi all,
> 
> We have been working on development of poll-mode driver for Cisco VIC
> Ethernet NIC and integration of it with DPDK.  We would like to submit this
> poll-mode driver (ENIC PMD) to the DPDK community so that it could be part
> of the DPDK tree.
> 
> Could someone please provide the guidelines and steps to do this?  As of
> now, ENIC PMD is being tested with DPDK 1.6.0r2.  Is it alright to submit a
> patch for DPDK 1.6.0r2?
> 
> One aspect of ENIC PMD is that it works with VFIO-PCI and not UIO.  Hope
> this is acceptable.  The following thread in dpdk-dev influenced this
> decision.
> 
http://dpdk.org/ml/archives/dev/2013-July/000373.html
> 
> ENIC PMD uses one interrupt per interface and it is used by the NIC for
> signalling the driver in case of any error.  Since this does not come in
> the fast path, it should be acceptable, isn¹t it?
> 
> Please give your suggestions and comments.
> 
> Thanks,
> -Sujith







 		 	   		  

Re: PMD for Cisco VIC Ethernet NIC - Request for guidelines for submission

[Sujith Sankar (ssujith)]

Hi Hobywan,

We’re still working on benchmarking, and would share the numbers once we are done with it.
Could you please elaborate on vectorisation functions?

Thanks,
-Sujith

From: Hobywan Kenoby <hobywank@hotmail.com<mailto:hobywank@hotmail.com>>
Date: Friday, 11 July 2014 6:46 pm
To: "Sujith Sankar (ssujith)" <ssujith@cisco.com<mailto:ssujith@cisco.com>>, "dev@dpdk.org<mailto:dev@dpdk.org>" <dev@dpdk.org<mailto:dev@dpdk.org>>
Subject: RE: [dpdk-dev] PMD for Cisco VIC Ethernet NIC - Request for guidelines for submission

Hi Sujith,

It makes sens, using VFIO makes a far cleaner implementation.

You worked on the performance, could you share some measurements ? Did you introduce vectorization functions as Intel did a while ago? There are allways tradeoffs between pps and latency, do you include documentation to configure the card for one or the other?

HK
________________________________
From: ssujith@cisco.com<mailto:ssujith@cisco.com>
To: hobywank@hotmail.com<mailto:hobywank@hotmail.com>; dev@dpdk.org<mailto:dev@dpdk.org>
Subject: Re: [dpdk-dev] PMD for Cisco VIC Ethernet NIC - Request for guidelines for submission
Date: Fri, 11 Jul 2014 07:46:08 +0000

Hi Hobywan,
Thanks for the email !

We’ve been working on performance benchmarking.  Also, we felt that it would be better to push the driver after Anatoly’s patch (vfio-pci) got in so that we could make the necessary modification before submission.
Now that 1.7.0 is out, we are hopeful of submitting the patch soon.

Thanks,
-Sujith

From: Hobywan Kenoby <hobywank@hotmail.com<mailto:hobywank@hotmail.com>>
Date: Thursday, 10 July 2014 1:37 am
To: "Sujith Sankar (ssujith)" <ssujith@cisco.com<mailto:ssujith@cisco.com>>, "dev@dpdk.org<mailto:dev@dpdk.org>" <dev@dpdk.org<mailto:dev@dpdk.org>>
Subject: RE: [dpdk-dev] PMD for Cisco VIC Ethernet NIC - Request for guidelines for submission

Hi Sujith,

It was exciting to see open source code coming from Cisco ensuring a DPDK application can run on any platform and with any card....
I haven't seen your patch yet. What happened?

HK





> Date : Wed, 28 May 2014 08:06

> From : dev [mailto:dev-bounces@dpdk.org]

> To : dev@dpdk.org<mailto:dev@dpdk.org>

> Subject : [dpdk-dev] PMD for Cisco VIC Ethernet NIC - Request for guidelines

> for submission

>

>

> Hi all,

>

> We have been working on development of poll-mode driver for Cisco VIC

> Ethernet NIC and integration of it with DPDK.  We would like to submit this

> poll-mode driver (ENIC PMD) to the DPDK community so that it could be part

> of the DPDK tree.

>

> Could someone please provide the guidelines and steps to do this?  As of

> now, ENIC PMD is being tested with DPDK 1.6.0r2.  Is it alright to submit a

> patch for DPDK 1.6.0r2?

>

> One aspect of ENIC PMD is that it works with VFIO-PCI and not UIO.  Hope

> this is acceptable.  The following thread in dpdk-dev influenced this

> decision.

> http://dpdk.org/ml/archives/dev/2013-July/000373.html

>

> ENIC PMD uses one interrupt per interface and it is used by the NIC for

> signalling the driver in case of any error.  Since this does not come in

> the fast path, it should be acceptable, isn¹t it?

>

> Please give your suggestions and comments.

>

> Thanks,

> -Sujith