All of lore.kernel.org
 help / color / mirror / Atom feed
* Cannot use MLX4 with igb_uio driver
@ 2017-01-09 14:53 Royce Niu
  2017-01-09 15:13 ` Adrien Mazarguil
  0 siblings, 1 reply; 5+ messages in thread
From: Royce Niu @ 2017-01-09 14:53 UTC (permalink / raw)
  To: dev

Dear all,

I cannot use my Mellanox 3 Pro, after I binded it with igb_uio driver.

It always shows when I use my DPDK application.

EAL: Detected 32 lcore(s)
EAL: Probing VFIO support...
PMD: bnxt_rte_pmd_init() called for (null)
EAL: PCI device 0000:02:00.0 on NUMA socket 0
EAL:   probe driver: 8086:1521 rte_igb_pmd
EAL: PCI device 0000:02:00.1 on NUMA socket 0
EAL:   probe driver: 8086:1521 rte_igb_pmd
EAL: PCI device 0000:02:00.2 on NUMA socket 0
EAL:   probe driver: 8086:1521 rte_igb_pmd
EAL: PCI device 0000:02:00.3 on NUMA socket 0
EAL:   probe driver: 8086:1521 rte_igb_pmd
EAL: PCI device 0000:81:00.0 on NUMA socket 1
EAL:   probe driver: 15b3:1007 librte_pmd_mlx4
PMD: librte_pmd_mlx4: cannot access device, is mlx4_ib loaded?
EAL: Error - exiting with code: 1
  Cause: Cannot create mbuf pool

---------------
I have added CONFIG_RTE_LIBRTE_MLX4_PMD=y in .config, and
install MLNX_OFED_LINUX-3.4-2.0.0.0.

Thanks.
-- 
Regards,

Royce

^ permalink raw reply	[flat|nested] 5+ messages in thread
* Re: Cannot use MLX4 with igb_uio driver
  2017-01-09 14:53 Cannot use MLX4 with igb_uio driver Royce Niu
@ 2017-01-09 15:13 ` Adrien Mazarguil
  2017-01-09 15:23   ` Royce Niu
  0 siblings, 1 reply; 5+ messages in thread
From: Adrien Mazarguil @ 2017-01-09 15:13 UTC (permalink / raw)
  To: Royce Niu; +Cc: dev

Hi Royce,

On Mon, Jan 09, 2017 at 10:53:37PM +0800, Royce Niu wrote:
> Dear all,
> 
> I cannot use my Mellanox 3 Pro, after I binded it with igb_uio driver.
> 
> It always shows when I use my DPDK application.
> 
> EAL: Detected 32 lcore(s)
> EAL: Probing VFIO support...
> PMD: bnxt_rte_pmd_init() called for (null)
> EAL: PCI device 0000:02:00.0 on NUMA socket 0
> EAL:   probe driver: 8086:1521 rte_igb_pmd
> EAL: PCI device 0000:02:00.1 on NUMA socket 0
> EAL:   probe driver: 8086:1521 rte_igb_pmd
> EAL: PCI device 0000:02:00.2 on NUMA socket 0
> EAL:   probe driver: 8086:1521 rte_igb_pmd
> EAL: PCI device 0000:02:00.3 on NUMA socket 0
> EAL:   probe driver: 8086:1521 rte_igb_pmd
> EAL: PCI device 0000:81:00.0 on NUMA socket 1
> EAL:   probe driver: 15b3:1007 librte_pmd_mlx4
> PMD: librte_pmd_mlx4: cannot access device, is mlx4_ib loaded?
> EAL: Error - exiting with code: 1
>   Cause: Cannot create mbuf pool
> 
> ---------------
> I have added CONFIG_RTE_LIBRTE_MLX4_PMD=y in .config, and
> install MLNX_OFED_LINUX-3.4-2.0.0.0.

The mlx4 PMD does not operate through igb_uio (see mlx4 documentation [1]),
PCI devices must remain bound to their original kernel module (mlx4_core),
however you have to additionally load mlx4_ib, mlx4_en and ib_uverbs [2].

[1] http://dpdk.org/doc/guides/nics/mlx4.html
[2] http://dpdk.org/doc/guides/nics/mlx4.html#prerequisites

-- 
Adrien Mazarguil
6WIND

^ permalink raw reply	[flat|nested] 5+ messages in thread
* Re: Cannot use MLX4 with igb_uio driver
  2017-01-09 15:13 ` Adrien Mazarguil
@ 2017-01-09 15:23   ` Royce Niu
  2017-01-09 16:13     ` Adrien Mazarguil
  0 siblings, 1 reply; 5+ messages in thread
From: Royce Niu @ 2017-01-09 15:23 UTC (permalink / raw)
  To: Adrien Mazarguil; +Cc: Royce Niu, dev

Hi, Adrien,

Actually, I tested using the original kernel module without binding. It
works.

However, it is only 6Mpps for 64B in pkt-gen, which is so slow for a 40Gbps
NIC.

Is that right?


On Mon, Jan 9, 2017 at 11:13 PM, Adrien Mazarguil <
adrien.mazarguil@6wind.com> wrote:

> Hi Royce,
>
> On Mon, Jan 09, 2017 at 10:53:37PM +0800, Royce Niu wrote:
> > Dear all,
> >
> > I cannot use my Mellanox 3 Pro, after I binded it with igb_uio driver.
> >
> > It always shows when I use my DPDK application.
> >
> > EAL: Detected 32 lcore(s)
> > EAL: Probing VFIO support...
> > PMD: bnxt_rte_pmd_init() called for (null)
> > EAL: PCI device 0000:02:00.0 on NUMA socket 0
> > EAL:   probe driver: 8086:1521 rte_igb_pmd
> > EAL: PCI device 0000:02:00.1 on NUMA socket 0
> > EAL:   probe driver: 8086:1521 rte_igb_pmd
> > EAL: PCI device 0000:02:00.2 on NUMA socket 0
> > EAL:   probe driver: 8086:1521 rte_igb_pmd
> > EAL: PCI device 0000:02:00.3 on NUMA socket 0
> > EAL:   probe driver: 8086:1521 rte_igb_pmd
> > EAL: PCI device 0000:81:00.0 on NUMA socket 1
> > EAL:   probe driver: 15b3:1007 librte_pmd_mlx4
> > PMD: librte_pmd_mlx4: cannot access device, is mlx4_ib loaded?
> > EAL: Error - exiting with code: 1
> >   Cause: Cannot create mbuf pool
> >
> > ---------------
> > I have added CONFIG_RTE_LIBRTE_MLX4_PMD=y in .config, and
> > install MLNX_OFED_LINUX-3.4-2.0.0.0.
>
> The mlx4 PMD does not operate through igb_uio (see mlx4 documentation [1]),
> PCI devices must remain bound to their original kernel module (mlx4_core),
> however you have to additionally load mlx4_ib, mlx4_en and ib_uverbs [2].
>
> [1] http://dpdk.org/doc/guides/nics/mlx4.html
> [2] http://dpdk.org/doc/guides/nics/mlx4.html#prerequisites
>
> --
> Adrien Mazarguil
> 6WIND
>



-- 
Regards,

Royce

^ permalink raw reply	[flat|nested] 5+ messages in thread
* Re: Cannot use MLX4 with igb_uio driver
  2017-01-09 15:23   ` Royce Niu
@ 2017-01-09 16:13     ` Adrien Mazarguil
  2017-01-09 16:57       ` Royce Niu
  0 siblings, 1 reply; 5+ messages in thread
From: Adrien Mazarguil @ 2017-01-09 16:13 UTC (permalink / raw)
  To: Royce Niu; +Cc: dev

On Mon, Jan 09, 2017 at 11:23:56PM +0800, Royce Niu wrote:
> Hi, Adrien,
> 
> Actually, I tested using the original kernel module without binding. It
> works.
> 
> However, it is only 6Mpps for 64B in pkt-gen, which is so slow for a 40Gbps
> NIC.
> 
> Is that right?

That's difficult to say without knowing your specific setup or application,
however 6 Mpps seems abnormally slow assuming testpmd performing basic I/O
forwarding using a single thread and two ports.

> On Mon, Jan 9, 2017 at 11:13 PM, Adrien Mazarguil <
> adrien.mazarguil@6wind.com> wrote:
> 
> > Hi Royce,
> >
> > On Mon, Jan 09, 2017 at 10:53:37PM +0800, Royce Niu wrote:
> > > Dear all,
> > >
> > > I cannot use my Mellanox 3 Pro, after I binded it with igb_uio driver.
> > >
> > > It always shows when I use my DPDK application.
> > >
> > > EAL: Detected 32 lcore(s)
> > > EAL: Probing VFIO support...
> > > PMD: bnxt_rte_pmd_init() called for (null)
> > > EAL: PCI device 0000:02:00.0 on NUMA socket 0
> > > EAL:   probe driver: 8086:1521 rte_igb_pmd
> > > EAL: PCI device 0000:02:00.1 on NUMA socket 0
> > > EAL:   probe driver: 8086:1521 rte_igb_pmd
> > > EAL: PCI device 0000:02:00.2 on NUMA socket 0
> > > EAL:   probe driver: 8086:1521 rte_igb_pmd
> > > EAL: PCI device 0000:02:00.3 on NUMA socket 0
> > > EAL:   probe driver: 8086:1521 rte_igb_pmd
> > > EAL: PCI device 0000:81:00.0 on NUMA socket 1
> > > EAL:   probe driver: 15b3:1007 librte_pmd_mlx4
> > > PMD: librte_pmd_mlx4: cannot access device, is mlx4_ib loaded?
> > > EAL: Error - exiting with code: 1
> > >   Cause: Cannot create mbuf pool
> > >
> > > ---------------
> > > I have added CONFIG_RTE_LIBRTE_MLX4_PMD=y in .config, and
> > > install MLNX_OFED_LINUX-3.4-2.0.0.0.
> >
> > The mlx4 PMD does not operate through igb_uio (see mlx4 documentation [1]),
> > PCI devices must remain bound to their original kernel module (mlx4_core),
> > however you have to additionally load mlx4_ib, mlx4_en and ib_uverbs [2].
> >
> > [1] http://dpdk.org/doc/guides/nics/mlx4.html
> > [2] http://dpdk.org/doc/guides/nics/mlx4.html#prerequisites
> >
> > --
> > Adrien Mazarguil
> > 6WIND
> >
> 
> 
> 
> -- 
> Regards,
> 
> Royce

-- 
Adrien Mazarguil
6WIND

^ permalink raw reply	[flat|nested] 5+ messages in thread
* Re: Cannot use MLX4 with igb_uio driver
  2017-01-09 16:13     ` Adrien Mazarguil
@ 2017-01-09 16:57       ` Royce Niu
  0 siblings, 0 replies; 5+ messages in thread
From: Royce Niu @ 2017-01-09 16:57 UTC (permalink / raw)
  To: Adrien Mazarguil, Royce Niu; +Cc: dev

It is a simple L2FWD. It can be 14mpps in x520 nics. So, do you think where
should I check? Thanks


On Tue, 10 Jan 2017 at 12:13 AM, Adrien Mazarguil <
adrien.mazarguil@6wind.com> wrote:

> On Mon, Jan 09, 2017 at 11:23:56PM +0800, Royce Niu wrote:
>
> > Hi, Adrien,
>
> >
>
> > Actually, I tested using the original kernel module without binding. It
>
> > works.
>
> >
>
> > However, it is only 6Mpps for 64B in pkt-gen, which is so slow for a
> 40Gbps
>
> > NIC.
>
> >
>
> > Is that right?
>
>
>
> That's difficult to say without knowing your specific setup or application,
>
> however 6 Mpps seems abnormally slow assuming testpmd performing basic I/O
>
> forwarding using a single thread and two ports.
>
>
>
> > On Mon, Jan 9, 2017 at 11:13 PM, Adrien Mazarguil <
>
> > adrien.mazarguil@6wind.com> wrote:
>
> >
>
> > > Hi Royce,
>
> > >
>
> > > On Mon, Jan 09, 2017 at 10:53:37PM +0800, Royce Niu wrote:
>
> > > > Dear all,
>
> > > >
>
> > > > I cannot use my Mellanox 3 Pro, after I binded it with igb_uio
> driver.
>
> > > >
>
> > > > It always shows when I use my DPDK application.
>
> > > >
>
> > > > EAL: Detected 32 lcore(s)
>
> > > > EAL: Probing VFIO support...
>
> > > > PMD: bnxt_rte_pmd_init() called for (null)
>
> > > > EAL: PCI device 0000:02:00.0 on NUMA socket 0
>
> > > > EAL:   probe driver: 8086:1521 rte_igb_pmd
>
> > > > EAL: PCI device 0000:02:00.1 on NUMA socket 0
>
> > > > EAL:   probe driver: 8086:1521 rte_igb_pmd
>
> > > > EAL: PCI device 0000:02:00.2 on NUMA socket 0
>
> > > > EAL:   probe driver: 8086:1521 rte_igb_pmd
>
> > > > EAL: PCI device 0000:02:00.3 on NUMA socket 0
>
> > > > EAL:   probe driver: 8086:1521 rte_igb_pmd
>
> > > > EAL: PCI device 0000:81:00.0 on NUMA socket 1
>
> > > > EAL:   probe driver: 15b3:1007 librte_pmd_mlx4
>
> > > > PMD: librte_pmd_mlx4: cannot access device, is mlx4_ib loaded?
>
> > > > EAL: Error - exiting with code: 1
>
> > > >   Cause: Cannot create mbuf pool
>
> > > >
>
> > > > ---------------
>
> > > > I have added CONFIG_RTE_LIBRTE_MLX4_PMD=y in .config, and
>
> > > > install MLNX_OFED_LINUX-3.4-2.0.0.0.
>
> > >
>
> > > The mlx4 PMD does not operate through igb_uio (see mlx4 documentation
> [1]),
>
> > > PCI devices must remain bound to their original kernel module
> (mlx4_core),
>
> > > however you have to additionally load mlx4_ib, mlx4_en and ib_uverbs
> [2].
>
> > >
>
> > > [1] http://dpdk.org/doc/guides/nics/mlx4.html
>
> > > [2] http://dpdk.org/doc/guides/nics/mlx4.html#prerequisites
>
> > >
>
> > > --
>
> > > Adrien Mazarguil
>
> > > 6WIND
>
> > >
>
> >
>
> >
>
> >
>
> > --
>
> > Regards,
>
> >
>
> > Royce
>
>
>
> --
>
> Adrien Mazarguil
>
> 6WIND
>
>

^ permalink raw reply	[flat|nested] 5+ messages in thread
end of thread, other threads:[~2017-01-09 16:57 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2017-01-09 14:53 Cannot use MLX4 with igb_uio driver Royce Niu
2017-01-09 15:13 ` Adrien Mazarguil
2017-01-09 15:23   ` Royce Niu
2017-01-09 16:13     ` Adrien Mazarguil
2017-01-09 16:57       ` Royce Niu

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.