* [PATCH] doc/vhost: update zero copy perfromance tip
@ 2018-04-26 8:13 Junjie Chen
2018-05-04 12:49 ` Maxime Coquelin
2018-05-04 15:12 ` [PATCH] " Maxime Coquelin
0 siblings, 2 replies; 3+ messages in thread
From: Junjie Chen @ 2018-04-26 8:13 UTC (permalink / raw)
To: maxime.coquelin, jianfeng.tan, john.mcnamara, marko.kovacevic
Cc: dev, Junjie Chen
In VM2NIC case zero copy may need some tuning to get best performance. This
patch describes the zero copy starved case and provides a tuning tip.
Signed-off-by: Junjie Chen <junjie.j.chen@intel.com>
---
doc/guides/prog_guide/vhost_lib.rst | 20 ++++++++++++--------
1 file changed, 12 insertions(+), 8 deletions(-)
diff --git a/doc/guides/prog_guide/vhost_lib.rst b/doc/guides/prog_guide/vhost_lib.rst
index ef9a178..92dcdb5 100644
--- a/doc/guides/prog_guide/vhost_lib.rst
+++ b/doc/guides/prog_guide/vhost_lib.rst
@@ -65,14 +65,18 @@ The following is an overview of some key Vhost API functions:
* zero copy is really good for VM2VM case. For iperf between two VMs, the
boost could be above 70% (when TSO is enableld).
- * for VM2NIC case, the ``nb_tx_desc`` has to be small enough: <= 64 if virtio
- indirect feature is not enabled and <= 128 if it is enabled.
-
- This is because when dequeue zero copy is enabled, guest Tx used vring will
- be updated only when corresponding mbuf is freed. Thus, the nb_tx_desc
- has to be small enough so that the PMD driver will run out of available
- Tx descriptors and free mbufs timely. Otherwise, guest Tx vring would be
- starved.
+ * For zero copy in VM2NIC case, guest Tx used vring may be starved if the
+ PMD driver consume the mbuf but not release them timely.
+
+ For example, i40e driver has an optimization to maximum NIC pipeline which
+ postpones returning transmitted mbuf until only tx_free_threshold free
+ descs left. The virtio TX used ring will be starved if the formula
+ (num_i40e_tx_desc - num_virtio_tx_desc > tx_free_threshold) is true, since
+ i40e will not return back mbuf.
+
+ A performance tip for tuning zero copy in VM2NIC case is to adjust the
+ frequency of mbuf free (i.e. adjust tx_free_threshold of i40e driver) to
+ balance consumer and producer.
* Guest memory should be backended with huge pages to achieve better
performance. Using 1G page size is the best.
--
1.8.3.1
^ permalink raw reply related [flat|nested] 3+ messages in thread
* Re: doc/vhost: update zero copy perfromance tip
2018-04-26 8:13 [PATCH] doc/vhost: update zero copy perfromance tip Junjie Chen
@ 2018-05-04 12:49 ` Maxime Coquelin
2018-05-04 15:12 ` [PATCH] " Maxime Coquelin
1 sibling, 0 replies; 3+ messages in thread
From: Maxime Coquelin @ 2018-05-04 12:49 UTC (permalink / raw)
To: junjie.j.chen, jianfeng.tan, john.mcnamara, marko.kovacevic; +Cc: dev
On 04/26/2018 10:13 AM, junjie.j.chen@intel.com wrote:
> In VM2NIC case zero copy may need some tuning to get best performance. This
> patch describes the zero copy starved case and provides a tuning tip.
>
> Signed-off-by: Junjie Chen <junjie.j.chen@intel.com>
> ---
> doc/guides/prog_guide/vhost_lib.rst | 20 ++++++++++++--------
> 1 file changed, 12 insertions(+), 8 deletions(-)
>
Acked-by: Maxime Coquelin <maxime.coquelin@redhat.com>
Thanks,
Maxime
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [PATCH] doc/vhost: update zero copy perfromance tip
2018-04-26 8:13 [PATCH] doc/vhost: update zero copy perfromance tip Junjie Chen
2018-05-04 12:49 ` Maxime Coquelin
@ 2018-05-04 15:12 ` Maxime Coquelin
1 sibling, 0 replies; 3+ messages in thread
From: Maxime Coquelin @ 2018-05-04 15:12 UTC (permalink / raw)
To: Junjie Chen, jianfeng.tan, john.mcnamara, marko.kovacevic; +Cc: dev
On 04/26/2018 10:13 AM, Junjie Chen wrote:
> In VM2NIC case zero copy may need some tuning to get best performance. This
> patch describes the zero copy starved case and provides a tuning tip.
>
> Signed-off-by: Junjie Chen<junjie.j.chen@intel.com>
> ---
> doc/guides/prog_guide/vhost_lib.rst | 20 ++++++++++++--------
> 1 file changed, 12 insertions(+), 8 deletions(-)
Applied to dpdk-next-virtio/master.
Thanks,
Maxime
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2018-05-04 15:12 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2018-04-26 8:13 [PATCH] doc/vhost: update zero copy perfromance tip Junjie Chen
2018-05-04 12:49 ` Maxime Coquelin
2018-05-04 15:12 ` [PATCH] " Maxime Coquelin
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.