From mboxrd@z Thu Jan 1 00:00:00 1970 From: Zoltan Kiss Subject: Re: [PATCH] ixgbe: prefetch packet headers in vector PMD receive function Date: Fri, 25 Sep 2015 11:28:37 -0700 Message-ID: <56059255.5010507@linaro.org> References: <1441135036-7491-1-git-send-email-zoltan.kiss@linaro.org> <55ED8252.1020900@linaro.org> <59AF69C657FD0841A61C55336867B5B0359227DF@IRSMSX103.ger.corp.intel.com> <55ED9BFD.7040009@linaro.org> <59AF69C657FD0841A61C55336867B5B035922A83@IRSMSX103.ger.corp.intel.com> Mime-Version: 1.0 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit To: "Richardson, Bruce" , "dev@dpdk.org" Return-path: Received: from mail-pa0-f51.google.com (mail-pa0-f51.google.com [209.85.220.51]) by dpdk.org (Postfix) with ESMTP id 549BB8E6E for ; Fri, 25 Sep 2015 20:28:39 +0200 (CEST) Received: by padhy16 with SMTP id hy16so112673032pad.1 for ; Fri, 25 Sep 2015 11:28:38 -0700 (PDT) In-Reply-To: <59AF69C657FD0841A61C55336867B5B035922A83@IRSMSX103.ger.corp.intel.com> List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" On 07/09/15 07:41, Richardson, Bruce wrote: > >> -----Original Message----- >> From: Zoltan Kiss [mailto:zoltan.kiss@linaro.org] >> Sent: Monday, September 7, 2015 3:15 PM >> To: Richardson, Bruce; dev@dpdk.org >> Cc: Ananyev, Konstantin >> Subject: Re: [PATCH] ixgbe: prefetch packet headers in vector PMD receive >> function >> >> >> >> On 07/09/15 13:57, Richardson, Bruce wrote: >>> >>>> -----Original Message----- >>>> From: Zoltan Kiss [mailto:zoltan.kiss@linaro.org] >>>> Sent: Monday, September 7, 2015 1:26 PM >>>> To: dev@dpdk.org >>>> Cc: Ananyev, Konstantin; Richardson, Bruce >>>> Subject: Re: [PATCH] ixgbe: prefetch packet headers in vector PMD >>>> receive function >>>> >>>> Hi, >>>> >>>> I just realized I've missed the "[PATCH]" tag from the subject. Did >>>> anyone had time to review this? >>>> >>> Hi Zoltan, >>> >>> the big thing that concerns me with this is the addition of new >>> instructions for each packet in the fast path. Ideally, this >>> prefetching would be better handled in the application itself, as for >>> some apps, e.g. those using pipelining, the core doing the RX from the >>> NIC may not touch the packet data at all, and the prefetches will >> instead cause a performance slowdown. >>> Is it possible to get the same performance increase - or something >>> close to it - by making changes in OVS? >> OVS already does a prefetch when it's processing the previous packet, but >> apparently it's not early enough. At least for my test scenario, where I'm >> forwarding UDP packets with the least possible overhead. I guess in tests >> where OVS does more complex processing it should be fine. >> I'll try to move the prefetch earlier in OVS codebase, but I'm not sure if >> it'll help. > I would suggest trying to prefetch more than one packet ahead. Prefetching 4 or > 8 ahead might work better, depending on the processing being done. I've moved the prefetch earlier, and it seems to work: https://patchwork.ozlabs.org/patch/519017/ However it raises the question: should we remove header prefetch from all the other drivers, and the CONFIG_RTE_PMD_PACKET_PREFETCH option? > > /Bruce