From mboxrd@z Thu Jan 1 00:00:00 1970 From: "Jozwiak, TomaszX" Subject: Re: [PATCH 2/3] app/compress-perf: add performance measurement Date: Fri, 30 Nov 2018 14:43:23 +0000 Message-ID: References: <1538400427-20164-1-git-send-email-tomaszx.jozwiak@intel.com> <1538400427-20164-3-git-send-email-tomaszx.jozwiak@intel.com> <348A99DA5F5B7549AA880327E580B4358964F1CB@IRSMSX101.ger.corp.intel.com> <348A99DA5F5B7549AA880327E580B4358964F45C@IRSMSX101.ger.corp.intel.com> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Cc: "dev@dpdk.org" , "akhil.goyal@nxp.com" To: "Verma, Shally" , "Trahe, Fiona" , "Daly, Lee" Return-path: Received: from mga06.intel.com (mga06.intel.com [134.134.136.31]) by dpdk.org (Postfix) with ESMTP id 8DB971B501 for ; Fri, 30 Nov 2018 15:43:29 +0100 (CET) In-Reply-To: Content-Language: en-US List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Hi Shally, I'm about of sending V5 of compression-perf tool. Our performance testing shows that the number of sgls in a chain can be a f= actor in the performance. So we want to keep this on the cmd line for the performance tool. There are alternatives, like setting the input size and segment size to get= the num segments desired, but I prefer to have the option to specify the num segments explicitly. We'll document that if the max-num-sgl-segs x seg_sz > input size then segm= ents number in the chain will be lower ( to store all the data) As regards adding the max_nb_segments_per_sgl into the rte_compressdev_info= struct we're investigating another workaround to this limitation in QAT, so will leave this off the AP= I unless some other PMD needs it. In the meantime we'll document the limitation in QAT. Please let me know your thoughts. -- Tomek > -----Original Message----- > From: Verma, Shally [mailto:Shally.Verma@cavium.com] > Sent: Wednesday, October 17, 2018 6:48 PM > To: Trahe, Fiona ; Daly, Lee > Cc: Jozwiak, TomaszX ; dev@dpdk.org; > akhil.goyal@nxp.com > Subject: RE: [dpdk-dev] [PATCH 2/3] app/compress-perf: add performance > measurement >=20 >=20 >=20 > >-----Original Message----- > >From: Trahe, Fiona > >Sent: 17 October 2018 22:15 > >To: Verma, Shally ; Daly, Lee > > > >Cc: Jozwiak, TomaszX ; dev@dpdk.org; > >akhil.goyal@nxp.com; Trahe, Fiona > >Subject: RE: [dpdk-dev] [PATCH 2/3] app/compress-perf: add performance > >measurement > > > >External Email > > > >> -----Original Message----- > >> From: Verma, Shally [mailto:Shally.Verma@cavium.com] > >> Sent: Wednesday, October 17, 2018 8:43 AM > >> To: Trahe, Fiona ; Daly, Lee > >> > >> Cc: Jozwiak, TomaszX ; dev@dpdk.org; > >> akhil.goyal@nxp.com > >> Subject: RE: [dpdk-dev] [PATCH 2/3] app/compress-perf: add > >> performance measurement > >> > >> > >> > >> >-----Original Message----- > >> >From: Trahe, Fiona > >> >Sent: 17 October 2018 20:04 > >> >To: Daly, Lee ; Verma, Shally > >> > > >> >Cc: Jozwiak, TomaszX ; dev@dpdk.org; > >> >akhil.goyal@nxp.com; Trahe, Fiona > >> > >> >Subject: RE: [dpdk-dev] [PATCH 2/3] app/compress-perf: add > >> >performance measurement > >> > > >> >External Email > >> > > >> >Hi Shally, Lee, > >> > > >> >> -----Original Message----- > >> >> From: Daly, Lee > >> >> Sent: Monday, October 15, 2018 8:10 AM > >> >> To: Verma, Shally > >> >> Cc: Jozwiak, TomaszX ; dev@dpdk.org; > >> >> Trahe, Fiona ; akhil.goyal@nxp.com > >> >> Subject: RE: [dpdk-dev] [PATCH 2/3] app/compress-perf: add > >> >> performance measurement > >> >> > >> >> Thanks for your input Shally see comments below. > >> >> > >> >> > >> >> I will be reviewing these changes while Tomasz is out this week. > >> >> > >> >> > -----Original Message----- > >> >> > From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Verma, > >> >> > Shally > >> >> > Sent: Friday, October 12, 2018 11:16 AM > >> >> > To: Jozwiak, TomaszX ; > dev@dpdk.org; > >> >> > Trahe, Fiona ; akhil.goyal@nxp.com; De > >> >> > Lara Guarch, Pablo > >> >> > Cc: De@dpdk.org; Lara@dpdk.org; Guarch@dpdk.org > >> >> > Subject: Re: [dpdk-dev] [PATCH 2/3] app/compress-perf: add > >> >> > performance measurement > >> >> > > >> >/// > >> > > >> >> >Also, why do we need --max-num- > >> >> > sgl-segs as an input option from user? Shouldn't input_sz and > >> >> >seg_sz internally decide on num-segs? > >> >> > Or is it added to serve some other different purpose? > >> >> Will have to get back to you on this one, seems illogical to get > >> >> this input from user, But I will have to do further investigation t= o find if > there was a different purpose. > >> > > >> >[Fiona] Some PMDs have a limit on how many links can be in an sgl > >> >chain, e.g. in QAT case the PMD allocates a pool of internal > >> >structures of a suitable size during device initialisation, this is n= ot a hard > limit but can be configured in .config to give the user control over the > memory resources allocated. > >> >This perf-tool max-num-sgl-segs is so the user can pick a value <=3D > whatever the PMD's max is. > >> > >> Then also, I believe this could be taken care internally by an app. > >> App can choose convenient number of sgl segs as per PMD capability > >> and input sz and chunk sz selected by user. > >> Just my thoughts. > >[Fiona] Then we'd need to add this capability to the API, e.g. add > >uint16_t max_nb_segments_per_sgl into the rte_compressdev_info struct. > >Special case 0 means no limit. > >We did consider this before, I can't remember why we didn't do it, I thi= nk > it's needed. > >I'll push an API patch for this in 19.02 and we can remove the > >--max-num-sgl-segs param from the performance tool and hardcode it in > the tool in the meantime. > >Ok? > Yea. Sounds better.