From mboxrd@z Thu Jan 1 00:00:00 1970 From: Aleksander Aleksandrov via lttng-dev Subject: Babeltrace 2.0.2 performance issue Date: Thu, 2 Apr 2020 16:32:03 +0000 Message-ID: References: <76e78e538b804aa2b78f320510e8c10d@yadro.com> <9ee46aeb-1b9b-c7d4-94ea-c15772bc05eb@efficios.com> <5f3249fe30e040b5b4a444fba495de62@yadro.com> <6992879d-d139-06f5-d325-02530ad2c1b1@efficios.com>, Reply-To: Aleksander Aleksandrov Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7612407340748893677==" Return-path: Received: from mta-01.yadro.com (mta-02.yadro.com [89.207.88.252]) by lists.lttng.org (Postfix) with ESMTPS id 48tT9n74Dhz1bHj for ; Thu, 2 Apr 2020 12:32:13 -0400 (EDT) In-Reply-To: Content-Language: ru-RU List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: lttng-dev-bounces@lists.lttng.org Sender: "lttng-dev" To: Simon Marchi , "jeremie.galarneau@efficios.com" Cc: "lttng-dev@lists.lttng.org" List-Id: lttng-dev@lists.lttng.org --===============7612407340748893677== Content-Language: ru-RU Content-Type: multipart/alternative; boundary="_000_a095fcdafcf24edf85e047e9c177b0d0yadrocom_" --_000_a095fcdafcf24edf85e047e9c177b0d0yadrocom_ Content-Type: text/plain; charset="koi8-r" Content-Transfer-Encoding: quoted-printable Hi Simon, Thank you for your message! Unfortunately, I missed your previous message, = sorry for this. I processed the CI's trace logs, I got the following performance: bt2 (140.= 51s) vs bt1 (122.00s). In my opinion, the values are quite similar comparin= g with my other measurements. Best regards, Aleksandr On 2020-03-13 4:58 p.m., Simon Marchi wrote: > Hi Aleksander, > > I just noticed you did not send your original email to the lttng-dev mail= ing list, > please send such request on that mailing list, as it's of public interest= : > > https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev > > See my previous response here: > > https://pastebin.com/raw/3Q5PbYXn > > Simon > Hi Aleksander, Sorry, I forgot to follow up. Did you get my last message? This is the trace we use for benchmarking: https://files.efficios.com/s/pog= 5raGkBkH63y9 Could you try to compare bt1 and bt2 using that trace? On the CI benchmark system, we get some similar performance with both bt1 a= nd bt2. Although a colleague tried on a recent AMD Ryzen 3700X CPU, and he says bt2 is slowe= r than bt1 for him (36s vs 33s). I'd be curious to know what kind of numbers you get. Simon --_000_a095fcdafcf24edf85e047e9c177b0d0yadrocom_ Content-Type: text/html; charset="koi8-r" Content-Transfer-Encoding: quoted-printable

Hi Simon,

Thank you for your message! Unfortunately, I missed your previous message, = sorry for this.

I processed the CI’s trace logs, I got the following performance: bt2= (140.51s) vs bt1 (122.00s). In my opinion, the values are quite similar co= mparing with my other measurements.

Best regards,

Aleksandr

On 2020-03-13 4:58 p.m., Simon Marchi wrote:
> Hi Aleksander,
>
> I just noticed you did not send your original email to the lttng-dev m= ailing list,
> please send such request on that mailing list, as it's of public inter= est:
>
> https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev
>
> See my previous response here:
>
> https://pastebin.com/raw/3Q5PbYXn
>
> Simon
>

Hi Aleksander,

Sorry, I forgot to follow up. Did you get my last message?

This is the trace we use for benchmarking: https://files.efficios.com/s/pog5raGkBkH63y9

Could you try to compare bt1 and bt2 using that trace?

On the CI benchmark system, we get some similar performance with both bt1 a= nd bt2. Although
a colleague tried on a recent AMD Ryzen 3700X CPU, and he says bt2 is slowe= r than bt1 for
him (36s vs 33s). I'd be curious to know what kind of numbers you get= .

Simon

--_000_a095fcdafcf24edf85e047e9c177b0d0yadrocom_-- --===============7612407340748893677== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ lttng-dev mailing list lttng-dev@lists.lttng.org https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev --===============7612407340748893677==-- From mboxrd@z Thu Jan 1 00:00:00 1970 From: Aleksander Aleksandrov via lttng-dev Subject: Babeltrace 2.0.2 performance issue Date: Thu, 2 Apr 2020 16:30:25 +0000 Message-ID: References: <76e78e538b804aa2b78f320510e8c10d@yadro.com> Reply-To: Aleksander Aleksandrov Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7822043123732131005==" Return-path: Received: from mta-01.yadro.com (mta-02.yadro.com [89.207.88.252]) by lists.lttng.org (Postfix) with ESMTPS id 48tTGz6vkCz1bYw for ; Thu, 2 Apr 2020 12:36:43 -0400 (EDT) Received: from localhost (unknown [127.0.0.1]) by mta-01.yadro.com (Postfix) with ESMTP id 6A26141252 for ; Thu, 2 Apr 2020 16:30:26 +0000 (UTC) Received: from mta-01.yadro.com ([127.0.0.1]) by localhost (mta-01.yadro.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id DL_YD6TRiuVX for ; Thu, 2 Apr 2020 19:30:25 +0300 (MSK) Received: from T-EXCH-02.corp.yadro.com (t-exch-02.corp.yadro.com [172.17.10.102]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by mta-01.yadro.com (Postfix) with ESMTPS id 0D41141251 for ; Thu, 2 Apr 2020 19:30:24 +0300 (MSK) In-Reply-To: <76e78e538b804aa2b78f320510e8c10d@yadro.com> Content-Language: ru-RU List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: lttng-dev-bounces@lists.lttng.org Sender: "lttng-dev" To: "lttng-dev@lists.lttng.org" List-Id: lttng-dev@lists.lttng.org --===============7822043123732131005== Content-Language: ru-RU Content-Type: multipart/alternative; boundary="_000_ae52dda9bc3b4e54ba097209180e1ac9yadrocom_" --_000_ae52dda9bc3b4e54ba097209180e1ac9yadrocom_ Content-Type: text/plain; charset="koi8-r" Content-Transfer-Encoding: quoted-printable =EF=D4: Aleksander Aleksandrov =EF=D4=D0=D2=C1=D7=CC=C5=CE=CF: 12 =CD=C1=D2=D4=C1 2020 =C7. 14:36 =EB=CF=CD=D5: jeremie.galarneau@efficios.com =EB=CF=D0=C9=D1: simon.marchi@efficios.com; francis.deslauriers@efficios.co= m =F4=C5=CD=C1: Babeltrace 2.0.2 performance issue Hello Jeremie, My name is Aleksandr, I had a pleasure to write a plugin for babeltrace2 an= d I faced some performance issue (bt2 vs bt1). I attached the simple LTTng user-space log which is used to show my issue. = As far as I understand Babeltrace2's performance is comparable to Babeltrac= e1's. * Babeltrace 2: tag: v2.0.2 BABELTRACE_MINIMAL_LOG_LEVEL=3DINFO ./configure --disable-man-pages --disab= le-debug-info CFLAGS=3D'-O3 -DNDEBUG -Wno-error' LD_LIBRARY_PATH=3D./src/lib/.libs ./src/cli/.libs/babeltrace2 my-lttng-trac= e -o dummy 12,70s user 0,03s system 99% cpu 12,745 total * Babeltrace 1: tag: v1.5.8 ./configure CFLAGS=3D'-O3 -DNDEBUG -Wno-error' ./converter/babeltrace my-lttng-trace -o dummy 8,30s user 0,03s system 100= % cpu 8,334 total Babeltrace v2.0.2 is slower (~50%, processing time: 12,745 s vs 8,334 s) th= an Babeltrace v1.5.8 with a dummy output according to my measurements. I would be happy to receive any help or clarification from you. Thank you for your time! Best regards, Aleksandr --_000_ae52dda9bc3b4e54ba097209180e1ac9yadrocom_ Content-Type: text/html; charset="koi8-r" Content-Transfer-Encoding: quoted-printable

=EF=D4:<= /b> Alek= sander Aleksandrov

=EF=D4=D0=D2=C1=D7=CC=C5=CE=CF:= 12 =CD=C1=D2=D4=C1 2020 =C7. 14:36
=EB=CF=CD=D5: jeremie.galarneau@efficios.com
=EB=CF=D0=C9=D1: simon.marchi@efficios.com; francis.deslauriers@effi= cios.com
=F4=C5=CD=C1: Babeltrace 2.0.2 performance issue

Hello Jérémie,

My name is Aleksandr, I had a pleasure to write a plugin for babeltrace2 an= d I faced some performance issue (bt2 vs bt1).

I attached the simple LTTng user-space log which is used to show my is= sue. As far as I understand Babeltrace2’s performance is comparable t= o Babeltrace1’s.

Babeltrace 2:

tag: v2.0.2

BABELTRACE_MINIMAL_LOG_LEVEL=3DINFO ./configure --disable-man-pages --disab= le-debug-info CFLAGS=3D'-O3 -DNDEBUG -Wno-error'

LD_LIBRARY_PATH=3D./src/lib/.libs ./src/cli/.libs/babeltrace2 my-lttng-trac= e -o dummy 12,70s user 0,03s system 99% cpu 12,745 total

Babeltrace 1:

tag: v1.5.8

./configure CFLAGS=3D'-O3 -DNDEBUG -Wno-error'

./converter/babeltrace my-lttng-trace -o dummy 8,30s user 0,03s syste= m 100% cpu 8,334 total

Babeltrace v2.0.2 is slower (~50%, processing time: 12,745 s vs 8,334 = s) than Babeltrace v1.5.8 with a dummy output according to my measurements.=

I would be happy to receive any help or clarification from you.

Thank you for your time!

Best regards,

Aleksandr

--_000_ae52dda9bc3b4e54ba097209180e1ac9yadrocom_-- --===============7822043123732131005== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ lttng-dev mailing list lttng-dev@lists.lttng.org https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev --===============7822043123732131005==-- From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jonathan Rajotte-Julien via lttng-dev Subject: Re: Babeltrace 2.0.2 performance issue Date: Thu, 2 Apr 2020 12:53:00 -0400 Message-ID: <20200402165300.GB695@joraj-alpa> References: <76e78e538b804aa2b78f320510e8c10d@yadro.com> <9ee46aeb-1b9b-c7d4-94ea-c15772bc05eb@efficios.com> <5f3249fe30e040b5b4a444fba495de62@yadro.com> <6992879d-d139-06f5-d325-02530ad2c1b1@efficios.com> Reply-To: Jonathan Rajotte-Julien Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Return-path: Received: from mail.efficios.com (mail.efficios.com [167.114.26.124]) by lists.lttng.org (Postfix) with ESMTPS id 48tTdq30T0z1bT3 for ; Thu, 2 Apr 2020 12:53:02 -0400 (EDT) Content-Disposition: inline In-Reply-To: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: lttng-dev-bounces@lists.lttng.org Sender: "lttng-dev" To: Aleksander Aleksandrov Cc: Simon Marchi , "lttng-dev@lists.lttng.org" List-Id: lttng-dev@lists.lttng.org Hi Aleksander, On Thu, Apr 02, 2020 at 04:32:03PM +0000, Aleksander Aleksandrov via lttng-dev wrote: > Hi Simon, > > > Thank you for your message! Unfortunately, I missed your previous message, sorry for this. > > > I processed the CI's trace logs, I got the following performance: bt2 (140.51s) vs bt1 (122.00s). In my opinion, the values are quite similar comparing with my other measurements. Well, in that case we will augment the data gathered on our CI to better understand what is happening here an why we have such discrepancy. I should be able to allocate some time in the following weeks. Feel free to contribute to the optimization effort on your end if you see any big culprit. For now, the babeltrace team effort is primary on completing documentation and internal cleanup. On my laptop (Intel(R) Core(TM) i7-7500U CPU @ 2.70GHz) with scaling enabled (~3.2Ghz mean of freq used during the 5 run of each bt1 and bt2) I get extremely similar result for both bt1 (~46s) and bt2(~45s). On my desktop as Simon reported, (Ryzen 7 3700x , max freq 3.6Ghz), bt1 is ~33s and bt2 ~36s. All of this using the dummy output for both bt1 and bt2. Cheers > > > Best regards, > > Aleksandr > > > On 2020-03-13 4:58 p.m., Simon Marchi wrote: > > Hi Aleksander, > > > > I just noticed you did not send your original email to the lttng-dev mailing list, > > please send such request on that mailing list, as it's of public interest: > > > > https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev > > > > See my previous response here: > > > > https://pastebin.com/raw/3Q5PbYXn > > > > Simon > > > > Hi Aleksander, > > Sorry, I forgot to follow up. Did you get my last message? > > This is the trace we use for benchmarking: https://files.efficios.com/s/pog5raGkBkH63y9 > > Could you try to compare bt1 and bt2 using that trace? > > On the CI benchmark system, we get some similar performance with both bt1 and bt2. Although > a colleague tried on a recent AMD Ryzen 3700X CPU, and he says bt2 is slower than bt1 for > him (36s vs 33s). I'd be curious to know what kind of numbers you get. > > Simon > _______________________________________________ > lttng-dev mailing list > lttng-dev@lists.lttng.org > https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev -- Jonathan Rajotte-Julien EfficiOS