Re: Need help in converting trace data into CTF

Re: Need help in converting trace data into CTF

[Mathieu Desnoyers]

----- On May 16, 2019, at 1:42 AM, Ravindra Kumar Meena rmeena840@gmail.com wrote:

> Hi LTTng developers,
> I have been selected at GSoC 2019 with organization RTEMs. My project is [
> https://devel.rtems.org/ticket/3696 | https://devel.rtems.org/ticket/3696 ]

> The objective of the project is to convert the trace data into CTF. The trace
> data is already generated by the system. All that is left is to convert the
> trace data into CTF. I am interested in CTF because I want to send it to trace
> compass for analysis.

> Any idea how can I achieve this?

If you intend to produce CTF traces natively from the target, you will want to
look into the barectf project [1].

However, if your goal is to do a post-processing phase to convert traces from
some existing format to CTF, you will want to look into the Babeltrace project [2]
master branch which is in preparation for Babeltrace 2.0. The approach here
would be to create a Babeltrace 2 source plugin which reads your trace format into
the Babeltrace 2 intermediate representation by using the APIs exposed to
plugins by Babeltrace 2. Babeltrace 2 has a generic CTF sink which can serialize
the resulting trace intermediate representation into CTF.

Thanks,

Mathieu

[1] https://github.com/efficios/barectf 
[2] https://diamon.org/babeltrace/


> --
> Ravindra Kumar Meena ,
> B. Tech. Computer Science and Engineering,
> [ https://www.iitism.ac.in/ | Indian Institute of Technology (Indian School of
> Mines) ] , Dhanbad

> _______________________________________________
> lttng-dev mailing list
> lttng-dev@lists.lttng.org
> https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev
-- 
Mathieu Desnoyers
EfficiOS Inc.
http://www.efficios.com

Re: Need help in converting trace data into CTF

[Ravindra Kumar Meena]

[-- Attachment #1.1: Type: text/plain, Size: 1960 bytes --]

On Fri, May 17, 2019 at 12:22 AM Mathieu Desnoyers <
mathieu.desnoyers@efficios.com> wrote:

> ----- On May 16, 2019, at 1:42 AM, Ravindra Kumar Meena
> rmeena840@gmail.com wrote:
>
> > Hi LTTng developers,
> > I have been selected at GSoC 2019 with organization RTEMs. My project is
> [
> > https://devel.rtems.org/ticket/3696 |
> https://devel.rtems.org/ticket/3696 ]
>
> > The objective of the project is to convert the trace data into CTF. The
> trace
> > data is already generated by the system. All that is left is to convert
> the
> > trace data into CTF. I am interested in CTF because I want to send it to
> trace
> > compass for analysis.
>
> > Any idea how can I achieve this?
>
> If you intend to produce CTF traces natively from the target, you will
> want to
> look into the barectf project [1].
>
> However, if your goal is to do a post-processing phase to convert traces
> from
> some existing format to CTF, you will want to look into the Babeltrace
> project [2]
> master branch which is in preparation for Babeltrace 2.0. The approach here
> would be to create a Babeltrace 2 source plugin which reads your trace
> format into
> the Babeltrace 2 intermediate representation by using the APIs exposed to
> plugins by Babeltrace 2. Babeltrace 2 has a generic CTF sink which can
> serialize
> the resulting trace intermediate representation into CTF.
>
> Thanks,
>
> Mathieu
>
> [1] https://github.com/efficios/barectf
> [2] https://diamon.org/babeltrace/
>
> Thanks, Mathieu for the approach. I am trying to use the babeltrace and I
read its documentation and but I nowhere found the examples of conversion
from one format to CTF.

The examples would make it more clear.

Is it possible to convert the live trace stream into CTF stream with the
current babeltrace?

Thanks






-- 
*Ravindra Kumar Meena*,
B. Tech. Computer Science and Engineering,
Indian Institute of Technology (Indian School of Mines)
<https://www.iitism.ac.in/>, Dhanbad

[-- Attachment #1.2: Type: text/html, Size: 3176 bytes --]

[-- Attachment #2: Type: text/plain, Size: 156 bytes --]

_______________________________________________
lttng-dev mailing list
lttng-dev@lists.lttng.org
https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

Re: Need help in converting trace data into CTF

[Mathieu Desnoyers]

[-- Attachment #1.1: Type: text/plain, Size: 2510 bytes --]

----- On May 29, 2019, at 12:19 PM, Ravindra Kumar Meena <rmeena840@gmail.com> wrote: 

> On Fri, May 17, 2019 at 12:22 AM Mathieu Desnoyers < [
> mailto:mathieu.desnoyers@efficios.com | mathieu.desnoyers@efficios.com ] >
> wrote:

>> ----- On May 16, 2019, at 1:42 AM, Ravindra Kumar Meena [
>> mailto:rmeena840@gmail.com | rmeena840@gmail.com ] wrote:

>> > Hi LTTng developers,
>> > I have been selected at GSoC 2019 with organization RTEMs. My project is [
>>> [ https://devel.rtems.org/ticket/3696 | https://devel.rtems.org/ticket/3696 ] |
>> > [ https://devel.rtems.org/ticket/3696 | https://devel.rtems.org/ticket/3696 ] ]

>> > The objective of the project is to convert the trace data into CTF. The trace
>> > data is already generated by the system. All that is left is to convert the
>> > trace data into CTF. I am interested in CTF because I want to send it to trace
>> > compass for analysis.

>> > Any idea how can I achieve this?

>> If you intend to produce CTF traces natively from the target, you will want to
>> look into the barectf project [1].

>> However, if your goal is to do a post-processing phase to convert traces from
>> some existing format to CTF, you will want to look into the Babeltrace project
>> [2]
>> master branch which is in preparation for Babeltrace 2.0. The approach here
>> would be to create a Babeltrace 2 source plugin which reads your trace format
>> into
>> the Babeltrace 2 intermediate representation by using the APIs exposed to
>> plugins by Babeltrace 2. Babeltrace 2 has a generic CTF sink which can serialize
>> the resulting trace intermediate representation into CTF.

>> Thanks,

>> Mathieu

>> [1] [ https://github.com/efficios/barectf | https://github.com/efficios/barectf
>> ]
>> [2] [ https://diamon.org/babeltrace/ | https://diamon.org/babeltrace/ ]

> Thanks, Mathieu for the approach. I am trying to use the babeltrace and I read
> its documentation and but I nowhere found the examples of conversion from one
> format to CTF.

> The examples would make it more clear.

> Is it possible to convert the live trace stream into CTF stream with the current
> babeltrace?

With babeltrace 1.5.x: No. 

With babeltrace master branch (currently in -pre stage before 2.0): Yes. 

Thanks, 

Mathieu 

> Thanks

> --
> Ravindra Kumar Meena ,
> B. Tech. Computer Science and Engineering,
> [ https://www.iitism.ac.in/ | Indian Institute of Technology (Indian School of
> Mines) ] , Dhanbad

-- 
Mathieu Desnoyers 
EfficiOS Inc. 
http://www.efficios.com 

[-- Attachment #1.2: Type: text/html, Size: 4450 bytes --]

[-- Attachment #2: Type: text/plain, Size: 156 bytes --]

_______________________________________________
lttng-dev mailing list
lttng-dev@lists.lttng.org
https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

Re: Need help in converting trace data into CTF

[Ravindra Kumar Meena]

[-- Attachment #1.1: Type: text/plain, Size: 409 bytes --]

>
> With babeltrace 1.5.x: No.
>

Okay

>
>
> With babeltrace master branch (currently in -pre stage before 2.0): Yes.
>
Okay. That's great!!
Are there examples available on it?

Can the conversion be done directly via command-line?

Thanks




-- 
*Ravindra Kumar Meena*,
B. Tech. Computer Science and Engineering,
Indian Institute of Technology (Indian School of Mines)
<https://www.iitism.ac.in/>, Dhanbad

[-- Attachment #1.2: Type: text/html, Size: 1439 bytes --]

[-- Attachment #2: Type: text/plain, Size: 156 bytes --]

_______________________________________________
lttng-dev mailing list
lttng-dev@lists.lttng.org
https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

Re: Need help in converting trace data into CTF

[Ravindra Kumar Meena]

[-- Attachment #1.1: Type: text/plain, Size: 1309 bytes --]

Hi developers,

I have been selected at GSoC 2019. This is my project
https://devel.rtems.org/ticket/3696.

The objective of the project is to convert the current trace data into CTF.
After discussion with you all, I have managed to store the current trace
data into the disk. Now I have to convert it to CTF.

I have attached the stored current trace data file. Please find it in the
attachment.

I used "nc 169.254.12.97 1234 > rtems_record.out" command to store the
current trace data. Here 169.254.12.97 is IP address of QEMU target and
1234 is port of QEMU target.

Any idea how I can convert it to CTF?

Thanks


On Wed, May 29, 2019 at 9:58 PM Ravindra Kumar Meena <rmeena840@gmail.com>
wrote:

> With babeltrace 1.5.x: No.
>>
>
> Okay
>
>>
>>
>> With babeltrace master branch (currently in -pre stage before 2.0): Yes.
>>
> Okay. That's great!!
> Are there examples available on it?
>
> Can the conversion be done directly via command-line?
>
> Thanks
>
>
>
>
> --
> *Ravindra Kumar Meena*,
> B. Tech. Computer Science and Engineering,
> Indian Institute of Technology (Indian School of Mines)
> <https://www.iitism.ac.in/>, Dhanbad
>


-- 
*Ravindra Kumar Meena*,
B. Tech. Computer Science and Engineering,
Indian Institute of Technology (Indian School of Mines)
<https://www.iitism.ac.in/>, Dhanbad

[-- Attachment #1.2: Type: text/html, Size: 3251 bytes --]

[-- Attachment #2: rtems_record.out --]
[-- Type: application/octet-stream, Size: 667640 bytes --]

[-- Attachment #3: Type: text/plain, Size: 156 bytes --]

_______________________________________________
lttng-dev mailing list
lttng-dev@lists.lttng.org
https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

Re: Need help in converting trace data into CTF

[Jonathan Rajotte-Julien]

HI Ravindra,

On Tue, Jun 04, 2019 at 12:02:08PM +0530, Ravindra Kumar Meena wrote:
> Hi developers,
> 
> I have been selected at GSoC 2019. This is my project
> https://devel.rtems.org/ticket/3696.
> 
> The objective of the project is to convert the current trace data into CTF.
> After discussion with you all, I have managed to store the current trace
> data into the disk. Now I have to convert it to CTF.
> 
> I have attached the stored current trace data file. Please find it in the
> attachment.
> 
> I used "nc 169.254.12.97 1234 > rtems_record.out" command to store the
> current trace data. Here 169.254.12.97 is IP address of QEMU target and
> 1234 is port of QEMU target.
> 
> Any idea how I can convert it to CTF?

This was already discussed with you.

https://lists.lttng.org/pipermail/lttng-dev/2019-May/028946.html

You will have to write a decoder (source plugin) for whatever is produced as a
trace output.

See this dmesg source plugin for a base example of a source plugin [1]. This is
valid for babeltrace 2.0 only (AKA the current master branch of babeltrace)

For a more complete example of a source plugin,  you can take a look at the one for
ctf [2]. Once a source plugin is done you will be able to reuse all the current
infrastructure of babeltrace to output to ctf (ctf.sink).

There is no magic solution here, you will need to write a decoder (source
plugin) for your format.

[1] https://github.com/efficios/babeltrace/tree/master/plugins/text/dmesg
[2] https://github.com/efficios/babeltrace/tree/master/plugins/ctf/fs-src

> 
> Thanks
> 
> 
> On Wed, May 29, 2019 at 9:58 PM Ravindra Kumar Meena <rmeena840@gmail.com>
> wrote:
> 
> > With babeltrace 1.5.x: No.
> >>
> >
> > Okay
> >
> >>
> >>
> >> With babeltrace master branch (currently in -pre stage before 2.0): Yes.
> >>
> > Okay. That's great!!
> > Are there examples available on it?
> >
> > Can the conversion be done directly via command-line?
> >
> > Thanks
> >
> >
> >
> >
> > --
> > *Ravindra Kumar Meena*,
> > B. Tech. Computer Science and Engineering,
> > Indian Institute of Technology (Indian School of Mines)
> > <https://www.iitism.ac.in/>, Dhanbad
> >
> 
> 
> -- 
> *Ravindra Kumar Meena*,
> B. Tech. Computer Science and Engineering,
> Indian Institute of Technology (Indian School of Mines)
> <https://www.iitism.ac.in/>, Dhanbad


> _______________________________________________
> lttng-dev mailing list
> lttng-dev@lists.lttng.org
> https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev


-- 
Jonathan Rajotte-Julien
EfficiOS

Re: Need help in converting trace data into CTF

[Jonathan Rajotte-Julien]

> See this dmesg source plugin for a base example of a source plugin [1]. This is
> valid for babeltrace 2.0 only (AKA the current master branch of babeltrace)
> 
> For a more complete example of a source plugin,  you can take a look at the one for
> ctf [2]. Once a source plugin is done you will be able to reuse all the current
> infrastructure of babeltrace to output to ctf (ctf.sink).
> 
> There is no magic solution here, you will need to write a decoder (source
> plugin) for your format.
> 
> [1] https://github.com/efficios/babeltrace/tree/master/plugins/text/dmesg

For all the people coming here from the future:

[1] http://git.efficios.com/?p=babeltrace.git;a=tree;f=plugins/text/dmesg;h=a45918aaf266dac29db6f7a0e4d08ffdb056131a

> [2] https://github.com/efficios/babeltrace/tree/master/plugins/ctf/fs-src

[2] http://git.efficios.com/?p=babeltrace.git;a=tree;f=plugins/ctf/fs-sink;h=b96b435706cac0ed50cb64918603172b67afc424

Re: Need help in converting trace data into CTF

[Ravindra Kumar Meena]

[-- Attachment #1.1: Type: text/plain, Size: 1506 bytes --]

>
>
> > See this dmesg source plugin for a base example of a source plugin [1].
> This is
> > valid for babeltrace 2.0 only (AKA the current master branch of
> babeltrace)
> >
> > For a more complete example of a source plugin,  you can take a look at
> the one for
> > ctf [2]. Once a source plugin is done you will be able to reuse all the
> current
> > infrastructure of babeltrace to output to ctf (ctf.sink).
> >
> > There is no magic solution here, you will need to write a decoder (source
> > plugin) for your format.
> >
> > [1]
> https://github.com/efficios/babeltrace/tree/master/plugins/text/dmesg
>
> For all the people coming here from the future:
>
> [1]
> http://git.efficios.com/?p=babeltrace.git;a=tree;f=plugins/text/dmesg;h=a45918aaf266dac29db6f7a0e4d08ffdb056131a
>
> > [2]
> https://github.com/efficios/babeltrace/tree/master/plugins/ctf/fs-src
>
> [2]
> http://git.efficios.com/?p=babeltrace.git;a=tree;f=plugins/ctf/fs-sink;h=b96b435706cac0ed50cb64918603172b67afc424
>

Thanks for sharing the links. I have cloned the babeltrace master branch
and installed all the dependencies required. The build was successful.

How should I use decoder(source plugin) example[1]? I mean I can see the
code and change it but how should I use it?

[1]
https://github.com/efficios/babeltrace/tree/master/src/plugins/ctf/fs-src

Thanks
-- 
*Ravindra Kumar Meena*,
B. Tech. Computer Science and Engineering,
Indian Institute of Technology (Indian School of Mines)
<https://www.iitism.ac.in/>, Dhanbad

[-- Attachment #1.2: Type: text/html, Size: 2818 bytes --]

[-- Attachment #2: Type: text/plain, Size: 156 bytes --]

_______________________________________________
lttng-dev mailing list
lttng-dev@lists.lttng.org
https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

Re: Need help in converting trace data into CTF

[Ravindra Kumar Meena]

[-- Attachment #1.1: Type: text/plain, Size: 459 bytes --]

Hi developers,

I am trying to write a metadata file. I am following https://diamon.org/ctf/.
I found one metadata file on GitHub repository
https://github.com/efficios/epiphany-examples/tree/barectf-tracing/apps/barectf-tracing/ctf

 Which file format is used for the metadata files?

Thanks


-- 
*Ravindra Kumar Meena*,
B. Tech. Computer Science and Engineering,
Indian Institute of Technology (Indian School of Mines)
<https://www.iitism.ac.in/>, Dhanbad

[-- Attachment #1.2: Type: text/html, Size: 1136 bytes --]

[-- Attachment #2: Type: text/plain, Size: 156 bytes --]

_______________________________________________
lttng-dev mailing list
lttng-dev@lists.lttng.org
https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

Re: Need help in converting trace data into CTF

[Jonathan Rajotte-Julien]

Hi,

> I am trying to write a metadata file. I am following https://diamon.org/ctf/.
> I found one metadata file on GitHub repository
> https://github.com/efficios/epiphany-examples/tree/barectf-tracing/apps/barectf-tracing/ctf
> 
>  Which file format is used for the metadata files?

Babeltrace understand text based metadata file as long as it conforms to the TSDL
grammar.

See:
    https://diamon.org/ctf/#spec7
    https://diamon.org/ctf/#spec7.4
    https://diamon.org/ctf/#specC

For an example of metadata generator, you can look at Barectf[1] or
lttng-tools[2]

[1] https://github.com/efficios/barectf/blob/a3ebf5855c025a86ebc2d62cbda1338461e84c5a/barectf/tsdl182gen.py
[2] https://github.com/lttng/lttng-tools/blob/c8e0c5f5d94fb574f4e5d7518f0f8e6f984dfe3d/src/bin/lttng-sessiond/ust-metadata.c

-- 
Jonathan Rajotte-Julien
EfficiOS

Re: Need help in converting trace data into CTF

[Jonathan Rajotte-Julien]

Hi,

Note that if you plan on using Babeltrace 2 plugin system, the metadata file
will be generated based on the trace representation given by the source plugin.

See [1] for an example of this.

[1] http://git.efficios.com/?p=babeltrace.git;a=blob;f=src/plugins/text/dmesg/dmesg.c;h=7ed01cdc2f4dcdf64f88541884d26b8787df4760#l122

Cheers

On Mon, Jun 17, 2019 at 12:51:54PM -0400, Jonathan Rajotte-Julien wrote:
> Hi,
> 
> > I am trying to write a metadata file. I am following https://diamon.org/ctf/.
> > I found one metadata file on GitHub repository
> > https://github.com/efficios/epiphany-examples/tree/barectf-tracing/apps/barectf-tracing/ctf
> > 
> >  Which file format is used for the metadata files?
> 
> Babeltrace understand text based metadata file as long as it conforms to the TSDL
> grammar.
> 
> See:
>     https://diamon.org/ctf/#spec7
>     https://diamon.org/ctf/#spec7.4
>     https://diamon.org/ctf/#specC
> 
> For an example of metadata generator, you can look at Barectf[1] or
> lttng-tools[2]
> 
> [1] https://github.com/efficios/barectf/blob/a3ebf5855c025a86ebc2d62cbda1338461e84c5a/barectf/tsdl182gen.py
> [2] https://github.com/lttng/lttng-tools/blob/c8e0c5f5d94fb574f4e5d7518f0f8e6f984dfe3d/src/bin/lttng-sessiond/ust-metadata.c
> 
> -- 
> Jonathan Rajotte-Julien
> EfficiOS

-- 
Jonathan Rajotte-Julien
EfficiOS

Re: Need help in converting trace data into CTF

[Ravindra Kumar Meena]

[-- Attachment #1.1: Type: text/plain, Size: 1376 bytes --]

>
>
> Hi,
>
> > I am trying to write a metadata file. I am following
> https://diamon.org/ctf/.
> > I found one metadata file on GitHub repository
> >
> https://github.com/efficios/epiphany-examples/tree/barectf-tracing/apps/barectf-tracing/ctf
> >
> >  Which file format is used for the metadata files?
>
> Babeltrace understand text based metadata file as long as it conforms to
> the TSDL
> grammar.
>
> See:
>     https://diamon.org/ctf/#spec7
>     https://diamon.org/ctf/#spec7.4
>     https://diamon.org/ctf/#specC

Okay. I was following the above links to writing my own metadata file.

>
>
> For an example of metadata generator, you can look at Barectf[1] or
> lttng-tools[2]
>
> [1]
> https://github.com/efficios/barectf/blob/a3ebf5855c025a86ebc2d62cbda1338461e84c5a/barectf/tsdl182gen.py

I used "barectf config.yaml -m ctf" command. It helpled me generating the
metadata file. I looked at some other metadata file but they are binary
packetized. The one I generated using barectf is not binary packetized.

Are these file different?
Will both work the same way?

>
> [2]
> https://github.com/lttng/lttng-tools/blob/c8e0c5f5d94fb574f4e5d7518f0f8e6f984dfe3d/src/bin/lttng-sessiond/ust-metadata.c
>
>

-- 
*Ravindra Kumar Meena*,
B. Tech. Computer Science and Engineering,
Indian Institute of Technology (Indian School of Mines)
<https://www.iitism.ac.in/>, Dhanbad

[-- Attachment #1.2: Type: text/html, Size: 3210 bytes --]

[-- Attachment #2: Type: text/plain, Size: 156 bytes --]

_______________________________________________
lttng-dev mailing list
lttng-dev@lists.lttng.org
https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

Re: Need help in converting trace data into CTF

[Jonathan Rajotte-Julien]

Hi,

> I used "barectf config.yaml -m ctf" command. It helpled me generating the
> metadata file. I looked at some other metadata file but they are binary
> packetized. The one I generated using barectf is not binary packetized.
> 
> Are these file different?

Yes, they are. As you said one is packetized and the other simply text.

> Will both work the same way?

It will work the same as long as you use a reader that does not care.
AFAIK, Babeltrace is one of those readers.

-- 
Jonathan Rajotte-Julien
EfficiOS

Re: Need help in converting trace data into CTF

[Ravindra Kumar Meena]

[-- Attachment #1.1: Type: text/plain, Size: 1065 bytes --]

>
> > I used "barectf config.yaml -m ctf" command. It helpled me generating the
> > metadata file. I looked at some other metadata file but they are binary
> > packetized. The one I generated using barectf is not binary packetized.
> >
> > Are these file different?
>
> Yes, they are. As you said one is packetized and the other simply text.
>
> > Will both work the same way?
>
> It will work the same as long as you use a reader that does not care.
> AFAIK, Babeltrace is one of those readers.
>
Okay. This was helpful.

I will be storing the event stream in a file and I will pass metadata file
to babeltrace in order to read the CTF.

 I want to make babeltrace read my metadata file and event stream stored in
a file. How does babeltrace read an arbitrary CTF session(CTF+event stream)?

What should be the file format to store the event stream? I will use
fwrite() to store the events.

Thanks

-- 
*Ravindra Kumar Meena*,
B. Tech. Computer Science and Engineering,
Indian Institute of Technology (Indian School of Mines)
<https://www.iitism.ac.in/>, Dhanbad

[-- Attachment #1.2: Type: text/html, Size: 1732 bytes --]

[-- Attachment #2: Type: text/plain, Size: 156 bytes --]

_______________________________________________
lttng-dev mailing list
lttng-dev@lists.lttng.org
https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

Re: Need help in converting trace data into CTF

[Jonathan Rajotte-Julien]

Hi,

>  I want to make babeltrace read my metadata file and event stream stored in
> a file. How does babeltrace read an arbitrary CTF session(CTF+event stream)?

Babeltrace traverses the tree and look for files named "metadata"
. All files at the same depth of a metadata file are considered CTF streams.

e.g:
   /tmp/
       my-trace/
           another_dir/
               abcd
               efgh
               metadata

babeltrace /tmp/my-trace/

The files "abcd" and "efgh" will be considered stream files and babeltrace will
try to read them.

You can have hidden file (".abcd") at the same depth, they will not be
considered.

> 
> What should be the file format to store the event stream? I will use
> fwrite() to store the events.

The CTF format.

Cheers

-- 
Jonathan Rajotte-Julien
EfficiOS

Re: Need help in converting trace data into CTF

[Ravindra Kumar Meena]

[-- Attachment #1.1: Type: text/plain, Size: 1507 bytes --]

>
> >  I want to make babeltrace read my metadata file and event stream stored
> in
> > a file. How does babeltrace read an arbitrary CTF session(CTF+event
> stream)?
>
> Babeltrace traverses the tree and look for files named "metadata"
> . All files at the same depth of a metadata file are considered CTF
> streams.
>
> e.g:
>    /tmp/
>        my-trace/
>            another_dir/
>                abcd
>                efgh
>                metadata
>
> babeltrace /tmp/my-trace/
>
> The files "abcd" and "efgh" will be considered stream files and babeltrace
> will
> try to read them.
>
> You can have hidden file (".abcd") at the same depth, they will not be
> considered.
>
> >
> > What should be the file format to store the event stream? I will use
> > fwrite() to store the events.
>
> The CTF format.
>
> Okay. This worked for me. Thanks :)

Now I know how to write the metadata file but one thing I am not sure that
how should I relate the TSDL description of metadata with my system events?

Like I have this in my system:

typedef struct ctf_event {
  uint64_t                     ns;
  uint32_t                     cpu;
  rtems_record_event           event;
  uint64_t                     data;
} ctf_event;

How should I relate it with TSDL description of metadata? It should match
with the TSDL description. Isn't it?

Thanks

-- 
*Ravindra Kumar Meena*,
B. Tech. Computer Science and Engineering,
Indian Institute of Technology (Indian School of Mines)
<https://www.iitism.ac.in/>, Dhanbad

[-- Attachment #1.2: Type: text/html, Size: 2366 bytes --]

[-- Attachment #2: Type: text/plain, Size: 156 bytes --]

_______________________________________________
lttng-dev mailing list
lttng-dev@lists.lttng.org
https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

Re: Need help in converting trace data into CTF

[Ravindra Kumar Meena]

[-- Attachment #1.1: Type: text/plain, Size: 327 bytes --]

Since the magic number is optional, is it possible to create metadata and
stream file that does not use the CTF magic number and can be parsed by the
babeltrace?

-- 
*Ravindra Kumar Meena*,
B. Tech. Computer Science and Engineering,
Indian Institute of Technology (Indian School of Mines)
<https://www.iitism.ac.in/>, Dhanbad

[-- Attachment #1.2: Type: text/html, Size: 705 bytes --]

[-- Attachment #2: Type: text/plain, Size: 156 bytes --]

_______________________________________________
lttng-dev mailing list
lttng-dev@lists.lttng.org
https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

Re: Need help in converting trace data into CTF

[Ravindra Kumar Meena]

[-- Attachment #1.1: Type: text/plain, Size: 441 bytes --]

Hi developers,

I have multiple binary stream files. Each event stream file contains the
events of the same structure. Each file is for a particular CPU. There is a
total of 32 event stream files.

How to tell the consumers of the streams which file is for which CPU?

Thanks

-- 
*Ravindra Kumar Meena*,
B. Tech. Computer Science and Engineering,
Indian Institute of Technology (Indian School of Mines)
<https://www.iitism.ac.in/>, Dhanbad

[-- Attachment #1.2: Type: text/html, Size: 909 bytes --]

[-- Attachment #2: Type: text/plain, Size: 156 bytes --]

_______________________________________________
lttng-dev mailing list
lttng-dev@lists.lttng.org
https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

Need help in converting trace data into CTF

[Ravindra Kumar Meena]

[-- Attachment #1.1: Type: text/plain, Size: 586 bytes --]

Hi LTTng developers,

I have been selected at GSoC 2019 with organization RTEMs. My project is
https://devel.rtems.org/ticket/3696

The objective of the project is to convert the trace data into CTF. The
trace data is already generated by the system. All that is left is to
convert the trace data into CTF. I am interested in CTF because I want to
send it to trace compass for analysis.

Any idea how can I achieve this?

-- 
*Ravindra Kumar Meena*,
B. Tech. Computer Science and Engineering,
Indian Institute of Technology (Indian School of Mines)
<https://www.iitism.ac.in/>, Dhanbad

[-- Attachment #1.2: Type: text/html, Size: 1093 bytes --]

[-- Attachment #2: Type: text/plain, Size: 156 bytes --]

_______________________________________________
lttng-dev mailing list
lttng-dev@lists.lttng.org
https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev