All of lore.kernel.org
 help / color / mirror / Atom feed
From: Tvrtko Ursulin <tursulin@ursulin.net>
To: John Harrison <John.C.Harrison@Intel.com>,
	Tvrtko Ursulin <tvrtko.ursulin@linux.intel.com>,
	igt-dev@lists.freedesktop.org
Cc: intel-gfx@lists.freedesktop.org
Subject: Re: [igt-dev] [PATCH i-g-t v2 1/9] trace.pl: Improve time axis labels
Date: Tue, 17 Jul 2018 17:22:09 +0100	[thread overview]
Message-ID: <67dccb96-1f8f-23b5-b547-283e1c97632e@ursulin.net> (raw)
In-Reply-To: <07840c0e-3509-27e3-d78d-cd89b60c49cb@Intel.com>


On 17/07/18 16:31, John Harrison wrote:
> On 7/17/2018 8:11 AM, John Harrison wrote:
>> On 7/17/2018 1:56 AM, Tvrtko Ursulin wrote:
>>>
>>> On 16/07/2018 18:53, John Harrison wrote:
>>>> On 7/13/2018 2:55 AM, Tvrtko Ursulin wrote:
>>>>> From: Tvrtko Ursulin<tvrtko.ursulin@intel.com>
>>>>>
>>>>> It is possible to customize the axis display so change it to display
>>>>> timestamps in seconds on the major axis (with six decimal spaces) and
>>>>> millisecond offsets on the minor axis.
>>>>>
>>>>> v2:
>>>>>   * Give up on broken relative timestamps.
>>>>>
>>>>> Signed-off-by: Tvrtko Ursulin<tvrtko.ursulin@intel.com>
>>>>> Suggested-by: Chris Wilson<chris@chris-wilson.co.uk>
>>>>> Cc: Chris Wilson<chris@chris-wilson.co.uk>
>>>>> Cc: John Harrison<John.C.Harrison@Intel.com>
>>>>> ---
>>>>>   scripts/trace.pl | 37 +++++++++++++++++++++++++++++++++++++
>>>>>   1 file changed, 37 insertions(+)
>>>>>
>>>>> diff --git a/scripts/trace.pl b/scripts/trace.pl
>>>>> index fc1713e4f9a7..41f10749a153 100755
>>>>> --- a/scripts/trace.pl
>>>>> +++ b/scripts/trace.pl
>>>>> @@ -1000,6 +1000,42 @@ $first_ts = ts($first_ts);
>>>>>   print <<ENDHTML;
>>>>>     ]);
>>>>>   +  function majorAxis(date, scale, step) {
>>>>> +    var s = date / 1000;
>>>>> +    var precision;
>>>>> +
>>>>> +    if (scale == 'millisecond')
>>>>> +        precision = 6;
>>>>> +    else if (scale == 'second')
>>>>> +        precision = 3;
>>>>> +    else
>>>>> +        precision = 0;
>>>>> +
>>>>> +    return s.toFixed(precision) + "s";
>>>>> +  }
>>>>> +
>>>>> +  function minorAxis(date, scale, step) {
>>>>> +    var ms = date;
>>>>> +    var precision;
>>>>> +    var unit;
>>>>> +
>>>>> +    if (scale == 'millisecond') {
>>>>> +        ms %= 1000;
>>>>> +        precision = 0;
>>>>> +        unit = 'ms';
>>>>> +    } else if (scale == 'second') {
>>>>> +        ms /= 1000;
>>>>> +        precision = 1;
>>>>> +        unit = 's';
>>>>> +    } else {
>>>>> +        ms /= 1000;
>>>>> +        precision = 0;
>>>>> +        unit = 's';
>>>>> +    }
>>>>> +
>>>>> +    return ms.toFixed(precision) + unit;
>>>>> +  }
>>>>> +
>>>>>     // Configuration for the Timeline
>>>>>     var options = { groupOrder: 'content',
>>>>>             horizontalScroll: true,
>>>>> @@ -1007,6 +1043,7 @@ print <<ENDHTML;
>>>>>             stackSubgroups: false,
>>>>>             zoomKey: 'ctrlKey',
>>>>>             orientation: 'top',
>>>>> +          format: { majorLabels: majorAxis, minorLabels: minorAxis },
>>>>>             start: '$first_ts',
>>>>>             end: '$end_ts'};
>>>>
>>>> I'm still seeing some kind of strange offset. However, it appears to 
>>>> be browser dependent. If I use Chrome then the offset is +28.8 
>>>> seconds. With Firefox it is -59958115.2 seconds! On the other hand, 
>>>> if I try Edge or IE then I don't get a graph at all. I'm wondering 
>>>> if the issue is with Vis browser compatibility rather than anything 
>>>> in the trace.pl script. Are you seeing anything at all similar?
>>>>
>>>> Hmm, if I comment out the 'format:' line and go back to the 
>>>> unformatted time stamps then IE & Edge still show nothing. However, 
>>>> Firefox shows dates based on a year of 0097 whereas Chrome says 1997.
>>>>
>>>> Either way, I can't spot anything in this patch that could cause a 
>>>> random offset. So...
>>>
>>> Yeah, I can see that now that I tried in Firefox. I was using 
>>> Chromium so far and there timestamps are exactly matching the ones 
>>> from the tracepoint log. Which is what we want for easy correlation 
>>> between the log and HTML..
>>>
>>> Firefox corrupts that somehow by applying the large negative offset 
>>> to everyhting. Perhaps around two year worth of negative seconds if 
>>> my rough calculation can be trusted. Or Vis under Firefox, I wouldn't 
>>> know really who is to blame.
>>>
>>> I have no idea what to do here. :(
>>>
>>> Regards,
>>>
>>> Tvrtko
>>
>> I think ship it for now. It is better than it was. Certainly reporting 
>> in date format is vaguely meaningless at best and totally meaningless 
>> with the x1000 scale factor.
>>
>> Note that chromium on Ubuntu 16.04 does the same as Chrome on Windows 
>> for me - 28.8 seconds offset. It's not as bad as the 1.9 years of 
>> Firefox but it is still out :(. I'm guessing it is a bug in the date 
>> -> absolute seconds conversion going on within either Javascript 
>> itself or Vis in particular. The timestamps are still encoded as dates 
>> in the HTML file (and referenced from 0 not from 1900 or 1970 or 
>> whatever). So any difference in calculating leap years between the 
>> Perl script and the browser would potentially cause quite a 
>> significant delta.
>>
>> Is it at all possible to put absolute seconds style values in the HTML 
>> file instead of dates? That would seem like the obvious answer. I 
>> don't know if Vis would cope with that, though?
>>
>> John.
>>
> 
> Hmm. It looks like if I change the 'ts()' function to use 'localtime()' 
> instead of 'gmtime()' and to add on 1900 to the year then it all works 
> fine for me :). So yes, I think it is some incompatibility between the 
> Perl and Javascript implementations of date <-> absolute seconds 
> conversions. Given that the timestamp is no longer being reported as an 
> actual date anymore, the relative value doesn't really matter. So I 
> would go with using whatever scheme produces the least mutation along 
> the way!
> 
> I wonder if you see the correct values on Chrome because your logs have 
> smaller timestamps? The ones I am currently testing with are of the 
> order of 856985.688681. With the above tweaks, that comes out as a date 
> of '1997-02-26 11:34:48.681000'. The 'gmtime' version was '1997-02-26 
> 19:34:48.681000' and obviously the non-1900 version was '0097-02-26 
> 19:34:48.681000'. Actually, maybe the Chrome difference is because you 
> are in the UK and don't have a timezone delta? Although I would assume 
> you are on BST not GMT right now?

Can you try leaving gmtime in ts() and adding this diff:

diff --git a/scripts/trace.pl b/scripts/trace.pl
index 88abc2ee5ebf..2e43b68e3163 100755
--- a/scripts/trace.pl
+++ b/scripts/trace.pl
@@ -1338,6 +1338,10 @@ print <<ENDHTML;
                  zoomKey: 'ctrlKey',
                  orientation: 'top',
                  format: { majorLabels: majorAxis, minorLabels: minorAxis },
+  moment: function(date) {
+    return vis.moment(date).utc();
+  },
+
                  start: '$first_ts',
                  end: '$end_ts'};

Could be the gotcha we were missing!

Regards,

Tvrtko
_______________________________________________
Intel-gfx mailing list
Intel-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/intel-gfx

WARNING: multiple messages have this Message-ID (diff)
From: Tvrtko Ursulin <tursulin@ursulin.net>
To: John Harrison <John.C.Harrison@Intel.com>,
	Tvrtko Ursulin <tvrtko.ursulin@linux.intel.com>,
	igt-dev@lists.freedesktop.org
Cc: intel-gfx@lists.freedesktop.org,
	Tvrtko Ursulin <tvrtko.ursulin@intel.com>
Subject: Re: [igt-dev] [PATCH i-g-t v2 1/9] trace.pl: Improve time axis labels
Date: Tue, 17 Jul 2018 17:22:09 +0100	[thread overview]
Message-ID: <67dccb96-1f8f-23b5-b547-283e1c97632e@ursulin.net> (raw)
In-Reply-To: <07840c0e-3509-27e3-d78d-cd89b60c49cb@Intel.com>


On 17/07/18 16:31, John Harrison wrote:
> On 7/17/2018 8:11 AM, John Harrison wrote:
>> On 7/17/2018 1:56 AM, Tvrtko Ursulin wrote:
>>>
>>> On 16/07/2018 18:53, John Harrison wrote:
>>>> On 7/13/2018 2:55 AM, Tvrtko Ursulin wrote:
>>>>> From: Tvrtko Ursulin<tvrtko.ursulin@intel.com>
>>>>>
>>>>> It is possible to customize the axis display so change it to display
>>>>> timestamps in seconds on the major axis (with six decimal spaces) and
>>>>> millisecond offsets on the minor axis.
>>>>>
>>>>> v2:
>>>>>   * Give up on broken relative timestamps.
>>>>>
>>>>> Signed-off-by: Tvrtko Ursulin<tvrtko.ursulin@intel.com>
>>>>> Suggested-by: Chris Wilson<chris@chris-wilson.co.uk>
>>>>> Cc: Chris Wilson<chris@chris-wilson.co.uk>
>>>>> Cc: John Harrison<John.C.Harrison@Intel.com>
>>>>> ---
>>>>>   scripts/trace.pl | 37 +++++++++++++++++++++++++++++++++++++
>>>>>   1 file changed, 37 insertions(+)
>>>>>
>>>>> diff --git a/scripts/trace.pl b/scripts/trace.pl
>>>>> index fc1713e4f9a7..41f10749a153 100755
>>>>> --- a/scripts/trace.pl
>>>>> +++ b/scripts/trace.pl
>>>>> @@ -1000,6 +1000,42 @@ $first_ts = ts($first_ts);
>>>>>   print <<ENDHTML;
>>>>>     ]);
>>>>>   +  function majorAxis(date, scale, step) {
>>>>> +    var s = date / 1000;
>>>>> +    var precision;
>>>>> +
>>>>> +    if (scale == 'millisecond')
>>>>> +        precision = 6;
>>>>> +    else if (scale == 'second')
>>>>> +        precision = 3;
>>>>> +    else
>>>>> +        precision = 0;
>>>>> +
>>>>> +    return s.toFixed(precision) + "s";
>>>>> +  }
>>>>> +
>>>>> +  function minorAxis(date, scale, step) {
>>>>> +    var ms = date;
>>>>> +    var precision;
>>>>> +    var unit;
>>>>> +
>>>>> +    if (scale == 'millisecond') {
>>>>> +        ms %= 1000;
>>>>> +        precision = 0;
>>>>> +        unit = 'ms';
>>>>> +    } else if (scale == 'second') {
>>>>> +        ms /= 1000;
>>>>> +        precision = 1;
>>>>> +        unit = 's';
>>>>> +    } else {
>>>>> +        ms /= 1000;
>>>>> +        precision = 0;
>>>>> +        unit = 's';
>>>>> +    }
>>>>> +
>>>>> +    return ms.toFixed(precision) + unit;
>>>>> +  }
>>>>> +
>>>>>     // Configuration for the Timeline
>>>>>     var options = { groupOrder: 'content',
>>>>>             horizontalScroll: true,
>>>>> @@ -1007,6 +1043,7 @@ print <<ENDHTML;
>>>>>             stackSubgroups: false,
>>>>>             zoomKey: 'ctrlKey',
>>>>>             orientation: 'top',
>>>>> +          format: { majorLabels: majorAxis, minorLabels: minorAxis },
>>>>>             start: '$first_ts',
>>>>>             end: '$end_ts'};
>>>>
>>>> I'm still seeing some kind of strange offset. However, it appears to 
>>>> be browser dependent. If I use Chrome then the offset is +28.8 
>>>> seconds. With Firefox it is -59958115.2 seconds! On the other hand, 
>>>> if I try Edge or IE then I don't get a graph at all. I'm wondering 
>>>> if the issue is with Vis browser compatibility rather than anything 
>>>> in the trace.pl script. Are you seeing anything at all similar?
>>>>
>>>> Hmm, if I comment out the 'format:' line and go back to the 
>>>> unformatted time stamps then IE & Edge still show nothing. However, 
>>>> Firefox shows dates based on a year of 0097 whereas Chrome says 1997.
>>>>
>>>> Either way, I can't spot anything in this patch that could cause a 
>>>> random offset. So...
>>>
>>> Yeah, I can see that now that I tried in Firefox. I was using 
>>> Chromium so far and there timestamps are exactly matching the ones 
>>> from the tracepoint log. Which is what we want for easy correlation 
>>> between the log and HTML..
>>>
>>> Firefox corrupts that somehow by applying the large negative offset 
>>> to everyhting. Perhaps around two year worth of negative seconds if 
>>> my rough calculation can be trusted. Or Vis under Firefox, I wouldn't 
>>> know really who is to blame.
>>>
>>> I have no idea what to do here. :(
>>>
>>> Regards,
>>>
>>> Tvrtko
>>
>> I think ship it for now. It is better than it was. Certainly reporting 
>> in date format is vaguely meaningless at best and totally meaningless 
>> with the x1000 scale factor.
>>
>> Note that chromium on Ubuntu 16.04 does the same as Chrome on Windows 
>> for me - 28.8 seconds offset. It's not as bad as the 1.9 years of 
>> Firefox but it is still out :(. I'm guessing it is a bug in the date 
>> -> absolute seconds conversion going on within either Javascript 
>> itself or Vis in particular. The timestamps are still encoded as dates 
>> in the HTML file (and referenced from 0 not from 1900 or 1970 or 
>> whatever). So any difference in calculating leap years between the 
>> Perl script and the browser would potentially cause quite a 
>> significant delta.
>>
>> Is it at all possible to put absolute seconds style values in the HTML 
>> file instead of dates? That would seem like the obvious answer. I 
>> don't know if Vis would cope with that, though?
>>
>> John.
>>
> 
> Hmm. It looks like if I change the 'ts()' function to use 'localtime()' 
> instead of 'gmtime()' and to add on 1900 to the year then it all works 
> fine for me :). So yes, I think it is some incompatibility between the 
> Perl and Javascript implementations of date <-> absolute seconds 
> conversions. Given that the timestamp is no longer being reported as an 
> actual date anymore, the relative value doesn't really matter. So I 
> would go with using whatever scheme produces the least mutation along 
> the way!
> 
> I wonder if you see the correct values on Chrome because your logs have 
> smaller timestamps? The ones I am currently testing with are of the 
> order of 856985.688681. With the above tweaks, that comes out as a date 
> of '1997-02-26 11:34:48.681000'. The 'gmtime' version was '1997-02-26 
> 19:34:48.681000' and obviously the non-1900 version was '0097-02-26 
> 19:34:48.681000'. Actually, maybe the Chrome difference is because you 
> are in the UK and don't have a timezone delta? Although I would assume 
> you are on BST not GMT right now?

Can you try leaving gmtime in ts() and adding this diff:

diff --git a/scripts/trace.pl b/scripts/trace.pl
index 88abc2ee5ebf..2e43b68e3163 100755
--- a/scripts/trace.pl
+++ b/scripts/trace.pl
@@ -1338,6 +1338,10 @@ print <<ENDHTML;
                  zoomKey: 'ctrlKey',
                  orientation: 'top',
                  format: { majorLabels: majorAxis, minorLabels: minorAxis },
+  moment: function(date) {
+    return vis.moment(date).utc();
+  },
+
                  start: '$first_ts',
                  end: '$end_ts'};

Could be the gotcha we were missing!

Regards,

Tvrtko
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

  reply	other threads:[~2018-07-17 16:22 UTC|newest]

Thread overview: 70+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-07-12 10:59 [PATCH i-g-t 0/9] trace.pl fixes and improvements Tvrtko Ursulin
2018-07-12 10:59 ` [igt-dev] " Tvrtko Ursulin
2018-07-12 10:59 ` [PATCH i-g-t 1/9] trace.pl: Improve time axis labels Tvrtko Ursulin
2018-07-12 10:59   ` [igt-dev] " Tvrtko Ursulin
2018-07-12 12:42   ` Tvrtko Ursulin
2018-07-12 12:42     ` Tvrtko Ursulin
2018-07-12 22:35     ` John Harrison
2018-07-12 22:35       ` John Harrison
2018-07-13  9:55       ` [PATCH i-g-t v2 " Tvrtko Ursulin
2018-07-13  9:55         ` [igt-dev] " Tvrtko Ursulin
2018-07-16 17:53         ` John Harrison
2018-07-16 17:53           ` [Intel-gfx] " John Harrison
2018-07-17  8:56           ` [igt-dev] " Tvrtko Ursulin
2018-07-17  8:56             ` [Intel-gfx] " Tvrtko Ursulin
2018-07-17 15:11             ` John Harrison
2018-07-17 15:11               ` John Harrison
2018-07-17 15:31               ` John Harrison
2018-07-17 15:31                 ` John Harrison
2018-07-17 16:22                 ` Tvrtko Ursulin [this message]
2018-07-17 16:22                   ` Tvrtko Ursulin
2018-07-17 17:57                   ` John Harrison
2018-07-17 17:57                     ` John Harrison
2018-07-12 10:59 ` [PATCH i-g-t 2/9] trace.pl: Scale timeline for better precision Tvrtko Ursulin
2018-07-12 10:59   ` [igt-dev] " Tvrtko Ursulin
2018-07-13  0:21   ` John Harrison
2018-07-13  0:21     ` [igt-dev] " John Harrison
2018-07-13 10:02   ` [PATCH i-g-t v3 " Tvrtko Ursulin
2018-07-13 10:02     ` [igt-dev] " Tvrtko Ursulin
2018-07-16 18:15     ` John Harrison
2018-07-16 18:15       ` [igt-dev] " John Harrison
2018-07-12 10:59 ` [PATCH i-g-t 3/9] trace.pl: Improve readability of graphical timeline representation Tvrtko Ursulin
2018-07-12 10:59   ` [igt-dev] " Tvrtko Ursulin
2018-07-13  0:51   ` John Harrison
2018-07-13  0:51     ` [Intel-gfx] " John Harrison
2018-07-12 10:59 ` [PATCH i-g-t 4/9] trace.pl: Improve context colouring for large context id's Tvrtko Ursulin
2018-07-12 10:59   ` [igt-dev] " Tvrtko Ursulin
2018-07-13  0:51   ` John Harrison
2018-07-13  0:51     ` [Intel-gfx] " John Harrison
2018-07-12 10:59 ` [PATCH i-g-t 5/9] trace.pl: Improved key/colours Tvrtko Ursulin
2018-07-12 10:59   ` [igt-dev] " Tvrtko Ursulin
2018-07-12 11:03   ` Tvrtko Ursulin
2018-07-12 11:03     ` Tvrtko Ursulin
2018-07-13  0:52   ` John Harrison
2018-07-13  0:52     ` [igt-dev] " John Harrison
2018-07-13  9:56     ` [PATCH i-g-t v3 " Tvrtko Ursulin
2018-07-13  9:56       ` [igt-dev] " Tvrtko Ursulin
2018-07-14  0:01       ` John Harrison
2018-07-14  0:01         ` [igt-dev] " John Harrison
2018-07-16  8:49         ` [PATCH i-g-t v4 " Tvrtko Ursulin
2018-07-16  8:49           ` [Intel-gfx] " Tvrtko Ursulin
2018-07-16 19:11           ` John Harrison
2018-07-16 19:11             ` [igt-dev] " John Harrison
2018-07-12 10:59 ` [PATCH i-g-t 6/9] trace.pl: Context save only applies to last request of a bunch Tvrtko Ursulin
2018-07-12 10:59   ` [igt-dev] " Tvrtko Ursulin
2018-07-13  6:55   ` John Harrison
2018-07-12 10:59 ` [PATCH i-g-t 7/9] trace.pl: Fix incomplete request handling Tvrtko Ursulin
2018-07-12 10:59   ` [igt-dev] " Tvrtko Ursulin
2018-07-13  7:00   ` John Harrison
2018-07-13  7:00     ` [igt-dev] " John Harrison
2018-07-12 10:59 ` [PATCH i-g-t 8/9] trace.pl: Basic preemption support Tvrtko Ursulin
2018-07-12 10:59   ` [igt-dev] " Tvrtko Ursulin
2018-07-13  0:54   ` John Harrison
2018-07-12 10:59 ` [PATCH i-g-t 9/9] trace.pl: Fix request split mode Tvrtko Ursulin
2018-07-12 10:59   ` [igt-dev] " Tvrtko Ursulin
2018-07-12 14:26 ` [igt-dev] ✓ Fi.CI.BAT: success for trace.pl fixes and improvements (rev3) Patchwork
2018-07-12 15:50 ` [igt-dev] ✓ Fi.CI.IGT: " Patchwork
2018-07-13 11:09 ` [igt-dev] ✓ Fi.CI.BAT: success for trace.pl fixes and improvements (rev6) Patchwork
2018-07-13 13:59 ` [igt-dev] ✗ Fi.CI.IGT: failure " Patchwork
2018-07-16 10:03 ` [igt-dev] ✓ Fi.CI.BAT: success for trace.pl fixes and improvements (rev7) Patchwork
2018-07-16 16:41 ` [igt-dev] ✗ Fi.CI.IGT: failure " Patchwork

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=67dccb96-1f8f-23b5-b547-283e1c97632e@ursulin.net \
    --to=tursulin@ursulin.net \
    --cc=John.C.Harrison@Intel.com \
    --cc=igt-dev@lists.freedesktop.org \
    --cc=intel-gfx@lists.freedesktop.org \
    --cc=tvrtko.ursulin@linux.intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.