Crazy display

Crazy display

[Gary Thomas]

I haven't seen this before, just thought I'd toss it out there.
I was doing a build (actually three in parallel in separate
windows on my build box) and noticed this:

Currently  3 running tasks (3282 of 5081)  64% |################################################### 
        |
0: busybox-1.24.1-r0 do_compile (pid 29425)
Currently  3 running tasks (3283 of 5081)  64% |################################################### 
        |
Currently  3 running tasks (3429 of 5081)  67% |##################################################### 
        |
0: gstreamer1.0-libav-1.8.3-r0 do_configure (pid 10393)
Currently  1 running tasks (3560 of 5081)  70% |######################################################## 
        |
0: gstreamer1.0-libav-1.8.3-r0 do_compile (pid 17458)
Currently  3 running tasks (3601 of 5081)  70% |######################################################## 
        |
0: gstreamer1.0-libav-1.8.3-r0 do_compile (pid 17458)
1: gdk-pixbuf-2.34.0-r0 do_package_write_ipk (pid 12673)
2: unifdef-native-2.11-r0 do_populate_lic (pid 24548)

Somehow the task tracker (that does a nice job of telling the user
what's going on without being overwhelming BTW) got very confused!

I doubt if I can every repeat this, just passing on the observation!

-- 
------------------------------------------------------------
Gary Thomas                 |  Consulting for the
MLB Associates              |    Embedded world
------------------------------------------------------------

Re: Crazy display

[Burton, Ross]

[-- Attachment #1: Type: text/plain, Size: 1938 bytes --]

Yes, I see this at least once a day, and there's a bug for it somewhere in
bugzilla.

Ross

On 15 September 2016 at 12:30, Gary Thomas <gary@mlbassoc.com> wrote:

> I haven't seen this before, just thought I'd toss it out there.
> I was doing a build (actually three in parallel in separate
> windows on my build box) and noticed this:
>
> Currently  3 running tasks (3282 of 5081)  64%
> |###################################################        |
> 0: busybox-1.24.1-r0 do_compile (pid 29425)
> Currently  3 running tasks (3283 of 5081)  64%
> |###################################################        |
> Currently  3 running tasks (3429 of 5081)  67%
> |#####################################################        |
> 0: gstreamer1.0-libav-1.8.3-r0 do_configure (pid 10393)
> Currently  1 running tasks (3560 of 5081)  70%
> |########################################################        |
> 0: gstreamer1.0-libav-1.8.3-r0 do_compile (pid 17458)
> Currently  3 running tasks (3601 of 5081)  70%
> |########################################################        |
> 0: gstreamer1.0-libav-1.8.3-r0 do_compile (pid 17458)
> 1: gdk-pixbuf-2.34.0-r0 do_package_write_ipk (pid 12673)
> 2: unifdef-native-2.11-r0 do_populate_lic (pid 24548)
>
> Somehow the task tracker (that does a nice job of telling the user
> what's going on without being overwhelming BTW) got very confused!
>
> I doubt if I can every repeat this, just passing on the observation!
>
> --
> ------------------------------------------------------------
> Gary Thomas                 |  Consulting for the
> MLB Associates              |    Embedded world
> ------------------------------------------------------------
> --
> _______________________________________________
> Openembedded-core mailing list
> Openembedded-core@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-core
>

[-- Attachment #2: Type: text/html, Size: 2664 bytes --]

Re: Crazy display

[Paul Eggleton]

I understand some people are seeing this issue with the progress bar, but so 
far I haven't observed any problems here - any help reproducing it would be 
much appreciated. The bugzilla entry is:

  https://bugzilla.yoctoproject.org/show_bug.cgi?id=10046

Are you guys perhaps using the same terminal application? Using screen / tmux 
/ anything similar? (I'm using screen here and haven't experienced problems 
though.)

Cheers,
Paul

On Thu, 15 Sep 2016 12:38:21 Burton, Ross wrote:
> Yes, I see this at least once a day, and there's a bug for it somewhere in
> bugzilla.
> 
> Ross
> 
> On 15 September 2016 at 12:30, Gary Thomas <gary@mlbassoc.com> wrote:
> > I haven't seen this before, just thought I'd toss it out there.
> > I was doing a build (actually three in parallel in separate
> > windows on my build box) and noticed this:
> > 
> > Currently  3 running tasks (3282 of 5081)  64%
> > 
> > |###################################################        |
> > 
> > 0: busybox-1.24.1-r0 do_compile (pid 29425)
> > Currently  3 running tasks (3283 of 5081)  64%
> > 
> > |###################################################        |
> > 
> > Currently  3 running tasks (3429 of 5081)  67%
> > 
> > |#####################################################        |
> > 
> > 0: gstreamer1.0-libav-1.8.3-r0 do_configure (pid 10393)
> > Currently  1 running tasks (3560 of 5081)  70%
> > 
> > |########################################################        |
> > 
> > 0: gstreamer1.0-libav-1.8.3-r0 do_compile (pid 17458)
> > Currently  3 running tasks (3601 of 5081)  70%
> > 
> > |########################################################        |
> > 
> > 0: gstreamer1.0-libav-1.8.3-r0 do_compile (pid 17458)
> > 1: gdk-pixbuf-2.34.0-r0 do_package_write_ipk (pid 12673)
> > 2: unifdef-native-2.11-r0 do_populate_lic (pid 24548)
> > 
> > Somehow the task tracker (that does a nice job of telling the user
> > what's going on without being overwhelming BTW) got very confused!
> > 
> > I doubt if I can every repeat this, just passing on the observation!
> > 
> > --
> > ------------------------------------------------------------
> > Gary Thomas                 |  Consulting for the
> > MLB Associates              |    Embedded world
> > ------------------------------------------------------------
> > --
> > _______________________________________________
> > Openembedded-core mailing list
> > Openembedded-core@lists.openembedded.org
> > http://lists.openembedded.org/mailman/listinfo/openembedded-core

-- 

Paul Eggleton
Intel Open Source Technology Centre

Re: Crazy display

[Burton, Ross]

[-- Attachment #1: Type: text/plain, Size: 359 bytes --]

On 15 September 2016 at 21:03, Paul Eggleton <paul.eggleton@linux.intel.com>
wrote:

> Are you guys perhaps using the same terminal application? Using screen /
> tmux
> / anything similar? (I'm using screen here and haven't experienced problems
> though.)
>

I'm using iTerm2 on a Mac to run normal SSH to my Linux box. No
screen/tmux/etc.

Ross

[-- Attachment #2: Type: text/html, Size: 782 bytes --]

Re: Crazy display

[Gary Thomas]

On 2016-09-15 22:12, Burton, Ross wrote:
>
> On 15 September 2016 at 21:03, Paul Eggleton <paul.eggleton@linux.intel.com <mailto:paul.eggleton@linux.intel.com>> wrote:
>
>     Are you guys perhaps using the same terminal application? Using screen / tmux
>     / anything similar? (I'm using screen here and haven't experienced problems
>     though.)
>
>
> I'm using iTerm2 on a Mac to run normal SSH to my Linux box. No screen/tmux/etc.

Pretty much the same for me - just SSH in an xterm window.

-- 
------------------------------------------------------------
Gary Thomas                 |  Consulting for the
MLB Associates              |    Embedded world
------------------------------------------------------------

Re: Crazy display

[Paul Eggleton]

On Thu, 15 Sep 2016 22:26:09 Gary Thomas wrote:
> On 2016-09-15 22:12, Burton, Ross wrote:
> > On 15 September 2016 at 21:03, Paul Eggleton 
<paul.eggleton@linux.intel.com <mailto:paul.eggleton@linux.intel.com>> wrote:
> >     Are you guys perhaps using the same terminal application? Using screen
> >     / tmux / anything similar? (I'm using screen here and haven't
> >     experienced problems though.)
> > 
> > I'm using iTerm2 on a Mac to run normal SSH to my Linux box. No
> > screen/tmux/etc.
>
> Pretty much the same for me - just SSH in an xterm window.

Hmm, I'm still no closer then.

Does it just start happening at some point in the middle of a build? Or right 
from the start?

Cheers,
Paul

-- 

Paul Eggleton
Intel Open Source Technology Centre

Re: Crazy display

[Richard Purdie]

On Thu, 2016-09-15 at 22:26 +0200, Gary Thomas wrote:
> On 2016-09-15 22:12, Burton, Ross wrote:
> > 
> > 
> > On 15 September 2016 at 21:03, Paul Eggleton <paul.eggleton@linux.i
> > ntel.com <mailto:paul.eggleton@linux.intel.com>> wrote:
> > 
> >     Are you guys perhaps using the same terminal application? Using
> > screen / tmux
> >     / anything similar? (I'm using screen here and haven't
> > experienced problems
> >     though.)
> > 
> > 
> > I'm using iTerm2 on a Mac to run normal SSH to my Linux box. No
> > screen/tmux/etc.
> Pretty much the same for me - just SSH in an xterm window.

I've also seen it on a standard linux ssh session to a remote machine,
no screen, no tmux, just ssh from a gnome-terminal window to a remote.
I've not spotted what the pattern is, other than it seems to be
something about the console write timing being off and started around
the time of the progress changes.

Cheers,

Richard

Re: Crazy display

[Richard Purdie]

On Fri, 2016-09-16 at 08:41 +1200, Paul Eggleton wrote:
> On Thu, 15 Sep 2016 22:26:09 Gary Thomas wrote:
> > 
> > On 2016-09-15 22:12, Burton, Ross wrote:
> > > 
> > > On 15 September 2016 at 21:03, Paul Eggleton 
> <paul.eggleton@linux.intel.com <mailto:paul.eggleton@linux.intel.com>
> > wrote:
> > 
> > > 
> > >     Are you guys perhaps using the same terminal application?
> > > Using screen
> > >     / tmux / anything similar? (I'm using screen here and haven't
> > >     experienced problems though.)
> > > 
> > > I'm using iTerm2 on a Mac to run normal SSH to my Linux box. No
> > > screen/tmux/etc.
> > Pretty much the same for me - just SSH in an xterm window.
> Hmm, I'm still no closer then.
> 
> Does it just start happening at some point in the middle of a build?
> Or right 
> from the start?

Seems to happen at various points during the build. Looks like bad
timing of console updates so can happen at any point, I'd see evidence
its happened multiple times in a given build.

Cheers,

Richard

Re: Crazy display

[Paul Eggleton]

On Thu, 15 Sep 2016 22:51:47 Richard Purdie wrote:
> On Fri, 2016-09-16 at 08:41 +1200, Paul Eggleton wrote:
> > On Thu, 15 Sep 2016 22:26:09 Gary Thomas wrote:
> > > On 2016-09-15 22:12, Burton, Ross wrote:
> > > > On 15 September 2016 at 21:03, Paul Eggleton 
> > 
> > <paul.eggleton@linux.intel.com <mailto:paul.eggleton@linux.intel.com>
> > 
> > > wrote:
> > > >     Are you guys perhaps using the same terminal application?
> > > > Using screen
> > > >     / tmux / anything similar? (I'm using screen here and haven't
> > > >     experienced problems though.)
> > > > 
> > > > I'm using iTerm2 on a Mac to run normal SSH to my Linux box. No
> > > > screen/tmux/etc.
> > > 
> > > Pretty much the same for me - just SSH in an xterm window.
> > 
> > Hmm, I'm still no closer then.
> > 
> > Does it just start happening at some point in the middle of a build?
> > Or right 
> > from the start?
> 
> Seems to happen at various points during the build. Looks like bad
> timing of console updates so can happen at any point, I'd see evidence
> its happened multiple times in a given build.

This is bizarre. Clearly something is different between your systems and mine 
:/

Cheers,
Paul

-- 

Paul Eggleton
Intel Open Source Technology Centre

Re: Crazy display

[Gary Thomas]

On 2016-09-16 00:00, Paul Eggleton wrote:
> On Thu, 15 Sep 2016 22:51:47 Richard Purdie wrote:
>> On Fri, 2016-09-16 at 08:41 +1200, Paul Eggleton wrote:
>>> On Thu, 15 Sep 2016 22:26:09 Gary Thomas wrote:
>>>> On 2016-09-15 22:12, Burton, Ross wrote:
>>>>> On 15 September 2016 at 21:03, Paul Eggleton
>>>
>>> <paul.eggleton@linux.intel.com <mailto:paul.eggleton@linux.intel.com>
>>>
>>>> wrote:
>>>>>     Are you guys perhaps using the same terminal application?
>>>>> Using screen
>>>>>     / tmux / anything similar? (I'm using screen here and haven't
>>>>>     experienced problems though.)
>>>>>
>>>>> I'm using iTerm2 on a Mac to run normal SSH to my Linux box. No
>>>>> screen/tmux/etc.
>>>>
>>>> Pretty much the same for me - just SSH in an xterm window.
>>>
>>> Hmm, I'm still no closer then.
>>>
>>> Does it just start happening at some point in the middle of a build?
>>> Or right
>>> from the start?
>>
>> Seems to happen at various points during the build. Looks like bad
>> timing of console updates so can happen at any point, I'd see evidence
>> its happened multiple times in a given build.
>
> This is bizarre. Clearly something is different between your systems and mine
> :/

I've only seen it when my build machine was quite busy (yesterday
when I first noticed, I had three builds going at once)

-- 
------------------------------------------------------------
Gary Thomas                 |  Consulting for the
MLB Associates              |    Embedded world
------------------------------------------------------------

Re: Crazy display

[Mats Karrman]

On 2016-09-16 06:29, Gary Thomas wrote:
> I've only seen it when my build machine was quite busy (yesterday
> when I first noticed, I had three builds going at once)
>
Same for me.
I'm running build in a standard Gnome terminal on Ubuntu and have seen 
it popping up suddenly during a build.
I also have the notion that it happens when the machine is very busy / 
low on memory.
// Mats

Re: Crazy display

[Jonathan Liu]

Hi Gary,

On 15 September 2016 at 21:30, Gary Thomas <gary@mlbassoc.com> wrote:
> I haven't seen this before, just thought I'd toss it out there.
> I was doing a build (actually three in parallel in separate
> windows on my build box) and noticed this:
>
> Currently  3 running tasks (3282 of 5081)  64%
> |###################################################        |
> 0: busybox-1.24.1-r0 do_compile (pid 29425)
> Currently  3 running tasks (3283 of 5081)  64%
> |###################################################        |
> Currently  3 running tasks (3429 of 5081)  67%
> |#####################################################        |
> 0: gstreamer1.0-libav-1.8.3-r0 do_configure (pid 10393)
> Currently  1 running tasks (3560 of 5081)  70%
> |########################################################        |
> 0: gstreamer1.0-libav-1.8.3-r0 do_compile (pid 17458)
> Currently  3 running tasks (3601 of 5081)  70%
> |########################################################        |
> 0: gstreamer1.0-libav-1.8.3-r0 do_compile (pid 17458)
> 1: gdk-pixbuf-2.34.0-r0 do_package_write_ipk (pid 12673)
> 2: unifdef-native-2.11-r0 do_populate_lic (pid 24548)
>
> Somehow the task tracker (that does a nice job of telling the user
> what's going on without being overwhelming BTW) got very confused!
>
> I doubt if I can every repeat this, just passing on the observation!

This seems to be related to
https://bugzilla.yoctoproject.org/show_bug.cgi?id=10024.
I get this issue after it prints "Child process exit status 4:
lock_held" and then that message is overridden by the task status with
the progress bar duplicated down one line.

Regards,
Jonathan

Re: Crazy display

[Richard Purdie]

On Tue, 2016-09-27 at 15:50 +1000, Jonathan Liu wrote:
> Hi Gary,
> 
> On 15 September 2016 at 21:30, Gary Thomas <gary@mlbassoc.com> wrote:
> > 
> > I haven't seen this before, just thought I'd toss it out there.
> > I was doing a build (actually three in parallel in separate
> > windows on my build box) and noticed this:
> > 
> > Currently  3 running tasks (3282 of 5081)  64%
> > > 
> > > ###################################################        |
> > 0: busybox-1.24.1-r0 do_compile (pid 29425)
> > Currently  3 running tasks (3283 of 5081)  64%
> > > 
> > > ###################################################        |
> > Currently  3 running tasks (3429 of 5081)  67%
> > > 
> > > #####################################################        |
> > 0: gstreamer1.0-libav-1.8.3-r0 do_configure (pid 10393)
> > Currently  1 running tasks (3560 of 5081)  70%
> > > 
> > > ########################################################        |
> > 0: gstreamer1.0-libav-1.8.3-r0 do_compile (pid 17458)
> > Currently  3 running tasks (3601 of 5081)  70%
> > > 
> > > ########################################################        |
> > 0: gstreamer1.0-libav-1.8.3-r0 do_compile (pid 17458)
> > 1: gdk-pixbuf-2.34.0-r0 do_package_write_ipk (pid 12673)
> > 2: unifdef-native-2.11-r0 do_populate_lic (pid 24548)
> > 
> > Somehow the task tracker (that does a nice job of telling the user
> > what's going on without being overwhelming BTW) got very confused!
> > 
> > I doubt if I can every repeat this, just passing on the
> > observation!
> This seems to be related to
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=10024.
> I get this issue after it prints "Child process exit status 4:
> lock_held" and then that message is overridden by the task status
> with
> the progress bar duplicated down one line.

Paul did fix some progress bar issues which were one cause of this.
pseudo is another cause and we've not gotten to the bottom of the
pseudo issue :(. It writes to the console unknown to knotty so there
isn't much we can do about it from the bitbake side, it should be a)
making it clear the messages come from psuedo and b) likely going to a
logfile, not the main console.

Cheers,

Richard

Re: Crazy display

[Paul Eggleton]

On Fri, 16 Sep 2016 10:00:12 Paul Eggleton wrote:
> On Thu, 15 Sep 2016 22:51:47 Richard Purdie wrote:
> > On Fri, 2016-09-16 at 08:41 +1200, Paul Eggleton wrote:
> > > On Thu, 15 Sep 2016 22:26:09 Gary Thomas wrote:
> > > > On 2016-09-15 22:12, Burton, Ross wrote:
> > > > > On 15 September 2016 at 21:03, Paul Eggleton
> > > 
> > > <paul.eggleton@linux.intel.com <mailto:paul.eggleton@linux.intel.com>
> > > 
> > > > wrote:
> > > > >     Are you guys perhaps using the same terminal application?
> > > > > 
> > > > > Using screen
> > > > > 
> > > > >     / tmux / anything similar? (I'm using screen here and haven't
> > > > >     experienced problems though.)
> > > > > 
> > > > > I'm using iTerm2 on a Mac to run normal SSH to my Linux box. No
> > > > > screen/tmux/etc.
> > > > 
> > > > Pretty much the same for me - just SSH in an xterm window.
> > > 
> > > Hmm, I'm still no closer then.
> > > 
> > > Does it just start happening at some point in the middle of a build?
> > > Or right
> > > from the start?
> > 
> > Seems to happen at various points during the build. Looks like bad
> > timing of console updates so can happen at any point, I'd see evidence
> > its happened multiple times in a given build.
> 
> This is bizarre. Clearly something is different between your systems and
> mine :/

I just wanted to check particularly with Gary and Ross - since the following
pseudo fix went in, are you still seeing this problem?

 http://cgit.openembedded.org/openembedded-core/commit/?id=efd0b0f604f9f498b9c20bc9a25708c493aa4f4a

Cheers,
Paul

-- 

Paul Eggleton
Intel Open Source Technology Centre

Re: Crazy display

[Stephen Arnold]

I do mostly remote screen sessions (on gentoo host, sometimes
ubuntu/debian vm) and occasional local terminal (xfce term but remote
could be console only).  The fact that I have not seen this once is
just *weird* (and I'm pretty damn good about hitting the annoying
bits).

Steve

On Mon, Oct 3, 2016 at 10:05 AM, Paul Eggleton
<paul.eggleton@linux.intel.com> wrote:
> On Fri, 16 Sep 2016 10:00:12 Paul Eggleton wrote:
>> On Thu, 15 Sep 2016 22:51:47 Richard Purdie wrote:
>> > On Fri, 2016-09-16 at 08:41 +1200, Paul Eggleton wrote:
>> > > On Thu, 15 Sep 2016 22:26:09 Gary Thomas wrote:
>> > > > On 2016-09-15 22:12, Burton, Ross wrote:
>> > > > > On 15 September 2016 at 21:03, Paul Eggleton
>> > >
>> > > <paul.eggleton@linux.intel.com <mailto:paul.eggleton@linux.intel.com>
>> > >
>> > > > wrote:
>> > > > >     Are you guys perhaps using the same terminal application?
>> > > > >
>> > > > > Using screen
>> > > > >
>> > > > >     / tmux / anything similar? (I'm using screen here and haven't
>> > > > >     experienced problems though.)
>> > > > >
>> > > > > I'm using iTerm2 on a Mac to run normal SSH to my Linux box. No
>> > > > > screen/tmux/etc.
>> > > >
>> > > > Pretty much the same for me - just SSH in an xterm window.
>> > >
>> > > Hmm, I'm still no closer then.
>> > >
>> > > Does it just start happening at some point in the middle of a build?
>> > > Or right
>> > > from the start?
>> >
>> > Seems to happen at various points during the build. Looks like bad
>> > timing of console updates so can happen at any point, I'd see evidence
>> > its happened multiple times in a given build.
>>
>> This is bizarre. Clearly something is different between your systems and
>> mine :/
>
> I just wanted to check particularly with Gary and Ross - since the following
> pseudo fix went in, are you still seeing this problem?
>
>  http://cgit.openembedded.org/openembedded-core/commit/?id=efd0b0f604f9f498b9c20bc9a25708c493aa4f4a
>
> Cheers,
> Paul
>
> --
>
> Paul Eggleton
> Intel Open Source Technology Centre
> --
> _______________________________________________
> Openembedded-core mailing list
> Openembedded-core@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-core