Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Jerry Lian]

[-- Attachment #1: Type: text/plain, Size: 382 bytes --]

I am not sure whether it is a bug or an error:
* Quite often, bitbake will fail before finishing, with message like: ...
task failed with exit code 1...
* But if you rerun bitbake, it will continue to build.
* So sometimes I have to rerun many times for finish one build ----
annoying!
(by the way, my CPU can run 16 threads)

Any idea to clear this annoying bug?
thanks.

[-- Attachment #2: Type: text/html, Size: 485 bytes --]

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Nicolas Dechesne]

On Wed, Nov 8, 2017 at 4:49 PM, Jerry Lian <jerry.lian@gmail.com> wrote:
> I am not sure whether it is a bug or an error:
> * Quite often, bitbake will fail before finishing, with message like: ...
> task failed with exit code 1...
> * But if you rerun bitbake, it will continue to build.
> * So sometimes I have to rerun many times for finish one build ----
> annoying!
> (by the way, my CPU can run 16 threads)
>
> Any idea to clear this annoying bug?

it's not a bug. bitbake is using parallel tasks a lot. At any time it
is running N tasks. When one task fails, it will wait for N-1 ongoing
tasks to finish, and then stops.

If you restart again, it will likely try N new tasks again, and the
same task that failed,  will fail again, it will wait for N-1 tasks to
complete.

if you do that several times, you will  end up in a situation where
the only task that can run is the 'failing' one, so it will try 1 task
and fail immediately.

> thanks.
>
> --
> _______________________________________________
> yocto mailing list
> yocto@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/yocto
>

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Eric Schwarz]

Most likely a dependency problem of the package which fails w/ exit code 
1.
Check the dependencies in the recipe and w/ Yocto's bitbake it self.

Cheers
Eric

Am 08.11.2017 16:49, schrieb Jerry Lian:

> I am not sure whether it is a bug or an error: * Quite often, bitbake 
> will fail before finishing, with message like: ... task failed with 
> exit code 1... * But if you rerun bitbake, it will continue to build. * 
> So sometimes I have to rerun many times for finish one build ---- 
> annoying! (by the way, my CPU can run 16 threads)
> 
> Any idea to clear this annoying bug? thanks.

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Nicolas Dechesne]

On Wed, Nov 8, 2017 at 5:13 PM, Jerry Lian <jerry.lian@gmail.com> wrote:
> So according to what you said: the build will fail no matter what.
> But that is not my observation: my build succeed eventually (but you just
> need to rerun many times)!!!

ah. sorry, i missed that part. So then it's probably a bug in the
recipe, missing dependency or something along these lines. It would be
legit to report this bug then.


>
> On Wed, Nov 8, 2017 at 10:53 AM, Nicolas Dechesne
> <nicolas.dechesne@linaro.org> wrote:
>>
>> On Wed, Nov 8, 2017 at 4:49 PM, Jerry Lian <jerry.lian@gmail.com> wrote:
>> > I am not sure whether it is a bug or an error:
>> > * Quite often, bitbake will fail before finishing, with message like:
>> > ...
>> > task failed with exit code 1...
>> > * But if you rerun bitbake, it will continue to build.
>> > * So sometimes I have to rerun many times for finish one build ----
>> > annoying!
>> > (by the way, my CPU can run 16 threads)
>> >
>> > Any idea to clear this annoying bug?
>>
>> it's not a bug. bitbake is using parallel tasks a lot. At any time it
>> is running N tasks. When one task fails, it will wait for N-1 ongoing
>> tasks to finish, and then stops.
>>
>> If you restart again, it will likely try N new tasks again, and the
>> same task that failed,  will fail again, it will wait for N-1 tasks to
>> complete.
>>
>> if you do that several times, you will  end up in a situation where
>> the only task that can run is the 'failing' one, so it will try 1 task
>> and fail immediately.
>>
>> > thanks.
>> >
>> > --
>> > _______________________________________________
>> > yocto mailing list
>> > yocto@yoctoproject.org
>> > https://lists.yoctoproject.org/listinfo/yocto
>> >
>
>

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Jerry Lian]

[-- Attachment #1: Type: text/plain, Size: 2119 bytes --]

I am not talking about my own layer or recipe.
It happens even when I run the demo QEMU/beaglebone builds.
(I just download poky, and make NO modifications)

On Wed, Nov 8, 2017 at 11:15 AM, Nicolas Dechesne <
nicolas.dechesne@linaro.org> wrote:

> On Wed, Nov 8, 2017 at 5:13 PM, Jerry Lian <jerry.lian@gmail.com> wrote:
> > So according to what you said: the build will fail no matter what.
> > But that is not my observation: my build succeed eventually (but you just
> > need to rerun many times)!!!
>
> ah. sorry, i missed that part. So then it's probably a bug in the
> recipe, missing dependency or something along these lines. It would be
> legit to report this bug then.
>
>
> >
> > On Wed, Nov 8, 2017 at 10:53 AM, Nicolas Dechesne
> > <nicolas.dechesne@linaro.org> wrote:
> >>
> >> On Wed, Nov 8, 2017 at 4:49 PM, Jerry Lian <jerry.lian@gmail.com>
> wrote:
> >> > I am not sure whether it is a bug or an error:
> >> > * Quite often, bitbake will fail before finishing, with message like:
> >> > ...
> >> > task failed with exit code 1...
> >> > * But if you rerun bitbake, it will continue to build.
> >> > * So sometimes I have to rerun many times for finish one build ----
> >> > annoying!
> >> > (by the way, my CPU can run 16 threads)
> >> >
> >> > Any idea to clear this annoying bug?
> >>
> >> it's not a bug. bitbake is using parallel tasks a lot. At any time it
> >> is running N tasks. When one task fails, it will wait for N-1 ongoing
> >> tasks to finish, and then stops.
> >>
> >> If you restart again, it will likely try N new tasks again, and the
> >> same task that failed,  will fail again, it will wait for N-1 tasks to
> >> complete.
> >>
> >> if you do that several times, you will  end up in a situation where
> >> the only task that can run is the 'failing' one, so it will try 1 task
> >> and fail immediately.
> >>
> >> > thanks.
> >> >
> >> > --
> >> > _______________________________________________
> >> > yocto mailing list
> >> > yocto@yoctoproject.org
> >> > https://lists.yoctoproject.org/listinfo/yocto
> >> >
> >
> >
>

[-- Attachment #2: Type: text/html, Size: 3185 bytes --]

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Burton, Ross]

[-- Attachment #1: Type: text/plain, Size: 641 bytes --]

On 8 November 2017 at 15:49, Jerry Lian <jerry.lian@gmail.com> wrote:

> I am not sure whether it is a bug or an error:
> * Quite often, bitbake will fail before finishing, with message like: ...
> task failed with exit code 1...
> * But if you rerun bitbake, it will continue to build.
> * So sometimes I have to rerun many times for finish one build ----
> annoying!
> (by the way, my CPU can run 16 threads)
>

If you tell us what recipe is failing, and what the actual error is, then
we may be able to help.  Generally this is a bug in the makefiles that the
recipe is building and not a problem with Yocto itself.

Ross

[-- Attachment #2: Type: text/html, Size: 1045 bytes --]

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Jerry Lian]

[-- Attachment #1: Type: text/plain, Size: 881 bytes --]

I am not talking about my own layer or recipe.
It happens even when I run the demo QEMU/beaglebone builds.
(I just download poky, and make NO modifications)




On Wed, Nov 8, 2017 at 10:56 AM, Eric Schwarz <eas@sw-optimization.com>
wrote:

> Most likely a dependency problem of the package which fails w/ exit code 1.
> Check the dependencies in the recipe and w/ Yocto's bitbake it self.
>
> Cheers
> Eric
>
>
> Am 08.11.2017 16:49, schrieb Jerry Lian:
>
> I am not sure whether it is a bug or an error: * Quite often, bitbake will
>> fail before finishing, with message like: ... task failed with exit code
>> 1... * But if you rerun bitbake, it will continue to build. * So sometimes
>> I have to rerun many times for finish one build ---- annoying! (by the way,
>> my CPU can run 16 threads)
>>
>> Any idea to clear this annoying bug? thanks.
>>
>

[-- Attachment #2: Type: text/html, Size: 1425 bytes --]

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Jerry Lian]

[-- Attachment #1: Type: text/plain, Size: 913 bytes --]

I am not talking about my own layer or recipe.
It happens even when I run the demo QEMU/beaglebone builds.
(I just download poky, and make NO modifications)




On Wed, Nov 8, 2017 at 11:21 AM, Burton, Ross <ross.burton@intel.com> wrote:

> On 8 November 2017 at 15:49, Jerry Lian <jerry.lian@gmail.com> wrote:
>
>> I am not sure whether it is a bug or an error:
>> * Quite often, bitbake will fail before finishing, with message like: ...
>> task failed with exit code 1...
>> * But if you rerun bitbake, it will continue to build.
>> * So sometimes I have to rerun many times for finish one build ----
>> annoying!
>> (by the way, my CPU can run 16 threads)
>>
>
> If you tell us what recipe is failing, and what the actual error is, then
> we may be able to help.  Generally this is a bug in the makefiles that the
> recipe is building and not a problem with Yocto itself.
>
> Ross
>

[-- Attachment #2: Type: text/html, Size: 1711 bytes --]

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Burton, Ross]

[-- Attachment #1: Type: text/plain, Size: 1289 bytes --]

The autobuilder does about 50 builds a night using pure poky and we don't
see this, so again: what recipe and what errors?

Ross

On 8 November 2017 at 16:22, Jerry Lian <jerry.lian@gmail.com> wrote:

> I am not talking about my own layer or recipe.
> It happens even when I run the demo QEMU/beaglebone builds.
> (I just download poky, and make NO modifications)
>
>
>
>
> On Wed, Nov 8, 2017 at 10:56 AM, Eric Schwarz <eas@sw-optimization.com>
> wrote:
>
>> Most likely a dependency problem of the package which fails w/ exit code
>> 1.
>> Check the dependencies in the recipe and w/ Yocto's bitbake it self.
>>
>> Cheers
>> Eric
>>
>>
>> Am 08.11.2017 16:49, schrieb Jerry Lian:
>>
>> I am not sure whether it is a bug or an error: * Quite often, bitbake
>>> will fail before finishing, with message like: ... task failed with exit
>>> code 1... * But if you rerun bitbake, it will continue to build. * So
>>> sometimes I have to rerun many times for finish one build ---- annoying!
>>> (by the way, my CPU can run 16 threads)
>>>
>>> Any idea to clear this annoying bug? thanks.
>>>
>>
>
> --
> _______________________________________________
> yocto mailing list
> yocto@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/yocto
>
>

[-- Attachment #2: Type: text/html, Size: 2413 bytes --]

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Jerry Lian]

[-- Attachment #1: Type: text/plain, Size: 1731 bytes --]

So that is further tricky part:
* it may fail when finishing 20%, 40% 60%, 80%
* And the failure last time may not appear next time.
* So it just pop-up randomly

(By the way, I just build brand new PC with 16 threads CPU, 32G memory, and
install Ubuntu 16.4.3 with ESXI-6.5)
(so really confused)



On Wed, Nov 8, 2017 at 11:24 AM, Burton, Ross <ross.burton@intel.com> wrote:

> The autobuilder does about 50 builds a night using pure poky and we don't
> see this, so again: what recipe and what errors?
>
> Ross
>
> On 8 November 2017 at 16:22, Jerry Lian <jerry.lian@gmail.com> wrote:
>
>> I am not talking about my own layer or recipe.
>> It happens even when I run the demo QEMU/beaglebone builds.
>> (I just download poky, and make NO modifications)
>>
>>
>>
>>
>> On Wed, Nov 8, 2017 at 10:56 AM, Eric Schwarz <eas@sw-optimization.com>
>> wrote:
>>
>>> Most likely a dependency problem of the package which fails w/ exit code
>>> 1.
>>> Check the dependencies in the recipe and w/ Yocto's bitbake it self.
>>>
>>> Cheers
>>> Eric
>>>
>>>
>>> Am 08.11.2017 16:49, schrieb Jerry Lian:
>>>
>>> I am not sure whether it is a bug or an error: * Quite often, bitbake
>>>> will fail before finishing, with message like: ... task failed with exit
>>>> code 1... * But if you rerun bitbake, it will continue to build. * So
>>>> sometimes I have to rerun many times for finish one build ---- annoying!
>>>> (by the way, my CPU can run 16 threads)
>>>>
>>>> Any idea to clear this annoying bug? thanks.
>>>>
>>>
>>
>> --
>> _______________________________________________
>> yocto mailing list
>> yocto@yoctoproject.org
>> https://lists.yoctoproject.org/listinfo/yocto
>>
>>
>

[-- Attachment #2: Type: text/html, Size: 3662 bytes --]

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Burton, Ross]

[-- Attachment #1: Type: text/plain, Size: 2029 bytes --]

Well next time it happens feel free to reply to this thread. Otherwise
you're asking us "fix my problem" without saying what the problem is.

Ross

On 8 November 2017 at 16:31, Jerry Lian <jerry.lian@gmail.com> wrote:

> So that is further tricky part:
> * it may fail when finishing 20%, 40% 60%, 80%
> * And the failure last time may not appear next time.
> * So it just pop-up randomly
>
> (By the way, I just build brand new PC with 16 threads CPU, 32G memory,
> and install Ubuntu 16.4.3 with ESXI-6.5)
> (so really confused)
>
>
>
> On Wed, Nov 8, 2017 at 11:24 AM, Burton, Ross <ross.burton@intel.com>
> wrote:
>
>> The autobuilder does about 50 builds a night using pure poky and we don't
>> see this, so again: what recipe and what errors?
>>
>> Ross
>>
>> On 8 November 2017 at 16:22, Jerry Lian <jerry.lian@gmail.com> wrote:
>>
>>> I am not talking about my own layer or recipe.
>>> It happens even when I run the demo QEMU/beaglebone builds.
>>> (I just download poky, and make NO modifications)
>>>
>>>
>>>
>>>
>>> On Wed, Nov 8, 2017 at 10:56 AM, Eric Schwarz <eas@sw-optimization.com>
>>> wrote:
>>>
>>>> Most likely a dependency problem of the package which fails w/ exit
>>>> code 1.
>>>> Check the dependencies in the recipe and w/ Yocto's bitbake it self.
>>>>
>>>> Cheers
>>>> Eric
>>>>
>>>>
>>>> Am 08.11.2017 16:49, schrieb Jerry Lian:
>>>>
>>>> I am not sure whether it is a bug or an error: * Quite often, bitbake
>>>>> will fail before finishing, with message like: ... task failed with exit
>>>>> code 1... * But if you rerun bitbake, it will continue to build. * So
>>>>> sometimes I have to rerun many times for finish one build ---- annoying!
>>>>> (by the way, my CPU can run 16 threads)
>>>>>
>>>>> Any idea to clear this annoying bug? thanks.
>>>>>
>>>>
>>>
>>> --
>>> _______________________________________________
>>> yocto mailing list
>>> yocto@yoctoproject.org
>>> https://lists.yoctoproject.org/listinfo/yocto
>>>
>>>
>>
>

[-- Attachment #2: Type: text/html, Size: 4599 bytes --]

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Jerry Lian]

[-- Attachment #1: Type: text/plain, Size: 2306 bytes --]

Isn't my problem clear: the failure pop-up randomly!
Do you mean the random failure also help you for debugging?




On Wed, Nov 8, 2017 at 11:33 AM, Burton, Ross <ross.burton@intel.com> wrote:

> Well next time it happens feel free to reply to this thread. Otherwise
> you're asking us "fix my problem" without saying what the problem is.
>
> Ross
>
> On 8 November 2017 at 16:31, Jerry Lian <jerry.lian@gmail.com> wrote:
>
>> So that is further tricky part:
>> * it may fail when finishing 20%, 40% 60%, 80%
>> * And the failure last time may not appear next time.
>> * So it just pop-up randomly
>>
>> (By the way, I just build brand new PC with 16 threads CPU, 32G memory,
>> and install Ubuntu 16.4.3 with ESXI-6.5)
>> (so really confused)
>>
>>
>>
>> On Wed, Nov 8, 2017 at 11:24 AM, Burton, Ross <ross.burton@intel.com>
>> wrote:
>>
>>> The autobuilder does about 50 builds a night using pure poky and we
>>> don't see this, so again: what recipe and what errors?
>>>
>>> Ross
>>>
>>> On 8 November 2017 at 16:22, Jerry Lian <jerry.lian@gmail.com> wrote:
>>>
>>>> I am not talking about my own layer or recipe.
>>>> It happens even when I run the demo QEMU/beaglebone builds.
>>>> (I just download poky, and make NO modifications)
>>>>
>>>>
>>>>
>>>>
>>>> On Wed, Nov 8, 2017 at 10:56 AM, Eric Schwarz <eas@sw-optimization.com>
>>>> wrote:
>>>>
>>>>> Most likely a dependency problem of the package which fails w/ exit
>>>>> code 1.
>>>>> Check the dependencies in the recipe and w/ Yocto's bitbake it self.
>>>>>
>>>>> Cheers
>>>>> Eric
>>>>>
>>>>>
>>>>> Am 08.11.2017 16:49, schrieb Jerry Lian:
>>>>>
>>>>> I am not sure whether it is a bug or an error: * Quite often, bitbake
>>>>>> will fail before finishing, with message like: ... task failed with exit
>>>>>> code 1... * But if you rerun bitbake, it will continue to build. * So
>>>>>> sometimes I have to rerun many times for finish one build ---- annoying!
>>>>>> (by the way, my CPU can run 16 threads)
>>>>>>
>>>>>> Any idea to clear this annoying bug? thanks.
>>>>>>
>>>>>
>>>>
>>>> --
>>>> _______________________________________________
>>>> yocto mailing list
>>>> yocto@yoctoproject.org
>>>> https://lists.yoctoproject.org/listinfo/yocto
>>>>
>>>>
>>>
>>
>

[-- Attachment #2: Type: text/html, Size: 5544 bytes --]

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Burton, Ross]

[-- Attachment #1: Type: text/plain, Size: 2617 bytes --]

The failure doesn't happen for anyone else.  You're literally saying "it
breaks" but not even saying what "it" is, or how "it" is breaking.

Ross

On 8 November 2017 at 16:38, Jerry Lian <jerry.lian@gmail.com> wrote:

> Isn't my problem clear: the failure pop-up randomly!
> Do you mean the random failure also help you for debugging?
>
>
>
>
> On Wed, Nov 8, 2017 at 11:33 AM, Burton, Ross <ross.burton@intel.com>
> wrote:
>
>> Well next time it happens feel free to reply to this thread. Otherwise
>> you're asking us "fix my problem" without saying what the problem is.
>>
>> Ross
>>
>> On 8 November 2017 at 16:31, Jerry Lian <jerry.lian@gmail.com> wrote:
>>
>>> So that is further tricky part:
>>> * it may fail when finishing 20%, 40% 60%, 80%
>>> * And the failure last time may not appear next time.
>>> * So it just pop-up randomly
>>>
>>> (By the way, I just build brand new PC with 16 threads CPU, 32G memory,
>>> and install Ubuntu 16.4.3 with ESXI-6.5)
>>> (so really confused)
>>>
>>>
>>>
>>> On Wed, Nov 8, 2017 at 11:24 AM, Burton, Ross <ross.burton@intel.com>
>>> wrote:
>>>
>>>> The autobuilder does about 50 builds a night using pure poky and we
>>>> don't see this, so again: what recipe and what errors?
>>>>
>>>> Ross
>>>>
>>>> On 8 November 2017 at 16:22, Jerry Lian <jerry.lian@gmail.com> wrote:
>>>>
>>>>> I am not talking about my own layer or recipe.
>>>>> It happens even when I run the demo QEMU/beaglebone builds.
>>>>> (I just download poky, and make NO modifications)
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Wed, Nov 8, 2017 at 10:56 AM, Eric Schwarz <eas@sw-optimization.com
>>>>> > wrote:
>>>>>
>>>>>> Most likely a dependency problem of the package which fails w/ exit
>>>>>> code 1.
>>>>>> Check the dependencies in the recipe and w/ Yocto's bitbake it self.
>>>>>>
>>>>>> Cheers
>>>>>> Eric
>>>>>>
>>>>>>
>>>>>> Am 08.11.2017 16:49, schrieb Jerry Lian:
>>>>>>
>>>>>> I am not sure whether it is a bug or an error: * Quite often, bitbake
>>>>>>> will fail before finishing, with message like: ... task failed with exit
>>>>>>> code 1... * But if you rerun bitbake, it will continue to build. * So
>>>>>>> sometimes I have to rerun many times for finish one build ---- annoying!
>>>>>>> (by the way, my CPU can run 16 threads)
>>>>>>>
>>>>>>> Any idea to clear this annoying bug? thanks.
>>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>> _______________________________________________
>>>>> yocto mailing list
>>>>> yocto@yoctoproject.org
>>>>> https://lists.yoctoproject.org/listinfo/yocto
>>>>>
>>>>>
>>>>
>>>
>>
>

[-- Attachment #2: Type: text/html, Size: 6586 bytes --]

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Ayoub Zaki]

Hi,

On 08.11.2017 17:33, Burton, Ross wrote:
> Well next time it happens feel free to reply to this thread. Otherwise 
> you're asking us "fix my problem" without saying what the problem is.
>
> Ross
>
> On 8 November 2017 at 16:31, Jerry Lian <jerry.lian@gmail.com 
> <mailto:jerry.lian@gmail.com>> wrote:
>
>     So that is further tricky part:
>     * it may fail when finishing 20%, 40% 60%, 80%
>     * And the failure last time may not appear next time.
>     * So it just pop-up randomly
>
>     (By the way, I just build brand new PC with 16 threads CPU, 32G
>     memory, and install Ubuntu 16.4.3 with ESXI-6.5)
>

Do you have a Ryzen 7 based CPU ?!

In this case Ubuntu 16.4 with Linux kernel 4.4.x is know to be broken
You should upgrade your System with a recent kernel !!!


>     (so really confused)
>
>
>
>     On Wed, Nov 8, 2017 at 11:24 AM, Burton, Ross
>     <ross.burton@intel.com <mailto:ross.burton@intel.com>> wrote:
>
>         The autobuilder does about 50 builds a night using pure poky
>         and we don't see this, so again: what recipe and what errors?
>
>         Ross
>
>         On 8 November 2017 at 16:22, Jerry Lian <jerry.lian@gmail.com
>         <mailto:jerry.lian@gmail.com>> wrote:
>
>             I am not talking about my own layer or recipe.
>             It happens even when I run the demo QEMU/beaglebone builds.
>             (I just download poky, and make NO modifications)
>
>
>
>
>             On Wed, Nov 8, 2017 at 10:56 AM, Eric Schwarz
>             <eas@sw-optimization.com <mailto:eas@sw-optimization.com>>
>             wrote:
>
>                 Most likely a dependency problem of the package which
>                 fails w/ exit code 1.
>                 Check the dependencies in the recipe and w/ Yocto's
>                 bitbake it self.
>
>                 Cheers
>                 Eric
>
>
>                 Am 08.11.2017 16:49, schrieb Jerry Lian:
>
>                     I am not sure whether it is a bug or an error: *
>                     Quite often, bitbake will fail before finishing,
>                     with message like: ... task failed with exit code
>                     1... * But if you rerun bitbake, it will continue
>                     to build. * So sometimes I have to rerun many
>                     times for finish one build ---- annoying! (by the
>                     way, my CPU can run 16 threads)
>
>                     Any idea to clear this annoying bug? thanks.
>
>
>
>             --
>             _______________________________________________
>             yocto mailing list
>             yocto@yoctoproject.org <mailto:yocto@yoctoproject.org>
>             https://lists.yoctoproject.org/listinfo/yocto
>             <https://lists.yoctoproject.org/listinfo/yocto>
>
>
>
>
>
>

-- 
Ayoub Zaki
Embedded Systems Consultant

Vaihinger Straße 2/1
D-71634 Ludwigsburg

Tel.     : +4971415074546
Mobile   : +4917662901545
Email    : ayoub.zaki@embexus.com
Homepage : https://embexus.com
VAT No.  : DE313902634

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Burton, Ross]

[-- Attachment #1: Type: text/plain, Size: 588 bytes --]

On 8 November 2017 at 16:41, Ayoub Zaki <ayoub.zaki@embexus.com> wrote:

>     (By the way, I just build brand new PC with 16 threads CPU, 32G
>
>>     memory, and install Ubuntu 16.4.3 with ESXI-6.5)
>>
>>
> Do you have a Ryzen 7 based CPU ?!
>
> In this case Ubuntu 16.4 with Linux kernel 4.4.x is know to be broken
> You should upgrade your System with a recent kernel !!!
>

Following up, it's possible that this brand new PC has a cooling problem
and is overheating during the build, or the memory isn't installed
correctly.  This will cause random failures.

Ross

[-- Attachment #2: Type: text/html, Size: 1081 bytes --]

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Jerry Lian]

[-- Attachment #1: Type: text/plain, Size: 2832 bytes --]

Really, only me got this problem?




On Wed, Nov 8, 2017 at 11:40 AM, Burton, Ross <ross.burton@intel.com> wrote:

> The failure doesn't happen for anyone else.  You're literally saying "it
> breaks" but not even saying what "it" is, or how "it" is breaking.
>
> Ross
>
> On 8 November 2017 at 16:38, Jerry Lian <jerry.lian@gmail.com> wrote:
>
>> Isn't my problem clear: the failure pop-up randomly!
>> Do you mean the random failure also help you for debugging?
>>
>>
>>
>>
>> On Wed, Nov 8, 2017 at 11:33 AM, Burton, Ross <ross.burton@intel.com>
>> wrote:
>>
>>> Well next time it happens feel free to reply to this thread. Otherwise
>>> you're asking us "fix my problem" without saying what the problem is.
>>>
>>> Ross
>>>
>>> On 8 November 2017 at 16:31, Jerry Lian <jerry.lian@gmail.com> wrote:
>>>
>>>> So that is further tricky part:
>>>> * it may fail when finishing 20%, 40% 60%, 80%
>>>> * And the failure last time may not appear next time.
>>>> * So it just pop-up randomly
>>>>
>>>> (By the way, I just build brand new PC with 16 threads CPU, 32G memory,
>>>> and install Ubuntu 16.4.3 with ESXI-6.5)
>>>> (so really confused)
>>>>
>>>>
>>>>
>>>> On Wed, Nov 8, 2017 at 11:24 AM, Burton, Ross <ross.burton@intel.com>
>>>> wrote:
>>>>
>>>>> The autobuilder does about 50 builds a night using pure poky and we
>>>>> don't see this, so again: what recipe and what errors?
>>>>>
>>>>> Ross
>>>>>
>>>>> On 8 November 2017 at 16:22, Jerry Lian <jerry.lian@gmail.com> wrote:
>>>>>
>>>>>> I am not talking about my own layer or recipe.
>>>>>> It happens even when I run the demo QEMU/beaglebone builds.
>>>>>> (I just download poky, and make NO modifications)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Wed, Nov 8, 2017 at 10:56 AM, Eric Schwarz <
>>>>>> eas@sw-optimization.com> wrote:
>>>>>>
>>>>>>> Most likely a dependency problem of the package which fails w/ exit
>>>>>>> code 1.
>>>>>>> Check the dependencies in the recipe and w/ Yocto's bitbake it self.
>>>>>>>
>>>>>>> Cheers
>>>>>>> Eric
>>>>>>>
>>>>>>>
>>>>>>> Am 08.11.2017 16:49, schrieb Jerry Lian:
>>>>>>>
>>>>>>> I am not sure whether it is a bug or an error: * Quite often,
>>>>>>>> bitbake will fail before finishing, with message like: ... task failed with
>>>>>>>> exit code 1... * But if you rerun bitbake, it will continue to build. * So
>>>>>>>> sometimes I have to rerun many times for finish one build ---- annoying!
>>>>>>>> (by the way, my CPU can run 16 threads)
>>>>>>>>
>>>>>>>> Any idea to clear this annoying bug? thanks.
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> _______________________________________________
>>>>>> yocto mailing list
>>>>>> yocto@yoctoproject.org
>>>>>> https://lists.yoctoproject.org/listinfo/yocto
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>

[-- Attachment #2: Type: text/html, Size: 7578 bytes --]

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Ayoub Zaki]

On 08.11.2017 17:47, Burton, Ross wrote:
> On 8 November 2017 at 16:41, Ayoub Zaki <ayoub.zaki@embexus.com 
> <mailto:ayoub.zaki@embexus.com>> wrote:
>
>         (By the way, I just build brand new PC with 16 threads CPU, 32G
>
>             memory, and install Ubuntu 16.4.3 with ESXI-6.5)
>
>
>     Do you have a Ryzen 7 based CPU ?!
>
>     In this case Ubuntu 16.4 with Linux kernel 4.4.x is know to be broken
>     You should upgrade your System with a recent kernel !!!
>
>
> Following up, it's possible that this brand new PC has a cooling 
> problem and is overheating during the build, or the memory isn't 
> installed correctly.  This will cause random failures.

[1] 
https://www.pcworld.com/article/3176323/linux/kernel-410-gives-linux-support-for-zen-multithreading.html
>
> Ross

-- 
Ayoub Zaki
Embedded Systems Consultant

Vaihinger Straße 2/1
D-71634 Ludwigsburg

Tel.     : +4971415074546
Mobile   : +4917662901545
Email    : ayoub.zaki@embexus.com
Homepage : https://embexus.com
VAT No.  : DE313902634

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Ayoub Zaki]

On 08.11.2017 17:47, Jerry Lian wrote:
> Really, only me got this problem?
>
Probably it's just you did forgot to update your system to fix known SMT 
Problems ...

>
>
>
> On Wed, Nov 8, 2017 at 11:40 AM, Burton, Ross <ross.burton@intel.com 
> <mailto:ross.burton@intel.com>> wrote:
>
>     The failure doesn't happen for anyone else. You're literally
>     saying "it breaks" but not even saying what "it" is, or how "it"
>     is breaking.
>
>     Ross
>
>     On 8 November 2017 at 16:38, Jerry Lian <jerry.lian@gmail.com
>     <mailto:jerry.lian@gmail.com>> wrote:
>
>         Isn't my problem clear: the failure pop-up randomly!
>         Do you mean the random failure also help you for debugging?
>
>
>
>
>         On Wed, Nov 8, 2017 at 11:33 AM, Burton, Ross
>         <ross.burton@intel.com <mailto:ross.burton@intel.com>> wrote:
>
>             Well next time it happens feel free to reply to this
>             thread. Otherwise you're asking us "fix my problem"
>             without saying what the problem is.
>
>             Ross
>
>             On 8 November 2017 at 16:31, Jerry Lian
>             <jerry.lian@gmail.com <mailto:jerry.lian@gmail.com>> wrote:
>
>                 So that is further tricky part:
>                 * it may fail when finishing 20%, 40% 60%, 80%
>                 * And the failure last time may not appear next time.
>                 * So it just pop-up randomly
>
>                 (By the way, I just build brand new PC with 16 threads
>                 CPU, 32G memory, and install Ubuntu 16.4.3 with ESXI-6.5)
>                 (so really confused)
>
>
>
>                 On Wed, Nov 8, 2017 at 11:24 AM, Burton, Ross
>                 <ross.burton@intel.com <mailto:ross.burton@intel.com>>
>                 wrote:
>
>                     The autobuilder does about 50 builds a night using
>                     pure poky and we don't see this, so again: what
>                     recipe and what errors?
>
>                     Ross
>
>                     On 8 November 2017 at 16:22, Jerry Lian
>                     <jerry.lian@gmail.com
>                     <mailto:jerry.lian@gmail.com>> wrote:
>
>                         I am not talking about my own layer or recipe.
>                         It happens even when I run the demo
>                         QEMU/beaglebone builds.
>                         (I just download poky, and make NO modifications)
>
>
>
>
>                         On Wed, Nov 8, 2017 at 10:56 AM, Eric Schwarz
>                         <eas@sw-optimization.com
>                         <mailto:eas@sw-optimization.com>> wrote:
>
>                             Most likely a dependency problem of the
>                             package which fails w/ exit code 1.
>                             Check the dependencies in the recipe and
>                             w/ Yocto's bitbake it self.
>
>                             Cheers
>                             Eric
>
>
>                             Am 08.11.2017 16:49, schrieb Jerry Lian:
>
>                                 I am not sure whether it is a bug or
>                                 an error: * Quite often, bitbake will
>                                 fail before finishing, with message
>                                 like: ... task failed with exit code
>                                 1... * But if you rerun bitbake, it
>                                 will continue to build. * So sometimes
>                                 I have to rerun many times for finish
>                                 one build ---- annoying! (by the way,
>                                 my CPU can run 16 threads)
>
>                                 Any idea to clear this annoying bug?
>                                 thanks.
>
>
>
>                         --
>                         _______________________________________________
>                         yocto mailing list
>                         yocto@yoctoproject.org
>                         <mailto:yocto@yoctoproject.org>
>                         https://lists.yoctoproject.org/listinfo/yocto
>                         <https://lists.yoctoproject.org/listinfo/yocto>
>
>
>
>
>
>
>
>
>

-- 
Ayoub Zaki
Embedded Systems Consultant

Vaihinger Straße 2/1
D-71634 Ludwigsburg

Tel.     : +4971415074546
Mobile   : +4917662901545
Email    : ayoub.zaki@embexus.com
Homepage : https://embexus.com
VAT No.  : DE313902634

Re: Annoying "rerun to fix" bug for bitbake: task failed, but rerun can fix it.

[Jerry Lian]

[-- Attachment #1: Type: text/plain, Size: 3112 bytes --]

So bad: I do use Ryzen-7!
I will try new kernel, how about Ubuntu-17? or should be latest Debian?

On Wed, Nov 8, 2017 at 11:47 AM, Jerry Lian <jerry.lian@gmail.com> wrote:

> Really, only me got this problem?
>
>
>
>
> On Wed, Nov 8, 2017 at 11:40 AM, Burton, Ross <ross.burton@intel.com>
> wrote:
>
>> The failure doesn't happen for anyone else.  You're literally saying "it
>> breaks" but not even saying what "it" is, or how "it" is breaking.
>>
>> Ross
>>
>> On 8 November 2017 at 16:38, Jerry Lian <jerry.lian@gmail.com> wrote:
>>
>>> Isn't my problem clear: the failure pop-up randomly!
>>> Do you mean the random failure also help you for debugging?
>>>
>>>
>>>
>>>
>>> On Wed, Nov 8, 2017 at 11:33 AM, Burton, Ross <ross.burton@intel.com>
>>> wrote:
>>>
>>>> Well next time it happens feel free to reply to this thread. Otherwise
>>>> you're asking us "fix my problem" without saying what the problem is.
>>>>
>>>> Ross
>>>>
>>>> On 8 November 2017 at 16:31, Jerry Lian <jerry.lian@gmail.com> wrote:
>>>>
>>>>> So that is further tricky part:
>>>>> * it may fail when finishing 20%, 40% 60%, 80%
>>>>> * And the failure last time may not appear next time.
>>>>> * So it just pop-up randomly
>>>>>
>>>>> (By the way, I just build brand new PC with 16 threads CPU, 32G
>>>>> memory, and install Ubuntu 16.4.3 with ESXI-6.5)
>>>>> (so really confused)
>>>>>
>>>>>
>>>>>
>>>>> On Wed, Nov 8, 2017 at 11:24 AM, Burton, Ross <ross.burton@intel.com>
>>>>> wrote:
>>>>>
>>>>>> The autobuilder does about 50 builds a night using pure poky and we
>>>>>> don't see this, so again: what recipe and what errors?
>>>>>>
>>>>>> Ross
>>>>>>
>>>>>> On 8 November 2017 at 16:22, Jerry Lian <jerry.lian@gmail.com> wrote:
>>>>>>
>>>>>>> I am not talking about my own layer or recipe.
>>>>>>> It happens even when I run the demo QEMU/beaglebone builds.
>>>>>>> (I just download poky, and make NO modifications)
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Wed, Nov 8, 2017 at 10:56 AM, Eric Schwarz <
>>>>>>> eas@sw-optimization.com> wrote:
>>>>>>>
>>>>>>>> Most likely a dependency problem of the package which fails w/ exit
>>>>>>>> code 1.
>>>>>>>> Check the dependencies in the recipe and w/ Yocto's bitbake it self.
>>>>>>>>
>>>>>>>> Cheers
>>>>>>>> Eric
>>>>>>>>
>>>>>>>>
>>>>>>>> Am 08.11.2017 16:49, schrieb Jerry Lian:
>>>>>>>>
>>>>>>>> I am not sure whether it is a bug or an error: * Quite often,
>>>>>>>>> bitbake will fail before finishing, with message like: ... task failed with
>>>>>>>>> exit code 1... * But if you rerun bitbake, it will continue to build. * So
>>>>>>>>> sometimes I have to rerun many times for finish one build ---- annoying!
>>>>>>>>> (by the way, my CPU can run 16 threads)
>>>>>>>>>
>>>>>>>>> Any idea to clear this annoying bug? thanks.
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> _______________________________________________
>>>>>>> yocto mailing list
>>>>>>> yocto@yoctoproject.org
>>>>>>> https://lists.yoctoproject.org/listinfo/yocto
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>

[-- Attachment #2: Type: text/html, Size: 8617 bytes --]