Reproducible Builds Issue Status

Reproducible Builds Issue Status

[Richard Purdie]

Good news is we're down to a set of specific issues and those issues
seem "stable". The ones we haven't fixed yet with master-next are:

/srv/autobuilder/autobuilder.yoctoproject.org/pub/repro-fail/oe-reproducible-20200205-rtw2qpgl:
(https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20200205-rtw2qpgl/)
/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/gtk+3-dbg_3.24.13-r0_amd64.deb
/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/gtk+3-src_3.24.13-r0_amd64.deb
/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/libgtk-3.0_3.24.13-r0_amd64.deb
(needs a bug)
/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/libidn2-dev_2.3.0-r0_amd64.deb
(https://bugzilla.yoctoproject.org/show_bug.cgi?id=13771)
/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/ncurses-doc_6.1+20191019-r0_amd64.deb
(needs a bug)
/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/openssl-ptest_1.1.1d-r0_amd64.deb
(https://bugzilla.yoctoproject.org/show_bug.cgi?id=13770)
/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-dbg_5.30.1-r0_amd64.deb
(https://bugzilla.yoctoproject.org/show_bug.cgi?id=13773)
/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-dev_5.30.1-r0_amd64.deb
(https://bugzilla.yoctoproject.org/show_bug.cgi?id=13772)
/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-module-config-heavy_5.30.1-r0_amd64.deb
(https://bugzilla.yoctoproject.org/show_bug.cgi?id=13774)
/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-module-data-dumper_5.30.1-r0_amd64.deb
(unfiled, may be related to above 13772)
/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-ptest_5.30.1-r0_amd64.deb
(unfiled, may be related to above 13772)
/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl_5.30.1-r0_amd64.deb
(unfiled, may be related to above 13772)
/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/tar-dbg_1.32-r0_amd64.deb
/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/tar_1.32-r0_amd64.deb
(needs a bug)

Also:
https://bugzilla.yoctoproject.org/show_bug.cgi?id=13776
(didn't show on this set of builds)

Cheers,

Richard

Re: Reproducible Builds Issue Status

[Alexander Kanavin]

[-- Attachment #1: Type: text/plain, Size: 3429 bytes --]

Good to hear, I am still settling at the new workplace (there's no build
machine yet that I can use, but it's apparently on the way). I'll try to
use the auto builders to look into these issues from home, but can't
promise quick patches.

I think a green a-full looks within reach now!

Alex

On Wed, 5 Feb 2020 at 15:27, Richard Purdie <
richard.purdie@linuxfoundation.org> wrote:

> Good news is we're down to a set of specific issues and those issues
> seem "stable". The ones we haven't fixed yet with master-next are:
>
> /srv/autobuilder/
> autobuilder.yoctoproject.org/pub/repro-fail/oe-reproducible-20200205-rtw2qpgl
> :
> (
> https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20200205-rtw2qpgl/
> )
>
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/gtk+3-dbg_3.24.13-r0_amd64.deb
>
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/gtk+3-src_3.24.13-r0_amd64.deb
>
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/libgtk-3.0_3.24.13-r0_amd64.deb
> (needs a bug)
>
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/libidn2-dev_2.3.0-r0_amd64.deb
> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13771)
>
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/ncurses-doc_6.1+20191019-r0_amd64.deb
> (needs a bug)
>
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/openssl-ptest_1.1.1d-r0_amd64.deb
> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13770)
>
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-dbg_5.30.1-r0_amd64.deb
> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13773)
>
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-dev_5.30.1-r0_amd64.deb
> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13772)
>
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-module-config-heavy_5.30.1-r0_amd64.deb
> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13774)
>
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-module-data-dumper_5.30.1-r0_amd64.deb
> (unfiled, may be related to above 13772)
>
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-ptest_5.30.1-r0_amd64.deb
> (unfiled, may be related to above 13772)
>
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl_5.30.1-r0_amd64.deb
> (unfiled, may be related to above 13772)
>
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/tar-dbg_1.32-r0_amd64.deb
>
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/tar_1.32-r0_amd64.deb
> (needs a bug)
>
> Also:
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13776
> (didn't show on this set of builds)
>
> Cheers,
>
> Richard
>
>

[-- Attachment #2: Type: text/html, Size: 4736 bytes --]

Re: Reproducible Builds Issue Status

[Ross Burton]

On 05/02/2020 14:27, Richard Purdie wrote:
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/gtk+3-dbg_3.24.13-r0_amd64.deb
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/gtk+3-src_3.24.13-r0_amd64.deb
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/libgtk-3.0_3.24.13-r0_amd64.deb

I grabbed the library on the theory that this is just a single probem. 
The issue is that the gresources segment in libgdk.so (files embedded 
inside the binary) had the same files in a different order, so I just 
sent a patch to sort the $(wildcard).  Hopefully that solves the problem.

Ross

Re: Reproducible Builds Issue Status

[Richard Purdie]

On Wed, 2020-02-05 at 14:27 +0000, Richard Purdie wrote:
> Good news is we're down to a set of specific issues and those issues
> seem "stable". The ones we haven't fixed yet with master-next are:
> 
> /srv/autobuilder/autobuilder.yoctoproject.org/pub/repro-fail/oe-reproducible-20200205-rtw2qpgl:
> (https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20200205-rtw2qpgl/)
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/gtk+3-dbg_3.24.13-r0_amd64.deb
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/gtk+3-src_3.24.13-r0_amd64.deb
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/libgtk-3.0_3.24.13-r0_amd64.deb
> (needs a bug)

Ross has a patch for the gtk3 issue (thanks!).

> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/libidn2-dev_2.3.0-r0_amd64.deb
> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13771)

I've sent a patch for libidn2.

> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/ncurses-doc_6.1+20191019-r0_amd64.deb
> (needs a bug)

Still needs a bug, not looked at.

> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/openssl-ptest_1.1.1d-r0_amd64.deb
> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13770)
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-dbg_5.30.1-r0_amd64.deb
> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13773)
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-dev_5.30.1-r0_amd64.deb
> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13772)
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-module-config-heavy_5.30.1-r0_amd64.deb
> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13774)

13772 is looking to be partially a dash vs bash issue.
13774 is partially a sorting issue from perl-cross, I've something
locally I'm experimenting with.

There are multiple perl issues intertwined and I suspect several more
issues to find.

> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-module-data-dumper_5.30.1-r0_amd64.deb
> (unfiled, may be related to above 13772)
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-ptest_5.30.1-r0_amd64.deb
> (unfiled, may be related to above 13772)
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl_5.30.1-r0_amd64.deb
> (unfiled, may be related to above 13772)
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/tar-dbg_1.32-r0_amd64.deb
> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/tar_1.32-r0_amd64.deb
> (needs a bug)

This one is fixed, patch out for review.

> Also:
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13776
> (didn't show on this set of builds)

I looked at and commented on this but don't know how to reproduce.

Cheers,

Richard

Re: Reproducible Builds Issue Status

[Randy MacLeod]

On 2/5/20 2:02 PM, Richard Purdie wrote:
> On Wed, 2020-02-05 at 14:27 +0000, Richard Purdie wrote:
>> Good news is we're down to a set of specific issues and those issues
>> seem "stable". The ones we haven't fixed yet with master-next are:
>>
>> /srv/autobuilder/autobuilder.yoctoproject.org/pub/repro-fail/oe-reproducible-20200205-rtw2qpgl:
>> (https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20200205-rtw2qpgl/)
>> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/gtk+3-dbg_3.24.13-r0_amd64.deb
>> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/gtk+3-src_3.24.13-r0_amd64.deb
>> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/libgtk-3.0_3.24.13-r0_amd64.deb
>> (needs a bug)
> 
> Ross has a patch for the gtk3 issue (thanks!).
> 
>> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/libidn2-dev_2.3.0-r0_amd64.deb
>> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13771)
> 
> I've sent a patch for libidn2.
> 
>> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/ncurses-doc_6.1+20191019-r0_amd64.deb
>> (needs a bug)
> 
> Still needs a bug, not looked at.

Minimal bug report created:
https://bugzilla.yoctoproject.org/show_bug.cgi?id=13781

Richard claimed that the rest are in hand there are
no other defects to file.

../Randy

> 
>> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/openssl-ptest_1.1.1d-r0_amd64.deb
>> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13770)
>> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-dbg_5.30.1-r0_amd64.deb
>> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13773)
>> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-dev_5.30.1-r0_amd64.deb
>> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13772)
>> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-module-config-heavy_5.30.1-r0_amd64.deb
>> (https://bugzilla.yoctoproject.org/show_bug.cgi?id=13774)
> 
> 13772 is looking to be partially a dash vs bash issue.
> 13774 is partially a sorting issue from perl-cross, I've something
> locally I'm experimenting with.
> 
> There are multiple perl issues intertwined and I suspect several more
> issues to find.
> 
>> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-module-data-dumper_5.30.1-r0_amd64.deb
>> (unfiled, may be related to above 13772)
>> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl-ptest_5.30.1-r0_amd64.deb
>> (unfiled, may be related to above 13772)
>> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/perl_5.30.1-r0_amd64.deb
>> (unfiled, may be related to above 13772)
>> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/tar-dbg_1.32-r0_amd64.deb
>> /home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/build-st-25815/reproducibleB/tmp/deploy/deb/./core2-64/tar_1.32-r0_amd64.deb
>> (needs a bug)
> 
> This one is fixed, patch out for review.
> 
>> Also:
>> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13776
>> (didn't show on this set of builds)
> 
> I looked at and commented on this but don't know how to reproduce.
> 
> Cheers,
> 
> Richard
> 
> 


-- 
# Randy MacLeod
# Wind River Linux