[PATCH] oeqa/selftest/reproducibile: Include rust packages

[PATCH] oeqa/selftest/reproducibile: Include rust packages

[Pgowda]

rust-llvm-liblto and rust-llvm-staticdev have been tested and generates
same ipk, rpm and deb files for reproducibleA and reproducibleB in
debain environment.

Signed-off-by: Pgowda <pgowda.cve@gmail.com>
---
 meta/lib/oeqa/selftest/cases/reproducible.py | 4 ----
 1 file changed, 4 deletions(-)

diff --git a/meta/lib/oeqa/selftest/cases/reproducible.py b/meta/lib/oeqa/selftest/cases/reproducible.py
index e4582cb82a..a147e933cc 100644
--- a/meta/lib/oeqa/selftest/cases/reproducible.py
+++ b/meta/lib/oeqa/selftest/cases/reproducible.py
@@ -27,8 +27,6 @@ import datetime
 
 # ruby-ri-docs, meson:
 #https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20210215-0_td9la2/packages/diff-html/
-# rust-llvm:
-#https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20210825-kaihham6/
 exclude_packages = [
 	'glide',
 	'go-helloworld',
@@ -36,8 +34,6 @@ exclude_packages = [
 	'go_',
 	'go-',
 	'ruby-ri-docs',
-	'rust-llvm-liblto',
-	'rust-llvm-staticdev'
 	]
 
 def is_excluded(package):
-- 
2.31.1

Re: [PATCH] oeqa/selftest/reproducibile: Include rust packages

[Richard Purdie]

On Fri, 2021-10-08 at 01:37 -0700, Pgowda wrote:
> rust-llvm-liblto and rust-llvm-staticdev have been tested and generates
> same ipk, rpm and deb files for reproducibleA and reproducibleB in
> debain environment.
> 
> Signed-off-by: Pgowda <pgowda.cve@gmail.com>
> ---
>  meta/lib/oeqa/selftest/cases/reproducible.py | 4 ----
>  1 file changed, 4 deletions(-)
> 
> diff --git a/meta/lib/oeqa/selftest/cases/reproducible.py b/meta/lib/oeqa/selftest/cases/reproducible.py
> index e4582cb82a..a147e933cc 100644
> --- a/meta/lib/oeqa/selftest/cases/reproducible.py
> +++ b/meta/lib/oeqa/selftest/cases/reproducible.py
> @@ -27,8 +27,6 @@ import datetime
>  
>  # ruby-ri-docs, meson:
>  #https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20210215-0_td9la2/packages/diff-html/
> -# rust-llvm:
> -#https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20210825-kaihham6/
>  exclude_packages = [
>  	'glide',
>  	'go-helloworld',
> @@ -36,8 +34,6 @@ exclude_packages = [
>  	'go_',
>  	'go-',
>  	'ruby-ri-docs',
> -	'rust-llvm-liblto',
> -	'rust-llvm-staticdev'
>  	]
>  
>  def is_excluded(package):

Not sure how you checked this but here is a build where they were not:

https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/764

Note the lines:


2021-10-08 04:36:27,176 - oe-selftest - INFO - Reproducibility summary for rpm: same=8819 different=0 different_excluded=11 missing=0 total=8830
unused_exclusions=['go-runtime', 'go_', 'ruby-ri-docs']

i.e. it used the rust exclusions.

Cheers,

Richard

Re: [PATCH] oeqa/selftest/reproducibile: Include rust packages

[pgowda cve]

Hi Richard,

>> https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/764

Thanks very much for sharing your inputs and comments on the issue.

I could see some more builds where rust exclusions were unused:-
Some of the example builds are:-
https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/757
https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/755
https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/751

Can you please let me know about this inconsistent behavior?
I will try to check the issue based on your inputs.

I tried to build the reproducible with and without rust exclusions on
many poky sources.
Could not see this error on any sources ranging over the past two months.
More details on the issue are shared at:-
https://bugzilla.yoctoproject.org/show_bug.cgi?id=14525

Thanks,
pgowda

Re: [PATCH] oeqa/selftest/reproducibile: Include rust packages

[Richard Purdie]

On Fri, 2021-10-08 at 17:29 +0530, pgowda cve wrote:
> Hi Richard,
> 
> > > https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/764
> 
> Thanks very much for sharing your inputs and comments on the issue.
> 
> I could see some more builds where rust exclusions were unused:-
> Some of the example builds are:-
> https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/757
> https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/755
> https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/751
> 
> Can you please let me know about this inconsistent behavior?

The reproducible test runs on different hosts and has two builds it compares.
The first build can come from sstate. The second build is built on the specific
worker the builds runs on.

We can see from my link above that the build that shows reproducibility issues
ran on fedora33 so it is probably something specific to that distro.

The most likely way to reproduce the issue is therefore to build on something
like an ubuntu system and compare the packages with those built on a fedora33
system.

> I will try to check the issue based on your inputs.
> 
> I tried to build the reproducible with and without rust exclusions on
> many poky sources.
> Could not see this error on any sources ranging over the past two months.
> More details on the issue are shared at:-
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=14525

It sounds like you're only testing on debian whilst the autobuilder has multiple
different hosts which is the difference.

Cheers,

Richard

Re: [OE-core] [PATCH] oeqa/selftest/reproducibile: Include rust packages

[Thomas Perrot]

[-- Attachment #1: Type: text/plain, Size: 2546 bytes --]

Hi Pgowda,

On Fri, 2021-10-08 at 13:34 +0100, Richard Purdie wrote:
> On Fri, 2021-10-08 at 17:29 +0530, pgowda cve wrote:
> > Hi Richard,
> > 
> > > > https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/764
> > 
> > Thanks very much for sharing your inputs and comments on the issue.
> > 
> > I could see some more builds where rust exclusions were unused:-
> > Some of the example builds are:-
> > https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/757
> > https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/755
> > https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/751
> > 
> > Can you please let me know about this inconsistent behavior?
> 
> The reproducible test runs on different hosts and has two builds it
> compares.
> The first build can come from sstate. The second build is built on the
> specific
> worker the builds runs on.
> 
> We can see from my link above that the build that shows reproducibility
> issues
> ran on fedora33 so it is probably something specific to that distro.
> 
> The most likely way to reproduce the issue is therefore to build on
> something
> like an ubuntu system and compare the packages with those built on a
> fedora33
> system.
> 
> > I will try to check the issue based on your inputs.
> > 
> > I tried to build the reproducible with and without rust exclusions on
> > many poky sources.
> > Could not see this error on any sources ranging over the past two
> > months.
> > More details on the issue are shared at:-
> > https://bugzilla.yoctoproject.org/show_bug.cgi?id=14525
> 
> It sounds like you're only testing on debian whilst the autobuilder has
> multiple
> different hosts which is the difference.
> 
> Cheers,
> 
> Richard
> 

There is a new occurrence of the reproducibility issue on Fedora 33 :
https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/782/steps/12/logs/stdio

Best regards,
Thomas

> 
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#156782): 
> https://lists.openembedded.org/g/openembedded-core/message/156782
> Mute This Topic: https://lists.openembedded.org/mt/86165875/5443093
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe:
> https://lists.openembedded.org/g/openembedded-core/unsub [thomas.perrot@bootlin.com
> ]
> -=-=-=-=-=-=-=-=-=-=-=-
> 

-- 
Thomas Perrot, Bootlin
Embedded Linux and kernel engineering
https://bootlin.com


[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 659 bytes --]