[PATCH 1/2] oeqa/selftest/esdk: Ensure parent directory exists

[PATCH 1/2] oeqa/selftest/esdk: Ensure parent directory exists

[Richard Purdie]

INFO - ======================================================================
INFO - ERROR: setUpClass (eSDK.oeSDKExtSelfTest)
INFO - ----------------------------------------------------------------------
INFO - Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/oe-selftest-debian/build/meta/lib/oeqa/core/case.py", line 32, in _oeSetUpClass
    clss.setUpClassMethod()
  File "/home/pokybuild/yocto-worker/oe-selftest-debian/build/meta/lib/oeqa/selftest/cases/eSDK.py", line 76, in setUpClass
    cls.tmpdirobj = tempfile.TemporaryDirectory(prefix="selftest-esdk-", dir=bb_vars["WORKDIR"])
  File "/usr/lib/python3.5/tempfile.py", line 929, in __init__
    self.name = mkdtemp(suffix, prefix, dir)
  File "/usr/lib/python3.5/tempfile.py", line 507, in mkdtemp
    _os.mkdir(file, 0o700)
FileNotFoundError: [Errno 2] No such file or directory: '/home/pokybuild/yocto-worker/oe-selftest-debian/build/build/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/selftest-esdk-q7ln84gc'

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
---
 meta/lib/oeqa/selftest/cases/eSDK.py | 1 +
 1 file changed, 1 insertion(+)

diff --git a/meta/lib/oeqa/selftest/cases/eSDK.py b/meta/lib/oeqa/selftest/cases/eSDK.py
index 12bd710e2dc..d7aef939913 100644
--- a/meta/lib/oeqa/selftest/cases/eSDK.py
+++ b/meta/lib/oeqa/selftest/cases/eSDK.py
@@ -73,6 +73,7 @@ CORE_IMAGE_EXTRA_INSTALL = "perl"
         cls.image = 'core-image-minimal'
 
         bb_vars = get_bb_vars(['SSTATE_DIR', 'WORKDIR'], cls.image)
+        bb.utils.mkdirhier(bb_vars["WORKDIR"])
         cls.tmpdirobj = tempfile.TemporaryDirectory(prefix="selftest-esdk-", dir=bb_vars["WORKDIR"])
         cls.tmpdir_eSDKQA = cls.tmpdirobj.name
 
-- 
2.19.1

[PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

[Richard Purdie]

opkg needs the replaces/conflicts/provides in order for this package
to function as intended. When enabled, this code caused failures for
core-image-sato -c populate_sdk.

The reason is that nativesdk-autoconf has several perl dependencies. We
need to list more of the things which this package provides/conflicts
with in order for it to function correctly. Therefore add the missing
entries.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
---
 meta/recipes-core/meta/dummy-sdk-package.inc  |  4 ++--
 .../meta/nativesdk-sdk-provides-dummy.bb      | 20 +++++++++++++++++++
 .../meta/target-sdk-provides-dummy.bb         |  3 +++
 3 files changed, 25 insertions(+), 2 deletions(-)

diff --git a/meta/recipes-core/meta/dummy-sdk-package.inc b/meta/recipes-core/meta/dummy-sdk-package.inc
index eafcb823ab2..4d653706b13 100644
--- a/meta/recipes-core/meta/dummy-sdk-package.inc
+++ b/meta/recipes-core/meta/dummy-sdk-package.inc
@@ -20,7 +20,7 @@ PR[vardeps] += "DUMMYPROVIDES"
 python populate_packages_prepend() {
     p = d.getVar("PN")
     d.appendVar("RPROVIDES_%s" % p, "${DUMMYPROVIDES}")
-    #d.appendVar("RCONFLICTS_%s" % p, "${DUMMYPROVIDES}")
-    #d.appendVar("RREPLACES_%s" % p, "${DUMMYPROVIDES}")
+    d.appendVar("RCONFLICTS_%s" % p, "${DUMMYPROVIDES}")
+    d.appendVar("RREPLACES_%s" % p, "${DUMMYPROVIDES}")
 }
 
diff --git a/meta/recipes-core/meta/nativesdk-sdk-provides-dummy.bb b/meta/recipes-core/meta/nativesdk-sdk-provides-dummy.bb
index 11a727d4867..d33e978666f 100644
--- a/meta/recipes-core/meta/nativesdk-sdk-provides-dummy.bb
+++ b/meta/recipes-core/meta/nativesdk-sdk-provides-dummy.bb
@@ -2,6 +2,26 @@ DUMMYARCH = "sdk-provides-dummy-${SDKPKGSUFFIX}"
 
 # Add /bin/sh?
 DUMMYPROVIDES = "\
+    nativesdk-perl \
+    nativesdk-libxml-parser-perl \
+    nativesdk-perl-module-bytes \
+    nativesdk-perl-module-carp \
+    nativesdk-perl-module-constant \
+    nativesdk-perl-module-data-dumper \
+    nativesdk-perl-module-errno \
+    nativesdk-perl-module-exporter \
+    nativesdk-perl-module-file-basename \
+    nativesdk-perl-module-file-compare \
+    nativesdk-perl-module-file-copy \
+    nativesdk-perl-module-file-find \
+    nativesdk-perl-module-file-glob \
+    nativesdk-perl-module-file-path \
+    nativesdk-perl-module-file-stat \
+    nativesdk-perl-module-getopt-long \
+    nativesdk-perl-module-io-file \
+    nativesdk-perl-module-posix \
+    nativesdk-perl-module-thread-queue \
+    nativesdk-perl-module-threads \
     /bin/bash \
     /usr/bin/env \
     /usr/bin/perl \
diff --git a/meta/recipes-core/meta/target-sdk-provides-dummy.bb b/meta/recipes-core/meta/target-sdk-provides-dummy.bb
index 714d15d8ba9..57c10044f87 100644
--- a/meta/recipes-core/meta/target-sdk-provides-dummy.bb
+++ b/meta/recipes-core/meta/target-sdk-provides-dummy.bb
@@ -1,6 +1,9 @@
 DUMMYARCH = "sdk-provides-dummy-target"
 
 DUMMYPROVIDES = "\
+    busybox \
+    bash \
+    perl \
     /bin/sh \
     /bin/bash \
     /usr/bin/env \
-- 
2.19.1

Re: [PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

[Richard Purdie]

On Fri, 2018-12-07 at 12:06 +0000, Richard Purdie wrote:
> opkg needs the replaces/conflicts/provides in order for this package
> to function as intended. When enabled, this code caused failures for
> core-image-sato -c populate_sdk.
> 
> The reason is that nativesdk-autoconf has several perl dependencies.
> We
> need to list more of the things which this package provides/conflicts
> with in order for it to function correctly. Therefore add the missing
> entries.
> 
> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> ---
>  meta/recipes-core/meta/dummy-sdk-package.inc  |  4 ++--
>  .../meta/nativesdk-sdk-provides-dummy.bb      | 20
> +++++++++++++++++++
>  .../meta/target-sdk-provides-dummy.bb         |  3 +++
>  3 files changed, 25 insertions(+), 2 deletions(-)

Sadly this breaks the SDK on machines without libxml-parser-perl:

https://autobuilder.yoctoproject.org/typhoon/#/builders/59/builds/68

so a resolution will need to be found to that before it can merge.

Cheers,

Richard

Re: [PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

[Andrej Valek]

Hello Richard

Did you have some time to take a look on it?
What about just list all perl's deps and add these packages? Or is there
something more behind it?

Regards,
Andrej

On 12/8/18 1:07 AM, Richard Purdie wrote:
> On Fri, 2018-12-07 at 12:06 +0000, Richard Purdie wrote:
>> opkg needs the replaces/conflicts/provides in order for this package
>> to function as intended. When enabled, this code caused failures for
>> core-image-sato -c populate_sdk.
>>
>> The reason is that nativesdk-autoconf has several perl dependencies.
>> We
>> need to list more of the things which this package provides/conflicts
>> with in order for it to function correctly. Therefore add the missing
>> entries.
>>
>> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
>> ---
>>  meta/recipes-core/meta/dummy-sdk-package.inc  |  4 ++--
>>  .../meta/nativesdk-sdk-provides-dummy.bb      | 20
>> +++++++++++++++++++
>>  .../meta/target-sdk-provides-dummy.bb         |  3 +++
>>  3 files changed, 25 insertions(+), 2 deletions(-)
> 
> Sadly this breaks the SDK on machines without libxml-parser-perl:
> 
> https://autobuilder.yoctoproject.org/typhoon/#/builders/59/builds/68
> 
> so a resolution will need to be found to that before it can merge.
> 
> Cheers,
> 
> Richard
> 

Re: [PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

[richard.purdie]

On Wed, 2018-12-26 at 09:39 +0100, Andrej Valek wrote:
> Hello Richard
> 
> Did you have some time to take a look on it?
> What about just list all perl's deps and add these packages? Or is
> there something more behind it?

I got this far with it but it then got placed on the "needs more work"
pile and I got distracted by other problems.

I suspect a solution is comparatively close and it would be nice to get
this one fixed...

Did you have a solution to the problem below in mind?

Cheers,

Richard

> Regards,
> Andrej
> 
> On 12/8/18 1:07 AM, Richard Purdie wrote:
> > On Fri, 2018-12-07 at 12:06 +0000, Richard Purdie wrote:
> > > opkg needs the replaces/conflicts/provides in order for this
> > > package
> > > to function as intended. When enabled, this code caused failures
> > > for
> > > core-image-sato -c populate_sdk.
> > > 
> > > The reason is that nativesdk-autoconf has several perl
> > > dependencies.
> > > We
> > > need to list more of the things which this package
> > > provides/conflicts
> > > with in order for it to function correctly. Therefore add the
> > > missing
> > > entries.
> > > 
> > > Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org
> > > >
> > > ---
> > >  meta/recipes-core/meta/dummy-sdk-package.inc  |  4 ++--
> > >  .../meta/nativesdk-sdk-provides-dummy.bb      | 20
> > > +++++++++++++++++++
> > >  .../meta/target-sdk-provides-dummy.bb         |  3 +++
> > >  3 files changed, 25 insertions(+), 2 deletions(-)
> > 
> > Sadly this breaks the SDK on machines without libxml-parser-perl:
> > 
> > https://autobuilder.yoctoproject.org/typhoon/#/builders/59/builds/68
> > 
> > so a resolution will need to be found to that before it can merge.
> > 
> > Cheers,
> > 
> > Richard
> > 

Re: [PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

[Andrej Valek]

Your previous solution is working for me, so I was not working on fixing
this. I thought, that You will just add missing packages, and that is.
I don't have setup for failing machine.

Is there any simple way to get all missing perl packages?

Regards,
Andrej

On 12/26/18 12:09 PM, richard.purdie@linuxfoundation.org wrote:
> On Wed, 2018-12-26 at 09:39 +0100, Andrej Valek wrote:
>> Hello Richard
>>
>> Did you have some time to take a look on it?
>> What about just list all perl's deps and add these packages? Or is
>> there something more behind it?
> 
> I got this far with it but it then got placed on the "needs more work"
> pile and I got distracted by other problems.
> 
> I suspect a solution is comparatively close and it would be nice to get
> this one fixed...
> 
> Did you have a solution to the problem below in mind?
> 
> Cheers,
> 
> Richard
> 
>> Regards,
>> Andrej
>>
>> On 12/8/18 1:07 AM, Richard Purdie wrote:
>>> On Fri, 2018-12-07 at 12:06 +0000, Richard Purdie wrote:
>>>> opkg needs the replaces/conflicts/provides in order for this
>>>> package
>>>> to function as intended. When enabled, this code caused failures
>>>> for
>>>> core-image-sato -c populate_sdk.
>>>>
>>>> The reason is that nativesdk-autoconf has several perl
>>>> dependencies.
>>>> We
>>>> need to list more of the things which this package
>>>> provides/conflicts
>>>> with in order for it to function correctly. Therefore add the
>>>> missing
>>>> entries.
>>>>
>>>> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org
>>>>>
>>>> ---
>>>>  meta/recipes-core/meta/dummy-sdk-package.inc  |  4 ++--
>>>>  .../meta/nativesdk-sdk-provides-dummy.bb      | 20
>>>> +++++++++++++++++++
>>>>  .../meta/target-sdk-provides-dummy.bb         |  3 +++
>>>>  3 files changed, 25 insertions(+), 2 deletions(-)
>>>
>>> Sadly this breaks the SDK on machines without libxml-parser-perl:
>>>
>>> https://autobuilder.yoctoproject.org/typhoon/#/builders/59/builds/68
>>>
>>> so a resolution will need to be found to that before it can merge.
>>>
>>> Cheers,
>>>
>>> Richard
>>>
> 

Re: [PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

[Richard Purdie]

On Mon, 2018-12-31 at 20:56 +0100, Andrej Valek wrote:
> Your previous solution is working for me, so I was not working on
> fixing
> this. I thought, that You will just add missing packages, and that
> is.
> I don't have setup for failing machine.
> 
> Is there any simple way to get all missing perl packages?

I reworked the patch a bit, tested and just merged a working version of
it:

http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=d4e27863f3874fb7dc543eed8dcf6a8c4d146fb5

Cheers,

Richard

Re: [PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

[Phil Reid]

On 3/01/2019 9:59 pm, Richard Purdie wrote:
> On Mon, 2018-12-31 at 20:56 +0100, Andrej Valek wrote:
>> Your previous solution is working for me, so I was not working on
>> fixing
>> this. I thought, that You will just add missing packages, and that
>> is.
>> I don't have setup for failing machine.
>>
>> Is there any simple way to get all missing perl packages?
> 
> I reworked the patch a bit, tested and just merged a working version of
> it:
> 
> http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=d4e27863f3874fb7dc543eed8dcf6a8c4d146fb5
> 
> Cheers,
> 
> Richard
> 

This patch seems to trigger the following new warning for me during populate_sdk

Collected errors:
  * Solver encountered 1 problem(s):
  * Problem 1/1:
  *   - package busybox-dev-1.29.2-r0.4.cortexa9t2hf-neon requires busybox = 1.29.2-r0.4, but none of the providers can be installed
  *
  * Solution 1:
  *   - allow deinstallation of target-sdk-provides-dummy-1.0-r0.9.sdk-provides-dummy-target

  *   - do not ask to install a package providing target-sdk-provides-dummy-dev

  * Solution 2:
  *   - do not ask to install a package providing busybox-dev


Not sure what is request busybox-dev to be istalled in the sdk.
Any thoughts?



-- 
Regards
Phil Reid

Re: [PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

[Khem Raj]

On Wed, Feb 6, 2019 at 6:39 PM Phil Reid <preid@electromag.com.au> wrote:
>
> On 3/01/2019 9:59 pm, Richard Purdie wrote:
> > On Mon, 2018-12-31 at 20:56 +0100, Andrej Valek wrote:
> >> Your previous solution is working for me, so I was not working on
> >> fixing
> >> this. I thought, that You will just add missing packages, and that
> >> is.
> >> I don't have setup for failing machine.
> >>
> >> Is there any simple way to get all missing perl packages?
> >
> > I reworked the patch a bit, tested and just merged a working version of
> > it:
> >
> > http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=d4e27863f3874fb7dc543eed8dcf6a8c4d146fb5
> >
> > Cheers,
> >
> > Richard
> >
>
> This patch seems to trigger the following new warning for me during populate_sdk
>
> Collected errors:
>   * Solver encountered 1 problem(s):
>   * Problem 1/1:
>   *   - package busybox-dev-1.29.2-r0.4.cortexa9t2hf-neon requires busybox = 1.29.2-r0.4, but none of the providers can be installed
>   *
>   * Solution 1:
>   *   - allow deinstallation of target-sdk-provides-dummy-1.0-r0.9.sdk-provides-dummy-target
>
>   *   - do not ask to install a package providing target-sdk-provides-dummy-dev
>
>   * Solution 2:
>   *   - do not ask to install a package providing busybox-dev
>
>
> Not sure what is request busybox-dev to be istalled in the sdk.
> Any thoughts?
>

Richard

I am seeing same failure as well. I solved it by adding

RDEPENDS_${PN}-dev = "" in busybox recipe.

I am not sure if thats right solution, busybox-dev seems to be empty package.


>
>
> --
> Regards
> Phil Reid
> --
> _______________________________________________
> Openembedded-core mailing list
> Openembedded-core@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

[Valek, Andrej]

Seems to be, that is not the right solution, even if -dev package is not existing. On the other hand, why busybox package needs -dev package itself?

We can create an empty package, without any requirements if it's really required.

Regards,
Andrej

-----Original Message-----
From: Khem Raj <raj.khem@gmail.com> 
Sent: 11. februára 2019 15:35
To: Phil Reid <preid@electromag.com.au>
Cc: Richard Purdie <richard.purdie@linuxfoundation.org>; Valek, Andrej (CT RDA DS EU SK BT1) <andrej.valek@siemens.com>; openembedded-core@lists.openembedded.org
Subject: Re: [OE-core] [PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

On Wed, Feb 6, 2019 at 6:39 PM Phil Reid <preid@electromag.com.au> wrote:
>
> On 3/01/2019 9:59 pm, Richard Purdie wrote:
> > On Mon, 2018-12-31 at 20:56 +0100, Andrej Valek wrote:
> >> Your previous solution is working for me, so I was not working on 
> >> fixing this. I thought, that You will just add missing packages, 
> >> and that is.
> >> I don't have setup for failing machine.
> >>
> >> Is there any simple way to get all missing perl packages?
> >
> > I reworked the patch a bit, tested and just merged a working version 
> > of
> > it:
> >
> > http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=d4e27863f3874fb
> > 7dc543eed8dcf6a8c4d146fb5
> >
> > Cheers,
> >
> > Richard
> >
>
> This patch seems to trigger the following new warning for me during 
> populate_sdk
>
> Collected errors:
>   * Solver encountered 1 problem(s):
>   * Problem 1/1:
>   *   - package busybox-dev-1.29.2-r0.4.cortexa9t2hf-neon requires busybox = 1.29.2-r0.4, but none of the providers can be installed
>   *
>   * Solution 1:
>   *   - allow deinstallation of target-sdk-provides-dummy-1.0-r0.9.sdk-provides-dummy-target
>
>   *   - do not ask to install a package providing target-sdk-provides-dummy-dev
>
>   * Solution 2:
>   *   - do not ask to install a package providing busybox-dev
>
>
> Not sure what is request busybox-dev to be istalled in the sdk.
> Any thoughts?
>

Richard

I am seeing same failure as well. I solved it by adding

RDEPENDS_${PN}-dev = "" in busybox recipe.

I am not sure if thats right solution, busybox-dev seems to be empty package.


>
>
> --
> Regards
> Phil Reid
> --
> _______________________________________________
> Openembedded-core mailing list
> Openembedded-core@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

[Richard Purdie]

On Mon, 2019-02-11 at 06:35 -0800, Khem Raj wrote:
> On Wed, Feb 6, 2019 at 6:39 PM Phil Reid <preid@electromag.com.au>
> wrote:
> > On 3/01/2019 9:59 pm, Richard Purdie wrote:
> > > On Mon, 2018-12-31 at 20:56 +0100, Andrej Valek wrote:
> > > > Your previous solution is working for me, so I was not working
> > > > on
> > > > fixing
> > > > this. I thought, that You will just add missing packages, and
> > > > that
> > > > is.
> > > > I don't have setup for failing machine.
> > > > 
> > > > Is there any simple way to get all missing perl packages?
> > > 
> > > I reworked the patch a bit, tested and just merged a working
> > > version of
> > > it:
> > > 
> > > http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=d4e27863f3874fb7dc543eed8dcf6a8c4d146fb5
> > > 
> > > Cheers,
> > > 
> > > Richard
> > > 
> > 
> > This patch seems to trigger the following new warning for me during
> > populate_sdk
> > 
> > Collected errors:
> >   * Solver encountered 1 problem(s):
> >   * Problem 1/1:
> >   *   - package busybox-dev-1.29.2-r0.4.cortexa9t2hf-neon requires
> > busybox = 1.29.2-r0.4, but none of the providers can be installed
> >   *
> >   * Solution 1:
> >   *   - allow deinstallation of target-sdk-provides-dummy-1.0-
> > r0.9.sdk-provides-dummy-target
> > 
> >   *   - do not ask to install a package providing target-sdk-
> > provides-dummy-dev
> > 
> >   * Solution 2:
> >   *   - do not ask to install a package providing busybox-dev
> > 
> > 
> > Not sure what is request busybox-dev to be istalled in the sdk.
> > Any thoughts?
> > 
> 
> Richard
> 
> I am seeing same failure as well. I solved it by adding
> 
> RDEPENDS_${PN}-dev = "" in busybox recipe.
> 
> I am not sure if thats right solution, busybox-dev seems to be empty
> package.

Its not. The real question is why busybox is being installed into the
SDK (which in turn pulls in busybox-dev). I don't think it is being
pulled in on our test images so its probably both your local
configurations that trigger something we don't see on the autobuilder.
Perhaps something is missing from target-sdk-provides-dummy.bb?

I'm also guessing this is thud so its possible we're missing a backport
of a related patch...

Cheers,

Richard

Re: [PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

[Khem Raj]

Hi Richard

my case is with master infact master-next

On Mon, Feb 11, 2019 at 6:45 AM Richard Purdie
<richard.purdie@linuxfoundation.org> wrote:
>
> On Mon, 2019-02-11 at 06:35 -0800, Khem Raj wrote:
> > On Wed, Feb 6, 2019 at 6:39 PM Phil Reid <preid@electromag.com.au>
> > wrote:
> > > On 3/01/2019 9:59 pm, Richard Purdie wrote:
> > > > On Mon, 2018-12-31 at 20:56 +0100, Andrej Valek wrote:
> > > > > Your previous solution is working for me, so I was not working
> > > > > on
> > > > > fixing
> > > > > this. I thought, that You will just add missing packages, and
> > > > > that
> > > > > is.
> > > > > I don't have setup for failing machine.
> > > > >
> > > > > Is there any simple way to get all missing perl packages?
> > > >
> > > > I reworked the patch a bit, tested and just merged a working
> > > > version of
> > > > it:
> > > >
> > > > http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=d4e27863f3874fb7dc543eed8dcf6a8c4d146fb5
> > > >
> > > > Cheers,
> > > >
> > > > Richard
> > > >
> > >
> > > This patch seems to trigger the following new warning for me during
> > > populate_sdk
> > >
> > > Collected errors:
> > >   * Solver encountered 1 problem(s):
> > >   * Problem 1/1:
> > >   *   - package busybox-dev-1.29.2-r0.4.cortexa9t2hf-neon requires
> > > busybox = 1.29.2-r0.4, but none of the providers can be installed
> > >   *
> > >   * Solution 1:
> > >   *   - allow deinstallation of target-sdk-provides-dummy-1.0-
> > > r0.9.sdk-provides-dummy-target
> > >
> > >   *   - do not ask to install a package providing target-sdk-
> > > provides-dummy-dev
> > >
> > >   * Solution 2:
> > >   *   - do not ask to install a package providing busybox-dev
> > >
> > >
> > > Not sure what is request busybox-dev to be istalled in the sdk.
> > > Any thoughts?
> > >
> >
> > Richard
> >
> > I am seeing same failure as well. I solved it by adding
> >
> > RDEPENDS_${PN}-dev = "" in busybox recipe.
> >
> > I am not sure if thats right solution, busybox-dev seems to be empty
> > package.
>
> Its not. The real question is why busybox is being installed into the
> SDK (which in turn pulls in busybox-dev). I don't think it is being
> pulled in on our test images so its probably both your local
> configurations that trigger something we don't see on the autobuilder.
> Perhaps something is missing from target-sdk-provides-dummy.bb?
>
> I'm also guessing this is thud so its possible we're missing a backport
> of a related patch...
>
> Cheers,
>
> Richard
>

Re: [PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

[Luca Boccassi]

[-- Attachment #1: Type: text/plain, Size: 6505 bytes --]

On Thu, 2019-01-03 at 13:59 +0000, Richard Purdie wrote:
> On Mon, 2018-12-31 at 20:56 +0100, Andrej Valek wrote:
> > Your previous solution is working for me, so I was not working on
> > fixing
> > this. I thought, that You will just add missing packages, and that
> > is.
> > I don't have setup for failing machine.
> > 
> > Is there any simple way to get all missing perl packages?
> 
> I reworked the patch a bit, tested and just merged a working version
> of
> it:
> 
> http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=d4e27863f3874fb7dc543eed8dcf6a8c4d146fb5
> 
> 
> Cheers,
> 
> Richard

Hello Richard,

Due to this change in thud, the populate_sdk step when PACKAGE_CLASSES
is set to package_deb rather than rpm does not work anymore:

2019-06-27T13:18:54.5591007Z [WARN] [15901] ERROR: mc:generic-lnx-
sdk:generic-image-gen1-1.0-r0 do_populate_sdk: Unable to install
packages. Command '/source/build-proj-generic-x86-64-dev/tmp-generic-
lnx-sdk-glibc/work/_generic_x86_64_dev-linux/generic-image-gen1/1.0-
r0/recipe-sysroot-native/usr/bin/apt-get  install --force-yes --allow-
unauthenticated cryptsetup libprotobuf17 libxslt-dev m4 gnupg util-
linux-uuidd openssh-ssh util-linux-uuidgen python3-pip cmake logrotate
volatile-binds-dev sudo update-alternatives-opkg key-store-system-
trusted-privkey util-linux-mkfs libfontconfig1 base-files libgmp-dev
openssh-scp lz4-dev perl libsepol1 diffutils libc-staticdev lighttpd
cryptodev-linux-dev udev-hwdb cppnetlib cppnetlib-staticdev openssl-
staticdev libx11-6 cpio sed-dev openssh-sshd ethtool unzip-dev openssh-
keygen db procps-dev libprotobuf-c-dev diskprep ncurses-staticdev pango
grub util-linux-agetty util-linux-readprofile less util-linux-sulogin
keyutils libatomic-dev libsigc-2.0-0 packagegroup-core-boot util-linux-
utmpdump locale-base-en-us libxext6 gawk libsrpm-dev cppneturi-dev
libxml2-dev libarchive init-ifupdown bzip2-dev dpkg ncurses-dev
libgomp-staticdev shadow-securetty-dev libgcc-s-dev cppnetlib-dev
rsyslog findutils which linux-libc-headers-dev libffi-dev which-dev
util-linux-fsck libarchive-dev makedumpfile liblzo2-dev libxml++-2.6-2
python3 libgomp1 sharutils libubsan1 boost liblzo2-2 packagegroup-core-
standalone-sdk-target dtc shadow-securetty util-linux-lsblk lz4-
staticdev libdevmapper libstdc++-dev libgdbm-dev bridge-utils key-
store-ima-privkey lttng-tools-dev libselinux-bin shadow apt valgrind
util-linux-losetup flex-dev volatile-debug-binds libpng16-16 libc6-dev
grep perf util-linux-mountpoint util-linux-fdisk libprotobuf-dev tpm2-
abrmd libcroco-dev openssl-engines libxrender1 libcgroup-dev make
openssh lttng-tools libreadline-dev ncurses-tools nettle-dev libz-dev
libaio1 libselinux1 grpc-dev e2fsprogs-dev util-linux-sfdisk
libcpprest2.10 util-linux-prlimit rapidjson-dev net-tools tar shared-
mime-info libsrpm1 util-linux-switch-root.static squashfs-tools
openssl-conf selinux-policy curl-dev ntp libz1 libasan5 libnginx-dev
procps zip util-linux-dev libharfbuzz0 socat libsigc-2.0-dev libxcb1
gawk-dev tpm2-tools ima-inspect libgomp-dev iptables openssl-misc
libstdc++6 libgdbm-compat4 libcap-dev update-rc.d db-dev lvm2
packagegroup-core-tools-debug shared-mime-info-dev libcairo2 libgdbm6
libreadline-staticdev libxslt openssl xz lz4 libaio-staticdev libnginx-
staticdev nettle python3-dev base-passwd rsync libstdc++-staticdev
iproute2 ntttcp os-release gettext xz-dev libubsan-dev libxml++-2.6-dev 
libsrpm-staticdev dhcp-client unzip util-linux-mount udev coreutils-dev 
elfutils glibc-binary-localedata-en-us libaio-dev boost-staticdev
cppneturi-staticdev packagegroup-base-extended kbd-keymaps libnginx1
cppneturi bash diffutils-dev m4-dev libglib-2.0-0 libglib-2.0-dev libz-
staticdev util-linux-swaponoff v86d curl libcpprest-dev netbase ima-
evm-utils gzip util-linux-kill glibmm libatomic1 util-linux-cfdisk
systemd-analyze libreadline7 systemd-serialgetty-dev tpm2-tss rrdtool
openssl-bin openssl-dev gettext-dev ifupdown util-linux-switch-root
rng-tools libasan-dev systemd-serialgetty kmod libcap2 util-linux-
getopt grep-dev kdump policycoreutils-setfiles libcroco e2fsprogs-
staticdev target-sdk-provides-dummy acl boost-dev libxml2 e2fsprogs
flex libxft2 libpixman-1-0 shadow-base cryptodev-linux libffi6 attr
packagegroup-core-sdk policycoreutils-sestatus systemd libprotobuf-c1
bzip2 libatomic-staticdev libgmp10 shadow-dev util-linux-umount lsb
python-dev util-linux-ionice libxdmcp6 systemd-dev git libcgroup run-
postinsts kbd pciutils libcap-staticdev kmod-dev ncurses-terminfo-base
sed util-linux-blkdiscard libxau6 coreutils grpc make-dev kexec-tools
dbus-dev kexec libpcre-dev' returned 100:
2019-06-27T13:18:54.5592415Z [WARN] [15902] Reading package lists...
2019-06-27T13:18:54.5592628Z [WARN] [15903] Building dependency tree...
2019-06-27T13:18:54.5593124Z [WARN] [15904] Some packages could not be installed. This may mean that you have
2019-06-27T13:18:54.5593526Z [WARN] [15905] requested an impossible situation or if you are using the unstable
2019-06-27T13:18:54.5593893Z [WARN] [15906] distribution that some required packages have not yet been created
2019-06-27T13:18:54.5599962Z [WARN] [15907] or been moved out of Incoming.
2019-06-27T13:18:54.5600415Z [WARN] [15908] The following information may help to resolve the situation:
2019-06-27T13:18:54.5600834Z [WARN] [15909] The following packages have unmet dependencies:
2019-06-27T13:18:54.5601383Z [WARN] [15910]  target-sdk-provides-dummy : Conflicts: bash
2019-06-27T13:18:54.5601724Z [WARN] [15911]                              Conflicts: coreutils
2019-06-27T13:18:54.5602246Z [WARN] [15912]                              Conflicts: coreutils-dev
2019-06-27T13:18:54.5602590Z [WARN] [15913]                              Conflicts: perl
2019-06-27T13:18:54.5603147Z [WARN] [15914]                              Conflicts: perl-module-strict
2019-06-27T13:18:54.5603989Z [WARN] [15915]                              Conflicts: perl-module-vars
2019-06-27T13:18:54.5605346Z [WARN] [15916]                              Conflicts: perl-module-warnings
2019-06-27T13:18:54.5606090Z [WARN] [15917] E: Unable to correct problems, you have held broken packages.

Same config worked fine in sumo.

Any suggestion on how to fix it? Is it possible to enter the working
directory to run apt manually, so that I can dig further into the
dependency issue?

Thanks!

-- 
Kind regards,
Luca Boccassi

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 499 bytes --]

Re: [PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

[richard.purdie]

On Fri, 2019-06-28 at 16:52 +0000, Luca Boccassi wrote:
> 2019-06-27T13:18:54.5592415Z [WARN] [15902] Reading package lists...
> 2019-06-27T13:18:54.5592628Z [WARN] [15903] Building dependency tree...
> 2019-06-27T13:18:54.5593124Z [WARN] [15904] Some packages could not be installed. This may mean that you have
> 2019-06-27T13:18:54.5593526Z [WARN] [15905] requested an impossible situation or if you are using the unstable
> 2019-06-27T13:18:54.5593893Z [WARN] [15906] distribution that some required packages have not yet been created
> 2019-06-27T13:18:54.5599962Z [WARN] [15907] or been moved out of Incoming.
> 2019-06-27T13:18:54.5600415Z [WARN] [15908] The following information may help to resolve the situation:
> 2019-06-27T13:18:54.5600834Z [WARN] [15909] The following packages have unmet dependencies:
> 2019-06-27T13:18:54.5601383Z [WARN] [15910]  target-sdk-provides-dummy : Conflicts: bash
> 2019-06-27T13:18:54.5601724Z [WARN] [15911]                              Conflicts: coreutils
> 2019-06-27T13:18:54.5602246Z [WARN] [15912]                              Conflicts: coreutils-dev
> 2019-06-27T13:18:54.5602590Z [WARN] [15913]                              Conflicts: perl
> 2019-06-27T13:18:54.5603147Z [WARN] [15914]                              Conflicts: perl-module-strict
> 2019-06-27T13:18:54.5603989Z [WARN] [15915]                              Conflicts: perl-module-vars
> 2019-06-27T13:18:54.5605346Z [WARN] [15916]                              Conflicts: perl-module-warnings
> 2019-06-27T13:18:54.5606090Z [WARN] [15917] E: Unable to correct problems, you have held broken packages.
> 
> Same config worked fine in sumo.
> 
> Any suggestion on how to fix it? Is it possible to enter the working
> directory to run apt manually, so that I can dig further into the
> dependency issue?

Sadly such "enter a shell" functionality has never been implemented so
that isn't possible.

The message is basically saying that there are conflicted providers of
some things the SDK is trying to remove (like bash, perl). Its likely
the dummy recipe isn't providing something which it needs to which
would then stop the other provider being pulled in.

How to isolate what that is, I'm less sure about, there isn't an easy
way. I've just done it from package inspection in the past.

Cheers,

Richard

Re: [PATCH 2/2] nativesdk-*-provides-dummy: Fixes to allow correct operation with opkg

[Luca Boccassi]

On Fri, 2019-06-28 at 17:57 +0100, richard.purdie@linuxfoundation.org
wrote:
> On Fri, 2019-06-28 at 16:52 +0000, Luca Boccassi wrote:
> > 2019-06-27T13:18:54.5592415Z [WARN] [15902] Reading package
> > lists...
> > 2019-06-27T13:18:54.5592628Z [WARN] [15903] Building dependency
> > tree...
> > 2019-06-27T13:18:54.5593124Z [WARN] [15904] Some packages could not
> > be installed. This may mean that you have
> > 2019-06-27T13:18:54.5593526Z [WARN] [15905] requested an impossible
> > situation or if you are using the unstable
> > 2019-06-27T13:18:54.5593893Z [WARN] [15906] distribution that some
> > required packages have not yet been created
> > 2019-06-27T13:18:54.5599962Z [WARN] [15907] or been moved out of
> > Incoming.
> > 2019-06-27T13:18:54.5600415Z [WARN] [15908] The following
> > information may help to resolve the situation:
> > 2019-06-27T13:18:54.5600834Z [WARN] [15909] The following packages
> > have unmet dependencies:
> > 2019-06-27T13:18:54.5601383Z [WARN] [15910]  target-sdk-provides-
> > dummy : Conflicts: bash
> > 2019-06-27T13:18:54.5601724Z [WARN]
> > [15911]                              Conflicts: coreutils
> > 2019-06-27T13:18:54.5602246Z [WARN]
> > [15912]                              Conflicts: coreutils-dev
> > 2019-06-27T13:18:54.5602590Z [WARN]
> > [15913]                              Conflicts: perl
> > 2019-06-27T13:18:54.5603147Z [WARN]
> > [15914]                              Conflicts: perl-module-strict
> > 2019-06-27T13:18:54.5603989Z [WARN]
> > [15915]                              Conflicts: perl-module-vars
> > 2019-06-27T13:18:54.5605346Z [WARN]
> > [15916]                              Conflicts: perl-module-
> > warnings
> > 2019-06-27T13:18:54.5606090Z [WARN] [15917] E: Unable to correct
> > problems, you have held broken packages.
> > 
> > Same config worked fine in sumo.
> > 
> > Any suggestion on how to fix it? Is it possible to enter the
> > working
> > directory to run apt manually, so that I can dig further into the
> > dependency issue?
> 
> Sadly such "enter a shell" functionality has never been implemented
> so
> that isn't possible.
> 
> The message is basically saying that there are conflicted providers
> of
> some things the SDK is trying to remove (like bash, perl). Its likely
> the dummy recipe isn't providing something which it needs to which
> would then stop the other provider being pulled in.
> 
> How to isolate what that is, I'm less sure about, there isn't an easy
> way. I've just done it from package inspection in the past.
> 
> Cheers,
> 
> Richard

Thanks - I'll try to get the packages out of the build directory and
recreate the apt state in a chroot.

Is there a test build of the SDK with a packages_deb configuration? The
distro conf we use that triggers this failure is not that esoteric -
pretty much standard stuff.

-- 
Kind regards,
Luca Boccassi