nspr-4.16-r0 do_package: Function failed: split_and_strip_files

nspr-4.16-r0 do_package: Function failed: split_and_strip_files

[matti kaasinen]

[-- Attachment #1: Type: text/plain, Size: 945 bytes --]

Hi!
My build stops while packaging nspr-4.16-r0 do_package while executing
split_and_strip_files.
I try now building Poky based image using docker container (crops/poky). I
already had to add HOSTTOOLS_append = " svn " to get SRCREV = "${AUTOREV}"
statement work that I did not need in direct PC installation.

Could this also be something resembling i.e. something related to host sw
because I have not had this problem in similar set-up with same PC but
without docker. In fact there I did not use repo system but just checked
out layers manually.

Poky revision is 68a612b7d31d270348ef5439d7f779c309bdb6ec. It is supposed
to be "rocko" tag, but I'm not quite sure what repo took. Git does not
report any branch. Repo set-up was:
  <project remote="yocto"
revision="90414ecd5cf72995074f3dc6b05cfbee0a1dab67" upstream="rocko"
name="poky" path="sources/poky"/>

I hope someone can guide me with this problem.
Thanks,
Matti

[-- Attachment #2: Type: text/html, Size: 1327 bytes --]

Re: nspr-4.16-r0 do_package: Function failed: split_and_strip_files

[matti kaasinen]

[-- Attachment #1: Type: text/plain, Size: 1184 bytes --]

I checked that tag. It seems to be correct:
68a612b7d31d270348ef5439d7f779c309bdb6ec    refs/heads/rocko

pe 7. jouluk. 2018 klo 11.42 matti kaasinen (matti.kaasinen@gmail.com)
kirjoitti:

> Hi!
> My build stops while packaging nspr-4.16-r0 do_package while executing
> split_and_strip_files.
> I try now building Poky based image using docker container (crops/poky). I
> already had to add HOSTTOOLS_append = " svn " to get SRCREV = "${AUTOREV}"
> statement work that I did not need in direct PC installation.
>
> Could this also be something resembling i.e. something related to host sw
> because I have not had this problem in similar set-up with same PC but
> without docker. In fact there I did not use repo system but just checked
> out layers manually.
>
> Poky revision is 68a612b7d31d270348ef5439d7f779c309bdb6ec. It is supposed
> to be "rocko" tag, but I'm not quite sure what repo took. Git does not
> report any branch. Repo set-up was:
>   <project remote="yocto"
> revision="90414ecd5cf72995074f3dc6b05cfbee0a1dab67" upstream="rocko"
> name="poky" path="sources/poky"/>
>
> I hope someone can guide me with this problem.
> Thanks,
> Matti
>

[-- Attachment #2: Type: text/html, Size: 1824 bytes --]

Re: nspr-4.16-r0 do_package: Function failed: split_and_strip_files

[Burton, Ross]

On Fri, 7 Dec 2018 at 09:42, matti kaasinen <matti.kaasinen@gmail.com> wrote:
> My build stops while packaging nspr-4.16-r0 do_package while executing split_and_strip_files.
> I try now building Poky based image using docker container (crops/poky). I already had to add HOSTTOOLS_append = " svn " to get SRCREV = "${AUTOREV}" statement work that I did not need in direct PC installation.

You'll have to tell us what the actual error is if you want any help.

Ross

Re: nspr-4.16-r0 do_package: Function failed: split_and_strip_files

[matti kaasinen]

[-- Attachment #1: Type: text/plain, Size: 1423 bytes --]

These are the error messages returned:
ERROR: nspr-4.16-r0 do_package: debugsrc symlink fixup failed with exit
code 2 (cmd was find
/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug
-type l -print0 -delete | sed
s#/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug/##g
| (cd '/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi' ; cpio -pd0mL
--no-preserve-owner
'/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug'
2>/dev/null))
ERROR: nspr-4.16-r0 do_package: Function failed: split_and_strip_files
ERROR: Logfile of failure stored in:
/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/temp/log.do_package.29429
ERROR: Task (/workdir/sources/poky/meta/recipes-support/nspr/nspr_4.16.bb:do_package)
failed with exit code '1'


pe 7. jouluk. 2018 klo 12.10 Burton, Ross (ross.burton@intel.com) kirjoitti:

> On Fri, 7 Dec 2018 at 09:42, matti kaasinen <matti.kaasinen@gmail.com>
> wrote:
> > My build stops while packaging nspr-4.16-r0 do_package while executing
> split_and_strip_files.
> > I try now building Poky based image using docker container (crops/poky).
> I already had to add HOSTTOOLS_append = " svn " to get SRCREV =
> "${AUTOREV}" statement work that I did not need in direct PC installation.
>
> You'll have to tell us what the actual error is if you want any help.
>
> Ross
>

[-- Attachment #2: Type: text/html, Size: 1844 bytes --]

Re: nspr-4.16-r0 do_package: Function failed: split_and_strip_files

[matti kaasinen]

[-- Attachment #1: Type: text/plain, Size: 1885 bytes --]

I tried executing tasks until the crash. Last task that did not crash
seemed to be do_populate_sysroot. Then I executed the command reported on
the first ERROR message line. It returned zero return value. I executed it
also in pieces. For example find command without -delete option did not
find any symbolic links.

pe 7. jouluk. 2018 klo 12.42 matti kaasinen (matti.kaasinen@gmail.com)
kirjoitti:

> These are the error messages returned:
> ERROR: nspr-4.16-r0 do_package: debugsrc symlink fixup failed with exit
> code 2 (cmd was find
> /BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug
> -type l -print0 -delete | sed
> s#/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug/##g
> | (cd '/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi' ; cpio -pd0mL
> --no-preserve-owner
> '/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug'
> 2>/dev/null))
> ERROR: nspr-4.16-r0 do_package: Function failed: split_and_strip_files
> ERROR: Logfile of failure stored in:
> /BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/temp/log.do_package.29429
> ERROR: Task (/workdir/sources/poky/meta/recipes-support/nspr/nspr_4.16.bb:do_package)
> failed with exit code '1'
>
>
> pe 7. jouluk. 2018 klo 12.10 Burton, Ross (ross.burton@intel.com)
> kirjoitti:
>
>> On Fri, 7 Dec 2018 at 09:42, matti kaasinen <matti.kaasinen@gmail.com>
>> wrote:
>> > My build stops while packaging nspr-4.16-r0 do_package while executing
>> split_and_strip_files.
>> > I try now building Poky based image using docker container
>> (crops/poky). I already had to add HOSTTOOLS_append = " svn " to get SRCREV
>> = "${AUTOREV}" statement work that I did not need in direct PC installation.
>>
>> You'll have to tell us what the actual error is if you want any help.
>>
>> Ross
>>
>

[-- Attachment #2: Type: text/html, Size: 2523 bytes --]

Re: nspr-4.16-r0 do_package: Function failed: split_and_strip_files

[matti kaasinen]

[-- Attachment #1: Type: text/plain, Size: 2207 bytes --]

Previous message was not correct. Do_populate_sysroot does not produce
package directory. Instead, I get zero return code while running this "cmd"
manually after crashed do_package.

ma 10. jouluk. 2018 klo 9.50 matti kaasinen (matti.kaasinen@gmail.com)
kirjoitti:

> I tried executing tasks until the crash. Last task that did not crash
> seemed to be do_populate_sysroot. Then I executed the command reported on
> the first ERROR message line. It returned zero return value. I executed it
> also in pieces. For example find command without -delete option did not
> find any symbolic links.
>
> pe 7. jouluk. 2018 klo 12.42 matti kaasinen (matti.kaasinen@gmail.com)
> kirjoitti:
>
>> These are the error messages returned:
>> ERROR: nspr-4.16-r0 do_package: debugsrc symlink fixup failed with exit
>> code 2 (cmd was find
>> /BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug
>> -type l -print0 -delete | sed
>> s#/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug/##g
>> | (cd '/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi' ; cpio -pd0mL
>> --no-preserve-owner
>> '/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug'
>> 2>/dev/null))
>> ERROR: nspr-4.16-r0 do_package: Function failed: split_and_strip_files
>> ERROR: Logfile of failure stored in:
>> /BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/temp/log.do_package.29429
>> ERROR: Task (/workdir/sources/poky/meta/recipes-support/nspr/nspr_4.16.bb:do_package)
>> failed with exit code '1'
>>
>>
>> pe 7. jouluk. 2018 klo 12.10 Burton, Ross (ross.burton@intel.com)
>> kirjoitti:
>>
>>> On Fri, 7 Dec 2018 at 09:42, matti kaasinen <matti.kaasinen@gmail.com>
>>> wrote:
>>> > My build stops while packaging nspr-4.16-r0 do_package while executing
>>> split_and_strip_files.
>>> > I try now building Poky based image using docker container
>>> (crops/poky). I already had to add HOSTTOOLS_append = " svn " to get SRCREV
>>> = "${AUTOREV}" statement work that I did not need in direct PC installation.
>>>
>>> You'll have to tell us what the actual error is if you want any help.
>>>
>>> Ross
>>>
>>

[-- Attachment #2: Type: text/html, Size: 3078 bytes --]

Re: nspr-4.16-r0 do_package: Function failed: split_and_strip_files

[matti kaasinen]

[-- Attachment #1: Type: text/plain, Size: 2713 bytes --]

I tried running same command from devpyshell that that returns the error
message, i.e. (retval, output) = oe.utils.getstatusoutput(cmd),
cmd is the command that error message reports.
This results to (retval, output) == (0, '0 blocks')
Now I'm somewhat less and less impressed about docker performance. It seems
that I have to rise my hands with this.

ma 10. jouluk. 2018 klo 13.40 matti kaasinen (matti.kaasinen@gmail.com)
kirjoitti:

> Previous message was not correct. Do_populate_sysroot does not produce
> package directory. Instead, I get zero return code while running this "cmd"
> manually after crashed do_package.
>
> ma 10. jouluk. 2018 klo 9.50 matti kaasinen (matti.kaasinen@gmail.com)
> kirjoitti:
>
>> I tried executing tasks until the crash. Last task that did not crash
>> seemed to be do_populate_sysroot. Then I executed the command reported on
>> the first ERROR message line. It returned zero return value. I executed it
>> also in pieces. For example find command without -delete option did not
>> find any symbolic links.
>>
>> pe 7. jouluk. 2018 klo 12.42 matti kaasinen (matti.kaasinen@gmail.com)
>> kirjoitti:
>>
>>> These are the error messages returned:
>>> ERROR: nspr-4.16-r0 do_package: debugsrc symlink fixup failed with exit
>>> code 2 (cmd was find
>>> /BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug
>>> -type l -print0 -delete | sed
>>> s#/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug/##g
>>> | (cd '/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi' ; cpio -pd0mL
>>> --no-preserve-owner
>>> '/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug'
>>> 2>/dev/null))
>>> ERROR: nspr-4.16-r0 do_package: Function failed: split_and_strip_files
>>> ERROR: Logfile of failure stored in:
>>> /BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/temp/log.do_package.29429
>>> ERROR: Task
>>> (/workdir/sources/poky/meta/recipes-support/nspr/nspr_4.16.bb:do_package)
>>> failed with exit code '1'
>>>
>>>
>>> pe 7. jouluk. 2018 klo 12.10 Burton, Ross (ross.burton@intel.com)
>>> kirjoitti:
>>>
>>>> On Fri, 7 Dec 2018 at 09:42, matti kaasinen <matti.kaasinen@gmail.com>
>>>> wrote:
>>>> > My build stops while packaging nspr-4.16-r0 do_package while
>>>> executing split_and_strip_files.
>>>> > I try now building Poky based image using docker container
>>>> (crops/poky). I already had to add HOSTTOOLS_append = " svn " to get SRCREV
>>>> = "${AUTOREV}" statement work that I did not need in direct PC installation.
>>>>
>>>> You'll have to tell us what the actual error is if you want any help.
>>>>
>>>> Ross
>>>>
>>>

[-- Attachment #2: Type: text/html, Size: 3874 bytes --]

Re: nspr-4.16-r0 do_package: Function failed: split_and_strip_files

[matti kaasinen]

[-- Attachment #1: Type: text/plain, Size: 3840 bytes --]

Ok, I just rose my hands halfway: Problem was that I had TMPDIR="/BUILD"
setting.
On the other hand, /BUILD was a symbolic link. BB class package.bbclass was
fiddling with symbolic links at the point where nspr build crashed. Most
likely it just corrupted this link. So, it had nothing to do with docker
installation.

This cleared out. However, I faced with a new problems that seems also
hitting to same bbclass. It seems that convention has changed since
Yocto/krogoth (now Rocko) how autotools handles .debug directory. Then I
just had statements:
FILES_pam-oath-dbg = "${libdir}/security/.debug"
FILES_pam-oath = "${libdir}/security"
Then I got both pam-oath and pam-oath-dbg. However, now I cant find a way
either to get QA error about .debug directory (without pam-oath-dbg line)
or not getting pam-oath (with pam-oath-dbg line).
Is there any reference handling this issue? I did not find any. Or should I
write a new question with proper title?

ti 11. jouluk. 2018 klo 9.12 matti kaasinen (matti.kaasinen@gmail.com)
kirjoitti:

> I tried running same command from devpyshell that that returns the error
> message, i.e. (retval, output) = oe.utils.getstatusoutput(cmd),
> cmd is the command that error message reports.
> This results to (retval, output) == (0, '0 blocks')
> Now I'm somewhat less and less impressed about docker performance. It
> seems that I have to rise my hands with this.
>
> ma 10. jouluk. 2018 klo 13.40 matti kaasinen (matti.kaasinen@gmail.com)
> kirjoitti:
>
>> Previous message was not correct. Do_populate_sysroot does not produce
>> package directory. Instead, I get zero return code while running this "cmd"
>> manually after crashed do_package.
>>
>> ma 10. jouluk. 2018 klo 9.50 matti kaasinen (matti.kaasinen@gmail.com)
>> kirjoitti:
>>
>>> I tried executing tasks until the crash. Last task that did not crash
>>> seemed to be do_populate_sysroot. Then I executed the command reported on
>>> the first ERROR message line. It returned zero return value. I executed it
>>> also in pieces. For example find command without -delete option did not
>>> find any symbolic links.
>>>
>>> pe 7. jouluk. 2018 klo 12.42 matti kaasinen (matti.kaasinen@gmail.com)
>>> kirjoitti:
>>>
>>>> These are the error messages returned:
>>>> ERROR: nspr-4.16-r0 do_package: debugsrc symlink fixup failed with exit
>>>> code 2 (cmd was find
>>>> /BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug
>>>> -type l -print0 -delete | sed
>>>> s#/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug/##g
>>>> | (cd '/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi' ; cpio -pd0mL
>>>> --no-preserve-owner
>>>> '/BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/package/usr/src/debug'
>>>> 2>/dev/null))
>>>> ERROR: nspr-4.16-r0 do_package: Function failed: split_and_strip_files
>>>> ERROR: Logfile of failure stored in:
>>>> /BUILD/work/cortexa7hf-neon-poky-linux-gnueabi/nspr/4.16-r0/temp/log.do_package.29429
>>>> ERROR: Task
>>>> (/workdir/sources/poky/meta/recipes-support/nspr/nspr_4.16.bb:do_package)
>>>> failed with exit code '1'
>>>>
>>>>
>>>> pe 7. jouluk. 2018 klo 12.10 Burton, Ross (ross.burton@intel.com)
>>>> kirjoitti:
>>>>
>>>>> On Fri, 7 Dec 2018 at 09:42, matti kaasinen <matti.kaasinen@gmail.com>
>>>>> wrote:
>>>>> > My build stops while packaging nspr-4.16-r0 do_package while
>>>>> executing split_and_strip_files.
>>>>> > I try now building Poky based image using docker container
>>>>> (crops/poky). I already had to add HOSTTOOLS_append = " svn " to get SRCREV
>>>>> = "${AUTOREV}" statement work that I did not need in direct PC installation.
>>>>>
>>>>> You'll have to tell us what the actual error is if you want any help.
>>>>>
>>>>> Ross
>>>>>
>>>>

[-- Attachment #2: Type: text/html, Size: 5351 bytes --]

Re: nspr-4.16-r0 do_package: Function failed: split_and_strip_files

[Burton, Ross]

On Thu, 13 Dec 2018 at 14:14, matti kaasinen <matti.kaasinen@gmail.com> wrote:
> This cleared out. However, I faced with a new problems that seems also hitting to same bbclass. It seems that convention has changed since Yocto/krogoth (now Rocko) how autotools handles .debug directory. Then I just had statements:
> FILES_pam-oath-dbg = "${libdir}/security/.debug"
> FILES_pam-oath = "${libdir}/security"
> Then I got both pam-oath and pam-oath-dbg. However, now I cant find a way either to get QA error about .debug directory (without pam-oath-dbg line) or not getting pam-oath (with pam-oath-dbg line).
> Is there any reference handling this issue? I did not find any. Or should I write a new question with proper title?

The best practise is to ship only one -dbg package per recipe
(${PN}-dbg is in the default PACKAGES), and you don't nee to list any
FILES for it because it will automatically sweep up all the .debug/
directories.

Ross

Re: nspr-4.16-r0 do_package: Function failed: split_and_strip_files

[Richard Purdie]

On Thu, 2018-12-13 at 14:23 +0000, Burton, Ross wrote:
> On Thu, 13 Dec 2018 at 14:14, matti kaasinen <
> matti.kaasinen@gmail.com> wrote:
> > This cleared out. However, I faced with a new problems that seems
> > also hitting to same bbclass. It seems that convention has changed
> > since Yocto/krogoth (now Rocko) how autotools handles .debug
> > directory. Then I just had statements:
> > FILES_pam-oath-dbg = "${libdir}/security/.debug"
> > FILES_pam-oath = "${libdir}/security"
> > Then I got both pam-oath and pam-oath-dbg. However, now I cant find
> > a way either to get QA error about .debug directory (without pam-
> > oath-dbg line) or not getting pam-oath (with pam-oath-dbg line).
> > Is there any reference handling this issue? I did not find any. Or
> > should I write a new question with proper title?
> 
> The best practise is to ship only one -dbg package per recipe
> (${PN}-dbg is in the default PACKAGES), and you don't nee to list any
> FILES for it because it will automatically sweep up all the .debug/
> directories.

Incidentally, this happened in the 2.1 (krogoth) release:

https://www.yoctoproject.org/docs/2.6/mega-manual/mega-manual.html#migration-2.1-miscellaneous-changes

Cheers,

Richard

Re: nspr-4.16-r0 do_package: Function failed: split_and_strip_files

[matti kaasinen]

[-- Attachment #1: Type: text/plain, Size: 1780 bytes --]

It had nothing to do with FILES statements. In fact that pam-oath was not
swallowed. Instead, it was not produced produced because one DEPENDS
statement was missing so that this recipe did not get some system headers.
Configure went through (with errors reporting these missing header files),
but one package was not produced.

This is clear,
Thanks,
Matti

to 13. jouluk. 2018 klo 17.15 Richard Purdie (
richard.purdie@linuxfoundation.org) kirjoitti:

> On Thu, 2018-12-13 at 14:23 +0000, Burton, Ross wrote:
> > On Thu, 13 Dec 2018 at 14:14, matti kaasinen <
> > matti.kaasinen@gmail.com> wrote:
> > > This cleared out. However, I faced with a new problems that seems
> > > also hitting to same bbclass. It seems that convention has changed
> > > since Yocto/krogoth (now Rocko) how autotools handles .debug
> > > directory. Then I just had statements:
> > > FILES_pam-oath-dbg = "${libdir}/security/.debug"
> > > FILES_pam-oath = "${libdir}/security"
> > > Then I got both pam-oath and pam-oath-dbg. However, now I cant find
> > > a way either to get QA error about .debug directory (without pam-
> > > oath-dbg line) or not getting pam-oath (with pam-oath-dbg line).
> > > Is there any reference handling this issue? I did not find any. Or
> > > should I write a new question with proper title?
> >
> > The best practise is to ship only one -dbg package per recipe
> > (${PN}-dbg is in the default PACKAGES), and you don't nee to list any
> > FILES for it because it will automatically sweep up all the .debug/
> > directories.
>
> Incidentally, this happened in the 2.1 (krogoth) release:
>
>
> https://www.yoctoproject.org/docs/2.6/mega-manual/mega-manual.html#migration-2.1-miscellaneous-changes
>
> Cheers,
>
> Richard
>
>
>
>

[-- Attachment #2: Type: text/html, Size: 2485 bytes --]