Exporting kernel header from patch

Exporting kernel header from patch

[Vuille, Martin (Martin)]

[-- Attachment #1: Type: text/plain, Size: 696 bytes --]

I have a custom layer to add patches to my vendor's BSP layer
(based on Linux 3.4, if it matters) and a .bbappend to list the
patches.

One of the patches adds a header, and this header needs to
be exported to the sysroot.

I added the following to my .bbappend, based on a discussion
I found:

do_install_append() {
    install -d ${D}${includedir}/linux
    install -m 644 ${S}/include/linux/uc1698u.h ${D}${includedir}/linux/uc1698u.h
}

It "works" (i.e., the header is installed in the sysroot) but there must
be more to it than that because I also get a warning about the header
being "installed but not shipped in any package".

What's the correct way to do this?

MV

[-- Attachment #2: Type: text/html, Size: 3126 bytes --]

Re: Exporting kernel header from patch

[Bruce Ashfield]

On 14-04-24 11:57 AM, Vuille, Martin (Martin) wrote:
> I have a custom layer to add patches to my vendor’s BSP layer
>
> (based on Linux 3.4, if it matters) and a .bbappend to list the
>
> patches.
>
> One of the patches adds a header, and this header needs to
>
> be exported to the sysroot.
>
> I added the following to my .bbappend, based on a discussion
>
> I found:
>
> do_install_append() {
>
>      install -d ${D}${includedir}/linux
>
>      install -m 644 ${S}/include/linux/uc1698u.h
> ${D}${includedir}/linux/uc1698u.h
>
> }
>
> It “works” (i.e., the header is installed in the sysroot) but there must
>
> be more to it than that because I also get a warning about the header
>
> being “installed but not shipped in any package”.
>
> What’s the correct way to do this?

Not answering the question directly, but I can say that kernel's
shouldn't be exporting their header files over the sysroot's
include/linux/* directory structure, since that is where linux-libc-headers
installs and manages the userspace safe headers for the c-library.

Sure you are probably installing a new file, and one that doesn't
conflict with the existing libc-headers, but as soon as you start
working in that directory structure .. you will eventually clobber
an existing file.

There have been quite a few discussions on this topic over time on the
oe-core and yocto lists. Look at the comment in the linux-libc-headers.inc
file, and you'll see a note from Richard explaining why this shouldn't
be done (searches on the mailing list archives will also find more
hits).

When you install into the sysroot, the header file should also be
in a FILES_<package> as part of your recipe .. and that is why you
are seeing the warning. packaging it would remove the warning, but
you'll still have the problem I mention above.

The right way is for your application to look at the STAGING_KERNEL_DIR,
which will have a copy of that same header file.

Alternatively, you can stage your header file at a different sysroot
location than include/linux/* and have your application look there.

I have an open enhancement that I'm doing for yocto 1.7 which automates
the alternate header file structure, but doing it explicitly in your
recipes will work for now.

Cheers,

Bruce


>
> MV
>
>
>

Re: Exporting kernel header from patch

[Vuille, Martin (Martin)]

> From: Bruce Ashfield [mailto:bruce.ashfield@windriver.com]
> Sent: April 24, 2014 1:32 PM
> 
> On 14-04-24 11:57 AM, Vuille, Martin (Martin) wrote:
> > I have a custom layer to add patches to my vendor's BSP layer
> >
> > (based on Linux 3.4, if it matters) and a .bbappend to list the
> >
> > patches.
> >
> > One of the patches adds a header, and this header needs to
> >
> > be exported to the sysroot.
> >
> > I added the following to my .bbappend, based on a discussion
> >
> > I found:
> >
> > do_install_append() {
> >
> >      install -d ${D}${includedir}/linux
> >
> >      install -m 644 ${S}/include/linux/uc1698u.h
> > ${D}${includedir}/linux/uc1698u.h
> >
> > }
> >
> > It "works" (i.e., the header is installed in the sysroot) but there
> > must
> >
> > be more to it than that because I also get a warning about the header
> >
> > being "installed but not shipped in any package".
> >
> > What's the correct way to do this?
> 
> Not answering the question directly, but I can say that kernel's shouldn't be
> exporting their header files over the sysroot's
> include/linux/* directory structure, since that is where linux-libc-headers
> installs and manages the userspace safe headers for the c-library.
> 
> Sure you are probably installing a new file, and one that doesn't conflict
> with the existing libc-headers, but as soon as you start working in that
> directory structure .. you will eventually clobber an existing file.
> 
> There have been quite a few discussions on this topic over time on the oe-
> core and yocto lists. Look at the comment in the linux-libc-headers.inc file,
> and you'll see a note from Richard explaining why this shouldn't be done
> (searches on the mailing list archives will also find more hits).
> 
> When you install into the sysroot, the header file should also be in a
> FILES_<package> as part of your recipe .. and that is why you are seeing the
> warning. packaging it would remove the warning, but you'll still have the
> problem I mention above.
> 
> The right way is for your application to look at the STAGING_KERNEL_DIR,
> which will have a copy of that same header file.
> 
> Alternatively, you can stage your header file at a different sysroot location
> than include/linux/* and have your application look there.
> 
> I have an open enhancement that I'm doing for yocto 1.7 which automates
> the alternate header file structure, but doing it explicitly in your recipes will
> work for now.

Hi Bruce,

Thanks for your response. But I'm afraid I'm not entirely following you. I am
quite new to Yocto/OE, so I may be missing something fundamental/obvious.

Leaving aside the patch and .bbappend for the moment, presumably it is
normal for the kernel in the BSP layer to export headers for userland's
consumption. How is that specified? Where is the FILES_<package> that
lists those headers?

MV

Re: Exporting kernel header from patch

[Bruce Ashfield]

On 14-04-24 01:52 PM, Vuille, Martin (Martin) wrote:
>> From: Bruce Ashfield [mailto:bruce.ashfield@windriver.com]
>> Sent: April 24, 2014 1:32 PM
>>
>> On 14-04-24 11:57 AM, Vuille, Martin (Martin) wrote:
>>> I have a custom layer to add patches to my vendor's BSP layer
>>>
>>> (based on Linux 3.4, if it matters) and a .bbappend to list the
>>>
>>> patches.
>>>
>>> One of the patches adds a header, and this header needs to
>>>
>>> be exported to the sysroot.
>>>
>>> I added the following to my .bbappend, based on a discussion
>>>
>>> I found:
>>>
>>> do_install_append() {
>>>
>>>       install -d ${D}${includedir}/linux
>>>
>>>       install -m 644 ${S}/include/linux/uc1698u.h
>>> ${D}${includedir}/linux/uc1698u.h
>>>
>>> }
>>>
>>> It "works" (i.e., the header is installed in the sysroot) but there
>>> must
>>>
>>> be more to it than that because I also get a warning about the header
>>>
>>> being "installed but not shipped in any package".
>>>
>>> What's the correct way to do this?
>>
>> Not answering the question directly, but I can say that kernel's shouldn't be
>> exporting their header files over the sysroot's
>> include/linux/* directory structure, since that is where linux-libc-headers
>> installs and manages the userspace safe headers for the c-library.
>>
>> Sure you are probably installing a new file, and one that doesn't conflict
>> with the existing libc-headers, but as soon as you start working in that
>> directory structure .. you will eventually clobber an existing file.
>>
>> There have been quite a few discussions on this topic over time on the oe-
>> core and yocto lists. Look at the comment in the linux-libc-headers.inc file,
>> and you'll see a note from Richard explaining why this shouldn't be done
>> (searches on the mailing list archives will also find more hits).
>>
>> When you install into the sysroot, the header file should also be in a
>> FILES_<package> as part of your recipe .. and that is why you are seeing the
>> warning. packaging it would remove the warning, but you'll still have the
>> problem I mention above.
>>
>> The right way is for your application to look at the STAGING_KERNEL_DIR,
>> which will have a copy of that same header file.
>>
>> Alternatively, you can stage your header file at a different sysroot location
>> than include/linux/* and have your application look there.
>>
>> I have an open enhancement that I'm doing for yocto 1.7 which automates
>> the alternate header file structure, but doing it explicitly in your recipes will
>> work for now.
>
> Hi Bruce,
>
> Thanks for your response. But I'm afraid I'm not entirely following you. I am
> quite new to Yocto/OE, so I may be missing something fundamental/obvious.
>
> Leaving aside the patch and .bbappend for the moment, presumably it is
> normal for the kernel in the BSP layer to export headers for userland's
> consumption. How is that specified? Where is the FILES_<package> that
> lists those headers?

Actually, in the yocto world, it isn't. At least not in the sense that
you are looking for.

The kernel's source tree is staged for consumption by other packages
in the sysroot, accessible via the variable STAGING_KERNEL_DIR. That's
the first choice for an application to look for kernel header files.

The sysroots /usr/include/linux/* is strictly for the linux-libc-headers
package, and nothing else should be installing into that structure.

If you do need to export something to the sysroot, that isn't already
in the libc-headers, and you can't use the STAGING_KERNEL_DIR, then you
should be installing it to another directory structure like: 
/usr-alt/include/linux/*
and have your applications look there. You'd export and install them 
similarly
to what you are doing, and you'd need to package them similarly.

i.e. in the recipe:

PACKAGES += " kernel-extra-headers"
FILES_kernel-extra-headers = "/usr-alt/linux/*'

And you'd get the header in the sysroot, and avoid the QA warning about
it not being packaged.

Bruce



>
> MV
>

Re: Exporting kernel header from patch

[Vuille, Martin (Martin)]

> From: Bruce Ashfield
> Sent: April 24, 2014 2:01 PM
> To: Vuille, Martin (Martin); yocto@yoctoproject.org
> Subject: Re: [yocto] Exporting kernel header from patch
> 
> On 14-04-24 01:52 PM, Vuille, Martin (Martin) wrote:
> >> From: Bruce Ashfield
> >> Sent: April 24, 2014 1:32 PM
> >>
> >> On 14-04-24 11:57 AM, Vuille, Martin (Martin) wrote:
> >>> I have a custom layer to add patches to my vendor's BSP layer
> >>>
> >>> (based on Linux 3.4, if it matters) and a .bbappend to list the
> >>>
> >>> patches.
> >>>
> >>> One of the patches adds a header, and this header needs to
> >>>
> >>> be exported to the sysroot.
> >>>
> >>> I added the following to my .bbappend, based on a discussion
> >>>
> >>> I found:
> >>>
> >>> do_install_append() {
> >>>
> >>>       install -d ${D}${includedir}/linux
> >>>
> >>>       install -m 644 ${S}/include/linux/uc1698u.h
> >>> ${D}${includedir}/linux/uc1698u.h
> >>>
> >>> }
> >>>
> >>> It "works" (i.e., the header is installed in the sysroot) but there
> >>> must
> >>>
> >>> be more to it than that because I also get a warning about the
> >>> header
> >>>
> >>> being "installed but not shipped in any package".
> >>>
> >>> What's the correct way to do this?
> >>
> >> Not answering the question directly, but I can say that kernel's
> >> shouldn't be exporting their header files over the sysroot's
> >> include/linux/* directory structure, since that is where
> >> linux-libc-headers installs and manages the userspace safe headers for
> the c-library.
> >>
> >> Sure you are probably installing a new file, and one that doesn't
> >> conflict with the existing libc-headers, but as soon as you start
> >> working in that directory structure .. you will eventually clobber an
> existing file.
> >>
> >> There have been quite a few discussions on this topic over time on
> >> the oe- core and yocto lists. Look at the comment in the
> >> linux-libc-headers.inc file, and you'll see a note from Richard
> >> explaining why this shouldn't be done (searches on the mailing list
> archives will also find more hits).
> >>
> >> When you install into the sysroot, the header file should also be in
> >> a FILES_<package> as part of your recipe .. and that is why you are
> >> seeing the warning. packaging it would remove the warning, but you'll
> >> still have the problem I mention above.
> >>
> >> The right way is for your application to look at the
> >> STAGING_KERNEL_DIR, which will have a copy of that same header file.
> >>
> >> Alternatively, you can stage your header file at a different sysroot
> >> location than include/linux/* and have your application look there.
> >>
> >> I have an open enhancement that I'm doing for yocto 1.7 which
> >> automates the alternate header file structure, but doing it
> >> explicitly in your recipes will work for now.
> >
> > Hi Bruce,
> >
> > Thanks for your response. But I'm afraid I'm not entirely following
> > you. I am quite new to Yocto/OE, so I may be missing something
> fundamental/obvious.
> >
> > Leaving aside the patch and .bbappend for the moment, presumably it is
> > normal for the kernel in the BSP layer to export headers for
> > userland's consumption. How is that specified? Where is the
> > FILES_<package> that lists those headers?
> 
> Actually, in the yocto world, it isn't. At least not in the sense that you are
> looking for.
> 
> The kernel's source tree is staged for consumption by other packages in the
> sysroot, accessible via the variable STAGING_KERNEL_DIR. That's the first
> choice for an application to look for kernel header files.
> 
> The sysroots /usr/include/linux/* is strictly for the linux-libc-headers
> package, and nothing else should be installing into that structure.
> 
> If you do need to export something to the sysroot, that isn't already in the
> libc-headers, and you can't use the STAGING_KERNEL_DIR, then you should
> be installing it to another directory structure like:
> /usr-alt/include/linux/*
> and have your applications look there. You'd export and install them
> similarly to what you are doing, and you'd need to package them similarly.
> 
> i.e. in the recipe:
> 
> PACKAGES += " kernel-extra-headers"
> FILES_kernel-extra-headers = "/usr-alt/linux/*'
> 
> And you'd get the header in the sysroot, and avoid the QA warning about it
> not being packaged.
> 

I probably should've mentioned earlier that this header contains some ioctl
definitions that I need to import into some userland code.

If I include the header from STAGING_KERNEL_DIR, isn't that the "raw"
header, unprepared for inclusion from userland? (Of course, that was also
a problem with my original way of doing it, which I omitted from my OP).

What is special about the headers added to sysroot by linux-libc-headers?
If this driver were part of upstream instead of added by me, wouldn't its
header file be included in the sysroot by linux-libc-headers?

I understand that glibc was built against the headers from linux-libc-headers,
but that shouldn't matter since no one else but me knows about this new
header.

Is there a legitimate way for me to add to linux-libc-headers?

Apologies if I've gotten myself confused.

MV

Re: Exporting kernel header from patch

[Bruce Ashfield]

On 14-04-24 03:54 PM, Vuille, Martin (Martin) wrote:
>> From: Bruce Ashfield
>> Sent: April 24, 2014 2:01 PM
>> To: Vuille, Martin (Martin); yocto@yoctoproject.org
>> Subject: Re: [yocto] Exporting kernel header from patch
>>
>> On 14-04-24 01:52 PM, Vuille, Martin (Martin) wrote:
>>>> From: Bruce Ashfield
>>>> Sent: April 24, 2014 1:32 PM
>>>>
>>>> On 14-04-24 11:57 AM, Vuille, Martin (Martin) wrote:
>>>>> I have a custom layer to add patches to my vendor's BSP layer
>>>>>
>>>>> (based on Linux 3.4, if it matters) and a .bbappend to list the
>>>>>
>>>>> patches.
>>>>>
>>>>> One of the patches adds a header, and this header needs to
>>>>>
>>>>> be exported to the sysroot.
>>>>>
>>>>> I added the following to my .bbappend, based on a discussion
>>>>>
>>>>> I found:
>>>>>
>>>>> do_install_append() {
>>>>>
>>>>>        install -d ${D}${includedir}/linux
>>>>>
>>>>>        install -m 644 ${S}/include/linux/uc1698u.h
>>>>> ${D}${includedir}/linux/uc1698u.h
>>>>>
>>>>> }
>>>>>
>>>>> It "works" (i.e., the header is installed in the sysroot) but there
>>>>> must
>>>>>
>>>>> be more to it than that because I also get a warning about the
>>>>> header
>>>>>
>>>>> being "installed but not shipped in any package".
>>>>>
>>>>> What's the correct way to do this?
>>>>
>>>> Not answering the question directly, but I can say that kernel's
>>>> shouldn't be exporting their header files over the sysroot's
>>>> include/linux/* directory structure, since that is where
>>>> linux-libc-headers installs and manages the userspace safe headers for
>> the c-library.
>>>>
>>>> Sure you are probably installing a new file, and one that doesn't
>>>> conflict with the existing libc-headers, but as soon as you start
>>>> working in that directory structure .. you will eventually clobber an
>> existing file.
>>>>
>>>> There have been quite a few discussions on this topic over time on
>>>> the oe- core and yocto lists. Look at the comment in the
>>>> linux-libc-headers.inc file, and you'll see a note from Richard
>>>> explaining why this shouldn't be done (searches on the mailing list
>> archives will also find more hits).
>>>>
>>>> When you install into the sysroot, the header file should also be in
>>>> a FILES_<package> as part of your recipe .. and that is why you are
>>>> seeing the warning. packaging it would remove the warning, but you'll
>>>> still have the problem I mention above.
>>>>
>>>> The right way is for your application to look at the
>>>> STAGING_KERNEL_DIR, which will have a copy of that same header file.
>>>>
>>>> Alternatively, you can stage your header file at a different sysroot
>>>> location than include/linux/* and have your application look there.
>>>>
>>>> I have an open enhancement that I'm doing for yocto 1.7 which
>>>> automates the alternate header file structure, but doing it
>>>> explicitly in your recipes will work for now.
>>>
>>> Hi Bruce,
>>>
>>> Thanks for your response. But I'm afraid I'm not entirely following
>>> you. I am quite new to Yocto/OE, so I may be missing something
>> fundamental/obvious.
>>>
>>> Leaving aside the patch and .bbappend for the moment, presumably it is
>>> normal for the kernel in the BSP layer to export headers for
>>> userland's consumption. How is that specified? Where is the
>>> FILES_<package> that lists those headers?
>>
>> Actually, in the yocto world, it isn't. At least not in the sense that you are
>> looking for.
>>
>> The kernel's source tree is staged for consumption by other packages in the
>> sysroot, accessible via the variable STAGING_KERNEL_DIR. That's the first
>> choice for an application to look for kernel header files.
>>
>> The sysroots /usr/include/linux/* is strictly for the linux-libc-headers
>> package, and nothing else should be installing into that structure.
>>
>> If you do need to export something to the sysroot, that isn't already in the
>> libc-headers, and you can't use the STAGING_KERNEL_DIR, then you should
>> be installing it to another directory structure like:
>> /usr-alt/include/linux/*
>> and have your applications look there. You'd export and install them
>> similarly to what you are doing, and you'd need to package them similarly.
>>
>> i.e. in the recipe:
>>
>> PACKAGES += " kernel-extra-headers"
>> FILES_kernel-extra-headers = "/usr-alt/linux/*'
>>
>> And you'd get the header in the sysroot, and avoid the QA warning about it
>> not being packaged.
>>
>
> I probably should've mentioned earlier that this header contains some ioctl
> definitions that I need to import into some userland code.
>
> If I include the header from STAGING_KERNEL_DIR, isn't that the "raw"
> header, unprepared for inclusion from userland? (Of course, that was also
> a problem with my original way of doing it, which I omitted from my OP).

Yep, it is the kernel header without having been run through the uapi
export. But that doesn't mean it is immediately wrong, applications that
know what they are doing can look at headers directly.

>
> What is special about the headers added to sysroot by linux-libc-headers?
> If this driver were part of upstream instead of added by me, wouldn't its
> header file be included in the sysroot by linux-libc-headers?

Yes it would be, and then it forms part of the released kernel's ABI,
and is what the libc interface is based on. It also means that the
definitions are consistent across kernels of that same version. If you
are patching the kernel to add it, that no longer holds.

I assume you found the history and .inc file I pointed out ? They
explain a some of what I have above, but maybe not clearly enough. Those
exports are special, and are for the c library. They are not for kernel
exports to userspace. That's the way the system works, and it is to
ensure a sane and santized mapping between the c library and the kernel.

board specific exports (which is what you are describing), are done in
board specific ways, which I described as the options. When your application
is looking for something that is specific to your kernel, the application
is by definition board/arch specific, so can depend on the kernel to
get the headers that it needs.

>
> I understand that glibc was built against the headers from linux-libc-headers,
> but that shouldn't matter since no one else but me knows about this new
> header.

It's the slippery slope. Don't install into that structure since
someone can inadvertently change a syscall number, function signature,
or something else fundamental.

I realize you aren't doing that, but eventually someone will .. so
simply saying "don't do that", is the right thing to keep the system
sane and correct.

>
> Is there a legitimate way for me to add to linux-libc-headers?

You can bbappend and patch the source code. That means that you've 
considered
the change, and want it explicitly exported to userspace via the
libc-headers. That will also trigger the libc-headers signature to
change and then chain to a full system rebuild (Which is the
other reason we simply don't install into the c headers path).

Instead of doing that, see my suggestion about installing into an
alternate location and have your application put it on it's
include path .. a -I is pretty easy to add. Since the application
is clearly aware and in need of a special kernel capability, either
looking at the source directly, or using that alternate include are
not out of the ordinary.

Cheers,

Bruce

>
> Apologies if I've gotten myself confused.
>
> MV
>

Re: Exporting kernel header from patch

[Vuille, Martin (Martin)]

> From: Bruce Ashfield
> Sent: April 24, 2014 4:06 PM
> To: Vuille, Martin (Martin); yocto@yoctoproject.org
> Subject: Re: [yocto] Exporting kernel header from patch
> 
> On 14-04-24 03:54 PM, Vuille, Martin (Martin) wrote:
> >> From: Bruce Ashfield
> >> Sent: April 24, 2014 2:01 PM
> >> To: Vuille, Martin (Martin); yocto@yoctoproject.org
> >> Subject: Re: [yocto] Exporting kernel header from patch
> >>
> >> On 14-04-24 01:52 PM, Vuille, Martin (Martin) wrote:
> >>>> From: Bruce Ashfield
> >>>> Sent: April 24, 2014 1:32 PM
> >>>>
> >>>> On 14-04-24 11:57 AM, Vuille, Martin (Martin) wrote:
> >>>>> I have a custom layer to add patches to my vendor's BSP layer
> >>>>>
> >>>>> (based on Linux 3.4, if it matters) and a .bbappend to list the
> >>>>>
> >>>>> patches.
> >>>>>
> >>>>> One of the patches adds a header, and this header needs to
> >>>>>
> >>>>> be exported to the sysroot.
> >>>>>
> >>>>> I added the following to my .bbappend, based on a discussion
> >>>>>
> >>>>> I found:
> >>>>>
> >>>>> do_install_append() {
> >>>>>
> >>>>>        install -d ${D}${includedir}/linux
> >>>>>
> >>>>>        install -m 644 ${S}/include/linux/uc1698u.h
> >>>>> ${D}${includedir}/linux/uc1698u.h
> >>>>>
> >>>>> }
> >>>>>
> >>>>> It "works" (i.e., the header is installed in the sysroot) but
> >>>>> there must
> >>>>>
> >>>>> be more to it than that because I also get a warning about the
> >>>>> header
> >>>>>
> >>>>> being "installed but not shipped in any package".
> >>>>>
> >>>>> What's the correct way to do this?
> >>>>
> >>>> Not answering the question directly, but I can say that kernel's
> >>>> shouldn't be exporting their header files over the sysroot's
> >>>> include/linux/* directory structure, since that is where
> >>>> linux-libc-headers installs and manages the userspace safe headers
> >>>> for
> >> the c-library.
> >>>>
> >>>> Sure you are probably installing a new file, and one that doesn't
> >>>> conflict with the existing libc-headers, but as soon as you start
> >>>> working in that directory structure .. you will eventually clobber
> >>>> an
> >> existing file.
> >>>>
> >>>> There have been quite a few discussions on this topic over time on
> >>>> the oe- core and yocto lists. Look at the comment in the
> >>>> linux-libc-headers.inc file, and you'll see a note from Richard
> >>>> explaining why this shouldn't be done (searches on the mailing list
> >> archives will also find more hits).
> >>>>
> >>>> When you install into the sysroot, the header file should also be
> >>>> in a FILES_<package> as part of your recipe .. and that is why you
> >>>> are seeing the warning. packaging it would remove the warning, but
> >>>> you'll still have the problem I mention above.
> >>>>
> >>>> The right way is for your application to look at the
> >>>> STAGING_KERNEL_DIR, which will have a copy of that same header file.
> >>>>
> >>>> Alternatively, you can stage your header file at a different
> >>>> sysroot location than include/linux/* and have your application look
> there.
> >>>>
> >>>> I have an open enhancement that I'm doing for yocto 1.7 which
> >>>> automates the alternate header file structure, but doing it
> >>>> explicitly in your recipes will work for now.
> >>>
> >>> Hi Bruce,
> >>>
> >>> Thanks for your response. But I'm afraid I'm not entirely following
> >>> you. I am quite new to Yocto/OE, so I may be missing something
> >> fundamental/obvious.
> >>>
> >>> Leaving aside the patch and .bbappend for the moment, presumably it
> >>> is normal for the kernel in the BSP layer to export headers for
> >>> userland's consumption. How is that specified? Where is the
> >>> FILES_<package> that lists those headers?
> >>
> >> Actually, in the yocto world, it isn't. At least not in the sense
> >> that you are looking for.
> >>
> >> The kernel's source tree is staged for consumption by other packages
> >> in the sysroot, accessible via the variable STAGING_KERNEL_DIR.
> >> That's the first choice for an application to look for kernel header files.
> >>
> >> The sysroots /usr/include/linux/* is strictly for the
> >> linux-libc-headers package, and nothing else should be installing into
> that structure.
> >>
> >> If you do need to export something to the sysroot, that isn't already
> >> in the libc-headers, and you can't use the STAGING_KERNEL_DIR, then
> >> you should be installing it to another directory structure like:
> >> /usr-alt/include/linux/*
> >> and have your applications look there. You'd export and install them
> >> similarly to what you are doing, and you'd need to package them
> similarly.
> >>
> >> i.e. in the recipe:
> >>
> >> PACKAGES += " kernel-extra-headers"
> >> FILES_kernel-extra-headers = "/usr-alt/linux/*'
> >>
> >> And you'd get the header in the sysroot, and avoid the QA warning
> >> about it not being packaged.
> >>
> >
> > I probably should've mentioned earlier that this header contains some
> > ioctl definitions that I need to import into some userland code.
> >
> > If I include the header from STAGING_KERNEL_DIR, isn't that the "raw"
> > header, unprepared for inclusion from userland? (Of course, that was
> > also a problem with my original way of doing it, which I omitted from my
> OP).
> 
> Yep, it is the kernel header without having been run through the uapi
> export. But that doesn't mean it is immediately wrong, applications that
> know what they are doing can look at headers directly.
> 
> >
> > What is special about the headers added to sysroot by linux-libc-headers?
> > If this driver were part of upstream instead of added by me, wouldn't
> > its header file be included in the sysroot by linux-libc-headers?
> 
> Yes it would be, and then it forms part of the released kernel's ABI, and is
> what the libc interface is based on. It also means that the definitions are
> consistent across kernels of that same version. If you are patching the
> kernel to add it, that no longer holds.
> 
> I assume you found the history and .inc file I pointed out ? They explain a
> some of what I have above, but maybe not clearly enough. Those exports
> are special, and are for the c library. They are not for kernel exports to
> userspace. That's the way the system works, and it is to ensure a sane and
> santized mapping between the c library and the kernel.
> 
> board specific exports (which is what you are describing), are done in board
> specific ways, which I described as the options. When your application is
> looking for something that is specific to your kernel, the application is by
> definition board/arch specific, so can depend on the kernel to get the
> headers that it needs.
> 
> >
> > I understand that glibc was built against the headers from
> > linux-libc-headers, but that shouldn't matter since no one else but me
> > knows about this new header.
> 
> It's the slippery slope. Don't install into that structure since someone can
> inadvertently change a syscall number, function signature, or something
> else fundamental.
> 
> I realize you aren't doing that, but eventually someone will .. so simply
> saying "don't do that", is the right thing to keep the system sane and correct.
> 
> >
> > Is there a legitimate way for me to add to linux-libc-headers?
> 
> You can bbappend and patch the source code. That means that you've
> considered the change, and want it explicitly exported to userspace via the
> libc-headers. That will also trigger the libc-headers signature to change and
> then chain to a full system rebuild (Which is the other reason we simply
> don't install into the c headers path).
> 
> Instead of doing that, see my suggestion about installing into an alternate
> location and have your application put it on it's include path .. a -I is pretty
> easy to add. Since the application is clearly aware and in need of a special
> kernel capability, either looking at the source directly, or using that
> alternate include are not out of the ordinary.
> 

Thanks for the detailed explanation. I will head in the direction of a separate
location for that (and any other board-specific) headers.

MV

Re: Exporting kernel header from patch

[Gamma.Dean]

[-- Attachment #1: Type: text/plain, Size: 1463 bytes --]

I didn’t find “rm_work” in any of my conf files so I don’t think that’s the issue.

It appears that STAGING_KERNEL_DIR just doesn’t get rebuilt from sstate which I can understand since it isn’t needed by default.  I found a way to set up the dependencies to build it when needed and I started a new thread over on the oe-core list titled “Rebuilding STAGING_KERNEL_DIR from sstate cache” regarding that.

Thanks!

From: Daniel. [mailto:danielhilst@gmail.com]
Sent: Wednesday, July 22, 2015 9:03 PM
To: Dean, Gamma [NETPWR/FL]
Cc: yocto@yoctoproject.org
Subject: Re: [yocto] Exporting kernel header from patch


Just a guess,

Did you have INHERIT += "rm_work" in your local.conf?

Cheers,
- dhs
Em 22/07/2015 18:36, <Gamma.Dean@emerson.com<mailto:Gamma.Dean@emerson.com>> escreveu:
When using a shared sstate cache which has the previously built kernel it appears that STAGING_KERNEL_DIR does not get populated – in my case there is no tmp/work-shared directory at all.  If I have modified the user space app to look there for a header is there some dependency I can add that will force STAGING_KERNEL_DIR to get built?

If not, perhaps the best answer is your other proposed method of just adding the header to an additional path in sysroot.

--
_______________________________________________
yocto mailing list
yocto@yoctoproject.org<mailto:yocto@yoctoproject.org>
https://lists.yoctoproject.org/listinfo/yocto

[-- Attachment #2: Type: text/html, Size: 5086 bytes --]

Re: Exporting kernel header from patch

[Daniel.]

[-- Attachment #1: Type: text/plain, Size: 771 bytes --]

Just a guess,

Did you have INHERIT += "rm_work" in your local.conf?

Cheers,
- dhs
Em 22/07/2015 18:36, <Gamma.Dean@emerson.com> escreveu:

 When using a shared sstate cache which has the previously built kernel it
appears that STAGING_KERNEL_DIR does not get populated – in my case there
is no tmp/work-shared directory at all.  If I have modified the user space
app to look there for a header is there some dependency I can add that will
force STAGING_KERNEL_DIR to get built?



If not, perhaps the best answer is your other proposed method of just
adding the header to an additional path in sysroot.

--
_______________________________________________
yocto mailing list
yocto@yoctoproject.org
https://lists.yoctoproject.org/listinfo/yocto

[-- Attachment #2: Type: text/html, Size: 1403 bytes --]

Re: Exporting kernel header from patch

[Gamma.Dean]

[-- Attachment #1: Type: text/plain, Size: 464 bytes --]

When using a shared sstate cache which has the previously built kernel it appears that STAGING_KERNEL_DIR does not get populated - in my case there is no tmp/work-shared directory at all.  If I have modified the user space app to look there for a header is there some dependency I can add that will force STAGING_KERNEL_DIR to get built?

If not, perhaps the best answer is your other proposed method of just adding the header to an additional path in sysroot.

[-- Attachment #2: Type: text/html, Size: 2127 bytes --]