Recipe versions and layer confusion

Recipe versions and layer confusion

[Mike Looijmans]

I'm confused.

Layer "meta-xilinx" defines:

recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.1.bb

This recipe is too old for my liking, so I made a newer one in "meta-topic"

recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.3.bb


Much to my surprise, when I build, OE picks the 2017.1 version and not the 
2017.3 version.

bitbake-layers show-layers reveils:
..
meta-xilinx           /home/mike/projects/zynq-platform/meta-xilinx  5
meta-topic            /home/mike/projects/zynq-platform/meta-topic  6
..

so that means that my meta-topic should win even if my PV were lower, right?


Kind regards,

Mike Looijmans
System Expert

TOPIC Products
Materiaalweg 4, NL-5681 RJ Best
Postbus 440, NL-5680 AK Best
Telefoon: +31 (0) 499 33 69 79
E-mail: mike.looijmans@topicproducts.com
Website: www.topicproducts.com

Please consider the environment before printing this e-mail


Visit us at the Space Tech Expo Europe (Stand E-71)

Re: Recipe versions and layer confusion

[Mark Hatle]

On 10/5/17 9:49 AM, Mike Looijmans wrote:
> I'm confused.
> 
> Layer "meta-xilinx" defines:
> 
> recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.1.bb
> 
> This recipe is too old for my liking, so I made a newer one in "meta-topic"
> 
> recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.3.bb
> 
> 
> Much to my surprise, when I build, OE picks the 2017.1 version and not the 
> 2017.3 version.

Typically the version is selected by whichever PV is 'higher'.  However there
are many ways to change this behavior.

The primary way is for a configuration file (often the machine configuration) to
defined a preferred version.  I.e.

  PREFERRED_VERSION_arm-trusted-firmware = "2017.1"

Most likely there is a line like that someone in meta-xilinx.

Additional ways would be to have a recipe define itself as never the default
version.

> bitbake-layers show-layers reveils:
> ..
> meta-xilinx           /home/mike/projects/zynq-platform/meta-xilinx  5
> meta-topic            /home/mike/projects/zynq-platform/meta-topic  6
> ..

The layer priority does not directly affect recipe selection.  It may if you
have two layers of the -same- version.

--Mark

> so that means that my meta-topic should win even if my PV were lower, right?
> 
> 
> Kind regards,
> 
> Mike Looijmans
> System Expert
> 
> TOPIC Products
> Materiaalweg 4, NL-5681 RJ Best
> Postbus 440, NL-5680 AK Best
> Telefoon: +31 (0) 499 33 69 79
> E-mail: mike.looijmans@topicproducts.com
> Website: www.topicproducts.com
> 
> Please consider the environment before printing this e-mail
> 
> 
> Visit us at the Space Tech Expo Europe (Stand E-71)
> 

Re: Recipe versions and layer confusion

[Mike Looijmans]

On 05-10-17 16:59, Mark Hatle wrote:
> On 10/5/17 9:49 AM, Mike Looijmans wrote:
>> I'm confused.
>>
>> Layer "meta-xilinx" defines:
>>
>> recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.1.bb
>>
>> This recipe is too old for my liking, so I made a newer one in "meta-topic"
>>
>> recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.3.bb
>>
>>
>> Much to my surprise, when I build, OE picks the 2017.1 version and not the
>> 2017.3 version.
> 
> Typically the version is selected by whichever PV is 'higher'.  However there
> are many ways to change this behavior.
> 
> The primary way is for a configuration file (often the machine configuration) to
> defined a preferred version.  I.e.
> 
>    PREFERRED_VERSION_arm-trusted-firmware = "2017.1"
> 
> Most likely there is a line like that someone in meta-xilinx.

Nope, no such line.

> 
> Additional ways would be to have a recipe define itself as never the default
> version.
> 
>> bitbake-layers show-layers reveils:
>> ..
>> meta-xilinx           /home/mike/projects/zynq-platform/meta-xilinx  5
>> meta-topic            /home/mike/projects/zynq-platform/meta-topic  6
>> ..
> 
> The layer priority does not directly affect recipe selection.  It may if you
> have two layers of the -same- version.
> 
> --Mark
> 
>> so that means that my meta-topic should win even if my PV were lower, right?
>>
>>
>> Kind regards,
>>
>> Mike Looijmans
>> System Expert
>>
>> TOPIC Products
>> Materiaalweg 4, NL-5681 RJ Best
>> Postbus 440, NL-5680 AK Best
>> Telefoon: +31 (0) 499 33 69 79
>> E-mail: mike.looijmans@topicproducts.com
>> Website: www.topicproducts.com
>>
>> Please consider the environment before printing this e-mail
>>
>>
>> Visit us at the Space Tech Expo Europe (Stand E-71)
>>
> 



Kind regards,

Mike Looijmans
System Expert

TOPIC Products
Materiaalweg 4, NL-5681 RJ Best
Postbus 440, NL-5680 AK Best
Telefoon: +31 (0) 499 33 69 79
E-mail: mike.looijmans@topicproducts.com
Website: www.topicproducts.com

Please consider the environment before printing this e-mail


Visit us at the Space Tech Expo Europe (Stand E-71)

Re: Recipe versions and layer confusion

[Leonardo Sandoval]

On Thu, 5 Oct 2017 16:49:28 +0200
Mike Looijmans <mike.looijmans@topic.nl> wrote:

> I'm confused.
> 
> Layer "meta-xilinx" defines:
> 
> recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.1.bb
> 
> This recipe is too old for my liking, so I made a newer one in "meta-topic"
> 
> recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.3.bb
> 
> 
> Much to my surprise, when I build, OE picks the 2017.1 version and not the 
> 2017.3 version.
> 
> bitbake-layers show-layers reveils:
> ..
> meta-xilinx           /home/mike/projects/zynq-platform/meta-xilinx  5
> meta-topic            /home/mike/projects/zynq-platform/meta-topic  6
> ..
> 
> so that means that my meta-topic should win even if my PV were lower, right?

"For example, a layer that has a recipe with a higher PV value but for which the BBFILE_PRIORITY is set to have a lower precedence still has a lower precedence."

taken from

http://www.yoctoproject.org/docs/2.3.2/mega-manual/mega-manual.html#var-BBFILE_PRIORITY

> 
> 
> Kind regards,
> 
> Mike Looijmans
> System Expert
> 
> TOPIC Products
> Materiaalweg 4, NL-5681 RJ Best
> Postbus 440, NL-5680 AK Best
> Telefoon: +31 (0) 499 33 69 79
> E-mail: mike.looijmans@topicproducts.com
> Website: www.topicproducts.com
> 
> Please consider the environment before printing this e-mail
> 
> 
> Visit us at the Space Tech Expo Europe (Stand E-71)
> -- 
> _______________________________________________
> Openembedded-core mailing list
> Openembedded-core@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-core


-- 
Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com>

Re: Recipe versions and layer confusion

[Paul Eggleton]

Hi Mike,

On Friday, 6 October 2017 3:49:28 AM NZDT Mike Looijmans wrote:
> I'm confused.
> 
> Layer "meta-xilinx" defines:
> 
> recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.1.bb
> 
> This recipe is too old for my liking, so I made a newer one in "meta-topic"
> 
> recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.3.bb
> 
> 
> Much to my surprise, when I build, OE picks the 2017.1 version and not the 
> 2017.3 version.
> 
> bitbake-layers show-layers reveils:
> ..
> meta-xilinx           /home/mike/projects/zynq-platform/meta-xilinx  5
> meta-topic            /home/mike/projects/zynq-platform/meta-topic  6
> ..
> 
> so that means that my meta-topic should win even if my PV were lower, right?

At face value I would have to agree - it doesn't sound like it's working the 
way it should.

What does bitbake-layers show-recipes  arm-trusted-firmware show ?

Another diagnostic would be to do bitbake -DDD arm-trusted-firmware and see if 
it gives any explanation as to why it's picking the older version (you'll have 
to wade through all of the other irrelevant debug info though).

Cheers,
Paul

-- 

Paul Eggleton
Intel Open Source Technology Centre

Re: Recipe versions and layer confusion

[Leonardo Sandoval]

On Thu, 5 Oct 2017 10:19:18 -0500
Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com> wrote:

> On Thu, 5 Oct 2017 16:49:28 +0200
> Mike Looijmans <mike.looijmans@topic.nl> wrote:
> 
> > I'm confused.
> > 
> > Layer "meta-xilinx" defines:
> > 
> > recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.1.bb
> > 
> > This recipe is too old for my liking, so I made a newer one in "meta-topic"
> > 
> > recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.3.bb
> > 
> > 
> > Much to my surprise, when I build, OE picks the 2017.1 version and not the 
> > 2017.3 version.
> > 
> > bitbake-layers show-layers reveils:
> > ..
> > meta-xilinx           /home/mike/projects/zynq-platform/meta-xilinx  5
> > meta-topic            /home/mike/projects/zynq-platform/meta-topic  6
> > ..
> > 
> > so that means that my meta-topic should win even if my PV were lower, right?
> 
> "For example, a layer that has a recipe with a higher PV value but for which the BBFILE_PRIORITY is set to have a lower precedence still has a lower precedence."

My bad. topic has higher priority than xilinx, so there is something wrong as you mentioned.

Leo


> 
> taken from
> 
> http://www.yoctoproject.org/docs/2.3.2/mega-manual/mega-manual.html#var-BBFILE_PRIORITY
> 
> > 
> > 
> > Kind regards,
> > 
> > Mike Looijmans
> > System Expert
> > 
> > TOPIC Products
> > Materiaalweg 4, NL-5681 RJ Best
> > Postbus 440, NL-5680 AK Best
> > Telefoon: +31 (0) 499 33 69 79
> > E-mail: mike.looijmans@topicproducts.com
> > Website: www.topicproducts.com
> > 
> > Please consider the environment before printing this e-mail
> > 
> > 
> > Visit us at the Space Tech Expo Europe (Stand E-71)
> > -- 
> > _______________________________________________
> > Openembedded-core mailing list
> > Openembedded-core@lists.openembedded.org
> > http://lists.openembedded.org/mailman/listinfo/openembedded-core
> 
> 
> -- 
> Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com>
> -- 
> _______________________________________________
> Openembedded-core mailing list
> Openembedded-core@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-core


-- 
Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com>

Re: Recipe versions and layer confusion

[Andre McCurdy]

On Thu, Oct 5, 2017 at 2:44 PM, Leonardo Sandoval
<leonardo.sandoval.gonzalez@linux.intel.com> wrote:
> On Thu, 5 Oct 2017 10:19:18 -0500
> Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com> wrote:
>
>> On Thu, 5 Oct 2017 16:49:28 +0200
>> Mike Looijmans <mike.looijmans@topic.nl> wrote:
>>
>> > I'm confused.
>> >
>> > Layer "meta-xilinx" defines:
>> >
>> > recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.1.bb
>> >
>> > This recipe is too old for my liking, so I made a newer one in "meta-topic"
>> >
>> > recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.3.bb
>> >
>> >
>> > Much to my surprise, when I build, OE picks the 2017.1 version and not the
>> > 2017.3 version.
>> >
>> > bitbake-layers show-layers reveils:
>> > ..
>> > meta-xilinx           /home/mike/projects/zynq-platform/meta-xilinx  5
>> > meta-topic            /home/mike/projects/zynq-platform/meta-topic  6
>> > ..
>> >
>> > so that means that my meta-topic should win even if my PV were lower, right?

Yes. The comments in bitbake/lib/bb/providers.py -> findBestProvider()
explain the process pretty well:

  If there is a PREFERRED_VERSION, find the highest-priority bbfile
  providing that version.  If not, find the latest version provided by
  an bbfile in the highest-priority set.

The only caveat is that if PREFERRED_VERSION contains a wildcard (%)
and matches more than one available version then all bets are off and
results may be unpredictable. It's up to the user to ensure that
doesn't happen.

Note that looking at the meta-xilinx recipe it seems that PV is set
manually and doesn't follow the recipe name, so depending on how you
set PV in your new recipe, it may not be completely obvious which
recipe is actually being used?

  https://github.com/Xilinx/meta-xilinx/blob/master/recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.1.bb

Re: Recipe versions and layer confusion

[Khem Raj]

On Thu, Oct 5, 2017 at 7:49 AM, Mike Looijmans <mike.looijmans@topic.nl> wrote:
> I'm confused.
>
> Layer "meta-xilinx" defines:
>
> recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.1.bb
>
> This recipe is too old for my liking, so I made a newer one in "meta-topic"
>
> recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.3.bb
>
>
> Much to my surprise, when I build, OE picks the 2017.1 version and not the
> 2017.3 version.
>
> bitbake-layers show-layers reveils:
> ..
> meta-xilinx           /home/mike/projects/zynq-platform/meta-xilinx  5
> meta-topic            /home/mike/projects/zynq-platform/meta-topic  6
> ..
>
> so that means that my meta-topic should win even if my PV were lower, right?
>

what does your BBPATH look like

Re: Recipe versions and layer confusion

[Mike Looijmans]

On 06-10-17 00:10, Andre McCurdy wrote:
> On Thu, Oct 5, 2017 at 2:44 PM, Leonardo Sandoval
> <leonardo.sandoval.gonzalez@linux.intel.com> wrote:
>> On Thu, 5 Oct 2017 10:19:18 -0500
>> Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com> wrote:
>>
>>> On Thu, 5 Oct 2017 16:49:28 +0200
>>> Mike Looijmans <mike.looijmans@topic.nl> wrote:
>>>
>>>> I'm confused.
>>>>
>>>> Layer "meta-xilinx" defines:
>>>>
>>>> recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.1.bb
>>>>
>>>> This recipe is too old for my liking, so I made a newer one in "meta-topic"
>>>>
>>>> recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.3.bb
>>>>
>>>>
>>>> Much to my surprise, when I build, OE picks the 2017.1 version and not the
>>>> 2017.3 version.
>>>>
>>>> bitbake-layers show-layers reveils:
>>>> ..
>>>> meta-xilinx           /home/mike/projects/zynq-platform/meta-xilinx  5
>>>> meta-topic            /home/mike/projects/zynq-platform/meta-topic  6
>>>> ..
>>>>
>>>> so that means that my meta-topic should win even if my PV were lower, right?
> 
> Yes. The comments in bitbake/lib/bb/providers.py -> findBestProvider()
> explain the process pretty well:
> 
>    If there is a PREFERRED_VERSION, find the highest-priority bbfile
>    providing that version.  If not, find the latest version provided by
>    an bbfile in the highest-priority set.
> 
> The only caveat is that if PREFERRED_VERSION contains a wildcard (%)
> and matches more than one available version then all bets are off and
> results may be unpredictable. It's up to the user to ensure that
> doesn't happen.
> 
> Note that looking at the meta-xilinx recipe it seems that PV is set
> manually and doesn't follow the recipe name, so depending on how you
> set PV in your new recipe, it may not be completely obvious which
> recipe is actually being used?
> 
>    https://github.com/Xilinx/meta-xilinx/blob/master/recipes-bsp/arm-trusted-firmware/arm-trusted-firmware_2017.1.bb
> 

Yeah, that turned out to be the problem. The recipe is versioned as 
"2017.1" but that is not the version it will actually build.

"bitbake-layers show-recipes arm-trusted-firmware" reveiled the true 
versions, as Paul suggested, and that explained the strange choices.

-- 
Mike Looijmans


Kind regards,

Mike Looijmans
System Expert

TOPIC Products
Materiaalweg 4, NL-5681 RJ Best
Postbus 440, NL-5680 AK Best
Telefoon: +31 (0) 499 33 69 79
E-mail: mike.looijmans@topicproducts.com
Website: www.topicproducts.com

Please consider the environment before printing this e-mail


Visit us at the Space Tech Expo Europe (Stand E-71)