All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Armin Kuster" <akuster808@gmail.com>
To: Richard Purdie <richard.purdie@linuxfoundation.org>,
	openembedded-core <openembedded-core@lists.openembedded.org>
Cc: Joshua Watt <JPEWhacker@gmail.com>,
	Michael Halstead <mhalstead@linuxfoundation.org>
Subject: Re: [OE-core] Public project sstate/hash equivalence mirror now live
Date: Sun, 12 Sep 2021 07:55:17 -0700	[thread overview]
Message-ID: <95bf1261-eb40-cafa-3153-0c472142fb98@gmail.com> (raw)
In-Reply-To: <0b6111c1d71f1665cacafafaea972e609a77a0cd.camel@linuxfoundation.org>



On 9/12/21 4:46 AM, Richard Purdie wrote:
> We made the autobuilder sstate public a while ago but it wasn't useful after we
> switched to hash equivalence by default. I'm pleased to be able to report that
> we now have a read-only public server for the hash equivalence. We did have to
> fix a small API omission and a couple of sstate related bugs but I'm pleased to
> be able to report it is now operational and usable. An example config would be:
>
> SSTATE_MIRRORS ?= "file://.* http://sstate.yoctoproject.org/dev/PATH;downloadfilename=PATH"
> BB_HASHSERVE_UPSTREAM = "typhoon.yocto.io:8687"
>
> I've included an example image build below where it took 11 minutes for a 
> core-image-minimal image build. Obviously this is only of benefit if you're
> building configurations that match the project autobuilder although hash
> equivalence could be useful alone in reducing some build times.

What branches that support hash equivalence will be available other than
Master?


>
> I have updated the local.conf sample file in poky to match the new release.
> We're not widely highlighting that information as yet as it remains to be seen
> how well it scales and what the hosting impacts for it will look like but it is
> there to experiment with to a wider audience such as this list.

The should improve the out-of-the-box experience.

thanks,

> The builds will sit for a long time whilst it queries hash equivalency and I
> appreciate the UI feedback could be better there but one step at a time!
>
> Cheers,
>
> Richard
>
> $ time bitbake core-image-minimal
> Loading cache: 100% |                                                                                                                                                       | ETA:  --:--:--
> Loaded 0 entries from dependency cache.
> Parsing recipes: 100% |######################################################################################################################################################| Time: 0:00:03
> Parsing of 871 .bb files complete (0 cached, 871 parsed). 1519 targets, 49 skipped, 0 masked, 0 errors.
> NOTE: Resolving any missing task queue dependencies
>
> Build Configuration:
> BB_VERSION           = "1.51.1"
> BUILD_SYS            = "x86_64-linux"
> NATIVELSBSTRING      = "ubuntu-20.04"
> TARGET_SYS           = "x86_64-poky-linux"
> MACHINE              = "qemux86-64"
> DISTRO               = "poky"
> DISTRO_VERSION       = "3.3+snapshot-89e48765083f15bf79839a778d08a68f8aece51d"
> TUNE_FEATURES        = "m64 core2"
> TARGET_FPU           = ""
> meta                 
> meta-poky            
> meta-yocto-bsp       
> meta-selftest        = "master:89e48765083f15bf79839a778d08a68f8aece51d"
>
> Initialising tasks: 100% |###################################################################################################################################################| Time: 0:03:40
> Checking sstate mirror object availability: 100% |###########################################################################################################################| Time: 0:00:28
> Sstate summary: Wanted 1525 Local 0 Network 1515 Missed 10 Current 0 (99% match, 0% complete)
> NOTE: Executing Tasks
> NOTE: Tasks Summary: Attempted 3913 tasks of which 3603 didn't need to be rerun and all succeeded.
>
> real	11m2.578s
> user	0m42.927s
> sys	0m9.963s
>
>
>
>
> 
>


  reply	other threads:[~2021-09-12 14:55 UTC|newest]

Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-09-12 11:46 Public project sstate/hash equivalence mirror now live Richard Purdie
2021-09-12 14:55 ` Armin Kuster [this message]
2021-09-12 15:58   ` [OE-core] " Richard Purdie
2021-09-12 16:01     ` Joshua Watt
2021-09-14 15:27       ` Konrad Weihmann
2021-09-14 16:26         ` Richard Purdie

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=95bf1261-eb40-cafa-3153-0c472142fb98@gmail.com \
    --to=akuster808@gmail.com \
    --cc=JPEWhacker@gmail.com \
    --cc=mhalstead@linuxfoundation.org \
    --cc=openembedded-core@lists.openembedded.org \
    --cc=richard.purdie@linuxfoundation.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.