From: Richard Purdie <richard.purdie@linuxfoundation.org>
To: bitbake-devel <bitbake-devel@lists.openembedded.org>
Cc: Joshua Watt <JPEWhacker@gmail.com>
Subject: Cache timings with various changes
Date: Wed, 23 Nov 2022 00:07:11 +0000 [thread overview]
Message-ID: <f963c6619df931162db7de468699d2aad0c1b76a.camel@linuxfoundation.org> (raw)
I've talked about changing the data we cache in various forums. These
are some actual numbers from a local system (88 core):
Patch Full reparse time Cache load time Cache size (compressed) Cache size (uncompressed)
----- ----------------- --------------- ----------------------- -------------------------
master baseline 5.732s 2.261s N/A 24M
frozenset changes 4.326s 2.289s N/A 24M
pickle in one 4.509s 2.177s N/A 24M
compress with zstd 6.040s 2.204s 3.4M 24M
add hash data to cache 9.693s 4.327s 17M 83M
It seems the frozenset improvements I have speed things up nicely and
look like a good change. The compression does slow things down, as does
pickling the cache in one go.
The patches are in poky-contrib rpurdie/t222. I'll post the frozenset
one, the others look like they need more thought.
Cheers,
Richard
next reply other threads:[~2022-11-23 0:07 UTC|newest]
Thread overview: 3+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-11-23 0:07 Richard Purdie [this message]
2022-11-23 4:33 ` [bitbake-devel] Cache timings with various changes Peter Kjellerstedt
2022-11-23 12:24 ` Richard Purdie
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=f963c6619df931162db7de468699d2aad0c1b76a.camel@linuxfoundation.org \
--to=richard.purdie@linuxfoundation.org \
--cc=JPEWhacker@gmail.com \
--cc=bitbake-devel@lists.openembedded.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.