All of lore.kernel.org
 help / color / mirror / Atom feed
From: Denys Dmytriyenko <denis@denix.org>
To: "Tammana, Gowtham" <g-tammana@ti.com>
Cc: "meta-arago@arago-project.org" <meta-arago@arago-project.org>,
	"denys@konsulko.com" <denys@konsulko.com>
Subject: Re: [EXTERNAL] Re: [dunfell/master][PATCH] oe-layertool-setup: Let user change parallel build options
Date: Fri, 16 Apr 2021 18:14:43 -0400	[thread overview]
Message-ID: <20210416221443.GG15937@denix.org> (raw)
In-Reply-To: <f2929faefdb04e42a15049e1d35ed672@ti.com>

On Fri, Apr 16, 2021 at 10:11:27PM +0000, Tammana, Gowtham wrote:
> 
> 
> >-----Original Message-----
> >From: Denys Dmytriyenko <denis@denix.org>
> >Sent: Friday, April 16, 2021 5:00 PM
> >To: Tammana, Gowtham <g-tammana@ti.com>
> >Cc: meta-arago@arago-project.org; Bajjuri, Praneeth <praneeth@ti.com>;
> >denys@konsulko.com
> >Subject: [EXTERNAL] Re: [meta-arago] [dunfell/master][PATCH] oe-layertool-
> >setup: Let user change parallel build options
> >
> >I guess this is for [oe-layersetup] project, not [dunfell/master] branch
> >of
> >meta-arago, recipe oe-layertool-setup :)
> 
> Oops. Will send v2.
> 
> >
> >You are changing local.conf, which is user-modifiable anyway, so what's
> >the
> >point in making it weak here?
> 
> That is true, but this makes the option configurable per recipe basis. For
> e.g. I could do below for resource heavy recipe and switch back to default
> for the rest without having to change the local.conf file.
> 
> BB_NUMBER_THREADS=2 PARALLEL_MAKE="-j 2" bitbake qtwebkit

I see, sounds reasonable.


> Thanks,
> Gowtham
> 
> >
> >
> >On Fri, Apr 16, 2021 at 03:34:37PM -0500, Gowtham Tammana wrote:
> >> Change BB_NUMBER_THREADS and PARALLEL_MAKE to weak assignment so that
> >> these can be changed when building recipes. Useful on machines with
> >> lower resources.
> >>
> >> Signed-off-by: Gowtham Tammana <g-tammana@ti.com>
> >> ---
> >>
> >> Changing parallel build options is the only way I can build the complete
> >image
> >> on my system :).
> >>
> >> Thanks,
> >> Gowtham
> >>
> >>  oe-layertool-setup.sh                           | 4 ++--
> >>  sample-files/local-amsdk.conf.sample            | 4 ++--
> >>  sample-files/local-arago.conf.sample            | 4 ++--
> >>  sample-files/local-arago64.conf.sample          | 4 ++--
> >>  sample-files/local-glsdk.conf.sample            | 4 ++--
> >>  sample-files/local-poky.conf.sample             | 4 ++--
> >>  sample-files/local-processor-sdk-64.conf.sample | 4 ++--
> >>  sample-files/local-processor-sdk.conf.sample    | 4 ++--
> >>  sample-files/local.conf.sample                  | 4 ++--
> >>  9 files changed, 18 insertions(+), 18 deletions(-)
> >>
> >> diff --git a/oe-layertool-setup.sh b/oe-layertool-setup.sh
> >> index aa16042..df1523f 100755
> >> --- a/oe-layertool-setup.sh
> >> +++ b/oe-layertool-setup.sh
> >> @@ -753,8 +753,8 @@ EOM
> >>      # set the number of threads
> >>      threads=`cat /proc/cpuinfo | grep -c processor`
> >>      tnum=`expr \( ${threads} + 1 \) \* 75 / 100`
> >> -    sed -i "s/^PARALLEL_MAKE.*/PARALLEL_MAKE = \"-j ${tnum}\"/"
> >$confdir/local.conf
> >> -    sed -i "s/^BB_NUMBER_THREADS.*/BB_NUMBER_THREADS = \"${tnum}\"/"
> >$confdir/local.conf
> >> +    sed -i "s/^PARALLEL_MAKE.*/PARALLEL_MAKE ?= \"-j ${tnum}\"/"
> >$confdir/local.conf
> >> +    sed -i "s/^BB_NUMBER_THREADS.*/BB_NUMBER_THREADS ?= \"${tnum}\"/"
> >$confdir/local.conf
> >>
> >>      # Find if old DL_DIR was set
> >>      if [ -e $confdir/local.conf.bak ]
> >> diff --git a/sample-files/local-amsdk.conf.sample b/sample-files/local-
> >amsdk.conf.sample
> >> index 756286d..ac39788 100644
> >> --- a/sample-files/local-amsdk.conf.sample
> >> +++ b/sample-files/local-amsdk.conf.sample
> >> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> >>  # These two options control how much parallelism BitBake should use.
> >The first
> >>  # option determines how many tasks bitbake should run in parallel:
> >>  #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >>  #
> >>  # The second option controls how many processes make should run in
> >parallel when
> >>  # running compile tasks:
> >>  #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >>  #
> >>  # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >>  # be appropriate for example
> >> diff --git a/sample-files/local-arago.conf.sample b/sample-files/local-
> >arago.conf.sample
> >> index 96dfaf9..62f0f92 100644
> >> --- a/sample-files/local-arago.conf.sample
> >> +++ b/sample-files/local-arago.conf.sample
> >> @@ -138,12 +138,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> >>  # These two options control how much parallelism BitBake should use.
> >The first
> >>  # option determines how many tasks bitbake should run in parallel:
> >>  #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >>  #
> >>  # The second option controls how many processes make should run in
> >parallel when
> >>  # running compile tasks:
> >>  #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >>  #
> >>  # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >>  # be appropriate for example
> >> diff --git a/sample-files/local-arago64.conf.sample b/sample-
> >files/local-arago64.conf.sample
> >> index f48db77..68f0bff 100644
> >> --- a/sample-files/local-arago64.conf.sample
> >> +++ b/sample-files/local-arago64.conf.sample
> >> @@ -138,12 +138,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> >>  # These two options control how much parallelism BitBake should use.
> >The first
> >>  # option determines how many tasks bitbake should run in parallel:
> >>  #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >>  #
> >>  # The second option controls how many processes make should run in
> >parallel when
> >>  # running compile tasks:
> >>  #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >>  #
> >>  # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >>  # be appropriate for example
> >> diff --git a/sample-files/local-glsdk.conf.sample b/sample-files/local-
> >glsdk.conf.sample
> >> index acd094f..189730a 100644
> >> --- a/sample-files/local-glsdk.conf.sample
> >> +++ b/sample-files/local-glsdk.conf.sample
> >> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> >>  # These two options control how much parallelism BitBake should use.
> >The first
> >>  # option determines how many tasks bitbake should run in parallel:
> >>  #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >>  #
> >>  # The second option controls how many processes make should run in
> >parallel when
> >>  # running compile tasks:
> >>  #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >>  #
> >>  # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >>  # be appropriate for example
> >> diff --git a/sample-files/local-poky.conf.sample b/sample-files/local-
> >poky.conf.sample
> >> index 34b6b10..ba5d4c1 100644
> >> --- a/sample-files/local-poky.conf.sample
> >> +++ b/sample-files/local-poky.conf.sample
> >> @@ -135,12 +135,12 @@ PATCHRESOLVE = "noop"
> >>  # These two options control how much parallelism BitBake should use.
> >The first
> >>  # option determines how many tasks bitbake should run in parallel:
> >>  #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >>  #
> >>  # The second option controls how many processes make should run in
> >parallel when
> >>  # running compile tasks:
> >>  #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >>  #
> >>  # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >>  # be appropriate for example
> >> diff --git a/sample-files/local-processor-sdk-64.conf.sample b/sample-
> >files/local-processor-sdk-64.conf.sample
> >> index 75e59f1..9087be9 100644
> >> --- a/sample-files/local-processor-sdk-64.conf.sample
> >> +++ b/sample-files/local-processor-sdk-64.conf.sample
> >> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> >>  # These two options control how much parallelism BitBake should use.
> >The first
> >>  # option determines how many tasks bitbake should run in parallel:
> >>  #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >>  #
> >>  # The second option controls how many processes make should run in
> >parallel when
> >>  # running compile tasks:
> >>  #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >>  #
> >>  # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >>  # be appropriate for example
> >> diff --git a/sample-files/local-processor-sdk.conf.sample b/sample-
> >files/local-processor-sdk.conf.sample
> >> index d5af93a..59b11e6 100644
> >> --- a/sample-files/local-processor-sdk.conf.sample
> >> +++ b/sample-files/local-processor-sdk.conf.sample
> >> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> >>  # These two options control how much parallelism BitBake should use.
> >The first
> >>  # option determines how many tasks bitbake should run in parallel:
> >>  #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >>  #
> >>  # The second option controls how many processes make should run in
> >parallel when
> >>  # running compile tasks:
> >>  #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >>  #
> >>  # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >>  # be appropriate for example
> >> diff --git a/sample-files/local.conf.sample b/sample-
> >files/local.conf.sample
> >> index d971b97..e60bedc 100644
> >> --- a/sample-files/local.conf.sample
> >> +++ b/sample-files/local.conf.sample
> >> @@ -135,12 +135,12 @@ PATCHRESOLVE = "noop"
> >>  # These two options control how much parallelism BitBake should use.
> >The first
> >>  # option determines how many tasks bitbake should run in parallel:
> >>  #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >>  #
> >>  # The second option controls how many processes make should run in
> >parallel when
> >>  # running compile tasks:
> >>  #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >>  #
> >>  # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >>  # be appropriate for example
> >> --
> >> 2.31.1
> >>
> >> _______________________________________________
> >> meta-arago mailing list
> >> meta-arago@arago-project.org
> >> http://arago-project.org/cgi-bin/mailman/listinfo/meta-arago
> >>
> >
> >--
> >Regards,
> >Denys Dmytriyenko <denis@denix.org>
> >PGP: 0x420902729A92C964 - https://denix.org/0x420902729A92C964
> >Fingerprint: 25FC E4A5 8A72 2F69 1186  6D76 4209 0272 9A92 C964
> 

-- 
Regards,
Denys Dmytriyenko <denis@denix.org>
PGP: 0x420902729A92C964 - https://denix.org/0x420902729A92C964
Fingerprint: 25FC E4A5 8A72 2F69 1186  6D76 4209 0272 9A92 C964


      reply	other threads:[~2021-04-16 22:14 UTC|newest]

Thread overview: 4+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-04-16 20:34 [dunfell/master][PATCH] oe-layertool-setup: Let user change parallel build options Gowtham Tammana
2021-04-16 22:00 ` Denys Dmytriyenko
2021-04-16 22:11   ` [EXTERNAL] " Tammana, Gowtham
2021-04-16 22:14     ` Denys Dmytriyenko [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20210416221443.GG15937@denix.org \
    --to=denis@denix.org \
    --cc=denys@konsulko.com \
    --cc=g-tammana@ti.com \
    --cc=meta-arago@arago-project.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body. 
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.