* [dunfell/master][PATCH] oe-layertool-setup: Let user change parallel build options
@ 2021-04-16 20:34 Gowtham Tammana
2021-04-16 22:00 ` Denys Dmytriyenko
0 siblings, 1 reply; 4+ messages in thread
From: Gowtham Tammana @ 2021-04-16 20:34 UTC (permalink / raw)
To: meta-arago, Praneeth Bajjuri, denys
Change BB_NUMBER_THREADS and PARALLEL_MAKE to weak assignment so that
these can be changed when building recipes. Useful on machines with
lower resources.
Signed-off-by: Gowtham Tammana <g-tammana@ti.com>
---
Changing parallel build options is the only way I can build the complete image
on my system :).
Thanks,
Gowtham
oe-layertool-setup.sh | 4 ++--
sample-files/local-amsdk.conf.sample | 4 ++--
sample-files/local-arago.conf.sample | 4 ++--
sample-files/local-arago64.conf.sample | 4 ++--
sample-files/local-glsdk.conf.sample | 4 ++--
sample-files/local-poky.conf.sample | 4 ++--
sample-files/local-processor-sdk-64.conf.sample | 4 ++--
sample-files/local-processor-sdk.conf.sample | 4 ++--
sample-files/local.conf.sample | 4 ++--
9 files changed, 18 insertions(+), 18 deletions(-)
diff --git a/oe-layertool-setup.sh b/oe-layertool-setup.sh
index aa16042..df1523f 100755
--- a/oe-layertool-setup.sh
+++ b/oe-layertool-setup.sh
@@ -753,8 +753,8 @@ EOM
# set the number of threads
threads=`cat /proc/cpuinfo | grep -c processor`
tnum=`expr \( ${threads} + 1 \) \* 75 / 100`
- sed -i "s/^PARALLEL_MAKE.*/PARALLEL_MAKE = \"-j ${tnum}\"/" $confdir/local.conf
- sed -i "s/^BB_NUMBER_THREADS.*/BB_NUMBER_THREADS = \"${tnum}\"/" $confdir/local.conf
+ sed -i "s/^PARALLEL_MAKE.*/PARALLEL_MAKE ?= \"-j ${tnum}\"/" $confdir/local.conf
+ sed -i "s/^BB_NUMBER_THREADS.*/BB_NUMBER_THREADS ?= \"${tnum}\"/" $confdir/local.conf
# Find if old DL_DIR was set
if [ -e $confdir/local.conf.bak ]
diff --git a/sample-files/local-amsdk.conf.sample b/sample-files/local-amsdk.conf.sample
index 756286d..ac39788 100644
--- a/sample-files/local-amsdk.conf.sample
+++ b/sample-files/local-amsdk.conf.sample
@@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
# These two options control how much parallelism BitBake should use. The first
# option determines how many tasks bitbake should run in parallel:
#
-BB_NUMBER_THREADS = "1"
+BB_NUMBER_THREADS ?= "1"
#
# The second option controls how many processes make should run in parallel when
# running compile tasks:
#
-PARALLEL_MAKE = "-j 1"
+PARALLEL_MAKE ?= "-j 1"
#
# For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
# be appropriate for example
diff --git a/sample-files/local-arago.conf.sample b/sample-files/local-arago.conf.sample
index 96dfaf9..62f0f92 100644
--- a/sample-files/local-arago.conf.sample
+++ b/sample-files/local-arago.conf.sample
@@ -138,12 +138,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
# These two options control how much parallelism BitBake should use. The first
# option determines how many tasks bitbake should run in parallel:
#
-BB_NUMBER_THREADS = "1"
+BB_NUMBER_THREADS ?= "1"
#
# The second option controls how many processes make should run in parallel when
# running compile tasks:
#
-PARALLEL_MAKE = "-j 1"
+PARALLEL_MAKE ?= "-j 1"
#
# For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
# be appropriate for example
diff --git a/sample-files/local-arago64.conf.sample b/sample-files/local-arago64.conf.sample
index f48db77..68f0bff 100644
--- a/sample-files/local-arago64.conf.sample
+++ b/sample-files/local-arago64.conf.sample
@@ -138,12 +138,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
# These two options control how much parallelism BitBake should use. The first
# option determines how many tasks bitbake should run in parallel:
#
-BB_NUMBER_THREADS = "1"
+BB_NUMBER_THREADS ?= "1"
#
# The second option controls how many processes make should run in parallel when
# running compile tasks:
#
-PARALLEL_MAKE = "-j 1"
+PARALLEL_MAKE ?= "-j 1"
#
# For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
# be appropriate for example
diff --git a/sample-files/local-glsdk.conf.sample b/sample-files/local-glsdk.conf.sample
index acd094f..189730a 100644
--- a/sample-files/local-glsdk.conf.sample
+++ b/sample-files/local-glsdk.conf.sample
@@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
# These two options control how much parallelism BitBake should use. The first
# option determines how many tasks bitbake should run in parallel:
#
-BB_NUMBER_THREADS = "1"
+BB_NUMBER_THREADS ?= "1"
#
# The second option controls how many processes make should run in parallel when
# running compile tasks:
#
-PARALLEL_MAKE = "-j 1"
+PARALLEL_MAKE ?= "-j 1"
#
# For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
# be appropriate for example
diff --git a/sample-files/local-poky.conf.sample b/sample-files/local-poky.conf.sample
index 34b6b10..ba5d4c1 100644
--- a/sample-files/local-poky.conf.sample
+++ b/sample-files/local-poky.conf.sample
@@ -135,12 +135,12 @@ PATCHRESOLVE = "noop"
# These two options control how much parallelism BitBake should use. The first
# option determines how many tasks bitbake should run in parallel:
#
-BB_NUMBER_THREADS = "1"
+BB_NUMBER_THREADS ?= "1"
#
# The second option controls how many processes make should run in parallel when
# running compile tasks:
#
-PARALLEL_MAKE = "-j 1"
+PARALLEL_MAKE ?= "-j 1"
#
# For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
# be appropriate for example
diff --git a/sample-files/local-processor-sdk-64.conf.sample b/sample-files/local-processor-sdk-64.conf.sample
index 75e59f1..9087be9 100644
--- a/sample-files/local-processor-sdk-64.conf.sample
+++ b/sample-files/local-processor-sdk-64.conf.sample
@@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
# These two options control how much parallelism BitBake should use. The first
# option determines how many tasks bitbake should run in parallel:
#
-BB_NUMBER_THREADS = "1"
+BB_NUMBER_THREADS ?= "1"
#
# The second option controls how many processes make should run in parallel when
# running compile tasks:
#
-PARALLEL_MAKE = "-j 1"
+PARALLEL_MAKE ?= "-j 1"
#
# For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
# be appropriate for example
diff --git a/sample-files/local-processor-sdk.conf.sample b/sample-files/local-processor-sdk.conf.sample
index d5af93a..59b11e6 100644
--- a/sample-files/local-processor-sdk.conf.sample
+++ b/sample-files/local-processor-sdk.conf.sample
@@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
# These two options control how much parallelism BitBake should use. The first
# option determines how many tasks bitbake should run in parallel:
#
-BB_NUMBER_THREADS = "1"
+BB_NUMBER_THREADS ?= "1"
#
# The second option controls how many processes make should run in parallel when
# running compile tasks:
#
-PARALLEL_MAKE = "-j 1"
+PARALLEL_MAKE ?= "-j 1"
#
# For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
# be appropriate for example
diff --git a/sample-files/local.conf.sample b/sample-files/local.conf.sample
index d971b97..e60bedc 100644
--- a/sample-files/local.conf.sample
+++ b/sample-files/local.conf.sample
@@ -135,12 +135,12 @@ PATCHRESOLVE = "noop"
# These two options control how much parallelism BitBake should use. The first
# option determines how many tasks bitbake should run in parallel:
#
-BB_NUMBER_THREADS = "1"
+BB_NUMBER_THREADS ?= "1"
#
# The second option controls how many processes make should run in parallel when
# running compile tasks:
#
-PARALLEL_MAKE = "-j 1"
+PARALLEL_MAKE ?= "-j 1"
#
# For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
# be appropriate for example
--
2.31.1
^ permalink raw reply related [flat|nested] 4+ messages in thread
* Re: [dunfell/master][PATCH] oe-layertool-setup: Let user change parallel build options
2021-04-16 20:34 [dunfell/master][PATCH] oe-layertool-setup: Let user change parallel build options Gowtham Tammana
@ 2021-04-16 22:00 ` Denys Dmytriyenko
2021-04-16 22:11 ` [EXTERNAL] " Tammana, Gowtham
0 siblings, 1 reply; 4+ messages in thread
From: Denys Dmytriyenko @ 2021-04-16 22:00 UTC (permalink / raw)
To: Gowtham Tammana; +Cc: meta-arago, denys
I guess this is for [oe-layersetup] project, not [dunfell/master] branch of
meta-arago, recipe oe-layertool-setup :)
You are changing local.conf, which is user-modifiable anyway, so what's the
point in making it weak here?
On Fri, Apr 16, 2021 at 03:34:37PM -0500, Gowtham Tammana wrote:
> Change BB_NUMBER_THREADS and PARALLEL_MAKE to weak assignment so that
> these can be changed when building recipes. Useful on machines with
> lower resources.
>
> Signed-off-by: Gowtham Tammana <g-tammana@ti.com>
> ---
>
> Changing parallel build options is the only way I can build the complete image
> on my system :).
>
> Thanks,
> Gowtham
>
> oe-layertool-setup.sh | 4 ++--
> sample-files/local-amsdk.conf.sample | 4 ++--
> sample-files/local-arago.conf.sample | 4 ++--
> sample-files/local-arago64.conf.sample | 4 ++--
> sample-files/local-glsdk.conf.sample | 4 ++--
> sample-files/local-poky.conf.sample | 4 ++--
> sample-files/local-processor-sdk-64.conf.sample | 4 ++--
> sample-files/local-processor-sdk.conf.sample | 4 ++--
> sample-files/local.conf.sample | 4 ++--
> 9 files changed, 18 insertions(+), 18 deletions(-)
>
> diff --git a/oe-layertool-setup.sh b/oe-layertool-setup.sh
> index aa16042..df1523f 100755
> --- a/oe-layertool-setup.sh
> +++ b/oe-layertool-setup.sh
> @@ -753,8 +753,8 @@ EOM
> # set the number of threads
> threads=`cat /proc/cpuinfo | grep -c processor`
> tnum=`expr \( ${threads} + 1 \) \* 75 / 100`
> - sed -i "s/^PARALLEL_MAKE.*/PARALLEL_MAKE = \"-j ${tnum}\"/" $confdir/local.conf
> - sed -i "s/^BB_NUMBER_THREADS.*/BB_NUMBER_THREADS = \"${tnum}\"/" $confdir/local.conf
> + sed -i "s/^PARALLEL_MAKE.*/PARALLEL_MAKE ?= \"-j ${tnum}\"/" $confdir/local.conf
> + sed -i "s/^BB_NUMBER_THREADS.*/BB_NUMBER_THREADS ?= \"${tnum}\"/" $confdir/local.conf
>
> # Find if old DL_DIR was set
> if [ -e $confdir/local.conf.bak ]
> diff --git a/sample-files/local-amsdk.conf.sample b/sample-files/local-amsdk.conf.sample
> index 756286d..ac39788 100644
> --- a/sample-files/local-amsdk.conf.sample
> +++ b/sample-files/local-amsdk.conf.sample
> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> # These two options control how much parallelism BitBake should use. The first
> # option determines how many tasks bitbake should run in parallel:
> #
> -BB_NUMBER_THREADS = "1"
> +BB_NUMBER_THREADS ?= "1"
> #
> # The second option controls how many processes make should run in parallel when
> # running compile tasks:
> #
> -PARALLEL_MAKE = "-j 1"
> +PARALLEL_MAKE ?= "-j 1"
> #
> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
> # be appropriate for example
> diff --git a/sample-files/local-arago.conf.sample b/sample-files/local-arago.conf.sample
> index 96dfaf9..62f0f92 100644
> --- a/sample-files/local-arago.conf.sample
> +++ b/sample-files/local-arago.conf.sample
> @@ -138,12 +138,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> # These two options control how much parallelism BitBake should use. The first
> # option determines how many tasks bitbake should run in parallel:
> #
> -BB_NUMBER_THREADS = "1"
> +BB_NUMBER_THREADS ?= "1"
> #
> # The second option controls how many processes make should run in parallel when
> # running compile tasks:
> #
> -PARALLEL_MAKE = "-j 1"
> +PARALLEL_MAKE ?= "-j 1"
> #
> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
> # be appropriate for example
> diff --git a/sample-files/local-arago64.conf.sample b/sample-files/local-arago64.conf.sample
> index f48db77..68f0bff 100644
> --- a/sample-files/local-arago64.conf.sample
> +++ b/sample-files/local-arago64.conf.sample
> @@ -138,12 +138,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> # These two options control how much parallelism BitBake should use. The first
> # option determines how many tasks bitbake should run in parallel:
> #
> -BB_NUMBER_THREADS = "1"
> +BB_NUMBER_THREADS ?= "1"
> #
> # The second option controls how many processes make should run in parallel when
> # running compile tasks:
> #
> -PARALLEL_MAKE = "-j 1"
> +PARALLEL_MAKE ?= "-j 1"
> #
> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
> # be appropriate for example
> diff --git a/sample-files/local-glsdk.conf.sample b/sample-files/local-glsdk.conf.sample
> index acd094f..189730a 100644
> --- a/sample-files/local-glsdk.conf.sample
> +++ b/sample-files/local-glsdk.conf.sample
> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> # These two options control how much parallelism BitBake should use. The first
> # option determines how many tasks bitbake should run in parallel:
> #
> -BB_NUMBER_THREADS = "1"
> +BB_NUMBER_THREADS ?= "1"
> #
> # The second option controls how many processes make should run in parallel when
> # running compile tasks:
> #
> -PARALLEL_MAKE = "-j 1"
> +PARALLEL_MAKE ?= "-j 1"
> #
> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
> # be appropriate for example
> diff --git a/sample-files/local-poky.conf.sample b/sample-files/local-poky.conf.sample
> index 34b6b10..ba5d4c1 100644
> --- a/sample-files/local-poky.conf.sample
> +++ b/sample-files/local-poky.conf.sample
> @@ -135,12 +135,12 @@ PATCHRESOLVE = "noop"
> # These two options control how much parallelism BitBake should use. The first
> # option determines how many tasks bitbake should run in parallel:
> #
> -BB_NUMBER_THREADS = "1"
> +BB_NUMBER_THREADS ?= "1"
> #
> # The second option controls how many processes make should run in parallel when
> # running compile tasks:
> #
> -PARALLEL_MAKE = "-j 1"
> +PARALLEL_MAKE ?= "-j 1"
> #
> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
> # be appropriate for example
> diff --git a/sample-files/local-processor-sdk-64.conf.sample b/sample-files/local-processor-sdk-64.conf.sample
> index 75e59f1..9087be9 100644
> --- a/sample-files/local-processor-sdk-64.conf.sample
> +++ b/sample-files/local-processor-sdk-64.conf.sample
> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> # These two options control how much parallelism BitBake should use. The first
> # option determines how many tasks bitbake should run in parallel:
> #
> -BB_NUMBER_THREADS = "1"
> +BB_NUMBER_THREADS ?= "1"
> #
> # The second option controls how many processes make should run in parallel when
> # running compile tasks:
> #
> -PARALLEL_MAKE = "-j 1"
> +PARALLEL_MAKE ?= "-j 1"
> #
> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
> # be appropriate for example
> diff --git a/sample-files/local-processor-sdk.conf.sample b/sample-files/local-processor-sdk.conf.sample
> index d5af93a..59b11e6 100644
> --- a/sample-files/local-processor-sdk.conf.sample
> +++ b/sample-files/local-processor-sdk.conf.sample
> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> # These two options control how much parallelism BitBake should use. The first
> # option determines how many tasks bitbake should run in parallel:
> #
> -BB_NUMBER_THREADS = "1"
> +BB_NUMBER_THREADS ?= "1"
> #
> # The second option controls how many processes make should run in parallel when
> # running compile tasks:
> #
> -PARALLEL_MAKE = "-j 1"
> +PARALLEL_MAKE ?= "-j 1"
> #
> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
> # be appropriate for example
> diff --git a/sample-files/local.conf.sample b/sample-files/local.conf.sample
> index d971b97..e60bedc 100644
> --- a/sample-files/local.conf.sample
> +++ b/sample-files/local.conf.sample
> @@ -135,12 +135,12 @@ PATCHRESOLVE = "noop"
> # These two options control how much parallelism BitBake should use. The first
> # option determines how many tasks bitbake should run in parallel:
> #
> -BB_NUMBER_THREADS = "1"
> +BB_NUMBER_THREADS ?= "1"
> #
> # The second option controls how many processes make should run in parallel when
> # running compile tasks:
> #
> -PARALLEL_MAKE = "-j 1"
> +PARALLEL_MAKE ?= "-j 1"
> #
> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
> # be appropriate for example
> --
> 2.31.1
>
> _______________________________________________
> meta-arago mailing list
> meta-arago@arago-project.org
> http://arago-project.org/cgi-bin/mailman/listinfo/meta-arago
>
--
Regards,
Denys Dmytriyenko <denis@denix.org>
PGP: 0x420902729A92C964 - https://denix.org/0x420902729A92C964
Fingerprint: 25FC E4A5 8A72 2F69 1186 6D76 4209 0272 9A92 C964
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [EXTERNAL] Re: [dunfell/master][PATCH] oe-layertool-setup: Let user change parallel build options
2021-04-16 22:00 ` Denys Dmytriyenko
@ 2021-04-16 22:11 ` Tammana, Gowtham
2021-04-16 22:14 ` Denys Dmytriyenko
0 siblings, 1 reply; 4+ messages in thread
From: Tammana, Gowtham @ 2021-04-16 22:11 UTC (permalink / raw)
To: Denys Dmytriyenko; +Cc: meta-arago, denys
>-----Original Message-----
>From: Denys Dmytriyenko <denis@denix.org>
>Sent: Friday, April 16, 2021 5:00 PM
>To: Tammana, Gowtham <g-tammana@ti.com>
>Cc: meta-arago@arago-project.org; Bajjuri, Praneeth <praneeth@ti.com>;
>denys@konsulko.com
>Subject: [EXTERNAL] Re: [meta-arago] [dunfell/master][PATCH] oe-layertool-
>setup: Let user change parallel build options
>
>I guess this is for [oe-layersetup] project, not [dunfell/master] branch
>of
>meta-arago, recipe oe-layertool-setup :)
Oops. Will send v2.
>
>You are changing local.conf, which is user-modifiable anyway, so what's
>the
>point in making it weak here?
That is true, but this makes the option configurable per recipe basis. For
e.g. I could do below for resource heavy recipe and switch back to default
for the rest without having to change the local.conf file.
BB_NUMBER_THREADS=2 PARALLEL_MAKE="-j 2" bitbake qtwebkit
Thanks,
Gowtham
>
>
>On Fri, Apr 16, 2021 at 03:34:37PM -0500, Gowtham Tammana wrote:
>> Change BB_NUMBER_THREADS and PARALLEL_MAKE to weak assignment so that
>> these can be changed when building recipes. Useful on machines with
>> lower resources.
>>
>> Signed-off-by: Gowtham Tammana <g-tammana@ti.com>
>> ---
>>
>> Changing parallel build options is the only way I can build the complete
>image
>> on my system :).
>>
>> Thanks,
>> Gowtham
>>
>> oe-layertool-setup.sh | 4 ++--
>> sample-files/local-amsdk.conf.sample | 4 ++--
>> sample-files/local-arago.conf.sample | 4 ++--
>> sample-files/local-arago64.conf.sample | 4 ++--
>> sample-files/local-glsdk.conf.sample | 4 ++--
>> sample-files/local-poky.conf.sample | 4 ++--
>> sample-files/local-processor-sdk-64.conf.sample | 4 ++--
>> sample-files/local-processor-sdk.conf.sample | 4 ++--
>> sample-files/local.conf.sample | 4 ++--
>> 9 files changed, 18 insertions(+), 18 deletions(-)
>>
>> diff --git a/oe-layertool-setup.sh b/oe-layertool-setup.sh
>> index aa16042..df1523f 100755
>> --- a/oe-layertool-setup.sh
>> +++ b/oe-layertool-setup.sh
>> @@ -753,8 +753,8 @@ EOM
>> # set the number of threads
>> threads=`cat /proc/cpuinfo | grep -c processor`
>> tnum=`expr \( ${threads} + 1 \) \* 75 / 100`
>> - sed -i "s/^PARALLEL_MAKE.*/PARALLEL_MAKE = \"-j ${tnum}\"/"
>$confdir/local.conf
>> - sed -i "s/^BB_NUMBER_THREADS.*/BB_NUMBER_THREADS = \"${tnum}\"/"
>$confdir/local.conf
>> + sed -i "s/^PARALLEL_MAKE.*/PARALLEL_MAKE ?= \"-j ${tnum}\"/"
>$confdir/local.conf
>> + sed -i "s/^BB_NUMBER_THREADS.*/BB_NUMBER_THREADS ?= \"${tnum}\"/"
>$confdir/local.conf
>>
>> # Find if old DL_DIR was set
>> if [ -e $confdir/local.conf.bak ]
>> diff --git a/sample-files/local-amsdk.conf.sample b/sample-files/local-
>amsdk.conf.sample
>> index 756286d..ac39788 100644
>> --- a/sample-files/local-amsdk.conf.sample
>> +++ b/sample-files/local-amsdk.conf.sample
>> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
>> # These two options control how much parallelism BitBake should use.
>The first
>> # option determines how many tasks bitbake should run in parallel:
>> #
>> -BB_NUMBER_THREADS = "1"
>> +BB_NUMBER_THREADS ?= "1"
>> #
>> # The second option controls how many processes make should run in
>parallel when
>> # running compile tasks:
>> #
>> -PARALLEL_MAKE = "-j 1"
>> +PARALLEL_MAKE ?= "-j 1"
>> #
>> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
>4" would
>> # be appropriate for example
>> diff --git a/sample-files/local-arago.conf.sample b/sample-files/local-
>arago.conf.sample
>> index 96dfaf9..62f0f92 100644
>> --- a/sample-files/local-arago.conf.sample
>> +++ b/sample-files/local-arago.conf.sample
>> @@ -138,12 +138,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
>> # These two options control how much parallelism BitBake should use.
>The first
>> # option determines how many tasks bitbake should run in parallel:
>> #
>> -BB_NUMBER_THREADS = "1"
>> +BB_NUMBER_THREADS ?= "1"
>> #
>> # The second option controls how many processes make should run in
>parallel when
>> # running compile tasks:
>> #
>> -PARALLEL_MAKE = "-j 1"
>> +PARALLEL_MAKE ?= "-j 1"
>> #
>> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
>4" would
>> # be appropriate for example
>> diff --git a/sample-files/local-arago64.conf.sample b/sample-
>files/local-arago64.conf.sample
>> index f48db77..68f0bff 100644
>> --- a/sample-files/local-arago64.conf.sample
>> +++ b/sample-files/local-arago64.conf.sample
>> @@ -138,12 +138,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
>> # These two options control how much parallelism BitBake should use.
>The first
>> # option determines how many tasks bitbake should run in parallel:
>> #
>> -BB_NUMBER_THREADS = "1"
>> +BB_NUMBER_THREADS ?= "1"
>> #
>> # The second option controls how many processes make should run in
>parallel when
>> # running compile tasks:
>> #
>> -PARALLEL_MAKE = "-j 1"
>> +PARALLEL_MAKE ?= "-j 1"
>> #
>> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
>4" would
>> # be appropriate for example
>> diff --git a/sample-files/local-glsdk.conf.sample b/sample-files/local-
>glsdk.conf.sample
>> index acd094f..189730a 100644
>> --- a/sample-files/local-glsdk.conf.sample
>> +++ b/sample-files/local-glsdk.conf.sample
>> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
>> # These two options control how much parallelism BitBake should use.
>The first
>> # option determines how many tasks bitbake should run in parallel:
>> #
>> -BB_NUMBER_THREADS = "1"
>> +BB_NUMBER_THREADS ?= "1"
>> #
>> # The second option controls how many processes make should run in
>parallel when
>> # running compile tasks:
>> #
>> -PARALLEL_MAKE = "-j 1"
>> +PARALLEL_MAKE ?= "-j 1"
>> #
>> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
>4" would
>> # be appropriate for example
>> diff --git a/sample-files/local-poky.conf.sample b/sample-files/local-
>poky.conf.sample
>> index 34b6b10..ba5d4c1 100644
>> --- a/sample-files/local-poky.conf.sample
>> +++ b/sample-files/local-poky.conf.sample
>> @@ -135,12 +135,12 @@ PATCHRESOLVE = "noop"
>> # These two options control how much parallelism BitBake should use.
>The first
>> # option determines how many tasks bitbake should run in parallel:
>> #
>> -BB_NUMBER_THREADS = "1"
>> +BB_NUMBER_THREADS ?= "1"
>> #
>> # The second option controls how many processes make should run in
>parallel when
>> # running compile tasks:
>> #
>> -PARALLEL_MAKE = "-j 1"
>> +PARALLEL_MAKE ?= "-j 1"
>> #
>> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
>4" would
>> # be appropriate for example
>> diff --git a/sample-files/local-processor-sdk-64.conf.sample b/sample-
>files/local-processor-sdk-64.conf.sample
>> index 75e59f1..9087be9 100644
>> --- a/sample-files/local-processor-sdk-64.conf.sample
>> +++ b/sample-files/local-processor-sdk-64.conf.sample
>> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
>> # These two options control how much parallelism BitBake should use.
>The first
>> # option determines how many tasks bitbake should run in parallel:
>> #
>> -BB_NUMBER_THREADS = "1"
>> +BB_NUMBER_THREADS ?= "1"
>> #
>> # The second option controls how many processes make should run in
>parallel when
>> # running compile tasks:
>> #
>> -PARALLEL_MAKE = "-j 1"
>> +PARALLEL_MAKE ?= "-j 1"
>> #
>> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
>4" would
>> # be appropriate for example
>> diff --git a/sample-files/local-processor-sdk.conf.sample b/sample-
>files/local-processor-sdk.conf.sample
>> index d5af93a..59b11e6 100644
>> --- a/sample-files/local-processor-sdk.conf.sample
>> +++ b/sample-files/local-processor-sdk.conf.sample
>> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
>> # These two options control how much parallelism BitBake should use.
>The first
>> # option determines how many tasks bitbake should run in parallel:
>> #
>> -BB_NUMBER_THREADS = "1"
>> +BB_NUMBER_THREADS ?= "1"
>> #
>> # The second option controls how many processes make should run in
>parallel when
>> # running compile tasks:
>> #
>> -PARALLEL_MAKE = "-j 1"
>> +PARALLEL_MAKE ?= "-j 1"
>> #
>> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
>4" would
>> # be appropriate for example
>> diff --git a/sample-files/local.conf.sample b/sample-
>files/local.conf.sample
>> index d971b97..e60bedc 100644
>> --- a/sample-files/local.conf.sample
>> +++ b/sample-files/local.conf.sample
>> @@ -135,12 +135,12 @@ PATCHRESOLVE = "noop"
>> # These two options control how much parallelism BitBake should use.
>The first
>> # option determines how many tasks bitbake should run in parallel:
>> #
>> -BB_NUMBER_THREADS = "1"
>> +BB_NUMBER_THREADS ?= "1"
>> #
>> # The second option controls how many processes make should run in
>parallel when
>> # running compile tasks:
>> #
>> -PARALLEL_MAKE = "-j 1"
>> +PARALLEL_MAKE ?= "-j 1"
>> #
>> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
>4" would
>> # be appropriate for example
>> --
>> 2.31.1
>>
>> _______________________________________________
>> meta-arago mailing list
>> meta-arago@arago-project.org
>> http://arago-project.org/cgi-bin/mailman/listinfo/meta-arago
>>
>
>--
>Regards,
>Denys Dmytriyenko <denis@denix.org>
>PGP: 0x420902729A92C964 - https://denix.org/0x420902729A92C964
>Fingerprint: 25FC E4A5 8A72 2F69 1186 6D76 4209 0272 9A92 C964
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [EXTERNAL] Re: [dunfell/master][PATCH] oe-layertool-setup: Let user change parallel build options
2021-04-16 22:11 ` [EXTERNAL] " Tammana, Gowtham
@ 2021-04-16 22:14 ` Denys Dmytriyenko
0 siblings, 0 replies; 4+ messages in thread
From: Denys Dmytriyenko @ 2021-04-16 22:14 UTC (permalink / raw)
To: Tammana, Gowtham; +Cc: meta-arago, denys
On Fri, Apr 16, 2021 at 10:11:27PM +0000, Tammana, Gowtham wrote:
>
>
> >-----Original Message-----
> >From: Denys Dmytriyenko <denis@denix.org>
> >Sent: Friday, April 16, 2021 5:00 PM
> >To: Tammana, Gowtham <g-tammana@ti.com>
> >Cc: meta-arago@arago-project.org; Bajjuri, Praneeth <praneeth@ti.com>;
> >denys@konsulko.com
> >Subject: [EXTERNAL] Re: [meta-arago] [dunfell/master][PATCH] oe-layertool-
> >setup: Let user change parallel build options
> >
> >I guess this is for [oe-layersetup] project, not [dunfell/master] branch
> >of
> >meta-arago, recipe oe-layertool-setup :)
>
> Oops. Will send v2.
>
> >
> >You are changing local.conf, which is user-modifiable anyway, so what's
> >the
> >point in making it weak here?
>
> That is true, but this makes the option configurable per recipe basis. For
> e.g. I could do below for resource heavy recipe and switch back to default
> for the rest without having to change the local.conf file.
>
> BB_NUMBER_THREADS=2 PARALLEL_MAKE="-j 2" bitbake qtwebkit
I see, sounds reasonable.
> Thanks,
> Gowtham
>
> >
> >
> >On Fri, Apr 16, 2021 at 03:34:37PM -0500, Gowtham Tammana wrote:
> >> Change BB_NUMBER_THREADS and PARALLEL_MAKE to weak assignment so that
> >> these can be changed when building recipes. Useful on machines with
> >> lower resources.
> >>
> >> Signed-off-by: Gowtham Tammana <g-tammana@ti.com>
> >> ---
> >>
> >> Changing parallel build options is the only way I can build the complete
> >image
> >> on my system :).
> >>
> >> Thanks,
> >> Gowtham
> >>
> >> oe-layertool-setup.sh | 4 ++--
> >> sample-files/local-amsdk.conf.sample | 4 ++--
> >> sample-files/local-arago.conf.sample | 4 ++--
> >> sample-files/local-arago64.conf.sample | 4 ++--
> >> sample-files/local-glsdk.conf.sample | 4 ++--
> >> sample-files/local-poky.conf.sample | 4 ++--
> >> sample-files/local-processor-sdk-64.conf.sample | 4 ++--
> >> sample-files/local-processor-sdk.conf.sample | 4 ++--
> >> sample-files/local.conf.sample | 4 ++--
> >> 9 files changed, 18 insertions(+), 18 deletions(-)
> >>
> >> diff --git a/oe-layertool-setup.sh b/oe-layertool-setup.sh
> >> index aa16042..df1523f 100755
> >> --- a/oe-layertool-setup.sh
> >> +++ b/oe-layertool-setup.sh
> >> @@ -753,8 +753,8 @@ EOM
> >> # set the number of threads
> >> threads=`cat /proc/cpuinfo | grep -c processor`
> >> tnum=`expr \( ${threads} + 1 \) \* 75 / 100`
> >> - sed -i "s/^PARALLEL_MAKE.*/PARALLEL_MAKE = \"-j ${tnum}\"/"
> >$confdir/local.conf
> >> - sed -i "s/^BB_NUMBER_THREADS.*/BB_NUMBER_THREADS = \"${tnum}\"/"
> >$confdir/local.conf
> >> + sed -i "s/^PARALLEL_MAKE.*/PARALLEL_MAKE ?= \"-j ${tnum}\"/"
> >$confdir/local.conf
> >> + sed -i "s/^BB_NUMBER_THREADS.*/BB_NUMBER_THREADS ?= \"${tnum}\"/"
> >$confdir/local.conf
> >>
> >> # Find if old DL_DIR was set
> >> if [ -e $confdir/local.conf.bak ]
> >> diff --git a/sample-files/local-amsdk.conf.sample b/sample-files/local-
> >amsdk.conf.sample
> >> index 756286d..ac39788 100644
> >> --- a/sample-files/local-amsdk.conf.sample
> >> +++ b/sample-files/local-amsdk.conf.sample
> >> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> >> # These two options control how much parallelism BitBake should use.
> >The first
> >> # option determines how many tasks bitbake should run in parallel:
> >> #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >> #
> >> # The second option controls how many processes make should run in
> >parallel when
> >> # running compile tasks:
> >> #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >> #
> >> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >> # be appropriate for example
> >> diff --git a/sample-files/local-arago.conf.sample b/sample-files/local-
> >arago.conf.sample
> >> index 96dfaf9..62f0f92 100644
> >> --- a/sample-files/local-arago.conf.sample
> >> +++ b/sample-files/local-arago.conf.sample
> >> @@ -138,12 +138,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> >> # These two options control how much parallelism BitBake should use.
> >The first
> >> # option determines how many tasks bitbake should run in parallel:
> >> #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >> #
> >> # The second option controls how many processes make should run in
> >parallel when
> >> # running compile tasks:
> >> #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >> #
> >> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >> # be appropriate for example
> >> diff --git a/sample-files/local-arago64.conf.sample b/sample-
> >files/local-arago64.conf.sample
> >> index f48db77..68f0bff 100644
> >> --- a/sample-files/local-arago64.conf.sample
> >> +++ b/sample-files/local-arago64.conf.sample
> >> @@ -138,12 +138,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> >> # These two options control how much parallelism BitBake should use.
> >The first
> >> # option determines how many tasks bitbake should run in parallel:
> >> #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >> #
> >> # The second option controls how many processes make should run in
> >parallel when
> >> # running compile tasks:
> >> #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >> #
> >> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >> # be appropriate for example
> >> diff --git a/sample-files/local-glsdk.conf.sample b/sample-files/local-
> >glsdk.conf.sample
> >> index acd094f..189730a 100644
> >> --- a/sample-files/local-glsdk.conf.sample
> >> +++ b/sample-files/local-glsdk.conf.sample
> >> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> >> # These two options control how much parallelism BitBake should use.
> >The first
> >> # option determines how many tasks bitbake should run in parallel:
> >> #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >> #
> >> # The second option controls how many processes make should run in
> >parallel when
> >> # running compile tasks:
> >> #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >> #
> >> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >> # be appropriate for example
> >> diff --git a/sample-files/local-poky.conf.sample b/sample-files/local-
> >poky.conf.sample
> >> index 34b6b10..ba5d4c1 100644
> >> --- a/sample-files/local-poky.conf.sample
> >> +++ b/sample-files/local-poky.conf.sample
> >> @@ -135,12 +135,12 @@ PATCHRESOLVE = "noop"
> >> # These two options control how much parallelism BitBake should use.
> >The first
> >> # option determines how many tasks bitbake should run in parallel:
> >> #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >> #
> >> # The second option controls how many processes make should run in
> >parallel when
> >> # running compile tasks:
> >> #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >> #
> >> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >> # be appropriate for example
> >> diff --git a/sample-files/local-processor-sdk-64.conf.sample b/sample-
> >files/local-processor-sdk-64.conf.sample
> >> index 75e59f1..9087be9 100644
> >> --- a/sample-files/local-processor-sdk-64.conf.sample
> >> +++ b/sample-files/local-processor-sdk-64.conf.sample
> >> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> >> # These two options control how much parallelism BitBake should use.
> >The first
> >> # option determines how many tasks bitbake should run in parallel:
> >> #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >> #
> >> # The second option controls how many processes make should run in
> >parallel when
> >> # running compile tasks:
> >> #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >> #
> >> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >> # be appropriate for example
> >> diff --git a/sample-files/local-processor-sdk.conf.sample b/sample-
> >files/local-processor-sdk.conf.sample
> >> index d5af93a..59b11e6 100644
> >> --- a/sample-files/local-processor-sdk.conf.sample
> >> +++ b/sample-files/local-processor-sdk.conf.sample
> >> @@ -135,12 +135,12 @@ ENABLE_BINARY_LOCALE_GENERATION = "0"
> >> # These two options control how much parallelism BitBake should use.
> >The first
> >> # option determines how many tasks bitbake should run in parallel:
> >> #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >> #
> >> # The second option controls how many processes make should run in
> >parallel when
> >> # running compile tasks:
> >> #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >> #
> >> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >> # be appropriate for example
> >> diff --git a/sample-files/local.conf.sample b/sample-
> >files/local.conf.sample
> >> index d971b97..e60bedc 100644
> >> --- a/sample-files/local.conf.sample
> >> +++ b/sample-files/local.conf.sample
> >> @@ -135,12 +135,12 @@ PATCHRESOLVE = "noop"
> >> # These two options control how much parallelism BitBake should use.
> >The first
> >> # option determines how many tasks bitbake should run in parallel:
> >> #
> >> -BB_NUMBER_THREADS = "1"
> >> +BB_NUMBER_THREADS ?= "1"
> >> #
> >> # The second option controls how many processes make should run in
> >parallel when
> >> # running compile tasks:
> >> #
> >> -PARALLEL_MAKE = "-j 1"
> >> +PARALLEL_MAKE ?= "-j 1"
> >> #
> >> # For a quad-core machine, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j
> >4" would
> >> # be appropriate for example
> >> --
> >> 2.31.1
> >>
> >> _______________________________________________
> >> meta-arago mailing list
> >> meta-arago@arago-project.org
> >> http://arago-project.org/cgi-bin/mailman/listinfo/meta-arago
> >>
> >
> >--
> >Regards,
> >Denys Dmytriyenko <denis@denix.org>
> >PGP: 0x420902729A92C964 - https://denix.org/0x420902729A92C964
> >Fingerprint: 25FC E4A5 8A72 2F69 1186 6D76 4209 0272 9A92 C964
>
--
Regards,
Denys Dmytriyenko <denis@denix.org>
PGP: 0x420902729A92C964 - https://denix.org/0x420902729A92C964
Fingerprint: 25FC E4A5 8A72 2F69 1186 6D76 4209 0272 9A92 C964
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2021-04-16 22:14 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-04-16 20:34 [dunfell/master][PATCH] oe-layertool-setup: Let user change parallel build options Gowtham Tammana
2021-04-16 22:00 ` Denys Dmytriyenko
2021-04-16 22:11 ` [EXTERNAL] " Tammana, Gowtham
2021-04-16 22:14 ` Denys Dmytriyenko
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.