All of lore.kernel.org
 help / color / mirror / Atom feed
* [Buildroot] [PATCH 1/1] package/nginx: override endianness
@ 2021-08-30 20:53 Nevo Hed
  2021-08-31 11:11 ` Nevo Hed
  2021-08-31 13:45 ` Arnout Vandecappelle
  0 siblings, 2 replies; 8+ messages in thread
From: Nevo Hed @ 2021-08-30 20:53 UTC (permalink / raw)
  To: buildroot; +Cc: Nevo Hed, Samuel Martin

Though several patches exist in buildroot's nginx package dir they do
not seem to address endianness.

The test program generated my the script compiles but fails to run (as
it is built for another architecture) but the script does not
distinguish between the failure to run the program and an indication
of certain endianness.  As such the fallback of big-endian is used.
This setting then causes http2 headers (anything not in the satic
dictionary) to come out as undecipherble trash.

This commit includes a patch to the configure script to allow a
`--force-endianness=big|little` flag as as setting that flag in
buildroot's package makefile.

Signed-off-by: Nevo Hed <nhed+buildroot@starry.com>
---
 ...-of-endianness-for-cross-compilation.patch | 115 ++++++++++++++++++
 package/nginx/nginx.mk                        |   1 +
 2 files changed, 116 insertions(+)
 create mode 100644 package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch

diff --git a/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch b/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
new file mode 100644
index 0000000000..137ff6ea5d
--- /dev/null
+++ b/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
@@ -0,0 +1,115 @@
+From b1a6b13d8ac2cade71bae508c7d20fbee6807e4e Mon Sep 17 00:00:00 2001
+From: Nevo Hed <nhed+buildroot@starry.com>
+Date: Mon, 30 Aug 2021 13:28:13 -0400
+Subject: [PATCH] Allow forcing of endianness for cross-compilation
+
+Signed-off-by: Nevo Hed <nhed+buildroot@starry.com>
+---
+ auto/endianness | 61 ++++++++++++++++++++++++++++++++-----------------
+ auto/options    |  6 +++++
+ 2 files changed, 46 insertions(+), 21 deletions(-)
+
+diff --git a/auto/endianness b/auto/endianness
+index 1b552b6b..4b2a3cd7 100644
+--- a/auto/endianness
++++ b/auto/endianness
+@@ -26,25 +26,44 @@ int main(void) {
+ 
+ END
+ 
+-ngx_test="$CC $CC_TEST_FLAGS $CC_AUX_FLAGS \
+-          -o $NGX_AUTOTEST $NGX_AUTOTEST.c $NGX_LD_OPT $ngx_feature_libs"
+-
+-eval "$ngx_test >> $NGX_AUTOCONF_ERR 2>&1"
+-
+-if [ -x $NGX_AUTOTEST ]; then
+-    if $NGX_AUTOTEST >/dev/null 2>&1; then
+-        echo " little endian"
++case "${NGX_FORCE_ENDIANNESS}" in
++    little)
++        echo " little endian (forced)"
+         have=NGX_HAVE_LITTLE_ENDIAN . auto/have
+-    else
+-        echo " big endian"
+-    fi
+-
+-    rm -rf $NGX_AUTOTEST*
+-
+-else
+-    rm -rf $NGX_AUTOTEST*
+-
+-    echo
+-    echo "$0: error: cannot detect system byte ordering"
+-    exit 1
+-fi
++    ;;
++
++    big)
++        echo " big endian (forced)"
++    ;;
++
++    "")
++        ngx_test="$CC $CC_TEST_FLAGS $CC_AUX_FLAGS \
++                  -o $NGX_AUTOTEST $NGX_AUTOTEST.c $NGX_LD_OPT $ngx_feature_libs"
++
++        eval "$ngx_test >> $NGX_AUTOCONF_ERR 2>&1"
++
++        if [ -x $NGX_AUTOTEST ]; then
++            if $NGX_AUTOTEST >/dev/null 2>&1; then
++                echo " little endian"
++                have=NGX_HAVE_LITTLE_ENDIAN . auto/have
++            else
++                echo " big endian"
++            fi
++
++            rm -rf $NGX_AUTOTEST*
++
++        else
++            rm -rf $NGX_AUTOTEST*
++
++            echo
++            echo "$0: error: cannot detect system byte ordering"
++            exit 1
++        fi
++    ;;
++
++    *)
++        echo
++        echo "$0: error: invalid \"--force-endianness=${NGX_FORCE_ENDIANNESS}\""
++        exit 1
++    ;;
++esac
+diff --git a/auto/options b/auto/options
+index 80be906e..85a06456 100644
+--- a/auto/options
++++ b/auto/options
+@@ -17,6 +17,8 @@ NGX_USER=
+ NGX_GROUP=
+ NGX_BUILD=
+ 
++NGX_FORCE_ENDIANNESS=
++
+ CC=${CC:-cc}
+ CPP=
+ NGX_OBJS=objs
+@@ -196,6 +198,8 @@ do
+         --user=*)                        NGX_USER="$value"          ;;
+         --group=*)                       NGX_GROUP="$value"         ;;
+ 
++        --force-endianness=*)            NGX_FORCE_ENDIANNESS="$value" ;;
++
+         --crossbuild=*)                  NGX_PLATFORM="$value"      ;;
+ 
+         --build=*)                       NGX_BUILD="$value"         ;;
+@@ -432,6 +436,8 @@ cat << END
+   --build=NAME                       set build name
+   --builddir=DIR                     set build directory
+ 
++  --force-endianness=<big>|<little>  force endianness
++
+   --with-select_module               enable select module
+   --without-select_module            disable select module
+   --with-poll_module                 enable poll module
+-- 
+2.31.1
+
diff --git a/package/nginx/nginx.mk b/package/nginx/nginx.mk
index 1f996cc613..31b6e276b7 100644
--- a/package/nginx/nginx.mk
+++ b/package/nginx/nginx.mk
@@ -49,6 +49,7 @@ NGINX_CONF_ENV += \
 
 # prefix: nginx root configuration location
 NGINX_CONF_OPTS += \
+	--force-endianness=$(call qstrip,$(call LOWERCASE,$(BR2_ENDIAN))) \
 	--prefix=/usr \
 	--conf-path=/etc/nginx/nginx.conf \
 	--sbin-path=/usr/sbin/nginx \
-- 
2.31.1

_______________________________________________
buildroot mailing list
buildroot@busybox.net
http://lists.busybox.net/mailman/listinfo/buildroot

^ permalink raw reply related	[flat|nested] 8+ messages in thread

* Re: [Buildroot] [PATCH 1/1] package/nginx: override endianness
  2021-08-30 20:53 [Buildroot] [PATCH 1/1] package/nginx: override endianness Nevo Hed
@ 2021-08-31 11:11 ` Nevo Hed
  2021-08-31 11:55   ` Baruch Siach
  2021-08-31 13:45 ` Arnout Vandecappelle
  1 sibling, 1 reply; 8+ messages in thread
From: Nevo Hed @ 2021-08-31 11:11 UTC (permalink / raw)
  To: buildroot; +Cc: Samuel Martin


[-- Attachment #1.1: Type: text/plain, Size: 5596 bytes --]

Hi All

This is my first contribution attempt in buildroot.

Just noticed a couple of typos (missing words actually) in the top commit
message.  Should I wait for other feedback or work on replacement patch
asap (won't be in office for at least 5 from now).

On Mon, Aug 30, 2021, 4:54 PM Nevo Hed <nhed+buildroot@starry.com> wrote:

> Though several patches exist in buildroot's nginx package dir they do
> not seem to address endianness.
>
> The test program generated my the script compiles but fails to run (as
> it is built for another architecture) but the script does not
> distinguish between the failure to run the program and an indication
> of certain endianness.  As such the fallback of big-endian is used.
> This setting then causes http2 headers (anything not in the satic
> dictionary) to come out as undecipherble trash.
>
> This commit includes a patch to the configure script to allow a
> `--force-endianness=big|little` flag as as setting that flag in
> buildroot's package makefile.
>
> Signed-off-by: Nevo Hed <nhed+buildroot@starry.com>
> ---
>  ...-of-endianness-for-cross-compilation.patch | 115 ++++++++++++++++++
>  package/nginx/nginx.mk                        |   1 +
>  2 files changed, 116 insertions(+)
>  create mode 100644
> package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
>
> diff --git
> a/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
> b/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
> new file mode 100644
> index 0000000000..137ff6ea5d
> --- /dev/null
> +++
> b/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
> @@ -0,0 +1,115 @@
> +From b1a6b13d8ac2cade71bae508c7d20fbee6807e4e Mon Sep 17 00:00:00 2001
> +From: Nevo Hed <nhed+buildroot@starry.com>
> +Date: Mon, 30 Aug 2021 13:28:13 -0400
> +Subject: [PATCH] Allow forcing of endianness for cross-compilation
> +
> +Signed-off-by: Nevo Hed <nhed+buildroot@starry.com>
> +---
> + auto/endianness | 61 ++++++++++++++++++++++++++++++++-----------------
> + auto/options    |  6 +++++
> + 2 files changed, 46 insertions(+), 21 deletions(-)
> +
> +diff --git a/auto/endianness b/auto/endianness
> +index 1b552b6b..4b2a3cd7 100644
> +--- a/auto/endianness
> ++++ b/auto/endianness
> +@@ -26,25 +26,44 @@ int main(void) {
> +
> + END
> +
> +-ngx_test="$CC $CC_TEST_FLAGS $CC_AUX_FLAGS \
> +-          -o $NGX_AUTOTEST $NGX_AUTOTEST.c $NGX_LD_OPT $ngx_feature_libs"
> +-
> +-eval "$ngx_test >> $NGX_AUTOCONF_ERR 2>&1"
> +-
> +-if [ -x $NGX_AUTOTEST ]; then
> +-    if $NGX_AUTOTEST >/dev/null 2>&1; then
> +-        echo " little endian"
> ++case "${NGX_FORCE_ENDIANNESS}" in
> ++    little)
> ++        echo " little endian (forced)"
> +         have=NGX_HAVE_LITTLE_ENDIAN . auto/have
> +-    else
> +-        echo " big endian"
> +-    fi
> +-
> +-    rm -rf $NGX_AUTOTEST*
> +-
> +-else
> +-    rm -rf $NGX_AUTOTEST*
> +-
> +-    echo
> +-    echo "$0: error: cannot detect system byte ordering"
> +-    exit 1
> +-fi
> ++    ;;
> ++
> ++    big)
> ++        echo " big endian (forced)"
> ++    ;;
> ++
> ++    "")
> ++        ngx_test="$CC $CC_TEST_FLAGS $CC_AUX_FLAGS \
> ++                  -o $NGX_AUTOTEST $NGX_AUTOTEST.c $NGX_LD_OPT
> $ngx_feature_libs"
> ++
> ++        eval "$ngx_test >> $NGX_AUTOCONF_ERR 2>&1"
> ++
> ++        if [ -x $NGX_AUTOTEST ]; then
> ++            if $NGX_AUTOTEST >/dev/null 2>&1; then
> ++                echo " little endian"
> ++                have=NGX_HAVE_LITTLE_ENDIAN . auto/have
> ++            else
> ++                echo " big endian"
> ++            fi
> ++
> ++            rm -rf $NGX_AUTOTEST*
> ++
> ++        else
> ++            rm -rf $NGX_AUTOTEST*
> ++
> ++            echo
> ++            echo "$0: error: cannot detect system byte ordering"
> ++            exit 1
> ++        fi
> ++    ;;
> ++
> ++    *)
> ++        echo
> ++        echo "$0: error: invalid
> \"--force-endianness=${NGX_FORCE_ENDIANNESS}\""
> ++        exit 1
> ++    ;;
> ++esac
> +diff --git a/auto/options b/auto/options
> +index 80be906e..85a06456 100644
> +--- a/auto/options
> ++++ b/auto/options
> +@@ -17,6 +17,8 @@ NGX_USER=
> + NGX_GROUP=
> + NGX_BUILD=
> +
> ++NGX_FORCE_ENDIANNESS=
> ++
> + CC=${CC:-cc}
> + CPP=
> + NGX_OBJS=objs
> +@@ -196,6 +198,8 @@ do
> +         --user=*)                        NGX_USER="$value"          ;;
> +         --group=*)                       NGX_GROUP="$value"         ;;
> +
> ++        --force-endianness=*)            NGX_FORCE_ENDIANNESS="$value" ;;
> ++
> +         --crossbuild=*)                  NGX_PLATFORM="$value"      ;;
> +
> +         --build=*)                       NGX_BUILD="$value"         ;;
> +@@ -432,6 +436,8 @@ cat << END
> +   --build=NAME                       set build name
> +   --builddir=DIR                     set build directory
> +
> ++  --force-endianness=<big>|<little>  force endianness
> ++
> +   --with-select_module               enable select module
> +   --without-select_module            disable select module
> +   --with-poll_module                 enable poll module
> +--
> +2.31.1
> +
> diff --git a/package/nginx/nginx.mk b/package/nginx/nginx.mk
> index 1f996cc613..31b6e276b7 100644
> --- a/package/nginx/nginx.mk
> +++ b/package/nginx/nginx.mk
> @@ -49,6 +49,7 @@ NGINX_CONF_ENV += \
>
>  # prefix: nginx root configuration location
>  NGINX_CONF_OPTS += \
> +       --force-endianness=$(call qstrip,$(call LOWERCASE,$(BR2_ENDIAN))) \
>         --prefix=/usr \
>         --conf-path=/etc/nginx/nginx.conf \
>         --sbin-path=/usr/sbin/nginx \
> --
> 2.31.1
>
>

[-- Attachment #1.2: Type: text/html, Size: 7715 bytes --]

[-- Attachment #2: Type: text/plain, Size: 145 bytes --]

_______________________________________________
buildroot mailing list
buildroot@busybox.net
http://lists.busybox.net/mailman/listinfo/buildroot

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [Buildroot] [PATCH 1/1] package/nginx: override endianness
  2021-08-31 11:11 ` Nevo Hed
@ 2021-08-31 11:55   ` Baruch Siach
  0 siblings, 0 replies; 8+ messages in thread
From: Baruch Siach @ 2021-08-31 11:55 UTC (permalink / raw)
  To: Nevo Hed; +Cc: Samuel Martin, buildroot


On Tue, Aug 31 2021, Nevo Hed wrote:
> This is my first contribution attempt in buildroot. 
>
> Just noticed a couple of typos (missing words actually) in the top
> commit message.  Should I wait for other feedback or work on
> replacement patch asap (won't be in office for at least 5 from now).

You can do either.

In case you send v2 patch, make sure to mark this one as superseded in
the Buildroot patchwork:

  http://patchwork.ozlabs.org/project/buildroot/list/

baruch

> On Mon, Aug 30, 2021, 4:54 PM Nevo Hed <nhed+buildroot@starry.com> wrote:
>
>  Though several patches exist in buildroot's nginx package dir they do
>  not seem to address endianness.
>
>  The test program generated my the script compiles but fails to run (as
>  it is built for another architecture) but the script does not
>  distinguish between the failure to run the program and an indication
>  of certain endianness.  As such the fallback of big-endian is used.
>  This setting then causes http2 headers (anything not in the satic
>  dictionary) to come out as undecipherble trash.
>
>  This commit includes a patch to the configure script to allow a
>  `--force-endianness=big|little` flag as as setting that flag in
>  buildroot's package makefile.
>
>  Signed-off-by: Nevo Hed <nhed+buildroot@starry.com>
>  ---
>   ...-of-endianness-for-cross-compilation.patch | 115 ++++++++++++++++++
>   package/nginx/nginx.mk                        |   1 +
>   2 files changed, 116 insertions(+)
>   create mode 100644 package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
>
>  diff --git a/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
>  b/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
>  new file mode 100644
>  index 0000000000..137ff6ea5d
>  --- /dev/null
>  +++ b/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
>  @@ -0,0 +1,115 @@
>  +From b1a6b13d8ac2cade71bae508c7d20fbee6807e4e Mon Sep 17 00:00:00 2001
>  +From: Nevo Hed <nhed+buildroot@starry.com>
>  +Date: Mon, 30 Aug 2021 13:28:13 -0400
>  +Subject: [PATCH] Allow forcing of endianness for cross-compilation
>  +
>  +Signed-off-by: Nevo Hed <nhed+buildroot@starry.com>
>  +---
>  + auto/endianness | 61 ++++++++++++++++++++++++++++++++-----------------
>  + auto/options    |  6 +++++
>  + 2 files changed, 46 insertions(+), 21 deletions(-)
>  +
>  +diff --git a/auto/endianness b/auto/endianness
>  +index 1b552b6b..4b2a3cd7 100644
>  +--- a/auto/endianness
>  ++++ b/auto/endianness
>  +@@ -26,25 +26,44 @@ int main(void) {
>  + 
>  + END
>  + 
>  +-ngx_test="$CC $CC_TEST_FLAGS $CC_AUX_FLAGS \
>  +-          -o $NGX_AUTOTEST $NGX_AUTOTEST.c $NGX_LD_OPT $ngx_feature_libs"
>  +-
>  +-eval "$ngx_test >> $NGX_AUTOCONF_ERR 2>&1"
>  +-
>  +-if [ -x $NGX_AUTOTEST ]; then
>  +-    if $NGX_AUTOTEST >/dev/null 2>&1; then
>  +-        echo " little endian"
>  ++case "${NGX_FORCE_ENDIANNESS}" in
>  ++    little)
>  ++        echo " little endian (forced)"
>  +         have=NGX_HAVE_LITTLE_ENDIAN . auto/have
>  +-    else
>  +-        echo " big endian"
>  +-    fi
>  +-
>  +-    rm -rf $NGX_AUTOTEST*
>  +-
>  +-else
>  +-    rm -rf $NGX_AUTOTEST*
>  +-
>  +-    echo
>  +-    echo "$0: error: cannot detect system byte ordering"
>  +-    exit 1
>  +-fi
>  ++    ;;
>  ++
>  ++    big)
>  ++        echo " big endian (forced)"
>  ++    ;;
>  ++
>  ++    "")
>  ++        ngx_test="$CC $CC_TEST_FLAGS $CC_AUX_FLAGS \
>  ++                  -o $NGX_AUTOTEST $NGX_AUTOTEST.c $NGX_LD_OPT $ngx_feature_libs"
>  ++
>  ++        eval "$ngx_test >> $NGX_AUTOCONF_ERR 2>&1"
>  ++
>  ++        if [ -x $NGX_AUTOTEST ]; then
>  ++            if $NGX_AUTOTEST >/dev/null 2>&1; then
>  ++                echo " little endian"
>  ++                have=NGX_HAVE_LITTLE_ENDIAN . auto/have
>  ++            else
>  ++                echo " big endian"
>  ++            fi
>  ++
>  ++            rm -rf $NGX_AUTOTEST*
>  ++
>  ++        else
>  ++            rm -rf $NGX_AUTOTEST*
>  ++
>  ++            echo
>  ++            echo "$0: error: cannot detect system byte ordering"
>  ++            exit 1
>  ++        fi
>  ++    ;;
>  ++
>  ++    *)
>  ++        echo
>  ++        echo "$0: error: invalid \"--force-endianness=${NGX_FORCE_ENDIANNESS}\""
>  ++        exit 1
>  ++    ;;
>  ++esac
>  +diff --git a/auto/options b/auto/options
>  +index 80be906e..85a06456 100644
>  +--- a/auto/options
>  ++++ b/auto/options
>  +@@ -17,6 +17,8 @@ NGX_USER=
>  + NGX_GROUP=
>  + NGX_BUILD=
>  + 
>  ++NGX_FORCE_ENDIANNESS=
>  ++
>  + CC=${CC:-cc}
>  + CPP=
>  + NGX_OBJS=objs
>  +@@ -196,6 +198,8 @@ do
>  +         --user=*)                        NGX_USER="$value"          ;;
>  +         --group=*)                       NGX_GROUP="$value"         ;;
>  + 
>  ++        --force-endianness=*)            NGX_FORCE_ENDIANNESS="$value" ;;
>  ++
>  +         --crossbuild=*)                  NGX_PLATFORM="$value"      ;;
>  + 
>  +         --build=*)                       NGX_BUILD="$value"         ;;
>  +@@ -432,6 +436,8 @@ cat << END
>  +   --build=NAME                       set build name
>  +   --builddir=DIR                     set build directory
>  + 
>  ++  --force-endianness=<big>|<little>  force endianness
>  ++
>  +   --with-select_module               enable select module
>  +   --without-select_module            disable select module
>  +   --with-poll_module                 enable poll module
>  +-- 
>  +2.31.1
>  +
>  diff --git a/package/nginx/nginx.mk b/package/nginx/nginx.mk
>  index 1f996cc613..31b6e276b7 100644
>  --- a/package/nginx/nginx.mk
>  +++ b/package/nginx/nginx.mk
>  @@ -49,6 +49,7 @@ NGINX_CONF_ENV += \
>
>   # prefix: nginx root configuration location
>   NGINX_CONF_OPTS += \
>  +       --force-endianness=$(call qstrip,$(call LOWERCASE,$(BR2_ENDIAN))) \
>          --prefix=/usr \
>          --conf-path=/etc/nginx/nginx.conf \
>          --sbin-path=/usr/sbin/nginx \
>  -- 
>  2.31.1
>
> _______________________________________________
> buildroot mailing list
> buildroot@busybox.net
> http://lists.busybox.net/mailman/listinfo/buildroot


-- 
                                                     ~. .~   Tk Open Systems
=}------------------------------------------------ooO--U--Ooo------------{=
   - baruch@tkos.co.il - tel: +972.52.368.4656, http://www.tkos.co.il -
_______________________________________________
buildroot mailing list
buildroot@busybox.net
http://lists.busybox.net/mailman/listinfo/buildroot

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [Buildroot] [PATCH 1/1] package/nginx: override endianness
  2021-08-30 20:53 [Buildroot] [PATCH 1/1] package/nginx: override endianness Nevo Hed
  2021-08-31 11:11 ` Nevo Hed
@ 2021-08-31 13:45 ` Arnout Vandecappelle
  2021-08-31 16:19   ` Nevo Hed
  1 sibling, 1 reply; 8+ messages in thread
From: Arnout Vandecappelle @ 2021-08-31 13:45 UTC (permalink / raw)
  To: Nevo Hed, buildroot; +Cc: Samuel Martin



On 30/08/2021 22:53, Nevo Hed wrote:
> Though several patches exist in buildroot's nginx package dir they do
> not seem to address endianness.
> 
> The test program generated my the script compiles but fails to run (as
> it is built for another architecture) but the script does not
> distinguish between the failure to run the program and an indication
> of certain endianness.  As such the fallback of big-endian is used.
> This setting then causes http2 headers (anything not in the satic
> dictionary) to come out as undecipherble trash.
> 
> This commit includes a patch to the configure script to allow a
> `--force-endianness=big|little` flag as as setting that flag in
> buildroot's package makefile.
> 
> Signed-off-by: Nevo Hed <nhed+buildroot@starry.com>
> ---
>  ...-of-endianness-for-cross-compilation.patch | 115 ++++++++++++++++++
>  package/nginx/nginx.mk                        |   1 +
>  2 files changed, 116 insertions(+)
>  create mode 100644 package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
> 
> diff --git a/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch b/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
> new file mode 100644
> index 0000000000..137ff6ea5d
> --- /dev/null
> +++ b/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
> @@ -0,0 +1,115 @@
> +From b1a6b13d8ac2cade71bae508c7d20fbee6807e4e Mon Sep 17 00:00:00 2001
> +From: Nevo Hed <nhed+buildroot@starry.com>
> +Date: Mon, 30 Aug 2021 13:28:13 -0400
> +Subject: [PATCH] Allow forcing of endianness for cross-compilation
> +
> +Signed-off-by: Nevo Hed <nhed+buildroot@starry.com>

 Ideally, you should have sent the patch upstream and you should add a reference
to the upstream contribution. In this case, it can be as simple as:

Upstream-status: Invalid (upstream doesn't support cross-compilation)
See https://trac.nginx.org/nginx/ticket/2240


 Regards,
 Arnout

> +---
> + auto/endianness | 61 ++++++++++++++++++++++++++++++++-----------------
> + auto/options    |  6 +++++
> + 2 files changed, 46 insertions(+), 21 deletions(-)
> +
> +diff --git a/auto/endianness b/auto/endianness
> +index 1b552b6b..4b2a3cd7 100644
> +--- a/auto/endianness
> ++++ b/auto/endianness
> +@@ -26,25 +26,44 @@ int main(void) {
> + 
> + END
> + 
> +-ngx_test="$CC $CC_TEST_FLAGS $CC_AUX_FLAGS \
> +-          -o $NGX_AUTOTEST $NGX_AUTOTEST.c $NGX_LD_OPT $ngx_feature_libs"
> +-
> +-eval "$ngx_test >> $NGX_AUTOCONF_ERR 2>&1"
> +-
> +-if [ -x $NGX_AUTOTEST ]; then
> +-    if $NGX_AUTOTEST >/dev/null 2>&1; then
> +-        echo " little endian"
> ++case "${NGX_FORCE_ENDIANNESS}" in
> ++    little)
> ++        echo " little endian (forced)"
> +         have=NGX_HAVE_LITTLE_ENDIAN . auto/have
> +-    else
> +-        echo " big endian"
> +-    fi
> +-
> +-    rm -rf $NGX_AUTOTEST*
> +-
> +-else
> +-    rm -rf $NGX_AUTOTEST*
> +-
> +-    echo
> +-    echo "$0: error: cannot detect system byte ordering"
> +-    exit 1
> +-fi
> ++    ;;
> ++
> ++    big)
> ++        echo " big endian (forced)"
> ++    ;;
> ++
> ++    "")
> ++        ngx_test="$CC $CC_TEST_FLAGS $CC_AUX_FLAGS \
> ++                  -o $NGX_AUTOTEST $NGX_AUTOTEST.c $NGX_LD_OPT $ngx_feature_libs"
> ++
> ++        eval "$ngx_test >> $NGX_AUTOCONF_ERR 2>&1"
> ++
> ++        if [ -x $NGX_AUTOTEST ]; then
> ++            if $NGX_AUTOTEST >/dev/null 2>&1; then
> ++                echo " little endian"
> ++                have=NGX_HAVE_LITTLE_ENDIAN . auto/have
> ++            else
> ++                echo " big endian"
> ++            fi
> ++
> ++            rm -rf $NGX_AUTOTEST*
> ++
> ++        else
> ++            rm -rf $NGX_AUTOTEST*
> ++
> ++            echo
> ++            echo "$0: error: cannot detect system byte ordering"
> ++            exit 1
> ++        fi
> ++    ;;
> ++
> ++    *)
> ++        echo
> ++        echo "$0: error: invalid \"--force-endianness=${NGX_FORCE_ENDIANNESS}\""
> ++        exit 1
> ++    ;;
> ++esac
> +diff --git a/auto/options b/auto/options
> +index 80be906e..85a06456 100644
> +--- a/auto/options
> ++++ b/auto/options
> +@@ -17,6 +17,8 @@ NGX_USER=
> + NGX_GROUP=
> + NGX_BUILD=
> + 
> ++NGX_FORCE_ENDIANNESS=
> ++
> + CC=${CC:-cc}
> + CPP=
> + NGX_OBJS=objs
> +@@ -196,6 +198,8 @@ do
> +         --user=*)                        NGX_USER="$value"          ;;
> +         --group=*)                       NGX_GROUP="$value"         ;;
> + 
> ++        --force-endianness=*)            NGX_FORCE_ENDIANNESS="$value" ;;
> ++
> +         --crossbuild=*)                  NGX_PLATFORM="$value"      ;;
> + 
> +         --build=*)                       NGX_BUILD="$value"         ;;
> +@@ -432,6 +436,8 @@ cat << END
> +   --build=NAME                       set build name
> +   --builddir=DIR                     set build directory
> + 
> ++  --force-endianness=<big>|<little>  force endianness
> ++
> +   --with-select_module               enable select module
> +   --without-select_module            disable select module
> +   --with-poll_module                 enable poll module
> +-- 
> +2.31.1
> +
> diff --git a/package/nginx/nginx.mk b/package/nginx/nginx.mk
> index 1f996cc613..31b6e276b7 100644
> --- a/package/nginx/nginx.mk
> +++ b/package/nginx/nginx.mk
> @@ -49,6 +49,7 @@ NGINX_CONF_ENV += \
>  
>  # prefix: nginx root configuration location
>  NGINX_CONF_OPTS += \
> +	--force-endianness=$(call qstrip,$(call LOWERCASE,$(BR2_ENDIAN))) \
>  	--prefix=/usr \
>  	--conf-path=/etc/nginx/nginx.conf \
>  	--sbin-path=/usr/sbin/nginx \
> 
_______________________________________________
buildroot mailing list
buildroot@busybox.net
http://lists.busybox.net/mailman/listinfo/buildroot

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [Buildroot] [PATCH 1/1] package/nginx: override endianness
  2021-08-31 13:45 ` Arnout Vandecappelle
@ 2021-08-31 16:19   ` Nevo Hed
  2021-08-31 16:39     ` Arnout Vandecappelle
  0 siblings, 1 reply; 8+ messages in thread
From: Nevo Hed @ 2021-08-31 16:19 UTC (permalink / raw)
  To: Arnout Vandecappelle; +Cc: Samuel Martin, buildroot


[-- Attachment #1.1: Type: text/plain, Size: 6253 bytes --]

Yes Arnout, That link is my report to nginx.

I will add that comment to my patch, but quick question -
will that go on my inner or outer patch?
I don't see the word 'upstream' in any of the current nginx patches and
most of them deal with unsupported cross-compilation


On Tue, Aug 31, 2021 at 9:45 AM Arnout Vandecappelle <arnout@mind.be> wrote:

>
>
> On 30/08/2021 22:53, Nevo Hed wrote:
> > Though several patches exist in buildroot's nginx package dir they do
> > not seem to address endianness.
> >
> > The test program generated my the script compiles but fails to run (as
> > it is built for another architecture) but the script does not
> > distinguish between the failure to run the program and an indication
> > of certain endianness.  As such the fallback of big-endian is used.
> > This setting then causes http2 headers (anything not in the satic
> > dictionary) to come out as undecipherble trash.
> >
> > This commit includes a patch to the configure script to allow a
> > `--force-endianness=big|little` flag as as setting that flag in
> > buildroot's package makefile.
> >
> > Signed-off-by: Nevo Hed <nhed+buildroot@starry.com>
> > ---
> >  ...-of-endianness-for-cross-compilation.patch | 115 ++++++++++++++++++
> >  package/nginx/nginx.mk                        |   1 +
> >  2 files changed, 116 insertions(+)
> >  create mode 100644
> package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
> >
> > diff --git
> a/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
> b/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
> > new file mode 100644
> > index 0000000000..137ff6ea5d
> > --- /dev/null
> > +++
> b/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
> > @@ -0,0 +1,115 @@
> > +From b1a6b13d8ac2cade71bae508c7d20fbee6807e4e Mon Sep 17 00:00:00 2001
> > +From: Nevo Hed <nhed+buildroot@starry.com>
> > +Date: Mon, 30 Aug 2021 13:28:13 -0400
> > +Subject: [PATCH] Allow forcing of endianness for cross-compilation
> > +
> > +Signed-off-by: Nevo Hed <nhed+buildroot@starry.com>
>
>  Ideally, you should have sent the patch upstream and you should add a
> reference
> to the upstream contribution. In this case, it can be as simple as:
>
> Upstream-status: Invalid (upstream doesn't support cross-compilation)
> See https://trac.nginx.org/nginx/ticket/2240
>
>
>  Regards,
>  Arnout
>
> > +---
> > + auto/endianness | 61 ++++++++++++++++++++++++++++++++-----------------
> > + auto/options    |  6 +++++
> > + 2 files changed, 46 insertions(+), 21 deletions(-)
> > +
> > +diff --git a/auto/endianness b/auto/endianness
> > +index 1b552b6b..4b2a3cd7 100644
> > +--- a/auto/endianness
> > ++++ b/auto/endianness
> > +@@ -26,25 +26,44 @@ int main(void) {
> > +
> > + END
> > +
> > +-ngx_test="$CC $CC_TEST_FLAGS $CC_AUX_FLAGS \
> > +-          -o $NGX_AUTOTEST $NGX_AUTOTEST.c $NGX_LD_OPT
> $ngx_feature_libs"
> > +-
> > +-eval "$ngx_test >> $NGX_AUTOCONF_ERR 2>&1"
> > +-
> > +-if [ -x $NGX_AUTOTEST ]; then
> > +-    if $NGX_AUTOTEST >/dev/null 2>&1; then
> > +-        echo " little endian"
> > ++case "${NGX_FORCE_ENDIANNESS}" in
> > ++    little)
> > ++        echo " little endian (forced)"
> > +         have=NGX_HAVE_LITTLE_ENDIAN . auto/have
> > +-    else
> > +-        echo " big endian"
> > +-    fi
> > +-
> > +-    rm -rf $NGX_AUTOTEST*
> > +-
> > +-else
> > +-    rm -rf $NGX_AUTOTEST*
> > +-
> > +-    echo
> > +-    echo "$0: error: cannot detect system byte ordering"
> > +-    exit 1
> > +-fi
> > ++    ;;
> > ++
> > ++    big)
> > ++        echo " big endian (forced)"
> > ++    ;;
> > ++
> > ++    "")
> > ++        ngx_test="$CC $CC_TEST_FLAGS $CC_AUX_FLAGS \
> > ++                  -o $NGX_AUTOTEST $NGX_AUTOTEST.c $NGX_LD_OPT
> $ngx_feature_libs"
> > ++
> > ++        eval "$ngx_test >> $NGX_AUTOCONF_ERR 2>&1"
> > ++
> > ++        if [ -x $NGX_AUTOTEST ]; then
> > ++            if $NGX_AUTOTEST >/dev/null 2>&1; then
> > ++                echo " little endian"
> > ++                have=NGX_HAVE_LITTLE_ENDIAN . auto/have
> > ++            else
> > ++                echo " big endian"
> > ++            fi
> > ++
> > ++            rm -rf $NGX_AUTOTEST*
> > ++
> > ++        else
> > ++            rm -rf $NGX_AUTOTEST*
> > ++
> > ++            echo
> > ++            echo "$0: error: cannot detect system byte ordering"
> > ++            exit 1
> > ++        fi
> > ++    ;;
> > ++
> > ++    *)
> > ++        echo
> > ++        echo "$0: error: invalid
> \"--force-endianness=${NGX_FORCE_ENDIANNESS}\""
> > ++        exit 1
> > ++    ;;
> > ++esac
> > +diff --git a/auto/options b/auto/options
> > +index 80be906e..85a06456 100644
> > +--- a/auto/options
> > ++++ b/auto/options
> > +@@ -17,6 +17,8 @@ NGX_USER=
> > + NGX_GROUP=
> > + NGX_BUILD=
> > +
> > ++NGX_FORCE_ENDIANNESS=
> > ++
> > + CC=${CC:-cc}
> > + CPP=
> > + NGX_OBJS=objs
> > +@@ -196,6 +198,8 @@ do
> > +         --user=*)                        NGX_USER="$value"          ;;
> > +         --group=*)                       NGX_GROUP="$value"         ;;
> > +
> > ++        --force-endianness=*)            NGX_FORCE_ENDIANNESS="$value"
> ;;
> > ++
> > +         --crossbuild=*)                  NGX_PLATFORM="$value"      ;;
> > +
> > +         --build=*)                       NGX_BUILD="$value"         ;;
> > +@@ -432,6 +436,8 @@ cat << END
> > +   --build=NAME                       set build name
> > +   --builddir=DIR                     set build directory
> > +
> > ++  --force-endianness=<big>|<little>  force endianness
> > ++
> > +   --with-select_module               enable select module
> > +   --without-select_module            disable select module
> > +   --with-poll_module                 enable poll module
> > +--
> > +2.31.1
> > +
> > diff --git a/package/nginx/nginx.mk b/package/nginx/nginx.mk
> > index 1f996cc613..31b6e276b7 100644
> > --- a/package/nginx/nginx.mk
> > +++ b/package/nginx/nginx.mk
> > @@ -49,6 +49,7 @@ NGINX_CONF_ENV += \
> >
> >  # prefix: nginx root configuration location
> >  NGINX_CONF_OPTS += \
> > +     --force-endianness=$(call qstrip,$(call LOWERCASE,$(BR2_ENDIAN))) \
> >       --prefix=/usr \
> >       --conf-path=/etc/nginx/nginx.conf \
> >       --sbin-path=/usr/sbin/nginx \
> >
>

[-- Attachment #1.2: Type: text/html, Size: 8851 bytes --]

[-- Attachment #2: Type: text/plain, Size: 145 bytes --]

_______________________________________________
buildroot mailing list
buildroot@busybox.net
http://lists.busybox.net/mailman/listinfo/buildroot

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [Buildroot] [PATCH 1/1] package/nginx: override endianness
  2021-08-31 16:19   ` Nevo Hed
@ 2021-08-31 16:39     ` Arnout Vandecappelle
  0 siblings, 0 replies; 8+ messages in thread
From: Arnout Vandecappelle @ 2021-08-31 16:39 UTC (permalink / raw)
  To: Nevo Hed; +Cc: Samuel Martin, buildroot



On 31/08/2021 18:19, Nevo Hed wrote:
> Yes Arnout, That link is my report to nginx.
> 
> I will add that comment to my patch, but quick question -
> will that go on my inner or outer patch?

 The inner patch.

> I don't see the word 'upstream' in any of the current nginx patches and most of
> them deal with unsupported cross-compilation

 Most of the patches are very old and we didn't have that "rule" back then. The
rule is also not very strict - we often overlook it while applying.


 Note: small changes like this (and the spelling fixes in the commit message) we
can make while applying, but of course it's much appreciated if you send a v2
with all the fixes.

 Regards,
 Arnout

> 
> 
> On Tue, Aug 31, 2021 at 9:45 AM Arnout Vandecappelle <arnout@mind.be
> <mailto:arnout@mind.be>> wrote:
> 
> 
> 
>     On 30/08/2021 22:53, Nevo Hed wrote:
>     > Though several patches exist in buildroot's nginx package dir they do
>     > not seem to address endianness.
>     >
>     > The test program generated my the script compiles but fails to run (as
>     > it is built for another architecture) but the script does not
>     > distinguish between the failure to run the program and an indication
>     > of certain endianness.  As such the fallback of big-endian is used.
>     > This setting then causes http2 headers (anything not in the satic
>     > dictionary) to come out as undecipherble trash.
>     >
>     > This commit includes a patch to the configure script to allow a
>     > `--force-endianness=big|little` flag as as setting that flag in
>     > buildroot's package makefile.
>     >
>     > Signed-off-by: Nevo Hed <nhed+buildroot@starry.com
>     <mailto:nhed%2Bbuildroot@starry.com>>
>     > ---
>     >  ...-of-endianness-for-cross-compilation.patch | 115 ++++++++++++++++++
>     >  package/nginx/nginx.mk <http://nginx.mk>                        |   1 +
>     >  2 files changed, 116 insertions(+)
>     >  create mode 100644
>     package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
>     >
>     > diff --git
>     a/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
>     b/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
>     > new file mode 100644
>     > index 0000000000..137ff6ea5d
>     > --- /dev/null
>     > +++
>     b/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
>     > @@ -0,0 +1,115 @@
>     > +From b1a6b13d8ac2cade71bae508c7d20fbee6807e4e Mon Sep 17 00:00:00 2001
>     > +From: Nevo Hed <nhed+buildroot@starry.com
>     <mailto:nhed%2Bbuildroot@starry.com>>
>     > +Date: Mon, 30 Aug 2021 13:28:13 -0400
>     > +Subject: [PATCH] Allow forcing of endianness for cross-compilation
>     > +
>     > +Signed-off-by: Nevo Hed <nhed+buildroot@starry.com
>     <mailto:nhed%2Bbuildroot@starry.com>>
> 
>      Ideally, you should have sent the patch upstream and you should add a reference
>     to the upstream contribution. In this case, it can be as simple as:
> 
>     Upstream-status: Invalid (upstream doesn't support cross-compilation)
>     See https://trac.nginx.org/nginx/ticket/2240
>     <https://trac.nginx.org/nginx/ticket/2240>
> 
> 
>      Regards,
>      Arnout
> 
>     > +---
>     > + auto/endianness | 61 ++++++++++++++++++++++++++++++++-----------------
>     > + auto/options    |  6 +++++
>     > + 2 files changed, 46 insertions(+), 21 deletions(-)
>     > +
>     > +diff --git a/auto/endianness b/auto/endianness
>     > +index 1b552b6b..4b2a3cd7 100644
>     > +--- a/auto/endianness
>     > ++++ b/auto/endianness
>     > +@@ -26,25 +26,44 @@ int main(void) {
>     > +
>     > + END
>     > +
>     > +-ngx_test="$CC $CC_TEST_FLAGS $CC_AUX_FLAGS \
>     > +-          -o $NGX_AUTOTEST $NGX_AUTOTEST.c $NGX_LD_OPT $ngx_feature_libs"
>     > +-
>     > +-eval "$ngx_test >> $NGX_AUTOCONF_ERR 2>&1"
>     > +-
>     > +-if [ -x $NGX_AUTOTEST ]; then
>     > +-    if $NGX_AUTOTEST >/dev/null 2>&1; then
>     > +-        echo " little endian"
>     > ++case "${NGX_FORCE_ENDIANNESS}" in
>     > ++    little)
>     > ++        echo " little endian (forced)"
>     > +         have=NGX_HAVE_LITTLE_ENDIAN . auto/have
>     > +-    else
>     > +-        echo " big endian"
>     > +-    fi
>     > +-
>     > +-    rm -rf $NGX_AUTOTEST*
>     > +-
>     > +-else
>     > +-    rm -rf $NGX_AUTOTEST*
>     > +-
>     > +-    echo
>     > +-    echo "$0: error: cannot detect system byte ordering"
>     > +-    exit 1
>     > +-fi
>     > ++    ;;
>     > ++
>     > ++    big)
>     > ++        echo " big endian (forced)"
>     > ++    ;;
>     > ++
>     > ++    "")
>     > ++        ngx_test="$CC $CC_TEST_FLAGS $CC_AUX_FLAGS \
>     > ++                  -o $NGX_AUTOTEST $NGX_AUTOTEST.c $NGX_LD_OPT
>     $ngx_feature_libs"
>     > ++
>     > ++        eval "$ngx_test >> $NGX_AUTOCONF_ERR 2>&1"
>     > ++
>     > ++        if [ -x $NGX_AUTOTEST ]; then
>     > ++            if $NGX_AUTOTEST >/dev/null 2>&1; then
>     > ++                echo " little endian"
>     > ++                have=NGX_HAVE_LITTLE_ENDIAN . auto/have
>     > ++            else
>     > ++                echo " big endian"
>     > ++            fi
>     > ++
>     > ++            rm -rf $NGX_AUTOTEST*
>     > ++
>     > ++        else
>     > ++            rm -rf $NGX_AUTOTEST*
>     > ++
>     > ++            echo
>     > ++            echo "$0: error: cannot detect system byte ordering"
>     > ++            exit 1
>     > ++        fi
>     > ++    ;;
>     > ++
>     > ++    *)
>     > ++        echo
>     > ++        echo "$0: error: invalid
>     \"--force-endianness=${NGX_FORCE_ENDIANNESS}\""
>     > ++        exit 1
>     > ++    ;;
>     > ++esac
>     > +diff --git a/auto/options b/auto/options
>     > +index 80be906e..85a06456 100644
>     > +--- a/auto/options
>     > ++++ b/auto/options
>     > +@@ -17,6 +17,8 @@ NGX_USER=
>     > + NGX_GROUP=
>     > + NGX_BUILD=
>     > +
>     > ++NGX_FORCE_ENDIANNESS=
>     > ++
>     > + CC=${CC:-cc}
>     > + CPP=
>     > + NGX_OBJS=objs
>     > +@@ -196,6 +198,8 @@ do
>     > +         --user=*)                        NGX_USER="$value"          ;;
>     > +         --group=*)                       NGX_GROUP="$value"         ;;
>     > +
>     > ++        --force-endianness=*)            NGX_FORCE_ENDIANNESS="$value" ;;
>     > ++
>     > +         --crossbuild=*)                  NGX_PLATFORM="$value"      ;;
>     > +
>     > +         --build=*)                       NGX_BUILD="$value"         ;;
>     > +@@ -432,6 +436,8 @@ cat << END
>     > +   --build=NAME                       set build name
>     > +   --builddir=DIR                     set build directory
>     > +
>     > ++  --force-endianness=<big>|<little>  force endianness
>     > ++
>     > +   --with-select_module               enable select module
>     > +   --without-select_module            disable select module
>     > +   --with-poll_module                 enable poll module
>     > +--
>     > +2.31.1
>     > +
>     > diff --git a/package/nginx/nginx.mk <http://nginx.mk>
>     b/package/nginx/nginx.mk <http://nginx.mk>
>     > index 1f996cc613..31b6e276b7 100644
>     > --- a/package/nginx/nginx.mk <http://nginx.mk>
>     > +++ b/package/nginx/nginx.mk <http://nginx.mk>
>     > @@ -49,6 +49,7 @@ NGINX_CONF_ENV += \
>     > 
>     >  # prefix: nginx root configuration location
>     >  NGINX_CONF_OPTS += \
>     > +     --force-endianness=$(call qstrip,$(call LOWERCASE,$(BR2_ENDIAN))) \
>     >       --prefix=/usr \
>     >       --conf-path=/etc/nginx/nginx.conf \
>     >       --sbin-path=/usr/sbin/nginx \
>     >
> 
_______________________________________________
buildroot mailing list
buildroot@busybox.net
http://lists.busybox.net/mailman/listinfo/buildroot

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [Buildroot] [PATCH 1/1] package/nginx: override endianness
  2021-08-31 20:24 ` [Buildroot] [PATCH 1/1] " Nevo Hed
@ 2021-09-10  9:59   ` Peter Korsgaard
  0 siblings, 0 replies; 8+ messages in thread
From: Peter Korsgaard @ 2021-09-10  9:59 UTC (permalink / raw)
  To: Nevo Hed; +Cc: Samuel Martin, buildroot

>>>>> "Nevo" == Nevo Hed <nhed+buildroot@starry.com> writes:

 > Though several cross-compilation patches exist in buildroot's nginx
 > package dir they do not seem to address endianness.

 > The test program generated by the configure script compiles but fails
 > to run (as it is built for another architecture) but the script does
 > not distinguish between the failure to run the program and an
 > indication of certain endianness.  As such the fallback of big-endian
 > is used.  This setting then causes http2 headers (anything not in the
 > static dictionary) to come out as undecipherable trash on 64bit
 > targets (see ngx_http_v2_huff_encode_buf()).

 > This commit includes a patch to the configure script to allow a
 > `--force-endianness=big|little` flag as well as setting that flag in
 > buildroot's package makefile.

 > Signed-off-by: Nevo Hed <nhed+buildroot@starry.com>

Committed to 2021.02.x and 2021.05.x, thanks.

-- 
Bye, Peter Korsgaard
_______________________________________________
buildroot mailing list
buildroot@lists.buildroot.org
https://lists.buildroot.org/mailman/listinfo/buildroot

^ permalink raw reply	[flat|nested] 8+ messages in thread

* [Buildroot] [PATCH 1/1] package/nginx: override endianness
  2021-08-31 20:24 [Buildroot] [PATCH v2 0/1] " Nevo Hed
@ 2021-08-31 20:24 ` Nevo Hed
  2021-09-10  9:59   ` Peter Korsgaard
  0 siblings, 1 reply; 8+ messages in thread
From: Nevo Hed @ 2021-08-31 20:24 UTC (permalink / raw)
  To: buildroot; +Cc: Nevo Hed, Samuel Martin

Though several cross-compilation patches exist in buildroot's nginx
package dir they do not seem to address endianness.

The test program generated by the configure script compiles but fails
to run (as it is built for another architecture) but the script does
not distinguish between the failure to run the program and an
indication of certain endianness.  As such the fallback of big-endian
is used.  This setting then causes http2 headers (anything not in the
static dictionary) to come out as undecipherable trash on 64bit
targets (see ngx_http_v2_huff_encode_buf()).

This commit includes a patch to the configure script to allow a
`--force-endianness=big|little` flag as well as setting that flag in
buildroot's package makefile.

Signed-off-by: Nevo Hed <nhed+buildroot@starry.com>
---
 ...-of-endianness-for-cross-compilation.patch | 118 ++++++++++++++++++
 package/nginx/nginx.mk                        |   1 +
 2 files changed, 119 insertions(+)
 create mode 100644 package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch

diff --git a/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch b/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
new file mode 100644
index 0000000000..3810412b52
--- /dev/null
+++ b/package/nginx/0010-Allow-forcing-of-endianness-for-cross-compilation.patch
@@ -0,0 +1,118 @@
+From 4bd8fe780ff2064f2d4e9c905d8a98dd0f9b6191 Mon Sep 17 00:00:00 2001
+From: Nevo Hed <nhed+buildroot@starry.com>
+Date: Mon, 30 Aug 2021 13:28:13 -0400
+Subject: [PATCH] Allow forcing of endianness for cross-compilation
+
+Upstream-status: Invalid (upstream doesn't support cross-compilation)
+See https://trac.nginx.org/nginx/ticket/2240
+
+Signed-off-by: Nevo Hed <nhed+buildroot@starry.com>
+---
+ auto/endianness | 61 ++++++++++++++++++++++++++++++++-----------------
+ auto/options    |  6 +++++
+ 2 files changed, 46 insertions(+), 21 deletions(-)
+
+diff --git a/auto/endianness b/auto/endianness
+index 1b552b6b..4b2a3cd7 100644
+--- a/auto/endianness
++++ b/auto/endianness
+@@ -26,25 +26,44 @@ int main(void) {
+ 
+ END
+ 
+-ngx_test="$CC $CC_TEST_FLAGS $CC_AUX_FLAGS \
+-          -o $NGX_AUTOTEST $NGX_AUTOTEST.c $NGX_LD_OPT $ngx_feature_libs"
+-
+-eval "$ngx_test >> $NGX_AUTOCONF_ERR 2>&1"
+-
+-if [ -x $NGX_AUTOTEST ]; then
+-    if $NGX_AUTOTEST >/dev/null 2>&1; then
+-        echo " little endian"
++case "${NGX_FORCE_ENDIANNESS}" in
++    little)
++        echo " little endian (forced)"
+         have=NGX_HAVE_LITTLE_ENDIAN . auto/have
+-    else
+-        echo " big endian"
+-    fi
+-
+-    rm -rf $NGX_AUTOTEST*
+-
+-else
+-    rm -rf $NGX_AUTOTEST*
+-
+-    echo
+-    echo "$0: error: cannot detect system byte ordering"
+-    exit 1
+-fi
++    ;;
++
++    big)
++        echo " big endian (forced)"
++    ;;
++
++    "")
++        ngx_test="$CC $CC_TEST_FLAGS $CC_AUX_FLAGS \
++                  -o $NGX_AUTOTEST $NGX_AUTOTEST.c $NGX_LD_OPT $ngx_feature_libs"
++
++        eval "$ngx_test >> $NGX_AUTOCONF_ERR 2>&1"
++
++        if [ -x $NGX_AUTOTEST ]; then
++            if $NGX_AUTOTEST >/dev/null 2>&1; then
++                echo " little endian"
++                have=NGX_HAVE_LITTLE_ENDIAN . auto/have
++            else
++                echo " big endian"
++            fi
++
++            rm -rf $NGX_AUTOTEST*
++
++        else
++            rm -rf $NGX_AUTOTEST*
++
++            echo
++            echo "$0: error: cannot detect system byte ordering"
++            exit 1
++        fi
++    ;;
++
++    *)
++        echo
++        echo "$0: error: invalid \"--force-endianness=${NGX_FORCE_ENDIANNESS}\""
++        exit 1
++    ;;
++esac
+diff --git a/auto/options b/auto/options
+index 80be906e..85a06456 100644
+--- a/auto/options
++++ b/auto/options
+@@ -17,6 +17,8 @@ NGX_USER=
+ NGX_GROUP=
+ NGX_BUILD=
+ 
++NGX_FORCE_ENDIANNESS=
++
+ CC=${CC:-cc}
+ CPP=
+ NGX_OBJS=objs
+@@ -196,6 +198,8 @@ do
+         --user=*)                        NGX_USER="$value"          ;;
+         --group=*)                       NGX_GROUP="$value"         ;;
+ 
++        --force-endianness=*)            NGX_FORCE_ENDIANNESS="$value" ;;
++
+         --crossbuild=*)                  NGX_PLATFORM="$value"      ;;
+ 
+         --build=*)                       NGX_BUILD="$value"         ;;
+@@ -432,6 +436,8 @@ cat << END
+   --build=NAME                       set build name
+   --builddir=DIR                     set build directory
+ 
++  --force-endianness=<big>|<little>  force endianness
++
+   --with-select_module               enable select module
+   --without-select_module            disable select module
+   --with-poll_module                 enable poll module
+-- 
+2.31.1
+
diff --git a/package/nginx/nginx.mk b/package/nginx/nginx.mk
index 1f996cc613..31b6e276b7 100644
--- a/package/nginx/nginx.mk
+++ b/package/nginx/nginx.mk
@@ -49,6 +49,7 @@ NGINX_CONF_ENV += \
 
 # prefix: nginx root configuration location
 NGINX_CONF_OPTS += \
+	--force-endianness=$(call qstrip,$(call LOWERCASE,$(BR2_ENDIAN))) \
 	--prefix=/usr \
 	--conf-path=/etc/nginx/nginx.conf \
 	--sbin-path=/usr/sbin/nginx \
-- 
2.31.1

_______________________________________________
buildroot mailing list
buildroot@busybox.net
http://lists.busybox.net/mailman/listinfo/buildroot

^ permalink raw reply related	[flat|nested] 8+ messages in thread

end of thread, other threads:[~2021-09-10  9:59 UTC | newest]

Thread overview: 8+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-08-30 20:53 [Buildroot] [PATCH 1/1] package/nginx: override endianness Nevo Hed
2021-08-31 11:11 ` Nevo Hed
2021-08-31 11:55   ` Baruch Siach
2021-08-31 13:45 ` Arnout Vandecappelle
2021-08-31 16:19   ` Nevo Hed
2021-08-31 16:39     ` Arnout Vandecappelle
2021-08-31 20:24 [Buildroot] [PATCH v2 0/1] " Nevo Hed
2021-08-31 20:24 ` [Buildroot] [PATCH 1/1] " Nevo Hed
2021-09-10  9:59   ` Peter Korsgaard

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.