From: Andrii Nakryiko <andriin@fb.com>
To: <bpf@vger.kernel.org>, <netdev@vger.kernel.org>, <ast@fb.com>,
<daniel@iogearbox.net>
Cc: <andrii.nakryiko@gmail.com>, <kernel-team@fb.com>,
Andrii Nakryiko <andriin@fb.com>
Subject: [RFC PATCH bpf-next 0/9] Add support for type-based and enum value-based CO-RE relocations
Date: Tue, 4 Aug 2020 11:24:00 -0700 [thread overview]
Message-ID: <20200804182409.1512434-1-andriin@fb.com> (raw)
N.B. Posting this patch set as an RFC to raise awareness and let people think
about other ways to apply these in practical applications.
This patch set adds libbpf support to two new classes of CO-RE relocations:
type-based (TYPE_EXISTS/TYPE_SIZE/TYPE_ID_LOCAL/TYPE_ID_TARGET) and enum
value-vased (ENUMVAL_EXISTS/ENUMVAL_VALUE):
- TYPE_EXISTS allows to detect presence in kernel BTF of a locally-recorded
BTF type. Useful for feature detection (new functionality often comes with
new internal kernel types), as well as handling type renames and bigger
refactorings.
- TYPE_SIZE allows to get the real size (in bytes) of a specified kernel
type. Useful for dumping internal structure as-is through perfbuf or
ringbuf.
- TYPE_ID_LOCAL/TYPE_ID_TARGET allow to capture BTF type ID of a BTF type in
program's BTF or kernel BTF, respectively. These could be used for
high-performance and space-efficient generic data dumping/logging by
relying on small and cheap BTF type ID as a data layout descriptor, for
post-processing on user-space side.
- ENUMVAL_EXISTS can be used for detecting the presence of enumerator value
in kernel's enum type. Most direct application is to detect BPF helper
support in kernel.
- ENUMVAL_VALUE allows to relocate real integer value of kernel enumerator
value, which is subject to change (e.g., always a potential issue for
internal, non-UAPI, kernel enums).
I've indicated potential applications for these relocations, but relocations
themselves are generic and unassuming and are designed to work correctly even
in unintended applications. Furthermore, relocated values become constants,
known to the verifier and could and would be used for dead branch code
detection and elimination. This makes them ideal to do all sorts of feature
detection and guarding functionality that's not available on some older (but
still supported by BPF program) kernels, while having to compile and maintain
one unified source code.
As part of this patch set, one potential issue with ambiguous CO-RE
relocations was solved (see patch #3). There are also some improvements to the
way debug relocation logs are emitted, helping to get a high-level idea of
what's going on for users that are willing to dive deeper into the internals
of libbpf (or libbpf contributors, of course).
Selftests are added for all the new features and relocation ambiguity issue is
excercised as well.
LLVM patches adding these relocation in Clang:
- __builtin_btf_type_id() ([0], [1], [2]);
- __builtin_preserve_type_info(), __builtin_preserve_enum_value() ([3], [4]).
[0] https://reviews.llvm.org/D74572
[1] https://reviews.llvm.org/D74668
[2] https://reviews.llvm.org/D85174
[3] https://reviews.llvm.org/D83878
[4] https://reviews.llvm.org/D83242
Andrii Nakryiko (9):
libbpf: improve error logging for mismatched BTF kind cases
libbpf: clean up and improve CO-RE reloc logging
libbpf: improve relocation ambiguity detection
selftests/bpf: add test validating failure on ambiguous relocation
value
libbpf: implement type-based CO-RE relocations support
selftests/bpf: test TYPE_EXISTS and TYPE_SIZE CO-RE relocations
selftests/bpf: add CO-RE relo test for TYPE_ID_LOCAL/TYPE_ID_TARGET
libbpf: implement enum value-based CO-RE relocations
selftests/bpf: add tests for ENUMVAL_EXISTS/ENUMVAL_VALUE relocations
tools/lib/bpf/Makefile | 2 +-
tools/lib/bpf/bpf_core_read.h | 80 +-
tools/lib/bpf/btf.c | 17 +-
tools/lib/bpf/btf.h | 38 -
tools/lib/bpf/libbpf.c | 754 ++++++++++++++----
tools/lib/bpf/libbpf_internal.h | 84 +-
.../selftests/bpf/prog_tests/core_reloc.c | 328 +++++++-
.../bpf/progs/btf__core_reloc_enumval.c | 3 +
.../progs/btf__core_reloc_enumval___diff.c | 3 +
.../btf__core_reloc_enumval___err_missing.c | 3 +
.../btf__core_reloc_enumval___val3_missing.c | 3 +
.../btf__core_reloc_size___err_ambiguous.c | 4 +
.../bpf/progs/btf__core_reloc_type_based.c | 3 +
...btf__core_reloc_type_based___all_missing.c | 3 +
.../btf__core_reloc_type_based___diff_sz.c | 3 +
...f__core_reloc_type_based___fn_wrong_args.c | 3 +
.../btf__core_reloc_type_based___incompat.c | 3 +
.../bpf/progs/btf__core_reloc_type_id.c | 3 +
...tf__core_reloc_type_id___missing_targets.c | 3 +
.../selftests/bpf/progs/core_reloc_types.h | 352 +++++++-
.../bpf/progs/test_core_reloc_enumval.c | 69 ++
.../bpf/progs/test_core_reloc_type_based.c | 107 +++
.../bpf/progs/test_core_reloc_type_id.c | 94 +++
23 files changed, 1728 insertions(+), 234 deletions(-)
create mode 100644 tools/testing/selftests/bpf/progs/btf__core_reloc_enumval.c
create mode 100644 tools/testing/selftests/bpf/progs/btf__core_reloc_enumval___diff.c
create mode 100644 tools/testing/selftests/bpf/progs/btf__core_reloc_enumval___err_missing.c
create mode 100644 tools/testing/selftests/bpf/progs/btf__core_reloc_enumval___val3_missing.c
create mode 100644 tools/testing/selftests/bpf/progs/btf__core_reloc_size___err_ambiguous.c
create mode 100644 tools/testing/selftests/bpf/progs/btf__core_reloc_type_based.c
create mode 100644 tools/testing/selftests/bpf/progs/btf__core_reloc_type_based___all_missing.c
create mode 100644 tools/testing/selftests/bpf/progs/btf__core_reloc_type_based___diff_sz.c
create mode 100644 tools/testing/selftests/bpf/progs/btf__core_reloc_type_based___fn_wrong_args.c
create mode 100644 tools/testing/selftests/bpf/progs/btf__core_reloc_type_based___incompat.c
create mode 100644 tools/testing/selftests/bpf/progs/btf__core_reloc_type_id.c
create mode 100644 tools/testing/selftests/bpf/progs/btf__core_reloc_type_id___missing_targets.c
create mode 100644 tools/testing/selftests/bpf/progs/test_core_reloc_enumval.c
create mode 100644 tools/testing/selftests/bpf/progs/test_core_reloc_type_based.c
create mode 100644 tools/testing/selftests/bpf/progs/test_core_reloc_type_id.c
--
2.24.1
next reply other threads:[~2020-08-04 18:24 UTC|newest]
Thread overview: 14+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-08-04 18:24 Andrii Nakryiko [this message]
2020-08-04 18:24 ` [RFC PATCH bpf-next 1/9] libbpf: improve error logging for mismatched BTF kind cases Andrii Nakryiko
2020-08-04 18:24 ` [RFC PATCH bpf-next 2/9] libbpf: clean up and improve CO-RE reloc logging Andrii Nakryiko
2020-08-04 18:24 ` [RFC PATCH bpf-next 3/9] libbpf: improve relocation ambiguity detection Andrii Nakryiko
2020-08-04 18:24 ` [RFC PATCH bpf-next 4/9] selftests/bpf: add test validating failure on ambiguous relocation value Andrii Nakryiko
2020-08-04 18:24 ` [RFC PATCH bpf-next 5/9] libbpf: implement type-based CO-RE relocations support Andrii Nakryiko
2020-08-04 18:24 ` [RFC PATCH bpf-next 6/9] selftests/bpf: test TYPE_EXISTS and TYPE_SIZE CO-RE relocations Andrii Nakryiko
2020-08-04 18:24 ` [RFC PATCH bpf-next 7/9] selftests/bpf: add CO-RE relo test for TYPE_ID_LOCAL/TYPE_ID_TARGET Andrii Nakryiko
2020-08-06 22:30 ` Alexei Starovoitov
2020-08-06 23:48 ` Andrii Nakryiko
2020-08-07 0:10 ` Alexei Starovoitov
2020-08-07 0:11 ` Andrii Nakryiko
2020-08-04 18:24 ` [RFC PATCH bpf-next 8/9] libbpf: implement enum value-based CO-RE relocations Andrii Nakryiko
2020-08-04 18:24 ` [RFC PATCH bpf-next 9/9] selftests/bpf: add tests for ENUMVAL_EXISTS/ENUMVAL_VALUE relocations Andrii Nakryiko
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20200804182409.1512434-1-andriin@fb.com \
--to=andriin@fb.com \
--cc=andrii.nakryiko@gmail.com \
--cc=ast@fb.com \
--cc=bpf@vger.kernel.org \
--cc=daniel@iogearbox.net \
--cc=kernel-team@fb.com \
--cc=netdev@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).