From: Yonghong Song <yhs@fb.com>
To: <bpf@vger.kernel.org>, <netdev@vger.kernel.org>
Cc: Alexei Starovoitov <ast@kernel.org>,
Daniel Borkmann <daniel@iogearbox.net>, <kernel-team@fb.com>,
Martin KaFai Lau <kafai@fb.com>
Subject: [PATCH bpf-next 00/13] bpf: implement bpf iterator for map elements
Date: Mon, 13 Jul 2020 09:17:39 -0700 [thread overview]
Message-ID: <20200713161739.3076283-1-yhs@fb.com> (raw)
Bpf iterator is introduced in Commit ae24345da54e
("bpf: Implement an interface to register bpf_iter targets")
which iterates through a particular kernel data
structure and bpf program will be called for each
traversed kernel object.
Bpf iterator has been implemented for task, task_file,
bpf_map, ipv6_route, netlink, tcp and udp so far.
For map elements, there are two ways to traverse all elements from
user space:
1. using BPF_MAP_GET_NEXT_KEY bpf subcommand to get elements
one by one.
2. using BPF_MAP_LOOKUP_BATCH bpf subcommand to get a batch of
elements.
Both these approaches need to copy data from kernel to user space
in order to do inspection.
This patch implements bpf iterator for map elements.
User can have a bpf program in kernel to run with each map element,
do checking, filtering, aggregation, etc. without copying data
to user space.
Patch #1 and #2 are refactoring. Patch #3 implements readonly buffer
support in verifier. Patches #4 - #7 implements map element support
for hash, percpu hash, lru hash lru percpu hash, array, percpu array
and sock local storage maps. Patches #8 - #9 are libbpf and bpftool
support. Patches #10 - #13 are selftests for implemented
map element iterators.
Yonghong Song (13):
bpf: refactor bpf_iter_reg to have separate seq_info member
bpf: refactor to provide aux info to bpf_iter_init_seq_priv_t
bpf: support readonly buffer in verifier
bpf: implement bpf iterator for map elements
bpf: implement bpf iterator for hash maps
bpf: implement bpf iterator for array maps
bpf: implement bpf iterator for sock local storage map
tools/libbpf: add support for bpf map element iterator
tools/bpftool: add bpftool support for bpf map element iterator
selftests/bpf: add test for bpf hash map iterators
selftests/bpf: add test for bpf array map iterators
selftests/bpf: add a test for bpf sk_storage_map iterator
selftests/bpf: add a test for out of bound rdonly buf access
fs/proc/proc_net.c | 2 +-
include/linux/bpf.h | 43 +-
include/linux/bpf_verifier.h | 2 +
include/linux/proc_fs.h | 3 +-
include/uapi/linux/bpf.h | 7 +
kernel/bpf/arraymap.c | 140 ++++++
kernel/bpf/bpf_iter.c | 89 +++-
kernel/bpf/btf.c | 13 +
kernel/bpf/hashtab.c | 191 ++++++++
kernel/bpf/map_iter.c | 62 ++-
kernel/bpf/task_iter.c | 18 +-
kernel/bpf/verifier.c | 74 ++-
net/core/bpf_sk_storage.c | 203 +++++++++
net/ipv4/tcp_ipv4.c | 12 +-
net/ipv4/udp.c | 12 +-
net/ipv6/route.c | 8 +-
net/netlink/af_netlink.c | 8 +-
.../bpftool/Documentation/bpftool-iter.rst | 16 +-
tools/bpf/bpftool/iter.c | 32 +-
tools/include/uapi/linux/bpf.h | 7 +
tools/lib/bpf/bpf.c | 1 +
tools/lib/bpf/bpf.h | 3 +-
tools/lib/bpf/libbpf.c | 10 +-
tools/lib/bpf/libbpf.h | 3 +-
.../selftests/bpf/prog_tests/bpf_iter.c | 422 ++++++++++++++++++
.../bpf/progs/bpf_iter_bpf_array_map.c | 38 ++
.../bpf/progs/bpf_iter_bpf_hash_map.c | 100 +++++
.../bpf/progs/bpf_iter_bpf_percpu_array_map.c | 48 ++
.../bpf/progs/bpf_iter_bpf_percpu_hash_map.c | 51 +++
.../bpf/progs/bpf_iter_bpf_sk_storage_map.c | 35 ++
.../selftests/bpf/progs/bpf_iter_test_kern5.c | 36 ++
31 files changed, 1624 insertions(+), 65 deletions(-)
create mode 100644 tools/testing/selftests/bpf/progs/bpf_iter_bpf_array_map.c
create mode 100644 tools/testing/selftests/bpf/progs/bpf_iter_bpf_hash_map.c
create mode 100644 tools/testing/selftests/bpf/progs/bpf_iter_bpf_percpu_array_map.c
create mode 100644 tools/testing/selftests/bpf/progs/bpf_iter_bpf_percpu_hash_map.c
create mode 100644 tools/testing/selftests/bpf/progs/bpf_iter_bpf_sk_storage_map.c
create mode 100644 tools/testing/selftests/bpf/progs/bpf_iter_test_kern5.c
--
2.24.1
next reply other threads:[~2020-07-13 16:17 UTC|newest]
Thread overview: 22+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-07-13 16:17 Yonghong Song [this message]
2020-07-13 16:17 ` [PATCH bpf-next 01/13] bpf: refactor bpf_iter_reg to have separate seq_info member Yonghong Song
2020-07-13 16:17 ` [PATCH bpf-next 02/13] bpf: refactor to provide aux info to bpf_iter_init_seq_priv_t Yonghong Song
2020-07-13 16:17 ` [PATCH bpf-next 03/13] bpf: support readonly buffer in verifier Yonghong Song
2020-07-13 23:25 ` Alexei Starovoitov
2020-07-15 17:34 ` Yonghong Song
2020-07-15 17:52 ` Alexei Starovoitov
2020-07-13 16:17 ` [PATCH bpf-next 04/13] bpf: implement bpf iterator for map elements Yonghong Song
2020-07-13 16:17 ` [PATCH bpf-next 05/13] bpf: implement bpf iterator for hash maps Yonghong Song
2020-07-13 16:17 ` [PATCH bpf-next 06/13] bpf: implement bpf iterator for array maps Yonghong Song
2020-07-13 18:49 ` kernel test robot
2020-07-13 16:17 ` [PATCH bpf-next 07/13] bpf: implement bpf iterator for sock local storage map Yonghong Song
2020-07-13 16:17 ` [PATCH bpf-next 08/13] tools/libbpf: add support for bpf map element iterator Yonghong Song
2020-07-13 16:17 ` [PATCH bpf-next 09/13] tools/bpftool: add bpftool " Yonghong Song
2020-07-16 16:39 ` Quentin Monnet
2020-07-16 17:42 ` Yonghong Song
2020-07-17 12:57 ` Quentin Monnet
2020-07-17 18:52 ` Yonghong Song
2020-07-13 16:17 ` [PATCH bpf-next 10/13] selftests/bpf: add test for bpf hash map iterators Yonghong Song
2020-07-13 16:17 ` [PATCH bpf-next 11/13] selftests/bpf: add test for bpf array " Yonghong Song
2020-07-13 16:17 ` [PATCH bpf-next 12/13] selftests/bpf: add a test for bpf sk_storage_map iterator Yonghong Song
2020-07-13 16:17 ` [PATCH bpf-next 13/13] selftests/bpf: add a test for out of bound rdonly buf access Yonghong Song
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20200713161739.3076283-1-yhs@fb.com \
--to=yhs@fb.com \
--cc=ast@kernel.org \
--cc=bpf@vger.kernel.org \
--cc=daniel@iogearbox.net \
--cc=kafai@fb.com \
--cc=kernel-team@fb.com \
--cc=netdev@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).