From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-11.4 required=3.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,USER_AGENT_GIT,USER_IN_DEF_DKIM_WL autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id E9D6DC76186 for ; Wed, 24 Jul 2019 16:58:24 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id BEFA421841 for ; Wed, 24 Jul 2019 16:58:24 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="FQTT+XyX" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728173AbfGXQ6T (ORCPT ); Wed, 24 Jul 2019 12:58:19 -0400 Received: from mail-pg1-f202.google.com ([209.85.215.202]:43564 "EHLO mail-pg1-f202.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725883AbfGXQ6T (ORCPT ); Wed, 24 Jul 2019 12:58:19 -0400 Received: by mail-pg1-f202.google.com with SMTP id p29so20463292pgm.10 for ; Wed, 24 Jul 2019 09:58:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=date:message-id:mime-version:subject:from:to:cc; bh=6m5pZYRwQ/VLImDzwYssdUybUrVH4MZ+xdF6UGNAnzQ=; b=FQTT+XyX/59gFXT1uGFwGXtgUyjKf4iPsM32Sk9G7dinmYGnLj5i3YxJQtU8tzbl3K fwhzXeFXWn0VIXqHMCinq/2BuSH08UCWzLV1RhNs2sLV3K6hH4jBQs/6fNwFi/g+EKXR edlGI5m6uMpv4ChVdLz3GNY/yAFrgF63w7bCSpQpduHIbJ8i4GKo67HwDYWtHVc30uH2 cHuLWQEAtdudgD5RySbzOO2htsNdMFjzNb5sD0lRZwmVsGSKHhc+cjH/B0sFOU6XO4MB 0uVmd0DQzCI7Nlg93wUgjZRchVV0sPjtemJxHS6WjwuQVp1T4K0c/o2K1wYsWPyE4XZD OPxw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:message-id:mime-version:subject:from:to:cc; bh=6m5pZYRwQ/VLImDzwYssdUybUrVH4MZ+xdF6UGNAnzQ=; b=S9lfLOfwoH81pwZxKP9pNzZEHg8xNiAqn8q2CyZxdg0gBeoYtxxyACgDkr/vU2ZNB9 Qk4BimdBxLMo/QEKZGjBTxIDL3EXJL0L7ViktSqsSZkFP5O7145kHZcYl1Pv5l+l6/lb gTXenvpTGAxshzsRdntVR5ls64NkTv0+qlsrMjqboE5bfUDw0wqqAHQfsZmYP/T7DCOQ wsWPPnWSbPnVNMaZkU4CURU6HAE/Q6DRAyFglozDHY0/Jc6EtY+ccfBCtX4QjuWGFAT6 3dDv/BC0DMDi1NIT+uy1azeS7cezZhgPJ7zEG6AUpcC6bAQNXFlmj8LApZWDUQ5X8Qww gaNA== X-Gm-Message-State: APjAAAUu+UUkqJU2kN9tsQHCV5wmKjJS8qmZv0x3z/EeyhSVjYuivBAx b9Yjve8DLBkkf11V1tSrT7tk/oP2xbpH X-Google-Smtp-Source: APXvYqz+p+xcj+020H6PKH7tPE0RHUStQ5VIaTQ18W/SgvXCVq97XWVBm/0xcPcAITrs8Or7z49zx7jJypgy X-Received: by 2002:a63:a35e:: with SMTP id v30mr23431447pgn.129.1563987497938; Wed, 24 Jul 2019 09:58:17 -0700 (PDT) Date: Wed, 24 Jul 2019 09:57:57 -0700 Message-Id: <20190724165803.87470-1-brianvv@google.com> Mime-Version: 1.0 X-Mailer: git-send-email 2.22.0.657.g960e92d24f-goog Subject: [PATCH bpf-next 0/6] bpf: add BPF_MAP_DUMP command to dump more than one entry per call From: Brian Vazquez To: Brian Vazquez , Alexei Starovoitov , Daniel Borkmann , "David S . Miller" Cc: Stanislav Fomichev , Willem de Bruijn , Petar Penkov , linux-kernel@vger.kernel.org, netdev@vger.kernel.org, bpf@vger.kernel.org, Brian Vazquez Content-Type: text/plain; charset="UTF-8" Sender: bpf-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: bpf@vger.kernel.org This introduces a new command to retrieve multiple number of entries from a bpf map. This new command can be executed from the existing BPF syscall as follows: err = bpf(BPF_MAP_DUMP, union bpf_attr *attr, u32 size) using attr->dump.map_fd, attr->dump.prev_key, attr->dump.buf, attr->dump.buf_len returns zero or negative error, and populates buf and buf_len on succees This implementation is wrapping the existing bpf methods: map_get_next_key and map_lookup_elem Note that this implementation can be extended later to do dump and delete by extending map_lookup_and_delete_elem (currently it only works for bpf queue/stack maps) and either use a new flag in map_dump or a new command map_dump_and_delete. Results show that even with a 1-elem_size buffer, it runs ~40 faster than the current implementation, improvements of ~85% are reported when the buffer size is increased, although, after the buffer size is around 5% of the total number of entries there's no huge difference in increasing it. Tested: Tried different size buffers to handle case where the bulk is bigger, or the elements to retrieve are less than the existing ones, all runs read a map of 100K entries. Below are the results(in ns) from the different runs: buf_len_1: 69038725 entry-by-entry: 112384424 improvement 38.569134 buf_len_2: 40897447 entry-by-entry: 111030546 improvement 63.165590 buf_len_230: 13652714 entry-by-entry: 111694058 improvement 87.776687 buf_len_5000: 13576271 entry-by-entry: 111101169 improvement 87.780263 buf_len_73000: 14694343 entry-by-entry: 111740162 improvement 86.849542 buf_len_100000: 13745969 entry-by-entry: 114151991 improvement 87.958187 buf_len_234567: 14329834 entry-by-entry: 114427589 improvement 87.476941 The series of patches are split as follows: - First patch move some map_lookup_elem logic into 2 fucntions to deduplicate code: bpf_map_value_size and bpf_map_copy_value - Second patch introduce map_dump function - Third patch syncs tools linux headers - Fourth patch adds libbpf support - Last two patches adds tests RFC Changelog: - remove wrong usage of attr.flags - move map_fd to remove hole after it v3: - add explanation of the API in the commit message - fix masked errors and return them to user - copy last_key from return buf into prev_key if it was provided - run perf test with kpti and retpoline mitigations v2: - use proper bpf-next tag Brian Vazquez (6): bpf: add bpf_map_value_size and bp_map_copy_value helper functions bpf: add BPF_MAP_DUMP command to dump more than one entry per call bpf: keep bpf.h in sync with tools/ libbpf: support BPF_MAP_DUMP command selftests/bpf: test BPF_MAP_DUMP command on a bpf hashmap selftests/bpf: add test to measure performance of BPF_MAP_DUMP include/uapi/linux/bpf.h | 9 + kernel/bpf/syscall.c | 251 ++++++++++++++++++------ tools/include/uapi/linux/bpf.h | 9 + tools/lib/bpf/bpf.c | 28 +++ tools/lib/bpf/bpf.h | 4 + tools/lib/bpf/libbpf.map | 2 + tools/testing/selftests/bpf/test_maps.c | 148 +++++++++++++- 7 files changed, 388 insertions(+), 63 deletions(-) -- 2.22.0.657.g960e92d24f-goog