* [GIT PULL] perf tools changes for v5.19: 2nd batch
@ 2022-05-29 15:45 Arnaldo Carvalho de Melo
2022-05-29 17:28 ` Linus Torvalds
0 siblings, 1 reply; 3+ messages in thread
From: Arnaldo Carvalho de Melo @ 2022-05-29 15:45 UTC (permalink / raw)
To: Linus Torvalds
Cc: Ingo Molnar, Thomas Gleixner, Jiri Olsa, Namhyung Kim,
Clark Williams, Kate Carcia, linux-kernel, linux-perf-users,
Arnaldo Carvalho de Melo, Adrian Hunter, Carsten Haitzler,
Claire Jensen, Dmitriy Vyukov, Eelco Chaudron, Eric Lin,
Florian Fischer, German Gomez, Ian Rogers, James Clark,
Joe Mario, Kan Liang, Leo Yan, Martin Liška, Thomas Richter,
Xing Zhengjun, Yang Jihong, Arnaldo Carvalho de Melo
Hi Linus,
Please consider pulling,
Best regards,
- Arnaldo
Test results at the end of this message.
The following changes since commit babf0bb978e3c9fce6c4eba6b744c8754fd43d8e:
Merge tag 'xfs-5.19-for-linus' of git://git.kernel.org/pub/scm/fs/xfs/xfs-linux (2022-05-25 19:34:40 -0700)
are available in the Git repository at:
git://git.kernel.org/pub/scm/linux/kernel/git/acme/linux.git tags/perf-tools-for-v5.19-2022-05-28
for you to fetch changes up to 9dde6cadb92b5670b23b97ec53091df0530ec38b:
tools arch x86: Sync the msr-index.h copy with the kernel sources (2022-05-27 13:22:14 -0300)
----------------------------------------------------------------
perf tools changes for v5.19: 2nd batch
- Add BPF based off-CPU profiling.
- Improvements for system wide recording, specially for Intel PT.
- Improve DWARF unwinding on arm64.
- Support Arm CoreSight trace data disassembly in 'perf script' python.
- Fix build with new libbpf version, related to supporting older versions
of distro released libbpf packages.
- Fix event syntax error caused by ExtSel in the JSON events infra.
- Use stdio interface if slang is not supported in 'perf c2c'.
- Add 'perf test' checking for perf stat CSV output.
- Sync the msr-index.h copy with the kernel sources.
Signed-off-by: Arnaldo Carvalho de Melo <acme@redhat.com>
----------------------------------------------------------------
Adrian Hunter (15):
perf intel-pt: Add a test for system-wide side band
perf auxtrace: Add mmap_needed to auxtrace_mmap_params
perf auxtrace: Remove auxtrace_mmap_params__set_idx() per_cpu parameter
perf evlist: Factor out evlist__dummy_event()
perf evlist: Add evlist__add_dummy_on_all_cpus()
perf record: Use evlist__add_dummy_on_all_cpus() in record__config_text_poke()
perf intel-pt: Use evlist__add_dummy_on_all_cpus() for switch tracking
perf intel-pt: Track sideband system-wide when needed
perf tools: Allow all_cpus to be a superset of user_requested_cpus
libperf evlist: Allow mixing per-thread and per-cpu mmaps
libperf evlist: Check nr_mmaps is correct
perf stat: Add requires_cpu flag for uncore
libperf evsel: Add comments for booleans
perf tools: Allow system-wide events to keep their own CPUs
perf tools: Allow system-wide events to keep their own threads
Arnaldo Carvalho de Melo (2):
perf build: Stop using __weak bpf_map_create() to handle older libbpf versions
tools arch x86: Sync the msr-index.h copy with the kernel sources
Claire Jensen (1):
perf test: Add checking for perf stat CSV output.
James Clark (5):
perf unwind arm64: Use perf's copy of kernel headers
perf tools arm64: Copy perf_regs.h from the kernel
perf unwind: Use dynamic register set for DWARF unwind
perf unwind arm64: Decouple Libunwind register names from Perf
perf tools arm64: Add support for VG register
Jiri Olsa (5):
perf build: Fix btf__load_from_kernel_by_id() feature check
perf build: Stop using __weak bpf_prog_load() to handle older libbpf versions
perf build: Stop using __weak bpf_object__next_program() to handle older libbpf versions
perf build: Stop using __weak bpf_object__next_map() to handle older libbpf versions
perf build: Stop using __weak btf__raw_data() to handle older libbpf versions
Leo Yan (3):
perf c2c: Use stdio interface if slang is not supported
perf scripting python: Expose dso and map information
perf scripts python: Support Arm CoreSight trace data disassembly
Namhyung Kim (6):
perf report: Do not extend sample type of bpf-output event
perf record: Enable off-cpu analysis with BPF
perf record: Implement basic filtering for off-cpu
perf record: Handle argument change in sched_switch
perf record: Add cgroup support for off-cpu profiling
perf test: Add a basic offcpu profiling test
Zhengjun Xing (1):
perf jevents: Fix event syntax error caused by ExtSel
tools/arch/arm64/include/uapi/asm/perf_regs.h | 7 +-
tools/arch/x86/include/asm/msr-index.h | 19 ++
tools/build/Makefile.feature | 4 +
tools/build/feature/Makefile | 20 ++
tools/build/feature/test-libbpf-bpf_map_create.c | 8 +
.../feature/test-libbpf-bpf_object__next_map.c | 8 +
.../feature/test-libbpf-bpf_object__next_program.c | 8 +
tools/build/feature/test-libbpf-bpf_prog_load.c | 9 +
.../test-libbpf-btf__load_from_kernel_by_id.c | 5 +-
tools/build/feature/test-libbpf-btf__raw_data.c | 8 +
tools/lib/perf/evlist.c | 71 ++---
tools/lib/perf/include/internal/evsel.h | 11 +
tools/perf/Documentation/perf-record.txt | 10 +
tools/perf/Makefile.config | 25 ++
tools/perf/Makefile.perf | 1 +
tools/perf/arch/arm64/util/perf_regs.c | 38 +++
tools/perf/arch/arm64/util/unwind-libunwind.c | 73 +----
tools/perf/arch/x86/util/intel-pt.c | 31 +-
tools/perf/builtin-c2c.c | 6 +-
tools/perf/builtin-record.c | 64 ++--
tools/perf/builtin-stat.c | 5 +-
tools/perf/pmu-events/jevents.c | 2 +-
tools/perf/scripts/python/arm-cs-trace-disasm.py | 272 +++++++++++++++++
tools/perf/tests/shell/lib/perf_csv_output_lint.py | 48 +++
tools/perf/tests/shell/record_offcpu.sh | 60 ++++
tools/perf/tests/shell/stat+csv_output.sh | 147 +++++++++
tools/perf/tests/shell/test_intel_pt.sh | 71 +++++
tools/perf/util/Build | 1 +
tools/perf/util/auxtrace.c | 15 +-
tools/perf/util/auxtrace.h | 13 +-
tools/perf/util/bpf-event.c | 24 +-
tools/perf/util/bpf_counter.c | 6 +-
tools/perf/util/bpf_off_cpu.c | 338 +++++++++++++++++++++
tools/perf/util/bpf_skel/off_cpu.bpf.c | 229 ++++++++++++++
tools/perf/util/evlist.c | 61 +++-
tools/perf/util/evlist.h | 5 +
tools/perf/util/evsel.c | 7 +-
tools/perf/util/libunwind/arm64.c | 2 +-
tools/perf/util/mmap.c | 4 +-
tools/perf/util/off_cpu.h | 29 ++
tools/perf/util/parse-events.c | 2 +-
tools/perf/util/perf_regs.c | 2 +
tools/perf/util/python-ext-sources | 1 +
.../util/scripting-engines/trace-event-python.c | 21 +-
44 files changed, 1594 insertions(+), 197 deletions(-)
create mode 100644 tools/build/feature/test-libbpf-bpf_map_create.c
create mode 100644 tools/build/feature/test-libbpf-bpf_object__next_map.c
create mode 100644 tools/build/feature/test-libbpf-bpf_object__next_program.c
create mode 100644 tools/build/feature/test-libbpf-bpf_prog_load.c
create mode 100644 tools/build/feature/test-libbpf-btf__raw_data.c
create mode 100755 tools/perf/scripts/python/arm-cs-trace-disasm.py
create mode 100644 tools/perf/tests/shell/lib/perf_csv_output_lint.py
create mode 100755 tools/perf/tests/shell/record_offcpu.sh
create mode 100755 tools/perf/tests/shell/stat+csv_output.sh
create mode 100755 tools/perf/tests/shell/test_intel_pt.sh
create mode 100644 tools/perf/util/bpf_off_cpu.c
create mode 100644 tools/perf/util/bpf_skel/off_cpu.bpf.c
create mode 100644 tools/perf/util/off_cpu.h
Test results:
The first ones are container based builds of tools/perf with and without libelf
support. Where clang is available, it is also used to build perf with/without
libelf, and building with LIBCLANGLLVM=1 (built-in clang) with gcc and clang
when clang and its devel libraries are installed.
Several are cross builds, the ones with -x-ARCH and the android one, and those
may not have all the features built, due to lack of multi-arch devel packages,
available and being used so far on just a few, like
debian:experimental-x-{arm64,mipsel}.
The 'perf test' one will perform a variety of tests exercising
tools/perf/util/, tools/lib/{bpf,traceevent,etc}, as well as run perf commands
with a variety of command line event specifications to then intercept the
sys_perf_event syscall to check that the perf_event_attr fields are set up as
expected, among a variety of other unit tests.
Then there is the 'make -C tools/perf build-test' ones, that build tools/perf/
Gwith a variety of feature sets, exercising the build with an incomplete set of
features as well as with a complete one.
There is still the mageia:7 distro + clang 8 failure, seemingly unrelated to
the patches in this series, it'll be investigated. It builds just fine with gcc
8.4.
There is also a strange one with openmandriva:4.2 and openmandriva:cooker,
where on the feature build test it doesn't manage to find libpthread, because
the pthread functions (and the ones in librt, IIRC) are on the main libc, so a
test for that is needed to avoid adding '-lpthread and -lrt' in distros where
this is the case. It's in the TODO list.
Ubuntu 20.04 is failing on a corner case where perf links with libllvm and libclang,
which isn't the default perf build.
$ grep -m1 'model name' /proc/cpuinfo
model name : AMD Ryzen 9 5950X 16-Core Processor
$ export BUILD_TARBALL=http://192.168.100.2/perf/perf-5.18.0.tar.xz
$ time dm
1 116.57 almalinux:8 : Ok gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-4) , clang version 12.0.1 (Red Hat 12.0.1-4.module_el8.5.0+1025+93159d6c)
2 80.45 alpine:3.9 : Ok gcc (Alpine 8.3.0) 8.3.0 , Alpine clang version 5.0.1 (tags/RELEASE_502/final) (based on LLVM 5.0.1)
3 107.62 alpine:3.10 : Ok gcc (Alpine 8.3.0) 8.3.0 , Alpine clang version 8.0.0 (tags/RELEASE_800/final) (based on LLVM 8.0.0)
4 122.56 alpine:3.11 : Ok gcc (Alpine 9.3.0) 9.3.0 , Alpine clang version 9.0.0 (https://git.alpinelinux.org/aports f7f0d2c2b8bcd6a5843401a9a702029556492689) (based on LLVM 9.0.0)
5 127.50 alpine:3.12 : Ok gcc (Alpine 9.3.0) 9.3.0 , Alpine clang version 10.0.0 (https://gitlab.alpinelinux.org/alpine/aports.git 7445adce501f8473efdb93b17b5eaf2f1445ed4c)
6 135.22 alpine:3.13 : Ok gcc (Alpine 10.2.1_pre1) 10.2.1 20201203 , Alpine clang version 10.0.1
7 122.78 alpine:3.14 : Ok gcc (Alpine 10.3.1_git20210424) 10.3.1 20210424 , Alpine clang version 11.1.0
8 125.58 alpine:3.15 : Ok gcc (Alpine 10.3.1_git20211027) 10.3.1 20211027 , Alpine clang version 12.0.1
9 115.86 alpine:edge : Ok gcc (Alpine 11.2.1_git20220219) 11.2.1 20220219 , Alpine clang version 13.0.1
10 62.79 alt:p8 : Ok x86_64-alt-linux-gcc (GCC) 5.3.1 20151207 (ALT p8 5.3.1-alt3.M80P.1) , clang version 3.8.0 (tags/RELEASE_380/final)
11 91.69 alt:p9 : Ok x86_64-alt-linux-gcc (GCC) 8.4.1 20200305 (ALT p9 8.4.1-alt0.p9.1) , clang version 10.0.0
12 89.89 alt:p10 : Ok x86_64-alt-linux-gcc (GCC) 10.3.1 20210703 (ALT Sisyphus 10.3.1-alt2) , clang version 11.0.1
13 90.38 alt:sisyphus : Ok x86_64-alt-linux-gcc (GCC) 11.2.1 20211202 (ALT Sisyphus 11.2.1-alt2) , ALT Linux Team clang version 12.0.1
14 63.89 amazonlinux:1 : Ok gcc (GCC) 7.2.1 20170915 (Red Hat 7.2.1-2) , clang version 3.6.2 (tags/RELEASE_362/final)
15 100.42 amazonlinux:2 : Ok gcc (GCC) 7.3.1 20180712 (Red Hat 7.3.1-14) , clang version 11.1.0 (Amazon Linux 2 11.1.0-1.amzn2.0.2)
16 106.34 amazonlinux:devel : Ok gcc (GCC) 11.2.1 20220401 (Red Hat 11.2.1-10) , clang version 12.0.1 (Fedora 12.0.1-1.amzn2022)
17 105.71 archlinux:base : Ok gcc (GCC) 11.2.0 , clang version 13.0.1
18 99.29 centos:8 : Ok gcc (GCC) 8.4.1 20200928 (Red Hat 8.4.1-1) , clang version 11.0.1 (Red Hat 11.0.1-1.module_el8.4.0+966+2995ef20)
19 107.32 centos:stream : Ok gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-13) , clang version 13.0.0 (Red Hat 13.0.0-3.module_el8.6.0+1074+380cef3f)
20 55.52 clearlinux:latest : Ok gcc (Clear Linux OS for Intel Architecture) 12.1.1 20220518 releases/gcc-12.1.0-54-g9c8125b98c , clang version 14.0.1
21 84.27 debian:9 : Ok gcc (Debian 6.3.0-18+deb9u1) 6.3.0 20170516 , clang version 3.8.1-24 (tags/RELEASE_381/final)
22 84.46 debian:10 : Ok gcc (Debian 8.3.0-6) 8.3.0 , Debian clang version 11.0.1-2~deb10u1
23 99.71 debian:11 : Ok gcc (Debian 10.2.1-6) 10.2.1 20210110 , Debian clang version 11.0.1-2
24 116.17 debian:experimental : Ok gcc (Debian 11.3.0-1) 11.3.0 , Debian clang version 13.0.1-4
25 24.67 debian:experimental-x-arm64 : Ok aarch64-linux-gnu-gcc (Debian 11.3.0-1) 11.3.0
26 20.04 debian:experimental-x-mips : Ok mips-linux-gnu-gcc (Debian 11.2.0-18) 11.2.0
27 22.05 debian:experimental-x-mips64 : Ok mips64-linux-gnuabi64-gcc (Debian 10.2.1-6) 10.2.1 20210110
28 22.85 debian:experimental-x-mipsel : Ok mipsel-linux-gnu-gcc (Debian 11.2.0-18) 11.2.0
29 22.85 fedora:22 : Ok gcc (GCC) 5.3.1 20160406 (Red Hat 5.3.1-6) , clang version 3.5.0 (tags/RELEASE_350/final)
30 68.91 fedora:23 : Ok gcc (GCC) 5.3.1 20160406 (Red Hat 5.3.1-6) , clang version 3.7.0 (tags/RELEASE_370/final)
31 80.54 fedora:24 : Ok gcc (GCC) 6.3.1 20161221 (Red Hat 6.3.1-1) , clang version 3.8.1 (tags/RELEASE_381/final)
32 18.12 fedora:24-x-ARC-uClibc : Ok arc-linux-gcc (ARCompact ISA Linux uClibc toolchain 2017.09-rc2) 7.1.1 20170710
33 82.25 fedora:25 : Ok gcc (GCC) 6.4.1 20170727 (Red Hat 6.4.1-1) , clang version 3.9.1 (tags/RELEASE_391/final)
34 97.88 fedora:26 : Ok gcc (GCC) 7.3.1 20180130 (Red Hat 7.3.1-2) , clang version 4.0.1 (tags/RELEASE_401/final)
35 97.69 fedora:27 : Ok gcc (GCC) 7.3.1 20180712 (Red Hat 7.3.1-6) , clang version 5.0.2 (tags/RELEASE_502/final)
36 107.71 fedora:28 : Ok gcc (GCC) 8.3.1 20190223 (Red Hat 8.3.1-2) , clang version 6.0.1 (tags/RELEASE_601/final)
37 113.43 fedora:29 : Ok gcc (GCC) 8.3.1 20190223 (Red Hat 8.3.1-2) , clang version 7.0.1 (Fedora 7.0.1-6.fc29)
38 118.05 fedora:30 : Ok gcc (GCC) 9.3.1 20200408 (Red Hat 9.3.1-2) , clang version 8.0.0 (Fedora 8.0.0-3.fc30)
39 111.43 fedora:31 : Ok gcc (GCC) 9.3.1 20200408 (Red Hat 9.3.1-2) , clang version 9.0.1 (Fedora 9.0.1-4.fc31)
40 106.94 fedora:32 : Ok gcc (GCC) 10.3.1 20210422 (Red Hat 10.3.1-1) , clang version 10.0.1 (Fedora 10.0.1-3.fc32)
41 103.84 fedora:33 : Ok gcc (GCC) 10.3.1 20210422 (Red Hat 10.3.1-1) , clang version 11.0.0 (Fedora 11.0.0-3.fc33)
42 112.75 fedora:34 : Ok gcc (GCC) 11.2.1 20220127 (Red Hat 11.2.1-9) , clang version 12.0.1 (Fedora 12.0.1-1.fc34)
43 20.44 fedora:34-x-ARC-glibc : Ok arc-linux-gcc (ARC HS GNU/Linux glibc toolchain 2019.03-rc1) 8.3.1 20190225
44 18.33 fedora:34-x-ARC-uClibc : Ok arc-linux-gcc (ARCv2 ISA Linux uClibc toolchain 2019.03-rc1) 8.3.1 20190225
45 113.78 fedora:35 : Ok gcc (GCC) 11.2.1 20220127 (Red Hat 11.2.1-9) , clang version 13.0.0 (Fedora 13.0.0-3.fc35)
46 124.60 fedora:36 : Ok gcc (GCC) 12.0.1 20220413 (Red Hat 12.0.1-0) , clang version 14.0.0 (Fedora 14.0.0-1.fc36)
47 125.51 fedora:rawhide : Ok gcc (GCC) 12.1.1 20220507 (Red Hat 12.1.1-1) , clang version 14.0.0 (Fedora 14.0.0-1.fc37)
48 96.71 gentoo-stage3:latest : Ok gcc (Gentoo 11.2.0 p1) 11.2.0 , clang version 13.0.0
49 82.24 mageia:6 : Ok gcc (Mageia 5.5.0-1.mga6) 5.5.0 , clang version 3.9.1 (tags/RELEASE_391/final)
50 43.11 mageia:7 : FAIL clang version 8.0.0 (Mageia 8.0.0-1.mga7)
yychar = yylex (&yylval, &yylloc, scanner);
^
#define yylex parse_events_lex
^
1 error generated.
make[3]: *** [/git/perf-5.18.0/tools/build/Makefile.build:139: util] Error 2
51 107.13 manjaro:base : Ok gcc (GCC) 11.1.0 , clang version 13.0.0
52 6.47 openmandriva:4.2 : FAIL gcc version 11.2.0 20210728 (OpenMandriva) (GCC)
In file included from builtin-bench.c:22:
bench/bench.h:68:19: error: conflicting types for 'pthread_attr_setaffinity_np'; have 'int(pthread_attr_t *, size_t, cpu_set_t *)' {aka 'int(pthread_attr_t *, long unsigned int, cpu_set_t *)'}
68 | static inline int pthread_attr_setaffinity_np(pthread_attr_t *attr __maybe_unused,
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from bench/bench.h:66,
from builtin-bench.c:22:
/usr/include/pthread.h:394:12: note: previous declaration of 'pthread_attr_setaffinity_np' with type 'int(pthread_attr_t *, size_t, const cpu_set_t *)' {aka 'int(pthread_attr_t *, long unsigned int, const cpu_set_t *)'}
394 | extern int pthread_attr_setaffinity_np (pthread_attr_t *__attr,
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~
ld: warning: -r and --gc-sections may not be used together, disabling --gc-sections
ld: warning: -r and --icf may not be used together, disabling --icf
ld: warning: -r and --gc-sections may not be used together, disabling --gc-sections
ld: warning: -r and --icf may not be used together, disabling --icf
ld: warning: -r and --gc-sections may not be used together, disabling --gc-sections
ld: warning: -r and --icf may not be used together, disabling --icf
53 6.47 openmandriva:cooker : FAIL gcc version 11.2.0 20210728 (OpenMandriva) (GCC)
In file included from builtin-bench.c:22:
bench/bench.h:68:19: error: conflicting types for 'pthread_attr_setaffinity_np'; have 'int(pthread_attr_t *, size_t, cpu_set_t *)' {aka 'int(pthread_attr_t *, long unsigned int, cpu_set_t *)'}
68 | static inline int pthread_attr_setaffinity_np(pthread_attr_t *attr __maybe_unused,
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from bench/bench.h:66,
from builtin-bench.c:22:
/usr/include/pthread.h:394:12: note: previous declaration of 'pthread_attr_setaffinity_np' with type 'int(pthread_attr_t *, size_t, const cpu_set_t *)' {aka 'int(pthread_attr_t *, long unsigned int, const cpu_set_t *)'}
394 | extern int pthread_attr_setaffinity_np (pthread_attr_t *__attr,
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~
ld: warning: -r and --gc-sections may not be used together, disabling --gc-sections
ld: warning: -r and --icf may not be used together, disabling --icf
ld: warning: -r and --gc-sections may not be used together, disabling --gc-sections
ld: warning: -r and --icf may not be used together, disabling --icf
ld: warning: -r and --gc-sections may not be used together, disabling --gc-sections
ld: warning: -r and --icf may not be used together, disabling --icf
54 115.94 opensuse:15.0 : Ok gcc (SUSE Linux) 7.4.1 20190905 [gcc-7-branch revision 275407] , clang version 5.0.1 (tags/RELEASE_501/final 312548)
55 123.16 opensuse:15.1 : Ok gcc (SUSE Linux) 7.5.0 , clang version 7.0.1 (tags/RELEASE_701/final 349238)
56 118.84 opensuse:15.2 : Ok gcc (SUSE Linux) 7.5.0 , clang version 9.0.1
57 133.41 opensuse:15.3 : Ok gcc (SUSE Linux) 7.5.0 , clang version 11.0.1
58 132.20 opensuse:15.4 : Ok gcc (SUSE Linux) 7.5.0 , clang version 13.0.1
59 154.67 opensuse:tumbleweed : Ok gcc (SUSE Linux) 11.2.1 20220316 [revision 6a1150d1524aeda3381b2171712e1a6611d441d6] , clang version 13.0.1
60 113.35 oraclelinux:8 : Ok gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-4.0.1) , clang version 12.0.1 (Red Hat 12.0.1-4.0.1.module+el8.5.0+20428+2b4ecd47)
61 116.85 rockylinux:8 : Ok gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-4) , clang version 12.0.1 (Red Hat 12.0.1-4.module+el8.5.0+715+58f51d49)
62 85.96 ubuntu:16.04 : Ok gcc (Ubuntu 5.4.0-6ubuntu1~16.04.12) 5.4.0 20160609 , clang version 3.8.0-2ubuntu4 (tags/RELEASE_380/final)
63 19.44 ubuntu:16.04-x-arm : Ok arm-linux-gnueabihf-gcc (Ubuntu/Linaro 5.4.0-6ubuntu1~16.04.9) 5.4.0 20160609
64 19.13 ubuntu:16.04-x-powerpc : Ok powerpc-linux-gnu-gcc (Ubuntu 5.4.0-6ubuntu1~16.04.9) 5.4.0 20160609
65 19.74 ubuntu:16.04-x-powerpc64 : Ok powerpc64-linux-gnu-gcc (Ubuntu/IBM 5.4.0-6ubuntu1~16.04.9) 5.4.0 20160609
66 19.54 ubuntu:16.04-x-powerpc64el : Ok powerpc64le-linux-gnu-gcc (Ubuntu/IBM 5.4.0-6ubuntu1~16.04.9) 5.4.0 20160609
67 90.26 ubuntu:18.04 : Ok gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0 , clang version 6.0.0-1ubuntu2 (tags/RELEASE_600/final)
68 21.14 ubuntu:18.04-x-arm : Ok arm-linux-gnueabihf-gcc (Ubuntu/Linaro 7.5.0-3ubuntu1~18.04) 7.5.0
69 21.34 ubuntu:18.04-x-arm64 : Ok aarch64-linux-gnu-gcc (Ubuntu/Linaro 7.5.0-3ubuntu1~18.04) 7.5.0
70 17.23 ubuntu:18.04-x-m68k : Ok m68k-linux-gnu-gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0
71 20.44 ubuntu:18.04-x-powerpc : Ok powerpc-linux-gnu-gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0
72 22.25 ubuntu:18.04-x-powerpc64 : Ok powerpc64-linux-gnu-gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0
73 22.15 ubuntu:18.04-x-powerpc64el : Ok powerpc64le-linux-gnu-gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0
74 102.01 ubuntu:18.04-x-riscv64 : Ok riscv64-linux-gnu-gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0
75 19.04 ubuntu:18.04-x-s390 : Ok s390x-linux-gnu-gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0
76 20.14 ubuntu:18.04-x-sh4 : Ok sh4-linux-gnu-gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0
77 19.13 ubuntu:18.04-x-sparc64 : Ok sparc64-linux-gnu-gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0
78 90.16 ubuntu:20.04 : FAIL clang version 10.0.0-4ubuntu1
79 22.85 ubuntu:20.04-x-powerpc64el : Ok powerpc64le-linux-gnu-gcc (Ubuntu 10.3.0-1ubuntu1~20.04) 10.3.0
80 88.06 ubuntu:20.10 : Ok gcc (Ubuntu 10.3.0-1ubuntu1~20.10) 10.3.0 , Ubuntu clang version 11.0.0-2
81 108.04 ubuntu:21.04 : Ok gcc (Ubuntu 10.3.0-1ubuntu1) 10.3.0 , Ubuntu clang version 12.0.0-3ubuntu1~21.04.2
82 104.72 ubuntu:21.10 : Ok gcc (Ubuntu 11.2.0-7ubuntu2) 11.2.0 , Ubuntu clang version 13.0.0-2
83 127.91 ubuntu:22.04 : Ok gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0 , Ubuntu clang version 14.0.0-1ubuntu1
84 129.21 ubuntu:22.10 : Ok gcc (Ubuntu 11.3.0-3ubuntu1) 11.3.0 , Ubuntu clang version 14.0.3-2ubuntu1
BUILD_TARBALL_HEAD=9dde6cadb92b5670b23b97ec53091df0530ec38b
85 6707.14
real 113m31.627s
user 0m47.844s
sys 0m55.348s
$
$ uname -a
Linux quaco 5.17.9-300.fc36.x86_64 #1 SMP PREEMPT Wed May 18 15:08:23 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
$ git log --oneline -1
9dde6cadb92b5670 (HEAD -> perf/core, seventh/perf/core, five/perf/core, acme/tmp.perf/core, acme.korg/tmp.perf/core) tools arch x86: Sync the msr-index.h copy with the kernel sources
$ perf -v
perf version 5.18.g9dde6cadb92b
$ sudo su -
[root@quaco ~]# perf -vv
perf version 5.18.g9dde6cadb92b
dwarf: [ on ] # HAVE_DWARF_SUPPORT
dwarf_getlocations: [ on ] # HAVE_DWARF_GETLOCATIONS_SUPPORT
glibc: [ on ] # HAVE_GLIBC_SUPPORT
syscall_table: [ on ] # HAVE_SYSCALL_TABLE_SUPPORT
libbfd: [ on ] # HAVE_LIBBFD_SUPPORT
debuginfod: [ on ] # HAVE_DEBUGINFOD_SUPPORT
libelf: [ on ] # HAVE_LIBELF_SUPPORT
libnuma: [ on ] # HAVE_LIBNUMA_SUPPORT
numa_num_possible_cpus: [ on ] # HAVE_LIBNUMA_SUPPORT
libperl: [ on ] # HAVE_LIBPERL_SUPPORT
libpython: [ on ] # HAVE_LIBPYTHON_SUPPORT
libslang: [ on ] # HAVE_SLANG_SUPPORT
libcrypto: [ OFF ] # HAVE_LIBCRYPTO_SUPPORT
libunwind: [ on ] # HAVE_LIBUNWIND_SUPPORT
libdw-dwarf-unwind: [ on ] # HAVE_DWARF_SUPPORT
zlib: [ on ] # HAVE_ZLIB_SUPPORT
lzma: [ on ] # HAVE_LZMA_SUPPORT
get_cpuid: [ on ] # HAVE_AUXTRACE_SUPPORT
bpf: [ on ] # HAVE_LIBBPF_SUPPORT
aio: [ on ] # HAVE_AIO_SUPPORT
zstd: [ on ] # HAVE_ZSTD_SUPPORT
libpfm4: [ OFF ] # HAVE_LIBPFM
[root@quaco ~]# perf test
1: vmlinux symtab matches kallsyms : Ok
2: Detect openat syscall event : Ok
3: Detect openat syscall event on all cpus : Ok
4: Read samples using the mmap interface : Ok
5: Test data source output : Ok
6: Parse event definition strings :
6.1: Test event parsing : Ok
6.2: Test parsing of "hybrid" CPU events : Skip (not hybrid)
6.3: Parsing of all PMU events from sysfs : Ok
6.4: Parsing of given PMU events from sysfs : Ok
6.5: Parsing of aliased events from sysfs : Skip (no aliases in sysfs)
6.6: Parsing of aliased events : Ok
6.7: Parsing of terms (event modifiers) : Ok
7: Simple expression parser : Ok
8: PERF_RECORD_* events & perf_sample fields : Ok
9: Parse perf pmu format : Ok
10: PMU events :
10.1: PMU event table sanity : Ok
10.2: PMU event map aliases : Ok
10.3: Parsing of PMU event table metrics : Ok
10.4: Parsing of PMU event table metrics with fake PMUs : Ok
11: DSO data read : Ok
12: DSO data cache : Ok
13: DSO data reopen : Ok
14: Roundtrip evsel->name : Ok
15: Parse sched tracepoints fields : Ok
16: syscalls:sys_enter_openat event fields : Ok
17: Setup struct perf_event_attr : Ok
18: Match and link multiple hists : Ok
19: 'import perf' in python : Ok
20: Breakpoint overflow signal handler : Ok
21: Breakpoint overflow sampling : Ok
22: Breakpoint accounting : Ok
23: Watchpoint :
23.1: Read Only Watchpoint : Skip (missing hardware support)
23.2: Write Only Watchpoint : Ok
23.3: Read / Write Watchpoint : Ok
23.4: Modify Watchpoint : Ok
24: Number of exit events of a simple workload : Ok
25: Software clock events period values : Ok
26: Object code reading : Ok
27: Sample parsing : Ok
28: Use a dummy software event to keep tracking : Ok
29: Parse with no sample_id_all bit set : Ok
30: Filter hist entries : Ok
31: Lookup mmap thread : Ok
32: Share thread maps : Ok
33: Sort output of hist entries : Ok
34: Cumulate child hist entries : Ok
35: Track with sched_switch : Ok
36: Filter fds with revents mask in a fdarray : Ok
37: Add fd to a fdarray, making it autogrow : Ok
38: kmod_path__parse : Ok
39: Thread map : Ok
40: LLVM search and compile :
40.1: Basic BPF llvm compile : Ok
40.2: kbuild searching : Ok
40.3: Compile source for BPF prologue generation : Ok
40.4: Compile source for BPF relocation : Ok
41: Session topology : Ok
42: BPF filter :
42.1: Basic BPF filtering : Ok
42.2: BPF pinning : Ok
42.3: BPF prologue generation : Ok
43: Synthesize thread map : Ok
44: Remove thread map : Ok
45: Synthesize cpu map : Ok
46: Synthesize stat config : Ok
47: Synthesize stat : Ok
48: Synthesize stat round : Ok
49: Synthesize attr update : Ok
50: Event times : Ok
51: Read backward ring buffer : Ok
52: Print cpu map : Ok
53: Merge cpu map : Ok
54: Probe SDT events : Ok
55: is_printable_array : Ok
56: Print bitmap : Ok
57: perf hooks : Ok
58: builtin clang support :
58.1: builtin clang compile C source to IR : Skip (not compiled in)
58.2: builtin clang compile C source to ELF object : Skip (not compiled in)
59: unit_number__scnprintf : Ok
60: mem2node : Ok
61: time utils : Ok
62: Test jit_write_elf : Ok
63: Test libpfm4 support :
63.1: test of individual --pfm-events : Skip (not compiled in)
63.2: test groups of --pfm-events : Skip (not compiled in)
64: Test api io : Ok
65: maps__merge_in : Ok
66: Demangle Java : Ok
67: Demangle OCaml : Ok
68: Parse and process metrics : Ok
69: PE file support : Ok
70: Event expansion for cgroups : Ok
71: Convert perf time to TSC :
71.1: TSC support : Ok
71.2: Perf time to TSC : Ok
72: dlfilter C API : Ok
73: Sigtrap : Ok
74: x86 rdpmc : Ok
75: Test dwarf unwind : Ok
76: x86 instruction decoder - new instructions : Ok
77: Intel PT packet decoder : Ok
78: x86 bp modify : Ok
79: x86 Sample parsing : Ok
80: build id cache operations : Ok
81: daemon operations : Ok
82: perf pipe recording and injection test : Ok
83: Add vfs_getname probe to get syscall args filenames : Ok
84: probe libc's inet_pton & backtrace it with ping : Ok
85: Use vfs_getname probe to get syscall args filenames : Ok
86: Zstd perf.data compression/decompression : Ok
87: perf record tests : Ok
88: perf record offcpu profiling tests : Ok
89: perf stat CSV output linter : Skip
90: perf stat csv summary test : Ok
91: perf stat metrics (shadow stat) test : Ok
92: perf stat tests : Ok
93: perf all metricgroups test : Ok
94: perf all metrics test : FAILED!
95: perf all PMU test : Ok
96: perf stat --bpf-counters test : Ok
97: Check Arm64 callgraphs are complete in fp mode : Skip
98: Check Arm CoreSight trace data recording and synthesized samples: Skip
99: Check Arm SPE trace data recording and synthesized samples : Skip
100: Miscellaneous Intel PT testing : Ok
101: Check open filename arg using perf trace + vfs_getname : Ok
[root@quaco ~]#
$ git log --oneline -1 ; time make -C tools/perf/ build-test
9dde6cadb92b5670 (HEAD -> perf/core, seventh/perf/core, five/perf/core, acme/tmp.perf/core, acme.korg/tmp.perf/core) tools arch x86: Sync the msr-index.h copy with the kernel sources
make: Entering directory '/home/acme/git/perf/tools/perf'
- tarpkg: ./tests/perf-targz-src-pkg .
make_static: make LDFLAGS=-static NO_PERF_READ_VDSO32=1 NO_PERF_READ_VDSOX32=1 NO_JVMTI=1 -j8 DESTDIR=/tmp/tmp.75b2IpEEhs
make_with_gtk2: make GTK2=1 -j8 DESTDIR=/tmp/tmp.orGe9xEAht
make_no_slang_O: make NO_SLANG=1
make_no_libpython_O: make NO_LIBPYTHON=1
make_tags_O: make tags
make_no_libnuma_O: make NO_LIBNUMA=1
make_no_demangle_O: make NO_DEMANGLE=1
make_no_backtrace_O: make NO_BACKTRACE=1
make_no_libbionic_O: make NO_LIBBIONIC=1
make_no_scripts_O: make NO_LIBPYTHON=1 NO_LIBPERL=1
make_no_libelf_O: make NO_LIBELF=1
make_no_syscall_tbl_O: make NO_SYSCALL_TABLE=1
make_minimal_O: make NO_LIBPERL=1 NO_LIBPYTHON=1 NO_NEWT=1 NO_GTK2=1 NO_DEMANGLE=1 NO_LIBELF=1 NO_LIBUNWIND=1 NO_BACKTRACE=1 NO_LIBNUMA=1 NO_LIBAUDIT=1 NO_LIBBIONIC=1 NO_LIBDW_DWARF_UNWIND=1 NO_AUXTRACE=1 NO_LIBBPF=1 NO_LIBCRYPTO=1 NO_SDT=1 NO_JVMTI=1 NO_LIBZSTD=1 NO_LIBCAP=1 NO_SYSCALL_TABLE=1
make_no_sdt_O: make NO_SDT=1
make_help_O: make help
make_no_auxtrace_O: make NO_AUXTRACE=1
make_clean_all_O: make clean all
make_install_O: make install
make_with_coresight_O: make CORESIGHT=1
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [GIT PULL] perf tools changes for v5.19: 2nd batch
2022-05-29 15:45 [GIT PULL] perf tools changes for v5.19: 2nd batch Arnaldo Carvalho de Melo
@ 2022-05-29 17:28 ` Linus Torvalds
2022-05-29 21:32 ` Arnaldo Carvalho de Melo
0 siblings, 1 reply; 3+ messages in thread
From: Linus Torvalds @ 2022-05-29 17:28 UTC (permalink / raw)
To: Arnaldo Carvalho de Melo
Cc: Ingo Molnar, Thomas Gleixner, Jiri Olsa, Namhyung Kim,
Clark Williams, Kate Carcia, Linux Kernel Mailing List,
linux-perf-users, Adrian Hunter, Carsten Haitzler, Claire Jensen,
Dmitriy Vyukov, Eelco Chaudron, Eric Lin, Florian Fischer,
German Gomez, Ian Rogers, James Clark, Joe Mario, Kan Liang,
Leo Yan, Martin Liška, Thomas Richter, Xing Zhengjun,
Yang Jihong, Arnaldo Carvalho de Melo
On Sun, May 29, 2022 at 8:45 AM Arnaldo Carvalho de Melo
<acme@kernel.org> wrote:
>
> - Add BPF based off-CPU profiling.
I suspect this could have come with a bit more explanation of what
"off-CPU profiling" means.
It seems to be "account time when process was scheduled away to
caller", but I had to go look at the commits to figure that out.
Partly unrelated side note: I've occasionally looked for "useful perf
recipes". Not from kernel developers, but from people who solved real
performance problems using perf, giving useful examples.
Linus
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [GIT PULL] perf tools changes for v5.19: 2nd batch
2022-05-29 17:28 ` Linus Torvalds
@ 2022-05-29 21:32 ` Arnaldo Carvalho de Melo
0 siblings, 0 replies; 3+ messages in thread
From: Arnaldo Carvalho de Melo @ 2022-05-29 21:32 UTC (permalink / raw)
To: Linus Torvalds, Arnaldo Carvalho de Melo
Cc: Ingo Molnar, Thomas Gleixner, Jiri Olsa, Namhyung Kim,
Clark Williams, Kate Carcia, Linux Kernel Mailing List,
linux-perf-users, Adrian Hunter, Carsten Haitzler, Claire Jensen,
Dmitriy Vyukov, Eelco Chaudron, Eric Lin, Florian Fischer,
German Gomez, Ian Rogers, James Clark, Joe Mario, Kan Liang,
Leo Yan, Martin Liška, Thomas Richter, Xing Zhengjun,
Yang Jihong, Arnaldo Carvalho de Melo, anicolas
On May 29, 2022 7:28:26 PM GMT+02:00, Linus Torvalds <torvalds@linux-foundation.org> wrote:
>On Sun, May 29, 2022 at 8:45 AM Arnaldo Carvalho de Melo
><acme@kernel.org> wrote:
>>
>> - Add BPF based off-CPU profiling.
>
>I suspect this could have come with a bit more explanation of what
>"off-CPU profiling" means.
Sorry about that, I was in a hurry, traveling to Paris for Kernel Recipes[1], afraid to miss the merge window.
>It seems to be "account time when process was scheduled away to
>caller", but I had to go look at the commits to figure that out.
Thanks for merging!
>Partly unrelated side note: I've occasionally looked for "useful perf
>recipes". Not from kernel developers, but from people who solved real
>performance problems using perf, giving useful examples.
Yeah, collecting such experiences somewhere and trying to reduce boilerplate to achieve the results sometimes ends up creating new tools or making the existing ones now actionable.
When people ask me about such recipes I usually point them to:
https://www.brendangregg.com/perf.html
Lots of features in perf came from trying to address comments, complaints from you, Ingo, Peter, Thomas, Milian Wolff, Brendan, Stephane and lots of others, thanks!
Back to this off-CPU thing, I'm talking with Namhyung on how to streamline it, this one and the growing number of BPF based perf tools,
- Arnaldo
[1] https://kernel-recipes.org/en/2022/
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2022-05-29 21:33 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-05-29 15:45 [GIT PULL] perf tools changes for v5.19: 2nd batch Arnaldo Carvalho de Melo
2022-05-29 17:28 ` Linus Torvalds
2022-05-29 21:32 ` Arnaldo Carvalho de Melo
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).