Greeting, FYI, we noticed a -14.0% regression of aim7.jobs-per-min due to commit: commit: 45208c9105bd96015b98cdf31fbd6a3bcff234b6 ("[patch 097/212] memcg: infrastructure to flush memcg stats") url: https://github.com/0day-ci/linux/commits/Andrew-Morton/ia64-fix-typo-in-a-comment/20210903-065028 in testcase: aim7 on test machine: 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz with 256G memory with following parameters: disk: 1BRD_48G fs: xfs test: disk_rr load: 3000 cpufreq_governor: performance ucode: 0xd000280 test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system. test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/ In addition to that, the commit also has significant impact on the following tests: +------------------+-------------------------------------------------------------------------------------+ | testcase: change | reaim: reaim.jobs_per_min -10.0% regression | | test machine | 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory | | test parameters | cpufreq_governor=performance | | | nr_task=100% | | | runtime=300s | | | test=compute | | | ucode=0x5003006 | +------------------+-------------------------------------------------------------------------------------+ | testcase: change | will-it-scale: will-it-scale.per_process_ops -29.8% regression | | test machine | 104 threads 2 sockets Skylake with 192G memory | | test parameters | cpufreq_governor=performance | | | mode=process | | | nr_task=100% | | | test=fallocate2 | | | ucode=0x2006a0a | +------------------+-------------------------------------------------------------------------------------+ | testcase: change | fio-basic: fio.read_iops -20.5% regression | | test machine | 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory | | test parameters | bs=4k | | | cpufreq_governor=performance | | | disk=2pmem | | | fs=xfs | | | ioengine=mmap | | | nr_task=50% | | | runtime=200s | | | rw=read | | | test_size=200G | | | time_based=tb | | | ucode=0x5003006 | +------------------+-------------------------------------------------------------------------------------+ | testcase: change | will-it-scale: will-it-scale.per_process_ops -9.2% regression | | test machine | 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory | | test parameters | cpufreq_governor=performance | | | mode=process | | | nr_task=50% | | | test=page_fault3 | | | ucode=0x42e | +------------------+-------------------------------------------------------------------------------------+ | testcase: change | will-it-scale: will-it-scale.per_thread_ops -2.3% regression | | test machine | 144 threads 4 sockets Intel(R) Xeon(R) Gold 5318H CPU @ 2.50GHz with 128G memory | | test parameters | cpufreq_governor=performance | | | mode=thread | | | nr_task=100% | | | test=tlb_flush1 | | | ucode=0x700001e | +------------------+-------------------------------------------------------------------------------------+ | testcase: change | will-it-scale: will-it-scale.per_thread_ops -8.9% regression | | test machine | 144 threads 4 sockets Intel(R) Xeon(R) Gold 5318H CPU @ 2.50GHz with 128G memory | | test parameters | cpufreq_governor=performance | | | mode=thread | | | nr_task=16 | | | test=tlb_flush1 | | | ucode=0x700001e | +------------------+-------------------------------------------------------------------------------------+ | testcase: change | will-it-scale: will-it-scale.per_process_ops -6.4% regression | | test machine | 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory | | test parameters | cpufreq_governor=performance | | | mode=process | | | nr_task=50% | | | test=page_fault2 | | | ucode=0x42e | +------------------+-------------------------------------------------------------------------------------+ | testcase: change | netperf: netperf.Throughput_Mbps 89.8% improvement | | test machine | 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory | | test parameters | cluster=cs-localhost | | | cpufreq_governor=performance | | | ip=ipv4 | | | nr_threads=200% | | | runtime=900s | | | test=TCP_MAERTS | | | ucode=0x5003006 | +------------------+-------------------------------------------------------------------------------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run bin/lkp run generated-yaml-file ========================================================================================= compiler/cpufreq_governor/disk/fs/kconfig/load/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/1BRD_48G/xfs/x86_64-rhel-8.3/3000/debian-10.4-x86_64-20200603.cgz/lkp-icl-2sp2/disk_rr/aim7/0xd000280 commit: 3c28c7680e ("memcg: switch lruvec stats to rstat") 45208c9105 ("memcg: infrastructure to flush memcg stats") 3c28c7680e1c39b9 45208c9105bd96015b98cdf31fb ---------------- --------------------------- %stddev %change %stddev \ | \ 589279 -14.0% 506860 aim7.jobs-per-min 2510 ± 5% +1075.4% 29509 ± 5% aim7.time.involuntary_context_switches 594.27 ± 2% +265.5% 2172 ± 2% aim7.time.system_time 953353 -6.3% 893500 aim7.time.voluntary_context_switches 3.783e+09 ± 5% -27.7% 2.736e+09 ± 5% cpuidle..time 8575835 ± 4% -23.3% 6576912 ± 4% cpuidle..usage 85.15 -34.4% 55.89 ± 2% iostat.cpu.idle 13.77 ± 4% +212.8% 43.07 ± 3% iostat.cpu.system 84.38 -30.7 53.71 ± 3% mpstat.cpu.all.idle% 0.09 ± 3% -0.0 0.06 mpstat.cpu.all.soft% 13.63 ± 4% +30.8 44.40 ± 3% mpstat.cpu.all.sys% 84.83 -34.8% 55.33 ± 2% vmstat.cpu.id 17.50 ± 4% +221.0% 56.17 ± 4% vmstat.procs.r 295154 +9.7% 323704 ± 3% vmstat.system.in 7265 ± 17% -62.1% 2752 ± 10% softirqs.CPU11.RCU 7329 ± 18% -56.2% 3211 ± 33% softirqs.CPU7.RCU 7291 ± 24% -63.4% 2671 ± 15% softirqs.CPU76.RCU 814854 ± 2% -58.7% 336317 ± 6% softirqs.RCU 416.83 ± 4% +188.2% 1201 ± 3% turbostat.Avg_MHz 16.05 ± 4% +30.2 46.27 ± 3% turbostat.Busy% 8580008 ± 4% -23.6% 6558461 ± 4% turbostat.C1 85.14 -30.7 54.48 ± 3% turbostat.C1% 10650547 ± 3% +23.2% 13120314 ± 4% turbostat.IRQ 22456 ± 5% +270.7% 83244 ± 3% meminfo.Active 15681 ± 10% +239.8% 53290 ± 3% meminfo.Active(anon) 6773 ± 8% +342.2% 29953 ± 11% meminfo.Active(file) 378124 +10.7% 418453 ± 2% meminfo.Inactive(anon) 44735 +92.1% 85948 ± 6% meminfo.Mapped 37940 ± 3% +186.6% 108723 ± 3% meminfo.Shmem 0.03 ±147% -74.4% 0.01 ± 16% perf-sched.sch_delay.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64 3.28 +62.6% 5.33 ± 22% perf-sched.sch_delay.max.ms.worker_thread.kthread.ret_from_fork 583.33 ± 5% +77.5% 1035 ± 12% perf-sched.total_wait_and_delay.count.ms 1.38 ± 21% -81.7% 0.25 ± 24% perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork 50.17 ± 11% +917.6% 510.50 ± 20% perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork 1.31 ± 21% -83.7% 0.21 ± 21% perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork 3290 ± 8% +17.7% 3873 ± 7% slabinfo.kmalloc-cg-1k.active_objs 3290 ± 8% +17.7% 3873 ± 7% slabinfo.kmalloc-cg-1k.num_objs 50845 +23.7% 62890 slabinfo.radix_tree_node.active_objs 908.17 +24.2% 1128 slabinfo.radix_tree_node.active_slabs 50876 +24.3% 63221 slabinfo.radix_tree_node.num_objs 908.17 +24.2% 1128 slabinfo.radix_tree_node.num_slabs 6342 ± 29% +165.1% 16811 ± 13% numa-meminfo.node0.Active 3683 ± 13% +287.3% 14266 ± 13% numa-meminfo.node0.Active(file) 31786 ± 40% +61.2% 51254 ± 2% numa-meminfo.node0.Mapped 93423 ± 5% -67.2% 30632 ±133% numa-meminfo.node0.PageTables 16014 ± 19% +313.9% 66284 ± 3% numa-meminfo.node1.Active 13022 ± 22% +289.8% 50755 ± 3% numa-meminfo.node1.Active(anon) 2991 ± 17% +419.1% 15528 ± 12% numa-meminfo.node1.Active(file) 481048 ± 3% +10.8% 533239 ± 3% numa-meminfo.node1.Dirty 564411 ± 8% +23.2% 695626 ± 13% numa-meminfo.node1.Inactive 84926 ± 46% +98.5% 168539 ± 56% numa-meminfo.node1.Inactive(anon) 840.17 ± 23% +7571.8% 64455 ± 69% numa-meminfo.node1.PageTables 23552 ± 31% +297.9% 93724 ± 7% numa-meminfo.node1.Shmem 154648 ± 22% +47.6% 228217 ± 23% numa-meminfo.node1.Slab 948.33 ± 14% +278.4% 3588 ± 13% numa-vmstat.node0.nr_active_file 7946 ± 40% +61.3% 12814 ± 2% numa-vmstat.node0.nr_mapped 23354 ± 5% -67.2% 7658 ±133% numa-vmstat.node0.nr_page_table_pages 955.17 ± 14% +275.2% 3583 ± 13% numa-vmstat.node0.nr_zone_active_file 3255 ± 22% +289.8% 12689 ± 3% numa-vmstat.node1.nr_active_anon 747.83 ± 20% +423.4% 3914 ± 12% numa-vmstat.node1.nr_active_file 120249 ± 3% +10.8% 133246 ± 3% numa-vmstat.node1.nr_dirty 21234 ± 46% +98.4% 42135 ± 56% numa-vmstat.node1.nr_inactive_anon 210.00 ± 23% +7572.6% 16112 ± 69% numa-vmstat.node1.nr_page_table_pages 5887 ± 31% +297.9% 23429 ± 7% numa-vmstat.node1.nr_shmem 3255 ± 22% +289.8% 12689 ± 3% numa-vmstat.node1.nr_zone_active_anon 754.67 ± 19% +419.1% 3917 ± 12% numa-vmstat.node1.nr_zone_active_file 21234 ± 46% +98.4% 42135 ± 56% numa-vmstat.node1.nr_zone_inactive_anon 120773 ± 3% +9.8% 132625 ± 3% numa-vmstat.node1.nr_zone_write_pending 3920 ± 10% +239.9% 13323 ± 3% proc-vmstat.nr_active_anon 1714 ± 8% +345.9% 7645 ± 10% proc-vmstat.nr_active_file 240516 ± 3% +9.0% 262057 ± 2% proc-vmstat.nr_dirty 847275 +4.6% 886517 proc-vmstat.nr_file_pages 94529 +10.7% 104604 ± 2% proc-vmstat.nr_inactive_anon 11184 +92.2% 21494 ± 6% proc-vmstat.nr_mapped 9484 ± 3% +186.6% 27179 ± 3% proc-vmstat.nr_shmem 37421 +6.9% 40004 proc-vmstat.nr_slab_reclaimable 3920 ± 10% +239.9% 13323 ± 3% proc-vmstat.nr_zone_active_anon 1714 ± 8% +345.9% 7644 ± 10% proc-vmstat.nr_zone_active_file 94529 +10.7% 104604 ± 2% proc-vmstat.nr_zone_inactive_anon 241459 ± 3% +8.0% 260729 ± 2% proc-vmstat.nr_zone_write_pending 401067 +7.7% 432079 proc-vmstat.pgfault 12465 +9.0% 13586 ± 2% proc-vmstat.pgreuse 1573 +2.1% 1605 proc-vmstat.unevictable_pgs_culled 5.65 ± 2% +13.2% 6.39 ± 2% perf-stat.i.MPKI 0.65 ± 3% -0.1 0.58 ± 3% perf-stat.i.branch-miss-rate% 1.293e+08 ± 3% +16.5% 1.506e+08 ± 2% perf-stat.i.cache-misses 4.507e+08 ± 3% +11.6% 5.03e+08 ± 2% perf-stat.i.cache-references 1.92 ± 5% +45.6% 2.80 ± 2% perf-stat.i.cpi 5.438e+10 ± 4% +177.4% 1.509e+11 ± 3% perf-stat.i.cpu-cycles 1286 ± 4% +417.9% 6660 ± 3% perf-stat.i.cpu-migrations 0.01 ± 2% -0.0 0.01 ± 2% perf-stat.i.dTLB-load-miss-rate% 1958804 ± 4% -12.8% 1708670 ± 5% perf-stat.i.dTLB-load-misses 218781 ± 6% -16.0% 183740 ± 4% perf-stat.i.dTLB-store-misses 1.059e+10 ± 4% -14.7% 9.033e+09 ± 2% perf-stat.i.dTLB-stores 0.93 ± 3% -56.0% 0.41 perf-stat.i.ipc 0.43 ± 4% +176.5% 1.18 ± 3% perf-stat.i.metric.GHz 683.67 ± 3% +6.7% 729.59 ± 2% perf-stat.i.metric.K/sec 38.44 ± 4% +16.0 54.48 perf-stat.i.node-load-miss-rate% 5765381 ± 4% +233.2% 19207678 ± 2% perf-stat.i.node-load-misses 38882013 ± 4% -29.4% 27435575 ± 3% perf-stat.i.node-loads 3232868 ± 4% +82.2% 5889275 ± 2% perf-stat.i.node-store-misses 6.77 +12.5% 7.61 perf-stat.overall.MPKI 0.30 -0.0 0.30 perf-stat.overall.branch-miss-rate% 28.70 +1.2 29.94 perf-stat.overall.cache-miss-rate% 0.82 +178.5% 2.27 perf-stat.overall.cpi 420.30 +137.4% 997.89 ± 2% perf-stat.overall.cycles-between-cache-misses 1.23 -64.1% 0.44 perf-stat.overall.ipc 12.91 +28.2 41.07 perf-stat.overall.node-load-miss-rate% 8.87 +5.5 14.39 perf-stat.overall.node-store-miss-rate% 1.28e+10 ± 3% +8.0% 1.383e+10 ± 2% perf-stat.ps.branch-instructions 1.273e+08 ± 3% +21.7% 1.55e+08 ± 3% perf-stat.ps.cache-misses 4.435e+08 ± 3% +16.7% 5.176e+08 ± 3% perf-stat.ps.cache-references 5.351e+10 ± 4% +189.0% 1.546e+11 ± 3% perf-stat.ps.cpu-cycles 1265 ± 4% +437.8% 6803 ± 3% perf-stat.ps.cpu-migrations 214181 ± 6% -12.8% 186735 ± 5% perf-stat.ps.dTLB-store-misses 1.042e+10 ± 3% -10.9% 9.287e+09 ± 2% perf-stat.ps.dTLB-stores 5677458 ± 4% +247.6% 19734668 ± 3% perf-stat.ps.node-load-misses 38291599 ± 4% -26.0% 28320179 ± 3% perf-stat.ps.node-loads 3183080 ± 4% +90.3% 6058716 ± 3% perf-stat.ps.node-store-misses 32706767 ± 3% +10.2% 36055755 ± 3% perf-stat.ps.node-stores 2.224e+12 +17.8% 2.621e+12 perf-stat.total.instructions 69224 ± 4% +10.0% 76158 ± 5% interrupts.CPU0.LOC:Local_timer_interrupts 2598 ± 23% +222.8% 8389 ± 14% interrupts.CPU0.NMI:Non-maskable_interrupts 2598 ± 23% +222.8% 8389 ± 14% interrupts.CPU0.PMI:Performance_monitoring_interrupts 4074 ± 4% +33.6% 5443 ± 11% interrupts.CPU0.RES:Rescheduling_interrupts 69234 ± 4% +10.1% 76193 ± 5% interrupts.CPU1.LOC:Local_timer_interrupts 2690 ± 22% +227.1% 8799 ± 4% interrupts.CPU1.NMI:Non-maskable_interrupts 2690 ± 22% +227.1% 8799 ± 4% interrupts.CPU1.PMI:Performance_monitoring_interrupts 69202 ± 4% +10.1% 76197 ± 5% interrupts.CPU10.LOC:Local_timer_interrupts 2504 ± 21% +214.5% 7877 ± 19% interrupts.CPU10.NMI:Non-maskable_interrupts 2504 ± 21% +214.5% 7877 ± 19% interrupts.CPU10.PMI:Performance_monitoring_interrupts 4174 ± 12% +32.3% 5522 ± 13% interrupts.CPU10.RES:Rescheduling_interrupts 69168 ± 4% +11.1% 76836 ± 6% interrupts.CPU100.LOC:Local_timer_interrupts 2948 ± 12% +169.3% 7939 ± 19% interrupts.CPU100.NMI:Non-maskable_interrupts 2948 ± 12% +169.3% 7939 ± 19% interrupts.CPU100.PMI:Performance_monitoring_interrupts 3729 ± 5% +34.6% 5020 ± 7% interrupts.CPU100.RES:Rescheduling_interrupts 69006 ± 4% +10.6% 76312 ± 5% interrupts.CPU101.LOC:Local_timer_interrupts 2833 ± 14% +178.8% 7899 ± 19% interrupts.CPU101.NMI:Non-maskable_interrupts 2833 ± 14% +178.8% 7899 ± 19% interrupts.CPU101.PMI:Performance_monitoring_interrupts 3712 ± 5% +28.2% 4760 ± 2% interrupts.CPU101.RES:Rescheduling_interrupts 69192 ± 4% +10.4% 76383 ± 5% interrupts.CPU102.LOC:Local_timer_interrupts 2996 ± 14% +163.6% 7900 ± 19% interrupts.CPU102.NMI:Non-maskable_interrupts 2996 ± 14% +163.6% 7900 ± 19% interrupts.CPU102.PMI:Performance_monitoring_interrupts 3749 ± 2% +27.9% 4797 ± 2% interrupts.CPU102.RES:Rescheduling_interrupts 69191 ± 4% +10.4% 76360 ± 5% interrupts.CPU103.LOC:Local_timer_interrupts 2744 ± 18% +205.1% 8371 ± 14% interrupts.CPU103.NMI:Non-maskable_interrupts 2744 ± 18% +205.1% 8371 ± 14% interrupts.CPU103.PMI:Performance_monitoring_interrupts 3707 ± 3% +26.7% 4697 ± 6% interrupts.CPU103.RES:Rescheduling_interrupts 69201 ± 4% +10.3% 76355 ± 5% interrupts.CPU104.LOC:Local_timer_interrupts 2788 ± 17% +210.3% 8653 ± 10% interrupts.CPU104.NMI:Non-maskable_interrupts 2788 ± 17% +210.3% 8653 ± 10% interrupts.CPU104.PMI:Performance_monitoring_interrupts 3720 ± 3% +33.7% 4975 ± 19% interrupts.CPU104.RES:Rescheduling_interrupts 69162 ± 4% +10.3% 76280 ± 5% interrupts.CPU105.LOC:Local_timer_interrupts 2512 ± 18% +234.2% 8397 ± 13% interrupts.CPU105.NMI:Non-maskable_interrupts 2512 ± 18% +234.2% 8397 ± 13% interrupts.CPU105.PMI:Performance_monitoring_interrupts 3683 ± 3% +25.0% 4602 ± 5% interrupts.CPU105.RES:Rescheduling_interrupts 69163 ± 4% +9.9% 76032 ± 5% interrupts.CPU106.LOC:Local_timer_interrupts 2820 ± 16% +196.1% 8352 ± 12% interrupts.CPU106.NMI:Non-maskable_interrupts 2820 ± 16% +196.1% 8352 ± 12% interrupts.CPU106.PMI:Performance_monitoring_interrupts 3760 ± 4% +29.7% 4879 ± 7% interrupts.CPU106.RES:Rescheduling_interrupts 69181 ± 4% +10.3% 76306 ± 5% interrupts.CPU107.LOC:Local_timer_interrupts 2760 ± 19% +201.5% 8320 ± 14% interrupts.CPU107.NMI:Non-maskable_interrupts 2760 ± 19% +201.5% 8320 ± 14% interrupts.CPU107.PMI:Performance_monitoring_interrupts 3753 +33.5% 5011 ± 6% interrupts.CPU107.RES:Rescheduling_interrupts 69166 ± 4% +10.3% 76316 ± 5% interrupts.CPU108.LOC:Local_timer_interrupts 2471 ± 22% +241.0% 8429 ± 14% interrupts.CPU108.NMI:Non-maskable_interrupts 2471 ± 22% +241.0% 8429 ± 14% interrupts.CPU108.PMI:Performance_monitoring_interrupts 3829 ± 3% +31.1% 5021 ± 9% interrupts.CPU108.RES:Rescheduling_interrupts 69169 ± 4% +10.3% 76309 ± 5% interrupts.CPU109.LOC:Local_timer_interrupts 2241 ± 13% +277.0% 8450 ± 14% interrupts.CPU109.NMI:Non-maskable_interrupts 2241 ± 13% +277.0% 8450 ± 14% interrupts.CPU109.PMI:Performance_monitoring_interrupts 69205 ± 4% +12.0% 77543 ± 7% interrupts.CPU11.LOC:Local_timer_interrupts 2657 ± 20% +207.6% 8173 ± 16% interrupts.CPU11.NMI:Non-maskable_interrupts 2657 ± 20% +207.6% 8173 ± 16% interrupts.CPU11.PMI:Performance_monitoring_interrupts 69170 ± 4% +10.2% 76230 ± 5% interrupts.CPU110.LOC:Local_timer_interrupts 2339 ± 22% +262.1% 8469 ± 14% interrupts.CPU110.NMI:Non-maskable_interrupts 2339 ± 22% +262.1% 8469 ± 14% interrupts.CPU110.PMI:Performance_monitoring_interrupts 69185 ± 4% +10.3% 76300 ± 5% interrupts.CPU111.LOC:Local_timer_interrupts 2299 ± 15% +290.8% 8986 ± 3% interrupts.CPU111.NMI:Non-maskable_interrupts 2299 ± 15% +290.8% 8986 ± 3% interrupts.CPU111.PMI:Performance_monitoring_interrupts 3749 ± 2% +34.2% 5030 ± 4% interrupts.CPU111.RES:Rescheduling_interrupts 69165 ± 4% +10.4% 76328 ± 5% interrupts.CPU112.LOC:Local_timer_interrupts 2469 ± 19% +260.4% 8899 ± 3% interrupts.CPU112.NMI:Non-maskable_interrupts 2469 ± 19% +260.4% 8899 ± 3% interrupts.CPU112.PMI:Performance_monitoring_interrupts 3655 ± 3% +26.9% 4637 ± 5% interrupts.CPU112.RES:Rescheduling_interrupts 69154 ± 4% +10.4% 76365 ± 5% interrupts.CPU113.LOC:Local_timer_interrupts 2566 ± 19% +226.2% 8371 ± 13% interrupts.CPU113.NMI:Non-maskable_interrupts 2566 ± 19% +226.2% 8371 ± 13% interrupts.CPU113.PMI:Performance_monitoring_interrupts 3734 ± 4% +35.9% 5074 ± 8% interrupts.CPU113.RES:Rescheduling_interrupts 69179 ± 4% +10.3% 76280 ± 5% interrupts.CPU114.LOC:Local_timer_interrupts 2536 ± 17% +231.8% 8416 ± 14% interrupts.CPU114.NMI:Non-maskable_interrupts 2536 ± 17% +231.8% 8416 ± 14% interrupts.CPU114.PMI:Performance_monitoring_interrupts 3752 ± 2% +38.4% 5192 ± 16% interrupts.CPU114.RES:Rescheduling_interrupts 69173 ± 4% +10.5% 76468 ± 5% interrupts.CPU115.LOC:Local_timer_interrupts 2680 ± 19% +198.4% 7999 ± 19% interrupts.CPU115.NMI:Non-maskable_interrupts 2680 ± 19% +198.4% 7999 ± 19% interrupts.CPU115.PMI:Performance_monitoring_interrupts 3779 ± 3% +27.9% 4834 ± 5% interrupts.CPU115.RES:Rescheduling_interrupts 69181 ± 4% +10.3% 76305 ± 5% interrupts.CPU116.LOC:Local_timer_interrupts 2625 ± 15% +220.5% 8416 ± 14% interrupts.CPU116.NMI:Non-maskable_interrupts 2625 ± 15% +220.5% 8416 ± 14% interrupts.CPU116.PMI:Performance_monitoring_interrupts 3709 ± 4% +28.4% 4761 ± 5% interrupts.CPU116.RES:Rescheduling_interrupts 69192 ± 4% +10.2% 76275 ± 5% interrupts.CPU117.LOC:Local_timer_interrupts 2657 ± 18% +196.2% 7872 ± 17% interrupts.CPU117.NMI:Non-maskable_interrupts 2657 ± 18% +196.2% 7872 ± 17% interrupts.CPU117.PMI:Performance_monitoring_interrupts 3820 ± 4% +30.4% 4980 ± 14% interrupts.CPU117.RES:Rescheduling_interrupts 69167 ± 4% +10.4% 76334 ± 5% interrupts.CPU118.LOC:Local_timer_interrupts 2916 ± 19% +168.8% 7841 ± 17% interrupts.CPU118.NMI:Non-maskable_interrupts 2916 ± 19% +168.8% 7841 ± 17% interrupts.CPU118.PMI:Performance_monitoring_interrupts 3804 ± 3% +28.6% 4891 ± 4% interrupts.CPU118.RES:Rescheduling_interrupts 69176 ± 4% +10.3% 76303 ± 5% interrupts.CPU119.LOC:Local_timer_interrupts 2667 ± 19% +195.1% 7874 ± 17% interrupts.CPU119.NMI:Non-maskable_interrupts 2667 ± 19% +195.1% 7874 ± 17% interrupts.CPU119.PMI:Performance_monitoring_interrupts 3646 ± 2% +34.6% 4907 ± 8% interrupts.CPU119.RES:Rescheduling_interrupts 69243 ± 4% +10.9% 76824 ± 5% interrupts.CPU12.LOC:Local_timer_interrupts 2493 ± 22% +213.9% 7828 ± 18% interrupts.CPU12.NMI:Non-maskable_interrupts 2493 ± 22% +213.9% 7828 ± 18% interrupts.CPU12.PMI:Performance_monitoring_interrupts 3913 ± 2% +27.6% 4994 ± 4% interrupts.CPU12.RES:Rescheduling_interrupts 69173 ± 4% +10.2% 76255 ± 5% interrupts.CPU120.LOC:Local_timer_interrupts 2795 ± 16% +180.8% 7848 ± 17% interrupts.CPU120.NMI:Non-maskable_interrupts 2795 ± 16% +180.8% 7848 ± 17% interrupts.CPU120.PMI:Performance_monitoring_interrupts 3735 ± 4% +26.2% 4714 ± 4% interrupts.CPU120.RES:Rescheduling_interrupts 69180 ± 4% +10.3% 76326 ± 5% interrupts.CPU121.LOC:Local_timer_interrupts 2921 ± 16% +174.0% 8004 ± 17% interrupts.CPU121.NMI:Non-maskable_interrupts 2921 ± 16% +174.0% 8004 ± 17% interrupts.CPU121.PMI:Performance_monitoring_interrupts 3829 ± 3% +42.8% 5467 ± 17% interrupts.CPU121.RES:Rescheduling_interrupts 69182 ± 4% +10.3% 76301 ± 5% interrupts.CPU122.LOC:Local_timer_interrupts 2714 ± 15% +192.0% 7925 ± 17% interrupts.CPU122.NMI:Non-maskable_interrupts 2714 ± 15% +192.0% 7925 ± 17% interrupts.CPU122.PMI:Performance_monitoring_interrupts 3713 ± 3% +31.4% 4877 ± 4% interrupts.CPU122.RES:Rescheduling_interrupts 69155 ± 4% +10.4% 76361 ± 5% interrupts.CPU123.LOC:Local_timer_interrupts 2743 ± 16% +206.0% 8394 ± 14% interrupts.CPU123.NMI:Non-maskable_interrupts 2743 ± 16% +206.0% 8394 ± 14% interrupts.CPU123.PMI:Performance_monitoring_interrupts 3684 ± 3% +31.3% 4839 ± 7% interrupts.CPU123.RES:Rescheduling_interrupts 69168 ± 4% +10.3% 76282 ± 5% interrupts.CPU124.LOC:Local_timer_interrupts 2584 ± 18% +225.5% 8411 ± 13% interrupts.CPU124.NMI:Non-maskable_interrupts 2584 ± 18% +225.5% 8411 ± 13% interrupts.CPU124.PMI:Performance_monitoring_interrupts 3655 ± 3% +32.2% 4832 ± 6% interrupts.CPU124.RES:Rescheduling_interrupts 69207 ± 4% +10.4% 76422 ± 5% interrupts.CPU125.LOC:Local_timer_interrupts 2632 ± 17% +220.2% 8429 ± 14% interrupts.CPU125.NMI:Non-maskable_interrupts 2632 ± 17% +220.2% 8429 ± 14% interrupts.CPU125.PMI:Performance_monitoring_interrupts 3715 ± 4% +40.3% 5211 ± 18% interrupts.CPU125.RES:Rescheduling_interrupts 69172 ± 4% +10.4% 76364 ± 5% interrupts.CPU126.LOC:Local_timer_interrupts 2755 ± 18% +189.0% 7963 ± 18% interrupts.CPU126.NMI:Non-maskable_interrupts 2755 ± 18% +189.0% 7963 ± 18% interrupts.CPU126.PMI:Performance_monitoring_interrupts 3598 ± 5% +33.9% 4816 ± 3% interrupts.CPU126.RES:Rescheduling_interrupts 69018 ± 4% +11.1% 76646 ± 5% interrupts.CPU127.LOC:Local_timer_interrupts 2792 ± 19% +169.4% 7521 ± 20% interrupts.CPU127.NMI:Non-maskable_interrupts 2792 ± 19% +169.4% 7521 ± 20% interrupts.CPU127.PMI:Performance_monitoring_interrupts 3261 ± 4% +31.2% 4280 ± 10% interrupts.CPU127.RES:Rescheduling_interrupts 69216 ± 4% +10.8% 76658 ± 5% interrupts.CPU13.LOC:Local_timer_interrupts 2497 ± 20% +215.9% 7890 ± 18% interrupts.CPU13.NMI:Non-maskable_interrupts 2497 ± 20% +215.9% 7890 ± 18% interrupts.CPU13.PMI:Performance_monitoring_interrupts 4043 ± 2% +39.9% 5658 ± 20% interrupts.CPU13.RES:Rescheduling_interrupts 69343 ± 4% +10.0% 76295 ± 5% interrupts.CPU14.LOC:Local_timer_interrupts 2633 ± 20% +198.8% 7868 ± 18% interrupts.CPU14.NMI:Non-maskable_interrupts 2633 ± 20% +198.8% 7868 ± 18% interrupts.CPU14.PMI:Performance_monitoring_interrupts 2562 ± 18% +209.0% 7917 ± 18% interrupts.CPU15.NMI:Non-maskable_interrupts 2562 ± 18% +209.0% 7917 ± 18% interrupts.CPU15.PMI:Performance_monitoring_interrupts 4087 ± 10% +29.9% 5307 ± 13% interrupts.CPU15.RES:Rescheduling_interrupts 2653 ± 21% +178.4% 7386 ± 19% interrupts.CPU16.NMI:Non-maskable_interrupts 2653 ± 21% +178.4% 7386 ± 19% interrupts.CPU16.PMI:Performance_monitoring_interrupts 3931 ± 3% +28.1% 5035 ± 3% interrupts.CPU16.RES:Rescheduling_interrupts 69224 ± 4% +10.1% 76228 ± 5% interrupts.CPU17.LOC:Local_timer_interrupts 2614 ± 17% +199.6% 7833 ± 16% interrupts.CPU17.NMI:Non-maskable_interrupts 2614 ± 17% +199.6% 7833 ± 16% interrupts.CPU17.PMI:Performance_monitoring_interrupts 2494 ± 18% +256.4% 8890 ± 2% interrupts.CPU18.NMI:Non-maskable_interrupts 2494 ± 18% +256.4% 8890 ± 2% interrupts.CPU18.PMI:Performance_monitoring_interrupts 3898 ± 5% +29.9% 5063 ± 5% interrupts.CPU18.RES:Rescheduling_interrupts 69206 ± 4% +10.3% 76316 ± 5% interrupts.CPU19.LOC:Local_timer_interrupts 2798 ± 15% +179.3% 7815 ± 16% interrupts.CPU19.NMI:Non-maskable_interrupts 2798 ± 15% +179.3% 7815 ± 16% interrupts.CPU19.PMI:Performance_monitoring_interrupts 3897 ± 3% +33.6% 5205 ± 6% interrupts.CPU19.RES:Rescheduling_interrupts 69233 ± 4% +10.2% 76318 ± 5% interrupts.CPU2.LOC:Local_timer_interrupts 2807 ± 21% +197.3% 8345 ± 13% interrupts.CPU2.NMI:Non-maskable_interrupts 2807 ± 21% +197.3% 8345 ± 13% interrupts.CPU2.PMI:Performance_monitoring_interrupts 69206 ± 4% +10.1% 76207 ± 5% interrupts.CPU20.LOC:Local_timer_interrupts 2423 ± 19% +244.6% 8350 ± 11% interrupts.CPU20.NMI:Non-maskable_interrupts 2423 ± 19% +244.6% 8350 ± 11% interrupts.CPU20.PMI:Performance_monitoring_interrupts 3938 ± 4% +33.3% 5250 ± 8% interrupts.CPU20.RES:Rescheduling_interrupts 69244 ± 4% +10.2% 76278 ± 5% interrupts.CPU21.LOC:Local_timer_interrupts 2211 ± 16% +277.4% 8345 ± 11% interrupts.CPU21.NMI:Non-maskable_interrupts 2211 ± 16% +277.4% 8345 ± 11% interrupts.CPU21.PMI:Performance_monitoring_interrupts 3916 ± 4% +32.1% 5173 ± 7% interrupts.CPU21.RES:Rescheduling_interrupts 69183 ± 4% +10.2% 76243 ± 5% interrupts.CPU22.LOC:Local_timer_interrupts 2255 ± 22% +266.4% 8264 ± 12% interrupts.CPU22.NMI:Non-maskable_interrupts 2255 ± 22% +266.4% 8264 ± 12% interrupts.CPU22.PMI:Performance_monitoring_interrupts 69246 ± 4% +10.2% 76293 ± 5% interrupts.CPU23.LOC:Local_timer_interrupts 2655 ± 21% +213.5% 8324 ± 12% interrupts.CPU23.NMI:Non-maskable_interrupts 2655 ± 21% +213.5% 8324 ± 12% interrupts.CPU23.PMI:Performance_monitoring_interrupts 3933 ± 2% +37.4% 5406 ± 23% interrupts.CPU23.RES:Rescheduling_interrupts 69137 ± 4% +10.3% 76286 ± 5% interrupts.CPU24.LOC:Local_timer_interrupts 2510 ± 23% +230.7% 8303 ± 11% interrupts.CPU24.NMI:Non-maskable_interrupts 2510 ± 23% +230.7% 8303 ± 11% interrupts.CPU24.PMI:Performance_monitoring_interrupts 3907 ± 4% +34.1% 5238 ± 14% interrupts.CPU24.RES:Rescheduling_interrupts 69211 ± 4% +15.3% 79784 ± 8% interrupts.CPU25.LOC:Local_timer_interrupts 2835 ± 19% +213.0% 8875 ± 2% interrupts.CPU25.NMI:Non-maskable_interrupts 2835 ± 19% +213.0% 8875 ± 2% interrupts.CPU25.PMI:Performance_monitoring_interrupts 3963 ± 3% +26.9% 5028 ± 5% interrupts.CPU25.RES:Rescheduling_interrupts 69219 ± 4% +10.0% 76170 ± 5% interrupts.CPU26.LOC:Local_timer_interrupts 2745 ± 17% +225.8% 8942 ± 2% interrupts.CPU26.NMI:Non-maskable_interrupts 2745 ± 17% +225.8% 8942 ± 2% interrupts.CPU26.PMI:Performance_monitoring_interrupts 3879 ± 3% +35.6% 5259 ± 12% interrupts.CPU26.RES:Rescheduling_interrupts 69226 ± 4% +10.2% 76273 ± 5% interrupts.CPU27.LOC:Local_timer_interrupts 2758 ± 16% +222.4% 8892 ± 2% interrupts.CPU27.NMI:Non-maskable_interrupts 2758 ± 16% +222.4% 8892 ± 2% interrupts.CPU27.PMI:Performance_monitoring_interrupts 2981 ± 13% +198.9% 8909 ± 3% interrupts.CPU28.NMI:Non-maskable_interrupts 2981 ± 13% +198.9% 8909 ± 3% interrupts.CPU28.PMI:Performance_monitoring_interrupts 3898 ± 4% +28.2% 4996 ± 11% interrupts.CPU28.RES:Rescheduling_interrupts 69499 ± 5% +9.5% 76123 ± 5% interrupts.CPU29.LOC:Local_timer_interrupts 2988 ± 15% +196.8% 8869 ± 3% interrupts.CPU29.NMI:Non-maskable_interrupts 2988 ± 15% +196.8% 8869 ± 3% interrupts.CPU29.PMI:Performance_monitoring_interrupts 3943 ± 3% +24.4% 4904 ± 3% interrupts.CPU29.RES:Rescheduling_interrupts 69195 ± 4% +10.3% 76353 ± 5% interrupts.CPU3.LOC:Local_timer_interrupts 2763 ± 18% +217.4% 8772 ± 3% interrupts.CPU3.NMI:Non-maskable_interrupts 2763 ± 18% +217.4% 8772 ± 3% interrupts.CPU3.PMI:Performance_monitoring_interrupts 4003 ± 4% +38.9% 5558 ± 19% interrupts.CPU3.RES:Rescheduling_interrupts 69239 ± 4% +10.1% 76262 ± 5% interrupts.CPU30.LOC:Local_timer_interrupts 3170 ± 2% +179.8% 8870 ± 3% interrupts.CPU30.NMI:Non-maskable_interrupts 3170 ± 2% +179.8% 8870 ± 3% interrupts.CPU30.PMI:Performance_monitoring_interrupts 3996 ± 5% +29.0% 5153 ± 3% interrupts.CPU30.RES:Rescheduling_interrupts 69213 ± 4% +10.1% 76198 ± 5% interrupts.CPU31.LOC:Local_timer_interrupts 3165 ± 4% +178.9% 8829 ± 2% interrupts.CPU31.NMI:Non-maskable_interrupts 3165 ± 4% +178.9% 8829 ± 2% interrupts.CPU31.PMI:Performance_monitoring_interrupts 3927 ± 3% +28.6% 5051 ± 4% interrupts.CPU31.RES:Rescheduling_interrupts 69085 ± 4% +13.4% 78358 ± 4% interrupts.CPU32.LOC:Local_timer_interrupts 3168 ± 5% +179.5% 8857 ± 2% interrupts.CPU32.NMI:Non-maskable_interrupts 3168 ± 5% +179.5% 8857 ± 2% interrupts.CPU32.PMI:Performance_monitoring_interrupts 3716 ± 2% +30.3% 4842 ± 3% interrupts.CPU32.RES:Rescheduling_interrupts 69197 ± 4% +16.2% 80403 ± 9% interrupts.CPU33.LOC:Local_timer_interrupts 3203 ± 4% +168.6% 8604 ± 13% interrupts.CPU33.NMI:Non-maskable_interrupts 3203 ± 4% +168.6% 8604 ± 13% interrupts.CPU33.PMI:Performance_monitoring_interrupts 69200 ± 4% +10.4% 76370 ± 5% interrupts.CPU34.LOC:Local_timer_interrupts 3040 ± 7% +172.4% 8284 ± 13% interrupts.CPU34.NMI:Non-maskable_interrupts 3040 ± 7% +172.4% 8284 ± 13% interrupts.CPU34.PMI:Performance_monitoring_interrupts 69199 ± 4% +10.3% 76325 ± 5% interrupts.CPU35.LOC:Local_timer_interrupts 3178 ± 6% +164.6% 8412 ± 13% interrupts.CPU35.NMI:Non-maskable_interrupts 3178 ± 6% +164.6% 8412 ± 13% interrupts.CPU35.PMI:Performance_monitoring_interrupts 3734 ± 4% +35.5% 5061 ± 4% interrupts.CPU35.RES:Rescheduling_interrupts 69134 ± 4% +10.6% 76432 ± 5% interrupts.CPU36.LOC:Local_timer_interrupts 3158 ± 4% +150.1% 7899 ± 16% interrupts.CPU36.NMI:Non-maskable_interrupts 3158 ± 4% +150.1% 7899 ± 16% interrupts.CPU36.PMI:Performance_monitoring_interrupts 3756 ± 2% +39.7% 5246 ± 17% interrupts.CPU36.RES:Rescheduling_interrupts 69178 ± 4% +10.4% 76358 ± 5% interrupts.CPU37.LOC:Local_timer_interrupts 3283 ± 5% +140.3% 7890 ± 17% interrupts.CPU37.NMI:Non-maskable_interrupts 3283 ± 5% +140.3% 7890 ± 17% interrupts.CPU37.PMI:Performance_monitoring_interrupts 3821 ± 2% +35.9% 5193 ± 14% interrupts.CPU37.RES:Rescheduling_interrupts 69203 ± 4% +10.4% 76417 ± 5% interrupts.CPU38.LOC:Local_timer_interrupts 3236 +158.5% 8364 ± 14% interrupts.CPU38.NMI:Non-maskable_interrupts 3236 +158.5% 8364 ± 14% interrupts.CPU38.PMI:Performance_monitoring_interrupts 3738 ± 2% +44.5% 5399 ± 23% interrupts.CPU38.RES:Rescheduling_interrupts 69188 ± 4% +10.3% 76336 ± 5% interrupts.CPU39.LOC:Local_timer_interrupts 3199 ± 4% +163.6% 8435 ± 14% interrupts.CPU39.NMI:Non-maskable_interrupts 3199 ± 4% +163.6% 8435 ± 14% interrupts.CPU39.PMI:Performance_monitoring_interrupts 3833 ± 4% +32.8% 5089 ± 12% interrupts.CPU39.RES:Rescheduling_interrupts 69206 ± 4% +10.3% 76337 ± 5% interrupts.CPU4.LOC:Local_timer_interrupts 2414 ± 20% +265.6% 8827 ± 3% interrupts.CPU4.NMI:Non-maskable_interrupts 2414 ± 20% +265.6% 8827 ± 3% interrupts.CPU4.PMI:Performance_monitoring_interrupts 3840 ± 5% +32.0% 5070 ± 4% interrupts.CPU4.RES:Rescheduling_interrupts 69200 ± 4% +10.3% 76322 ± 5% interrupts.CPU40.LOC:Local_timer_interrupts 3043 ± 6% +174.3% 8347 ± 14% interrupts.CPU40.NMI:Non-maskable_interrupts 3043 ± 6% +174.3% 8347 ± 14% interrupts.CPU40.PMI:Performance_monitoring_interrupts 3677 ± 2% +30.5% 4797 ± 4% interrupts.CPU40.RES:Rescheduling_interrupts 69121 ± 4% +10.3% 76258 ± 5% interrupts.CPU41.LOC:Local_timer_interrupts 3114 ± 3% +170.6% 8426 ± 14% interrupts.CPU41.NMI:Non-maskable_interrupts 3114 ± 3% +170.6% 8426 ± 14% interrupts.CPU41.PMI:Performance_monitoring_interrupts 3839 ± 5% +41.4% 5429 ± 19% interrupts.CPU41.RES:Rescheduling_interrupts 69137 ± 4% +10.4% 76323 ± 5% interrupts.CPU42.LOC:Local_timer_interrupts 3076 ± 3% +176.5% 8506 ± 14% interrupts.CPU42.NMI:Non-maskable_interrupts 3076 ± 3% +176.5% 8506 ± 14% interrupts.CPU42.PMI:Performance_monitoring_interrupts 3732 ± 3% +43.4% 5354 ± 15% interrupts.CPU42.RES:Rescheduling_interrupts 69187 ± 4% +10.3% 76324 ± 5% interrupts.CPU43.LOC:Local_timer_interrupts 3096 +174.2% 8491 ± 14% interrupts.CPU43.NMI:Non-maskable_interrupts 3096 +174.2% 8491 ± 14% interrupts.CPU43.PMI:Performance_monitoring_interrupts 3706 ± 2% +36.6% 5062 ± 6% interrupts.CPU43.RES:Rescheduling_interrupts 69159 ± 4% +10.4% 76318 ± 5% interrupts.CPU44.LOC:Local_timer_interrupts 3143 ± 3% +168.1% 8428 ± 13% interrupts.CPU44.NMI:Non-maskable_interrupts 3143 ± 3% +168.1% 8428 ± 13% interrupts.CPU44.PMI:Performance_monitoring_interrupts 3735 ± 3% +32.7% 4955 ± 7% interrupts.CPU44.RES:Rescheduling_interrupts 69158 ± 4% +10.3% 76315 ± 5% interrupts.CPU45.LOC:Local_timer_interrupts 3143 ± 5% +168.1% 8428 ± 14% interrupts.CPU45.NMI:Non-maskable_interrupts 3143 ± 5% +168.1% 8428 ± 14% interrupts.CPU45.PMI:Performance_monitoring_interrupts 3787 ± 2% +28.7% 4874 ± 3% interrupts.CPU45.RES:Rescheduling_interrupts 69190 ± 4% +10.4% 76360 ± 5% interrupts.CPU46.LOC:Local_timer_interrupts 3117 ± 6% +170.6% 8434 ± 12% interrupts.CPU46.NMI:Non-maskable_interrupts 3117 ± 6% +170.6% 8434 ± 12% interrupts.CPU46.PMI:Performance_monitoring_interrupts 3703 ± 3% +31.7% 4877 ± 3% interrupts.CPU46.RES:Rescheduling_interrupts 69211 ± 4% +10.2% 76296 ± 5% interrupts.CPU47.LOC:Local_timer_interrupts 3199 ± 5% +146.0% 7870 ± 18% interrupts.CPU47.NMI:Non-maskable_interrupts 3199 ± 5% +146.0% 7870 ± 18% interrupts.CPU47.PMI:Performance_monitoring_interrupts 3729 ± 4% +37.6% 5132 ± 12% interrupts.CPU47.RES:Rescheduling_interrupts 69200 ± 4% +10.3% 76348 ± 5% interrupts.CPU48.LOC:Local_timer_interrupts 3042 ± 13% +164.9% 8059 ± 19% interrupts.CPU48.NMI:Non-maskable_interrupts 3042 ± 13% +164.9% 8059 ± 19% interrupts.CPU48.PMI:Performance_monitoring_interrupts 3766 ± 3% +25.0% 4707 ± 6% interrupts.CPU48.RES:Rescheduling_interrupts 69276 ± 4% +10.0% 76189 ± 5% interrupts.CPU49.LOC:Local_timer_interrupts 2896 ± 14% +174.2% 7943 ± 17% interrupts.CPU49.NMI:Non-maskable_interrupts 2896 ± 14% +174.2% 7943 ± 17% interrupts.CPU49.PMI:Performance_monitoring_interrupts 69230 ± 4% +10.3% 76344 ± 5% interrupts.CPU5.LOC:Local_timer_interrupts 2616 ± 20% +241.4% 8930 ± 2% interrupts.CPU5.NMI:Non-maskable_interrupts 2616 ± 20% +241.4% 8930 ± 2% interrupts.CPU5.PMI:Performance_monitoring_interrupts 3921 ± 3% +33.1% 5217 ± 5% interrupts.CPU5.RES:Rescheduling_interrupts 69230 ± 4% +10.2% 76322 ± 5% interrupts.CPU50.LOC:Local_timer_interrupts 2956 ± 13% +166.5% 7877 ± 17% interrupts.CPU50.NMI:Non-maskable_interrupts 2956 ± 13% +166.5% 7877 ± 17% interrupts.CPU50.PMI:Performance_monitoring_interrupts 3642 ± 4% +41.3% 5146 ± 7% interrupts.CPU50.RES:Rescheduling_interrupts 69198 ± 4% +10.3% 76333 ± 5% interrupts.CPU51.LOC:Local_timer_interrupts 2937 ± 15% +184.7% 8362 ± 14% interrupts.CPU51.NMI:Non-maskable_interrupts 2937 ± 15% +184.7% 8362 ± 14% interrupts.CPU51.PMI:Performance_monitoring_interrupts 3815 ± 5% +29.1% 4925 ± 9% interrupts.CPU51.RES:Rescheduling_interrupts 69208 ± 4% +10.3% 76360 ± 5% interrupts.CPU52.LOC:Local_timer_interrupts 3197 ± 4% +162.3% 8386 ± 13% interrupts.CPU52.NMI:Non-maskable_interrupts 3197 ± 4% +162.3% 8386 ± 13% interrupts.CPU52.PMI:Performance_monitoring_interrupts 3709 ± 3% +75.1% 6493 ± 44% interrupts.CPU52.RES:Rescheduling_interrupts 69199 ± 4% +10.3% 76338 ± 5% interrupts.CPU53.LOC:Local_timer_interrupts 3116 ± 5% +153.8% 7907 ± 17% interrupts.CPU53.NMI:Non-maskable_interrupts 3116 ± 5% +153.8% 7907 ± 17% interrupts.CPU53.PMI:Performance_monitoring_interrupts 3720 ± 3% +47.7% 5496 ± 26% interrupts.CPU53.RES:Rescheduling_interrupts 69214 ± 4% +10.2% 76277 ± 5% interrupts.CPU54.LOC:Local_timer_interrupts 3000 ± 14% +170.5% 8114 ± 20% interrupts.CPU54.NMI:Non-maskable_interrupts 3000 ± 14% +170.5% 8114 ± 20% interrupts.CPU54.PMI:Performance_monitoring_interrupts 3744 ± 2% +37.1% 5132 ± 15% interrupts.CPU54.RES:Rescheduling_interrupts 69292 ± 4% +10.2% 76333 ± 5% interrupts.CPU55.LOC:Local_timer_interrupts 2871 ± 13% +177.5% 7968 ± 19% interrupts.CPU55.NMI:Non-maskable_interrupts 2871 ± 13% +177.5% 7968 ± 19% interrupts.CPU55.PMI:Performance_monitoring_interrupts 3644 ± 2% +29.5% 4721 ± 6% interrupts.CPU55.RES:Rescheduling_interrupts 69191 ± 4% +10.3% 76323 ± 5% interrupts.CPU56.LOC:Local_timer_interrupts 2988 ± 12% +189.7% 8658 ± 15% interrupts.CPU56.NMI:Non-maskable_interrupts 2988 ± 12% +189.7% 8658 ± 15% interrupts.CPU56.PMI:Performance_monitoring_interrupts 3755 ± 3% +28.8% 4837 ± 9% interrupts.CPU56.RES:Rescheduling_interrupts 69179 ± 4% +10.3% 76322 ± 5% interrupts.CPU57.LOC:Local_timer_interrupts 2852 ± 14% +195.9% 8439 ± 14% interrupts.CPU57.NMI:Non-maskable_interrupts 2852 ± 14% +195.9% 8439 ± 14% interrupts.CPU57.PMI:Performance_monitoring_interrupts 3663 ± 2% +36.2% 4990 ± 8% interrupts.CPU57.RES:Rescheduling_interrupts 69255 ± 4% +10.1% 76241 ± 5% interrupts.CPU58.LOC:Local_timer_interrupts 2743 ± 18% +225.7% 8937 ± 2% interrupts.CPU58.NMI:Non-maskable_interrupts 2743 ± 18% +225.7% 8937 ± 2% interrupts.CPU58.PMI:Performance_monitoring_interrupts 3733 ± 4% +62.0% 6049 ± 33% interrupts.CPU58.RES:Rescheduling_interrupts 3148 ± 4% +182.9% 8906 ± 2% interrupts.CPU59.NMI:Non-maskable_interrupts 3148 ± 4% +182.9% 8906 ± 2% interrupts.CPU59.PMI:Performance_monitoring_interrupts 3668 ± 4% +33.3% 4888 ± 2% interrupts.CPU59.RES:Rescheduling_interrupts 69082 ± 4% +10.4% 76278 ± 5% interrupts.CPU6.LOC:Local_timer_interrupts 2672 ± 23% +213.2% 8370 ± 14% interrupts.CPU6.NMI:Non-maskable_interrupts 2672 ± 23% +213.2% 8370 ± 14% interrupts.CPU6.PMI:Performance_monitoring_interrupts 3979 ± 3% +28.1% 5098 ± 8% interrupts.CPU6.RES:Rescheduling_interrupts 2895 ± 13% +206.0% 8861 ± 2% interrupts.CPU60.NMI:Non-maskable_interrupts 2895 ± 13% +206.0% 8861 ± 2% interrupts.CPU60.PMI:Performance_monitoring_interrupts 3771 ± 3% +37.4% 5181 ± 12% interrupts.CPU60.RES:Rescheduling_interrupts 69115 ± 4% +10.4% 76320 ± 5% interrupts.CPU61.LOC:Local_timer_interrupts 2954 ± 13% +202.9% 8947 ± 2% interrupts.CPU61.NMI:Non-maskable_interrupts 2954 ± 13% +202.9% 8947 ± 2% interrupts.CPU61.PMI:Performance_monitoring_interrupts 3820 ± 4% +46.2% 5587 ± 19% interrupts.CPU61.RES:Rescheduling_interrupts 69194 ± 4% +10.4% 76357 ± 5% interrupts.CPU62.LOC:Local_timer_interrupts 2902 ± 13% +208.3% 8947 ± 2% interrupts.CPU62.NMI:Non-maskable_interrupts 2902 ± 13% +208.3% 8947 ± 2% interrupts.CPU62.PMI:Performance_monitoring_interrupts 3768 ± 3% +52.4% 5744 ± 27% interrupts.CPU62.RES:Rescheduling_interrupts 69217 ± 4% +10.4% 76402 ± 5% interrupts.CPU63.LOC:Local_timer_interrupts 3153 ± 3% +180.7% 8850 ± 2% interrupts.CPU63.NMI:Non-maskable_interrupts 3153 ± 3% +180.7% 8850 ± 2% interrupts.CPU63.PMI:Performance_monitoring_interrupts 3587 ± 3% +40.1% 5025 ± 14% interrupts.CPU63.RES:Rescheduling_interrupts 69224 ± 4% +10.0% 76175 ± 5% interrupts.CPU64.LOC:Local_timer_interrupts 3163 ± 4% +179.2% 8832 ± 2% interrupts.CPU64.NMI:Non-maskable_interrupts 3163 ± 4% +179.2% 8832 ± 2% interrupts.CPU64.PMI:Performance_monitoring_interrupts 3887 ± 4% +28.6% 4999 ± 7% interrupts.CPU64.RES:Rescheduling_interrupts 69338 ± 4% +10.0% 76260 ± 5% interrupts.CPU65.LOC:Local_timer_interrupts 3079 ± 16% +198.0% 9177 ± 6% interrupts.CPU65.NMI:Non-maskable_interrupts 3079 ± 16% +198.0% 9177 ± 6% interrupts.CPU65.PMI:Performance_monitoring_interrupts 69257 ± 4% +10.1% 76249 ± 5% interrupts.CPU66.LOC:Local_timer_interrupts 3190 ± 6% +175.6% 8793 ± 2% interrupts.CPU66.NMI:Non-maskable_interrupts 3190 ± 6% +175.6% 8793 ± 2% interrupts.CPU66.PMI:Performance_monitoring_interrupts 69230 ± 4% +10.0% 76171 ± 5% interrupts.CPU67.LOC:Local_timer_interrupts 3188 ± 2% +180.7% 8948 ± 2% interrupts.CPU67.NMI:Non-maskable_interrupts 3188 ± 2% +180.7% 8948 ± 2% interrupts.CPU67.PMI:Performance_monitoring_interrupts 3893 ± 3% +29.3% 5034 ± 5% interrupts.CPU67.RES:Rescheduling_interrupts 3214 ± 4% +180.4% 9013 ± 4% interrupts.CPU68.NMI:Non-maskable_interrupts 3214 ± 4% +180.4% 9013 ± 4% interrupts.CPU68.PMI:Performance_monitoring_interrupts 69205 ± 4% +10.2% 76291 ± 5% interrupts.CPU69.LOC:Local_timer_interrupts 3130 ± 7% +182.3% 8839 ± 2% interrupts.CPU69.NMI:Non-maskable_interrupts 3130 ± 7% +182.3% 8839 ± 2% interrupts.CPU69.PMI:Performance_monitoring_interrupts 69222 ± 4% +10.2% 76297 ± 5% interrupts.CPU7.LOC:Local_timer_interrupts 2409 ± 17% +273.0% 8985 ± 6% interrupts.CPU7.NMI:Non-maskable_interrupts 2409 ± 17% +273.0% 8985 ± 6% interrupts.CPU7.PMI:Performance_monitoring_interrupts 4024 ± 2% +27.4% 5127 ± 9% interrupts.CPU7.RES:Rescheduling_interrupts 69183 ± 4% +10.2% 76229 ± 5% interrupts.CPU70.LOC:Local_timer_interrupts 2890 ± 16% +204.9% 8813 ± 2% interrupts.CPU70.NMI:Non-maskable_interrupts 2890 ± 16% +204.9% 8813 ± 2% interrupts.CPU70.PMI:Performance_monitoring_interrupts 69209 ± 4% +13.1% 78247 ± 10% interrupts.CPU71.LOC:Local_timer_interrupts 3185 ± 4% +178.3% 8864 ± 2% interrupts.CPU71.NMI:Non-maskable_interrupts 3185 ± 4% +178.3% 8864 ± 2% interrupts.CPU71.PMI:Performance_monitoring_interrupts 69160 ± 4% +11.2% 76913 ± 6% interrupts.CPU72.LOC:Local_timer_interrupts 3152 ± 3% +166.1% 8388 ± 13% interrupts.CPU72.NMI:Non-maskable_interrupts 3152 ± 3% +166.1% 8388 ± 13% interrupts.CPU72.PMI:Performance_monitoring_interrupts 3992 ± 5% +30.3% 5202 ± 7% interrupts.CPU72.RES:Rescheduling_interrupts 69247 ± 4% +10.1% 76212 ± 5% interrupts.CPU73.LOC:Local_timer_interrupts 3207 ± 4% +144.2% 7832 ± 18% interrupts.CPU73.NMI:Non-maskable_interrupts 3207 ± 4% +144.2% 7832 ± 18% interrupts.CPU73.PMI:Performance_monitoring_interrupts 4079 ± 5% +26.0% 5137 ± 5% interrupts.CPU73.RES:Rescheduling_interrupts 3109 ± 6% +184.4% 8841 ± 2% interrupts.CPU74.NMI:Non-maskable_interrupts 3109 ± 6% +184.4% 8841 ± 2% interrupts.CPU74.PMI:Performance_monitoring_interrupts 4033 ± 5% +23.2% 4969 ± 5% interrupts.CPU74.RES:Rescheduling_interrupts 69076 ± 3% +10.5% 76347 ± 5% interrupts.CPU75.LOC:Local_timer_interrupts 2944 ± 15% +198.1% 8779 ± 3% interrupts.CPU75.NMI:Non-maskable_interrupts 2944 ± 15% +198.1% 8779 ± 3% interrupts.CPU75.PMI:Performance_monitoring_interrupts 4062 ± 7% +25.4% 5092 ± 7% interrupts.CPU75.RES:Rescheduling_interrupts 69221 ± 4% +10.2% 76316 ± 5% interrupts.CPU76.LOC:Local_timer_interrupts 2969 ± 13% +197.4% 8830 ± 2% interrupts.CPU76.NMI:Non-maskable_interrupts 2969 ± 13% +197.4% 8830 ± 2% interrupts.CPU76.PMI:Performance_monitoring_interrupts 4013 ± 5% +27.9% 5134 ± 6% interrupts.CPU76.RES:Rescheduling_interrupts 69185 ± 4% +10.3% 76324 ± 5% interrupts.CPU77.LOC:Local_timer_interrupts 2899 ± 13% +212.6% 9063 ± 4% interrupts.CPU77.NMI:Non-maskable_interrupts 2899 ± 13% +212.6% 9063 ± 4% interrupts.CPU77.PMI:Performance_monitoring_interrupts 3882 ± 3% +24.5% 4832 ± 7% interrupts.CPU77.RES:Rescheduling_interrupts 69385 ± 4% +9.8% 76212 ± 5% interrupts.CPU78.LOC:Local_timer_interrupts 2582 ± 19% +241.4% 8816 ± 2% interrupts.CPU78.NMI:Non-maskable_interrupts 2582 ± 19% +241.4% 8816 ± 2% interrupts.CPU78.PMI:Performance_monitoring_interrupts 3987 ± 4% +27.4% 5080 ± 2% interrupts.CPU78.RES:Rescheduling_interrupts 69234 ± 4% +10.2% 76277 ± 5% interrupts.CPU79.LOC:Local_timer_interrupts 2702 ± 16% +225.1% 8784 ± 2% interrupts.CPU79.NMI:Non-maskable_interrupts 2702 ± 16% +225.1% 8784 ± 2% interrupts.CPU79.PMI:Performance_monitoring_interrupts 69199 ± 4% +10.2% 76241 ± 5% interrupts.CPU8.LOC:Local_timer_interrupts 2766 ± 20% +205.9% 8460 ± 14% interrupts.CPU8.NMI:Non-maskable_interrupts 2766 ± 20% +205.9% 8460 ± 14% interrupts.CPU8.PMI:Performance_monitoring_interrupts 4080 ± 3% +27.8% 5215 ± 9% interrupts.CPU8.RES:Rescheduling_interrupts 69236 ± 4% +10.2% 76318 ± 5% interrupts.CPU80.LOC:Local_timer_interrupts 2822 ± 17% +211.0% 8775 ± 3% interrupts.CPU80.NMI:Non-maskable_interrupts 2822 ± 17% +211.0% 8775 ± 3% interrupts.CPU80.PMI:Performance_monitoring_interrupts 4121 ± 12% +35.5% 5584 ± 15% interrupts.CPU80.RES:Rescheduling_interrupts 68967 ± 4% +12.4% 77537 ± 7% interrupts.CPU81.LOC:Local_timer_interrupts 2792 ± 14% +202.6% 8450 ± 11% interrupts.CPU81.NMI:Non-maskable_interrupts 2792 ± 14% +202.6% 8450 ± 11% interrupts.CPU81.PMI:Performance_monitoring_interrupts 4064 ± 3% +26.1% 5124 ± 9% interrupts.CPU81.RES:Rescheduling_interrupts 69179 ± 4% +15.9% 80160 ± 12% interrupts.CPU82.LOC:Local_timer_interrupts 3051 ± 11% +189.3% 8829 ± 2% interrupts.CPU82.NMI:Non-maskable_interrupts 3051 ± 11% +189.3% 8829 ± 2% interrupts.CPU82.PMI:Performance_monitoring_interrupts 3997 +26.8% 5069 ± 4% interrupts.CPU82.RES:Rescheduling_interrupts 3012 ± 14% +193.1% 8831 ± 2% interrupts.CPU83.NMI:Non-maskable_interrupts 3012 ± 14% +193.1% 8831 ± 2% interrupts.CPU83.PMI:Performance_monitoring_interrupts 4121 ± 3% +26.1% 5194 ± 4% interrupts.CPU83.RES:Rescheduling_interrupts 69218 ± 4% +10.1% 76239 ± 5% interrupts.CPU84.LOC:Local_timer_interrupts 2941 ± 12% +203.1% 8914 ± 3% interrupts.CPU84.NMI:Non-maskable_interrupts 2941 ± 12% +203.1% 8914 ± 3% interrupts.CPU84.PMI:Performance_monitoring_interrupts 3943 ± 2% +23.6% 4873 ± 7% interrupts.CPU84.RES:Rescheduling_interrupts 69214 ± 4% +10.2% 76243 ± 5% interrupts.CPU85.LOC:Local_timer_interrupts 3078 ± 13% +186.4% 8816 ± 2% interrupts.CPU85.NMI:Non-maskable_interrupts 3078 ± 13% +186.4% 8816 ± 2% interrupts.CPU85.PMI:Performance_monitoring_interrupts 69185 ± 4% +10.3% 76304 ± 5% interrupts.CPU86.LOC:Local_timer_interrupts 2952 ± 12% +204.3% 8982 ± 2% interrupts.CPU86.NMI:Non-maskable_interrupts 2952 ± 12% +204.3% 8982 ± 2% interrupts.CPU86.PMI:Performance_monitoring_interrupts 3977 ± 6% +24.7% 4959 ± 6% interrupts.CPU86.RES:Rescheduling_interrupts 69220 ± 4% +10.2% 76282 ± 5% interrupts.CPU87.LOC:Local_timer_interrupts 2967 ± 13% +200.0% 8901 ± 4% interrupts.CPU87.NMI:Non-maskable_interrupts 2967 ± 13% +200.0% 8901 ± 4% interrupts.CPU87.PMI:Performance_monitoring_interrupts 69223 ± 4% +10.2% 76267 ± 5% interrupts.CPU88.LOC:Local_timer_interrupts 3071 ± 14% +194.1% 9034 ± 5% interrupts.CPU88.NMI:Non-maskable_interrupts 3071 ± 14% +194.1% 9034 ± 5% interrupts.CPU88.PMI:Performance_monitoring_interrupts 4163 ± 3% +29.5% 5390 ± 21% interrupts.CPU88.RES:Rescheduling_interrupts 69167 ± 4% +10.3% 76296 ± 5% interrupts.CPU89.LOC:Local_timer_interrupts 2982 ± 16% +196.1% 8830 ± 2% interrupts.CPU89.NMI:Non-maskable_interrupts 2982 ± 16% +196.1% 8830 ± 2% interrupts.CPU89.PMI:Performance_monitoring_interrupts 3950 ± 4% +42.1% 5615 ± 22% interrupts.CPU89.RES:Rescheduling_interrupts 69226 ± 4% +10.4% 76392 ± 5% interrupts.CPU9.LOC:Local_timer_interrupts 2454 ± 18% +241.2% 8375 ± 14% interrupts.CPU9.NMI:Non-maskable_interrupts 2454 ± 18% +241.2% 8375 ± 14% interrupts.CPU9.PMI:Performance_monitoring_interrupts 69249 ± 4% +10.2% 76298 ± 5% interrupts.CPU90.LOC:Local_timer_interrupts 2994 ± 14% +179.3% 8365 ± 14% interrupts.CPU90.NMI:Non-maskable_interrupts 2994 ± 14% +179.3% 8365 ± 14% interrupts.CPU90.PMI:Performance_monitoring_interrupts 69232 ± 4% +10.2% 76290 ± 5% interrupts.CPU91.LOC:Local_timer_interrupts 3208 ± 4% +144.0% 7828 ± 19% interrupts.CPU91.NMI:Non-maskable_interrupts 3208 ± 4% +144.0% 7828 ± 19% interrupts.CPU91.PMI:Performance_monitoring_interrupts 4193 ± 4% +20.1% 5036 ± 5% interrupts.CPU91.RES:Rescheduling_interrupts 69249 ± 4% +10.2% 76303 ± 5% interrupts.CPU92.LOC:Local_timer_interrupts 2940 ± 16% +169.6% 7926 ± 19% interrupts.CPU92.NMI:Non-maskable_interrupts 2940 ± 16% +169.6% 7926 ± 19% interrupts.CPU92.PMI:Performance_monitoring_interrupts 2931 ± 12% +184.1% 8328 ± 14% interrupts.CPU93.NMI:Non-maskable_interrupts 2931 ± 12% +184.1% 8328 ± 14% interrupts.CPU93.PMI:Performance_monitoring_interrupts 69239 ± 4% +10.1% 76234 ± 5% interrupts.CPU94.LOC:Local_timer_interrupts 2921 ± 12% +170.7% 7909 ± 18% interrupts.CPU94.NMI:Non-maskable_interrupts 2921 ± 12% +170.7% 7909 ± 18% interrupts.CPU94.PMI:Performance_monitoring_interrupts 4004 ± 2% +26.8% 5076 ± 3% interrupts.CPU94.RES:Rescheduling_interrupts 69230 ± 4% +10.2% 76268 ± 5% interrupts.CPU95.LOC:Local_timer_interrupts 3113 ± 13% +154.8% 7933 ± 19% interrupts.CPU95.NMI:Non-maskable_interrupts 3113 ± 13% +154.8% 7933 ± 19% interrupts.CPU95.PMI:Performance_monitoring_interrupts 69187 ± 4% +10.4% 76350 ± 5% interrupts.CPU96.LOC:Local_timer_interrupts 2935 ± 11% +172.5% 7998 ± 19% interrupts.CPU96.NMI:Non-maskable_interrupts 2935 ± 11% +172.5% 7998 ± 19% interrupts.CPU96.PMI:Performance_monitoring_interrupts 3690 ± 3% +55.7% 5746 ± 34% interrupts.CPU96.RES:Rescheduling_interrupts 69202 ± 4% +10.4% 76412 ± 5% interrupts.CPU97.LOC:Local_timer_interrupts 2936 ± 12% +171.5% 7973 ± 20% interrupts.CPU97.NMI:Non-maskable_interrupts 2936 ± 12% +171.5% 7973 ± 20% interrupts.CPU97.PMI:Performance_monitoring_interrupts 3706 ± 3% +42.0% 5261 ± 16% interrupts.CPU97.RES:Rescheduling_interrupts 69188 ± 4% +10.3% 76311 ± 5% interrupts.CPU98.LOC:Local_timer_interrupts 3015 ± 13% +166.5% 8036 ± 20% interrupts.CPU98.NMI:Non-maskable_interrupts 3015 ± 13% +166.5% 8036 ± 20% interrupts.CPU98.PMI:Performance_monitoring_interrupts 3749 ± 2% +29.5% 4855 ± 7% interrupts.CPU98.RES:Rescheduling_interrupts 69189 ± 4% +10.4% 76359 ± 5% interrupts.CPU99.LOC:Local_timer_interrupts 2997 ± 12% +164.2% 7917 ± 19% interrupts.CPU99.NMI:Non-maskable_interrupts 2997 ± 12% +164.2% 7917 ± 19% interrupts.CPU99.PMI:Performance_monitoring_interrupts 3768 ± 2% +30.6% 4922 ± 15% interrupts.CPU99.RES:Rescheduling_interrupts 28.67 ± 25% +1177.3% 366.17 ± 5% interrupts.IWI:IRQ_work_interrupts 8876658 ± 4% +10.2% 9785657 ± 5% interrupts.LOC:Local_timer_interrupts 365958 ± 2% +194.6% 1077929 ± 6% interrupts.NMI:Non-maskable_interrupts 365958 ± 2% +194.6% 1077929 ± 6% interrupts.PMI:Performance_monitoring_interrupts 503767 +29.9% 654211 interrupts.RES:Rescheduling_interrupts 45.34 -14.5 30.83 perf-profile.calltrace.cycles-pp.write 42.83 -12.5 30.29 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write 42.41 -12.2 30.16 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 41.60 -11.7 29.90 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 40.59 -11.0 29.60 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 38.14 -9.3 28.82 perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 37.09 -8.6 28.48 perf-profile.calltrace.cycles-pp.xfs_file_buffered_write.new_sync_write.vfs_write.ksys_write.do_syscall_64 5.36 ± 2% -5.4 0.00 perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.acpi_idle_do_entry.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter 32.10 -5.2 26.88 perf-profile.calltrace.cycles-pp.iomap_file_buffered_write.xfs_file_buffered_write.new_sync_write.vfs_write.ksys_write 31.80 -5.0 26.79 perf-profile.calltrace.cycles-pp.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_write.new_sync_write.vfs_write 6.23 -4.1 2.13 ± 2% perf-profile.calltrace.cycles-pp.copy_page_to_iter.filemap_read.xfs_file_buffered_read.xfs_file_read_iter.new_sync_read 5.31 -3.9 1.37 ± 2% perf-profile.calltrace.cycles-pp.llseek 4.68 ± 2% -3.9 0.77 ± 7% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify 4.64 ± 2% -3.9 0.76 ± 7% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 4.64 ± 2% -3.9 0.76 ± 7% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify 4.64 ± 2% -3.9 0.76 ± 7% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 6.16 -3.9 2.31 ± 2% perf-profile.calltrace.cycles-pp.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_write 4.18 ± 2% -3.5 0.66 ± 8% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 4.17 ± 2% -3.5 0.65 ± 7% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 4.04 ± 2% -3.4 0.63 ± 8% perf-profile.calltrace.cycles-pp.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 4.98 -3.3 1.72 ± 2% perf-profile.calltrace.cycles-pp.copyout.copy_page_to_iter.filemap_read.xfs_file_buffered_read.xfs_file_read_iter 4.79 -3.1 1.66 ± 2% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout.copy_page_to_iter.filemap_read.xfs_file_buffered_read 4.00 -2.8 1.23 ± 3% perf-profile.calltrace.cycles-pp.xfs_buffered_write_iomap_begin.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_write.new_sync_write 3.83 -2.6 1.24 ± 2% perf-profile.calltrace.cycles-pp.filemap_get_pages.filemap_read.xfs_file_buffered_read.xfs_file_read_iter.new_sync_read 3.38 -2.4 0.97 ± 2% perf-profile.calltrace.cycles-pp.iomap_set_range_uptodate.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write 3.38 -2.3 1.09 ± 2% perf-profile.calltrace.cycles-pp.filemap_get_read_batch.filemap_get_pages.filemap_read.xfs_file_buffered_read.xfs_file_read_iter 3.24 ± 2% -2.1 1.14 ± 3% perf-profile.calltrace.cycles-pp.unlink 3.20 ± 2% -2.1 1.13 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink 3.20 ± 2% -2.1 1.13 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.unlink 3.18 ± 2% -2.1 1.12 ± 3% perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink 2.96 -1.9 1.07 ± 2% perf-profile.calltrace.cycles-pp.creat64 2.94 -1.9 1.06 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.creat64 2.94 -1.9 1.06 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat64 2.92 -1.9 1.06 ± 2% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat64 2.92 -1.9 1.06 ± 2% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat64 2.88 -1.8 1.04 ± 2% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.88 -1.8 1.04 ± 2% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64 2.73 -1.8 0.91 ± 2% perf-profile.calltrace.cycles-pp.xfs_file_write_checks.xfs_file_buffered_write.new_sync_write.vfs_write.ksys_write 2.67 -1.8 0.85 ± 2% perf-profile.calltrace.cycles-pp.iomap_set_range_uptodate.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write 2.40 -1.7 0.70 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.llseek 2.26 -1.5 0.74 ± 3% perf-profile.calltrace.cycles-pp.copy_page_from_iter_atomic.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_write 2.08 -1.5 0.60 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.llseek 1.93 -1.4 0.56 ± 3% perf-profile.calltrace.cycles-pp.touch_atime.filemap_read.xfs_file_buffered_read.xfs_file_read_iter.new_sync_read 2.11 ± 2% -1.4 0.75 ± 4% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink 2.48 -1.4 1.13 ± 3% perf-profile.calltrace.cycles-pp.__set_page_dirty_nobuffers.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write 2.20 ± 2% -1.2 1.02 ± 2% perf-profile.calltrace.cycles-pp.workingset_activation.mark_page_accessed.filemap_read.xfs_file_buffered_read.xfs_file_read_iter 1.61 -1.2 0.43 ± 44% perf-profile.calltrace.cycles-pp.copyin.copy_page_from_iter_atomic.iomap_write_actor.iomap_apply.iomap_file_buffered_write 2.37 -1.1 1.27 ± 2% perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin 1.74 ± 3% -1.0 0.79 ± 3% perf-profile.calltrace.cycles-pp.workingset_age_nonresident.workingset_activation.mark_page_accessed.filemap_read.xfs_file_buffered_read 1.22 -1.0 0.26 ±100% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2.do_sys_open 25.71 -0.9 24.86 perf-profile.calltrace.cycles-pp.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_write.new_sync_write 1.40 -0.7 0.73 ± 2% perf-profile.calltrace.cycles-pp.__set_page_dirty.__set_page_dirty_nobuffers.iomap_write_end.iomap_write_actor.iomap_apply 1.07 -0.5 0.54 ± 2% perf-profile.calltrace.cycles-pp.truncate_cleanup_page.truncate_inode_pages_range.evict.__dentry_kill.dput 1.05 -0.4 0.64 ± 3% perf-profile.calltrace.cycles-pp.__activate_page.pagevec_lru_move_fn.mark_page_accessed.filemap_read.xfs_file_buffered_read 0.72 -0.3 0.44 ± 44% perf-profile.calltrace.cycles-pp.__mem_cgroup_charge.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin 0.00 +0.7 0.70 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_add_drain_cpu.lru_add_drain 0.00 +0.7 0.70 ± 2% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_add_drain_cpu 0.00 +0.7 0.70 ± 2% perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_add_drain_cpu.lru_add_drain.__pagevec_release 0.00 +0.7 0.71 perf-profile.calltrace.cycles-pp.__pagevec_lru_add.lru_add_drain_cpu.lru_add_drain.__pagevec_release.truncate_inode_pages_range 0.00 +0.8 0.78 ± 7% perf-profile.calltrace.cycles-pp.mem_cgroup_css_rstat_flush.cgroup_rstat_flush_locked.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work 0.00 +1.1 1.10 ± 7% perf-profile.calltrace.cycles-pp.cgroup_rstat_flush_locked.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work.worker_thread 0.00 +1.1 1.10 ± 7% perf-profile.calltrace.cycles-pp.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work.worker_thread.kthread 0.00 +1.1 1.11 ± 7% perf-profile.calltrace.cycles-pp.mem_cgroup_flush_stats.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +1.1 1.12 ± 7% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +1.1 1.13 ± 7% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork 0.00 +1.1 1.14 ± 7% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 0.00 +1.1 1.15 ± 7% perf-profile.calltrace.cycles-pp.ret_from_fork 0.00 +1.3 1.34 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.pagevec_lru_move_fn.lru_add_drain_cpu.lru_add_drain 0.00 +1.3 1.34 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.pagevec_lru_move_fn.lru_add_drain_cpu 0.00 +1.3 1.34 perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.pagevec_lru_move_fn.lru_add_drain_cpu.lru_add_drain.__pagevec_release 0.00 +1.4 1.38 perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.lru_add_drain_cpu.lru_add_drain.__pagevec_release.truncate_inode_pages_range 0.00 +2.1 2.09 perf-profile.calltrace.cycles-pp.lru_add_drain.__pagevec_release.truncate_inode_pages_range.evict.__dentry_kill 0.00 +2.1 2.09 perf-profile.calltrace.cycles-pp.lru_add_drain_cpu.lru_add_drain.__pagevec_release.truncate_inode_pages_range.evict 30.42 +2.5 32.89 perf-profile.calltrace.cycles-pp.read 27.36 +4.8 32.16 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read 27.06 +5.0 32.06 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 26.39 +5.4 31.83 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 25.57 +6.0 31.58 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 14.38 +6.5 20.88 perf-profile.calltrace.cycles-pp.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_write 23.46 +7.4 30.89 perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 22.93 +7.8 30.72 perf-profile.calltrace.cycles-pp.xfs_file_read_iter.new_sync_read.vfs_read.ksys_read.do_syscall_64 22.50 +8.0 30.56 perf-profile.calltrace.cycles-pp.xfs_file_buffered_read.xfs_file_read_iter.new_sync_read.vfs_read.ksys_read 20.39 +9.5 29.89 perf-profile.calltrace.cycles-pp.filemap_read.xfs_file_buffered_read.xfs_file_read_iter.new_sync_read.vfs_read 9.43 +9.8 19.26 perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write 9.13 +10.0 19.16 perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply 4.78 +13.0 17.82 perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor 2.28 +14.2 16.51 perf-profile.calltrace.cycles-pp.lru_cache_add.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin 2.09 ± 2% +14.3 16.44 perf-profile.calltrace.cycles-pp.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin 1.04 ± 3% +14.8 15.85 perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.pagecache_get_page 1.03 ± 3% +14.8 15.84 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru 0.97 ± 3% +14.9 15.82 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add 6.04 +19.2 25.24 perf-profile.calltrace.cycles-pp.mark_page_accessed.filemap_read.xfs_file_buffered_read.xfs_file_read_iter.new_sync_read 2.78 +21.1 23.88 perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.mark_page_accessed.filemap_read.xfs_file_buffered_read.xfs_file_read_iter 1.15 ± 4% +21.7 22.88 perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.pagevec_lru_move_fn.mark_page_accessed.filemap_read.xfs_file_buffered_read 1.12 ± 4% +21.7 22.86 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.pagevec_lru_move_fn.mark_page_accessed.filemap_read 1.08 ± 4% +21.8 22.84 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.pagevec_lru_move_fn.mark_page_accessed 7.41 +22.5 29.90 perf-profile.calltrace.cycles-pp.__close 7.38 +22.5 29.89 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__close 7.38 +22.5 29.89 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__close 7.35 +22.5 29.88 perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__close 7.35 +22.5 29.88 perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__close 7.34 +22.5 29.88 perf-profile.calltrace.cycles-pp.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe 7.33 +22.5 29.88 perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64 7.14 +22.7 29.82 perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode 7.10 +22.7 29.81 perf-profile.calltrace.cycles-pp.__dentry_kill.dput.__fput.task_work_run.exit_to_user_mode_prepare 3.04 ± 2% +23.1 26.12 perf-profile.calltrace.cycles-pp.release_pages.__pagevec_release.truncate_inode_pages_range.evict.__dentry_kill 5.99 +23.4 29.41 perf-profile.calltrace.cycles-pp.evict.__dentry_kill.dput.__fput.task_work_run 5.95 +23.4 29.39 perf-profile.calltrace.cycles-pp.truncate_inode_pages_range.evict.__dentry_kill.dput.__fput 1.27 ± 4% +23.8 25.08 perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.release_pages.__pagevec_release.truncate_inode_pages_range.evict 1.26 ± 4% +23.8 25.06 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.release_pages.__pagevec_release.truncate_inode_pages_range 1.20 ± 4% +23.8 25.04 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.release_pages.__pagevec_release 3.27 ± 2% +25.0 28.23 perf-profile.calltrace.cycles-pp.__pagevec_release.truncate_inode_pages_range.evict.__dentry_kill.dput 45.40 -14.3 31.08 perf-profile.children.cycles-pp.write 41.68 -11.7 29.96 perf-profile.children.cycles-pp.ksys_write 40.78 -11.1 29.69 perf-profile.children.cycles-pp.vfs_write 38.23 -9.4 28.88 perf-profile.children.cycles-pp.new_sync_write 37.19 -8.7 28.52 perf-profile.children.cycles-pp.xfs_file_buffered_write 32.14 -5.2 26.90 perf-profile.children.cycles-pp.iomap_file_buffered_write 31.88 -5.1 26.82 perf-profile.children.cycles-pp.iomap_apply 6.50 -4.3 2.21 ± 2% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 6.08 -4.2 1.83 ± 2% perf-profile.children.cycles-pp.iomap_set_range_uptodate 6.37 -4.2 2.18 ± 2% perf-profile.children.cycles-pp.copy_page_to_iter 6.26 -3.9 2.34 ± 2% perf-profile.children.cycles-pp.iomap_write_end 4.68 ± 2% -3.9 0.77 ± 7% perf-profile.children.cycles-pp.secondary_startup_64_no_verify 4.68 ± 2% -3.9 0.77 ± 7% perf-profile.children.cycles-pp.cpu_startup_entry 4.68 ± 2% -3.9 0.77 ± 7% perf-profile.children.cycles-pp.do_idle 4.64 ± 2% -3.9 0.76 ± 7% perf-profile.children.cycles-pp.start_secondary 5.34 -3.7 1.62 ± 2% perf-profile.children.cycles-pp.llseek 4.21 ± 2% -3.6 0.66 ± 8% perf-profile.children.cycles-pp.cpuidle_enter 4.20 ± 2% -3.5 0.66 ± 7% perf-profile.children.cycles-pp.cpuidle_enter_state 4.08 ± 2% -3.4 0.63 ± 7% perf-profile.children.cycles-pp.acpi_idle_enter 4.05 ± 2% -3.4 0.63 ± 8% perf-profile.children.cycles-pp.acpi_idle_do_entry 5.02 -3.3 1.73 ± 2% perf-profile.children.cycles-pp.copyout 4.06 ± 2% -3.2 0.90 ± 5% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 4.21 -2.9 1.30 ± 3% perf-profile.children.cycles-pp.xfs_buffered_write_iomap_begin 3.87 -2.6 1.25 ± 2% perf-profile.children.cycles-pp.filemap_get_pages 3.47 -2.4 1.12 ± 2% perf-profile.children.cycles-pp.filemap_get_read_batch 3.16 -2.2 0.96 ± 2% perf-profile.children.cycles-pp.xfs_ilock 3.14 -2.2 0.99 ± 2% perf-profile.children.cycles-pp.syscall_return_via_sysret 3.25 ± 2% -2.1 1.14 ± 3% perf-profile.children.cycles-pp.unlink 3.04 -2.1 0.96 perf-profile.children.cycles-pp.__entry_text_start 3.34 -2.1 1.26 ± 3% perf-profile.children.cycles-pp.rwsem_down_write_slowpath 3.18 ± 2% -2.1 1.12 ± 3% perf-profile.children.cycles-pp.do_unlinkat 3.04 -1.9 1.10 ± 2% perf-profile.children.cycles-pp.do_sys_open 3.04 -1.9 1.10 ± 2% perf-profile.children.cycles-pp.do_sys_openat2 2.98 -1.9 1.07 ± 2% perf-profile.children.cycles-pp.creat64 2.97 -1.9 1.07 ± 2% perf-profile.children.cycles-pp.do_filp_open 2.97 -1.9 1.07 ± 2% perf-profile.children.cycles-pp.path_openat 2.83 -1.9 0.94 perf-profile.children.cycles-pp.xfs_file_write_checks 2.30 -1.6 0.75 ± 3% perf-profile.children.cycles-pp.copy_page_from_iter_atomic 2.15 ± 2% -1.5 0.64 ± 3% perf-profile.children.cycles-pp.rwsem_spin_on_owner 2.02 -1.4 0.61 ± 2% perf-profile.children.cycles-pp.xfs_iunlock 1.99 -1.4 0.58 ± 3% perf-profile.children.cycles-pp.touch_atime 1.98 ± 5% -1.4 0.58 ± 3% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 2.56 -1.4 1.15 ± 3% perf-profile.children.cycles-pp.__set_page_dirty_nobuffers 1.89 -1.4 0.52 ± 2% perf-profile.children.cycles-pp.__fdget_pos 1.84 -1.3 0.54 ± 3% perf-profile.children.cycles-pp.down_write 1.79 -1.2 0.56 ± 3% perf-profile.children.cycles-pp.security_file_permission 2.21 ± 2% -1.2 1.02 ± 2% perf-profile.children.cycles-pp.workingset_activation 1.58 -1.2 0.42 ± 2% perf-profile.children.cycles-pp.__fget_light 2.43 -1.1 1.29 ± 2% perf-profile.children.cycles-pp.__add_to_page_cache_locked 1.65 -1.1 0.53 ± 2% perf-profile.children.cycles-pp.copyin 1.60 -1.1 0.50 ± 2% perf-profile.children.cycles-pp.___might_sleep 1.58 -1.1 0.49 ± 2% perf-profile.children.cycles-pp.xas_load 1.58 -1.1 0.49 ± 4% perf-profile.children.cycles-pp.__xfs_trans_commit 1.55 -1.1 0.48 ± 4% perf-profile.children.cycles-pp.xlog_cil_commit 1.41 -1.0 0.39 ± 3% perf-profile.children.cycles-pp.disk_rr 1.47 -1.0 0.49 ± 2% perf-profile.children.cycles-pp.__alloc_pages 25.90 -1.0 24.93 perf-profile.children.cycles-pp.iomap_write_actor 1.34 -1.0 0.37 perf-profile.children.cycles-pp.ksys_lseek 1.75 ± 3% -1.0 0.79 ± 2% perf-profile.children.cycles-pp.workingset_age_nonresident 1.38 -0.9 0.44 ± 2% perf-profile.children.cycles-pp.atime_needs_update 1.30 ± 2% -0.9 0.41 ± 3% perf-profile.children.cycles-pp.common_file_perm 1.19 -0.8 0.38 ± 3% perf-profile.children.cycles-pp.xfs_generic_create 1.17 -0.8 0.36 ± 2% perf-profile.children.cycles-pp.__might_sleep 1.18 -0.8 0.38 ± 3% perf-profile.children.cycles-pp.iov_iter_fault_in_readable 1.16 ± 2% -0.8 0.37 ± 3% perf-profile.children.cycles-pp.xfs_create 1.21 -0.8 0.43 ± 2% perf-profile.children.cycles-pp.file_update_time 1.16 -0.8 0.40 ± 3% perf-profile.children.cycles-pp.get_page_from_freelist 1.07 -0.7 0.33 ± 2% perf-profile.children.cycles-pp.xfs_ilock_iocb 1.02 ± 2% -0.7 0.29 ± 4% perf-profile.children.cycles-pp.xfs_vn_update_time 1.09 ± 6% -0.7 0.39 ± 4% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 1.45 -0.7 0.75 ± 2% perf-profile.children.cycles-pp.__set_page_dirty 1.05 -0.7 0.35 perf-profile.children.cycles-pp.__fsnotify_parent 1.08 -0.7 0.39 ± 3% perf-profile.children.cycles-pp.destroy_inode 0.98 -0.7 0.30 ± 6% perf-profile.children.cycles-pp.xlog_cil_insert_items 0.99 -0.7 0.32 ± 3% perf-profile.children.cycles-pp.__cond_resched 1.04 -0.7 0.38 ± 3% perf-profile.children.cycles-pp.xfs_fs_destroy_inode 1.03 ± 7% -0.7 0.37 ± 5% perf-profile.children.cycles-pp.hrtimer_interrupt 1.04 -0.7 0.38 ± 3% perf-profile.children.cycles-pp.xfs_inactive 0.91 ± 2% -0.6 0.26 ± 2% perf-profile.children.cycles-pp.up_write 0.89 -0.6 0.28 ± 3% perf-profile.children.cycles-pp.__get_user_nocheck_1 1.02 -0.6 0.42 ± 4% perf-profile.children.cycles-pp.delete_from_page_cache_batch 0.88 -0.6 0.27 perf-profile.children.cycles-pp.down_read 0.89 ± 2% -0.6 0.31 ± 3% perf-profile.children.cycles-pp.vfs_unlink 0.87 ± 3% -0.6 0.30 ± 2% perf-profile.children.cycles-pp.xfs_vn_unlink 0.86 ± 3% -0.6 0.30 ± 2% perf-profile.children.cycles-pp.xfs_remove 0.87 -0.6 0.32 ± 3% perf-profile.children.cycles-pp.xfs_inactive_ifree 0.80 -0.6 0.24 ± 3% perf-profile.children.cycles-pp.xfs_break_layouts 0.78 ± 2% -0.6 0.24 ± 2% perf-profile.children.cycles-pp.syscall_enter_from_user_mode 1.09 -0.5 0.55 ± 2% perf-profile.children.cycles-pp.truncate_cleanup_page 0.80 ± 2% -0.5 0.28 ± 4% perf-profile.children.cycles-pp.current_time 0.76 -0.5 0.26 ± 3% perf-profile.children.cycles-pp.xas_store 0.71 ± 2% -0.5 0.22 ± 5% perf-profile.children.cycles-pp.balance_dirty_pages_ratelimited 0.82 -0.5 0.34 ± 2% perf-profile.children.cycles-pp.__list_del_entry_valid 0.78 ± 3% -0.5 0.31 ± 4% perf-profile.children.cycles-pp._raw_spin_lock 0.61 -0.5 0.14 ± 2% perf-profile.children.cycles-pp.irq_exit_rcu 1.14 -0.5 0.68 ± 2% perf-profile.children.cycles-pp.__activate_page 0.70 ± 2% -0.5 0.25 ± 2% perf-profile.children.cycles-pp.__mod_lruvec_state 0.96 ± 5% -0.4 0.52 ± 9% perf-profile.children.cycles-pp.osq_lock 0.66 ± 2% -0.4 0.22 ± 5% perf-profile.children.cycles-pp.xfs_check_agi_freecount 0.90 -0.4 0.47 ± 2% perf-profile.children.cycles-pp.__cancel_dirty_page 0.66 -0.4 0.23 ± 4% perf-profile.children.cycles-pp.rmqueue 0.55 -0.4 0.13 ± 4% perf-profile.children.cycles-pp.__softirqentry_text_start 0.66 -0.4 0.24 ± 3% perf-profile.children.cycles-pp.xfs_ifree 0.61 -0.4 0.20 ± 4% perf-profile.children.cycles-pp.aa_file_perm 0.61 -0.4 0.22 perf-profile.children.cycles-pp.xfs_trans_read_buf_map 0.54 ± 3% -0.4 0.16 ± 4% perf-profile.children.cycles-pp.unlock_page 0.64 ± 2% -0.4 0.28 ± 3% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.52 ± 2% -0.4 0.16 ± 2% perf-profile.children.cycles-pp.map_id_range_down 0.52 -0.4 0.16 ± 4% perf-profile.children.cycles-pp.xas_start 0.50 ± 2% -0.4 0.14 ± 3% perf-profile.children.cycles-pp.percpu_counter_add_batch 0.55 ± 2% -0.4 0.20 ± 7% perf-profile.children.cycles-pp.__mem_cgroup_uncharge_list 0.39 ± 21% -0.3 0.06 ± 11% perf-profile.children.cycles-pp.ktime_get 0.49 ± 2% -0.3 0.16 ± 6% perf-profile.children.cycles-pp.rcu_all_qs 0.50 -0.3 0.17 ± 5% perf-profile.children.cycles-pp.xfs_dialloc 0.47 -0.3 0.15 ± 4% perf-profile.children.cycles-pp.xfs_iext_lookup_extent 0.50 ± 2% -0.3 0.18 ± 2% perf-profile.children.cycles-pp.__mod_node_page_state 0.45 ± 2% -0.3 0.14 ± 3% perf-profile.children.cycles-pp.up_read 0.58 ± 2% -0.3 0.27 ± 2% perf-profile.children.cycles-pp.free_unref_page_list 0.45 -0.3 0.15 ± 2% perf-profile.children.cycles-pp.rcu_read_unlock_strict 0.43 ± 2% -0.3 0.13 ± 3% perf-profile.children.cycles-pp.xfs_break_leased_layouts 0.44 ± 2% -0.3 0.15 ± 4% perf-profile.children.cycles-pp.xfs_difree 0.41 ± 3% -0.3 0.11 ± 4% perf-profile.children.cycles-pp.page_counter_uncharge 0.43 ± 4% -0.3 0.14 ± 6% perf-profile.children.cycles-pp.xfs_file_write_iter 0.43 ± 3% -0.3 0.14 perf-profile.children.cycles-pp.xfs_buffered_write_iomap_end 0.42 ± 3% -0.3 0.13 ± 3% perf-profile.children.cycles-pp.xfs_dir_removename 0.43 ± 3% -0.3 0.14 ± 2% perf-profile.children.cycles-pp.uncharge_batch 0.42 -0.3 0.13 ± 2% perf-profile.children.cycles-pp.xfs_errortag_test 0.43 -0.3 0.15 ± 3% perf-profile.children.cycles-pp.find_lock_entries 0.46 ± 4% -0.3 0.18 ± 4% perf-profile.children.cycles-pp.tick_sched_timer 0.40 ± 3% -0.3 0.12 ± 3% perf-profile.children.cycles-pp.xfs_dir2_node_removename 0.39 ± 2% -0.3 0.12 ± 4% perf-profile.children.cycles-pp.xfs_da3_node_lookup_int 0.39 ± 2% -0.3 0.12 ± 3% perf-profile.children.cycles-pp.generic_write_checks 0.65 -0.3 0.39 ± 2% perf-profile.children.cycles-pp.account_page_cleaned 1.50 -0.3 1.24 ± 2% perf-profile.children.cycles-pp.__mod_lruvec_page_state 0.42 -0.3 0.16 ± 2% perf-profile.children.cycles-pp.xfs_buf_read_map 0.37 ± 3% -0.3 0.12 ± 4% perf-profile.children.cycles-pp.xfs_trans_alloc 0.42 ± 2% -0.2 0.17 ± 4% perf-profile.children.cycles-pp.tick_sched_handle 0.34 ± 2% -0.2 0.10 ± 4% perf-profile.children.cycles-pp.try_charge_memcg 0.34 ± 4% -0.2 0.10 ± 3% perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack 0.40 -0.2 0.16 ± 3% perf-profile.children.cycles-pp.xfs_buf_get_map 0.35 ± 3% -0.2 0.11 ± 6% perf-profile.children.cycles-pp.xfs_difree_inobt 0.35 ± 5% -0.2 0.12 ± 8% perf-profile.children.cycles-pp.xfs_inobt_get_rec 0.40 ± 3% -0.2 0.17 ± 3% perf-profile.children.cycles-pp.update_process_times 0.33 ± 3% -0.2 0.10 ± 7% perf-profile.children.cycles-pp.xfs_trans_reserve 0.76 -0.2 0.53 ± 3% perf-profile.children.cycles-pp.__mem_cgroup_charge 0.32 ± 3% -0.2 0.09 ± 5% perf-profile.children.cycles-pp.xfs_log_reserve 0.32 ± 3% -0.2 0.10 ± 3% perf-profile.children.cycles-pp.make_kgid 0.54 -0.2 0.32 perf-profile.children.cycles-pp.memset_erms 0.33 -0.2 0.11 ± 3% perf-profile.children.cycles-pp.node_dirty_ok 0.28 ± 17% -0.2 0.06 ± 13% perf-profile.children.cycles-pp.clockevents_program_event 0.37 -0.2 0.15 perf-profile.children.cycles-pp.xfs_buf_find 0.30 ± 2% -0.2 0.08 ± 8% perf-profile.children.cycles-pp.asm_sysvec_call_function_single 0.31 ± 3% -0.2 0.10 perf-profile.children.cycles-pp.make_kuid 0.29 -0.2 0.08 ± 6% perf-profile.children.cycles-pp.rcu_core 0.31 ± 2% -0.2 0.10 ± 3% perf-profile.children.cycles-pp.__might_fault 0.30 ± 4% -0.2 0.09 ± 4% perf-profile.children.cycles-pp.page_counter_cancel 0.29 ± 3% -0.2 0.08 ± 5% perf-profile.children.cycles-pp.xfs_da_read_buf 0.31 ± 5% -0.2 0.10 ± 3% perf-profile.children.cycles-pp.timestamp_truncate 0.30 ± 4% -0.2 0.09 ± 5% perf-profile.children.cycles-pp.rw_verify_area 0.30 ± 2% -0.2 0.10 ± 4% perf-profile.children.cycles-pp.xfs_bmbt_to_iomap 0.29 ± 3% -0.2 0.09 ± 5% perf-profile.children.cycles-pp.xfs_iread_extents 0.27 ± 4% -0.2 0.07 ± 6% perf-profile.children.cycles-pp.xfs_file_llseek 0.27 -0.2 0.08 ± 5% perf-profile.children.cycles-pp.page_mapping 0.26 ± 3% -0.2 0.08 ± 5% perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare 0.24 ± 12% -0.2 0.07 ± 10% perf-profile.children.cycles-pp.alloc_pages 0.22 ± 3% -0.2 0.06 perf-profile.children.cycles-pp.write@plt 0.34 ± 2% -0.2 0.18 ± 2% perf-profile.children.cycles-pp.__schedule 0.22 ± 2% -0.2 0.07 ± 5% perf-profile.children.cycles-pp.xfs_dir_createname 0.22 ± 2% -0.2 0.07 perf-profile.children.cycles-pp.iomap_page_create 0.22 ± 3% -0.2 0.07 perf-profile.children.cycles-pp.iov_iter_init 0.21 ± 2% -0.2 0.06 ± 6% perf-profile.children.cycles-pp.xfs_dir2_node_addname 0.22 ± 2% -0.2 0.07 ± 6% perf-profile.children.cycles-pp.__list_add_valid 0.20 ± 3% -0.1 0.06 ± 9% perf-profile.children.cycles-pp.page_counter_try_charge 0.26 -0.1 0.11 ± 4% perf-profile.children.cycles-pp.xfs_read_agi 0.27 ± 3% -0.1 0.13 ± 5% perf-profile.children.cycles-pp.scheduler_tick 0.21 -0.1 0.07 ± 6% perf-profile.children.cycles-pp.__xa_set_mark 0.22 ± 5% -0.1 0.08 ± 7% perf-profile.children.cycles-pp.ktime_get_coarse_real_ts64 0.21 ± 3% -0.1 0.07 ± 5% perf-profile.children.cycles-pp.rcu_do_batch 0.19 ± 5% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.xfs_da3_node_read 0.16 ± 4% -0.1 0.02 ± 99% perf-profile.children.cycles-pp.xfs_dir_lookup 0.18 ± 6% -0.1 0.05 ± 7% perf-profile.children.cycles-pp.xa_get_order 0.32 ± 2% -0.1 0.19 ± 5% perf-profile.children.cycles-pp.unaccount_page_cache_page 0.19 ± 5% -0.1 0.06 perf-profile.children.cycles-pp.xfs_bmapi_reserve_delalloc 0.18 ± 3% -0.1 0.06 ± 9% perf-profile.children.cycles-pp.xfs_btree_lookup 0.19 ± 5% -0.1 0.06 perf-profile.children.cycles-pp.xfs_dir3_data_check 0.16 ± 5% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.xfs_lookup 0.18 ± 4% -0.1 0.06 perf-profile.children.cycles-pp.__xfs_dir3_data_check 0.19 ± 4% -0.1 0.07 ± 5% perf-profile.children.cycles-pp.xfs_btree_check_sblock 0.20 ± 3% -0.1 0.08 ± 4% perf-profile.children.cycles-pp.xfs_buf_item_format 0.16 ± 4% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.xfs_release 0.28 ± 5% -0.1 0.16 ± 3% perf-profile.children.cycles-pp.free_pcppages_bulk 0.19 ± 3% -0.1 0.07 perf-profile.children.cycles-pp.asm_sysvec_reschedule_ipi 0.17 ± 4% -0.1 0.05 perf-profile.children.cycles-pp.xfs_vn_lookup 0.17 ± 2% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.generic_write_check_limits 0.20 ± 2% -0.1 0.08 ± 6% perf-profile.children.cycles-pp.xfs_buf_item_format_segment 0.15 ± 3% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.wait_for_stable_page 0.18 ± 4% -0.1 0.06 ± 9% perf-profile.children.cycles-pp.xfs_btree_increment 0.18 ± 2% -0.1 0.06 ± 6% perf-profile.children.cycles-pp.xfs_btree_get_rec 0.17 ± 2% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.xfs_dir2_leafn_lookup_for_entry 0.20 ± 2% -0.1 0.09 ± 5% perf-profile.children.cycles-pp.xfs_iunlink_remove 0.14 ± 3% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.generic_file_llseek_size 0.18 ± 4% -0.1 0.07 ± 5% perf-profile.children.cycles-pp.kmem_cache_free 0.24 ± 5% -0.1 0.13 ± 9% perf-profile.children.cycles-pp.lock_page_memcg 0.16 ± 3% -0.1 0.06 ± 6% perf-profile.children.cycles-pp.xfs_inactive_truncate 0.18 ± 4% -0.1 0.08 ± 4% perf-profile.children.cycles-pp.kmem_cache_alloc 0.14 ± 4% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.xfs_dir2_leafn_remove 0.16 ± 3% -0.1 0.05 ± 7% perf-profile.children.cycles-pp.xas_init_marks 0.17 ± 3% -0.1 0.07 ± 7% perf-profile.children.cycles-pp.file_modified 0.20 ± 3% -0.1 0.10 ± 3% perf-profile.children.cycles-pp.mem_cgroup_update_lru_size 0.14 ± 5% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.__mod_zone_page_state 0.16 ± 6% -0.1 0.06 ± 8% perf-profile.children.cycles-pp.memcpy_erms 0.18 ± 5% -0.1 0.09 ± 5% perf-profile.children.cycles-pp.try_to_wake_up 0.14 ± 16% -0.1 0.05 ± 45% perf-profile.children.cycles-pp.xfs_inode_item_format 0.16 ± 6% -0.1 0.07 ± 5% perf-profile.children.cycles-pp.rwsem_wake 0.16 ± 5% -0.1 0.06 ± 11% perf-profile.children.cycles-pp.get_mem_cgroup_from_mm 0.14 ± 3% -0.1 0.05 perf-profile.children.cycles-pp.generic_file_read_iter 0.54 -0.1 0.45 ± 4% perf-profile.children.cycles-pp.charge_memcg 0.14 ± 7% -0.1 0.05 perf-profile.children.cycles-pp.xfs_itruncate_extents_flags 0.14 ± 2% -0.1 0.05 perf-profile.children.cycles-pp.open64 0.14 ± 5% -0.1 0.05 perf-profile.children.cycles-pp.xas_create 0.17 ± 2% -0.1 0.08 ± 9% perf-profile.children.cycles-pp._raw_spin_lock_irq 0.13 ± 5% -0.1 0.05 ± 7% perf-profile.children.cycles-pp.file_remove_privs 0.10 ± 4% -0.1 0.03 ±100% perf-profile.children.cycles-pp.uncharge_page 0.22 ± 2% -0.1 0.15 ± 3% perf-profile.children.cycles-pp.schedule 0.13 ± 5% -0.1 0.06 perf-profile.children.cycles-pp.update_load_avg 0.14 ± 4% -0.1 0.07 ± 6% perf-profile.children.cycles-pp.rmqueue_bulk 0.14 ± 7% -0.1 0.08 ± 6% perf-profile.children.cycles-pp.task_tick_fair 0.14 ± 3% -0.1 0.08 perf-profile.children.cycles-pp.xfs_buf_lock 0.11 ± 8% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.wake_up_q 0.13 ± 3% -0.1 0.08 perf-profile.children.cycles-pp.down 0.13 ± 4% -0.1 0.08 ± 4% perf-profile.children.cycles-pp.__down 0.12 ± 5% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.__free_one_page 0.10 ± 5% -0.0 0.05 perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.12 ± 4% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.schedule_timeout 0.07 ± 9% -0.0 0.04 ± 71% perf-profile.children.cycles-pp.generic_file_write_iter 0.16 ± 2% -0.0 0.13 ± 3% perf-profile.children.cycles-pp.__mod_memcg_state 0.08 ± 4% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.pick_next_task_fair 0.00 +0.1 0.06 ± 8% perf-profile.children.cycles-pp._find_next_bit 0.02 ± 99% +0.1 0.08 ± 5% perf-profile.children.cycles-pp.newidle_balance 0.00 +0.1 0.11 ± 6% perf-profile.children.cycles-pp.queue_work_on 0.11 ± 6% +0.2 0.34 ± 4% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.07 ± 5% +0.2 0.30 ± 4% perf-profile.children.cycles-pp.mem_cgroup_charge_statistics 0.59 +0.6 1.15 ± 2% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state 0.00 +0.8 0.79 ± 7% perf-profile.children.cycles-pp.mem_cgroup_css_rstat_flush 0.23 ± 2% +0.9 1.08 ± 3% perf-profile.children.cycles-pp.cgroup_rstat_updated 0.00 +1.1 1.10 ± 7% perf-profile.children.cycles-pp.cgroup_rstat_flush_locked 0.00 +1.1 1.10 ± 7% perf-profile.children.cycles-pp.cgroup_rstat_flush_irqsafe 0.00 +1.1 1.11 ± 7% perf-profile.children.cycles-pp.mem_cgroup_flush_stats 0.01 ±223% +1.1 1.12 ± 7% perf-profile.children.cycles-pp.process_one_work 0.03 ±105% +1.1 1.14 ± 7% perf-profile.children.cycles-pp.kthread 0.03 ±105% +1.1 1.15 ± 7% perf-profile.children.cycles-pp.ret_from_fork 0.01 ±223% +1.1 1.13 ± 7% perf-profile.children.cycles-pp.worker_thread 0.19 ± 3% +1.9 2.10 perf-profile.children.cycles-pp.lru_add_drain 0.19 ± 3% +1.9 2.10 perf-profile.children.cycles-pp.lru_add_drain_cpu 30.44 +2.7 33.13 perf-profile.children.cycles-pp.read 26.45 +5.4 31.84 perf-profile.children.cycles-pp.ksys_read 25.65 +6.0 31.61 perf-profile.children.cycles-pp.vfs_read 14.48 +6.4 20.92 perf-profile.children.cycles-pp.iomap_write_begin 23.55 +7.4 30.92 perf-profile.children.cycles-pp.new_sync_read 22.98 +7.8 30.73 perf-profile.children.cycles-pp.xfs_file_read_iter 22.60 +8.0 30.59 perf-profile.children.cycles-pp.xfs_file_buffered_read 86.48 +8.9 95.40 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 20.59 +9.4 29.96 perf-profile.children.cycles-pp.filemap_read 85.68 +9.5 95.14 perf-profile.children.cycles-pp.do_syscall_64 9.54 +9.8 19.29 perf-profile.children.cycles-pp.grab_cache_page_write_begin 9.28 +9.9 19.21 perf-profile.children.cycles-pp.pagecache_get_page 4.80 +13.0 17.83 perf-profile.children.cycles-pp.add_to_page_cache_lru 2.30 +14.2 16.53 perf-profile.children.cycles-pp.lru_cache_add 2.20 ± 2% +15.0 17.18 perf-profile.children.cycles-pp.__pagevec_lru_add 6.09 +19.2 25.25 perf-profile.children.cycles-pp.mark_page_accessed 8.44 +21.8 30.26 perf-profile.children.cycles-pp.syscall_exit_to_user_mode 7.85 +22.2 30.06 perf-profile.children.cycles-pp.exit_to_user_mode_prepare 2.90 +22.4 25.27 perf-profile.children.cycles-pp.pagevec_lru_move_fn 7.41 +22.5 29.90 perf-profile.children.cycles-pp.__close 7.34 +22.5 29.88 perf-profile.children.cycles-pp.task_work_run 7.33 +22.5 29.88 perf-profile.children.cycles-pp.__fput 7.17 +22.7 29.82 perf-profile.children.cycles-pp.dput 7.10 +22.7 29.81 perf-profile.children.cycles-pp.__dentry_kill 3.40 ± 2% +22.8 26.25 perf-profile.children.cycles-pp.release_pages 5.99 +23.4 29.41 perf-profile.children.cycles-pp.evict 5.96 +23.4 29.40 perf-profile.children.cycles-pp.truncate_inode_pages_range 3.27 ± 2% +25.0 28.23 perf-profile.children.cycles-pp.__pagevec_release 3.86 ± 4% +62.2 66.03 perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 3.90 ± 3% +62.2 66.11 perf-profile.children.cycles-pp._raw_spin_lock_irqsave 3.58 ± 4% +62.3 65.86 perf-profile.children.cycles-pp.lock_page_lruvec_irqsave 6.41 -4.2 2.19 ± 2% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 6.02 -4.2 1.81 ± 2% perf-profile.self.cycles-pp.iomap_set_range_uptodate 3.13 -2.1 0.98 ± 2% perf-profile.self.cycles-pp.syscall_return_via_sysret 2.32 -2.0 0.36 ± 7% perf-profile.self.cycles-pp.acpi_idle_do_entry 2.73 -1.8 0.88 ± 2% perf-profile.self.cycles-pp.filemap_get_read_batch 2.20 -1.5 0.67 ± 3% perf-profile.self.cycles-pp.filemap_read 2.12 ± 2% -1.5 0.63 ± 4% perf-profile.self.cycles-pp.rwsem_spin_on_owner 1.70 -1.2 0.49 ± 2% perf-profile.self.cycles-pp.pagecache_get_page 1.51 -1.1 0.40 perf-profile.self.cycles-pp.__fget_light 1.73 ± 3% -1.0 0.78 ± 2% perf-profile.self.cycles-pp.workingset_age_nonresident 1.39 -1.0 0.44 ± 2% perf-profile.self.cycles-pp.___might_sleep 1.28 -0.9 0.34 ± 3% perf-profile.self.cycles-pp.disk_rr 1.38 -0.9 0.46 ± 2% perf-profile.self.cycles-pp.iomap_apply 1.07 -0.7 0.33 ± 2% perf-profile.self.cycles-pp.xas_load 1.02 -0.7 0.32 ± 4% perf-profile.self.cycles-pp.mark_page_accessed 0.97 -0.7 0.30 ± 2% perf-profile.self.cycles-pp.__might_sleep 0.95 -0.6 0.30 ± 4% perf-profile.self.cycles-pp.xfs_buffered_write_iomap_begin 0.96 -0.6 0.32 ± 2% perf-profile.self.cycles-pp.__fsnotify_parent 0.93 -0.6 0.29 ± 2% perf-profile.self.cycles-pp.write 0.91 -0.6 0.27 ± 2% perf-profile.self.cycles-pp.down_write 0.91 -0.6 0.28 ± 2% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.86 ± 2% -0.6 0.25 ± 2% perf-profile.self.cycles-pp.up_write 0.87 -0.6 0.26 ± 2% perf-profile.self.cycles-pp.llseek 0.86 -0.6 0.27 ± 4% perf-profile.self.cycles-pp.__get_user_nocheck_1 0.86 ± 3% -0.6 0.29 ± 3% perf-profile.self.cycles-pp.vfs_write 0.84 ± 2% -0.6 0.27 ± 3% perf-profile.self.cycles-pp.read 0.81 -0.5 0.26 ± 4% perf-profile.self.cycles-pp.iomap_write_begin 0.75 -0.5 0.24 ± 2% perf-profile.self.cycles-pp.__entry_text_start 0.71 ± 2% -0.5 0.22 ± 4% perf-profile.self.cycles-pp.common_file_perm 0.69 ± 2% -0.5 0.21 ± 3% perf-profile.self.cycles-pp.syscall_enter_from_user_mode 0.72 ± 2% -0.5 0.24 ± 2% perf-profile.self.cycles-pp.copy_page_to_iter 0.79 -0.5 0.33 ± 2% perf-profile.self.cycles-pp.__list_del_entry_valid 0.64 ± 3% -0.4 0.20 ± 4% perf-profile.self.cycles-pp.xfs_file_buffered_write 0.95 ± 4% -0.4 0.52 ± 9% perf-profile.self.cycles-pp.osq_lock 0.64 ± 2% -0.4 0.20 ± 2% perf-profile.self.cycles-pp.do_syscall_64 0.64 -0.4 0.21 ± 2% perf-profile.self.cycles-pp.xfs_iunlock 0.65 -0.4 0.22 ± 3% perf-profile.self.cycles-pp.copy_page_from_iter_atomic 0.66 -0.4 0.22 ± 2% perf-profile.self.cycles-pp.iomap_write_actor 0.61 -0.4 0.20 ± 4% perf-profile.self.cycles-pp.iomap_write_end 0.59 ± 3% -0.4 0.18 ± 5% perf-profile.self.cycles-pp.balance_dirty_pages_ratelimited 0.68 -0.4 0.31 ± 3% perf-profile.self.cycles-pp.release_pages 0.53 -0.4 0.16 perf-profile.self.cycles-pp.down_read 0.53 -0.4 0.17 ± 3% perf-profile.self.cycles-pp.xfs_ilock 0.50 ± 2% -0.4 0.15 ± 4% perf-profile.self.cycles-pp.unlock_page 0.76 -0.3 0.42 ± 2% perf-profile.self.cycles-pp.__mod_lruvec_page_state 0.50 ± 3% -0.3 0.15 ± 4% perf-profile.self.cycles-pp.__set_page_dirty_nobuffers 0.50 -0.3 0.16 ± 4% perf-profile.self.cycles-pp.aa_file_perm 0.49 ± 2% -0.3 0.16 ± 3% perf-profile.self.cycles-pp.__cond_resched 0.49 -0.3 0.16 perf-profile.self.cycles-pp.new_sync_write 0.57 -0.3 0.25 ± 3% perf-profile.self.cycles-pp.__activate_page 0.48 -0.3 0.16 ± 4% perf-profile.self.cycles-pp.new_sync_read 0.46 ± 2% -0.3 0.14 ± 3% perf-profile.self.cycles-pp.map_id_range_down 0.46 ± 2% -0.3 0.14 ± 5% perf-profile.self.cycles-pp.xas_start 0.54 ± 2% -0.3 0.22 ± 4% perf-profile.self.cycles-pp.__pagevec_lru_add 0.52 -0.3 0.20 ± 2% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.45 -0.3 0.14 ± 4% perf-profile.self.cycles-pp.xfs_iext_lookup_extent 0.43 ± 2% -0.3 0.13 ± 3% perf-profile.self.cycles-pp.up_read 0.34 ± 26% -0.3 0.03 ± 70% perf-profile.self.cycles-pp.ktime_get 0.45 -0.3 0.15 ± 3% perf-profile.self.cycles-pp.vfs_read 0.46 ± 2% -0.3 0.17 ± 2% perf-profile.self.cycles-pp.__mod_node_page_state 0.41 -0.3 0.12 ± 4% perf-profile.self.cycles-pp.security_file_permission 0.42 ± 2% -0.3 0.14 ± 3% perf-profile.self.cycles-pp.exit_to_user_mode_prepare 0.38 ± 2% -0.3 0.11 ± 4% perf-profile.self.cycles-pp.xfs_break_leased_layouts 0.40 ± 4% -0.3 0.13 ± 5% perf-profile.self.cycles-pp.xfs_file_write_iter 0.40 ± 3% -0.3 0.13 ± 3% perf-profile.self.cycles-pp.filemap_get_pages 0.36 ± 2% -0.3 0.10 ± 3% perf-profile.self.cycles-pp.percpu_counter_add_batch 0.37 ± 3% -0.3 0.12 ± 4% perf-profile.self.cycles-pp.atime_needs_update 0.36 ± 3% -0.2 0.12 ± 4% perf-profile.self.cycles-pp.xas_store 0.39 ± 2% -0.2 0.15 ± 5% perf-profile.self.cycles-pp.xfs_file_read_iter 0.34 ± 5% -0.2 0.10 ± 3% perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack 0.34 ± 2% -0.2 0.11 ± 4% perf-profile.self.cycles-pp.__add_to_page_cache_locked 0.34 ± 3% -0.2 0.11 perf-profile.self.cycles-pp.xfs_file_write_checks 0.33 ± 2% -0.2 0.11 ± 4% perf-profile.self.cycles-pp.xfs_errortag_test 0.34 ± 2% -0.2 0.12 ± 4% perf-profile.self.cycles-pp.syscall_exit_to_user_mode 0.45 ± 2% -0.2 0.23 ± 3% perf-profile.self.cycles-pp.workingset_activation 0.32 ± 3% -0.2 0.11 ± 7% perf-profile.self.cycles-pp.rcu_all_qs 0.53 -0.2 0.32 perf-profile.self.cycles-pp.memset_erms 0.30 ± 4% -0.2 0.09 ± 5% perf-profile.self.cycles-pp.page_counter_cancel 0.30 ± 4% -0.2 0.09 ± 4% perf-profile.self.cycles-pp.__fdget_pos 0.33 -0.2 0.12 ± 3% perf-profile.self.cycles-pp.find_lock_entries 0.28 ± 2% -0.2 0.08 ± 4% perf-profile.self.cycles-pp.ksys_lseek 0.35 -0.2 0.16 ± 3% perf-profile.self.cycles-pp.pagevec_lru_move_fn 0.30 ± 3% -0.2 0.10 ± 4% perf-profile.self.cycles-pp.current_time 0.30 ± 4% -0.2 0.10 perf-profile.self.cycles-pp.file_update_time 0.28 ± 4% -0.2 0.09 perf-profile.self.cycles-pp.xfs_buffered_write_iomap_end 0.27 -0.2 0.08 ± 5% perf-profile.self.cycles-pp.ksys_write 0.28 ± 2% -0.2 0.10 ± 6% perf-profile.self.cycles-pp.xfs_bmbt_to_iomap 0.27 ± 5% -0.2 0.09 perf-profile.self.cycles-pp.timestamp_truncate 0.26 ± 4% -0.2 0.08 ± 8% perf-profile.self.cycles-pp.xfs_break_layouts 0.28 ± 3% -0.2 0.10 ± 3% perf-profile.self.cycles-pp.iov_iter_fault_in_readable 0.26 ± 2% -0.2 0.08 ± 4% perf-profile.self.cycles-pp.xfs_iread_extents 0.25 ± 4% -0.2 0.08 ± 4% perf-profile.self.cycles-pp.rw_verify_area 0.25 -0.2 0.08 ± 4% perf-profile.self.cycles-pp.page_mapping 0.25 ± 4% -0.2 0.08 ± 4% perf-profile.self.cycles-pp.iomap_file_buffered_write 0.23 ± 5% -0.2 0.06 ± 7% perf-profile.self.cycles-pp.xfs_file_llseek 0.23 ± 2% -0.2 0.07 ± 5% perf-profile.self.cycles-pp.rmqueue 0.24 ± 2% -0.2 0.08 ± 4% perf-profile.self.cycles-pp.node_dirty_ok 0.23 ± 2% -0.2 0.08 ± 4% perf-profile.self.cycles-pp.ksys_read 0.22 ± 2% -0.2 0.06 ± 7% perf-profile.self.cycles-pp.__set_page_dirty 0.22 ± 3% -0.1 0.07 ± 5% perf-profile.self.cycles-pp.generic_write_checks 0.20 ± 3% -0.1 0.06 ± 6% perf-profile.self.cycles-pp.__alloc_pages 0.20 ± 2% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.xfs_file_buffered_read 0.19 ± 2% -0.1 0.06 ± 6% perf-profile.self.cycles-pp.__list_add_valid 0.17 ± 3% -0.1 0.04 ± 44% perf-profile.self.cycles-pp.page_counter_try_charge 0.19 ± 2% -0.1 0.06 ± 6% perf-profile.self.cycles-pp.rcu_read_unlock_strict 0.19 ± 3% -0.1 0.07 ± 7% perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare 0.18 -0.1 0.06 ± 8% perf-profile.self.cycles-pp.iomap_page_create 0.20 ± 2% -0.1 0.07 ± 5% perf-profile.self.cycles-pp.__mod_lruvec_state 0.30 ± 3% -0.1 0.18 ± 5% perf-profile.self.cycles-pp._raw_spin_lock 0.15 ± 2% -0.1 0.03 ± 70% perf-profile.self.cycles-pp.generic_write_check_limits 0.17 ± 4% -0.1 0.06 ± 9% perf-profile.self.cycles-pp.touch_atime 0.17 ± 4% -0.1 0.06 ± 8% perf-profile.self.cycles-pp.__cancel_dirty_page 0.18 ± 7% -0.1 0.07 ± 7% perf-profile.self.cycles-pp.ktime_get_coarse_real_ts64 0.14 ± 6% -0.1 0.03 ± 70% perf-profile.self.cycles-pp.get_page_from_freelist 0.13 -0.1 0.02 ± 99% perf-profile.self.cycles-pp.xlog_cil_commit 0.14 ± 5% -0.1 0.04 ± 44% perf-profile.self.cycles-pp.account_page_cleaned 0.14 ± 7% -0.1 0.04 ± 44% perf-profile.self.cycles-pp.delete_from_page_cache_batch 0.16 ± 6% -0.1 0.06 ± 8% perf-profile.self.cycles-pp.memcpy_erms 0.21 ± 3% -0.1 0.12 ± 9% perf-profile.self.cycles-pp.lock_page_memcg 0.18 ± 5% -0.1 0.09 ± 7% perf-profile.self.cycles-pp.mem_cgroup_update_lru_size 0.14 ± 6% -0.1 0.05 ± 46% perf-profile.self.cycles-pp.get_mem_cgroup_from_mm 0.14 -0.1 0.05 ± 8% perf-profile.self.cycles-pp.lru_cache_add 0.13 ± 4% -0.1 0.05 ± 8% perf-profile.self.cycles-pp.truncate_cleanup_page 0.15 ± 3% -0.1 0.07 ± 5% perf-profile.self.cycles-pp._raw_spin_lock_irq 0.10 ± 4% -0.1 0.02 ± 99% perf-profile.self.cycles-pp.uncharge_page 0.11 ± 6% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.__free_one_page 0.29 ± 3% -0.0 0.25 ± 4% perf-profile.self.cycles-pp.__mod_memcg_lruvec_state 0.00 +0.1 0.10 ± 4% perf-profile.self.cycles-pp.queue_work_on 0.00 +0.2 0.24 ± 7% perf-profile.self.cycles-pp.cgroup_rstat_flush_locked 0.18 ± 2% +0.7 0.89 ± 3% perf-profile.self.cycles-pp.cgroup_rstat_updated 0.00 +0.7 0.75 ± 6% perf-profile.self.cycles-pp.mem_cgroup_css_rstat_flush 3.86 ± 4% +62.2 66.03 perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath aim7.jobs-per-min 600000 +------------------------------------------------------------------+ |.++.+.++. .+. +.+.++. .++.++. .++.+.++.++.+.++. .++.+. +.++.+.++.| 580000 |-+ ++ + + + + + | | | 560000 |-+ | | | 540000 |-+ | | | 520000 |-+ O O O O | | O OO O O O O O OO OO O OO OO O O O | 500000 |-+ O O O | | O | 480000 |-OO O OO O OO O OO | | O | 460000 +------------------------------------------------------------------+ aim7.time.involuntary_context_switches 60000 +-------------------------------------------------------------------+ | O | 50000 |-+ O O | | OO O O O | | OO O O O | 40000 |-+ | | O O | 30000 |-+ O O O O O O O O OO O O O OO O O | | O O O O OO | 20000 |-+ O O | | | | | 10000 |-+ | |.++.+.++.+.++.+.++.+.++.+.++.+.++.++.+.++.+.++.+.++.+.++.+.++.+.++.| 0 +-------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-csl-2ap3: 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory ========================================================================================= compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-8.3/100%/debian-10.4-x86_64-20200603.cgz/300s/lkp-csl-2ap3/compute/reaim/0x5003006 commit: 3c28c7680e ("memcg: switch lruvec stats to rstat") 45208c9105 ("memcg: infrastructure to flush memcg stats") 3c28c7680e1c39b9 45208c9105bd96015b98cdf31fb ---------------- --------------------------- %stddev %change %stddev \ | \ 25.60 ± 8% +83.3% 46.92 ± 4% reaim.child_systime 1176255 -10.0% 1058318 reaim.jobs_per_min 6126 -10.0% 5512 reaim.jobs_per_min_child 1285748 -14.7% 1096175 reaim.max_jobs_per_min 0.99 +11.0% 1.10 reaim.parent_time 4.03 ± 5% -19.9% 3.23 reaim.std_dev_percent 0.04 ± 6% -9.5% 0.03 ± 3% reaim.std_dev_time 467074 +46.9% 686171 reaim.time.involuntary_context_switches 38758 +18.7% 46008 reaim.time.major_page_faults 2.53e+08 -3.4% 2.445e+08 reaim.time.minor_page_faults 5610 +7.8% 6048 reaim.time.percent_of_cpu_this_job_got 2553 ± 8% +77.1% 4523 ± 4% reaim.time.system_time 14377 -4.3% 13761 reaim.time.user_time 1119923 ± 4% -5.5% 1058841 reaim.time.voluntary_context_switches 1913600 -3.3% 1849600 reaim.workload 14282 ± 6% +20.4% 17198 meminfo.PageTables 0.05 ± 4% +0.1 0.12 ± 2% mpstat.cpu.all.soft% 4.48 ± 8% +3.5 8.00 ± 4% mpstat.cpu.all.sys% 4055 ± 65% +102.0% 8192 ± 29% numa-meminfo.node0.PageTables 117359 ± 32% +36.3% 159956 ± 18% numa-meminfo.node0.SUnreclaim 983.00 ± 69% +107.9% 2043 ± 30% numa-vmstat.node0.nr_page_table_pages 29352 ± 32% +36.2% 39986 ± 18% numa-vmstat.node0.nr_slab_unreclaimable 33318 ± 15% +96.1% 65348 ± 18% turbostat.C1 122.82 +3.6% 127.24 turbostat.PkgWatt 11566 ± 3% +27.7% 14765 vmstat.system.cs 64057 +8.2% 69320 vmstat.system.in 3604 ± 9% +19.7% 4315 proc-vmstat.nr_page_table_pages 34371 +1.0% 34717 proc-vmstat.nr_slab_reclaimable 102724 +7.0% 109923 proc-vmstat.nr_slab_unreclaimable 2.45e+08 -3.1% 2.374e+08 proc-vmstat.numa_hit 2.451e+08 -3.1% 2.375e+08 proc-vmstat.numa_local 25844 +6.8% 27609 proc-vmstat.pgactivate 2.45e+08 -3.1% 2.374e+08 proc-vmstat.pgalloc_normal 2.543e+08 -3.3% 2.458e+08 proc-vmstat.pgfault 2.45e+08 -3.1% 2.374e+08 proc-vmstat.pgfree 10835833 -3.6% 10451119 proc-vmstat.pgreuse 29866 ± 3% +98.8% 59373 slabinfo.cred_jar.active_objs 710.67 ± 3% +99.0% 1414 slabinfo.cred_jar.active_slabs 29866 ± 3% +99.0% 59435 slabinfo.cred_jar.num_objs 710.67 ± 3% +99.0% 1414 slabinfo.cred_jar.num_slabs 22187 +89.3% 41994 slabinfo.shmem_inode_cache.active_objs 481.67 +89.8% 914.33 slabinfo.shmem_inode_cache.active_slabs 22187 +89.7% 42079 slabinfo.shmem_inode_cache.num_objs 481.67 +89.8% 914.33 slabinfo.shmem_inode_cache.num_slabs 16286 +21.8% 19840 slabinfo.signal_cache.active_objs 582.50 +22.9% 716.17 slabinfo.signal_cache.active_slabs 16320 +23.0% 20067 slabinfo.signal_cache.num_objs 582.50 +22.9% 716.17 slabinfo.signal_cache.num_slabs 2496 +11.7% 2788 slabinfo.task_struct.active_objs 2512 +11.6% 2802 slabinfo.task_struct.active_slabs 2512 +11.6% 2802 slabinfo.task_struct.num_objs 2512 +11.6% 2802 slabinfo.task_struct.num_slabs 28705 ± 2% -31.9% 19557 ± 3% softirqs.CPU0.RCU 26503 ± 6% -35.8% 17007 ± 5% softirqs.CPU1.RCU 26293 ± 3% -38.0% 16307 ± 5% softirqs.CPU10.RCU 25549 ± 3% -39.1% 15555 ± 6% softirqs.CPU100.RCU 25992 -39.7% 15678 ± 7% softirqs.CPU101.RCU 26758 ± 2% -41.1% 15769 ± 5% softirqs.CPU102.RCU 26260 ± 2% -38.5% 16146 ± 5% softirqs.CPU103.RCU 26063 ± 3% -38.6% 16011 ± 6% softirqs.CPU104.RCU 25852 -41.4% 15160 ± 3% softirqs.CPU105.RCU 25593 -40.2% 15309 ± 4% softirqs.CPU106.RCU 26124 ± 5% -42.1% 15138 ± 6% softirqs.CPU107.RCU 25411 ± 2% -39.3% 15432 ± 4% softirqs.CPU108.RCU 25997 -39.0% 15869 ± 6% softirqs.CPU109.RCU 26055 -37.3% 16325 ± 8% softirqs.CPU11.RCU 25724 ± 3% -39.1% 15675 ± 2% softirqs.CPU110.RCU 25569 -37.1% 16088 ± 3% softirqs.CPU111.RCU 25813 ± 5% -40.6% 15324 ± 4% softirqs.CPU112.RCU 25688 ± 4% -38.6% 15777 ± 4% softirqs.CPU113.RCU 25243 -35.9% 16174 ± 9% softirqs.CPU114.RCU 25643 ± 3% -38.6% 15733 ± 5% softirqs.CPU115.RCU 25577 ± 4% -37.4% 16004 ± 8% softirqs.CPU116.RCU 26438 ± 3% -41.1% 15564 ± 3% softirqs.CPU117.RCU 25536 ± 3% -37.4% 15982 ± 4% softirqs.CPU118.RCU 26251 ± 4% -40.5% 15622 ± 4% softirqs.CPU119.RCU 26239 -38.4% 16169 ± 6% softirqs.CPU12.RCU 25590 ± 4% -41.0% 15089 ± 4% softirqs.CPU120.RCU 25913 ± 3% -42.3% 14948 ± 2% softirqs.CPU121.RCU 25684 ± 4% -42.1% 14883 ± 4% softirqs.CPU122.RCU 26928 ± 7% -44.9% 14842 ± 2% softirqs.CPU123.RCU 26246 ± 4% -42.1% 15193 ± 4% softirqs.CPU124.RCU 25326 ± 2% -40.8% 15003 ± 2% softirqs.CPU125.RCU 25764 ± 4% -43.0% 14677 ± 3% softirqs.CPU126.RCU 25684 ± 4% -42.4% 14784 ± 3% softirqs.CPU127.RCU 25532 ± 4% -40.0% 15325 ± 4% softirqs.CPU128.RCU 25928 ± 3% -42.8% 14823 ± 3% softirqs.CPU129.RCU 27104 ± 7% -38.2% 16755 ± 12% softirqs.CPU13.RCU 25824 ± 4% -41.7% 15057 ± 3% softirqs.CPU130.RCU 26155 ± 5% -42.5% 15037 softirqs.CPU131.RCU 26055 ± 4% -42.7% 14930 ± 3% softirqs.CPU132.RCU 25844 ± 3% -41.5% 15108 ± 3% softirqs.CPU133.RCU 25750 ± 3% -40.6% 15307 ± 4% softirqs.CPU134.RCU 26036 ± 5% -41.2% 15318 ± 2% softirqs.CPU135.RCU 25685 ± 3% -41.0% 15163 ± 6% softirqs.CPU136.RCU 25817 ± 3% -41.1% 15198 softirqs.CPU137.RCU 26283 ± 2% -41.6% 15351 ± 7% softirqs.CPU138.RCU 10310 ± 6% -13.6% 8911 ± 6% softirqs.CPU139.NET_RX 27107 ± 5% -44.5% 15055 ± 2% softirqs.CPU139.RCU 25666 ± 3% -39.0% 15654 ± 4% softirqs.CPU14.RCU 25522 ± 2% -39.1% 15543 softirqs.CPU140.RCU 25845 ± 2% -42.4% 14897 ± 3% softirqs.CPU141.RCU 25868 ± 5% -41.3% 15194 ± 4% softirqs.CPU142.RCU 25325 ± 5% -39.5% 15318 ± 3% softirqs.CPU143.RCU 26221 ± 2% -42.6% 15042 ± 2% softirqs.CPU144.RCU 26366 ± 3% -42.4% 15197 ± 2% softirqs.CPU145.RCU 26355 ± 3% -43.5% 14895 ± 2% softirqs.CPU146.RCU 25762 -40.8% 15259 softirqs.CPU147.RCU 25694 ± 4% -40.9% 15196 softirqs.CPU148.RCU 26680 ± 2% -42.5% 15334 ± 2% softirqs.CPU149.RCU 25883 ± 2% -40.1% 15493 ± 2% softirqs.CPU15.RCU 26390 ± 3% -44.0% 14778 softirqs.CPU150.RCU 26695 ± 2% -43.6% 15066 ± 3% softirqs.CPU151.RCU 26128 ± 2% -42.0% 15152 ± 3% softirqs.CPU152.RCU 25897 ± 2% -42.5% 14883 ± 2% softirqs.CPU153.RCU 26043 ± 4% -42.7% 14915 ± 2% softirqs.CPU154.RCU 26324 ± 4% -42.9% 15035 softirqs.CPU155.RCU 26491 ± 4% -44.0% 14845 ± 4% softirqs.CPU156.RCU 10361 ± 4% -10.5% 9272 softirqs.CPU157.NET_RX 26347 ± 4% -43.1% 14986 ± 2% softirqs.CPU157.RCU 25523 ± 3% -41.1% 15029 ± 2% softirqs.CPU158.RCU 26240 ± 2% -44.4% 14588 ± 3% softirqs.CPU159.RCU 26715 ± 5% -42.8% 15289 ± 3% softirqs.CPU16.RCU 26370 ± 4% -44.3% 14695 ± 3% softirqs.CPU160.RCU 25738 ± 3% -42.6% 14775 softirqs.CPU161.RCU 10415 ± 2% -9.8% 9396 ± 2% softirqs.CPU162.NET_RX 25942 ± 3% -43.2% 14735 ± 3% softirqs.CPU162.RCU 25763 ± 2% -43.3% 14601 ± 2% softirqs.CPU163.RCU 25994 -42.7% 14897 ± 2% softirqs.CPU164.RCU 25951 ± 2% -42.3% 14980 ± 2% softirqs.CPU165.RCU 25484 ± 2% -43.1% 14511 softirqs.CPU166.RCU 26046 ± 3% -42.6% 14960 ± 5% softirqs.CPU167.RCU 25492 ± 3% -40.6% 15144 ± 4% softirqs.CPU168.RCU 25613 ± 4% -40.8% 15151 ± 7% softirqs.CPU169.RCU 25717 ± 3% -40.4% 15339 ± 4% softirqs.CPU17.RCU 25798 ± 4% -42.5% 14846 ± 3% softirqs.CPU170.RCU 25003 ± 4% -39.7% 15066 softirqs.CPU171.RCU 25727 ± 5% -41.9% 14939 ± 2% softirqs.CPU172.RCU 25738 ± 5% -41.1% 15148 softirqs.CPU173.RCU 24954 ± 3% -38.5% 15335 ± 3% softirqs.CPU174.RCU 25876 ± 5% -43.4% 14652 softirqs.CPU175.RCU 26505 ± 9% -41.6% 15491 ± 4% softirqs.CPU176.RCU 26006 ± 2% -40.6% 15459 ± 4% softirqs.CPU177.RCU 26585 ± 2% -42.6% 15250 ± 7% softirqs.CPU178.RCU 26239 ± 3% -41.3% 15392 ± 7% softirqs.CPU179.RCU 26107 ± 3% -42.0% 15146 ± 5% softirqs.CPU18.RCU 26320 ± 4% -40.9% 15548 ± 7% softirqs.CPU180.RCU 26170 ± 7% -42.3% 15093 ± 4% softirqs.CPU181.RCU 9958 ± 3% -7.3% 9236 ± 5% softirqs.CPU182.NET_RX 25566 ± 4% -41.5% 14965 ± 2% softirqs.CPU182.RCU 25797 ± 2% -42.7% 14770 ± 2% softirqs.CPU183.RCU 26296 ± 5% -42.8% 15047 ± 2% softirqs.CPU184.RCU 25473 ± 3% -39.3% 15460 ± 5% softirqs.CPU185.RCU 26082 ± 2% -39.2% 15858 ± 11% softirqs.CPU186.RCU 25806 ± 4% -41.9% 15006 ± 3% softirqs.CPU187.RCU 25467 ± 3% -39.9% 15310 ± 4% softirqs.CPU188.RCU 25282 ± 5% -40.6% 15021 ± 6% softirqs.CPU189.RCU 25951 ± 3% -39.7% 15658 ± 5% softirqs.CPU19.RCU 25224 ± 5% -41.1% 14864 ± 3% softirqs.CPU190.RCU 25308 ± 3% -41.2% 14874 ± 3% softirqs.CPU191.RCU 26403 ± 4% -38.3% 16298 ± 4% softirqs.CPU2.RCU 26010 -41.3% 15265 softirqs.CPU20.RCU 26947 ± 5% -41.5% 15759 ± 3% softirqs.CPU21.RCU 26367 ± 2% -40.2% 15764 ± 6% softirqs.CPU22.RCU 26134 ± 3% -39.4% 15825 ± 7% softirqs.CPU23.RCU 26038 ± 4% -42.8% 14890 ± 4% softirqs.CPU24.RCU 25746 ± 4% -40.7% 15264 ± 2% softirqs.CPU25.RCU 25914 ± 5% -42.4% 14936 ± 2% softirqs.CPU26.RCU 25438 ± 2% -40.8% 15060 ± 3% softirqs.CPU27.RCU 25608 ± 3% -41.2% 15046 ± 3% softirqs.CPU28.RCU 25883 ± 3% -41.7% 15090 softirqs.CPU29.RCU 25870 ± 5% -37.6% 16149 ± 4% softirqs.CPU3.RCU 25723 ± 4% -40.1% 15399 ± 3% softirqs.CPU30.RCU 25557 ± 5% -41.8% 14864 softirqs.CPU31.RCU 26293 ± 3% -42.5% 15131 softirqs.CPU32.RCU 10517 ± 4% -8.9% 9576 ± 4% softirqs.CPU33.NET_RX 26060 ± 3% -41.6% 15207 ± 2% softirqs.CPU33.RCU 25825 ± 4% -42.7% 14785 ± 3% softirqs.CPU34.RCU 25484 ± 2% -41.6% 14890 softirqs.CPU35.RCU 25841 ± 2% -41.3% 15176 ± 5% softirqs.CPU36.RCU 26009 ± 5% -42.6% 14938 ± 3% softirqs.CPU37.RCU 25834 ± 3% -40.2% 15441 softirqs.CPU38.RCU 25732 ± 3% -41.0% 15175 ± 2% softirqs.CPU39.RCU 25727 ± 2% -34.8% 16773 ± 9% softirqs.CPU4.RCU 26054 ± 5% -40.2% 15587 ± 3% softirqs.CPU40.RCU 26052 ± 2% -40.9% 15384 ± 3% softirqs.CPU41.RCU 25749 ± 3% -39.0% 15702 ± 3% softirqs.CPU42.RCU 26182 ± 4% -39.9% 15729 ± 3% softirqs.CPU43.RCU 10068 ± 8% -10.9% 8966 ± 4% softirqs.CPU44.NET_RX 26332 ± 3% -41.7% 15352 ± 2% softirqs.CPU44.RCU 25297 ± 2% -38.9% 15463 ± 2% softirqs.CPU45.RCU 26390 ± 4% -39.7% 15909 ± 2% softirqs.CPU46.RCU 25802 ± 3% -39.4% 15627 ± 3% softirqs.CPU47.RCU 26812 -42.2% 15510 ± 4% softirqs.CPU48.RCU 26393 ± 3% -42.8% 15102 ± 3% softirqs.CPU49.RCU 25646 ± 4% -36.6% 16271 ± 7% softirqs.CPU5.RCU 26722 ± 4% -42.6% 15337 ± 2% softirqs.CPU50.RCU 26122 ± 4% -41.7% 15238 ± 2% softirqs.CPU51.RCU 26093 ± 4% -41.2% 15331 ± 2% softirqs.CPU52.RCU 25751 ± 3% -40.8% 15249 softirqs.CPU53.RCU 26451 -42.7% 15150 ± 4% softirqs.CPU54.RCU 26071 ± 2% -41.7% 15197 softirqs.CPU55.RCU 26390 ± 2% -42.3% 15239 softirqs.CPU56.RCU 26794 -43.7% 15077 ± 2% softirqs.CPU57.RCU 26905 ± 3% -42.8% 15398 softirqs.CPU58.RCU 26392 ± 4% -42.7% 15120 ± 3% softirqs.CPU59.RCU 25879 ± 3% -39.8% 15575 ± 3% softirqs.CPU6.RCU 26053 ± 2% -41.9% 15149 ± 3% softirqs.CPU60.RCU 26082 ± 4% -42.4% 15015 ± 2% softirqs.CPU61.RCU 26550 ± 3% -42.1% 15382 softirqs.CPU62.RCU 26624 -42.3% 15349 softirqs.CPU63.RCU 26086 -42.3% 15061 ± 3% softirqs.CPU64.RCU 26408 ± 3% -42.6% 15171 ± 2% softirqs.CPU65.RCU 26179 ± 4% -42.4% 15086 softirqs.CPU66.RCU 26630 ± 2% -43.5% 15033 ± 4% softirqs.CPU67.RCU 26181 ± 3% -42.6% 15028 ± 4% softirqs.CPU68.RCU 26618 ± 3% -42.9% 15190 ± 2% softirqs.CPU69.RCU 25778 ± 5% -38.3% 15895 ± 4% softirqs.CPU7.RCU 26753 ± 2% -42.8% 15300 ± 2% softirqs.CPU70.RCU 26020 ± 2% -42.3% 15003 softirqs.CPU71.RCU 25989 ± 4% -41.7% 15148 ± 4% softirqs.CPU72.RCU 25313 ± 4% -34.9% 16485 ± 11% softirqs.CPU73.RCU 25311 ± 5% -37.2% 15894 ± 3% softirqs.CPU74.RCU 25704 ± 3% -38.2% 15893 ± 4% softirqs.CPU75.RCU 25640 ± 2% -39.9% 15420 ± 4% softirqs.CPU76.RCU 26039 ± 5% -39.9% 15652 ± 5% softirqs.CPU77.RCU 25951 ± 4% -41.0% 15320 ± 6% softirqs.CPU78.RCU 26019 ± 5% -41.7% 15178 ± 7% softirqs.CPU79.RCU 25532 ± 4% -35.6% 16431 ± 8% softirqs.CPU8.RCU 25895 ± 3% -41.2% 15213 ± 2% softirqs.CPU80.RCU 26200 ± 5% -41.1% 15444 ± 3% softirqs.CPU81.RCU 25833 ± 2% -39.3% 15684 ± 3% softirqs.CPU82.RCU 26218 ± 4% -41.6% 15319 ± 2% softirqs.CPU83.RCU 25989 ± 2% -41.7% 15159 ± 3% softirqs.CPU84.RCU 25784 ± 4% -40.9% 15238 ± 2% softirqs.CPU85.RCU 26282 ± 3% -42.4% 15129 ± 2% softirqs.CPU86.RCU 26422 -41.5% 15448 ± 3% softirqs.CPU87.RCU 26202 ± 4% -42.0% 15208 ± 2% softirqs.CPU88.RCU 26070 ± 2% -40.5% 15513 ± 4% softirqs.CPU89.RCU 26269 ± 2% -39.7% 15845 ± 4% softirqs.CPU9.RCU 26156 ± 5% -42.0% 15183 ± 3% softirqs.CPU90.RCU 26317 ± 2% -41.7% 15344 ± 2% softirqs.CPU91.RCU 26401 ± 5% -42.9% 15066 ± 2% softirqs.CPU92.RCU 26094 ± 5% -41.0% 15388 ± 5% softirqs.CPU93.RCU 26356 ± 5% -43.3% 14935 ± 3% softirqs.CPU94.RCU 26325 ± 5% -40.0% 15793 ± 3% softirqs.CPU95.RCU 25429 ± 2% -36.7% 16087 ± 6% softirqs.CPU96.RCU 25442 ± 3% -36.1% 16257 ± 3% softirqs.CPU97.RCU 25858 ± 3% -38.6% 15874 ± 6% softirqs.CPU98.RCU 25718 ± 3% -40.1% 15413 ± 7% softirqs.CPU99.RCU 4994065 ± 2% -40.9% 2949223 softirqs.RCU 264791 ± 4% +89.0% 500459 interrupts.CAL:Function_call_interrupts 1890 ± 15% +183.4% 5358 ± 25% interrupts.CPU0.CAL:Function_call_interrupts 457.00 ± 7% +173.8% 1251 ± 28% interrupts.CPU0.RES:Rescheduling_interrupts 1623 ± 17% +194.6% 4781 ± 31% interrupts.CPU1.CAL:Function_call_interrupts 102809 ± 3% +11.5% 114605 ± 3% interrupts.CPU1.LOC:Local_timer_interrupts 1317 ± 5% +248.9% 4596 ± 34% interrupts.CPU10.CAL:Function_call_interrupts 471.67 ± 8% +176.7% 1305 ± 32% interrupts.CPU10.RES:Rescheduling_interrupts 1342 ± 8% +259.1% 4820 ± 36% interrupts.CPU100.CAL:Function_call_interrupts 1279 ± 3% +262.5% 4636 ± 31% interrupts.CPU101.CAL:Function_call_interrupts 469.33 +184.2% 1334 ± 27% interrupts.CPU101.RES:Rescheduling_interrupts 1501 ± 20% +201.2% 4522 ± 36% interrupts.CPU102.CAL:Function_call_interrupts 1348 ± 5% +243.0% 4623 ± 35% interrupts.CPU103.CAL:Function_call_interrupts 1433 ± 14% +218.1% 4560 ± 33% interrupts.CPU104.CAL:Function_call_interrupts 487.83 ± 3% +165.4% 1294 ± 29% interrupts.CPU104.RES:Rescheduling_interrupts 1382 ± 8% +239.8% 4697 ± 33% interrupts.CPU105.CAL:Function_call_interrupts 1316 ± 4% +236.8% 4433 ± 35% interrupts.CPU106.CAL:Function_call_interrupts 1317 ± 6% +252.3% 4642 ± 32% interrupts.CPU107.CAL:Function_call_interrupts 480.83 ± 3% +168.2% 1289 ± 28% interrupts.CPU107.RES:Rescheduling_interrupts 1293 ± 6% +239.1% 4385 ± 30% interrupts.CPU108.CAL:Function_call_interrupts 1395 ± 8% +249.5% 4876 ± 33% interrupts.CPU109.CAL:Function_call_interrupts 1394 ± 8% +226.1% 4547 ± 32% interrupts.CPU11.CAL:Function_call_interrupts 99632 +11.7% 111261 ± 4% interrupts.CPU11.LOC:Local_timer_interrupts 1325 ± 8% +213.4% 4154 ± 32% interrupts.CPU110.CAL:Function_call_interrupts 485.83 ± 6% +151.7% 1222 ± 29% interrupts.CPU110.RES:Rescheduling_interrupts 1317 ± 6% +254.2% 4667 ± 35% interrupts.CPU111.CAL:Function_call_interrupts 1319 ± 8% +280.3% 5019 ± 33% interrupts.CPU112.CAL:Function_call_interrupts 480.50 ± 8% +181.1% 1350 ± 31% interrupts.CPU112.RES:Rescheduling_interrupts 1332 ± 6% +243.8% 4580 ± 31% interrupts.CPU113.CAL:Function_call_interrupts 489.00 ± 9% +165.5% 1298 ± 29% interrupts.CPU113.RES:Rescheduling_interrupts 1280 ± 2% +244.6% 4412 ± 35% interrupts.CPU114.CAL:Function_call_interrupts 1316 ± 6% +238.8% 4458 ± 32% interrupts.CPU115.CAL:Function_call_interrupts 485.17 ± 5% +158.5% 1254 ± 28% interrupts.CPU115.RES:Rescheduling_interrupts 1370 ± 7% +272.7% 5107 ± 35% interrupts.CPU116.CAL:Function_call_interrupts 1382 ± 4% +252.4% 4871 ± 32% interrupts.CPU117.CAL:Function_call_interrupts 100326 ± 3% +9.2% 109570 ± 2% interrupts.CPU117.LOC:Local_timer_interrupts 477.17 ± 9% +187.6% 1372 ± 30% interrupts.CPU117.RES:Rescheduling_interrupts 1321 ± 6% +265.6% 4830 ± 32% interrupts.CPU118.CAL:Function_call_interrupts 100478 ± 2% +10.1% 110598 ± 2% interrupts.CPU118.LOC:Local_timer_interrupts 490.67 ± 8% +181.8% 1382 ± 29% interrupts.CPU118.RES:Rescheduling_interrupts 1375 ± 7% +242.4% 4709 ± 33% interrupts.CPU119.CAL:Function_call_interrupts 100440 ± 2% +9.5% 110014 ± 2% interrupts.CPU119.LOC:Local_timer_interrupts 499.67 ± 7% +167.3% 1335 ± 29% interrupts.CPU119.RES:Rescheduling_interrupts 1314 ± 6% +266.6% 4816 ± 34% interrupts.CPU12.CAL:Function_call_interrupts 469.50 ± 4% +185.8% 1342 ± 31% interrupts.CPU12.RES:Rescheduling_interrupts 1380 ± 3% +21.0% 1670 ± 6% interrupts.CPU120.CAL:Function_call_interrupts 1261 ± 7% +26.7% 1598 ± 7% interrupts.CPU123.CAL:Function_call_interrupts 455.50 ± 5% +11.6% 508.33 ± 5% interrupts.CPU123.RES:Rescheduling_interrupts 1334 ± 3% +19.6% 1596 ± 5% interrupts.CPU124.CAL:Function_call_interrupts 1322 ± 5% +22.2% 1615 ± 4% interrupts.CPU125.CAL:Function_call_interrupts 1325 ± 3% +15.2% 1526 ± 3% interrupts.CPU126.CAL:Function_call_interrupts 1316 +21.9% 1604 ± 8% interrupts.CPU127.CAL:Function_call_interrupts 1327 ± 4% +20.5% 1599 ± 5% interrupts.CPU128.CAL:Function_call_interrupts 1326 ± 5% +18.7% 1573 ± 5% interrupts.CPU129.CAL:Function_call_interrupts 1393 ± 7% +211.7% 4342 ± 34% interrupts.CPU13.CAL:Function_call_interrupts 503.50 ± 6% +147.8% 1247 ± 31% interrupts.CPU13.RES:Rescheduling_interrupts 1335 ± 3% +20.3% 1606 ± 5% interrupts.CPU130.CAL:Function_call_interrupts 1340 ± 5% +18.5% 1588 ± 3% interrupts.CPU131.CAL:Function_call_interrupts 1345 ± 4% +18.6% 1595 ± 6% interrupts.CPU132.CAL:Function_call_interrupts 1327 ± 5% +19.4% 1584 ± 2% interrupts.CPU133.CAL:Function_call_interrupts 1305 ± 3% +21.9% 1590 ± 4% interrupts.CPU135.CAL:Function_call_interrupts 461.50 ± 7% +10.9% 511.67 ± 4% interrupts.CPU136.RES:Rescheduling_interrupts 1358 ± 8% +18.3% 1606 ± 4% interrupts.CPU137.CAL:Function_call_interrupts 1333 ± 4% +256.4% 4750 ± 33% interrupts.CPU14.CAL:Function_call_interrupts 429.50 ± 3% +211.8% 1339 ± 30% interrupts.CPU14.RES:Rescheduling_interrupts 460.17 ± 6% +16.8% 537.50 ± 3% interrupts.CPU140.RES:Rescheduling_interrupts 457.83 ± 6% +11.0% 508.17 ± 6% interrupts.CPU141.RES:Rescheduling_interrupts 1330 ± 4% +22.3% 1627 ± 4% interrupts.CPU142.CAL:Function_call_interrupts 1325 ± 3% +22.0% 1617 ± 6% interrupts.CPU143.CAL:Function_call_interrupts 450.00 ± 5% +17.2% 527.50 ± 5% interrupts.CPU143.RES:Rescheduling_interrupts 1349 ± 4% +15.6% 1560 ± 5% interrupts.CPU144.CAL:Function_call_interrupts 1287 ± 3% +39.0% 1789 ± 26% interrupts.CPU145.CAL:Function_call_interrupts 1324 ± 5% +16.8% 1547 ± 4% interrupts.CPU146.CAL:Function_call_interrupts 1312 ± 8% +19.8% 1571 ± 3% interrupts.CPU147.CAL:Function_call_interrupts 436.50 ± 9% +22.4% 534.17 ± 4% interrupts.CPU147.RES:Rescheduling_interrupts 452.83 ± 7% +20.9% 547.33 ± 9% interrupts.CPU148.RES:Rescheduling_interrupts 1369 ± 6% +245.9% 4735 ± 35% interrupts.CPU15.CAL:Function_call_interrupts 469.17 ± 6% +187.2% 1347 ± 33% interrupts.CPU15.RES:Rescheduling_interrupts 1307 ± 6% +18.5% 1548 ± 3% interrupts.CPU150.CAL:Function_call_interrupts 1348 ± 9% +21.7% 1640 ± 9% interrupts.CPU151.CAL:Function_call_interrupts 1315 ± 5% +17.7% 1548 ± 4% interrupts.CPU152.CAL:Function_call_interrupts 1293 ± 5% +23.5% 1597 ± 10% interrupts.CPU154.CAL:Function_call_interrupts 1295 ± 3% +20.3% 1557 ± 11% interrupts.CPU156.CAL:Function_call_interrupts 462.50 ± 7% +13.0% 522.67 ± 6% interrupts.CPU156.RES:Rescheduling_interrupts 1306 ± 6% +21.3% 1584 ± 2% interrupts.CPU157.CAL:Function_call_interrupts 1281 ± 11% +24.4% 1593 ± 5% interrupts.CPU158.CAL:Function_call_interrupts 434.17 ± 5% +22.0% 529.50 ± 4% interrupts.CPU158.RES:Rescheduling_interrupts 1363 ± 7% +13.4% 1546 ± 3% interrupts.CPU159.CAL:Function_call_interrupts 1396 ± 5% +263.5% 5075 ± 37% interrupts.CPU16.CAL:Function_call_interrupts 1317 ± 4% +17.9% 1553 ± 4% interrupts.CPU160.CAL:Function_call_interrupts 471.17 ± 6% +11.5% 525.50 ± 7% interrupts.CPU160.RES:Rescheduling_interrupts 1320 ± 6% +17.6% 1552 ± 4% interrupts.CPU162.CAL:Function_call_interrupts 445.50 ± 6% +16.2% 517.83 ± 3% interrupts.CPU162.RES:Rescheduling_interrupts 1271 ± 3% +24.3% 1580 ± 5% interrupts.CPU163.CAL:Function_call_interrupts 1326 ± 2% +16.7% 1548 ± 3% interrupts.CPU164.CAL:Function_call_interrupts 1291 ± 4% +19.8% 1546 ± 3% interrupts.CPU165.CAL:Function_call_interrupts 1287 ± 6% +21.9% 1569 ± 5% interrupts.CPU166.CAL:Function_call_interrupts 1328 ± 4% +16.4% 1546 ± 8% interrupts.CPU167.CAL:Function_call_interrupts 1350 ± 3% +69.1% 2283 ± 49% interrupts.CPU168.CAL:Function_call_interrupts 482.00 ± 3% +54.3% 743.67 ± 45% interrupts.CPU168.RES:Rescheduling_interrupts 1339 ± 8% +259.1% 4808 ± 30% interrupts.CPU17.CAL:Function_call_interrupts 468.50 ± 7% +190.8% 1362 ± 30% interrupts.CPU17.RES:Rescheduling_interrupts 1382 ± 5% +90.5% 2633 ± 56% interrupts.CPU170.CAL:Function_call_interrupts 1330 ± 7% +89.0% 2514 ± 57% interrupts.CPU171.CAL:Function_call_interrupts 452.33 ± 7% +74.7% 790.17 ± 52% interrupts.CPU171.RES:Rescheduling_interrupts 1331 ± 5% +94.3% 2587 ± 60% interrupts.CPU172.CAL:Function_call_interrupts 1390 ± 7% +85.7% 2582 ± 59% interrupts.CPU173.CAL:Function_call_interrupts 459.00 ± 4% +73.7% 797.33 ± 50% interrupts.CPU173.RES:Rescheduling_interrupts 461.83 ± 4% +74.4% 805.33 ± 55% interrupts.CPU174.RES:Rescheduling_interrupts 1381 ± 10% +81.3% 2505 ± 51% interrupts.CPU175.CAL:Function_call_interrupts 1328 ± 4% +101.1% 2672 ± 50% interrupts.CPU176.CAL:Function_call_interrupts 446.33 ± 2% +73.0% 772.17 ± 50% interrupts.CPU176.RES:Rescheduling_interrupts 1268 ± 10% +90.7% 2418 ± 55% interrupts.CPU177.CAL:Function_call_interrupts 457.83 ± 6% +67.1% 765.00 ± 52% interrupts.CPU177.RES:Rescheduling_interrupts 1386 ± 6% +219.4% 4428 ± 34% interrupts.CPU18.CAL:Function_call_interrupts 477.50 ± 5% +160.5% 1243 ± 31% interrupts.CPU18.RES:Rescheduling_interrupts 1427 ± 8% +89.7% 2707 ± 62% interrupts.CPU180.CAL:Function_call_interrupts 462.50 ± 5% +83.7% 849.83 ± 56% interrupts.CPU180.RES:Rescheduling_interrupts 460.67 ± 6% +81.8% 837.33 ± 56% interrupts.CPU181.RES:Rescheduling_interrupts 1340 ± 3% +87.9% 2519 ± 61% interrupts.CPU182.CAL:Function_call_interrupts 463.17 ± 6% +74.3% 807.33 ± 57% interrupts.CPU182.RES:Rescheduling_interrupts 1374 ± 8% +88.0% 2585 ± 62% interrupts.CPU183.CAL:Function_call_interrupts 455.17 ± 5% +79.9% 819.00 ± 58% interrupts.CPU183.RES:Rescheduling_interrupts 481.00 ± 4% +58.2% 760.83 ± 48% interrupts.CPU184.RES:Rescheduling_interrupts 1346 ± 5% +85.6% 2499 ± 62% interrupts.CPU185.CAL:Function_call_interrupts 472.00 ± 7% +65.0% 778.83 ± 53% interrupts.CPU185.RES:Rescheduling_interrupts 466.00 ± 8% +88.7% 879.33 ± 63% interrupts.CPU187.RES:Rescheduling_interrupts 1379 ± 9% +83.1% 2525 ± 62% interrupts.CPU188.CAL:Function_call_interrupts 466.17 ± 6% +73.5% 808.67 ± 59% interrupts.CPU188.RES:Rescheduling_interrupts 432.83 ± 6% +91.6% 829.17 ± 59% interrupts.CPU189.RES:Rescheduling_interrupts 1363 ± 5% +244.7% 4698 ± 36% interrupts.CPU19.CAL:Function_call_interrupts 1329 ± 3% +100.3% 2662 ± 71% interrupts.CPU190.CAL:Function_call_interrupts 442.17 ± 6% +88.9% 835.17 ± 66% interrupts.CPU190.RES:Rescheduling_interrupts 455.50 ± 3% +76.8% 805.33 ± 53% interrupts.CPU191.RES:Rescheduling_interrupts 1416 ± 6% +211.1% 4405 ± 30% interrupts.CPU2.CAL:Function_call_interrupts 101413 ± 2% +10.4% 111979 ± 2% interrupts.CPU2.LOC:Local_timer_interrupts 456.17 ± 7% +164.0% 1204 ± 28% interrupts.CPU2.RES:Rescheduling_interrupts 1374 ± 4% +230.9% 4548 ± 35% interrupts.CPU20.CAL:Function_call_interrupts 448.67 ± 6% +193.8% 1318 ± 32% interrupts.CPU20.RES:Rescheduling_interrupts 1399 ± 7% +249.4% 4889 ± 32% interrupts.CPU21.CAL:Function_call_interrupts 485.00 ± 8% +177.9% 1347 ± 29% interrupts.CPU21.RES:Rescheduling_interrupts 1379 ± 4% +236.7% 4645 ± 32% interrupts.CPU22.CAL:Function_call_interrupts 492.17 ± 3% +169.5% 1326 ± 29% interrupts.CPU22.RES:Rescheduling_interrupts 1364 ± 9% +234.6% 4565 ± 30% interrupts.CPU23.CAL:Function_call_interrupts 99689 +10.2% 109851 ± 2% interrupts.CPU23.LOC:Local_timer_interrupts 480.17 ± 5% +171.3% 1302 ± 27% interrupts.CPU23.RES:Rescheduling_interrupts 1350 ± 5% +22.8% 1658 ± 9% interrupts.CPU24.CAL:Function_call_interrupts 1337 ± 6% +22.2% 1633 ± 4% interrupts.CPU27.CAL:Function_call_interrupts 1356 ± 3% +18.4% 1606 ± 5% interrupts.CPU28.CAL:Function_call_interrupts 1377 ± 4% +16.5% 1604 ± 2% interrupts.CPU29.CAL:Function_call_interrupts 1302 ± 9% +247.1% 4522 ± 33% interrupts.CPU3.CAL:Function_call_interrupts 100628 +10.0% 110686 ± 2% interrupts.CPU3.LOC:Local_timer_interrupts 438.50 ± 6% +183.9% 1245 ± 31% interrupts.CPU3.RES:Rescheduling_interrupts 1354 ± 4% +17.4% 1590 ± 4% interrupts.CPU31.CAL:Function_call_interrupts 1379 ± 4% +16.6% 1607 ± 5% interrupts.CPU32.CAL:Function_call_interrupts 1381 ± 2% +14.4% 1581 ± 3% interrupts.CPU33.CAL:Function_call_interrupts 1348 ± 4% +18.1% 1592 ± 3% interrupts.CPU34.CAL:Function_call_interrupts 1327 ± 6% +18.4% 1571 ± 4% interrupts.CPU35.CAL:Function_call_interrupts 1340 ± 7% +20.9% 1620 interrupts.CPU36.CAL:Function_call_interrupts 1381 ± 6% +13.6% 1569 ± 5% interrupts.CPU37.CAL:Function_call_interrupts 1337 ± 14% +23.0% 1645 ± 2% interrupts.CPU38.CAL:Function_call_interrupts 1379 ± 6% +16.4% 1605 ± 5% interrupts.CPU39.CAL:Function_call_interrupts 1457 ± 12% +203.1% 4418 ± 29% interrupts.CPU4.CAL:Function_call_interrupts 99772 +9.7% 109413 ± 2% interrupts.CPU4.LOC:Local_timer_interrupts 452.83 ± 4% +174.5% 1242 ± 27% interrupts.CPU4.RES:Rescheduling_interrupts 1369 ± 6% +18.1% 1617 ± 5% interrupts.CPU40.CAL:Function_call_interrupts 455.83 ± 5% +12.1% 510.83 ± 5% interrupts.CPU40.RES:Rescheduling_interrupts 1314 ± 3% +24.7% 1638 ± 9% interrupts.CPU42.CAL:Function_call_interrupts 459.83 ± 3% +17.0% 538.00 ± 10% interrupts.CPU42.RES:Rescheduling_interrupts 1375 ± 5% +24.1% 1708 ± 4% interrupts.CPU43.CAL:Function_call_interrupts 1340 ± 5% +24.9% 1674 ± 5% interrupts.CPU46.CAL:Function_call_interrupts 1372 ± 6% +18.5% 1625 ± 2% interrupts.CPU47.CAL:Function_call_interrupts 1361 ± 5% +19.3% 1623 ± 8% interrupts.CPU49.CAL:Function_call_interrupts 1377 ± 3% +248.2% 4798 ± 32% interrupts.CPU5.CAL:Function_call_interrupts 99543 +9.8% 109308 ± 2% interrupts.CPU5.LOC:Local_timer_interrupts 1362 ± 6% +14.8% 1563 ± 5% interrupts.CPU50.CAL:Function_call_interrupts 1323 ± 6% +16.9% 1547 ± 3% interrupts.CPU53.CAL:Function_call_interrupts 1331 ± 7% +20.7% 1607 ± 10% interrupts.CPU54.CAL:Function_call_interrupts 1391 ± 3% +13.6% 1581 ± 5% interrupts.CPU55.CAL:Function_call_interrupts 1331 ± 5% +18.1% 1573 interrupts.CPU56.CAL:Function_call_interrupts 1378 ± 7% +14.8% 1581 ± 5% interrupts.CPU57.CAL:Function_call_interrupts 1346 ± 6% +17.9% 1588 ± 4% interrupts.CPU58.CAL:Function_call_interrupts 1319 ± 4% +22.5% 1615 ± 6% interrupts.CPU59.CAL:Function_call_interrupts 1328 ± 16% +241.7% 4538 ± 32% interrupts.CPU6.CAL:Function_call_interrupts 99442 +9.7% 109071 ± 2% interrupts.CPU6.LOC:Local_timer_interrupts 1367 ± 6% +19.7% 1636 ± 7% interrupts.CPU62.CAL:Function_call_interrupts 1340 ± 4% +18.8% 1591 ± 5% interrupts.CPU63.CAL:Function_call_interrupts 1352 ± 5% +18.4% 1601 ± 5% interrupts.CPU64.CAL:Function_call_interrupts 1339 ± 5% +16.3% 1557 ± 6% interrupts.CPU68.CAL:Function_call_interrupts 1363 ± 8% +21.4% 1654 ± 9% interrupts.CPU69.CAL:Function_call_interrupts 1451 ± 13% +222.2% 4677 ± 32% interrupts.CPU7.CAL:Function_call_interrupts 1341 ± 6% +20.5% 1616 ± 6% interrupts.CPU70.CAL:Function_call_interrupts 1337 ± 6% +16.8% 1562 ± 3% interrupts.CPU71.CAL:Function_call_interrupts 458.17 ± 5% +59.8% 732.33 ± 51% interrupts.CPU72.RES:Rescheduling_interrupts 458.17 ± 7% +75.6% 804.67 ± 60% interrupts.CPU73.RES:Rescheduling_interrupts 1387 ± 7% +83.6% 2547 ± 58% interrupts.CPU74.CAL:Function_call_interrupts 450.50 ± 6% +74.0% 783.83 ± 54% interrupts.CPU74.RES:Rescheduling_interrupts 1312 ± 12% +94.1% 2547 ± 58% interrupts.CPU75.CAL:Function_call_interrupts 451.00 ± 2% +71.7% 774.50 ± 50% interrupts.CPU75.RES:Rescheduling_interrupts 1356 ± 5% +95.6% 2652 ± 60% interrupts.CPU76.CAL:Function_call_interrupts 1417 ± 6% +86.7% 2645 ± 67% interrupts.CPU77.CAL:Function_call_interrupts 1403 ± 9% +76.1% 2471 ± 56% interrupts.CPU78.CAL:Function_call_interrupts 1368 ± 7% +90.9% 2611 ± 66% interrupts.CPU79.CAL:Function_call_interrupts 1331 ± 7% +249.3% 4651 ± 36% interrupts.CPU8.CAL:Function_call_interrupts 478.67 ± 4% +56.4% 748.50 ± 51% interrupts.CPU80.RES:Rescheduling_interrupts 447.33 ± 7% +80.6% 807.67 ± 56% interrupts.CPU82.RES:Rescheduling_interrupts 469.00 ± 6% +58.5% 743.17 ± 47% interrupts.CPU83.RES:Rescheduling_interrupts 1405 ± 7% +73.9% 2443 ± 55% interrupts.CPU84.CAL:Function_call_interrupts 1389 ± 8% +75.5% 2439 ± 55% interrupts.CPU85.CAL:Function_call_interrupts 459.67 ± 5% +68.3% 773.67 ± 53% interrupts.CPU85.RES:Rescheduling_interrupts 1390 ± 6% +77.9% 2474 ± 54% interrupts.CPU86.CAL:Function_call_interrupts 1441 ± 11% +75.2% 2525 ± 51% interrupts.CPU87.CAL:Function_call_interrupts 1325 ± 6% +89.6% 2513 ± 56% interrupts.CPU88.CAL:Function_call_interrupts 1341 ± 10% +92.9% 2586 ± 61% interrupts.CPU89.CAL:Function_call_interrupts 444.50 ± 2% +83.6% 816.00 ± 57% interrupts.CPU89.RES:Rescheduling_interrupts 1437 ± 8% +214.2% 4516 ± 34% interrupts.CPU9.CAL:Function_call_interrupts 440.00 ± 6% +78.7% 786.33 ± 54% interrupts.CPU90.RES:Rescheduling_interrupts 456.00 ± 8% +67.7% 764.83 ± 50% interrupts.CPU93.RES:Rescheduling_interrupts 1385 ± 5% +77.5% 2459 ± 59% interrupts.CPU94.CAL:Function_call_interrupts 461.33 ± 8% +68.9% 779.17 ± 54% interrupts.CPU94.RES:Rescheduling_interrupts 1383 ± 6% +248.1% 4814 ± 35% interrupts.CPU96.CAL:Function_call_interrupts 449.67 ± 7% +204.6% 1369 ± 31% interrupts.CPU96.RES:Rescheduling_interrupts 1341 ± 5% +257.2% 4792 ± 34% interrupts.CPU97.CAL:Function_call_interrupts 462.67 ± 8% +187.0% 1327 ± 31% interrupts.CPU97.RES:Rescheduling_interrupts 1298 ± 5% +290.5% 5069 ± 33% interrupts.CPU98.CAL:Function_call_interrupts 99241 +9.1% 108246 ± 2% interrupts.CPU98.LOC:Local_timer_interrupts 469.00 ± 6% +198.9% 1402 ± 30% interrupts.CPU98.RES:Rescheduling_interrupts 1319 ± 9% +248.3% 4594 ± 30% interrupts.CPU99.CAL:Function_call_interrupts 99835 +9.5% 109306 ± 2% interrupts.CPU99.LOC:Local_timer_interrupts 468.00 ± 7% +177.7% 1299 ± 24% interrupts.CPU99.RES:Rescheduling_interrupts 90232 +65.4% 149244 interrupts.RES:Rescheduling_interrupts *************************************************************************************************** lkp-skl-fpga01: 104 threads 2 sockets Skylake with 192G memory ========================================================================================= compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-8.3/process/100%/debian-10.4-x86_64-20200603.cgz/lkp-skl-fpga01/fallocate2/will-it-scale/0x2006a0a commit: 3c28c7680e ("memcg: switch lruvec stats to rstat") 45208c9105 ("memcg: infrastructure to flush memcg stats") 3c28c7680e1c39b9 45208c9105bd96015b98cdf31fb ---------------- --------------------------- %stddev %change %stddev \ | \ 2088046 ± 2% -29.8% 1466118 ± 5% will-it-scale.104.processes 20076 ± 2% -29.8% 14096 ± 5% will-it-scale.per_process_ops 2088046 ± 2% -29.8% 1466118 ± 5% will-it-scale.workload 27085 ± 5% +44.5% 39144 ± 4% cpuidle..usage 0.07 ± 2% -0.0 0.04 ± 7% mpstat.cpu.all.soft% 0.80 ± 2% -0.2 0.59 ± 4% mpstat.cpu.all.usr% 1936 +339.0% 8502 vmstat.system.cs 103216 +3.2% 106490 vmstat.system.in 3.057e+08 ± 5% -33.1% 2.046e+08 ± 9% numa-vmstat.node0.numa_hit 3.062e+08 ± 5% -33.1% 2.048e+08 ± 9% numa-vmstat.node0.numa_local 3.177e+08 ± 3% -26.5% 2.334e+08 ± 5% numa-vmstat.node1.numa_hit 3.18e+08 ± 3% -26.5% 2.336e+08 ± 5% numa-vmstat.node1.numa_local 70268 ± 2% -15.6% 59296 ± 3% slabinfo.radix_tree_node.active_objs 1254 ± 2% -15.6% 1058 ± 3% slabinfo.radix_tree_node.active_slabs 70268 ± 2% -15.6% 59296 ± 3% slabinfo.radix_tree_node.num_objs 1254 ± 2% -15.6% 1058 ± 3% slabinfo.radix_tree_node.num_slabs 1206 ±126% +396.1% 5983 ± 25% turbostat.C1 3452 ± 8% +88.7% 6512 ± 5% turbostat.C1E 17274 ± 6% +15.4% 19928 ± 2% turbostat.C6 112.75 +3.3% 116.50 turbostat.RAMWatt 6.174e+08 ± 5% -33.2% 4.124e+08 ± 9% numa-numastat.node0.local_node 6.163e+08 ± 5% -33.1% 4.121e+08 ± 9% numa-numastat.node0.numa_hit 43.83 ± 32% -87.5% 5.50 ± 98% numa-numastat.node0.other_node 6.417e+08 ± 3% -26.7% 4.705e+08 ± 5% numa-numastat.node1.local_node 6.41e+08 ± 3% -26.7% 4.701e+08 ± 5% numa-numastat.node1.numa_hit 670.67 -8.9% 610.67 proc-vmstat.nr_active_anon 18759 -2.5% 18281 proc-vmstat.nr_shmem 32737 -4.8% 31179 proc-vmstat.nr_slab_reclaimable 670.67 -8.9% 610.67 proc-vmstat.nr_zone_active_anon 1.257e+09 ± 2% -29.8% 8.822e+08 ± 5% proc-vmstat.numa_hit 1.259e+09 ± 2% -29.9% 8.83e+08 ± 5% proc-vmstat.numa_local 1.256e+09 ± 2% -29.8% 8.817e+08 ± 5% proc-vmstat.pgalloc_normal 1.256e+09 ± 2% -29.8% 8.817e+08 ± 5% proc-vmstat.pgfree 44687 ± 3% +1022.3% 501516 ± 4% interrupts.CAL:Function_call_interrupts 633.33 +35.2% 856.50 ± 12% interrupts.CPU0.RES:Rescheduling_interrupts 85.17 ± 61% +256.9% 304.00 ± 33% interrupts.CPU1.RES:Rescheduling_interrupts 445.33 ± 20% -36.7% 282.00 ± 3% interrupts.CPU10.CAL:Function_call_interrupts 381.17 ± 18% -24.0% 289.67 ± 7% interrupts.CPU101.CAL:Function_call_interrupts 156.17 ± 84% -90.5% 14.83 ±121% interrupts.CPU101.RES:Rescheduling_interrupts 426.83 ± 30% -33.0% 285.83 interrupts.CPU11.CAL:Function_call_interrupts 99.17 ± 71% +328.4% 424.83 ± 36% interrupts.CPU11.RES:Rescheduling_interrupts 90.00 ± 47% +329.3% 386.33 ± 31% interrupts.CPU12.RES:Rescheduling_interrupts 347.33 ± 12% -19.0% 281.17 ± 3% interrupts.CPU13.CAL:Function_call_interrupts 101.17 ± 58% +189.1% 292.50 ± 42% interrupts.CPU13.RES:Rescheduling_interrupts 532.50 ± 28% -45.8% 288.50 ± 7% interrupts.CPU14.CAL:Function_call_interrupts 84.00 ± 69% +307.7% 342.50 ± 32% interrupts.CPU14.RES:Rescheduling_interrupts 459.83 ± 47% -39.8% 277.00 ± 3% interrupts.CPU15.CAL:Function_call_interrupts 51.83 ± 34% +475.6% 298.33 ± 40% interrupts.CPU15.RES:Rescheduling_interrupts 89.33 ± 30% +262.1% 323.50 ± 30% interrupts.CPU16.RES:Rescheduling_interrupts 435.33 ± 41% -36.6% 276.17 ± 2% interrupts.CPU18.CAL:Function_call_interrupts 95.33 ± 84% +211.4% 296.83 ± 32% interrupts.CPU18.RES:Rescheduling_interrupts 95.50 ± 40% +196.9% 283.50 ± 26% interrupts.CPU19.RES:Rescheduling_interrupts 61.33 ± 27% +387.2% 298.83 ± 26% interrupts.CPU2.RES:Rescheduling_interrupts 59.00 ± 45% +320.3% 248.00 ± 22% interrupts.CPU20.RES:Rescheduling_interrupts 120.67 ± 86% +210.9% 375.17 ± 25% interrupts.CPU21.RES:Rescheduling_interrupts 152.50 ± 77% +151.7% 383.83 ± 27% interrupts.CPU22.RES:Rescheduling_interrupts 77.83 ± 65% +394.2% 384.67 ± 11% interrupts.CPU23.RES:Rescheduling_interrupts 97.67 ± 91% +232.4% 324.67 ± 27% interrupts.CPU24.RES:Rescheduling_interrupts 77.00 ± 64% +298.5% 306.83 ± 38% interrupts.CPU25.RES:Rescheduling_interrupts 51.83 ± 76% -84.6% 8.00 ± 61% interrupts.CPU26.RES:Rescheduling_interrupts 82.00 ± 28% +316.3% 341.33 ± 31% interrupts.CPU3.RES:Rescheduling_interrupts 466.17 ± 28% -38.3% 287.67 ± 4% interrupts.CPU32.CAL:Function_call_interrupts 426.33 ± 22% -30.4% 296.83 ± 7% interrupts.CPU33.CAL:Function_call_interrupts 132.33 ±126% -83.4% 22.00 ± 91% interrupts.CPU36.RES:Rescheduling_interrupts 506.50 ± 34% -41.2% 297.67 ± 6% interrupts.CPU37.CAL:Function_call_interrupts 453.17 ± 55% -37.0% 285.50 ± 6% interrupts.CPU4.CAL:Function_call_interrupts 77.67 ± 28% +382.2% 374.50 ± 26% interrupts.CPU4.RES:Rescheduling_interrupts 118.33 ± 79% -84.2% 18.67 ± 76% interrupts.CPU42.RES:Rescheduling_interrupts 414.83 ± 23% -30.7% 287.67 ± 3% interrupts.CPU45.CAL:Function_call_interrupts 382.50 ± 13% -27.1% 279.00 ± 4% interrupts.CPU49.CAL:Function_call_interrupts 124.00 ± 42% -91.3% 10.83 ± 62% interrupts.CPU49.RES:Rescheduling_interrupts 94.50 ± 49% +378.7% 452.33 ± 36% interrupts.CPU52.RES:Rescheduling_interrupts 328.33 ± 8% -16.9% 272.83 ± 2% interrupts.CPU53.CAL:Function_call_interrupts 63.33 ± 17% +401.3% 317.50 ± 28% interrupts.CPU53.RES:Rescheduling_interrupts 358.00 ± 10% -20.4% 285.00 ± 3% interrupts.CPU54.CAL:Function_call_interrupts 99.67 ± 44% +257.5% 356.33 ± 44% interrupts.CPU54.RES:Rescheduling_interrupts 336.00 ± 9% -15.2% 285.00 ± 4% interrupts.CPU55.CAL:Function_call_interrupts 60.83 ± 27% +474.8% 349.67 ± 22% interrupts.CPU55.RES:Rescheduling_interrupts 388.67 ± 18% -27.1% 283.33 ± 7% interrupts.CPU56.CAL:Function_call_interrupts 85.33 ± 33% +289.5% 332.33 ± 19% interrupts.CPU56.RES:Rescheduling_interrupts 114.83 ± 85% +241.4% 392.00 ± 20% interrupts.CPU57.RES:Rescheduling_interrupts 474.67 ± 20% -40.6% 282.17 ± 4% interrupts.CPU58.CAL:Function_call_interrupts 146.67 ± 39% +136.2% 346.50 ± 34% interrupts.CPU58.RES:Rescheduling_interrupts 395.83 ± 18% -22.9% 305.17 ± 8% interrupts.CPU6.CAL:Function_call_interrupts 112.67 ± 53% +222.3% 363.17 ± 24% interrupts.CPU6.RES:Rescheduling_interrupts 401.50 ± 27% -31.1% 276.83 ± 5% interrupts.CPU60.CAL:Function_call_interrupts 65.00 ± 25% +379.5% 311.67 ± 45% interrupts.CPU60.RES:Rescheduling_interrupts 423.17 ± 18% -30.3% 295.00 ± 11% interrupts.CPU61.CAL:Function_call_interrupts 177.83 ± 79% +148.0% 441.00 ± 61% interrupts.CPU61.RES:Rescheduling_interrupts 458.83 ± 25% -37.5% 286.67 ± 4% interrupts.CPU62.CAL:Function_call_interrupts 146.33 ± 65% +138.7% 349.33 ± 29% interrupts.CPU62.RES:Rescheduling_interrupts 93.50 ± 17% +323.7% 396.17 ± 27% interrupts.CPU63.RES:Rescheduling_interrupts 484.50 ± 21% -40.8% 286.67 ± 4% interrupts.CPU64.CAL:Function_call_interrupts 113.17 ± 37% +243.4% 388.67 ± 25% interrupts.CPU64.RES:Rescheduling_interrupts 377.50 ± 17% -20.8% 298.83 ± 3% interrupts.CPU65.CAL:Function_call_interrupts 82.83 ± 37% +493.4% 491.50 ± 32% interrupts.CPU65.RES:Rescheduling_interrupts 543.67 ± 32% -49.5% 274.33 interrupts.CPU66.CAL:Function_call_interrupts 481.83 ± 44% -41.9% 280.17 ± 6% interrupts.CPU67.CAL:Function_call_interrupts 98.50 ± 68% +234.7% 329.67 ± 33% interrupts.CPU67.RES:Rescheduling_interrupts 136.67 ± 51% +212.7% 427.33 ± 39% interrupts.CPU68.RES:Rescheduling_interrupts 121.83 ± 27% +297.7% 484.50 ± 37% interrupts.CPU69.RES:Rescheduling_interrupts 392.33 ± 21% -27.3% 285.33 ± 5% interrupts.CPU7.CAL:Function_call_interrupts 393.67 ± 25% -33.7% 260.83 ± 31% interrupts.CPU70.CAL:Function_call_interrupts 119.17 ± 63% +232.0% 395.67 ± 23% interrupts.CPU70.RES:Rescheduling_interrupts 81.00 ± 34% +401.0% 405.83 ± 48% interrupts.CPU71.RES:Rescheduling_interrupts 96.50 ± 32% +295.2% 381.33 ± 45% interrupts.CPU73.RES:Rescheduling_interrupts 147.00 ± 60% +183.7% 417.00 ± 33% interrupts.CPU74.RES:Rescheduling_interrupts 68.50 ± 19% +375.9% 326.00 ± 38% interrupts.CPU75.RES:Rescheduling_interrupts 63.33 ± 29% +582.1% 432.00 ± 36% interrupts.CPU76.RES:Rescheduling_interrupts 62.17 ± 46% +540.5% 398.17 ± 63% interrupts.CPU77.RES:Rescheduling_interrupts 364.00 ± 7% -22.2% 283.17 ± 5% interrupts.CPU78.CAL:Function_call_interrupts 71.83 ± 37% -80.0% 14.33 ± 82% interrupts.CPU78.RES:Rescheduling_interrupts 188.50 ± 57% +117.5% 410.00 ± 37% interrupts.CPU8.RES:Rescheduling_interrupts 484.50 ± 23% -41.5% 283.50 ± 2% interrupts.CPU84.CAL:Function_call_interrupts 154.17 ±115% -91.1% 13.67 ± 49% interrupts.CPU84.RES:Rescheduling_interrupts 95.50 ± 97% -76.6% 22.33 ± 91% interrupts.CPU85.RES:Rescheduling_interrupts 507.83 ± 37% -42.2% 293.50 ± 8% interrupts.CPU88.CAL:Function_call_interrupts 137.83 ± 58% -74.8% 34.67 ±128% interrupts.CPU88.RES:Rescheduling_interrupts 463.83 ± 31% -38.1% 287.17 ± 3% interrupts.CPU89.CAL:Function_call_interrupts 580.67 ± 40% -49.7% 292.33 ± 7% interrupts.CPU9.CAL:Function_call_interrupts 91.50 ± 55% +324.8% 388.67 ± 39% interrupts.CPU9.RES:Rescheduling_interrupts 467.83 ± 26% -36.9% 295.17 ± 5% interrupts.CPU91.CAL:Function_call_interrupts 149.17 ± 49% -84.0% 23.83 ± 75% interrupts.CPU91.RES:Rescheduling_interrupts 361.17 ± 10% -19.5% 290.67 ± 6% interrupts.CPU94.CAL:Function_call_interrupts 94.17 ± 19% -72.9% 25.50 ± 79% interrupts.CPU94.RES:Rescheduling_interrupts 502.67 ± 29% -37.4% 314.83 ± 23% interrupts.CPU97.CAL:Function_call_interrupts 13860 ± 7% +3974.9% 564808 ± 8% interrupts.RES:Rescheduling_interrupts 15188 ± 3% -22.4% 11781 ± 4% softirqs.CPU1.RCU 14542 ± 3% -24.0% 11052 ± 7% softirqs.CPU10.RCU 14615 ± 3% -21.6% 11455 ± 4% softirqs.CPU100.RCU 14407 ± 2% -18.1% 11798 ± 2% softirqs.CPU101.RCU 14286 ± 2% -18.3% 11678 ± 5% softirqs.CPU102.RCU 14552 ± 3% -19.2% 11760 ± 3% softirqs.CPU103.RCU 14871 ± 2% -25.7% 11048 ± 5% softirqs.CPU11.RCU 14416 ± 3% -22.7% 11140 ± 6% softirqs.CPU12.RCU 14662 ± 4% -18.2% 11987 ± 10% softirqs.CPU13.RCU 14369 ± 3% -22.3% 11163 ± 5% softirqs.CPU15.RCU 14480 ± 4% -20.8% 11472 ± 5% softirqs.CPU16.RCU 14407 ± 4% -23.4% 11037 ± 6% softirqs.CPU17.RCU 14188 ± 3% -22.0% 11071 ± 6% softirqs.CPU18.RCU 14183 ± 4% -22.4% 11000 ± 5% softirqs.CPU19.RCU 14938 ± 4% -21.6% 11712 ± 7% softirqs.CPU2.RCU 14483 ± 2% -23.5% 11076 ± 6% softirqs.CPU20.RCU 14372 ± 6% -21.9% 11228 ± 7% softirqs.CPU21.RCU 14077 ± 4% -20.5% 11185 ± 7% softirqs.CPU22.RCU 14268 ± 3% -20.7% 11310 ± 7% softirqs.CPU23.RCU 14060 ± 4% -20.0% 11245 ± 6% softirqs.CPU24.RCU 14346 ± 7% -22.5% 11121 ± 6% softirqs.CPU25.RCU 14872 ± 2% -27.8% 10732 ± 29% softirqs.CPU26.RCU 15425 ± 3% -20.8% 12223 ± 4% softirqs.CPU27.RCU 15076 ± 3% -20.1% 12043 ± 2% softirqs.CPU28.RCU 15135 ± 3% -19.6% 12166 softirqs.CPU29.RCU 14495 ± 3% -21.1% 11433 ± 6% softirqs.CPU3.RCU 15070 ± 2% -18.7% 12249 ± 4% softirqs.CPU30.RCU 14958 ± 4% -20.4% 11908 ± 3% softirqs.CPU31.RCU 15297 ± 3% -23.2% 11746 ± 2% softirqs.CPU32.RCU 15203 ± 5% -20.0% 12168 ± 4% softirqs.CPU33.RCU 14952 ± 4% -23.0% 11508 ± 3% softirqs.CPU34.RCU 14837 ± 2% -21.6% 11628 ± 2% softirqs.CPU35.RCU 14769 ± 2% -20.4% 11760 ± 4% softirqs.CPU36.RCU 15200 ± 7% -22.7% 11747 ± 4% softirqs.CPU37.RCU 14682 -20.2% 11723 ± 5% softirqs.CPU38.RCU 14721 ± 3% -20.1% 11764 ± 3% softirqs.CPU39.RCU 14563 ± 5% -22.3% 11309 ± 5% softirqs.CPU4.RCU 14805 ± 3% -21.2% 11672 ± 4% softirqs.CPU40.RCU 14981 ± 2% -23.1% 11517 ± 3% softirqs.CPU42.RCU 14787 ± 4% -22.1% 11515 ± 2% softirqs.CPU43.RCU 14971 ± 2% -21.4% 11768 ± 4% softirqs.CPU44.RCU 14486 ± 2% -29.1% 10267 ± 29% softirqs.CPU45.RCU 14452 ± 2% -18.0% 11849 ± 8% softirqs.CPU46.RCU 14445 ± 2% -16.9% 12002 ± 5% softirqs.CPU47.RCU 14444 -19.5% 11628 ± 2% softirqs.CPU48.RCU 14541 ± 2% -36.3% 9259 ± 41% softirqs.CPU49.RCU 14591 ± 4% -23.8% 11115 ± 5% softirqs.CPU5.RCU 14703 -21.5% 11538 ± 3% softirqs.CPU50.RCU 14641 ± 2% -20.1% 11698 ± 3% softirqs.CPU51.RCU 14488 ± 4% -22.6% 11218 ± 5% softirqs.CPU52.RCU 14401 ± 4% -21.9% 11246 ± 5% softirqs.CPU53.RCU 14902 ± 6% -26.1% 11012 ± 6% softirqs.CPU54.RCU 14624 ± 4% -24.5% 11036 ± 7% softirqs.CPU55.RCU 14451 ± 4% -24.3% 10932 ± 6% softirqs.CPU56.RCU 14637 ± 5% -24.3% 11082 ± 7% softirqs.CPU57.RCU 14757 ± 3% -23.6% 11272 ± 7% softirqs.CPU58.RCU 14685 ± 5% -23.4% 11244 ± 5% softirqs.CPU59.RCU 14398 ± 4% -20.6% 11431 ± 6% softirqs.CPU6.RCU 14508 ± 4% -20.8% 11487 ± 7% softirqs.CPU61.RCU 15398 ± 13% -25.8% 11430 ± 8% softirqs.CPU62.RCU 14973 ± 9% -25.3% 11178 ± 7% softirqs.CPU63.RCU 14516 ± 4% -23.4% 11121 ± 6% softirqs.CPU64.RCU 14323 ± 4% -23.3% 10989 ± 6% softirqs.CPU65.RCU 14362 ± 4% -22.1% 11189 ± 5% softirqs.CPU66.RCU 15049 ± 9% -26.2% 11112 ± 5% softirqs.CPU67.RCU 14736 ± 6% -25.5% 10985 ± 8% softirqs.CPU68.RCU 14975 ± 7% -26.2% 11044 ± 7% softirqs.CPU69.RCU 14364 ± 4% -20.5% 11419 ± 4% softirqs.CPU7.RCU 14456 ± 4% -22.8% 11158 ± 6% softirqs.CPU70.RCU 14244 ± 3% -23.1% 10956 ± 5% softirqs.CPU71.RCU 14245 ± 3% -21.5% 11182 ± 6% softirqs.CPU72.RCU 14682 ± 4% -24.4% 11102 ± 2% softirqs.CPU73.RCU 14350 ± 3% -22.3% 11155 ± 3% softirqs.CPU74.RCU 14362 ± 3% -24.0% 10908 ± 5% softirqs.CPU75.RCU 14362 ± 4% -21.4% 11282 ± 6% softirqs.CPU76.RCU 14940 ± 11% -24.2% 11328 ± 7% softirqs.CPU77.RCU 14848 -31.1% 10232 ± 28% softirqs.CPU78.RCU 14995 ± 3% -21.6% 11752 ± 4% softirqs.CPU79.RCU 14442 ± 4% -21.0% 11414 ± 8% softirqs.CPU8.RCU 15107 ± 2% -22.0% 11780 ± 4% softirqs.CPU80.RCU 14991 ± 3% -22.6% 11605 ± 5% softirqs.CPU81.RCU 15666 ± 10% -26.0% 11596 ± 4% softirqs.CPU82.RCU 14982 ± 2% -19.5% 12054 ± 4% softirqs.CPU83.RCU 14787 ± 2% -21.0% 11687 ± 2% softirqs.CPU84.RCU 14755 ± 2% -20.2% 11780 softirqs.CPU85.RCU 14705 ± 2% -29.1% 10430 ± 26% softirqs.CPU86.RCU 14787 ± 4% -19.0% 11984 ± 2% softirqs.CPU87.RCU 15744 ± 8% -23.9% 11977 ± 6% softirqs.CPU89.RCU 14812 ± 5% -23.9% 11266 ± 9% softirqs.CPU9.RCU 14535 ± 3% -19.8% 11653 ± 4% softirqs.CPU90.RCU 15089 ± 4% -21.8% 11797 ± 4% softirqs.CPU91.RCU 14870 ± 2% -22.1% 11588 ± 4% softirqs.CPU92.RCU 14644 ± 2% -21.2% 11546 ± 4% softirqs.CPU93.RCU 14640 ± 2% -18.2% 11981 ± 5% softirqs.CPU94.RCU 14905 ± 4% -22.5% 11553 ± 3% softirqs.CPU95.RCU 14663 -20.7% 11625 ± 2% softirqs.CPU96.RCU 14527 -17.1% 12049 ± 5% softirqs.CPU97.RCU 14493 -20.1% 11574 ± 3% softirqs.CPU98.RCU 3771 ± 34% +105.1% 7736 ± 73% softirqs.NET_RX 1529389 -21.9% 1194214 ± 3% softirqs.RCU *************************************************************************************************** lkp-csl-2sp6: 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory ========================================================================================= bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/time_based/ucode: 4k/gcc-9/performance/2pmem/xfs/mmap/x86_64-rhel-8.3/50%/debian-10.4-x86_64-20200603.cgz/200s/read/lkp-csl-2sp6/200G/fio-basic/tb/0x5003006 commit: 3c28c7680e ("memcg: switch lruvec stats to rstat") 45208c9105 ("memcg: infrastructure to flush memcg stats") 3c28c7680e1c39b9 45208c9105bd96015b98cdf31fb ---------------- --------------------------- %stddev %change %stddev \ | \ 0.01 +0.0 0.04 ± 8% fio.latency_1000us% 0.02 ± 3% -0.0 0.01 fio.latency_100us% 2.33 +1.2 3.55 ± 2% fio.latency_10us% 0.43 ± 6% +1.0 1.43 ± 13% fio.latency_20us% 0.68 -0.6 0.07 ± 13% fio.latency_250us% 11.97 ± 4% -10.6 1.37 ± 12% fio.latency_2us% 4.66 -3.1 1.57 ± 9% fio.latency_4us% 0.76 +0.4 1.17 ± 2% fio.latency_500us% 0.03 ± 6% +0.0 0.05 ± 18% fio.latency_50us% 0.09 ± 4% +0.2 0.24 ± 13% fio.latency_750us% 18591 -20.5% 14775 fio.read_bw_MBps 1669 -45.0% 918.67 ± 3% fio.read_clat_90%_us 3637 +67.7% 6101 ± 5% fio.read_clat_95%_us 238250 +62.5% 387072 ± 2% fio.read_clat_99%_us 9557 +25.1% 11957 fio.read_clat_mean_us 215796 +12.5% 242714 fio.read_clat_stddev 4759419 -20.5% 3782521 fio.read_iops 7.616e+09 -20.5% 6.053e+09 fio.time.file_system_inputs 682837 -21.8% 534027 fio.time.involuntary_context_switches 14879662 -20.5% 11826133 fio.time.major_page_faults 58692099 -20.5% 46676900 fio.time.minor_page_faults 8631 +4.9% 9052 fio.time.system_time 894.20 -44.7% 494.83 ± 2% fio.time.user_time 9.52e+08 -20.5% 7.566e+08 fio.workload 1486581 ± 3% +148.0% 3687424 ± 2% cpuidle..usage 3711818 -21.5% 2912747 meminfo.PageTables 49.63 -1.9% 48.67 iostat.cpu.idle 45.80 +6.5% 48.79 iostat.cpu.system 4.57 -44.6% 2.53 ± 2% iostat.cpu.user 0.44 -0.1 0.33 mpstat.cpu.all.irq% 0.06 -0.0 0.04 mpstat.cpu.all.soft% 4.61 -2.1 2.55 ± 2% mpstat.cpu.all.usr% 18621814 -20.5% 14811749 vmstat.io.bi 8895 +154.6% 22650 vmstat.system.cs 439187 -13.5% 379872 vmstat.system.in 503.17 ± 19% +50.1% 755.33 ± 5% slabinfo.biovec-max.active_objs 504.17 ± 19% +50.0% 756.00 ± 5% slabinfo.biovec-max.num_objs 275.50 ± 15% +61.7% 445.50 ± 9% slabinfo.kmalloc-cg-16.active_objs 275.50 ± 15% +61.7% 445.50 ± 9% slabinfo.kmalloc-cg-16.num_objs 17984086 ± 5% +8.0% 19426910 ± 3% numa-meminfo.node0.Inactive 17767062 ± 5% +8.0% 19193252 ± 3% numa-meminfo.node0.Inactive(file) 17679188 ± 5% +8.0% 19100304 ± 3% numa-meminfo.node0.Mapped 1785742 ± 5% -16.7% 1488053 ± 4% numa-meminfo.node0.PageTables 1931595 ± 4% -25.5% 1439274 ± 3% numa-meminfo.node1.PageTables 4.423e+08 ± 3% -17.9% 3.632e+08 ± 3% numa-numastat.node0.local_node 31920542 ± 37% -54.7% 14445802 ± 37% numa-numastat.node0.numa_foreign 4.41e+08 ± 3% -17.8% 3.624e+08 ± 3% numa-numastat.node0.numa_hit 4.669e+08 -22.7% 3.609e+08 numa-numastat.node1.local_node 4.657e+08 -22.7% 3.602e+08 numa-numastat.node1.numa_hit 31921822 ± 37% -54.7% 14444762 ± 37% numa-numastat.node1.numa_miss 31928636 ± 37% -54.7% 14460145 ± 37% numa-numastat.node1.other_node 27830 ± 5% +296.1% 110241 ± 3% turbostat.C1 0.02 +0.0 0.07 ± 5% turbostat.C1% 54124 +1717.4% 983655 ± 6% turbostat.C1E 0.11 ± 4% +0.6 0.68 ± 6% turbostat.C1E% 1372362 ± 4% +86.2% 2554977 turbostat.C6 1.75e+08 -15.4% 1.481e+08 turbostat.IRQ 163.06 -4.9% 155.02 turbostat.RAMWatt 4440379 ± 5% +8.1% 4799488 ± 3% numa-vmstat.node0.nr_inactive_file 4414780 ± 5% +8.2% 4776208 ± 3% numa-vmstat.node0.nr_mapped 446302 ± 5% -16.6% 372111 ± 4% numa-vmstat.node0.nr_page_table_pages 4439497 ± 5% +8.1% 4798972 ± 3% numa-vmstat.node0.nr_zone_inactive_file 19891167 ± 36% -49.6% 10033181 ± 42% numa-vmstat.node0.numa_foreign 33407454 ± 6% -20.9% 26410938 ± 5% numa-vmstat.node0.workingset_refault_file 248.33 ± 9% -29.3% 175.50 ± 11% numa-vmstat.node1.nr_isolated_file 482761 ± 4% -25.4% 359901 ± 3% numa-vmstat.node1.nr_page_table_pages 2.436e+08 ± 9% -26.5% 1.792e+08 numa-vmstat.node1.numa_hit 2.441e+08 ± 9% -26.5% 1.795e+08 numa-vmstat.node1.numa_local 19892370 ± 36% -49.6% 10031888 ± 42% numa-vmstat.node1.numa_miss 19905321 ± 36% -49.5% 10052308 ± 41% numa-vmstat.node1.numa_other 38105173 ± 3% -28.7% 27160931 ± 3% numa-vmstat.node1.workingset_refault_file 380561 -21.7% 298026 proc-vmstat.allocstall_movable 11702 ± 5% -42.6% 6718 ± 4% proc-vmstat.allocstall_normal 9743 ± 2% -26.2% 7192 ± 4% proc-vmstat.compact_daemon_wake 12423 -23.0% 9564 proc-vmstat.kswapd_low_wmark_hit_quickly 946132 +2.1% 965912 proc-vmstat.nr_dirty_background_threshold 1894578 +2.1% 1934188 proc-vmstat.nr_dirty_threshold 9839407 +2.0% 10037760 proc-vmstat.nr_file_pages 9240887 +2.1% 9439261 proc-vmstat.nr_inactive_file 455.00 ± 4% -20.9% 359.83 ± 7% proc-vmstat.nr_isolated_file 9183960 +2.0% 9365395 proc-vmstat.nr_mapped 927261 -21.5% 727868 proc-vmstat.nr_page_table_pages 54422 +1.6% 55292 proc-vmstat.nr_slab_unreclaimable 9239985 +2.1% 9438430 proc-vmstat.nr_zone_inactive_file 50193211 ± 2% -25.0% 37634362 ± 4% proc-vmstat.numa_foreign 9.067e+08 -20.3% 7.226e+08 proc-vmstat.numa_hit 9.092e+08 -20.4% 7.241e+08 proc-vmstat.numa_local 50206301 ± 2% -25.0% 37633961 ± 4% proc-vmstat.numa_miss 50211306 ± 2% -25.0% 37654376 ± 4% proc-vmstat.numa_other 12426 -23.0% 9566 proc-vmstat.pageoutrun 35353279 -20.2% 28222154 proc-vmstat.pgalloc_dma32 9.192e+08 -20.5% 7.305e+08 proc-vmstat.pgalloc_normal 89076596 -20.3% 70955687 proc-vmstat.pgfault 9.466e+08 -20.7% 7.504e+08 proc-vmstat.pgfree 2382 ± 16% -43.3% 1351 ± 15% proc-vmstat.pgmigrate_fail 3.808e+09 -20.5% 3.027e+09 proc-vmstat.pgpgin 1242 ± 12% -87.1% 160.33 ± 25% proc-vmstat.pgrotated 8.992e+08 -20.6% 7.136e+08 proc-vmstat.pgscan_direct 9.436e+08 -20.7% 7.478e+08 proc-vmstat.pgscan_file 44448740 ± 2% -22.9% 34259355 ± 5% proc-vmstat.pgscan_kswapd 8.992e+08 -20.6% 7.136e+08 proc-vmstat.pgsteal_direct 9.436e+08 -20.7% 7.478e+08 proc-vmstat.pgsteal_file 44447743 ± 2% -22.9% 34258395 ± 5% proc-vmstat.pgsteal_kswapd 362245 -2.6% 352780 proc-vmstat.workingset_nodes 71386315 -24.9% 53627661 ± 2% proc-vmstat.workingset_refault_file 30417 ± 14% +103.2% 61818 ± 10% softirqs.CPU0.SCHED 13669 ± 25% +173.4% 37373 ± 14% softirqs.CPU1.SCHED 10571 ± 7% -35.3% 6842 ± 6% softirqs.CPU10.RCU 9944 ± 4% -26.7% 7290 ± 8% softirqs.CPU11.RCU 10047 ± 2% -30.0% 7028 ± 9% softirqs.CPU12.RCU 10530 ± 9% -34.5% 6892 ± 7% softirqs.CPU13.RCU 10929 ± 11% -36.1% 6989 ± 9% softirqs.CPU14.RCU 10842 ± 6% -33.3% 7237 ± 14% softirqs.CPU15.RCU 10573 ± 7% -26.3% 7791 ± 12% softirqs.CPU16.RCU 10791 ± 6% -32.4% 7296 ± 6% softirqs.CPU17.RCU 10909 ± 5% -34.1% 7190 ± 13% softirqs.CPU18.RCU 10548 ± 5% -31.9% 7182 ± 9% softirqs.CPU19.RCU 10791 ± 18% +126.0% 24389 ± 8% softirqs.CPU2.SCHED 10850 ± 4% -37.3% 6802 ± 5% softirqs.CPU20.RCU 10989 ± 8% -35.7% 7063 ± 10% softirqs.CPU21.RCU 10680 ± 4% -39.5% 6460 ± 7% softirqs.CPU22.RCU 10584 ± 3% -36.3% 6737 ± 5% softirqs.CPU23.RCU 10848 ± 15% -39.4% 6579 ± 7% softirqs.CPU24.RCU 10717 ± 11% -32.8% 7200 ± 10% softirqs.CPU25.RCU 10890 ± 6% -39.8% 6552 ± 7% softirqs.CPU26.RCU 10144 ± 3% -39.1% 6180 ± 7% softirqs.CPU27.RCU 10421 ± 12% -39.5% 6309 ± 7% softirqs.CPU28.RCU 10541 ± 11% -38.0% 6534 ± 7% softirqs.CPU29.RCU 6497 ± 6% +136.4% 15362 ± 11% softirqs.CPU3.SCHED 10147 ± 7% -37.1% 6381 ± 8% softirqs.CPU30.RCU 10066 ± 3% -37.7% 6271 ± 6% softirqs.CPU31.RCU 9926 ± 4% -31.8% 6774 ± 7% softirqs.CPU32.RCU 10128 ± 8% -40.9% 5988 ± 6% softirqs.CPU33.RCU 10002 -36.5% 6356 ± 5% softirqs.CPU34.RCU 9831 ± 5% -35.0% 6387 ± 7% softirqs.CPU35.RCU 9929 ± 5% -36.7% 6284 ± 9% softirqs.CPU36.RCU 9625 ± 6% -31.1% 6632 ± 9% softirqs.CPU37.RCU 9697 ± 2% -35.9% 6219 ± 7% softirqs.CPU38.RCU 9785 ± 2% -37.7% 6091 ± 8% softirqs.CPU39.RCU 10613 ± 6% -22.0% 8280 ± 9% softirqs.CPU4.RCU 6906 ± 25% +72.3% 11897 ± 20% softirqs.CPU4.SCHED 9591 ± 3% -32.8% 6445 ± 5% softirqs.CPU40.RCU 10392 ± 6% -42.4% 5988 ± 9% softirqs.CPU41.RCU 9357 ± 7% -34.9% 6090 ± 7% softirqs.CPU42.RCU 9621 ± 4% -37.3% 6029 ± 5% softirqs.CPU43.RCU 9479 ± 4% -35.5% 6118 ± 3% softirqs.CPU44.RCU 9983 ± 11% -40.6% 5925 ± 2% softirqs.CPU45.RCU 9386 ± 7% -29.4% 6622 ± 16% softirqs.CPU46.RCU 9826 ± 5% -35.8% 6307 ± 3% softirqs.CPU47.RCU 6035 ± 10% +56.9% 9470 ± 14% softirqs.CPU48.SCHED 6265 ± 18% +116.7% 13577 ± 20% softirqs.CPU49.SCHED 10356 ± 4% -24.2% 7849 ± 8% softirqs.CPU5.RCU 6013 ± 13% +153.5% 15246 ± 20% softirqs.CPU50.SCHED 5989 ± 26% +116.7% 12978 ± 17% softirqs.CPU51.SCHED 4858 ± 19% +80.7% 8777 ± 18% softirqs.CPU54.SCHED 5512 ± 22% +68.5% 9289 ± 26% softirqs.CPU57.SCHED 5076 ± 22% +93.0% 9800 ± 12% softirqs.CPU58.SCHED 5283 ± 14% +84.6% 9753 ± 18% softirqs.CPU59.SCHED 10917 ± 5% -32.0% 7423 ± 14% softirqs.CPU6.RCU 5427 ± 13% +58.6% 8609 ± 23% softirqs.CPU63.SCHED 10294 ± 6% -30.4% 7160 ± 5% softirqs.CPU7.RCU 10436 ± 4% -30.2% 7283 ± 7% softirqs.CPU8.RCU 10199 ± 7% -30.3% 7106 ± 7% softirqs.CPU9.RCU 657813 -26.5% 483765 softirqs.RCU 507909 +42.1% 721610 softirqs.SCHED 78650534 -16.6% 65615247 interrupts.CAL:Function_call_interrupts 988858 ± 3% -14.9% 841729 ± 6% interrupts.CPU0.CAL:Function_call_interrupts 1049528 ± 4% -15.4% 887398 ± 6% interrupts.CPU0.TLB:TLB_shootdowns 1334049 ± 2% -21.9% 1041359 ± 8% interrupts.CPU1.CAL:Function_call_interrupts 311.00 ± 7% -21.6% 243.83 ± 10% interrupts.CPU1.RES:Rescheduling_interrupts 1432589 ± 2% -22.8% 1105917 ± 8% interrupts.CPU1.TLB:TLB_shootdowns 1390885 ± 2% -19.0% 1126751 ± 12% interrupts.CPU10.CAL:Function_call_interrupts 1499586 ± 2% -19.5% 1206979 ± 12% interrupts.CPU10.TLB:TLB_shootdowns 1418858 ± 2% -19.7% 1138727 ± 8% interrupts.CPU11.CAL:Function_call_interrupts 308.00 ± 6% -32.5% 207.83 ± 16% interrupts.CPU11.RES:Rescheduling_interrupts 1529392 ± 2% -20.3% 1218997 ± 9% interrupts.CPU11.TLB:TLB_shootdowns 1414243 ± 3% -16.6% 1178945 ± 5% interrupts.CPU12.CAL:Function_call_interrupts 307.83 ± 8% -38.8% 188.33 ± 4% interrupts.CPU12.RES:Rescheduling_interrupts 1527249 ± 3% -17.4% 1261785 ± 5% interrupts.CPU12.TLB:TLB_shootdowns 1409129 ± 4% -17.3% 1165829 ± 5% interrupts.CPU13.CAL:Function_call_interrupts 310.17 ± 6% -38.7% 190.00 ± 6% interrupts.CPU13.RES:Rescheduling_interrupts 1521052 ± 4% -18.0% 1247909 ± 5% interrupts.CPU13.TLB:TLB_shootdowns 1439233 ± 3% -21.4% 1131648 ± 6% interrupts.CPU14.CAL:Function_call_interrupts 324.17 ± 8% -42.9% 185.17 ± 8% interrupts.CPU14.RES:Rescheduling_interrupts 1555322 ± 4% -22.1% 1211323 ± 6% interrupts.CPU14.TLB:TLB_shootdowns 1449053 ± 4% -17.4% 1196752 ± 2% interrupts.CPU15.CAL:Function_call_interrupts 1566733 ± 3% -18.1% 1282588 ± 2% interrupts.CPU15.TLB:TLB_shootdowns 1430567 ± 4% -16.6% 1193802 ± 5% interrupts.CPU16.CAL:Function_call_interrupts 313.00 ± 6% -37.4% 196.00 ± 14% interrupts.CPU16.RES:Rescheduling_interrupts 1546623 ± 4% -17.3% 1279267 ± 5% interrupts.CPU16.TLB:TLB_shootdowns 1434433 ± 4% -15.7% 1208905 ± 5% interrupts.CPU17.CAL:Function_call_interrupts 313.00 ± 8% -41.0% 184.67 ± 7% interrupts.CPU17.RES:Rescheduling_interrupts 1551484 ± 4% -16.5% 1296043 ± 5% interrupts.CPU17.TLB:TLB_shootdowns 1445252 -18.7% 1175666 ± 7% interrupts.CPU18.CAL:Function_call_interrupts 306.83 ± 6% -38.1% 190.00 ± 5% interrupts.CPU18.RES:Rescheduling_interrupts 1564626 -19.4% 1261427 ± 7% interrupts.CPU18.TLB:TLB_shootdowns 1419537 ± 2% -17.7% 1168024 ± 5% interrupts.CPU19.CAL:Function_call_interrupts 308.67 ± 7% -38.6% 189.50 ± 7% interrupts.CPU19.RES:Rescheduling_interrupts 1536747 ± 2% -18.6% 1250514 ± 5% interrupts.CPU19.TLB:TLB_shootdowns 1338470 ± 3% -20.1% 1069965 ± 6% interrupts.CPU2.CAL:Function_call_interrupts 1439853 ± 3% -20.9% 1139087 ± 6% interrupts.CPU2.TLB:TLB_shootdowns 1424763 ± 3% -17.0% 1182036 ± 6% interrupts.CPU20.CAL:Function_call_interrupts 308.00 ± 8% -37.5% 192.50 ± 4% interrupts.CPU20.RES:Rescheduling_interrupts 1541870 ± 3% -17.8% 1267081 ± 6% interrupts.CPU20.TLB:TLB_shootdowns 1471426 ± 3% -20.4% 1170980 ± 6% interrupts.CPU21.CAL:Function_call_interrupts 308.17 ± 10% -35.8% 197.83 ± 9% interrupts.CPU21.RES:Rescheduling_interrupts 1594182 ± 3% -21.1% 1257154 ± 6% interrupts.CPU21.TLB:TLB_shootdowns 1435799 ± 2% -20.2% 1145135 ± 3% interrupts.CPU22.CAL:Function_call_interrupts 303.67 ± 7% -40.6% 180.50 ± 7% interrupts.CPU22.RES:Rescheduling_interrupts 1555228 ± 2% -21.0% 1228025 ± 3% interrupts.CPU22.TLB:TLB_shootdowns 1466708 ± 2% -18.7% 1192024 ± 2% interrupts.CPU23.CAL:Function_call_interrupts 314.67 ± 7% -40.5% 187.33 ± 4% interrupts.CPU23.RES:Rescheduling_interrupts 1589528 ± 2% -19.5% 1279255 ± 2% interrupts.CPU23.TLB:TLB_shootdowns 1431127 ± 3% -20.5% 1137256 ± 5% interrupts.CPU24.CAL:Function_call_interrupts 271.67 ± 3% -35.7% 174.67 ± 11% interrupts.CPU24.RES:Rescheduling_interrupts 1553935 ± 3% -21.2% 1224546 ± 5% interrupts.CPU24.TLB:TLB_shootdowns 1433507 ± 4% -13.6% 1238841 ± 4% interrupts.CPU25.CAL:Function_call_interrupts 270.00 ± 4% -39.6% 163.17 ± 13% interrupts.CPU25.RES:Rescheduling_interrupts 1555624 ± 4% -14.2% 1334409 ± 4% interrupts.CPU25.TLB:TLB_shootdowns 1468743 ± 2% -17.4% 1213301 ± 4% interrupts.CPU26.CAL:Function_call_interrupts 267.50 ± 4% -37.3% 167.67 ± 6% interrupts.CPU26.RES:Rescheduling_interrupts 1592824 ± 2% -17.9% 1307649 ± 4% interrupts.CPU26.TLB:TLB_shootdowns 1458323 ± 3% -17.8% 1199225 ± 3% interrupts.CPU27.CAL:Function_call_interrupts 261.00 ± 3% -39.8% 157.17 ± 9% interrupts.CPU27.RES:Rescheduling_interrupts 1582935 ± 3% -18.4% 1292170 ± 3% interrupts.CPU27.TLB:TLB_shootdowns 1428512 ± 3% -16.8% 1188963 ± 3% interrupts.CPU28.CAL:Function_call_interrupts 265.17 ± 5% -37.3% 166.33 ± 5% interrupts.CPU28.RES:Rescheduling_interrupts 1550555 ± 3% -17.6% 1278419 ± 3% interrupts.CPU28.TLB:TLB_shootdowns 1457355 ± 3% -16.7% 1214406 ± 5% interrupts.CPU29.CAL:Function_call_interrupts 266.33 ± 3% -39.2% 162.00 ± 7% interrupts.CPU29.RES:Rescheduling_interrupts 1582840 ± 4% -17.4% 1307750 ± 6% interrupts.CPU29.TLB:TLB_shootdowns 1325204 ± 4% -17.7% 1091164 ± 2% interrupts.CPU3.CAL:Function_call_interrupts 303.50 ± 5% -34.0% 200.33 ± 7% interrupts.CPU3.RES:Rescheduling_interrupts 1424459 ± 4% -18.2% 1164881 ± 2% interrupts.CPU3.TLB:TLB_shootdowns 1454064 ± 4% -19.4% 1172155 ± 3% interrupts.CPU30.CAL:Function_call_interrupts 265.67 ± 4% -35.6% 171.00 ± 8% interrupts.CPU30.RES:Rescheduling_interrupts 1579354 ± 4% -20.1% 1261126 ± 3% interrupts.CPU30.TLB:TLB_shootdowns 1415837 ± 3% -16.1% 1187663 ± 4% interrupts.CPU31.CAL:Function_call_interrupts 262.33 ± 5% -39.3% 159.17 ± 6% interrupts.CPU31.RES:Rescheduling_interrupts 1535893 ± 4% -16.9% 1276448 ± 5% interrupts.CPU31.TLB:TLB_shootdowns 1437703 ± 5% -14.5% 1229555 ± 5% interrupts.CPU32.CAL:Function_call_interrupts 259.67 ± 3% -31.3% 178.33 ± 8% interrupts.CPU32.RES:Rescheduling_interrupts 1560048 ± 5% -15.1% 1324601 ± 5% interrupts.CPU32.TLB:TLB_shootdowns 1439956 ± 3% -18.0% 1180837 ± 4% interrupts.CPU33.CAL:Function_call_interrupts 261.17 ± 6% -34.3% 171.67 ± 8% interrupts.CPU33.RES:Rescheduling_interrupts 1564216 ± 3% -18.7% 1271333 ± 4% interrupts.CPU33.TLB:TLB_shootdowns 1476314 ± 3% -21.7% 1155912 ± 5% interrupts.CPU34.CAL:Function_call_interrupts 266.83 ± 5% -37.4% 167.17 ± 10% interrupts.CPU34.RES:Rescheduling_interrupts 1603441 ± 2% -22.5% 1243240 ± 5% interrupts.CPU34.TLB:TLB_shootdowns 1429134 ± 4% -17.2% 1183314 ± 2% interrupts.CPU35.CAL:Function_call_interrupts 261.33 ± 3% -38.6% 160.50 ± 4% interrupts.CPU35.RES:Rescheduling_interrupts 1551878 ± 4% -18.1% 1271640 ± 2% interrupts.CPU35.TLB:TLB_shootdowns 1406381 ± 6% -14.7% 1199533 ± 3% interrupts.CPU36.CAL:Function_call_interrupts 253.17 ± 6% -32.8% 170.17 ± 7% interrupts.CPU36.RES:Rescheduling_interrupts 1525844 ± 5% -15.4% 1290509 ± 4% interrupts.CPU36.TLB:TLB_shootdowns 1407224 -18.0% 1153322 ± 2% interrupts.CPU37.CAL:Function_call_interrupts 253.17 ± 5% -33.4% 168.50 ± 10% interrupts.CPU37.RES:Rescheduling_interrupts 1527261 -18.8% 1239476 ± 2% interrupts.CPU37.TLB:TLB_shootdowns 1444605 ± 2% -18.7% 1174607 ± 4% interrupts.CPU38.CAL:Function_call_interrupts 264.00 ± 6% -39.6% 159.33 ± 7% interrupts.CPU38.RES:Rescheduling_interrupts 1570372 ± 2% -19.5% 1263660 ± 4% interrupts.CPU38.TLB:TLB_shootdowns 1396988 ± 4% -18.2% 1143157 ± 4% interrupts.CPU39.CAL:Function_call_interrupts 252.83 ± 7% -36.1% 161.50 ± 7% interrupts.CPU39.RES:Rescheduling_interrupts 1516658 ± 3% -19.2% 1226146 ± 4% interrupts.CPU39.TLB:TLB_shootdowns 1356025 ± 5% -19.8% 1088038 ± 5% interrupts.CPU4.CAL:Function_call_interrupts 301.33 ± 7% -30.0% 211.00 ± 12% interrupts.CPU4.RES:Rescheduling_interrupts 1460306 ± 5% -20.5% 1161158 ± 5% interrupts.CPU4.TLB:TLB_shootdowns 1410219 ± 4% -16.0% 1184073 ± 4% interrupts.CPU40.CAL:Function_call_interrupts 259.83 ± 8% -39.1% 158.33 ± 3% interrupts.CPU40.RES:Rescheduling_interrupts 1533100 ± 4% -16.9% 1273789 ± 4% interrupts.CPU40.TLB:TLB_shootdowns 1405516 ± 5% -17.7% 1156352 interrupts.CPU41.CAL:Function_call_interrupts 252.33 ± 9% -35.9% 161.83 ± 11% interrupts.CPU41.RES:Rescheduling_interrupts 1527602 ± 5% -18.7% 1241629 interrupts.CPU41.TLB:TLB_shootdowns 1352056 ± 5% -12.7% 1179830 ± 2% interrupts.CPU42.CAL:Function_call_interrupts 254.83 ± 8% -34.3% 167.33 ± 7% interrupts.CPU42.RES:Rescheduling_interrupts 1468738 ± 5% -13.7% 1267766 ± 2% interrupts.CPU42.TLB:TLB_shootdowns 1401031 ± 5% -14.9% 1191900 ± 3% interrupts.CPU43.CAL:Function_call_interrupts 254.17 ± 7% -37.9% 157.83 ± 9% interrupts.CPU43.RES:Rescheduling_interrupts 1520942 ± 5% -15.7% 1282218 ± 3% interrupts.CPU43.TLB:TLB_shootdowns 1388453 ± 4% -15.6% 1171886 ± 3% interrupts.CPU44.CAL:Function_call_interrupts 249.83 ± 8% -35.3% 161.67 ± 6% interrupts.CPU44.RES:Rescheduling_interrupts 1508096 ± 4% -16.4% 1260582 ± 3% interrupts.CPU44.TLB:TLB_shootdowns 253.50 ± 8% -39.8% 152.67 ± 9% interrupts.CPU45.RES:Rescheduling_interrupts 1365517 ± 6% -13.3% 1183501 ± 3% interrupts.CPU46.CAL:Function_call_interrupts 248.00 ± 8% -36.9% 156.50 ± 6% interrupts.CPU46.RES:Rescheduling_interrupts 1483742 ± 6% -14.3% 1271569 ± 3% interrupts.CPU46.TLB:TLB_shootdowns 1364673 ± 4% -18.5% 1111981 ± 7% interrupts.CPU47.CAL:Function_call_interrupts 1483542 ± 4% -19.5% 1194517 ± 7% interrupts.CPU47.TLB:TLB_shootdowns 662922 ± 12% -24.0% 503833 ± 10% interrupts.CPU48.CAL:Function_call_interrupts 174.00 ± 13% -22.2% 135.33 ± 15% interrupts.CPU48.RES:Rescheduling_interrupts 718349 ± 12% -24.5% 542164 ± 10% interrupts.CPU48.TLB:TLB_shootdowns 71091 ± 12% +35.7% 96498 ± 8% interrupts.CPU49.LOC:Local_timer_interrupts 1409966 ± 3% -21.2% 1110773 interrupts.CPU5.CAL:Function_call_interrupts 314.67 ± 6% -40.3% 188.00 ± 9% interrupts.CPU5.RES:Rescheduling_interrupts 1517779 ± 3% -21.9% 1185956 interrupts.CPU5.TLB:TLB_shootdowns 69197 ± 15% +33.7% 92518 ± 7% interrupts.CPU50.LOC:Local_timer_interrupts 68632 ± 12% +28.6% 88287 ± 9% interrupts.CPU51.LOC:Local_timer_interrupts 59430 ± 12% +48.6% 88319 ± 5% interrupts.CPU52.LOC:Local_timer_interrupts 51452 ± 13% +63.5% 84137 ± 6% interrupts.CPU53.LOC:Local_timer_interrupts 51703 ± 11% +62.5% 84010 ± 16% interrupts.CPU54.LOC:Local_timer_interrupts 63465 ± 10% +28.4% 81460 ± 9% interrupts.CPU55.LOC:Local_timer_interrupts 56380 ± 23% +55.2% 87501 ± 8% interrupts.CPU56.LOC:Local_timer_interrupts 57485 ± 22% +36.1% 78226 ± 16% interrupts.CPU57.LOC:Local_timer_interrupts 56560 ± 12% +48.5% 83990 ± 19% interrupts.CPU58.LOC:Local_timer_interrupts 56164 ± 13% +56.2% 87712 ± 19% interrupts.CPU59.LOC:Local_timer_interrupts 1430835 ± 3% -23.3% 1097317 ± 7% interrupts.CPU6.CAL:Function_call_interrupts 318.67 ± 7% -37.8% 198.33 ± 15% interrupts.CPU6.RES:Rescheduling_interrupts 1542877 ± 3% -24.0% 1172358 ± 8% interrupts.CPU6.TLB:TLB_shootdowns 55544 ± 16% +43.1% 79503 ± 12% interrupts.CPU60.LOC:Local_timer_interrupts 54663 ± 13% +42.1% 77655 ± 18% interrupts.CPU61.LOC:Local_timer_interrupts 45684 ± 32% +66.6% 76094 ± 17% interrupts.CPU62.LOC:Local_timer_interrupts 55445 ± 19% +24.1% 68823 ± 7% interrupts.CPU63.LOC:Local_timer_interrupts 46302 ± 26% +56.7% 72570 ± 22% interrupts.CPU64.LOC:Local_timer_interrupts 42591 ± 20% +60.0% 68132 ± 21% interrupts.CPU66.LOC:Local_timer_interrupts 43020 ± 15% +56.4% 67302 ± 10% interrupts.CPU67.LOC:Local_timer_interrupts 1350753 ± 4% -17.6% 1113032 ± 5% interrupts.CPU7.CAL:Function_call_interrupts 302.50 ± 6% -37.4% 189.50 ± 13% interrupts.CPU7.RES:Rescheduling_interrupts 1454116 ± 4% -18.3% 1188584 ± 5% interrupts.CPU7.TLB:TLB_shootdowns 48307 ± 27% +40.5% 67894 ± 7% interrupts.CPU70.LOC:Local_timer_interrupts 56662 ± 11% +33.2% 75478 ± 13% interrupts.CPU72.LOC:Local_timer_interrupts 53173 ± 15% +33.7% 71082 ± 16% interrupts.CPU74.LOC:Local_timer_interrupts 62.83 ± 25% +115.6% 135.50 ± 28% interrupts.CPU74.RES:Rescheduling_interrupts 47427 ± 20% +52.0% 72088 ± 8% interrupts.CPU75.LOC:Local_timer_interrupts 63.17 ± 21% +106.6% 130.50 ± 35% interrupts.CPU75.RES:Rescheduling_interrupts 51703 ± 11% +53.3% 79238 ± 8% interrupts.CPU76.LOC:Local_timer_interrupts 58.50 ± 23% +139.0% 139.83 ± 29% interrupts.CPU76.RES:Rescheduling_interrupts 48.17 ± 13% +140.8% 116.00 ± 41% interrupts.CPU77.RES:Rescheduling_interrupts 64.00 ± 13% +121.9% 142.00 ± 36% interrupts.CPU79.RES:Rescheduling_interrupts 1406043 ± 2% -20.5% 1117455 ± 7% interrupts.CPU8.CAL:Function_call_interrupts 307.17 ± 7% -34.8% 200.17 ± 8% interrupts.CPU8.RES:Rescheduling_interrupts 1516350 ± 2% -21.2% 1195355 ± 7% interrupts.CPU8.TLB:TLB_shootdowns 50.50 ± 9% +97.4% 99.67 ± 27% interrupts.CPU81.RES:Rescheduling_interrupts 45196 ± 10% +30.2% 58849 ± 22% interrupts.CPU89.LOC:Local_timer_interrupts 1400891 ± 7% -18.5% 1141448 ± 9% interrupts.CPU9.CAL:Function_call_interrupts 303.33 ± 7% -31.8% 207.00 ± 6% interrupts.CPU9.RES:Rescheduling_interrupts 1510923 ± 7% -19.1% 1222700 ± 9% interrupts.CPU9.TLB:TLB_shootdowns 85262776 -17.3% 70528541 interrupts.TLB:TLB_shootdowns *************************************************************************************************** lkp-ivb-2ep1: 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory ========================================================================================= compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-8.3/process/50%/debian-10.4-x86_64-20200603.cgz/lkp-ivb-2ep1/page_fault3/will-it-scale/0x42e commit: 3c28c7680e ("memcg: switch lruvec stats to rstat") 45208c9105 ("memcg: infrastructure to flush memcg stats") 3c28c7680e1c39b9 45208c9105bd96015b98cdf31fb ---------------- --------------------------- %stddev %change %stddev \ | \ 20026054 -9.2% 18192748 will-it-scale.24.processes 49.30 -4.4% 47.15 will-it-scale.24.processes_idle 834418 -9.2% 758030 will-it-scale.per_process_ops 20026054 -9.2% 18192748 will-it-scale.workload 1643 +1.7% 1671 boot-time.idle 1264 ± 3% +2506.3% 32948 vmstat.system.cs 0.04 ± 3% -0.0 0.04 ± 3% mpstat.cpu.all.soft% 33.28 +3.4 36.73 mpstat.cpu.all.sys% 6697099 -9.1% 6089215 ± 3% numa-numastat.node0.local_node 6729005 -9.1% 6117714 ± 3% numa-numastat.node0.numa_hit 100607 ± 5% +7365.6% 7510975 ± 42% turbostat.C1 0.02 +2.6 2.64 ± 38% turbostat.C1% 23.26 +3.6% 24.10 turbostat.RAMWatt 51483 +27.9% 65867 ± 18% interrupts.CAL:Function_call_interrupts 732.67 ± 12% +128.3% 1672 ± 25% interrupts.CPU0.CAL:Function_call_interrupts 123.00 ± 35% +85.9% 228.67 ± 27% interrupts.CPU19.RES:Rescheduling_interrupts 137.17 ± 38% +65.5% 227.00 ± 20% interrupts.CPU30.RES:Rescheduling_interrupts 988.83 ± 8% +50.6% 1489 ± 31% interrupts.CPU34.CAL:Function_call_interrupts 81.50 ± 65% +175.9% 224.83 ± 49% interrupts.CPU38.RES:Rescheduling_interrupts 980.17 ± 5% +27.8% 1252 ± 21% interrupts.CPU43.CAL:Function_call_interrupts 158.83 ± 41% +211.1% 494.17 ± 74% interrupts.CPU8.RES:Rescheduling_interrupts 48.67 ± 20% +126.7% 110.33 ± 7% interrupts.IWI:IRQ_work_interrupts 8584 +84.5% 15840 ± 7% interrupts.RES:Rescheduling_interrupts 422.67 ± 12% +73.2% 732.00 ± 14% interrupts.TLB:TLB_shootdowns 794314 +2.5% 814404 proc-vmstat.nr_active_anon 1438636 +1.5% 1459995 proc-vmstat.nr_file_pages 65358 +2.3% 66843 proc-vmstat.nr_inactive_anon 797612 +2.7% 818972 proc-vmstat.nr_shmem 794314 +2.5% 814404 proc-vmstat.nr_zone_active_anon 65358 +2.3% 66843 proc-vmstat.nr_zone_inactive_anon 13454807 -7.9% 12398029 proc-vmstat.numa_hit 13412580 -7.9% 12356302 proc-vmstat.numa_local 810871 +3.7% 840819 proc-vmstat.pgactivate 13458718 -7.8% 12403835 proc-vmstat.pgalloc_normal 6.024e+09 -9.2% 5.472e+09 proc-vmstat.pgfault 13470733 -8.1% 12383043 proc-vmstat.pgfree 15908 ± 19% -41.2% 9349 ± 12% softirqs.CPU0.RCU 19265 ± 21% -55.8% 8522 ± 26% softirqs.CPU1.RCU 15999 ± 23% -52.2% 7640 ± 20% softirqs.CPU10.RCU 19017 ± 18% -59.4% 7717 ± 26% softirqs.CPU11.RCU 12663 ± 26% -53.2% 5926 ± 13% softirqs.CPU12.RCU 14585 ± 27% -59.3% 5939 ± 12% softirqs.CPU13.RCU 16228 ± 18% -65.9% 5528 ± 9% softirqs.CPU14.RCU 15967 ± 22% -63.7% 5788 ± 13% softirqs.CPU15.RCU 16060 ± 23% -60.1% 6409 ± 17% softirqs.CPU16.RCU 15778 ± 18% -55.7% 6995 ± 14% softirqs.CPU17.RCU 14621 ± 29% -58.9% 6016 ± 17% softirqs.CPU18.RCU 13909 ± 23% -54.1% 6380 ± 16% softirqs.CPU19.RCU 18169 ± 12% -49.1% 9256 ± 28% softirqs.CPU2.RCU 16791 ± 41% -61.3% 6496 ± 16% softirqs.CPU20.RCU 15333 ± 24% -58.2% 6415 ± 9% softirqs.CPU21.RCU 17348 ± 25% -62.3% 6536 ± 14% softirqs.CPU22.RCU 14493 ± 27% -59.0% 5945 ± 13% softirqs.CPU23.RCU 19152 ± 25% -60.3% 7595 ± 20% softirqs.CPU24.RCU 16181 ± 34% -60.4% 6401 ± 19% softirqs.CPU25.RCU 18010 ± 25% -56.9% 7760 ± 20% softirqs.CPU26.RCU 16607 ± 30% -62.4% 6244 ± 10% softirqs.CPU27.RCU 16031 ± 28% -57.8% 6757 ± 20% softirqs.CPU28.RCU 16062 ± 29% -55.2% 7194 ± 31% softirqs.CPU29.RCU 18414 ± 12% -55.8% 8134 ± 22% softirqs.CPU3.RCU 17072 ± 26% -57.1% 7315 ± 24% softirqs.CPU30.RCU 17618 ± 28% -62.2% 6668 ± 22% softirqs.CPU31.RCU 17362 ± 27% -54.6% 7890 ± 32% softirqs.CPU32.RCU 15579 ± 16% -58.0% 6535 ± 17% softirqs.CPU33.RCU 17030 ± 15% -59.2% 6949 ± 19% softirqs.CPU34.RCU 14135 ± 28% -51.2% 6901 ± 20% softirqs.CPU35.RCU 16851 ± 10% -63.5% 6152 ± 15% softirqs.CPU36.RCU 16024 ± 31% -64.5% 5683 ± 16% softirqs.CPU37.RCU 13188 ± 29% -51.6% 6386 ± 14% softirqs.CPU38.RCU 14665 ± 29% -58.7% 6056 ± 15% softirqs.CPU39.RCU 18800 ± 19% -55.3% 8408 ± 23% softirqs.CPU4.RCU 15193 ± 24% -60.7% 5964 ± 12% softirqs.CPU40.RCU 16115 ± 26% -60.5% 6361 ± 12% softirqs.CPU41.RCU 16555 ± 24% -60.8% 6495 ± 16% softirqs.CPU42.RCU 17772 ± 21% -64.6% 6297 ± 8% softirqs.CPU43.RCU 15530 ± 15% -61.0% 6055 ± 11% softirqs.CPU44.RCU 15596 ± 22% -63.7% 5658 ± 10% softirqs.CPU45.RCU 14790 ± 27% -59.6% 5974 ± 15% softirqs.CPU46.RCU 17855 ± 23% -60.8% 6992 ± 9% softirqs.CPU47.RCU 20701 ± 9% -54.3% 9458 ± 7% softirqs.CPU5.RCU 17855 ± 9% -63.0% 6602 ± 27% softirqs.CPU6.RCU 17439 ± 19% -52.8% 8224 ± 24% softirqs.CPU7.RCU 16394 ± 11% -55.0% 7372 ± 23% softirqs.CPU8.RCU 17501 ± 18% -57.8% 7388 ± 20% softirqs.CPU9.RCU 790243 ± 16% -58.1% 330757 ± 12% softirqs.RCU 29941 ± 6% +68.4% 50414 softirqs.TIMER 0.02 ± 3% -27.5% 0.01 ± 11% perf-sched.sch_delay.avg.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown] 0.01 ± 5% -17.4% 0.01 ± 7% perf-sched.sch_delay.avg.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64 0.01 ± 3% -16.2% 0.01 ± 4% perf-sched.sch_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 0.01 ± 20% -61.3% 0.00 ± 62% perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.01 ± 13% -40.0% 0.01 ± 11% perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.sched_exec.bprm_execve 0.01 ± 17% -63.6% 0.00 perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 0.01 ± 4% -15.7% 0.01 ± 9% perf-sched.sch_delay.avg.ms.schedule_timeout.kcompactd.kthread.ret_from_fork 0.05 ± 19% -87.5% 0.01 perf-sched.sch_delay.avg.ms.worker_thread.kthread.ret_from_fork 0.05 ± 13% -54.7% 0.02 ± 61% perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.sched_exec.bprm_execve 0.01 ± 10% -47.8% 0.01 perf-sched.total_sch_delay.average.ms 192.65 ± 3% -96.2% 7.38 perf-sched.total_wait_and_delay.average.ms 6360 ± 3% +2476.2% 163865 perf-sched.total_wait_and_delay.count.ms 192.64 ± 3% -96.2% 7.37 perf-sched.total_wait_time.average.ms 1.29 ± 4% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 0.03 ± 12% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown] 0.05 ± 9% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown] 0.04 ± 7% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.05 ± 68% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.shmem_getpage_gfp.shmem_fault 0.08 ±128% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.zap_pte_range.unmap_page_range.unmap_vmas 2.77 ± 8% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.rcu_gp_kthread.kthread.ret_from_fork 631.12 ± 14% -57.5% 268.47 ± 6% perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 13.63 ± 18% -65.2% 4.74 ± 8% perf-sched.wait_and_delay.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 648.74 -99.6% 2.70 ± 2% perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork 245.67 -100.0% 0.00 perf-sched.wait_and_delay.count.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 141.17 ± 8% -100.0% 0.00 perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown] 105.50 ± 11% -100.0% 0.00 perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown] 197.17 ± 7% -100.0% 0.00 perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 86.83 ± 8% -100.0% 0.00 perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.pagecache_get_page.shmem_getpage_gfp.shmem_fault 41.50 ± 10% -100.0% 0.00 perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.zap_pte_range.unmap_page_range.unmap_vmas 77.83 ± 19% -100.0% 0.00 perf-sched.wait_and_delay.count.rcu_gp_kthread.kthread.ret_from_fork 56.67 ± 16% +132.9% 132.00 ± 6% perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 744.33 ± 19% +184.8% 2119 ± 8% perf-sched.wait_and_delay.count.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 675.67 +23083.3% 156641 perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork 39.23 ± 2% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 0.16 ± 73% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown] 0.29 ±109% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown] 0.50 ±138% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 1.17 ±196% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.shmem_getpage_gfp.shmem_fault 1.55 ±210% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.zap_pte_range.unmap_page_range.unmap_vmas 4.84 ± 7% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.rcu_gp_kthread.kthread.ret_from_fork 7398 -30.7% 5131 perf-sched.wait_and_delay.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 365.83 ± 9% -34.0% 241.47 ± 19% perf-sched.wait_and_delay.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 3541 ± 11% +76.8% 6260 ± 14% perf-sched.wait_and_delay.max.ms.worker_thread.kthread.ret_from_fork 0.05 ± 68% +275.7% 0.18 ±101% perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.shmem_getpage_gfp.shmem_fault 2.76 ± 8% -60.8% 1.08 ± 7% perf-sched.wait_time.avg.ms.rcu_gp_kthread.kthread.ret_from_fork 631.12 ± 14% -57.5% 268.47 ± 6% perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 13.62 ± 18% -65.2% 4.73 ± 8% perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 648.69 -99.6% 2.70 ± 2% perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork 0.16 ± 73% +8911.6% 14.48 ±145% perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown] 4.83 ± 7% -51.1% 2.36 ± 39% perf-sched.wait_time.max.ms.rcu_gp_kthread.kthread.ret_from_fork 7398 -30.7% 5131 perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 365.82 ± 9% -34.0% 241.46 ± 19% perf-sched.wait_time.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 3541 ± 11% +76.8% 6260 ± 14% perf-sched.wait_time.max.ms.worker_thread.kthread.ret_from_fork 1.10 +83.4% 2.01 ± 2% perf-stat.i.MPKI 0.64 +0.0 0.65 perf-stat.i.branch-miss-rate% 64941010 +3.1% 66926062 perf-stat.i.branch-misses 46.92 -16.8 30.12 perf-stat.i.cache-miss-rate% 26036960 +16.5% 30331430 perf-stat.i.cache-misses 55509821 +81.5% 1.007e+08 perf-stat.i.cache-references 1213 ± 3% +2628.4% 33113 perf-stat.i.context-switches 1.41 +5.3% 1.49 perf-stat.i.cpi 7.264e+10 +3.2% 7.496e+10 perf-stat.i.cpu-cycles 76.04 -10.1% 68.33 ± 3% perf-stat.i.cpu-migrations 2802 -11.5% 2479 perf-stat.i.cycles-between-cache-misses 1.541e+10 -4.2% 1.476e+10 perf-stat.i.dTLB-loads 1.01 -0.0 1.00 perf-stat.i.dTLB-store-miss-rate% 1.008e+08 -8.7% 92003240 perf-stat.i.dTLB-store-misses 9.838e+09 -7.8% 9.068e+09 perf-stat.i.dTLB-stores 21115776 -8.6% 19293395 perf-stat.i.iTLB-load-misses 148885 ± 9% +66.6% 248054 ± 20% perf-stat.i.iTLB-loads 5.145e+10 -2.0% 5.041e+10 perf-stat.i.instructions 2445 +7.3% 2624 perf-stat.i.instructions-per-iTLB-miss 0.71 -5.0% 0.67 perf-stat.i.ipc 1.51 +3.2% 1.56 perf-stat.i.metric.GHz 1380 +8.9% 1502 perf-stat.i.metric.K/sec 744.39 -3.8% 716.07 perf-stat.i.metric.M/sec 19943108 -9.2% 18114354 perf-stat.i.minor-faults 3.61 ± 14% +26.8 30.36 perf-stat.i.node-load-miss-rate% 168293 ± 15% +2091.9% 3688828 ± 4% perf-stat.i.node-load-misses 4469410 +89.5% 8469082 ± 2% perf-stat.i.node-loads 1.39 +5.7 7.09 ± 7% perf-stat.i.node-store-miss-rate% 318192 +431.2% 1690225 ± 8% perf-stat.i.node-store-misses 21288502 +2.4% 21795925 perf-stat.i.node-stores 19945726 -9.2% 18116966 perf-stat.i.page-faults 1.08 +85.3% 2.00 ± 2% perf-stat.overall.MPKI 0.63 +0.0 0.65 perf-stat.overall.branch-miss-rate% 46.91 -16.8 30.12 perf-stat.overall.cache-miss-rate% 1.41 +5.3% 1.49 perf-stat.overall.cpi 2789 -11.4% 2471 perf-stat.overall.cycles-between-cache-misses 1.01 -0.0 1.00 perf-stat.overall.dTLB-store-miss-rate% 2436 +7.2% 2613 perf-stat.overall.instructions-per-iTLB-miss 0.71 -5.0% 0.67 perf-stat.overall.ipc 3.63 ± 14% +26.7 30.32 perf-stat.overall.node-load-miss-rate% 1.47 +5.7 7.19 ± 7% perf-stat.overall.node-store-miss-rate% 774762 +7.8% 835446 perf-stat.overall.path-length 64756183 +3.1% 66747524 perf-stat.ps.branch-misses 25951585 +16.5% 30233592 perf-stat.ps.cache-misses 55325148 +81.5% 1.004e+08 perf-stat.ps.cache-references 1209 ± 3% +2629.1% 33003 perf-stat.ps.context-switches 7.24e+10 +3.2% 7.471e+10 perf-stat.ps.cpu-cycles 75.82 -10.0% 68.24 ± 3% perf-stat.ps.cpu-migrations 1.536e+10 -4.2% 1.472e+10 perf-stat.ps.dTLB-loads 1.004e+08 -8.7% 91697657 perf-stat.ps.dTLB-store-misses 9.805e+09 -7.8% 9.038e+09 perf-stat.ps.dTLB-stores 21045144 -8.6% 19229148 perf-stat.ps.iTLB-load-misses 148374 ± 9% +66.6% 247251 ± 20% perf-stat.ps.iTLB-loads 5.128e+10 -2.0% 5.025e+10 perf-stat.ps.instructions 19876527 -9.2% 18053975 perf-stat.ps.minor-faults 167937 ± 15% +2089.4% 3676879 ± 4% perf-stat.ps.node-load-misses 4456602 +89.5% 8443950 ± 2% perf-stat.ps.node-loads 317050 +431.3% 1684598 ± 8% perf-stat.ps.node-store-misses 21217485 +2.4% 21723678 perf-stat.ps.node-stores 19879129 -9.2% 18056577 perf-stat.ps.page-faults 1.552e+13 -2.0% 1.52e+13 perf-stat.total.instructions 0.00 +0.7 0.70 ± 10% perf-profile.calltrace.cycles-pp.cgroup_rstat_updated.__mod_memcg_lruvec_state.__mod_lruvec_page_state.page_remove_rmap.zap_pte_range 1.61 ± 13% +0.9 2.52 ± 9% perf-profile.calltrace.cycles-pp.page_remove_rmap.zap_pte_range.unmap_page_range.unmap_vmas.unmap_region 0.00 +0.9 0.91 ± 11% perf-profile.calltrace.cycles-pp.__mod_memcg_lruvec_state.__mod_lruvec_page_state.page_remove_rmap.zap_pte_range.unmap_page_range 0.78 ± 12% +1.0 1.74 ± 10% perf-profile.calltrace.cycles-pp.__mod_lruvec_page_state.page_remove_rmap.zap_pte_range.unmap_page_range.unmap_vmas 4.69 ± 12% +1.0 5.70 ± 10% perf-profile.calltrace.cycles-pp.zap_pte_range.unmap_page_range.unmap_vmas.unmap_region.__do_munmap 4.72 ± 12% +1.0 5.74 ± 10% perf-profile.calltrace.cycles-pp.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe.__munmap 4.70 ± 12% +1.0 5.72 ± 10% perf-profile.calltrace.cycles-pp.unmap_vmas.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap 4.70 ± 12% +1.0 5.72 ± 10% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.unmap_region.__do_munmap.__vm_munmap 4.72 ± 12% +1.0 5.74 ± 10% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__munmap 4.72 ± 12% +1.0 5.74 ± 10% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__munmap 4.73 ± 12% +1.0 5.74 ± 10% perf-profile.calltrace.cycles-pp.__munmap 4.72 ± 12% +1.0 5.74 ± 10% perf-profile.calltrace.cycles-pp.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.72 ± 12% +1.0 5.74 ± 10% perf-profile.calltrace.cycles-pp.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe.__munmap 4.72 ± 12% +1.0 5.74 ± 10% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64 0.00 +1.1 1.08 ± 11% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.cgroup_rstat_updated.handle_mm_fault.do_user_addr_fault 0.00 +1.2 1.17 ± 10% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.cgroup_rstat_updated.handle_mm_fault.do_user_addr_fault.exc_page_fault 0.00 +1.3 1.27 ± 14% perf-profile.calltrace.cycles-pp.cgroup_rstat_updated.__mod_memcg_lruvec_state.__mod_lruvec_page_state.page_add_file_rmap.do_set_pte 0.00 +1.6 1.58 ± 13% perf-profile.calltrace.cycles-pp.__mod_memcg_lruvec_state.__mod_lruvec_page_state.page_add_file_rmap.do_set_pte.finish_fault 0.65 ± 10% +1.7 2.36 ± 12% perf-profile.calltrace.cycles-pp.__mod_lruvec_page_state.page_add_file_rmap.do_set_pte.finish_fault.do_fault 0.00 +1.7 1.73 ± 27% perf-profile.calltrace.cycles-pp.mem_cgroup_css_rstat_flush.cgroup_rstat_flush_locked.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work 1.30 ± 11% +1.7 3.02 ± 11% perf-profile.calltrace.cycles-pp.page_add_file_rmap.do_set_pte.finish_fault.do_fault.__handle_mm_fault 1.76 ± 12% +1.8 3.51 ± 11% perf-profile.calltrace.cycles-pp.do_set_pte.finish_fault.do_fault.__handle_mm_fault.handle_mm_fault 2.92 ± 12% +1.8 4.69 ± 10% perf-profile.calltrace.cycles-pp.finish_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 0.00 +2.5 2.53 ± 28% perf-profile.calltrace.cycles-pp.cgroup_rstat_flush_locked.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work.worker_thread 0.00 +2.5 2.54 ± 28% perf-profile.calltrace.cycles-pp.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work.worker_thread.kthread 0.00 +2.6 2.57 ± 29% perf-profile.calltrace.cycles-pp.mem_cgroup_flush_stats.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +2.6 2.63 ± 28% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +2.6 2.65 ± 10% perf-profile.calltrace.cycles-pp.cgroup_rstat_updated.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 +2.8 2.83 ± 27% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork 0.00 +2.8 2.83 ± 27% perf-profile.calltrace.cycles-pp.ret_from_fork 0.00 +2.8 2.83 ± 27% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 15.88 ± 12% +4.7 20.58 ± 10% perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.testcase 19.89 ± 12% +4.8 24.65 ± 10% perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault.testcase 19.18 ± 12% +4.8 23.96 ± 10% perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.testcase 0.02 ±142% +0.1 0.07 ± 15% perf-profile.children.cycles-pp.__get_user_nocheck_8 0.02 ±142% +0.1 0.08 ± 22% perf-profile.children.cycles-pp.machines__deliver_event 0.00 +0.1 0.08 ± 19% perf-profile.children.cycles-pp.__orc_find 0.07 ± 36% +0.1 0.15 ± 22% perf-profile.children.cycles-pp.perf_session__deliver_event 0.01 ±223% +0.1 0.09 ± 26% perf-profile.children.cycles-pp.perf_output_sample 0.06 ± 57% +0.1 0.15 ± 21% perf-profile.children.cycles-pp.__ordered_events__flush 0.05 ± 46% +0.1 0.14 ± 25% perf-profile.children.cycles-pp.__unwind_start 0.00 +0.1 0.09 ± 50% perf-profile.children.cycles-pp.schedule_idle 0.04 ±102% +0.1 0.15 ± 21% perf-profile.children.cycles-pp.perf_session__process_user_event 0.00 +0.1 0.13 ± 47% perf-profile.children.cycles-pp.perf_trace_sched_switch 0.37 ± 9% +0.1 0.50 ± 10% perf-profile.children.cycles-pp.unlock_page 0.11 ± 9% +0.1 0.24 ± 19% perf-profile.children.cycles-pp.unwind_next_frame 0.00 +0.1 0.13 ± 11% perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template 0.01 ±223% +0.1 0.15 ± 23% perf-profile.children.cycles-pp.queue_event 0.11 ± 14% +0.1 0.26 ± 20% perf-profile.children.cycles-pp.__mod_memcg_state 0.01 ±223% +0.2 0.16 ± 25% perf-profile.children.cycles-pp.ordered_events__queue 0.20 ± 22% +0.2 0.36 ± 18% perf-profile.children.cycles-pp.__count_memcg_events 0.15 ± 17% +0.2 0.32 ± 19% perf-profile.children.cycles-pp.perf_callchain_kernel 0.00 +0.2 0.17 ± 25% perf-profile.children.cycles-pp._find_next_bit 0.00 +0.2 0.18 ± 10% perf-profile.children.cycles-pp.try_to_wake_up 0.00 +0.2 0.19 ± 48% perf-profile.children.cycles-pp.schedule 0.00 +0.2 0.20 ± 9% perf-profile.children.cycles-pp.__queue_work 0.20 ± 17% +0.2 0.40 ± 17% perf-profile.children.cycles-pp.get_perf_callchain 0.20 ± 17% +0.2 0.41 ± 17% perf-profile.children.cycles-pp.perf_callchain 0.10 ± 36% +0.2 0.33 ± 22% perf-profile.children.cycles-pp.process_simple 0.22 ± 17% +0.2 0.45 ± 18% perf-profile.children.cycles-pp.perf_prepare_sample 0.12 ± 36% +0.2 0.36 ± 22% perf-profile.children.cycles-pp.cmd_record 0.12 ± 37% +0.2 0.35 ± 22% perf-profile.children.cycles-pp.record__finish_output 0.12 ± 37% +0.2 0.35 ± 22% perf-profile.children.cycles-pp.perf_session__process_events 0.80 ± 12% +0.3 1.05 ± 7% perf-profile.children.cycles-pp._raw_spin_lock 0.00 +0.3 0.28 ± 48% perf-profile.children.cycles-pp.__schedule 0.27 ± 18% +0.3 0.57 ± 19% perf-profile.children.cycles-pp.perf_event_output_forward 0.27 ± 17% +0.3 0.58 ± 19% perf-profile.children.cycles-pp.__perf_event_overflow 0.28 ± 18% +0.3 0.58 ± 19% perf-profile.children.cycles-pp.perf_swevent_overflow 0.28 ± 17% +0.3 0.60 ± 19% perf-profile.children.cycles-pp.perf_tp_event 0.00 +0.5 0.52 ± 9% perf-profile.children.cycles-pp.queue_work_on 1.63 ± 13% +0.9 2.54 ± 9% perf-profile.children.cycles-pp.page_remove_rmap 4.70 ± 12% +1.0 5.72 ± 10% perf-profile.children.cycles-pp.zap_pte_range 4.71 ± 12% +1.0 5.72 ± 10% perf-profile.children.cycles-pp.unmap_vmas 4.71 ± 12% +1.0 5.72 ± 10% perf-profile.children.cycles-pp.unmap_page_range 4.72 ± 12% +1.0 5.74 ± 10% perf-profile.children.cycles-pp.__do_munmap 4.72 ± 12% +1.0 5.74 ± 10% perf-profile.children.cycles-pp.__x64_sys_munmap 4.72 ± 12% +1.0 5.74 ± 10% perf-profile.children.cycles-pp.__vm_munmap 4.72 ± 12% +1.0 5.74 ± 10% perf-profile.children.cycles-pp.unmap_region 4.73 ± 12% +1.0 5.74 ± 10% perf-profile.children.cycles-pp.__munmap 4.90 ± 12% +1.1 5.95 ± 9% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 4.90 ± 12% +1.1 5.95 ± 9% perf-profile.children.cycles-pp.do_syscall_64 0.00 +1.5 1.51 ± 10% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.00 +1.6 1.63 ± 10% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 1.30 ± 11% +1.7 3.04 ± 11% perf-profile.children.cycles-pp.page_add_file_rmap 0.00 +1.7 1.75 ± 27% perf-profile.children.cycles-pp.mem_cgroup_css_rstat_flush 1.79 ± 12% +1.8 3.55 ± 11% perf-profile.children.cycles-pp.do_set_pte 2.94 ± 12% +1.8 4.71 ± 10% perf-profile.children.cycles-pp.finish_fault 0.46 ± 11% +2.1 2.52 ± 12% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state 0.00 +2.5 2.54 ± 28% perf-profile.children.cycles-pp.cgroup_rstat_flush_locked 0.00 +2.5 2.54 ± 28% perf-profile.children.cycles-pp.cgroup_rstat_flush_irqsafe 0.00 +2.6 2.57 ± 29% perf-profile.children.cycles-pp.mem_cgroup_flush_stats 0.05 ± 48% +2.6 2.63 ± 28% perf-profile.children.cycles-pp.process_one_work 1.48 ± 11% +2.7 4.15 ± 10% perf-profile.children.cycles-pp.__mod_lruvec_page_state 0.06 ± 50% +2.8 2.83 ± 27% perf-profile.children.cycles-pp.kthread 0.06 ± 50% +2.8 2.83 ± 26% perf-profile.children.cycles-pp.ret_from_fork 0.05 ± 50% +2.8 2.83 ± 27% perf-profile.children.cycles-pp.worker_thread 0.26 ± 12% +4.4 4.65 ± 10% perf-profile.children.cycles-pp.cgroup_rstat_updated 15.96 ± 12% +4.7 20.66 ± 10% perf-profile.children.cycles-pp.handle_mm_fault 19.97 ± 12% +4.8 24.74 ± 10% perf-profile.children.cycles-pp.exc_page_fault 19.31 ± 12% +4.8 24.09 ± 10% perf-profile.children.cycles-pp.do_user_addr_fault 0.00 +0.1 0.08 ± 19% perf-profile.self.cycles-pp.__orc_find 0.20 ± 13% +0.1 0.27 ± 10% perf-profile.self.cycles-pp.__mod_memcg_lruvec_state 0.01 ±223% +0.1 0.10 ± 25% perf-profile.self.cycles-pp.unwind_next_frame 0.00 +0.1 0.12 ± 11% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.35 ± 9% +0.1 0.48 ± 9% perf-profile.self.cycles-pp.unlock_page 0.00 +0.1 0.14 ± 25% perf-profile.self.cycles-pp.queue_event 0.19 ± 23% +0.1 0.33 ± 20% perf-profile.self.cycles-pp.__count_memcg_events 0.11 ± 11% +0.2 0.26 ± 20% perf-profile.self.cycles-pp.__mod_memcg_state 0.00 +0.2 0.16 ± 23% perf-profile.self.cycles-pp._find_next_bit 0.77 ± 12% +0.3 1.03 ± 8% perf-profile.self.cycles-pp._raw_spin_lock 0.00 +0.3 0.32 ± 11% perf-profile.self.cycles-pp.queue_work_on 0.00 +0.5 0.51 ± 31% perf-profile.self.cycles-pp.cgroup_rstat_flush_locked 0.00 +1.5 1.51 ± 10% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.00 +1.6 1.59 ± 28% perf-profile.self.cycles-pp.mem_cgroup_css_rstat_flush 0.25 ± 13% +2.8 3.01 ± 10% perf-profile.self.cycles-pp.cgroup_rstat_updated *************************************************************************************************** lkp-cpl-4sp1: 144 threads 4 sockets Intel(R) Xeon(R) Gold 5318H CPU @ 2.50GHz with 128G memory ========================================================================================= compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-8.3/thread/100%/debian-10.4-x86_64-20200603.cgz/lkp-cpl-4sp1/tlb_flush1/will-it-scale/0x700001e commit: 3c28c7680e ("memcg: switch lruvec stats to rstat") 45208c9105 ("memcg: infrastructure to flush memcg stats") 3c28c7680e1c39b9 45208c9105bd96015b98cdf31fb ---------------- --------------------------- %stddev %change %stddev \ | \ 503768 -2.3% 492013 will-it-scale.144.threads 1.68 ± 2% +32.5% 2.22 will-it-scale.144.threads_idle 3498 -2.3% 3416 will-it-scale.per_thread_ops 503768 -2.3% 492013 will-it-scale.workload 0.00 ±104% +0.0 0.00 ± 47% mpstat.cpu.all.iowait% 1025379 ± 5% +39.8% 1433265 ± 2% turbostat.C1 1.157e+09 ± 10% +25.2% 1.449e+09 ± 5% cpuidle..time 5971337 ± 3% +16.3% 6946868 cpuidle..usage 45468 ± 78% -58.0% 19095 ± 2% numa-meminfo.node3.AnonHugePages 131621 ± 49% -50.0% 65813 ± 10% numa-meminfo.node3.AnonPages.max 2981 ± 5% -12.7% 2602 ± 2% slabinfo.fsnotify_mark_connector.active_objs 2981 ± 5% -12.7% 2602 ± 2% slabinfo.fsnotify_mark_connector.num_objs 10174 +84.1% 18735 vmstat.system.cs 6897906 -2.7% 6712563 vmstat.system.in 300488 +2.6% 308156 proc-vmstat.nr_inactive_anon 300488 +2.6% 308156 proc-vmstat.nr_zone_inactive_anon 1.598e+08 -2.3% 1.562e+08 proc-vmstat.numa_hit 1.597e+08 -2.3% 1.56e+08 proc-vmstat.numa_local 626526 ± 2% -5.3% 593571 proc-vmstat.numa_pte_updates 1.598e+08 -2.3% 1.562e+08 proc-vmstat.pgalloc_normal 3.082e+08 -2.3% 3.01e+08 proc-vmstat.pgfault 1.597e+08 -2.3% 1.561e+08 proc-vmstat.pgfree 26.97 +3.5% 27.91 perf-stat.i.MPKI 9.081e+09 +8.6% 9.864e+09 perf-stat.i.branch-instructions 1.14 -0.1 1.07 ± 3% perf-stat.i.branch-miss-rate% 42.59 -2.2 40.37 perf-stat.i.cache-miss-rate% 4.725e+08 +4.8% 4.953e+08 ± 2% perf-stat.i.cache-misses 1.107e+09 +10.1% 1.218e+09 perf-stat.i.cache-references 10162 +85.8% 18879 perf-stat.i.context-switches 11.26 -7.1% 10.45 perf-stat.i.cpi 197.31 +11.9% 220.86 perf-stat.i.cpu-migrations 985.33 -5.3% 933.47 ± 2% perf-stat.i.cycles-between-cache-misses 1.098e+10 +6.4% 1.169e+10 perf-stat.i.dTLB-loads 27634210 ± 2% -21.0% 21838549 perf-stat.i.iTLB-load-misses 313874 ± 2% +10.4% 346477 perf-stat.i.iTLB-loads 4.076e+10 +7.0% 4.36e+10 perf-stat.i.instructions 1513 ± 2% +38.0% 2088 perf-stat.i.instructions-per-iTLB-miss 0.09 +8.5% 0.10 perf-stat.i.ipc 183.92 +5.6% 194.20 perf-stat.i.metric.M/sec 1011833 -2.5% 986716 perf-stat.i.minor-faults 126438 +38.5% 175078 ± 4% perf-stat.i.node-stores 1011835 -2.5% 986718 perf-stat.i.page-faults 27.16 +2.9% 27.94 perf-stat.overall.MPKI 1.14 -0.1 1.05 perf-stat.overall.branch-miss-rate% 42.69 -2.0 40.66 perf-stat.overall.cache-miss-rate% 11.33 -7.1% 10.53 perf-stat.overall.cpi 978.00 -5.2% 927.43 perf-stat.overall.cycles-between-cache-misses 1476 ± 2% +35.2% 1996 perf-stat.overall.instructions-per-iTLB-miss 0.09 +7.6% 0.09 perf-stat.overall.ipc 24640644 +9.7% 27024500 perf-stat.overall.path-length 9.055e+09 +8.6% 9.83e+09 perf-stat.ps.branch-instructions 4.712e+08 +4.8% 4.936e+08 ± 2% perf-stat.ps.cache-misses 1.104e+09 +10.0% 1.214e+09 perf-stat.ps.cache-references 10122 +83.8% 18606 perf-stat.ps.context-switches 196.45 +11.8% 219.54 perf-stat.ps.cpu-migrations 1.095e+10 +6.4% 1.165e+10 perf-stat.ps.dTLB-loads 5.005e+09 -1.9% 4.913e+09 perf-stat.ps.dTLB-stores 27547553 ± 2% -21.0% 21768351 perf-stat.ps.iTLB-load-misses 311081 ± 2% +9.9% 341727 perf-stat.ps.iTLB-loads 4.064e+10 +6.9% 4.344e+10 perf-stat.ps.instructions 1008914 -2.6% 983136 perf-stat.ps.minor-faults 31114584 -2.2% 30429953 perf-stat.ps.node-loads 125870 +37.8% 173479 ± 4% perf-stat.ps.node-stores 1008917 -2.6% 983138 perf-stat.ps.page-faults 1.241e+13 +7.1% 1.33e+13 perf-stat.total.instructions 0.86 ±110% -99.9% 0.00 perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.zap_pte_range.unmap_page_range.unmap_vmas 0.02 ± 87% +201.1% 0.05 ± 37% perf-sched.sch_delay.avg.ms.rwsem_down_read_slowpath.do_madvise.part.0.__x64_sys_madvise 0.02 ±106% +259.5% 0.09 ± 22% perf-sched.sch_delay.avg.ms.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 ± 7% -31.0% 0.00 ± 14% perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff 0.06 ± 4% +55.8% 0.10 ± 28% perf-sched.sch_delay.avg.ms.schedule_timeout.kcompactd.kthread.ret_from_fork 1.54 ± 71% -69.7% 0.47 ± 90% perf-sched.sch_delay.avg.ms.schedule_timeout.wait_for_completion.__flush_work.lru_add_drain_all 0.02 ± 59% +1e+05% 15.13 ±109% perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.zap_page_range.do_madvise.part 0.19 ± 11% +369.3% 0.87 ±101% perf-sched.sch_delay.max.ms.schedule_timeout.kcompactd.kthread.ret_from_fork 3.75 ± 23% +531.7% 23.71 ± 47% perf-sched.sch_delay.max.ms.worker_thread.kthread.ret_from_fork 54.96 ± 3% -47.8% 28.68 ± 2% perf-sched.total_wait_and_delay.average.ms 58198 ± 4% +95.3% 113666 ± 2% perf-sched.total_wait_and_delay.count.ms 54.89 ± 3% -47.9% 28.60 ± 2% perf-sched.total_wait_time.average.ms 7.45 ± 8% -24.8% 5.61 ± 2% perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr 0.49 ± 6% +40.7% 0.69 ± 3% perf-sched.wait_and_delay.avg.ms.rwsem_down_read_slowpath.do_madvise.part.0.__x64_sys_madvise 0.51 ± 6% +47.8% 0.75 ± 4% perf-sched.wait_and_delay.avg.ms.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 5.96 ± 15% -21.1% 4.71 ± 4% perf-sched.wait_and_delay.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 777.48 -94.1% 45.81 perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork 3062 ± 3% +367.5% 14318 perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown] 4427 ± 10% +263.4% 16091 ± 3% perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe 1710 ± 12% +25.6% 2148 ± 4% perf-sched.wait_and_delay.count.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 1685 +1660.8% 29681 perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork 3216 ± 30% -68.9% 1001 perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr 3662 ± 31% -45.7% 1990 ± 12% perf-sched.wait_and_delay.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait 1027 +356.6% 4689 ± 54% perf-sched.wait_and_delay.max.ms.worker_thread.kthread.ret_from_fork 0.32 ± 68% -61.9% 0.12 ± 49% perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.down_read.do_madvise.part 7.45 ± 8% -24.8% 5.61 ± 2% perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr 0.24 ± 8% +123.3% 0.53 ± 51% perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.wp_page_copy.__handle_mm_fault.handle_mm_fault 0.44 ± 61% -54.0% 0.20 ± 27% perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.zap_page_range.do_madvise.part 0.11 ± 39% -66.6% 0.04 ± 72% perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.zap_pte_range.unmap_page_range.unmap_vmas 0.47 ± 7% +35.3% 0.64 perf-sched.wait_time.avg.ms.rwsem_down_read_slowpath.do_madvise.part.0.__x64_sys_madvise 0.48 ± 8% +36.9% 0.66 perf-sched.wait_time.avg.ms.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.12 ± 11% -51.4% 0.06 ± 13% perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff 5.90 ± 15% -21.4% 4.63 ± 4% perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 777.41 -94.1% 45.74 perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork 2.28 ±150% +570.6% 15.28 ± 16% perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__alloc_pages.alloc_pages_vma.wp_page_copy 0.83 ± 30% +1448.6% 12.85 ± 45% perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.unmap_page_range.zap_page_range.do_madvise 3214 ± 30% -68.9% 1001 perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr 0.90 ± 46% +2790.6% 26.15 ± 30% perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wp_page_copy.__handle_mm_fault.handle_mm_fault 1.62 ± 32% +735.1% 13.54 ± 49% perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.zap_pte_range.unmap_page_range.zap_page_range 24.31 ± 32% +135.7% 57.31 ± 25% perf-sched.wait_time.max.ms.rwsem_down_read_slowpath.do_madvise.part.0.__x64_sys_madvise 2.51 ± 13% +74.2% 4.36 ± 6% perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.down_write_killable.__vm_munmap.__x64_sys_munmap 1.25 ± 81% +251.0% 4.39 ± 18% perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff 3662 ± 31% -45.7% 1987 ± 12% perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait 1025 +357.1% 4689 ± 54% perf-sched.wait_time.max.ms.worker_thread.kthread.ret_from_fork 44.39 -1.2 43.14 perf-profile.calltrace.cycles-pp.ptep_clear_flush.wp_page_copy.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 44.03 -1.2 42.79 perf-profile.calltrace.cycles-pp.flush_tlb_mm_range.ptep_clear_flush.wp_page_copy.__handle_mm_fault.handle_mm_fault 41.40 -1.1 40.27 perf-profile.calltrace.cycles-pp.on_each_cpu_cond_mask.flush_tlb_mm_range.ptep_clear_flush.wp_page_copy.__handle_mm_fault 41.20 -1.1 40.08 perf-profile.calltrace.cycles-pp.smp_call_function_many_cond.on_each_cpu_cond_mask.flush_tlb_mm_range.ptep_clear_flush.wp_page_copy 13.00 ± 6% -1.0 12.04 perf-profile.calltrace.cycles-pp.flush_tlb_func.flush_smp_call_function_queue.__sysvec_call_function.sysvec_call_function.asm_sysvec_call_function 13.08 ± 5% -0.9 12.17 perf-profile.calltrace.cycles-pp.sysvec_call_function.asm_sysvec_call_function.smp_call_function_many_cond.on_each_cpu_cond_mask.flush_tlb_mm_range 12.98 ± 5% -0.9 12.08 perf-profile.calltrace.cycles-pp.__sysvec_call_function.sysvec_call_function.asm_sysvec_call_function.smp_call_function_many_cond.on_each_cpu_cond_mask 12.96 ± 5% -0.9 12.06 perf-profile.calltrace.cycles-pp.flush_smp_call_function_queue.__sysvec_call_function.sysvec_call_function.asm_sysvec_call_function.smp_call_function_many_cond 49.64 -0.9 48.76 perf-profile.calltrace.cycles-pp.testcase 49.38 -0.9 48.50 perf-profile.calltrace.cycles-pp.asm_exc_page_fault.testcase 49.31 -0.9 48.43 perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault.testcase 49.29 -0.9 48.42 perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.testcase 45.04 -0.9 44.18 perf-profile.calltrace.cycles-pp.wp_page_copy.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault 44.48 -0.8 43.71 perf-profile.calltrace.cycles-pp.flush_tlb_mm_range.tlb_flush_mmu.tlb_finish_mmu.zap_page_range.do_madvise 43.80 -0.8 43.04 perf-profile.calltrace.cycles-pp.on_each_cpu_cond_mask.flush_tlb_mm_range.tlb_flush_mmu.tlb_finish_mmu.zap_page_range 46.39 -0.7 45.65 perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 43.58 -0.7 42.84 perf-profile.calltrace.cycles-pp.smp_call_function_many_cond.on_each_cpu_cond_mask.flush_tlb_mm_range.tlb_flush_mmu.tlb_finish_mmu 46.72 -0.6 46.12 perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.testcase 12.42 -0.5 11.89 perf-profile.calltrace.cycles-pp.asm_sysvec_call_function.llist_add_batch.smp_call_function_many_cond.on_each_cpu_cond_mask.flush_tlb_mm_range 11.97 -0.5 11.47 perf-profile.calltrace.cycles-pp.sysvec_call_function.asm_sysvec_call_function.llist_add_batch.smp_call_function_many_cond.on_each_cpu_cond_mask 11.86 -0.5 11.35 perf-profile.calltrace.cycles-pp.flush_smp_call_function_queue.__sysvec_call_function.sysvec_call_function.asm_sysvec_call_function.llist_add_batch 11.88 -0.5 11.38 perf-profile.calltrace.cycles-pp.__sysvec_call_function.sysvec_call_function.asm_sysvec_call_function.llist_add_batch.smp_call_function_many_cond 6.53 ± 5% -0.5 6.06 perf-profile.calltrace.cycles-pp.asm_sysvec_call_function.smp_call_function_many_cond.on_each_cpu_cond_mask.flush_tlb_mm_range.ptep_clear_flush 6.91 ± 5% -0.5 6.46 perf-profile.calltrace.cycles-pp.asm_sysvec_call_function.smp_call_function_many_cond.on_each_cpu_cond_mask.flush_tlb_mm_range.tlb_flush_mmu 9.88 -0.3 9.55 perf-profile.calltrace.cycles-pp.llist_reverse_order.flush_smp_call_function_queue.__sysvec_call_function.sysvec_call_function.asm_sysvec_call_function 1.45 ± 6% -0.2 1.25 ± 8% perf-profile.calltrace.cycles-pp.down_read_trylock.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.testcase 0.57 -0.1 0.52 perf-profile.calltrace.cycles-pp.asm_sysvec_call_function.native_flush_tlb_multi.flush_tlb_mm_range.ptep_clear_flush.wp_page_copy 0.55 -0.0 0.50 perf-profile.calltrace.cycles-pp.__sysvec_call_function.sysvec_call_function.asm_sysvec_call_function.native_flush_tlb_multi.flush_tlb_mm_range 0.56 -0.0 0.51 perf-profile.calltrace.cycles-pp.sysvec_call_function.asm_sysvec_call_function.native_flush_tlb_multi.flush_tlb_mm_range.ptep_clear_flush 0.55 -0.0 0.50 perf-profile.calltrace.cycles-pp.flush_smp_call_function_queue.__sysvec_call_function.sysvec_call_function.asm_sysvec_call_function.native_flush_tlb_multi 0.74 -0.0 0.71 perf-profile.calltrace.cycles-pp.default_send_IPI_mask_sequence_phys.smp_call_function_many_cond.on_each_cpu_cond_mask.flush_tlb_mm_range.ptep_clear_flush 0.61 +0.1 0.74 perf-profile.calltrace.cycles-pp.filemap_map_pages.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 0.66 +0.2 0.82 perf-profile.calltrace.cycles-pp.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault 1.27 ± 8% +0.3 1.59 ± 8% perf-profile.calltrace.cycles-pp.uncharge_batch.__mem_cgroup_uncharge_list.release_pages.tlb_flush_mmu.tlb_finish_mmu 1.31 ± 8% +0.4 1.69 ± 9% perf-profile.calltrace.cycles-pp.__mem_cgroup_uncharge_list.release_pages.tlb_flush_mmu.tlb_finish_mmu.zap_page_range 0.00 +0.5 0.54 ± 4% perf-profile.calltrace.cycles-pp.mem_cgroup_css_rstat_flush.cgroup_rstat_flush_locked.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work 0.00 +0.6 0.59 perf-profile.calltrace.cycles-pp.__pagevec_lru_add.lru_add_drain_cpu.lru_add_drain.zap_page_range.do_madvise 0.00 +0.6 0.60 perf-profile.calltrace.cycles-pp.lru_add_drain_cpu.lru_add_drain.zap_page_range.do_madvise.__x64_sys_madvise 0.00 +0.6 0.61 perf-profile.calltrace.cycles-pp.lru_add_drain.zap_page_range.do_madvise.__x64_sys_madvise.do_syscall_64 0.00 +0.7 0.71 ± 3% perf-profile.calltrace.cycles-pp.mem_cgroup_flush_stats.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +0.7 0.71 ± 3% perf-profile.calltrace.cycles-pp.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work.worker_thread.kthread 0.00 +0.7 0.71 ± 3% perf-profile.calltrace.cycles-pp.cgroup_rstat_flush_locked.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work.worker_thread 0.00 +0.7 0.72 ± 3% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +0.7 0.73 ± 3% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork 0.00 +0.7 0.73 ± 2% perf-profile.calltrace.cycles-pp.ret_from_fork 0.00 +0.7 0.73 ± 2% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 1.57 ± 7% +0.7 2.31 ± 6% perf-profile.calltrace.cycles-pp.release_pages.tlb_flush_mmu.tlb_finish_mmu.zap_page_range.do_madvise 88.54 -2.0 86.53 perf-profile.children.cycles-pp.flush_tlb_mm_range 85.20 -1.9 83.33 perf-profile.children.cycles-pp.on_each_cpu_cond_mask 85.20 -1.9 83.32 perf-profile.children.cycles-pp.smp_call_function_many_cond 31.52 ± 2% -1.3 30.23 perf-profile.children.cycles-pp.asm_sysvec_call_function 30.49 ± 2% -1.3 29.23 perf-profile.children.cycles-pp.sysvec_call_function 30.51 ± 2% -1.3 29.26 perf-profile.children.cycles-pp.flush_smp_call_function_queue 30.26 ± 2% -1.3 29.01 perf-profile.children.cycles-pp.__sysvec_call_function 44.40 -1.2 43.15 perf-profile.children.cycles-pp.ptep_clear_flush 17.03 ± 5% -0.9 16.11 perf-profile.children.cycles-pp.flush_tlb_func 49.80 -0.9 48.92 perf-profile.children.cycles-pp.testcase 49.37 -0.9 48.50 perf-profile.children.cycles-pp.exc_page_fault 49.32 -0.9 48.45 perf-profile.children.cycles-pp.do_user_addr_fault 49.55 -0.9 48.69 perf-profile.children.cycles-pp.asm_exc_page_fault 45.04 -0.9 44.19 perf-profile.children.cycles-pp.wp_page_copy 46.41 -0.7 45.66 perf-profile.children.cycles-pp.__handle_mm_fault 46.74 -0.6 46.14 perf-profile.children.cycles-pp.handle_mm_fault 1.46 ± 6% -0.2 1.26 ± 8% perf-profile.children.cycles-pp.down_read_trylock 1.63 -0.1 1.58 perf-profile.children.cycles-pp.default_send_IPI_mask_sequence_phys 0.11 ± 4% -0.0 0.09 ± 5% perf-profile.children.cycles-pp._raw_spin_lock_irq 0.06 ± 6% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.__vm_munmap 0.06 ± 6% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.__munmap 0.06 ± 6% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.__x64_sys_munmap 0.06 ± 6% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.__do_munmap 0.05 +0.0 0.07 ± 7% perf-profile.children.cycles-pp.unmap_vmas 0.05 +0.0 0.07 perf-profile.children.cycles-pp.unmap_region 0.04 ± 72% +0.0 0.09 ± 9% perf-profile.children.cycles-pp.ordered_events__queue 0.04 ± 72% +0.0 0.09 ± 9% perf-profile.children.cycles-pp.queue_event 0.00 +0.1 0.05 perf-profile.children.cycles-pp.free_unref_page_list 0.06 ± 50% +0.1 0.11 ± 4% perf-profile.children.cycles-pp.cmd_record 0.78 ± 4% +0.1 0.83 ± 3% perf-profile.children.cycles-pp.unmap_page_range 0.05 ± 72% +0.1 0.10 ± 4% perf-profile.children.cycles-pp.process_simple 0.06 ± 48% +0.1 0.11 ± 4% perf-profile.children.cycles-pp.record__finish_output 0.06 ± 48% +0.1 0.11 ± 4% perf-profile.children.cycles-pp.perf_session__process_events 0.00 +0.1 0.06 ± 8% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.06 +0.1 0.12 perf-profile.children.cycles-pp._raw_spin_lock 0.05 +0.1 0.11 ± 4% perf-profile.children.cycles-pp.charge_memcg 0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.schedule 0.46 ± 9% +0.1 0.53 perf-profile.children.cycles-pp.scheduler_tick 0.44 ± 8% +0.1 0.51 ± 5% perf-profile.children.cycles-pp.zap_pte_range 0.10 ± 20% +0.1 0.18 ± 6% perf-profile.children.cycles-pp.__count_memcg_events 0.51 ± 8% +0.1 0.59 ± 2% perf-profile.children.cycles-pp.tick_sched_handle 0.00 +0.1 0.08 ± 11% perf-profile.children.cycles-pp.__schedule 0.52 ± 8% +0.1 0.60 ± 2% perf-profile.children.cycles-pp.tick_sched_timer 0.50 ± 8% +0.1 0.59 ± 2% perf-profile.children.cycles-pp.update_process_times 0.00 +0.1 0.10 ± 21% perf-profile.children.cycles-pp.uncharge_page 0.08 ± 11% +0.1 0.20 ± 8% perf-profile.children.cycles-pp.__mem_cgroup_charge 0.22 ± 18% +0.1 0.34 ± 20% perf-profile.children.cycles-pp.propagate_protected_usage 0.61 +0.1 0.75 perf-profile.children.cycles-pp.filemap_map_pages 0.09 ± 4% +0.1 0.24 ± 5% perf-profile.children.cycles-pp.page_remove_rmap 0.55 ± 7% +0.2 0.70 perf-profile.children.cycles-pp.__hrtimer_run_queues 0.67 +0.2 0.82 perf-profile.children.cycles-pp.do_fault 0.06 +0.2 0.21 ± 2% perf-profile.children.cycles-pp.do_set_pte 0.68 ± 7% +0.2 0.85 perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 0.64 ± 7% +0.2 0.81 perf-profile.children.cycles-pp.hrtimer_interrupt 0.64 ± 7% +0.2 0.82 ± 2% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 0.72 ± 6% +0.2 0.90 perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 0.01 ±223% +0.2 0.19 ± 2% perf-profile.children.cycles-pp.page_add_file_rmap 0.16 ± 3% +0.2 0.37 ± 4% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.19 ± 7% +0.2 0.40 ± 6% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.00 +0.2 0.22 ± 4% perf-profile.children.cycles-pp.page_add_new_anon_rmap 0.17 ± 9% +0.2 0.41 ± 4% perf-profile.children.cycles-pp.lock_page_lruvec_irqsave 0.00 +0.2 0.25 ± 16% perf-profile.children.cycles-pp.__mod_memcg_state 0.37 ± 4% +0.3 0.62 perf-profile.children.cycles-pp.lru_add_drain 0.35 ± 4% +0.3 0.60 perf-profile.children.cycles-pp.lru_add_drain_cpu 0.34 ± 3% +0.3 0.59 perf-profile.children.cycles-pp.__pagevec_lru_add 0.16 ± 9% +0.3 0.46 ± 4% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 1.27 ± 8% +0.3 1.59 ± 8% perf-profile.children.cycles-pp.uncharge_batch 1.31 ± 8% +0.4 1.69 ± 9% perf-profile.children.cycles-pp.__mem_cgroup_uncharge_list 0.04 ± 71% +0.4 0.47 perf-profile.children.cycles-pp.cgroup_rstat_updated 0.07 ± 5% +0.5 0.57 ± 4% perf-profile.children.cycles-pp.__mod_lruvec_page_state 0.00 +0.5 0.54 ± 4% perf-profile.children.cycles-pp.mem_cgroup_css_rstat_flush 0.02 ±141% +0.6 0.63 ± 5% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state 0.00 +0.7 0.71 ± 3% perf-profile.children.cycles-pp.mem_cgroup_flush_stats 0.00 +0.7 0.71 ± 3% perf-profile.children.cycles-pp.cgroup_rstat_flush_irqsafe 0.00 +0.7 0.71 ± 3% perf-profile.children.cycles-pp.cgroup_rstat_flush_locked 0.00 +0.7 0.72 ± 3% perf-profile.children.cycles-pp.process_one_work 0.00 +0.7 0.73 ± 3% perf-profile.children.cycles-pp.worker_thread 0.00 +0.7 0.73 ± 2% perf-profile.children.cycles-pp.ret_from_fork 0.00 +0.7 0.73 ± 2% perf-profile.children.cycles-pp.kthread 1.66 ± 6% +0.7 2.40 ± 5% perf-profile.children.cycles-pp.release_pages 15.67 ± 5% -0.9 14.82 perf-profile.self.cycles-pp.flush_tlb_func 0.92 ± 7% -0.1 0.79 ± 8% perf-profile.self.cycles-pp.down_read_trylock 2.31 ± 2% -0.1 2.22 perf-profile.self.cycles-pp.flush_smp_call_function_queue 1.20 -0.1 1.13 perf-profile.self.cycles-pp.native_flush_tlb_multi 0.03 ±100% +0.1 0.09 ± 9% perf-profile.self.cycles-pp.queue_event 0.08 ± 6% +0.1 0.14 ± 3% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.10 ± 20% +0.1 0.18 ± 6% perf-profile.self.cycles-pp.__count_memcg_events 0.16 ± 19% +0.1 0.25 ± 21% perf-profile.self.cycles-pp.propagate_protected_usage 0.00 +0.1 0.10 perf-profile.self.cycles-pp._raw_spin_lock 0.00 +0.1 0.12 ± 10% perf-profile.self.cycles-pp.cgroup_rstat_flush_locked 0.00 +0.2 0.18 ± 16% perf-profile.self.cycles-pp.__mod_memcg_state 0.19 ± 7% +0.2 0.40 ± 5% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.03 ±100% +0.3 0.34 perf-profile.self.cycles-pp.cgroup_rstat_updated 0.00 +0.5 0.51 ± 5% perf-profile.self.cycles-pp.mem_cgroup_css_rstat_flush 12787 ± 3% -27.3% 9296 ± 2% softirqs.CPU0.RCU 11378 ± 6% -36.4% 7237 ± 3% softirqs.CPU10.RCU 11407 ± 5% -37.8% 7093 ± 3% softirqs.CPU100.RCU 11282 ± 3% -35.7% 7249 ± 6% softirqs.CPU101.RCU 11276 ± 3% -35.7% 7255 ± 2% softirqs.CPU102.RCU 11542 ± 3% -36.0% 7388 ± 7% softirqs.CPU103.RCU 11336 ± 5% -37.8% 7046 ± 2% softirqs.CPU104.RCU 11177 ± 4% -37.1% 7031 softirqs.CPU105.RCU 11463 ± 7% -38.6% 7040 softirqs.CPU106.RCU 11151 ± 3% -36.6% 7066 ± 4% softirqs.CPU107.RCU 11539 ± 5% -39.1% 7023 ± 4% softirqs.CPU108.RCU 10921 ± 6% -36.2% 6965 ± 3% softirqs.CPU109.RCU 11575 ± 4% -37.5% 7238 ± 3% softirqs.CPU11.RCU 10469 ± 4% -37.1% 6583 softirqs.CPU110.RCU 10173 ± 5% -36.3% 6483 ± 2% softirqs.CPU111.RCU 11249 ± 4% -36.6% 7131 ± 6% softirqs.CPU112.RCU 11449 ± 7% -36.8% 7240 ± 6% softirqs.CPU113.RCU 11218 ± 4% -37.8% 6974 ± 5% softirqs.CPU114.RCU 11249 ± 4% -34.8% 7329 ± 9% softirqs.CPU115.RCU 11149 ± 3% -33.1% 7461 ± 11% softirqs.CPU116.RCU 11185 ± 4% -34.9% 7279 ± 7% softirqs.CPU117.RCU 11160 ± 4% -36.9% 7046 ± 5% softirqs.CPU118.RCU 11085 ± 3% -34.1% 7306 ± 7% softirqs.CPU119.RCU 11259 ± 3% -33.9% 7446 ± 4% softirqs.CPU12.RCU 11110 ± 4% -34.9% 7238 ± 9% softirqs.CPU120.RCU 11131 ± 3% -39.0% 6793 ± 2% softirqs.CPU121.RCU 11127 ± 4% -35.9% 7134 ± 6% softirqs.CPU122.RCU 11003 ± 4% -38.2% 6804 ± 3% softirqs.CPU123.RCU 11916 ± 18% -40.5% 7084 ± 7% softirqs.CPU124.RCU 10940 ± 4% -36.4% 6955 ± 6% softirqs.CPU125.RCU 9287 ± 5% -31.5% 6359 ± 8% softirqs.CPU126.RCU 10178 ± 9% -34.8% 6631 ± 7% softirqs.CPU128.RCU 9897 ± 5% -37.5% 6190 ± 4% softirqs.CPU129.RCU 12235 ± 16% -40.9% 7233 softirqs.CPU13.RCU 9866 ± 4% -36.2% 6298 ± 5% softirqs.CPU130.RCU 9713 ± 4% -36.2% 6193 ± 5% softirqs.CPU131.RCU 9772 ± 4% -34.0% 6448 ± 10% softirqs.CPU132.RCU 9995 ± 6% -37.7% 6225 ± 5% softirqs.CPU133.RCU 9886 ± 5% -35.7% 6352 ± 8% softirqs.CPU134.RCU 9740 ± 3% -35.4% 6290 ± 7% softirqs.CPU135.RCU 9745 ± 4% -36.0% 6240 ± 5% softirqs.CPU136.RCU 9748 ± 5% -30.3% 6798 ± 19% softirqs.CPU137.RCU 9685 ± 4% -36.9% 6111 ± 6% softirqs.CPU138.RCU 9725 ± 4% -27.2% 7077 ± 16% softirqs.CPU139.RCU 13759 ± 15% -43.3% 7804 ± 12% softirqs.CPU14.RCU 9984 ± 13% -41.9% 5800 softirqs.CPU140.RCU 9817 ± 6% -38.7% 6023 ± 4% softirqs.CPU141.RCU 10070 ± 8% -37.7% 6277 ± 2% softirqs.CPU143.RCU 11747 ± 11% -25.0% 8805 ± 16% softirqs.CPU15.RCU 9647 ± 5% -33.8% 6385 ± 7% softirqs.CPU16.RCU 9637 ± 3% -31.0% 6648 ± 8% softirqs.CPU17.RCU 12145 ± 7% -32.7% 8175 ± 4% softirqs.CPU18.RCU 12091 ± 4% -35.1% 7844 softirqs.CPU19.RCU 11595 ± 6% -32.4% 7839 ± 6% softirqs.CPU2.RCU 11665 ± 3% -34.3% 7663 ± 3% softirqs.CPU20.RCU 11688 ± 2% -31.8% 7966 ± 9% softirqs.CPU21.RCU 11576 ± 3% -35.1% 7517 ± 2% softirqs.CPU22.RCU 11515 ± 3% -36.4% 7322 softirqs.CPU23.RCU 11730 ± 5% -37.1% 7383 ± 3% softirqs.CPU24.RCU 11643 ± 5% -35.9% 7462 ± 3% softirqs.CPU25.RCU 11635 ± 5% -36.7% 7369 ± 2% softirqs.CPU26.RCU 11419 ± 4% -33.9% 7552 softirqs.CPU27.RCU 11615 ± 2% -34.1% 7651 ± 4% softirqs.CPU28.RCU 11352 ± 3% -35.5% 7317 ± 2% softirqs.CPU29.RCU 11486 ± 7% -31.4% 7876 ± 5% softirqs.CPU3.RCU 11323 ± 3% -32.8% 7607 ± 4% softirqs.CPU30.RCU 11376 ± 3% -34.3% 7473 ± 3% softirqs.CPU31.RCU 10292 ± 4% -37.1% 6479 ± 2% softirqs.CPU32.RCU 10329 ± 5% -35.6% 6653 ± 2% softirqs.CPU33.RCU 10218 ± 4% -36.2% 6516 softirqs.CPU34.RCU 10085 ± 4% -34.8% 6575 ± 3% softirqs.CPU35.RCU 12314 ± 4% -31.3% 8456 ± 9% softirqs.CPU36.RCU 12226 ± 4% -31.0% 8436 ± 10% softirqs.CPU37.RCU 12004 ± 3% -32.1% 8146 ± 8% softirqs.CPU38.RCU 11834 ± 3% -31.5% 8101 ± 8% softirqs.CPU39.RCU 11203 ± 5% -30.4% 7793 ± 10% softirqs.CPU4.RCU 11811 ± 3% -35.0% 7673 ± 4% softirqs.CPU40.RCU 11621 ± 3% -32.2% 7878 ± 6% softirqs.CPU41.RCU 11669 ± 4% -32.1% 7924 ± 9% softirqs.CPU42.RCU 11484 ± 4% -33.8% 7602 ± 6% softirqs.CPU43.RCU 11672 ± 3% -34.7% 7617 ± 6% softirqs.CPU44.RCU 11554 ± 4% -35.2% 7491 ± 5% softirqs.CPU45.RCU 11408 ± 4% -33.6% 7573 ± 7% softirqs.CPU46.RCU 11417 ± 3% -35.8% 7328 ± 4% softirqs.CPU47.RCU 11122 ± 4% -35.3% 7192 ± 5% softirqs.CPU48.RCU 11048 ± 3% -31.5% 7569 ± 8% softirqs.CPU49.RCU 11541 ± 5% -36.3% 7347 ± 5% softirqs.CPU5.RCU 10964 ± 4% -35.0% 7128 ± 6% softirqs.CPU50.RCU 11108 ± 4% -31.4% 7618 ± 11% softirqs.CPU51.RCU 11067 ± 4% -37.2% 6949 ± 2% softirqs.CPU52.RCU 11083 ± 4% -35.3% 7169 ± 5% softirqs.CPU53.RCU 11335 ± 5% -34.2% 7463 ± 5% softirqs.CPU54.RCU 11980 ± 5% -36.2% 7647 softirqs.CPU55.RCU 11510 ± 5% -32.7% 7750 ± 2% softirqs.CPU56.RCU 11074 ± 4% -34.2% 7286 softirqs.CPU57.RCU 11047 ± 4% -33.3% 7366 ± 4% softirqs.CPU58.RCU 10880 ± 4% -36.2% 6938 softirqs.CPU59.RCU 11114 ± 5% -33.3% 7415 ± 3% softirqs.CPU6.RCU 10997 ± 4% -36.8% 6948 ± 2% softirqs.CPU60.RCU 10900 ± 4% -36.1% 6970 ± 2% softirqs.CPU61.RCU 10723 ± 4% -36.3% 6834 ± 2% softirqs.CPU62.RCU 10623 ± 4% -36.6% 6735 softirqs.CPU63.RCU 10506 ± 3% -37.4% 6577 softirqs.CPU64.RCU 10539 ± 4% -36.7% 6671 ± 2% softirqs.CPU65.RCU 10682 ± 4% -38.0% 6621 ± 2% softirqs.CPU66.RCU 10872 ± 6% -37.9% 6754 ± 4% softirqs.CPU67.RCU 10555 ± 4% -32.8% 7092 ± 4% softirqs.CPU68.RCU 10640 ± 3% -36.6% 6744 ± 2% softirqs.CPU69.RCU 11279 ± 4% -39.0% 6878 ± 6% softirqs.CPU7.RCU 10616 ± 5% -38.4% 6534 softirqs.CPU70.RCU 10665 ± 4% -35.0% 6936 ± 7% softirqs.CPU71.RCU 11813 ± 4% -36.8% 7471 softirqs.CPU72.RCU 11967 ± 7% -34.6% 7830 ± 10% softirqs.CPU73.RCU 12118 ± 6% -27.4% 8801 ± 11% softirqs.CPU74.RCU 11935 ± 6% -39.1% 7265 softirqs.CPU75.RCU 11561 ± 3% -37.1% 7269 ± 2% softirqs.CPU76.RCU 11894 ± 5% -35.9% 7620 ± 9% softirqs.CPU77.RCU 11622 ± 5% -34.4% 7627 ± 8% softirqs.CPU78.RCU 12385 ± 7% -40.2% 7411 ± 4% softirqs.CPU79.RCU 11277 ± 7% -36.7% 7142 softirqs.CPU8.RCU 11593 ± 4% -38.9% 7089 ± 3% softirqs.CPU80.RCU 11465 ± 11% -39.3% 6958 ± 2% softirqs.CPU81.RCU 11890 ± 4% -40.6% 7059 softirqs.CPU82.RCU 11804 ± 4% -31.2% 8125 ± 16% softirqs.CPU83.RCU 11726 ± 5% -37.0% 7383 softirqs.CPU84.RCU 12170 ± 10% -39.6% 7344 ± 5% softirqs.CPU85.RCU 12384 ± 13% -35.6% 7981 ± 14% softirqs.CPU86.RCU 12043 ± 8% -32.6% 8117 ± 17% softirqs.CPU87.RCU 11942 ± 7% -39.6% 7219 ± 6% softirqs.CPU88.RCU 11958 ± 6% -38.3% 7372 ± 2% softirqs.CPU89.RCU 11212 ± 5% -19.8% 8997 ± 12% softirqs.CPU9.RCU 11994 ± 7% -34.3% 7875 ± 6% softirqs.CPU90.RCU 11071 ± 6% -36.0% 7087 ± 2% softirqs.CPU91.RCU 10816 ± 4% -36.3% 6889 ± 2% softirqs.CPU92.RCU 11010 ± 10% -39.6% 6653 softirqs.CPU93.RCU 10310 ± 7% -28.4% 7384 ± 15% softirqs.CPU94.RCU 10546 ± 4% -38.1% 6531 ± 2% softirqs.CPU95.RCU 11496 ± 3% -36.4% 7316 ± 3% softirqs.CPU96.RCU 11414 ± 5% -37.4% 7142 softirqs.CPU97.RCU 11311 ± 4% -37.2% 7101 ± 2% softirqs.CPU98.RCU 11231 ± 3% -34.6% 7341 ± 3% softirqs.CPU99.RCU 1605973 ± 3% -35.2% 1040028 ± 2% softirqs.RCU 2.03e+09 -2.5% 1.979e+09 interrupts.CAL:Function_call_interrupts 379.83 ± 6% +405.3% 1919 ± 30% interrupts.CPU0.RES:Rescheduling_interrupts 395.50 ± 4% +169.1% 1064 ± 16% interrupts.CPU1.RES:Rescheduling_interrupts 382.50 ± 8% +399.1% 1909 ± 29% interrupts.CPU10.RES:Rescheduling_interrupts 177.67 ± 25% +576.9% 1202 ± 19% interrupts.CPU100.RES:Rescheduling_interrupts 153.50 ± 21% +908.0% 1547 ± 14% interrupts.CPU101.RES:Rescheduling_interrupts 148.00 ± 22% +609.5% 1050 ± 12% interrupts.CPU102.RES:Rescheduling_interrupts 129.33 ± 20% +1100.0% 1552 ± 12% interrupts.CPU103.RES:Rescheduling_interrupts 119.50 ± 11% +1196.2% 1549 ± 30% interrupts.CPU104.RES:Rescheduling_interrupts 116.50 ± 19% +773.2% 1017 ± 23% interrupts.CPU105.RES:Rescheduling_interrupts 105.00 ± 16% +958.1% 1111 ± 9% interrupts.CPU106.RES:Rescheduling_interrupts 99.17 ± 15% +2345.0% 2424 ± 17% interrupts.CPU107.RES:Rescheduling_interrupts 130.83 ± 13% +1243.7% 1758 ± 33% interrupts.CPU108.RES:Rescheduling_interrupts 126.83 ± 15% +866.9% 1226 ± 14% interrupts.CPU109.RES:Rescheduling_interrupts 9188 -33.6% 6100 ± 35% interrupts.CPU11.NMI:Non-maskable_interrupts 9188 -33.6% 6100 ± 35% interrupts.CPU11.PMI:Performance_monitoring_interrupts 364.67 ± 3% +282.6% 1395 ± 8% interrupts.CPU11.RES:Rescheduling_interrupts 124.50 ± 12% +1229.3% 1655 ± 41% interrupts.CPU110.RES:Rescheduling_interrupts 111.50 ± 12% +784.0% 985.67 ± 29% interrupts.CPU111.RES:Rescheduling_interrupts 111.50 ± 16% +1000.4% 1227 ± 29% interrupts.CPU112.RES:Rescheduling_interrupts 112.67 ± 12% +696.4% 897.33 ± 12% interrupts.CPU113.RES:Rescheduling_interrupts 98.33 ± 23% +1228.1% 1306 ± 51% interrupts.CPU114.RES:Rescheduling_interrupts 97.00 ± 8% +984.5% 1052 ± 10% interrupts.CPU115.RES:Rescheduling_interrupts 97.17 ± 36% +1165.5% 1229 ± 14% interrupts.CPU116.RES:Rescheduling_interrupts 86.33 ± 12% +1385.7% 1282 ± 26% interrupts.CPU117.RES:Rescheduling_interrupts 91.33 ± 4% +710.9% 740.67 ± 18% interrupts.CPU118.RES:Rescheduling_interrupts 103.83 ± 17% +1063.4% 1208 ± 5% interrupts.CPU119.RES:Rescheduling_interrupts 360.67 ± 3% +300.5% 1444 ± 23% interrupts.CPU12.RES:Rescheduling_interrupts 87.50 ± 16% +2097.0% 1922 ± 65% interrupts.CPU120.RES:Rescheduling_interrupts 97.33 ± 8% +916.4% 989.33 ± 35% interrupts.CPU121.RES:Rescheduling_interrupts 8422 ± 20% -27.5% 6105 ± 35% interrupts.CPU122.NMI:Non-maskable_interrupts 8422 ± 20% -27.5% 6105 ± 35% interrupts.CPU122.PMI:Performance_monitoring_interrupts 89.17 ± 11% +1131.8% 1098 ± 27% interrupts.CPU122.RES:Rescheduling_interrupts 98.50 ± 26% +1359.9% 1438 ± 38% interrupts.CPU123.RES:Rescheduling_interrupts 89.67 ± 13% +1127.5% 1100 ± 5% interrupts.CPU124.RES:Rescheduling_interrupts 8412 ± 20% -27.4% 6107 ± 35% interrupts.CPU125.NMI:Non-maskable_interrupts 8412 ± 20% -27.4% 6107 ± 35% interrupts.CPU125.PMI:Performance_monitoring_interrupts 89.50 ± 17% +2383.4% 2222 ± 37% interrupts.CPU125.RES:Rescheduling_interrupts 123.83 ± 28% +1028.1% 1397 ± 29% interrupts.CPU126.RES:Rescheduling_interrupts 7652 ± 28% -40.2% 4578 interrupts.CPU127.NMI:Non-maskable_interrupts 7652 ± 28% -40.2% 4578 interrupts.CPU127.PMI:Performance_monitoring_interrupts 109.50 ± 10% +807.2% 993.33 ± 21% interrupts.CPU127.RES:Rescheduling_interrupts 8420 ± 20% -45.7% 4573 interrupts.CPU128.NMI:Non-maskable_interrupts 8420 ± 20% -45.7% 4573 interrupts.CPU128.PMI:Performance_monitoring_interrupts 95.33 ± 12% +1019.2% 1067 ± 26% interrupts.CPU128.RES:Rescheduling_interrupts 8423 ± 20% -27.4% 6114 ± 35% interrupts.CPU129.NMI:Non-maskable_interrupts 8423 ± 20% -27.4% 6114 ± 35% interrupts.CPU129.PMI:Performance_monitoring_interrupts 90.50 ± 9% +1170.3% 1149 ± 5% interrupts.CPU129.RES:Rescheduling_interrupts 376.50 ± 7% +295.8% 1490 ± 16% interrupts.CPU13.RES:Rescheduling_interrupts 106.83 ± 15% +1242.9% 1434 ± 21% interrupts.CPU130.RES:Rescheduling_interrupts 86.50 ± 3% +959.0% 916.00 ± 34% interrupts.CPU131.RES:Rescheduling_interrupts 8417 ± 20% -27.4% 6110 ± 35% interrupts.CPU132.NMI:Non-maskable_interrupts 8417 ± 20% -27.4% 6110 ± 35% interrupts.CPU132.PMI:Performance_monitoring_interrupts 88.67 ± 20% +1325.2% 1263 ± 13% interrupts.CPU132.RES:Rescheduling_interrupts 9182 -33.5% 6110 ± 35% interrupts.CPU133.NMI:Non-maskable_interrupts 9182 -33.5% 6110 ± 35% interrupts.CPU133.PMI:Performance_monitoring_interrupts 96.17 ± 14% +751.3% 818.67 ± 32% interrupts.CPU133.RES:Rescheduling_interrupts 9182 -33.5% 6108 ± 35% interrupts.CPU134.NMI:Non-maskable_interrupts 9182 -33.5% 6108 ± 35% interrupts.CPU134.PMI:Performance_monitoring_interrupts 118.83 ± 42% +858.5% 1139 ± 54% interrupts.CPU134.RES:Rescheduling_interrupts 9178 -33.5% 6107 ± 35% interrupts.CPU135.NMI:Non-maskable_interrupts 9178 -33.5% 6107 ± 35% interrupts.CPU135.PMI:Performance_monitoring_interrupts 83.33 ± 10% +1072.4% 977.00 ± 42% interrupts.CPU135.RES:Rescheduling_interrupts 79.67 ± 11% +929.7% 820.33 ± 30% interrupts.CPU136.RES:Rescheduling_interrupts 84.83 ± 9% +1550.3% 1400 ± 35% interrupts.CPU137.RES:Rescheduling_interrupts 96.17 ± 19% +708.3% 777.33 ± 32% interrupts.CPU138.RES:Rescheduling_interrupts 85.50 ± 10% +1402.5% 1284 ± 31% interrupts.CPU139.RES:Rescheduling_interrupts 362.00 ± 3% +328.3% 1550 ± 15% interrupts.CPU14.RES:Rescheduling_interrupts 77.67 ± 11% +949.8% 815.33 ± 33% interrupts.CPU140.RES:Rescheduling_interrupts 82.33 ± 20% +1217.0% 1084 ± 25% interrupts.CPU141.RES:Rescheduling_interrupts 95.00 ± 11% +898.6% 948.67 ± 9% interrupts.CPU142.RES:Rescheduling_interrupts 151.83 ± 6% +1154.7% 1905 ± 21% interrupts.CPU143.RES:Rescheduling_interrupts 9191 -33.4% 6122 ± 35% interrupts.CPU15.NMI:Non-maskable_interrupts 9191 -33.4% 6122 ± 35% interrupts.CPU15.PMI:Performance_monitoring_interrupts 384.83 ± 12% +257.8% 1377 ± 19% interrupts.CPU15.RES:Rescheduling_interrupts 374.67 ± 9% +324.4% 1590 ± 30% interrupts.CPU16.RES:Rescheduling_interrupts 374.67 ± 3% +434.5% 2002 ± 27% interrupts.CPU17.RES:Rescheduling_interrupts 455.83 ± 4% +830.1% 4239 ± 44% interrupts.CPU18.RES:Rescheduling_interrupts 427.00 ± 4% +389.0% 2088 ± 19% interrupts.CPU19.RES:Rescheduling_interrupts 376.00 +192.9% 1101 ± 19% interrupts.CPU2.RES:Rescheduling_interrupts 403.33 ± 5% +296.5% 1599 ± 9% interrupts.CPU20.RES:Rescheduling_interrupts 387.33 ± 3% +373.1% 1832 ± 10% interrupts.CPU21.RES:Rescheduling_interrupts 9190 -33.5% 6110 ± 35% interrupts.CPU22.NMI:Non-maskable_interrupts 9190 -33.5% 6110 ± 35% interrupts.CPU22.PMI:Performance_monitoring_interrupts 371.67 ± 2% +282.3% 1421 ± 18% interrupts.CPU22.RES:Rescheduling_interrupts 365.83 ± 3% +325.1% 1555 ± 31% interrupts.CPU23.RES:Rescheduling_interrupts 364.67 ± 5% +323.1% 1543 ± 4% interrupts.CPU24.RES:Rescheduling_interrupts 359.50 ± 3% +246.0% 1244 ± 38% interrupts.CPU25.RES:Rescheduling_interrupts 360.50 ± 3% +498.1% 2156 ± 49% interrupts.CPU26.RES:Rescheduling_interrupts 351.50 ± 2% +235.8% 1180 ± 27% interrupts.CPU27.RES:Rescheduling_interrupts 352.67 +277.8% 1332 ± 8% interrupts.CPU28.RES:Rescheduling_interrupts 360.00 ± 2% +244.5% 1240 ± 2% interrupts.CPU29.RES:Rescheduling_interrupts 389.67 ± 5% +278.2% 1473 ± 14% interrupts.CPU3.RES:Rescheduling_interrupts 372.17 ± 8% +424.0% 1950 ± 25% interrupts.CPU30.RES:Rescheduling_interrupts 360.67 ± 2% +396.0% 1789 ± 28% interrupts.CPU31.RES:Rescheduling_interrupts 352.00 +363.6% 1632 ± 13% interrupts.CPU32.RES:Rescheduling_interrupts 351.83 +357.1% 1608 ± 20% interrupts.CPU33.RES:Rescheduling_interrupts 363.83 ± 5% +259.6% 1308 ± 25% interrupts.CPU34.RES:Rescheduling_interrupts 350.17 ± 3% +604.5% 2467 ± 15% interrupts.CPU35.RES:Rescheduling_interrupts 447.67 ± 3% +568.7% 2993 ± 11% interrupts.CPU36.RES:Rescheduling_interrupts 458.67 ± 16% +296.6% 1819 ± 22% interrupts.CPU37.RES:Rescheduling_interrupts 411.33 +175.1% 1131 ± 9% interrupts.CPU38.RES:Rescheduling_interrupts 392.67 ± 6% +283.4% 1505 ± 14% interrupts.CPU39.RES:Rescheduling_interrupts 374.67 ± 4% +286.3% 1447 ± 24% interrupts.CPU4.RES:Rescheduling_interrupts 387.17 ± 5% +391.2% 1901 ± 35% interrupts.CPU40.RES:Rescheduling_interrupts 381.17 ± 2% +252.1% 1342 ± 33% interrupts.CPU41.RES:Rescheduling_interrupts 362.83 ± 2% +275.0% 1360 ± 39% interrupts.CPU42.RES:Rescheduling_interrupts 372.17 ± 2% +341.4% 1642 ± 26% interrupts.CPU43.RES:Rescheduling_interrupts 363.67 ± 6% +226.3% 1186 ± 18% interrupts.CPU44.RES:Rescheduling_interrupts 356.67 ± 3% +335.8% 1554 ± 8% interrupts.CPU45.RES:Rescheduling_interrupts 354.00 +367.5% 1655 ± 9% interrupts.CPU46.RES:Rescheduling_interrupts 349.33 ± 3% +264.0% 1271 ± 22% interrupts.CPU47.RES:Rescheduling_interrupts 357.33 ± 2% +362.4% 1652 ± 28% interrupts.CPU48.RES:Rescheduling_interrupts 349.83 ± 2% +543.0% 2249 ± 36% interrupts.CPU49.RES:Rescheduling_interrupts 374.00 ± 4% +299.0% 1492 ± 19% interrupts.CPU5.RES:Rescheduling_interrupts 354.50 ± 2% +327.7% 1516 ± 14% interrupts.CPU50.RES:Rescheduling_interrupts 357.67 ± 2% +217.7% 1136 ± 13% interrupts.CPU51.RES:Rescheduling_interrupts 377.33 ± 4% +218.6% 1202 ± 22% interrupts.CPU52.RES:Rescheduling_interrupts 430.33 ± 24% +369.8% 2021 ± 10% interrupts.CPU53.RES:Rescheduling_interrupts 466.83 ± 7% +292.1% 1830 ± 16% interrupts.CPU54.RES:Rescheduling_interrupts 408.67 ± 4% +275.2% 1533 ± 18% interrupts.CPU55.RES:Rescheduling_interrupts 383.33 ± 4% +184.2% 1089 ± 12% interrupts.CPU56.RES:Rescheduling_interrupts 394.17 ± 11% +217.8% 1252 ± 19% interrupts.CPU57.RES:Rescheduling_interrupts 415.33 ± 12% +211.0% 1291 ± 12% interrupts.CPU58.RES:Rescheduling_interrupts 369.33 ± 4% +244.2% 1271 ± 12% interrupts.CPU59.RES:Rescheduling_interrupts 387.50 ± 6% +177.3% 1074 ± 22% interrupts.CPU6.RES:Rescheduling_interrupts 376.33 ± 6% +173.9% 1030 ± 9% interrupts.CPU60.RES:Rescheduling_interrupts 368.50 ± 3% +256.7% 1314 ± 32% interrupts.CPU61.RES:Rescheduling_interrupts 387.00 ± 8% +398.4% 1929 ± 54% interrupts.CPU62.RES:Rescheduling_interrupts 357.33 ± 3% +309.8% 1464 ± 24% interrupts.CPU63.RES:Rescheduling_interrupts 358.83 ± 2% +261.6% 1297 ± 25% interrupts.CPU64.RES:Rescheduling_interrupts 369.17 ± 3% +309.3% 1511 ± 16% interrupts.CPU65.RES:Rescheduling_interrupts 363.67 ± 3% +225.8% 1184 ± 8% interrupts.CPU66.RES:Rescheduling_interrupts 357.50 ± 3% +693.9% 2838 ± 88% interrupts.CPU67.RES:Rescheduling_interrupts 356.83 ± 3% +462.9% 2008 ± 83% interrupts.CPU68.RES:Rescheduling_interrupts 351.33 ± 4% +334.3% 1525 ± 25% interrupts.CPU69.RES:Rescheduling_interrupts 378.83 ± 9% +346.5% 1691 ± 27% interrupts.CPU7.RES:Rescheduling_interrupts 346.00 +248.7% 1206 ± 29% interrupts.CPU70.RES:Rescheduling_interrupts 1413 ± 8% +65.9% 2344 ± 4% interrupts.CPU71.RES:Rescheduling_interrupts 442.33 ± 10% +257.4% 1581 ± 25% interrupts.CPU72.RES:Rescheduling_interrupts 404.50 ± 3% +280.0% 1537 ± 34% interrupts.CPU73.RES:Rescheduling_interrupts 396.83 ± 5% +341.6% 1752 ± 33% interrupts.CPU74.RES:Rescheduling_interrupts 384.17 ± 4% +248.4% 1338 ± 32% interrupts.CPU75.RES:Rescheduling_interrupts 371.33 ± 4% +220.2% 1189 ± 12% interrupts.CPU76.RES:Rescheduling_interrupts 386.67 ± 7% +338.4% 1695 ± 36% interrupts.CPU77.RES:Rescheduling_interrupts 362.67 +319.7% 1522 ± 33% interrupts.CPU78.RES:Rescheduling_interrupts 360.67 ± 3% +264.7% 1315 ± 12% interrupts.CPU79.RES:Rescheduling_interrupts 371.67 ± 7% +236.4% 1250 ± 11% interrupts.CPU8.RES:Rescheduling_interrupts 357.50 ± 2% +262.4% 1295 ± 22% interrupts.CPU80.RES:Rescheduling_interrupts 371.67 ± 5% +258.8% 1333 ± 22% interrupts.CPU81.RES:Rescheduling_interrupts 362.67 ± 4% +458.8% 2026 ± 17% interrupts.CPU82.RES:Rescheduling_interrupts 379.50 ± 11% +207.4% 1166 ± 12% interrupts.CPU83.RES:Rescheduling_interrupts 362.83 ± 4% +341.3% 1601 ± 47% interrupts.CPU84.RES:Rescheduling_interrupts 358.33 ± 4% +311.5% 1474 ± 38% interrupts.CPU85.RES:Rescheduling_interrupts 374.83 ± 7% +204.0% 1139 ± 21% interrupts.CPU86.RES:Rescheduling_interrupts 398.33 ± 16% +146.8% 983.00 ± 28% interrupts.CPU87.RES:Rescheduling_interrupts 345.83 ± 5% +451.9% 1908 ± 15% interrupts.CPU88.RES:Rescheduling_interrupts 351.00 ± 6% +379.1% 1681 ± 17% interrupts.CPU89.RES:Rescheduling_interrupts 374.83 ± 3% +404.0% 1889 ± 32% interrupts.CPU9.RES:Rescheduling_interrupts 366.00 ± 10% +689.7% 2890 ± 14% interrupts.CPU90.RES:Rescheduling_interrupts 349.50 ± 11% +400.0% 1747 ± 12% interrupts.CPU91.RES:Rescheduling_interrupts 337.00 ± 11% +403.0% 1695 ± 29% interrupts.CPU92.RES:Rescheduling_interrupts 289.17 ± 14% +719.3% 2369 ± 30% interrupts.CPU93.RES:Rescheduling_interrupts 277.50 ± 15% +442.9% 1506 ± 37% interrupts.CPU94.RES:Rescheduling_interrupts 259.50 ± 16% +606.9% 1834 ± 30% interrupts.CPU95.RES:Rescheduling_interrupts 239.67 ± 17% +377.5% 1144 ± 35% interrupts.CPU96.RES:Rescheduling_interrupts 214.17 ± 22% +870.6% 2078 ± 22% interrupts.CPU97.RES:Rescheduling_interrupts 202.00 ± 17% +336.8% 882.33 ± 16% interrupts.CPU98.RES:Rescheduling_interrupts 189.83 ± 20% +390.4% 931.00 ± 52% interrupts.CPU99.RES:Rescheduling_interrupts 42341 +407.8% 215020 interrupts.RES:Rescheduling_interrupts *************************************************************************************************** lkp-cpl-4sp1: 144 threads 4 sockets Intel(R) Xeon(R) Gold 5318H CPU @ 2.50GHz with 128G memory ========================================================================================= compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-8.3/thread/16/debian-10.4-x86_64-20200603.cgz/lkp-cpl-4sp1/tlb_flush1/will-it-scale/0x700001e commit: 3c28c7680e ("memcg: switch lruvec stats to rstat") 45208c9105 ("memcg: infrastructure to flush memcg stats") 3c28c7680e1c39b9 45208c9105bd96015b98cdf31fb ---------------- --------------------------- %stddev %change %stddev \ | \ 881519 -8.9% 802893 will-it-scale.16.threads 55094 -8.9% 50180 will-it-scale.per_thread_ops 881519 -8.9% 802893 will-it-scale.workload 78295432 +18.6% 92878961 ± 8% cpuidle..usage 8.45 +0.9 9.32 mpstat.cpu.all.sys% 3763 +1722.9% 68607 ± 3% vmstat.system.cs 6292179 -4.7% 5999045 vmstat.system.in 60233 ± 4% +278.2% 227817 ± 4% numa-meminfo.node3.Active 60233 ± 4% +278.2% 227817 ± 4% numa-meminfo.node3.Active(anon) 79033 ± 43% +230.6% 261305 ± 20% numa-meminfo.node3.FilePages 63708 ± 9% +275.3% 239107 ± 3% numa-meminfo.node3.Shmem 15044 ± 4% +278.5% 56935 ± 4% numa-vmstat.node3.nr_active_anon 19763 ± 43% +230.6% 65338 ± 20% numa-vmstat.node3.nr_file_pages 15931 ± 9% +275.3% 59789 ± 3% numa-vmstat.node3.nr_shmem 15044 ± 4% +278.5% 56935 ± 4% numa-vmstat.node3.nr_zone_active_anon 67214 ± 10% +14.6% 77043 ± 7% slabinfo.anon_vma_chain.active_objs 1054 ± 10% +14.6% 1208 ± 7% slabinfo.anon_vma_chain.active_slabs 67487 ± 10% +14.6% 77365 ± 7% slabinfo.anon_vma_chain.num_objs 1054 ± 10% +14.6% 1208 ± 7% slabinfo.anon_vma_chain.num_slabs 532831 +8.0% 575345 proc-vmstat.nr_active_anon 1180621 +3.8% 1224980 proc-vmstat.nr_file_pages 75483 +2.6% 77450 proc-vmstat.nr_inactive_anon 539700 +8.2% 583812 proc-vmstat.nr_shmem 532831 +8.0% 575345 proc-vmstat.nr_zone_active_anon 75483 +2.6% 77450 proc-vmstat.nr_zone_inactive_anon 2.679e+08 -8.9% 2.442e+08 proc-vmstat.numa_hit 2.68e+08 -8.9% 2.442e+08 proc-vmstat.numa_local 546779 +11.7% 610647 proc-vmstat.pgactivate 2.677e+08 -8.9% 2.44e+08 proc-vmstat.pgalloc_normal 5.319e+08 -8.9% 4.844e+08 proc-vmstat.pgfault 2.677e+08 -8.9% 2.439e+08 proc-vmstat.pgfree 57.00 ± 95% +5483.3% 3182 ±197% softirqs.CPU103.TIMER 34363 ± 22% +22.8% 42201 ± 3% softirqs.CPU109.SCHED 24001 ± 4% +8.2% 25980 ± 10% softirqs.CPU11.SCHED 26220 ± 8% -11.5% 23206 ± 8% softirqs.CPU12.SCHED 37634 ± 12% +13.1% 42580 ± 3% softirqs.CPU120.SCHED 36873 ± 16% +17.1% 43180 softirqs.CPU125.SCHED 6832 ± 9% +25.2% 8555 ± 18% softirqs.CPU16.RCU 40797 ± 2% -18.2% 33367 softirqs.CPU16.SCHED 40659 ± 2% -22.1% 31690 ± 5% softirqs.CPU17.SCHED 39914 ± 4% +8.7% 43395 ± 3% softirqs.CPU49.SCHED 36889 ± 16% +26.3% 46576 ± 20% softirqs.CPU53.SCHED 12351 ± 5% -10.9% 11002 ± 7% softirqs.CPU8.RCU 37338 ± 17% +13.6% 42426 ± 2% softirqs.CPU93.SCHED 37391 ± 17% +13.7% 42516 ± 2% softirqs.CPU95.SCHED 1.831e+09 -5.0% 1.74e+09 interrupts.CAL:Function_call_interrupts 2.867e+08 ± 9% -20.9% 2.268e+08 ± 16% interrupts.CPU11.TLB:TLB_shootdowns 68.83 ± 36% +4923.2% 3457 ± 41% interrupts.CPU16.NMI:Non-maskable_interrupts 68.83 ± 36% +4923.2% 3457 ± 41% interrupts.CPU16.PMI:Performance_monitoring_interrupts 31.33 ±161% +12292.6% 3883 ± 22% interrupts.CPU16.RES:Rescheduling_interrupts 84.50 ± 19% +3919.5% 3396 ± 39% interrupts.CPU17.NMI:Non-maskable_interrupts 84.50 ± 19% +3919.5% 3396 ± 39% interrupts.CPU17.PMI:Performance_monitoring_interrupts 17.50 ±109% +22560.0% 3965 ± 27% interrupts.CPU17.RES:Rescheduling_interrupts 2.768e+08 ± 5% -18.3% 2.26e+08 ± 14% interrupts.CPU72.TLB:TLB_shootdowns 2.973e+08 ± 11% -25.1% 2.226e+08 ± 23% interrupts.CPU8.TLB:TLB_shootdowns 72.33 ± 26% +4111.8% 3046 ± 65% interrupts.CPU88.NMI:Non-maskable_interrupts 72.33 ± 26% +4111.8% 3046 ± 65% interrupts.CPU88.PMI:Performance_monitoring_interrupts 22.50 ±167% +13497.0% 3059 ± 22% interrupts.CPU88.RES:Rescheduling_interrupts 76.17 ± 36% +2769.1% 2185 ± 63% interrupts.CPU89.NMI:Non-maskable_interrupts 76.17 ± 36% +2769.1% 2185 ± 63% interrupts.CPU89.PMI:Performance_monitoring_interrupts 9.17 ±115% +28389.1% 2611 ± 37% interrupts.CPU89.RES:Rescheduling_interrupts 648.33 ± 10% +29.2% 837.50 ± 18% interrupts.CPU9.RES:Rescheduling_interrupts 52.50 ± 15% +254.9% 186.33 ± 4% interrupts.IWI:IRQ_work_interrupts 19314 ± 2% +100.0% 38621 ± 4% interrupts.RES:Rescheduling_interrupts 0.00 ± 35% -66.7% 0.00 ± 31% perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 0.01 ± 16% -77.8% 0.00 perf-sched.sch_delay.avg.ms.worker_thread.kthread.ret_from_fork 3.51 ± 4% +300.8% 14.06 ± 52% perf-sched.sch_delay.max.ms.worker_thread.kthread.ret_from_fork 111.09 ± 2% -94.5% 6.14 ± 7% perf-sched.total_wait_and_delay.average.ms 19107 +1693.5% 342694 ± 6% perf-sched.total_wait_and_delay.count.ms 111.08 ± 2% -94.5% 6.14 ± 7% perf-sched.total_wait_time.average.ms 0.63 ± 3% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 0.05 ± 17% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown] 0.08 ± 87% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.73 ± 8% -84.5% 0.89 ±223% perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr 0.09 ± 5% +70.9% 0.15 ± 20% perf-sched.wait_and_delay.avg.ms.rwsem_down_read_slowpath.do_madvise.part.0.__x64_sys_madvise 0.09 ± 6% +72.2% 0.15 ± 14% perf-sched.wait_and_delay.avg.ms.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.05 ± 8% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.rwsem_down_write_slowpath.down_write_killable.__vm_munmap.__x64_sys_munmap 0.01 ± 15% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff 497.61 ± 8% -65.2% 173.18 ± 5% perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 495.72 ± 4% -99.8% 1.19 ± 9% perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork 304.00 -100.0% 0.00 perf-sched.wait_and_delay.count.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 137.33 ± 4% -100.0% 0.00 perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown] 135.67 ± 11% -100.0% 0.00 perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe 2743 -13.4% 2375 perf-sched.wait_and_delay.count.rwsem_down_read_slowpath.do_madvise.part.0.__x64_sys_madvise 4819 -12.1% 4234 perf-sched.wait_and_delay.count.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 791.83 ± 2% -100.0% 0.00 perf-sched.wait_and_delay.count.rwsem_down_write_slowpath.down_write_killable.__vm_munmap.__x64_sys_munmap 671.83 ± 8% -100.0% 0.00 perf-sched.wait_and_delay.count.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff 73.00 ± 11% +181.7% 205.67 ± 4% perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 778.17 ± 2% +41662.6% 324982 ± 6% perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork 16.56 -100.0% 0.00 perf-sched.wait_and_delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 0.43 ±152% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown] 4.67 ±217% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe 1213 ± 39% -86.3% 166.83 ±223% perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr 1.96 ± 6% +88.1% 3.70 ± 19% perf-sched.wait_and_delay.max.ms.rwsem_down_read_slowpath.do_madvise.part.0.__x64_sys_madvise 2.17 ± 19% +106.0% 4.48 ± 42% perf-sched.wait_and_delay.max.ms.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 1.93 ± 7% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.rwsem_down_write_slowpath.down_write_killable.__vm_munmap.__x64_sys_munmap 0.71 ±134% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff 5763 -39.8% 3470 perf-sched.wait_and_delay.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 1059 +183.9% 3006 ± 45% perf-sched.wait_and_delay.max.ms.smpboot_thread_fn.kthread.ret_from_fork 0.63 ± 3% +19.5% 0.75 ± 6% perf-sched.wait_time.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 0.05 ± 13% +27.3% 0.06 ± 6% perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.04 ± 17% +34.5% 0.06 ± 18% perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.unmap_page_range.zap_page_range.do_madvise 0.04 ± 9% +32.9% 0.06 ± 6% perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.wp_page_copy.__handle_mm_fault.handle_mm_fault 0.05 ± 14% +74.7% 0.09 ± 37% perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.zap_page_range.do_madvise.part 0.08 ± 5% +73.0% 0.15 ± 21% perf-sched.wait_time.avg.ms.rwsem_down_read_slowpath.do_madvise.part.0.__x64_sys_madvise 0.08 ± 6% +75.2% 0.15 ± 15% perf-sched.wait_time.avg.ms.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.05 ± 9% +45.8% 0.07 ± 26% perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.down_write_killable.__vm_munmap.__x64_sys_munmap 497.60 ± 8% -65.2% 173.18 ± 5% perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 495.70 ± 4% -99.8% 1.18 ± 9% perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork 0.06 ± 17% +57.0% 0.10 ± 25% perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.unmap_page_range.zap_page_range.do_madvise 0.08 ± 17% +54.0% 0.12 ± 10% perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wp_page_copy.__handle_mm_fault.handle_mm_fault 0.19 ±103% +644.7% 1.40 ± 88% perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.zap_page_range.do_madvise.part 1.96 ± 6% +88.2% 3.69 ± 19% perf-sched.wait_time.max.ms.rwsem_down_read_slowpath.do_madvise.part.0.__x64_sys_madvise 1.96 ± 6% +128.1% 4.48 ± 42% perf-sched.wait_time.max.ms.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 1.93 ± 7% +73.6% 3.34 ± 9% perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.down_write_killable.__vm_munmap.__x64_sys_munmap 5763 -39.8% 3470 perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 1059 +183.9% 3006 ± 45% perf-sched.wait_time.max.ms.smpboot_thread_fn.kthread.ret_from_fork 4.315e+09 +31.8% 5.687e+09 perf-stat.i.branch-instructions 14.41 ± 6% -3.2 11.18 ± 3% perf-stat.i.cache-miss-rate% 60050687 -5.1% 56968208 ± 2% perf-stat.i.cache-misses 4.181e+08 ± 6% +22.0% 5.1e+08 ± 5% perf-stat.i.cache-references 3682 +1769.2% 68827 ± 3% perf-stat.i.context-switches 2.75 -13.6% 2.38 perf-stat.i.cpi 5.6e+10 +7.7% 6.032e+10 perf-stat.i.cpu-cycles 148.56 +2.7% 152.55 perf-stat.i.cpu-migrations 936.30 +13.4% 1061 perf-stat.i.cycles-between-cache-misses 0.15 ± 11% -0.0 0.12 ± 11% perf-stat.i.dTLB-load-miss-rate% 5.528e+09 +22.7% 6.783e+09 perf-stat.i.dTLB-loads 0.21 -0.0 0.20 ± 2% perf-stat.i.dTLB-store-miss-rate% 6087357 -7.0% 5663595 ± 2% perf-stat.i.dTLB-store-misses 2.895e+09 -2.5% 2.823e+09 perf-stat.i.dTLB-stores 19456084 -10.2% 17474512 perf-stat.i.iTLB-load-misses 2.034e+10 +24.7% 2.537e+10 perf-stat.i.instructions 1067 ± 2% +37.5% 1468 perf-stat.i.instructions-per-iTLB-miss 0.36 +15.7% 0.42 perf-stat.i.ipc 0.39 +7.7% 0.42 perf-stat.i.metric.GHz 386.28 -6.8% 359.94 perf-stat.i.metric.K/sec 91.35 +20.1% 109.72 perf-stat.i.metric.M/sec 1761542 -8.9% 1604821 perf-stat.i.minor-faults 0.75 ± 6% +0.4 1.11 ± 4% perf-stat.i.node-load-miss-rate% 223203 ± 9% +53.4% 342504 ± 5% perf-stat.i.node-load-misses 43049558 -9.0% 39190464 perf-stat.i.node-loads 72.15 ± 6% +13.5 85.67 perf-stat.i.node-store-miss-rate% 76575 ± 5% +797.1% 686936 ± 7% perf-stat.i.node-store-misses 36453 ± 12% +229.8% 120214 ± 6% perf-stat.i.node-stores 1761543 -8.9% 1604822 perf-stat.i.page-faults 14.42 ± 6% -3.2 11.19 ± 3% perf-stat.overall.cache-miss-rate% 2.75 -13.6% 2.38 perf-stat.overall.cpi 932.62 +13.6% 1059 perf-stat.overall.cycles-between-cache-misses 0.15 ± 11% -0.0 0.12 ± 11% perf-stat.overall.dTLB-load-miss-rate% 0.21 -0.0 0.20 ± 2% perf-stat.overall.dTLB-store-miss-rate% 1045 +38.8% 1450 perf-stat.overall.instructions-per-iTLB-miss 0.36 +15.8% 0.42 perf-stat.overall.ipc 0.52 ± 9% +0.4 0.87 ± 5% perf-stat.overall.node-load-miss-rate% 67.86 ± 5% +17.2 85.07 perf-stat.overall.node-store-miss-rate% 6961497 +36.8% 9523188 perf-stat.overall.path-length 4.3e+09 +31.8% 5.667e+09 perf-stat.ps.branch-instructions 59848727 -5.1% 56771113 ± 2% perf-stat.ps.cache-misses 4.167e+08 ± 6% +22.0% 5.082e+08 ± 5% perf-stat.ps.cache-references 3668 +1769.9% 68588 ± 3% perf-stat.ps.context-switches 5.581e+10 +7.7% 6.011e+10 perf-stat.ps.cpu-cycles 148.06 +2.7% 152.00 perf-stat.ps.cpu-migrations 5.509e+09 +22.7% 6.76e+09 perf-stat.ps.dTLB-loads 6066825 -7.0% 5644008 ± 2% perf-stat.ps.dTLB-store-misses 2.885e+09 -2.5% 2.813e+09 perf-stat.ps.dTLB-stores 19396258 ± 2% -10.2% 17424044 perf-stat.ps.iTLB-load-misses 2.027e+10 +24.7% 2.528e+10 perf-stat.ps.instructions 1755603 -8.9% 1599280 perf-stat.ps.minor-faults 222251 ± 9% +53.4% 340934 ± 5% perf-stat.ps.node-load-misses 42905931 -9.0% 39056903 perf-stat.ps.node-loads 76261 ± 5% +797.2% 684245 ± 7% perf-stat.ps.node-store-misses 36159 ± 13% +230.6% 119551 ± 6% perf-stat.ps.node-stores 1755604 -8.9% 1599281 perf-stat.ps.page-faults 6.137e+12 +24.6% 7.646e+12 perf-stat.total.instructions 5.85 ± 10% -1.0 4.88 ± 10% perf-profile.calltrace.cycles-pp.llist_add_batch.smp_call_function_many_cond.on_each_cpu_cond_mask.flush_tlb_mm_range.ptep_clear_flush 3.40 ± 11% -0.7 2.67 ± 9% perf-profile.calltrace.cycles-pp.asm_sysvec_call_function.llist_add_batch.smp_call_function_many_cond.on_each_cpu_cond_mask.flush_tlb_mm_range 2.64 ± 11% -0.6 2.06 ± 9% perf-profile.calltrace.cycles-pp.sysvec_call_function.asm_sysvec_call_function.llist_add_batch.smp_call_function_many_cond.on_each_cpu_cond_mask 2.45 ± 11% -0.5 1.92 ± 9% perf-profile.calltrace.cycles-pp.__sysvec_call_function.sysvec_call_function.asm_sysvec_call_function.llist_add_batch.smp_call_function_many_cond 2.44 ± 11% -0.5 1.90 ± 9% perf-profile.calltrace.cycles-pp.flush_smp_call_function_queue.__sysvec_call_function.sysvec_call_function.asm_sysvec_call_function.llist_add_batch 0.63 ± 12% -0.4 0.26 ±100% perf-profile.calltrace.cycles-pp.release_pages.__pagevec_lru_add.lru_add_drain_cpu.lru_add_drain.zap_page_range 1.58 ± 10% -0.3 1.28 ± 9% perf-profile.calltrace.cycles-pp.next_uptodate_page.filemap_map_pages.do_fault.__handle_mm_fault.handle_mm_fault 0.68 ± 11% -0.3 0.38 ± 70% perf-profile.calltrace.cycles-pp.up_read.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.testcase 1.46 ± 10% -0.3 1.18 ± 10% perf-profile.calltrace.cycles-pp.asm_sysvec_call_function.default_send_IPI_mask_sequence_phys.smp_call_function_many_cond.on_each_cpu_cond_mask.flush_tlb_mm_range 1.61 ± 10% -0.3 1.32 ± 10% perf-profile.calltrace.cycles-pp.copy_page.wp_page_copy.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 1.52 ± 10% -0.3 1.26 ± 9% perf-profile.calltrace.cycles-pp.asm_exc_page_fault.__madvise 0.86 ± 13% -0.2 0.66 ± 10% perf-profile.calltrace.cycles-pp.asm_sysvec_call_function.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.testcase 0.78 ± 10% -0.2 0.60 ± 10% perf-profile.calltrace.cycles-pp.asm_sysvec_call_function.copy_page.wp_page_copy.__handle_mm_fault.handle_mm_fault 0.78 ± 12% -0.2 0.62 ± 11% perf-profile.calltrace.cycles-pp.down_read_trylock.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.testcase 0.71 ± 13% +0.2 0.86 ± 6% perf-profile.calltrace.cycles-pp.zap_pte_range.unmap_page_range.zap_page_range.do_madvise.__x64_sys_madvise 1.22 ± 10% +0.3 1.51 ± 6% perf-profile.calltrace.cycles-pp.uncharge_batch.__mem_cgroup_uncharge_list.release_pages.tlb_flush_mmu.tlb_finish_mmu 0.00 +0.6 0.59 ± 10% perf-profile.calltrace.cycles-pp.__mod_lruvec_page_state.page_add_file_rmap.do_set_pte.filemap_map_pages.do_fault 0.00 +0.7 0.69 ± 9% perf-profile.calltrace.cycles-pp.page_add_file_rmap.do_set_pte.filemap_map_pages.do_fault.__handle_mm_fault 0.00 +0.8 0.75 ± 9% perf-profile.calltrace.cycles-pp.do_set_pte.filemap_map_pages.do_fault.__handle_mm_fault.handle_mm_fault 0.00 +2.3 2.33 ± 21% perf-profile.calltrace.cycles-pp.mem_cgroup_css_rstat_flush.cgroup_rstat_flush_locked.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work 0.00 +3.5 3.51 ± 21% perf-profile.calltrace.cycles-pp.cgroup_rstat_flush_locked.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work.worker_thread 0.00 +3.5 3.52 ± 21% perf-profile.calltrace.cycles-pp.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work.worker_thread.kthread 0.00 +3.5 3.54 ± 21% perf-profile.calltrace.cycles-pp.mem_cgroup_flush_stats.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +3.6 3.59 ± 21% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +3.9 3.86 ± 20% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork 0.00 +3.9 3.88 ± 20% perf-profile.calltrace.cycles-pp.ret_from_fork 0.00 +3.9 3.88 ± 20% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 12.58 ± 10% -2.1 10.52 ± 10% perf-profile.children.cycles-pp.llist_add_batch 2.11 ± 10% -0.4 1.72 ± 9% perf-profile.children.cycles-pp.copy_page 1.68 ± 10% -0.3 1.36 ± 9% perf-profile.children.cycles-pp.next_uptodate_page 0.83 ± 12% -0.2 0.66 ± 11% perf-profile.children.cycles-pp.down_read_trylock 0.83 ± 11% -0.2 0.68 ± 10% perf-profile.children.cycles-pp.up_read 0.76 ± 9% -0.1 0.63 ± 9% perf-profile.children.cycles-pp.asm_sysvec_call_function_single 0.23 ± 13% -0.1 0.12 ± 12% perf-profile.children.cycles-pp.mem_cgroup_update_lru_size 0.52 ± 12% -0.1 0.42 ± 9% perf-profile.children.cycles-pp.down_read 0.27 ± 15% -0.1 0.17 ± 10% perf-profile.children.cycles-pp.sync_mm_rss 0.34 ± 16% -0.1 0.27 ± 9% perf-profile.children.cycles-pp.tlb_gather_mmu 0.21 ± 9% -0.1 0.15 ± 7% perf-profile.children.cycles-pp.__list_add_valid 0.30 ± 12% -0.1 0.25 ± 7% perf-profile.children.cycles-pp.__perf_sw_event 0.17 ± 12% -0.0 0.14 ± 12% perf-profile.children.cycles-pp.free_unref_page_list 0.08 ± 9% -0.0 0.05 ± 46% perf-profile.children.cycles-pp.syscall_enter_from_user_mode 0.08 ± 17% +0.0 0.13 ± 10% perf-profile.children.cycles-pp.propagate_protected_usage 0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.shmem_getpage_gfp 0.02 ± 99% +0.1 0.10 ± 25% perf-profile.children.cycles-pp.lru_cache_add 0.00 +0.1 0.08 ± 12% perf-profile.children.cycles-pp.__get_user_nocheck_8 0.00 +0.1 0.08 ± 9% perf-profile.children.cycles-pp.perf_callchain_user 0.00 +0.1 0.09 ± 12% perf-profile.children.cycles-pp.generic_perform_write 0.19 ± 5% +0.1 0.28 ± 13% perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime 0.00 +0.1 0.09 ± 14% perf-profile.children.cycles-pp.generic_file_write_iter 0.00 +0.1 0.09 ± 14% perf-profile.children.cycles-pp.__generic_file_write_iter 0.00 +0.1 0.09 ± 21% perf-profile.children.cycles-pp.perf_output_sample 0.00 +0.1 0.09 ± 14% perf-profile.children.cycles-pp.__libc_write 0.20 ± 5% +0.1 0.30 ± 13% perf-profile.children.cycles-pp.update_curr 0.00 +0.1 0.10 ± 13% perf-profile.children.cycles-pp.ksys_write 0.00 +0.1 0.10 ± 13% perf-profile.children.cycles-pp.vfs_write 0.00 +0.1 0.10 ± 13% perf-profile.children.cycles-pp.new_sync_write 0.01 ±223% +0.1 0.12 ± 9% perf-profile.children.cycles-pp.__orc_find 0.02 ±141% +0.1 0.13 ± 24% perf-profile.children.cycles-pp.perf_session__deliver_event 0.02 ±141% +0.1 0.13 ± 23% perf-profile.children.cycles-pp.__ordered_events__flush 0.01 ±223% +0.1 0.13 ± 24% perf-profile.children.cycles-pp.perf_session__process_user_event 0.00 +0.1 0.13 ± 30% perf-profile.children.cycles-pp.dequeue_entity 0.00 +0.1 0.13 ± 30% perf-profile.children.cycles-pp.dequeue_task_fair 0.00 +0.1 0.14 ± 11% perf-profile.children.cycles-pp.mem_cgroup_charge_statistics 0.03 ±100% +0.1 0.17 ± 21% perf-profile.children.cycles-pp.__unwind_start 0.08 ± 55% +0.2 0.23 ± 23% perf-profile.children.cycles-pp.process_simple 0.12 ± 31% +0.2 0.29 ± 21% perf-profile.children.cycles-pp.__libc_start_main 0.12 ± 31% +0.2 0.29 ± 21% perf-profile.children.cycles-pp.main 0.12 ± 31% +0.2 0.29 ± 21% perf-profile.children.cycles-pp.run_builtin 0.11 ± 36% +0.2 0.28 ± 22% perf-profile.children.cycles-pp.cmd_record 0.11 ± 36% +0.2 0.28 ± 22% perf-profile.children.cycles-pp.cmd_sched 0.09 ± 53% +0.2 0.26 ± 22% perf-profile.children.cycles-pp.record__finish_output 0.09 ± 53% +0.2 0.26 ± 22% perf-profile.children.cycles-pp.perf_session__process_events 0.00 +0.2 0.18 ± 26% perf-profile.children.cycles-pp.schedule_idle 0.15 ± 10% +0.2 0.34 ± 11% perf-profile.children.cycles-pp.charge_memcg 0.00 +0.2 0.21 ± 31% perf-profile.children.cycles-pp.perf_trace_sched_switch 0.00 +0.2 0.21 ± 11% perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template 0.11 ± 6% +0.2 0.32 ± 16% perf-profile.children.cycles-pp.unwind_next_frame 0.23 ± 19% +0.2 0.45 ± 7% perf-profile.children.cycles-pp.__mem_cgroup_charge 0.00 +0.2 0.23 ± 23% perf-profile.children.cycles-pp.__count_memcg_events 0.14 ± 9% +0.3 0.39 ± 17% perf-profile.children.cycles-pp.perf_callchain_kernel 0.03 ±100% +0.3 0.29 ± 23% perf-profile.children.cycles-pp.__mod_memcg_state 0.00 +0.3 0.28 ± 30% perf-profile.children.cycles-pp.schedule 0.18 ± 7% +0.3 0.48 ± 15% perf-profile.children.cycles-pp.get_perf_callchain 1.23 ± 10% +0.3 1.54 ± 6% perf-profile.children.cycles-pp.uncharge_batch 0.18 ± 7% +0.3 0.49 ± 15% perf-profile.children.cycles-pp.perf_callchain 0.00 +0.3 0.32 ± 10% perf-profile.children.cycles-pp.try_to_wake_up 0.00 +0.3 0.33 ± 10% perf-profile.children.cycles-pp.__queue_work 0.18 ± 8% +0.3 0.52 ± 15% perf-profile.children.cycles-pp.perf_prepare_sample 0.04 ± 71% +0.4 0.45 ± 28% perf-profile.children.cycles-pp.__schedule 0.20 ± 6% +0.4 0.64 ± 17% perf-profile.children.cycles-pp.perf_event_output_forward 0.20 ± 6% +0.4 0.65 ± 17% perf-profile.children.cycles-pp.perf_swevent_overflow 0.20 ± 6% +0.4 0.65 ± 17% perf-profile.children.cycles-pp.__perf_event_overflow 0.21 ± 7% +0.5 0.67 ± 17% perf-profile.children.cycles-pp.perf_tp_event 0.00 +0.5 0.47 ± 9% perf-profile.children.cycles-pp.queue_work_on 0.36 ± 11% +0.5 0.83 ± 8% perf-profile.children.cycles-pp.page_remove_rmap 0.22 ± 15% +0.5 0.70 ± 9% perf-profile.children.cycles-pp.page_add_file_rmap 0.30 ± 14% +0.5 0.80 ± 9% perf-profile.children.cycles-pp.do_set_pte 0.08 ± 13% +0.5 0.61 ± 10% perf-profile.children.cycles-pp.page_add_new_anon_rmap 0.21 ± 10% +0.7 0.94 ± 17% perf-profile.children.cycles-pp._raw_spin_lock 4.75 ± 8% +1.3 6.09 ± 10% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 3.86 ± 8% +1.4 5.24 ± 10% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.18 ± 11% +1.4 1.62 ± 10% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state 0.08 ± 11% +1.5 1.58 ± 9% perf-profile.children.cycles-pp.cgroup_rstat_updated 0.34 ± 11% +1.5 1.86 ± 9% perf-profile.children.cycles-pp.__mod_lruvec_page_state 0.00 +2.3 2.34 ± 21% perf-profile.children.cycles-pp.mem_cgroup_css_rstat_flush 0.00 +3.5 3.52 ± 21% perf-profile.children.cycles-pp.cgroup_rstat_flush_locked 0.00 +3.5 3.52 ± 21% perf-profile.children.cycles-pp.cgroup_rstat_flush_irqsafe 0.00 +3.5 3.54 ± 21% perf-profile.children.cycles-pp.mem_cgroup_flush_stats 0.00 +3.6 3.59 ± 21% perf-profile.children.cycles-pp.process_one_work 0.00 +3.9 3.86 ± 20% perf-profile.children.cycles-pp.worker_thread 0.01 ±223% +3.9 3.88 ± 20% perf-profile.children.cycles-pp.ret_from_fork 0.01 ±223% +3.9 3.88 ± 20% perf-profile.children.cycles-pp.kthread 1.57 ± 10% -0.3 1.32 ± 9% perf-profile.self.cycles-pp.copy_page 0.53 ± 12% -0.1 0.41 ± 11% perf-profile.self.cycles-pp.__handle_mm_fault 0.23 ± 13% -0.1 0.12 ± 13% perf-profile.self.cycles-pp.mem_cgroup_update_lru_size 0.64 ± 11% -0.1 0.54 ± 11% perf-profile.self.cycles-pp.up_read 0.26 ± 11% -0.1 0.19 ± 18% perf-profile.self.cycles-pp.ptep_clear_flush 0.20 ± 16% -0.1 0.13 ± 11% perf-profile.self.cycles-pp.sync_mm_rss 0.30 ± 12% -0.1 0.23 ± 12% perf-profile.self.cycles-pp.do_user_addr_fault 0.21 ± 10% -0.1 0.15 ± 9% perf-profile.self.cycles-pp.__list_add_valid 0.26 ± 12% -0.0 0.22 ± 9% perf-profile.self.cycles-pp.native_flush_tlb_multi 0.14 ± 14% -0.0 0.11 ± 14% perf-profile.self.cycles-pp.sysvec_call_function 0.06 ± 13% +0.0 0.08 ± 9% perf-profile.self.cycles-pp.__mod_node_page_state 0.06 ± 51% +0.1 0.11 ± 12% perf-profile.self.cycles-pp.propagate_protected_usage 0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.queue_work_on 0.02 ±141% +0.1 0.09 ± 31% perf-profile.self.cycles-pp.uncharge_batch 0.00 +0.1 0.07 ± 25% perf-profile.self.cycles-pp.lru_cache_add 0.07 ± 18% +0.1 0.15 ± 27% perf-profile.self.cycles-pp.__mod_memcg_lruvec_state 0.00 +0.1 0.08 ± 17% perf-profile.self.cycles-pp.lock_page_lruvec_irqsave 0.01 ±223% +0.1 0.12 ± 12% perf-profile.self.cycles-pp.__orc_find 0.01 ±223% +0.1 0.12 ± 20% perf-profile.self.cycles-pp.unwind_next_frame 0.07 ± 11% +0.2 0.22 ± 11% perf-profile.self.cycles-pp.__mod_lruvec_page_state 0.00 +0.2 0.23 ± 23% perf-profile.self.cycles-pp.__count_memcg_events 0.00 +0.2 0.24 ± 24% perf-profile.self.cycles-pp.__mod_memcg_state 0.00 +0.5 0.48 ± 20% perf-profile.self.cycles-pp.cgroup_rstat_flush_locked 0.07 ± 9% +0.6 0.68 ± 10% perf-profile.self.cycles-pp.cgroup_rstat_updated 0.17 ± 12% +0.7 0.89 ± 18% perf-profile.self.cycles-pp._raw_spin_lock 3.86 ± 8% +1.4 5.24 ± 10% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.00 +2.2 2.20 ± 21% perf-profile.self.cycles-pp.mem_cgroup_css_rstat_flush *************************************************************************************************** lkp-ivb-2ep1: 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory ========================================================================================= compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-8.3/process/50%/debian-10.4-x86_64-20200603.cgz/lkp-ivb-2ep1/page_fault2/will-it-scale/0x42e commit: 3c28c7680e ("memcg: switch lruvec stats to rstat") 45208c9105 ("memcg: infrastructure to flush memcg stats") 3c28c7680e1c39b9 45208c9105bd96015b98cdf31fb ---------------- --------------------------- %stddev %change %stddev \ | \ 5022212 -6.4% 4701021 will-it-scale.24.processes 49.04 -4.3% 46.93 will-it-scale.24.processes_idle 209258 -6.4% 195875 will-it-scale.per_process_ops 5022212 -6.4% 4701021 will-it-scale.workload 14913009 +21.8% 18167762 cpuidle..usage 0.09 ± 4% -0.0 0.08 ± 6% mpstat.cpu.all.soft% 1428 +1830.4% 27581 ± 2% vmstat.system.cs 39.38 +2.9% 40.51 boot-time.boot 16.68 +3.3% 17.23 boot-time.dhcp 1632 +2.6% 1675 boot-time.idle 75613 ± 3% +88.9% 142839 meminfo.Active 75613 ± 3% +88.9% 142839 meminfo.Active(anon) 37828 +11.0% 42007 meminfo.Mapped 17475 ± 9% +101.4% 35193 numa-vmstat.node1.nr_active_anon 391.67 ± 4% +192.1% 1144 ± 9% numa-vmstat.node1.nr_mapped 17475 ± 9% +101.4% 35193 numa-vmstat.node1.nr_zone_active_anon 93865 ± 6% +3971.5% 3821722 ± 5% turbostat.C1 0.02 ± 28% +1.5 1.52 ± 3% turbostat.C1% 11872222 ± 28% -29.1% 8418210 ± 31% turbostat.C6 91914 ± 47% +81.1% 166435 ± 9% numa-meminfo.node0.AnonHugePages 69904 ± 9% +101.4% 140786 numa-meminfo.node1.Active 69904 ± 9% +101.4% 140786 numa-meminfo.node1.Active(anon) 82883 ± 52% -90.2% 8160 ±206% numa-meminfo.node1.AnonHugePages 1562 ± 4% +192.9% 4575 ± 9% numa-meminfo.node1.Mapped 18903 ± 3% +88.9% 35709 proc-vmstat.nr_active_anon 1437395 +1.3% 1456557 proc-vmstat.nr_file_pages 9456 +11.1% 10501 proc-vmstat.nr_mapped 796324 +2.4% 815534 proc-vmstat.nr_shmem 18903 ± 3% +88.9% 35709 proc-vmstat.nr_zone_active_anon 5074 ± 2% -41.5% 2968 ± 20% proc-vmstat.numa_hint_faults 1.521e+09 -6.4% 1.424e+09 proc-vmstat.numa_hit 1.527e+09 -6.5% 1.428e+09 proc-vmstat.numa_local 27403 ± 2% +91.8% 52558 proc-vmstat.pgactivate 1.519e+09 -6.4% 1.421e+09 proc-vmstat.pgalloc_normal 1.514e+09 -6.4% 1.417e+09 proc-vmstat.pgfault 1.519e+09 -6.4% 1.421e+09 proc-vmstat.pgfree 12599 ± 4% -27.9% 9079 ± 4% softirqs.CPU0.RCU 12490 ± 10% -34.7% 8150 ± 14% softirqs.CPU1.RCU 10055 ± 18% -31.3% 6907 ± 15% softirqs.CPU10.RCU 9178 ± 11% -24.1% 6966 ± 17% softirqs.CPU11.RCU 9027 ± 8% -38.4% 5558 ± 5% softirqs.CPU16.RCU 9393 ± 6% -40.7% 5568 ± 3% softirqs.CPU17.RCU 9337 ± 7% -39.8% 5621 ± 2% softirqs.CPU18.RCU 10797 ± 15% -33.2% 7213 ± 9% softirqs.CPU2.RCU 8835 ± 8% -38.7% 5414 ± 3% softirqs.CPU23.RCU 9496 ± 15% -34.3% 6238 ± 8% softirqs.CPU25.RCU 10199 ± 11% -31.3% 7005 ± 14% softirqs.CPU27.RCU 9196 ± 10% -28.1% 6615 ± 3% softirqs.CPU28.RCU 9372 ± 8% -21.1% 7392 ± 8% softirqs.CPU29.RCU 10367 ± 5% -28.8% 7383 ± 6% softirqs.CPU3.RCU 9716 ± 7% -26.7% 7118 ± 11% softirqs.CPU30.RCU 9264 ± 9% -26.7% 6791 ± 6% softirqs.CPU31.RCU 9461 ± 4% -40.1% 5667 ± 6% softirqs.CPU36.RCU 9581 ± 4% -39.7% 5776 ± 3% softirqs.CPU37.RCU 9639 ± 4% -38.4% 5936 ± 4% softirqs.CPU38.RCU 9476 ± 6% -37.6% 5909 ± 4% softirqs.CPU39.RCU 8905 ± 14% -35.2% 5769 ± 4% softirqs.CPU40.RCU 9316 ± 5% -38.2% 5755 ± 4% softirqs.CPU41.RCU 9538 ± 7% -40.7% 5654 ± 5% softirqs.CPU43.RCU 9040 ± 9% -38.0% 5602 ± 4% softirqs.CPU44.RCU 9497 ± 5% -39.5% 5744 ± 2% softirqs.CPU45.RCU 9791 ± 5% -39.6% 5913 ± 3% softirqs.CPU47.RCU 10535 ± 13% -28.2% 7567 ± 17% softirqs.CPU5.RCU 9718 ± 16% -29.8% 6823 ± 9% softirqs.CPU6.RCU 9877 ± 6% -28.8% 7031 ± 16% softirqs.CPU7.RCU 9856 ± 10% -32.7% 6635 ± 6% softirqs.CPU8.RCU 9757 ± 5% -29.5% 6878 ± 8% softirqs.CPU9.RCU 455819 ± 4% -32.9% 305892 softirqs.RCU 44534 ± 2% +13.7% 50650 softirqs.TIMER 0.04 ± 6% -40.7% 0.02 ± 4% perf-sched.sch_delay.avg.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown] 0.04 ± 5% -41.1% 0.02 ± 10% perf-sched.sch_delay.avg.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64 0.02 ± 8% -16.5% 0.02 ± 8% perf-sched.sch_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 0.02 ± 18% -72.9% 0.01 ± 38% perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.03 ± 7% -43.3% 0.01 ± 11% perf-sched.sch_delay.avg.ms.rcu_gp_kthread.kthread.ret_from_fork 0.01 ± 24% -66.0% 0.00 ± 17% perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 0.03 ± 5% -36.4% 0.02 ± 5% perf-sched.sch_delay.avg.ms.schedule_timeout.kcompactd.kthread.ret_from_fork 0.03 ± 3% -42.7% 0.02 ± 11% perf-sched.sch_delay.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 0.16 ± 25% -94.5% 0.01 perf-sched.sch_delay.avg.ms.worker_thread.kthread.ret_from_fork 0.05 ± 7% -34.1% 0.04 ± 18% perf-sched.sch_delay.max.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown] 0.06 ± 15% -27.3% 0.04 ± 12% perf-sched.sch_delay.max.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64 0.07 ± 26% -36.7% 0.04 ± 25% perf-sched.sch_delay.max.ms.do_syslog.part.0.kmsg_read.vfs_read 0.05 ± 9% -36.7% 0.03 ± 20% perf-sched.sch_delay.max.ms.rcu_gp_kthread.kthread.ret_from_fork 0.05 ± 9% -23.2% 0.04 ± 17% perf-sched.sch_delay.max.ms.schedule_timeout.kcompactd.kthread.ret_from_fork 0.03 ± 11% -72.1% 0.01 ± 4% perf-sched.total_sch_delay.average.ms 173.07 ± 4% -94.8% 8.94 ± 2% perf-sched.total_wait_and_delay.average.ms 7046 ± 4% +1891.3% 140324 ± 2% perf-sched.total_wait_and_delay.count.ms 173.03 ± 4% -94.8% 8.93 ± 2% perf-sched.total_wait_time.average.ms 1.69 ± 4% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 0.06 ± 16% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown] 31.46 ±223% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.06 ± 7% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.shmem_getpage_gfp.shmem_fault 0.07 ± 12% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.zap_pte_range.unmap_page_range.unmap_vmas 397.65 ± 13% -36.2% 253.86 ± 4% perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 5.98 ± 8% -18.7% 4.86 ± 6% perf-sched.wait_and_delay.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 0.02 ± 22% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra 615.28 -99.5% 3.38 ± 2% perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork 244.67 -100.0% 0.00 perf-sched.wait_and_delay.count.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 304.83 ± 7% -100.0% 0.00 perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown] 38.83 ± 9% -100.0% 0.00 perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 142.17 ± 7% -100.0% 0.00 perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.pagecache_get_page.shmem_getpage_gfp.shmem_fault 74.50 ± 8% -100.0% 0.00 perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.zap_pte_range.unmap_page_range.unmap_vmas 77.17 ± 7% +77.5% 137.00 ± 3% perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 1660 ± 8% +23.7% 2053 ± 6% perf-sched.wait_and_delay.count.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 71.83 -100.0% 0.00 perf-sched.wait_and_delay.count.wait_for_partner.fifo_open.do_dentry_open.do_open.isra 704.00 +18807.4% 133108 ± 2% perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork 32.94 ± 40% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 0.82 ±120% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown] 1099 ±223% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.62 ± 66% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.shmem_getpage_gfp.shmem_fault 0.39 ± 38% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.zap_pte_range.unmap_page_range.unmap_vmas 417.46 ± 10% -45.6% 226.95 ± 36% perf-sched.wait_and_delay.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 0.35 ± 76% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra 0.03 ±188% +599.4% 0.21 ± 73% perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_call_function_single.[unknown] 0.00 ±223% +6.1e+05% 11.21 ±222% perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe 24.34 ±223% +656.2% 184.03 ± 88% perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.process_one_work.worker_thread.kthread 2.63 ± 7% -49.3% 1.34 ± 25% perf-sched.wait_time.avg.ms.rcu_gp_kthread.kthread.ret_from_fork 397.65 ± 13% -36.2% 253.86 ± 4% perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 5.95 ± 8% -18.6% 4.85 ± 6% perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 615.11 -99.5% 3.37 ± 2% perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork 0.08 ±204% +1983.0% 1.57 ± 67% perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_call_function_single.[unknown] 0.01 ±223% +3.1e+06% 167.26 ±222% perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe 24.34 ±223% +11427.3% 2805 ± 99% perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.process_one_work.worker_thread.kthread 417.44 ± 10% -45.6% 226.94 ± 36% perf-sched.wait_time.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 24.89 -2.2% 24.36 perf-stat.i.MPKI 4.891e+09 +9.3% 5.345e+09 perf-stat.i.branch-instructions 17202487 +33.3% 22935882 perf-stat.i.branch-misses 66.86 -4.4 62.43 perf-stat.i.cache-miss-rate% 4.162e+08 -3.2% 4.029e+08 perf-stat.i.cache-misses 6.21e+08 +3.8% 6.443e+08 perf-stat.i.cache-references 1381 +1906.4% 27718 ± 2% perf-stat.i.context-switches 2.90 -1.8% 2.85 perf-stat.i.cpi 7.227e+10 +4.0% 7.518e+10 perf-stat.i.cpu-cycles 174.81 +7.4% 187.68 perf-stat.i.cycles-between-cache-misses 8.369e+09 +3.0% 8.623e+09 perf-stat.i.dTLB-loads 36902358 -6.3% 34593711 perf-stat.i.dTLB-store-misses 5.358e+09 -4.2% 5.132e+09 perf-stat.i.dTLB-stores 96.35 -1.0 95.34 perf-stat.i.iTLB-load-miss-rate% 5776230 -3.3% 5585855 perf-stat.i.iTLB-load-misses 217681 +24.8% 271664 perf-stat.i.iTLB-loads 2.514e+10 +5.5% 2.651e+10 perf-stat.i.instructions 4344 +9.2% 4744 perf-stat.i.instructions-per-iTLB-miss 0.35 +1.5% 0.35 perf-stat.i.ipc 1.51 +4.0% 1.57 perf-stat.i.metric.GHz 1327 +12.0% 1486 perf-stat.i.metric.K/sec 412.80 +2.4% 422.86 perf-stat.i.metric.M/sec 4991686 -6.3% 4674888 perf-stat.i.minor-faults 4.29 ± 4% +1.8 6.10 ± 3% perf-stat.i.node-load-miss-rate% 11608578 +43.0% 16601356 perf-stat.i.node-load-misses 2.726e+08 -3.3% 2.635e+08 perf-stat.i.node-loads 1.64 ± 6% +1.9 3.54 ± 3% perf-stat.i.node-store-miss-rate% 4725769 +119.0% 10351554 perf-stat.i.node-store-misses 3.059e+08 -4.7% 2.916e+08 perf-stat.i.node-stores 4991695 -6.3% 4674897 perf-stat.i.page-faults 24.70 -1.6% 24.30 perf-stat.overall.MPKI 0.35 +0.1 0.43 perf-stat.overall.branch-miss-rate% 67.02 -4.5 62.52 perf-stat.overall.cache-miss-rate% 2.87 -1.4% 2.84 perf-stat.overall.cpi 173.65 +7.5% 186.63 perf-stat.overall.cycles-between-cache-misses 96.37 -1.0 95.36 perf-stat.overall.iTLB-load-miss-rate% 4352 +9.1% 4747 perf-stat.overall.instructions-per-iTLB-miss 0.35 +1.4% 0.35 perf-stat.overall.ipc 4.09 +1.8 5.93 ± 2% perf-stat.overall.node-load-miss-rate% 1.52 +1.9 3.43 ± 2% perf-stat.overall.node-store-miss-rate% 1518332 +12.6% 1709474 perf-stat.overall.path-length 4.874e+09 +9.3% 5.328e+09 perf-stat.ps.branch-instructions 17158593 +33.5% 22902070 perf-stat.ps.branch-misses 4.148e+08 -3.2% 4.015e+08 perf-stat.ps.cache-misses 6.189e+08 +3.8% 6.422e+08 perf-stat.ps.cache-references 1376 +1907.0% 27627 ± 2% perf-stat.ps.context-switches 7.203e+10 +4.0% 7.494e+10 perf-stat.ps.cpu-cycles 8.341e+09 +3.0% 8.595e+09 perf-stat.ps.dTLB-loads 36778785 -6.3% 34480016 perf-stat.ps.dTLB-store-misses 5.34e+09 -4.2% 5.115e+09 perf-stat.ps.dTLB-stores 5757055 -3.3% 5567467 perf-stat.ps.iTLB-load-misses 216945 +24.8% 270761 perf-stat.ps.iTLB-loads 2.506e+10 +5.5% 2.643e+10 perf-stat.ps.instructions 4975218 -6.3% 4659572 perf-stat.ps.minor-faults 11571489 +43.0% 16547464 perf-stat.ps.node-load-misses 2.717e+08 -3.3% 2.626e+08 perf-stat.ps.node-loads 4710117 +119.0% 10316937 perf-stat.ps.node-store-misses 3.049e+08 -4.7% 2.907e+08 perf-stat.ps.node-stores 4975226 -6.3% 4659581 perf-stat.ps.page-faults 7.625e+12 +5.4% 8.036e+12 perf-stat.total.instructions 188.00 ± 9% +145.1% 460.83 ± 60% interrupts.40:PCI-MSI.2621446-edge.eth0-TxRx-5 50741 +28.9% 65395 interrupts.CAL:Function_call_interrupts 724.83 ± 14% +123.7% 1621 ± 28% interrupts.CPU0.CAL:Function_call_interrupts 105.17 ± 15% +557.4% 691.33 ± 51% interrupts.CPU0.RES:Rescheduling_interrupts 206.67 ± 22% +195.1% 609.83 ± 33% interrupts.CPU1.RES:Rescheduling_interrupts 982.83 ± 5% +53.1% 1504 ± 31% interrupts.CPU10.CAL:Function_call_interrupts 6323 ± 11% -35.7% 4068 ± 16% interrupts.CPU10.NMI:Non-maskable_interrupts 6323 ± 11% -35.7% 4068 ± 16% interrupts.CPU10.PMI:Performance_monitoring_interrupts 170.00 ± 18% +213.4% 532.83 ± 47% interrupts.CPU11.RES:Rescheduling_interrupts 184.00 ± 7% +122.7% 409.83 ± 28% interrupts.CPU12.RES:Rescheduling_interrupts 185.00 ± 12% +143.5% 450.50 ± 38% interrupts.CPU13.RES:Rescheduling_interrupts 172.33 ± 11% +123.4% 385.00 ± 37% interrupts.CPU14.RES:Rescheduling_interrupts 1086 ± 5% +47.7% 1604 ± 14% interrupts.CPU15.CAL:Function_call_interrupts 187.50 ± 11% +305.9% 761.00 ± 28% interrupts.CPU15.RES:Rescheduling_interrupts 162.33 ± 8% +175.2% 446.67 ± 64% interrupts.CPU16.RES:Rescheduling_interrupts 171.17 ± 11% +131.7% 396.67 ± 29% interrupts.CPU17.RES:Rescheduling_interrupts 993.50 ± 7% +42.8% 1418 ± 8% interrupts.CPU18.CAL:Function_call_interrupts 174.67 ± 21% +170.6% 472.67 ± 39% interrupts.CPU18.RES:Rescheduling_interrupts 164.50 ± 18% +105.3% 337.67 ± 28% interrupts.CPU19.RES:Rescheduling_interrupts 1018 ± 6% +58.9% 1618 ± 26% interrupts.CPU2.CAL:Function_call_interrupts 216.67 ± 20% +171.7% 588.67 ± 36% interrupts.CPU2.RES:Rescheduling_interrupts 992.33 ± 6% +27.1% 1261 ± 14% interrupts.CPU20.CAL:Function_call_interrupts 1046 ± 12% +26.6% 1324 ± 10% interrupts.CPU21.CAL:Function_call_interrupts 180.17 ± 8% +126.6% 408.33 ± 43% interrupts.CPU21.RES:Rescheduling_interrupts 1014 ± 5% +80.3% 1828 ± 54% interrupts.CPU22.CAL:Function_call_interrupts 175.00 ± 17% +450.8% 963.83 ±120% interrupts.CPU22.RES:Rescheduling_interrupts 941.83 +25.7% 1183 ± 9% interrupts.CPU24.CAL:Function_call_interrupts 260.50 ± 5% +62.5% 423.33 ± 14% interrupts.CPU24.RES:Rescheduling_interrupts 204.83 ± 15% +138.5% 488.50 ± 39% interrupts.CPU25.RES:Rescheduling_interrupts 170.00 ± 28% +75.9% 299.00 ± 23% interrupts.CPU26.RES:Rescheduling_interrupts 199.17 ± 14% +91.3% 381.00 ± 31% interrupts.CPU27.RES:Rescheduling_interrupts 991.83 ± 8% +70.6% 1692 ± 31% interrupts.CPU28.CAL:Function_call_interrupts 158.50 ± 34% +431.0% 841.67 ± 66% interrupts.CPU28.RES:Rescheduling_interrupts 154.33 ± 34% +226.9% 504.50 ± 42% interrupts.CPU29.RES:Rescheduling_interrupts 172.83 ± 20% +159.3% 448.17 ± 33% interrupts.CPU3.RES:Rescheduling_interrupts 173.50 ± 27% +280.0% 659.33 ± 54% interrupts.CPU30.RES:Rescheduling_interrupts 188.00 ± 9% +145.1% 460.83 ± 60% interrupts.CPU31.40:PCI-MSI.2621446-edge.eth0-TxRx-5 162.50 ± 33% +298.4% 647.33 ± 44% interrupts.CPU31.RES:Rescheduling_interrupts 989.33 ± 6% +29.4% 1279 ± 16% interrupts.CPU32.CAL:Function_call_interrupts 169.67 ± 12% +192.4% 496.17 ± 47% interrupts.CPU32.RES:Rescheduling_interrupts 182.33 ± 20% +243.1% 625.67 ± 24% interrupts.CPU33.RES:Rescheduling_interrupts 189.83 ± 10% +105.8% 390.67 ± 29% interrupts.CPU34.RES:Rescheduling_interrupts 992.00 ± 6% +43.2% 1420 ± 36% interrupts.CPU35.CAL:Function_call_interrupts 5183 ± 32% +50.9% 7819 ± 6% interrupts.CPU35.NMI:Non-maskable_interrupts 5183 ± 32% +50.9% 7819 ± 6% interrupts.CPU35.PMI:Performance_monitoring_interrupts 195.50 ± 17% +133.9% 457.33 ± 30% interrupts.CPU35.RES:Rescheduling_interrupts 174.67 ± 8% +121.3% 386.50 ± 46% interrupts.CPU36.RES:Rescheduling_interrupts 184.17 ± 12% +177.9% 511.83 ± 42% interrupts.CPU37.RES:Rescheduling_interrupts 198.67 ± 11% +171.0% 538.33 ± 49% interrupts.CPU38.RES:Rescheduling_interrupts 173.50 ± 14% +148.2% 430.67 ± 30% interrupts.CPU39.RES:Rescheduling_interrupts 213.00 ± 20% +101.6% 429.50 ± 31% interrupts.CPU4.RES:Rescheduling_interrupts 961.50 +31.0% 1259 ± 15% interrupts.CPU41.CAL:Function_call_interrupts 177.33 ± 20% +145.3% 435.00 ± 40% interrupts.CPU42.RES:Rescheduling_interrupts 971.33 +43.4% 1392 ± 18% interrupts.CPU44.CAL:Function_call_interrupts 186.00 ± 12% +124.8% 418.17 ± 34% interrupts.CPU44.RES:Rescheduling_interrupts 1007 ± 4% +13.9% 1147 ± 12% interrupts.CPU45.CAL:Function_call_interrupts 1051 ± 11% +22.6% 1288 ± 12% interrupts.CPU46.CAL:Function_call_interrupts 166.50 ± 14% +159.5% 432.00 ± 27% interrupts.CPU46.RES:Rescheduling_interrupts 941.83 ± 8% +36.2% 1283 ± 11% interrupts.CPU47.CAL:Function_call_interrupts 219.00 ± 5% +124.0% 490.67 ± 25% interrupts.CPU47.RES:Rescheduling_interrupts 990.83 ± 4% +43.8% 1424 ± 22% interrupts.CPU5.CAL:Function_call_interrupts 223.50 ± 17% +170.2% 604.00 ± 54% interrupts.CPU5.RES:Rescheduling_interrupts 989.33 ± 19% +42.0% 1405 ± 16% interrupts.CPU6.CAL:Function_call_interrupts 204.50 ± 19% +166.3% 544.67 ± 41% interrupts.CPU6.RES:Rescheduling_interrupts 205.67 ± 25% +101.6% 414.67 ± 13% interrupts.CPU7.RES:Rescheduling_interrupts 196.33 ± 9% +142.6% 476.33 ± 39% interrupts.CPU8.RES:Rescheduling_interrupts 8829 +168.2% 23681 ± 8% interrupts.RES:Rescheduling_interrupts 330.83 ± 11% +132.7% 770.00 ± 8% interrupts.TLB:TLB_shootdowns 10.83 ± 10% -2.1 8.69 ± 13% perf-profile.calltrace.cycles-pp.alloc_pages_vma.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 10.31 ± 10% -2.1 8.18 ± 13% perf-profile.calltrace.cycles-pp.__alloc_pages.alloc_pages_vma.do_fault.__handle_mm_fault.handle_mm_fault 10.04 ± 10% -2.1 7.92 ± 13% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages.alloc_pages_vma.do_fault.__handle_mm_fault 9.79 ± 10% -2.1 7.68 ± 13% perf-profile.calltrace.cycles-pp.rmqueue.get_page_from_freelist.__alloc_pages.alloc_pages_vma.do_fault 9.07 ± 10% -2.1 6.98 ± 13% perf-profile.calltrace.cycles-pp.rmqueue_bulk.rmqueue.get_page_from_freelist.__alloc_pages.alloc_pages_vma 2.46 ± 35% -1.8 0.68 ± 71% perf-profile.calltrace.cycles-pp._raw_spin_lock.free_pcppages_bulk.free_unref_page_list.release_pages.tlb_flush_mmu 2.45 ± 35% -1.8 0.68 ± 71% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.free_pcppages_bulk.free_unref_page_list.release_pages 4.22 ± 18% -1.7 2.56 ± 13% perf-profile.calltrace.cycles-pp.free_pcppages_bulk.free_unref_page_list.release_pages.tlb_flush_mmu.zap_pte_range 4.56 ± 18% -1.6 2.91 ± 13% perf-profile.calltrace.cycles-pp.free_unref_page_list.release_pages.tlb_flush_mmu.zap_pte_range.unmap_page_range 6.60 ± 13% -1.4 5.14 ± 15% perf-profile.calltrace.cycles-pp._raw_spin_lock.rmqueue_bulk.rmqueue.get_page_from_freelist.__alloc_pages 6.58 ± 13% -1.4 5.14 ± 15% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.rmqueue_bulk.rmqueue.get_page_from_freelist 2.30 ± 13% -0.6 1.66 ± 16% perf-profile.calltrace.cycles-pp.__list_del_entry_valid.rmqueue_bulk.rmqueue.get_page_from_freelist.__alloc_pages 0.71 ± 15% +0.6 1.28 ± 14% perf-profile.calltrace.cycles-pp.charge_memcg.__mem_cgroup_charge.do_fault.__handle_mm_fault.handle_mm_fault 0.90 ± 15% +0.7 1.62 ± 14% perf-profile.calltrace.cycles-pp.__mem_cgroup_charge.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 0.00 +0.8 0.84 ± 14% perf-profile.calltrace.cycles-pp.__mod_lruvec_page_state.page_remove_rmap.zap_pte_range.unmap_page_range.unmap_vmas 0.00 +0.9 0.94 ± 13% perf-profile.calltrace.cycles-pp.cgroup_rstat_updated.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 +1.1 1.08 ± 13% perf-profile.calltrace.cycles-pp.page_remove_rmap.zap_pte_range.unmap_page_range.unmap_vmas.unmap_region 0.00 +1.3 1.33 ± 11% perf-profile.calltrace.cycles-pp.cgroup_rstat_updated.__mod_memcg_lruvec_state.__mod_lruvec_page_state.page_add_new_anon_rmap.do_set_pte 0.00 +1.4 1.44 ± 21% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.release_pages.tlb_flush_mmu 0.00 +1.5 1.46 ± 20% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.release_pages.tlb_flush_mmu.zap_pte_range 0.00 +1.5 1.47 ± 20% perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.release_pages.tlb_flush_mmu.zap_pte_range.unmap_page_range 0.50 ± 46% +1.5 1.98 ± 14% perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.do_set_pte.finish_fault 0.49 ± 46% +1.5 1.97 ± 14% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.do_set_pte 0.28 ±101% +1.6 1.92 ± 14% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add 0.00 +1.7 1.68 ± 11% perf-profile.calltrace.cycles-pp.__mod_memcg_lruvec_state.__mod_lruvec_page_state.page_add_new_anon_rmap.do_set_pte.finish_fault 1.83 ± 11% +2.1 3.90 ± 12% perf-profile.calltrace.cycles-pp.__pagevec_lru_add.lru_cache_add.do_set_pte.finish_fault.do_fault 0.12 ±223% +2.1 2.22 ± 11% perf-profile.calltrace.cycles-pp.__mod_lruvec_page_state.page_add_new_anon_rmap.do_set_pte.finish_fault.do_fault 0.12 ±223% +2.1 2.27 ± 11% perf-profile.calltrace.cycles-pp.page_add_new_anon_rmap.do_set_pte.finish_fault.do_fault.__handle_mm_fault 0.00 +2.2 2.17 ± 13% perf-profile.calltrace.cycles-pp.mem_cgroup_css_rstat_flush.cgroup_rstat_flush_locked.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work 1.99 ± 10% +2.2 4.18 ± 12% perf-profile.calltrace.cycles-pp.lru_cache_add.do_set_pte.finish_fault.do_fault.__handle_mm_fault 0.00 +3.0 3.02 ± 14% perf-profile.calltrace.cycles-pp.cgroup_rstat_flush_locked.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work.worker_thread 0.00 +3.0 3.03 ± 14% perf-profile.calltrace.cycles-pp.cgroup_rstat_flush_irqsafe.mem_cgroup_flush_stats.process_one_work.worker_thread.kthread 0.00 +3.1 3.06 ± 14% perf-profile.calltrace.cycles-pp.mem_cgroup_flush_stats.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +3.1 3.14 ± 14% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +3.4 3.38 ± 13% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork 0.00 +3.4 3.40 ± 14% perf-profile.calltrace.cycles-pp.ret_from_fork 0.00 +3.4 3.40 ± 14% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 5.95 ± 11% +3.5 9.49 ± 11% perf-profile.calltrace.cycles-pp.finish_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 2.57 ± 14% +4.0 6.58 ± 12% perf-profile.calltrace.cycles-pp.do_set_pte.finish_fault.do_fault.__handle_mm_fault.handle_mm_fault 12.59 ± 10% -3.5 9.11 ± 12% perf-profile.children.cycles-pp._raw_spin_lock 10.86 ± 10% -2.1 8.73 ± 13% perf-profile.children.cycles-pp.alloc_pages_vma 10.12 ± 10% -2.1 8.00 ± 13% perf-profile.children.cycles-pp.get_page_from_freelist 10.40 ± 10% -2.1 8.29 ± 13% perf-profile.children.cycles-pp.__alloc_pages 9.84 ± 10% -2.1 7.73 ± 13% perf-profile.children.cycles-pp.rmqueue 9.09 ± 10% -2.1 7.00 ± 13% perf-profile.children.cycles-pp.rmqueue_bulk 4.69 ± 19% -1.8 2.85 ± 13% perf-profile.children.cycles-pp.free_pcppages_bulk 5.08 ± 18% -1.8 3.25 ± 13% perf-profile.children.cycles-pp.free_unref_page_list 0.02 ±142% +0.0 0.07 ± 18% perf-profile.children.cycles-pp.__get_user_nocheck_8 0.00 +0.1 0.06 ± 8% perf-profile.children.cycles-pp.orc_find 0.02 ±141% +0.1 0.08 ± 30% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.00 +0.1 0.06 ± 14% perf-profile.children.cycles-pp.memcpy_erms 0.08 ± 20% +0.1 0.15 ± 15% perf-profile.children.cycles-pp.mem_cgroup_update_lru_size 0.01 ±223% +0.1 0.09 ± 14% perf-profile.children.cycles-pp.__orc_find 0.00 +0.1 0.08 ± 17% perf-profile.children.cycles-pp.perf_output_copy 0.06 +0.1 0.15 ± 15% perf-profile.children.cycles-pp.__unwind_start 0.02 ±141% +0.1 0.12 ± 9% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.33 ± 11% +0.1 0.43 ± 11% perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime 0.00 +0.1 0.10 ± 17% perf-profile.children.cycles-pp.dequeue_entity 0.00 +0.1 0.11 ± 13% perf-profile.children.cycles-pp.dequeue_task_fair 0.35 ± 11% +0.1 0.46 ± 11% perf-profile.children.cycles-pp.update_curr 0.13 ± 21% +0.1 0.26 ± 19% perf-profile.children.cycles-pp.get_mem_cgroup_from_mm 0.00 +0.1 0.13 ± 14% perf-profile.children.cycles-pp.perf_output_sample 0.00 +0.1 0.13 ± 17% perf-profile.children.cycles-pp._find_next_bit 0.12 ± 8% +0.1 0.26 ± 12% perf-profile.children.cycles-pp.unwind_next_frame 0.00 +0.1 0.14 ± 14% perf-profile.children.cycles-pp.schedule_idle 0.00 +0.2 0.15 ± 16% perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template 0.00 +0.2 0.16 ± 19% perf-profile.children.cycles-pp.perf_trace_sched_switch 0.17 ± 9% +0.2 0.34 ± 12% perf-profile.children.cycles-pp.perf_callchain_kernel 0.11 ± 33% +0.2 0.28 ± 15% perf-profile.children.cycles-pp.__count_memcg_events 0.00 +0.2 0.19 ± 14% perf-profile.children.cycles-pp.try_to_wake_up 0.00 +0.2 0.20 ± 15% perf-profile.children.cycles-pp.__queue_work 0.22 ± 12% +0.2 0.43 ± 13% perf-profile.children.cycles-pp.get_perf_callchain 0.23 ± 11% +0.2 0.44 ± 13% perf-profile.children.cycles-pp.perf_callchain 0.00 +0.2 0.23 ± 17% perf-profile.children.cycles-pp.schedule 0.26 ± 11% +0.2 0.50 ± 13% perf-profile.children.cycles-pp.perf_prepare_sample 0.17 ± 30% +0.3 0.44 ± 15% perf-profile.children.cycles-pp.__mod_memcg_state 0.31 ± 10% +0.4 0.66 ± 12% perf-profile.children.cycles-pp.perf_event_output_forward 0.31 ± 9% +0.4 0.67 ± 12% perf-profile.children.cycles-pp.perf_swevent_overflow 0.31 ± 9% +0.4 0.66 ± 12% perf-profile.children.cycles-pp.__perf_event_overflow 0.00 +0.4 0.37 ± 14% perf-profile.children.cycles-pp.__schedule 0.32 ± 10% +0.4 0.71 ± 13% perf-profile.children.cycles-pp.perf_tp_event 0.00 +0.4 0.42 ± 13% perf-profile.children.cycles-pp.queue_work_on 0.72 ± 15% +0.6 1.29 ± 14% perf-profile.children.cycles-pp.charge_memcg 0.04 ± 71% +0.6 0.62 ± 16% perf-profile.children.cycles-pp.mem_cgroup_charge_statistics 0.41 ± 13% +0.7 1.08 ± 13% perf-profile.children.cycles-pp.page_remove_rmap 0.90 ± 15% +0.7 1.63 ± 14% perf-profile.children.cycles-pp.__mem_cgroup_charge 0.46 ± 31% +1.8 2.27 ± 11% perf-profile.children.cycles-pp.page_add_new_anon_rmap 1.84 ± 10% +2.1 3.92 ± 12% perf-profile.children.cycles-pp.__pagevec_lru_add 0.00 +2.2 2.18 ± 13% perf-profile.children.cycles-pp.mem_cgroup_css_rstat_flush 1.99 ± 10% +2.2 4.19 ± 12% perf-profile.children.cycles-pp.lru_cache_add 0.62 ± 27% +2.5 3.09 ± 12% perf-profile.children.cycles-pp.__mod_lruvec_page_state 0.38 ± 20% +2.6 3.01 ± 11% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state 0.94 ± 12% +2.7 3.64 ± 10% perf-profile.children.cycles-pp.lock_page_lruvec_irqsave 0.00 +3.0 3.03 ± 14% perf-profile.children.cycles-pp.cgroup_rstat_flush_irqsafe 0.00 +3.0 3.03 ± 14% perf-profile.children.cycles-pp.cgroup_rstat_flush_locked 0.00 +3.1 3.06 ± 14% perf-profile.children.cycles-pp.mem_cgroup_flush_stats 0.04 ± 73% +3.1 3.14 ± 14% perf-profile.children.cycles-pp.process_one_work 0.04 ± 74% +3.3 3.38 ± 13% perf-profile.children.cycles-pp.worker_thread 0.06 ± 53% +3.3 3.40 ± 14% perf-profile.children.cycles-pp.ret_from_fork 0.06 ± 52% +3.3 3.40 ± 14% perf-profile.children.cycles-pp.kthread 5.96 ± 11% +3.5 9.49 ± 11% perf-profile.children.cycles-pp.finish_fault 0.14 ± 9% +3.6 3.74 ± 12% perf-profile.children.cycles-pp.cgroup_rstat_updated 0.92 ± 11% +3.9 4.82 ± 9% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 2.58 ± 14% +4.0 6.59 ± 12% perf-profile.children.cycles-pp.do_set_pte 0.00 +0.1 0.06 ± 9% perf-profile.self.cycles-pp.orc_find 0.02 ±141% +0.1 0.07 ± 18% perf-profile.self.cycles-pp.__mem_cgroup_charge 0.01 ±223% +0.1 0.07 ± 32% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 0.00 +0.1 0.06 ± 14% perf-profile.self.cycles-pp.memcpy_erms 0.08 ± 17% +0.1 0.15 ± 14% perf-profile.self.cycles-pp.mem_cgroup_update_lru_size 0.01 ±223% +0.1 0.09 ± 14% perf-profile.self.cycles-pp.__orc_find 0.01 ±223% +0.1 0.09 ± 14% perf-profile.self.cycles-pp.unwind_next_frame 0.07 ± 10% +0.1 0.17 ± 14% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.16 ± 29% +0.1 0.28 ± 21% perf-profile.self.cycles-pp.shmem_getpage_gfp 0.12 ± 24% +0.1 0.24 ± 19% perf-profile.self.cycles-pp.get_mem_cgroup_from_mm 0.12 ± 11% +0.1 0.24 ± 15% perf-profile.self.cycles-pp.lru_cache_add 0.00 +0.1 0.12 ± 20% perf-profile.self.cycles-pp._find_next_bit 0.12 ± 17% +0.2 0.28 ± 17% perf-profile.self.cycles-pp.__mod_memcg_lruvec_state 0.10 ± 34% +0.2 0.27 ± 15% perf-profile.self.cycles-pp.__count_memcg_events 0.66 ± 11% +0.2 0.83 ± 13% perf-profile.self.cycles-pp.__pagevec_lru_add 0.00 +0.2 0.21 ± 15% perf-profile.self.cycles-pp.queue_work_on 0.17 ± 44% +0.2 0.38 ± 12% perf-profile.self.cycles-pp.__mod_lruvec_page_state 0.16 ± 30% +0.3 0.43 ± 15% perf-profile.self.cycles-pp.__mod_memcg_state 0.00 +0.6 0.55 ± 17% perf-profile.self.cycles-pp.cgroup_rstat_flush_locked 0.00 +2.1 2.06 ± 13% perf-profile.self.cycles-pp.mem_cgroup_css_rstat_flush 0.14 ± 9% +2.4 2.54 ± 14% perf-profile.self.cycles-pp.cgroup_rstat_updated *************************************************************************************************** lkp-csl-2ap4: 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory ========================================================================================= cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/tbox_group/test/testcase/ucode: cs-localhost/gcc-9/performance/ipv4/x86_64-rhel-8.3/200%/debian-10.4-x86_64-20200603.cgz/900s/lkp-csl-2ap4/TCP_MAERTS/netperf/0x5003006 commit: 3c28c7680e ("memcg: switch lruvec stats to rstat") 45208c9105 ("memcg: infrastructure to flush memcg stats") 3c28c7680e1c39b9 45208c9105bd96015b98cdf31fb ---------------- --------------------------- %stddev %change %stddev \ | \ 2574 ± 24% +89.8% 4885 ± 11% netperf.Throughput_Mbps 988640 ± 24% +89.8% 1876064 ± 11% netperf.Throughput_total_Mbps 25981439 ± 10% -37.0% 16381040 ± 28% netperf.time.involuntary_context_switches 8753 ± 6% -20.3% 6979 ± 7% netperf.time.percent_of_cpu_this_job_got 78523 ± 6% -21.5% 61657 ± 8% netperf.time.system_time 1362 ± 15% +43.9% 1960 ± 8% netperf.time.user_time 2.858e+09 ± 44% +162.1% 7.492e+09 ± 16% netperf.time.voluntary_context_switches 6.788e+09 ± 24% +89.8% 1.288e+10 ± 11% netperf.workload 7064175 ± 14% -22.7% 5464112 ± 7% meminfo.Memused 6329937 ± 43% +159.8% 16447499 ± 16% vmstat.system.cs 3090 -4.2% 2961 turbostat.Bzy_MHz 329.05 +4.2% 342.72 turbostat.PkgWatt 1.74 ± 45% -0.8 0.89 ± 12% mpstat.cpu.all.irq% 9.90 ± 17% +5.8 15.68 ± 11% mpstat.cpu.all.soft% 1.75 ± 12% +0.7 2.40 ± 7% mpstat.cpu.all.usr% 9676 ± 11% -22.2% 7531 ± 10% numa-meminfo.node2.KernelStack 1172908 ± 14% -39.2% 713309 ± 34% numa-meminfo.node2.MemUsed 113939 ± 9% -19.0% 92278 ± 8% numa-meminfo.node2.SUnreclaim 137128 ± 16% -21.0% 108351 ± 14% numa-meminfo.node2.Slab 2.688e+09 ± 19% +70.4% 4.58e+09 ± 9% proc-vmstat.numa_hit 2.689e+09 ± 19% +70.5% 4.584e+09 ± 9% proc-vmstat.numa_local 2.687e+09 ± 19% +70.4% 4.577e+09 ± 9% proc-vmstat.pgalloc_normal 2.687e+09 ± 19% +70.4% 4.577e+09 ± 9% proc-vmstat.pgfree 40702 ± 6% -21.1% 32117 ± 8% slabinfo.kmalloc-1k.active_objs 1282 ± 6% -21.0% 1013 ± 8% slabinfo.kmalloc-1k.active_slabs 41061 ± 6% -21.0% 32443 ± 8% slabinfo.kmalloc-1k.num_objs 1282 ± 6% -21.0% 1013 ± 8% slabinfo.kmalloc-1k.num_slabs 6.707e+08 ± 18% +60.2% 1.075e+09 ± 18% numa-numastat.node1.local_node 6.702e+08 ± 18% +60.1% 1.073e+09 ± 18% numa-numastat.node1.numa_hit 6.588e+08 ± 22% +80.8% 1.191e+09 ± 19% numa-numastat.node2.local_node 6.584e+08 ± 22% +80.8% 1.19e+09 ± 19% numa-numastat.node2.numa_hit 6.088e+08 ± 18% +104.8% 1.247e+09 ± 24% numa-numastat.node3.local_node 6.085e+08 ± 18% +104.7% 1.246e+09 ± 24% numa-numastat.node3.numa_hit 3.151e+08 ± 10% +46.5% 4.615e+08 ± 15% numa-vmstat.node1.numa_hit 3.152e+08 ± 10% +46.5% 4.619e+08 ± 15% numa-vmstat.node1.numa_local 9675 ± 11% -22.2% 7531 ± 10% numa-vmstat.node2.nr_kernel_stack 28479 ± 9% -19.0% 23071 ± 8% numa-vmstat.node2.nr_slab_unreclaimable 3.059e+08 ± 15% +75.1% 5.356e+08 ± 19% numa-vmstat.node2.numa_hit 3.06e+08 ± 15% +75.2% 5.36e+08 ± 19% numa-vmstat.node2.numa_local 2.93e+08 ± 13% +100.4% 5.873e+08 ± 27% numa-vmstat.node3.numa_hit 2.931e+08 ± 13% +100.6% 5.88e+08 ± 27% numa-vmstat.node3.numa_local 900879 ± 16% +123.8% 2016377 ± 34% interrupts.CAL:Function_call_interrupts 4684 ± 81% +137.2% 11108 ± 52% interrupts.CPU111.CAL:Function_call_interrupts 8604 ± 88% +555.0% 56360 ±102% interrupts.CPU119.RES:Rescheduling_interrupts 7399 ±108% +442.6% 40147 ± 78% interrupts.CPU120.RES:Rescheduling_interrupts 4862 ± 59% +702.4% 39017 ± 81% interrupts.CPU121.RES:Rescheduling_interrupts 6346 ± 88% +414.4% 32643 ± 69% interrupts.CPU122.RES:Rescheduling_interrupts 5540 ± 88% +441.9% 30028 ± 96% interrupts.CPU125.RES:Rescheduling_interrupts 2600 ± 38% +1434.7% 39915 ± 89% interrupts.CPU127.RES:Rescheduling_interrupts 8383 ±121% +498.5% 50175 ± 70% interrupts.CPU128.RES:Rescheduling_interrupts 6096 ±144% +520.5% 37830 ± 45% interrupts.CPU129.RES:Rescheduling_interrupts 5734 ±116% +496.5% 34206 ± 59% interrupts.CPU132.RES:Rescheduling_interrupts 5656 ±129% +471.5% 32326 ±101% interrupts.CPU133.RES:Rescheduling_interrupts 3867 ± 43% +914.6% 39241 ± 82% interrupts.CPU134.RES:Rescheduling_interrupts 6416 ± 81% +384.1% 31059 ± 66% interrupts.CPU135.RES:Rescheduling_interrupts 3990 ± 81% +657.2% 30213 ± 96% interrupts.CPU137.RES:Rescheduling_interrupts 4405 ± 77% +444.2% 23977 ± 51% interrupts.CPU140.RES:Rescheduling_interrupts 4484 ± 86% +609.1% 31800 ± 83% interrupts.CPU141.RES:Rescheduling_interrupts 4224 ± 99% +727.7% 34966 ± 76% interrupts.CPU142.RES:Rescheduling_interrupts 3431 ± 18% +784.3% 30341 ± 81% interrupts.CPU145.RES:Rescheduling_interrupts 2352 ± 38% +1557.5% 38996 ± 84% interrupts.CPU148.RES:Rescheduling_interrupts 4951 ±116% +794.3% 44284 ± 95% interrupts.CPU154.RES:Rescheduling_interrupts 3475 ± 51% +885.8% 34261 ± 75% interrupts.CPU155.RES:Rescheduling_interrupts 5275 ± 96% +459.9% 29536 ± 74% interrupts.CPU156.RES:Rescheduling_interrupts 3023 ± 39% +1650.8% 52936 ± 82% interrupts.CPU158.RES:Rescheduling_interrupts 2403 ± 39% +1303.5% 33729 ± 68% interrupts.CPU159.RES:Rescheduling_interrupts 13265 ± 76% +282.4% 50733 ± 97% interrupts.CPU16.RES:Rescheduling_interrupts 2118 ± 41% +389.6% 10374 ± 73% interrupts.CPU160.CAL:Function_call_interrupts 6751 ± 90% +563.9% 44826 ± 89% interrupts.CPU160.RES:Rescheduling_interrupts 2847 ± 62% +305.0% 11532 ± 58% interrupts.CPU162.CAL:Function_call_interrupts 4415 ± 87% +600.5% 30928 ±114% interrupts.CPU163.RES:Rescheduling_interrupts 6583 ± 64% +503.9% 39757 ± 62% interrupts.CPU165.RES:Rescheduling_interrupts 1768 ± 46% +1899.3% 35354 ± 99% interrupts.CPU166.RES:Rescheduling_interrupts 5692 ± 52% +1069.4% 66566 ± 88% interrupts.CPU168.RES:Rescheduling_interrupts 7636 ±134% +921.2% 77987 ± 80% interrupts.CPU169.RES:Rescheduling_interrupts 5895 ± 54% +1040.2% 67222 ± 91% interrupts.CPU170.RES:Rescheduling_interrupts 2143 ± 65% +772.4% 18699 ± 84% interrupts.CPU172.CAL:Function_call_interrupts 2246 ± 22% +3782.4% 87211 ± 80% interrupts.CPU172.RES:Rescheduling_interrupts 2725 ± 49% +2580.0% 73044 ± 81% interrupts.CPU173.RES:Rescheduling_interrupts 6920 ± 57% +1043.3% 79122 ± 67% interrupts.CPU174.RES:Rescheduling_interrupts 2433 ± 59% +637.2% 17938 ±111% interrupts.CPU175.CAL:Function_call_interrupts 4825 ±124% +1761.5% 89827 ± 69% interrupts.CPU175.RES:Rescheduling_interrupts 2183 ± 42% +604.2% 15377 ± 95% interrupts.CPU176.CAL:Function_call_interrupts 2923 ± 91% +493.4% 17347 ±120% interrupts.CPU178.CAL:Function_call_interrupts 6260 ± 87% +1158.2% 78772 ± 99% interrupts.CPU178.RES:Rescheduling_interrupts 3955 ± 37% +1554.9% 65457 ± 93% interrupts.CPU179.RES:Rescheduling_interrupts 7484 ± 60% +766.8% 64871 ±101% interrupts.CPU180.RES:Rescheduling_interrupts 2718 ± 51% +2359.8% 66861 ±111% interrupts.CPU182.RES:Rescheduling_interrupts 8077 ±115% +692.1% 63984 ± 84% interrupts.CPU183.RES:Rescheduling_interrupts 5381 ± 93% +992.5% 58789 ± 83% interrupts.CPU184.RES:Rescheduling_interrupts 5614 ± 95% +1117.2% 68344 ± 85% interrupts.CPU185.RES:Rescheduling_interrupts 2586 ± 39% +367.0% 12080 ± 91% interrupts.CPU186.CAL:Function_call_interrupts 11775 ± 84% +423.6% 61655 ± 95% interrupts.CPU186.RES:Rescheduling_interrupts 5136 ± 60% +1331.7% 73530 ± 95% interrupts.CPU187.RES:Rescheduling_interrupts 12116 ±154% +702.9% 97280 ± 93% interrupts.CPU189.RES:Rescheduling_interrupts 3552 ± 35% +2136.0% 79433 ± 92% interrupts.CPU190.RES:Rescheduling_interrupts 5876 ± 60% +1271.1% 80565 ± 98% interrupts.CPU191.RES:Rescheduling_interrupts 9250 ±100% +531.2% 58394 ±110% interrupts.CPU23.RES:Rescheduling_interrupts 4766 ± 67% +501.7% 28678 ±124% interrupts.CPU27.RES:Rescheduling_interrupts 4668 ± 55% +643.1% 34687 ± 87% interrupts.CPU29.RES:Rescheduling_interrupts 2709 ± 47% +1409.8% 40911 ±100% interrupts.CPU31.RES:Rescheduling_interrupts 8442 ± 92% +462.9% 47521 ± 76% interrupts.CPU32.RES:Rescheduling_interrupts 5793 ± 54% +350.2% 26083 ± 75% interrupts.CPU34.RES:Rescheduling_interrupts 6938 ± 81% +392.4% 34166 ± 51% interrupts.CPU36.RES:Rescheduling_interrupts 2737 ± 63% +1293.5% 38146 ± 79% interrupts.CPU38.RES:Rescheduling_interrupts 5031 ± 81% +531.8% 31791 ± 84% interrupts.CPU42.RES:Rescheduling_interrupts 4377 ± 38% +654.6% 33031 ± 70% interrupts.CPU45.RES:Rescheduling_interrupts 6546 ± 15% +599.8% 45814 ± 55% interrupts.CPU48.RES:Rescheduling_interrupts 2766 ± 55% +167.5% 7399 ± 62% interrupts.CPU52.CAL:Function_call_interrupts 2564 ± 35% +1464.7% 40133 ± 82% interrupts.CPU52.RES:Rescheduling_interrupts 5679 ±101% +488.3% 33411 ± 86% interrupts.CPU53.RES:Rescheduling_interrupts 4120 ± 59% +626.0% 29910 ± 73% interrupts.CPU55.RES:Rescheduling_interrupts 4747 ± 68% +654.0% 35795 ± 76% interrupts.CPU59.RES:Rescheduling_interrupts 2226 ± 40% +385.7% 10816 ± 61% interrupts.CPU64.CAL:Function_call_interrupts 7061 ± 79% +457.0% 39332 ± 78% interrupts.CPU64.RES:Rescheduling_interrupts 3674 ± 89% +178.1% 10218 ± 66% interrupts.CPU67.CAL:Function_call_interrupts 5487 ±113% +533.0% 34735 ± 88% interrupts.CPU67.RES:Rescheduling_interrupts 11021 ±108% +161.3% 28800 ± 66% interrupts.CPU68.RES:Rescheduling_interrupts 3486 ± 76% +916.4% 35438 ± 89% interrupts.CPU70.RES:Rescheduling_interrupts 6585 ±121% +515.9% 40563 ± 97% interrupts.CPU71.RES:Rescheduling_interrupts 5839 ± 56% +831.1% 54364 ± 99% interrupts.CPU72.RES:Rescheduling_interrupts 3691 ± 59% +376.1% 17572 ± 59% interrupts.CPU73.CAL:Function_call_interrupts 9657 ± 83% +619.5% 69488 ± 78% interrupts.CPU73.RES:Rescheduling_interrupts 7255 ± 64% +803.7% 65564 ± 91% interrupts.CPU74.RES:Rescheduling_interrupts 4226 ± 55% +1920.2% 85372 ± 77% interrupts.CPU76.RES:Rescheduling_interrupts 4259 ± 24% +1661.7% 75047 ± 77% interrupts.CPU77.RES:Rescheduling_interrupts 1750 ± 54% +1091.9% 20859 ±106% interrupts.CPU79.CAL:Function_call_interrupts 4579 ± 89% +2046.8% 98302 ± 59% interrupts.CPU79.RES:Rescheduling_interrupts 3420 ± 62% +247.6% 11889 ± 69% interrupts.CPU8.CAL:Function_call_interrupts 4484 ± 57% +1629.9% 77581 ± 85% interrupts.CPU80.RES:Rescheduling_interrupts 7969 ± 52% +871.1% 77389 ± 88% interrupts.CPU81.RES:Rescheduling_interrupts 3367 ± 59% +377.9% 16092 ±108% interrupts.CPU82.CAL:Function_call_interrupts 6865 ± 91% +1049.3% 78911 ± 97% interrupts.CPU82.RES:Rescheduling_interrupts 6283 ± 64% +1005.2% 69447 ± 92% interrupts.CPU83.RES:Rescheduling_interrupts 4150 ± 50% +1692.5% 74395 ± 98% interrupts.CPU86.RES:Rescheduling_interrupts 7421 ± 80% +912.5% 75142 ± 77% interrupts.CPU89.RES:Rescheduling_interrupts 9035 ± 86% +651.1% 67865 ± 87% interrupts.CPU90.RES:Rescheduling_interrupts 3631 ± 44% +2094.1% 79666 ± 99% interrupts.CPU91.RES:Rescheduling_interrupts 10978 ±149% +734.7% 91630 ± 96% interrupts.CPU93.RES:Rescheduling_interrupts 5030 ± 65% +1457.5% 78348 ± 69% interrupts.CPU94.RES:Rescheduling_interrupts 1616844 ± 88% +491.5% 9563110 ± 29% interrupts.RES:Rescheduling_interrupts 14234744 ± 62% +111.7% 30137685 ± 50% softirqs.CPU103.NET_RX 15166105 ± 68% +110.4% 31916351 ± 46% softirqs.CPU116.NET_RX 13989220 ± 71% +135.1% 32885769 ± 31% softirqs.CPU121.NET_RX 11649887 ± 68% +176.8% 32245171 ± 25% softirqs.CPU122.NET_RX 99225 ± 4% +10.0% 109151 ± 4% softirqs.CPU122.TIMER 12580771 ± 39% +153.4% 31876377 ± 29% softirqs.CPU123.NET_RX 9819456 ± 62% +212.5% 30688551 ± 27% softirqs.CPU124.NET_RX 98889 ± 2% +10.6% 109323 ± 3% softirqs.CPU124.TIMER 11477315 ± 58% +184.8% 32684945 ± 27% softirqs.CPU125.NET_RX 11277834 ± 55% +149.3% 28118688 ± 36% softirqs.CPU127.NET_RX 99637 ± 2% +9.1% 108741 ± 3% softirqs.CPU127.TIMER 11765824 ± 62% +187.4% 33814408 ± 29% softirqs.CPU129.NET_RX 99421 ± 3% +8.1% 107434 ± 2% softirqs.CPU130.TIMER 13104876 ± 58% +138.9% 31301537 ± 22% softirqs.CPU132.NET_RX 10163277 ± 50% +203.0% 30798080 ± 31% softirqs.CPU134.NET_RX 10830918 ± 81% +192.5% 31681622 ± 25% softirqs.CPU135.NET_RX 11701606 ± 44% +149.4% 29186636 ± 35% softirqs.CPU136.NET_RX 12543121 ± 55% +160.4% 32657321 ± 28% softirqs.CPU139.NET_RX 14157200 ± 53% +114.7% 30401897 ± 28% softirqs.CPU140.NET_RX 14720881 ± 41% +157.3% 37874607 ± 21% softirqs.CPU144.NET_RX 10361303 ± 47% +248.9% 36154051 ± 18% softirqs.CPU145.NET_RX 12781741 ± 60% +166.0% 33998254 ± 33% softirqs.CPU146.NET_RX 99930 ± 5% +9.6% 109558 ± 5% softirqs.CPU146.TIMER 8735463 ± 66% +294.0% 34414443 ± 28% softirqs.CPU148.NET_RX 98948 ± 4% +9.7% 108510 ± 3% softirqs.CPU148.TIMER 15215465 ± 60% +147.8% 37700459 ± 31% softirqs.CPU150.NET_RX 100989 ± 5% +10.9% 112038 ± 7% softirqs.CPU150.TIMER 8823584 ± 98% +325.3% 37526933 ± 33% softirqs.CPU151.NET_RX 9410354 ± 80% +276.2% 35397794 ± 34% softirqs.CPU154.NET_RX 98458 ± 5% +10.8% 109109 ± 4% softirqs.CPU154.TIMER 11427331 ± 37% +218.6% 36408545 ± 32% softirqs.CPU155.NET_RX 11774083 ± 77% +196.1% 34867757 ± 26% softirqs.CPU156.NET_RX 99426 ± 4% +10.9% 110296 ± 4% softirqs.CPU156.TIMER 12384525 ± 50% +214.9% 38994131 ± 25% softirqs.CPU157.NET_RX 99359 ± 4% +13.1% 112340 ± 8% softirqs.CPU158.TIMER 9539416 ± 78% +270.8% 35370056 ± 36% softirqs.CPU159.NET_RX 98112 ± 3% +10.7% 108565 ± 4% softirqs.CPU159.TIMER 14024257 ± 63% +141.1% 33810731 ± 28% softirqs.CPU160.NET_RX 11911677 ± 39% +207.5% 36631132 ± 30% softirqs.CPU161.NET_RX 14490899 ± 82% +160.6% 37761237 ± 24% softirqs.CPU163.NET_RX 15385492 ± 41% +150.8% 38589823 ± 19% softirqs.CPU165.NET_RX 10070218 ± 71% +249.8% 35228287 ± 31% softirqs.CPU166.NET_RX 99062 ± 5% +10.5% 109429 ± 5% softirqs.CPU166.TIMER 11244119 ± 31% +244.3% 38718603 ± 31% softirqs.CPU168.NET_RX 11842159 ± 40% +258.0% 42396595 ± 24% softirqs.CPU169.NET_RX 15092199 ± 26% +157.7% 38889141 ± 26% softirqs.CPU170.NET_RX 8781209 ± 73% +346.5% 39208115 ± 36% softirqs.CPU172.NET_RX 9944219 ± 37% +323.3% 42095180 ± 27% softirqs.CPU173.NET_RX 14360085 ± 28% +183.3% 40676347 ± 30% softirqs.CPU174.NET_RX 12544488 ± 48% +214.0% 39393746 ± 34% softirqs.CPU175.NET_RX 12793260 ± 60% +212.5% 39977499 ± 30% softirqs.CPU176.NET_RX 13027065 ± 40% +196.2% 38591070 ± 32% softirqs.CPU178.NET_RX 13239284 ± 49% +225.1% 43040902 ± 17% softirqs.CPU179.NET_RX 13435769 ± 32% +190.7% 39062923 ± 36% softirqs.CPU180.NET_RX 14923921 ± 35% +152.7% 37711888 ± 34% softirqs.CPU181.NET_RX 13534665 ± 39% +201.6% 40815880 ± 34% softirqs.CPU183.NET_RX 10043983 ± 47% +283.0% 38467933 ± 32% softirqs.CPU184.NET_RX 10350988 ± 42% +284.7% 39822487 ± 29% softirqs.CPU185.NET_RX 12696988 ± 50% +217.1% 40266259 ± 24% softirqs.CPU186.NET_RX 14434520 ± 27% +180.5% 40493160 ± 31% softirqs.CPU187.NET_RX 11710254 ± 55% +268.7% 43173863 ± 26% softirqs.CPU189.NET_RX 13111257 ± 39% +219.9% 41937691 ± 29% softirqs.CPU190.NET_RX 14449787 ± 34% +186.9% 41449605 ± 25% softirqs.CPU191.NET_RX 16833022 ± 50% +90.1% 31997301 ± 51% softirqs.CPU21.NET_RX 13823903 ± 71% +129.7% 31750030 ± 37% softirqs.CPU25.NET_RX 13905255 ± 54% +139.3% 33275334 ± 26% softirqs.CPU26.NET_RX 99993 ± 3% +9.2% 109186 ± 3% softirqs.CPU26.TIMER 14406440 ± 53% +128.8% 32959318 ± 25% softirqs.CPU27.NET_RX 12272454 ± 50% +155.1% 31308890 ± 28% softirqs.CPU28.NET_RX 11468614 ± 67% +173.4% 31360670 ± 36% softirqs.CPU29.NET_RX 98799 ± 3% +8.8% 107534 ± 2% softirqs.CPU29.TIMER 13233831 ± 65% +140.8% 31865015 ± 18% softirqs.CPU36.NET_RX 11385376 ± 45% +157.4% 29309523 ± 30% softirqs.CPU38.NET_RX 12660613 ± 57% +146.4% 31196260 ± 21% softirqs.CPU39.NET_RX 11930635 ± 47% +155.8% 30523635 ± 29% softirqs.CPU40.NET_RX 99592 ± 3% +9.5% 109072 ± 3% softirqs.CPU43.TIMER 13546747 ± 58% +121.9% 30061759 ± 26% softirqs.CPU44.NET_RX 12405619 ± 32% +159.9% 32236355 ± 31% softirqs.CPU46.NET_RX 13907807 ± 43% +174.0% 38107265 ± 23% softirqs.CPU48.NET_RX 13517535 ± 39% +178.1% 37593718 ± 23% softirqs.CPU49.NET_RX 99083 ± 4% +9.6% 108583 ± 5% softirqs.CPU50.TIMER 10960038 ± 91% +246.3% 37953056 ± 34% softirqs.CPU51.NET_RX 11448489 ± 54% +218.8% 36501698 ± 31% softirqs.CPU52.NET_RX 98950 ± 4% +9.8% 108658 ± 4% softirqs.CPU52.TIMER 99658 ± 3% +9.0% 108626 ± 5% softirqs.CPU53.TIMER 15615465 ± 42% +138.3% 37218121 ± 31% softirqs.CPU54.NET_RX 100687 ± 4% +8.7% 109406 ± 5% softirqs.CPU54.TIMER 99797 ± 4% +7.9% 107722 ± 3% softirqs.CPU56.TIMER 99478 ± 4% +8.6% 108015 ± 5% softirqs.CPU57.TIMER 10003149 ± 64% +259.3% 35937916 ± 34% softirqs.CPU58.NET_RX 98347 ± 4% +10.4% 108554 ± 5% softirqs.CPU58.TIMER 11687808 ± 64% +214.2% 36723266 ± 33% softirqs.CPU59.NET_RX 12937071 ± 37% +197.7% 38514140 ± 26% softirqs.CPU61.NET_RX 11560384 ± 65% +225.3% 37605949 ± 31% softirqs.CPU63.NET_RX 98687 ± 3% +10.3% 108813 ± 3% softirqs.CPU63.TIMER 11794318 ± 52% +214.6% 37100264 ± 30% softirqs.CPU66.NET_RX 14877710 ± 72% +151.5% 37417593 ± 22% softirqs.CPU67.NET_RX 14150863 ± 33% +162.9% 37202456 ± 21% softirqs.CPU69.NET_RX 14321644 ± 57% +108.3% 29828349 ± 52% softirqs.CPU7.NET_RX 11452178 ± 68% +202.9% 34687130 ± 32% softirqs.CPU70.NET_RX 12029261 ± 30% +215.5% 37954566 ± 33% softirqs.CPU72.NET_RX 11239817 ± 48% +264.1% 40920975 ± 27% softirqs.CPU73.NET_RX 13666767 ± 29% +191.9% 39890837 ± 28% softirqs.CPU74.NET_RX 9796799 ± 40% +310.8% 40242249 ± 34% softirqs.CPU76.NET_RX 11740789 ± 27% +230.9% 38845528 ± 30% softirqs.CPU77.NET_RX 13118354 ± 32% +214.7% 41279654 ± 29% softirqs.CPU78.NET_RX 11061289 ± 50% +266.3% 40516111 ± 34% softirqs.CPU79.NET_RX 11877887 ± 62% +235.4% 39837159 ± 32% softirqs.CPU80.NET_RX 13440016 ± 28% +188.1% 38719673 ± 32% softirqs.CPU81.NET_RX 12345155 ± 44% +235.2% 41385385 ± 27% softirqs.CPU82.NET_RX 14200361 ± 41% +203.4% 43084415 ± 23% softirqs.CPU83.NET_RX 12686489 ± 41% +209.5% 39268561 ± 38% softirqs.CPU84.NET_RX 14108969 ± 55% +165.0% 37383069 ± 37% softirqs.CPU85.NET_RX 13552239 ± 30% +191.6% 39524993 ± 32% softirqs.CPU86.NET_RX 12962401 ± 46% +212.1% 40451805 ± 31% softirqs.CPU87.NET_RX 10270197 ± 32% +285.9% 39632034 ± 29% softirqs.CPU88.NET_RX 11593540 ± 45% +243.0% 39768872 ± 29% softirqs.CPU89.NET_RX 11140063 ± 41% +262.2% 40348290 ± 25% softirqs.CPU90.NET_RX 14856740 ± 17% +167.4% 39730583 ± 27% softirqs.CPU91.NET_RX 10432532 ± 43% +291.3% 40817874 ± 33% softirqs.CPU92.NET_RX 14312525 ± 31% +194.3% 42124840 ± 33% softirqs.CPU93.NET_RX 13930045 ± 43% +186.5% 39904212 ± 30% softirqs.CPU94.NET_RX 14797777 ± 34% +174.9% 40679378 ± 27% softirqs.CPU95.NET_RX 15780036 ± 49% +104.6% 32282485 ± 45% softirqs.CPU97.NET_RX 11545653 ± 56% +177.9% 32085242 ± 43% softirqs.CPU98.NET_RX 2.643e+09 ± 41% +152.1% 6.661e+09 ± 16% softirqs.NET_RX Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. --- 0DAY/LKP+ Test Infrastructure Open Source Technology Center https://lists.01.org/hyperkitty/list/lkp@lists.01.org Intel Corporation Thanks, Oliver Sang