Greeting, FYI, we noticed a 148.4% improvement of stress-ng.loop.ops_per_sec due to commit: commit: 8883efd909da6648570c698567fd8923bf66a852 ("[PATCH] loop: replace loop_ctl_mutex with loop_idr_spinlock") url: https://github.com/0day-ci/linux/commits/Tetsuo-Handa/loop-replace-loop_ctl_mutex-with-loop_idr_spinlock/20210827-000519 base: git://git.infradead.org/users/hch/configfs.git for-next in testcase: stress-ng on test machine: 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 512G memory with following parameters: nr_threads: 100% disk: 1HDD testtime: 60s class: device test: loop cpufreq_governor: performance ucode: 0x5003006 Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run bin/lkp run generated-yaml-file ========================================================================================= class/compiler/cpufreq_governor/disk/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode: device/gcc-9/performance/1HDD/x86_64-rhel-8.3/100%/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp7/loop/stress-ng/60s/0x5003006 commit: c42dd069be ("configfs: fix a race in configfs_lookup()") 8883efd909 ("loop: replace loop_ctl_mutex with loop_idr_spinlock") c42dd069be8dfc9b 8883efd909da6648570c698567f ---------------- --------------------------- %stddev %change %stddev \ | \ 1967 +148.1% 4882 stress-ng.loop.ops 32.23 +148.4% 80.06 stress-ng.loop.ops_per_sec 4439 +49.5% 6637 stress-ng.time.involuntary_context_switches 12363 +5.7% 13062 stress-ng.time.minor_page_faults 59.17 ± 2% +275.0% 221.86 ± 3% stress-ng.time.percent_of_cpu_this_job_got 37.89 +271.7% 140.82 ± 3% stress-ng.time.system_time 19176 +619.5% 137970 stress-ng.time.voluntary_context_switches 97.63 -1.8% 95.87 iostat.cpu.idle 2.21 ± 2% +71.0% 3.78 ± 3% iostat.cpu.system 2506 ± 24% +56.8% 3930 ± 10% numa-meminfo.node1.Active 2459 ± 21% +58.1% 3887 ± 9% numa-meminfo.node1.Active(anon) 614.33 ± 21% +58.2% 971.71 ± 9% numa-vmstat.node1.nr_active_anon 614.33 ± 21% +58.2% 971.71 ± 9% numa-vmstat.node1.nr_zone_active_anon 1.14 ± 2% -0.3 0.88 ± 10% mpstat.cpu.all.irq% 0.99 +1.9 2.85 ± 3% mpstat.cpu.all.sys% 0.14 ± 7% +0.2 0.33 mpstat.cpu.all.usr% 220892 ± 22% +58.7% 350634 ± 14% numa-numastat.node0.local_node 267158 ± 12% +55.8% 416300 ± 14% numa-numastat.node0.numa_hit 256360 ± 19% +54.0% 394696 ± 14% numa-numastat.node1.local_node 299440 ± 12% +41.8% 424652 ± 15% numa-numastat.node1.numa_hit 2627 +149.2% 6548 vmstat.io.bi 23.17 ± 20% +257.7% 82.86 ± 17% vmstat.memory.buff 1.33 ± 35% +317.9% 5.57 ± 13% vmstat.procs.r 10361 +100.6% 20779 vmstat.system.cs 0.01 ± 22% -75.9% 0.00 ±159% perf-sched.sch_delay.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64 1.78 ± 12% -73.8% 0.47 ±158% perf-sched.wait_and_delay.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64 3.55 ± 12% -73.8% 0.93 ±158% perf-sched.wait_and_delay.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64 1.77 ± 12% -73.8% 0.46 ±158% perf-sched.wait_time.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64 3.54 ± 12% -73.8% 0.93 ±158% perf-sched.wait_time.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64 79.00 ± 3% +94.6% 153.71 ± 2% turbostat.Avg_MHz 3.81 ± 3% +2.1 5.94 ± 3% turbostat.Busy% 2075 +25.0% 2594 turbostat.Bzy_MHz 91336 ± 5% +134.3% 213980 ± 12% turbostat.C1 0.14 ± 3% +0.1 0.27 ± 21% turbostat.C1% 50.33 +4.2% 52.43 turbostat.PkgTmp 136.43 +10.9% 151.37 turbostat.PkgWatt 4082 +38.7% 5663 ± 3% meminfo.Active 3836 +40.7% 5397 ± 4% meminfo.Active(anon) 278033 +17.0% 325254 meminfo.AnonPages 1423893 +12.9% 1608169 meminfo.Committed_AS 290333 +17.1% 339985 meminfo.Inactive 290180 +17.1% 339777 meminfo.Inactive(anon) 140265 +13.5% 159191 meminfo.KReclaimable 10899 ± 2% +39.4% 15189 ± 4% meminfo.PageTables 54413 +19.4% 64976 meminfo.Percpu 140265 +13.5% 159191 meminfo.SReclaimable 15761 +27.8% 20142 meminfo.Shmem 23366 +132.0% 54205 softirqs.BLOCK 10108 ± 5% -44.7% 5587 ± 13% softirqs.CPU0.RCU 7932 ± 13% +17.4% 9314 ± 4% softirqs.CPU14.SCHED 9034 ± 20% -55.4% 4031 ± 17% softirqs.CPU2.RCU 9678 ± 7% -12.5% 8464 ± 7% softirqs.CPU24.SCHED 7465 ± 16% -64.6% 2641 ± 6% softirqs.CPU28.RCU 8599 ± 16% -49.9% 4307 ± 36% softirqs.CPU3.RCU 7737 ± 20% -59.3% 3147 ± 8% softirqs.CPU64.RCU 8819 ± 20% -65.6% 3033 ± 17% softirqs.CPU93.RCU 720713 ± 2% -58.4% 299744 softirqs.RCU 27527 +18.6% 32659 softirqs.TIMER 956.67 +41.0% 1349 ± 4% proc-vmstat.nr_active_anon 69520 +17.0% 81314 proc-vmstat.nr_anon_pages 72558 +17.1% 84945 proc-vmstat.nr_inactive_anon 19957 +7.1% 21365 proc-vmstat.nr_kernel_stack 9759 +4.0% 10145 proc-vmstat.nr_mapped 2728 ± 2% +39.1% 3796 ± 4% proc-vmstat.nr_page_table_pages 3939 +27.8% 5035 proc-vmstat.nr_shmem 35060 +13.5% 39798 proc-vmstat.nr_slab_reclaimable 55263 +9.5% 60522 proc-vmstat.nr_slab_unreclaimable 956.67 +41.0% 1349 ± 4% proc-vmstat.nr_zone_active_anon 72558 +17.1% 84945 proc-vmstat.nr_zone_inactive_anon 854.83 ± 25% +88.3% 1610 ± 21% proc-vmstat.numa_hint_faults 568291 +48.2% 842456 proc-vmstat.numa_hit 478946 +55.9% 746875 proc-vmstat.numa_local 89355 +7.0% 95647 proc-vmstat.numa_other 565.00 ± 37% +64.3% 928.43 ± 15% proc-vmstat.numa_pages_migrated 12531 +155.2% 31985 proc-vmstat.pgactivate 618054 +65.2% 1021005 proc-vmstat.pgalloc_normal 343106 +5.6% 362461 proc-vmstat.pgfault 509485 +74.9% 891020 proc-vmstat.pgfree 565.00 ± 37% +64.3% 928.43 ± 15% proc-vmstat.pgmigrate_success 178270 +146.6% 439638 proc-vmstat.pgpgin 19761 ± 3% +13.9% 22508 proc-vmstat.pgreuse 17570 ± 3% +174.8% 48289 ± 2% proc-vmstat.unevictable_pgs_culled 4.988e+08 ± 2% +141.7% 1.206e+09 ± 3% perf-stat.i.branch-instructions 8933620 ± 15% +95.1% 17430543 ± 8% perf-stat.i.branch-misses 15.20 ± 16% +7.9 23.15 ± 9% perf-stat.i.cache-miss-rate% 2892116 ± 9% +275.9% 10871506 ± 2% perf-stat.i.cache-misses 19918505 ± 27% +141.7% 48133737 ± 12% perf-stat.i.cache-references 10259 +134.2% 24030 ± 3% perf-stat.i.context-switches 96024 +10.0% 105602 ± 3% perf-stat.i.cpu-clock 7.036e+09 ± 4% +134.4% 1.649e+10 ± 3% perf-stat.i.cpu-cycles 245.11 ± 5% +201.7% 739.59 ± 3% perf-stat.i.cpu-migrations 2548 ± 7% -32.4% 1722 ± 4% perf-stat.i.cycles-between-cache-misses 5.805e+08 +132.4% 1.349e+09 ± 2% perf-stat.i.dTLB-loads 0.03 ± 23% -0.0 0.02 ± 17% perf-stat.i.dTLB-store-miss-rate% 2.689e+08 +114.5% 5.766e+08 ± 2% perf-stat.i.dTLB-stores 39.31 ± 3% +5.6 44.91 ± 3% perf-stat.i.iTLB-load-miss-rate% 1097403 ± 5% +50.6% 1652224 ± 3% perf-stat.i.iTLB-load-misses 2.41e+09 ± 2% +137.9% 5.733e+09 ± 3% perf-stat.i.instructions 2197 ± 6% +59.6% 3507 ± 2% perf-stat.i.instructions-per-iTLB-miss 0.34 ± 3% +7.1% 0.36 ± 2% perf-stat.i.ipc 11.88 +63.1% 19.37 ± 6% perf-stat.i.major-faults 0.07 ± 4% +112.7% 0.16 ± 2% perf-stat.i.metric.GHz 237.42 ± 24% +115.5% 511.75 ± 11% perf-stat.i.metric.K/sec 14.03 ± 2% +113.1% 29.90 ± 2% perf-stat.i.metric.M/sec 3788 +41.6% 5363 ± 3% perf-stat.i.minor-faults 72.25 ± 2% +3.7 75.93 perf-stat.i.node-load-miss-rate% 505210 ± 5% +370.2% 2375302 ± 3% perf-stat.i.node-load-misses 192263 ± 3% +270.9% 713032 ± 5% perf-stat.i.node-loads 67.34 ± 3% +3.7 71.01 perf-stat.i.node-store-miss-rate% 319202 ± 7% +438.6% 1719185 ± 3% perf-stat.i.node-store-misses 148309 ± 8% +326.2% 632114 ± 3% perf-stat.i.node-stores 3849 +43.4% 5520 ± 3% perf-stat.i.page-faults 96024 +10.0% 105602 ± 3% perf-stat.i.task-clock 1.78 ± 13% -0.4 1.36 ± 9% perf-stat.overall.branch-miss-rate% 15.14 ± 16% +7.7 22.85 ± 12% perf-stat.overall.cache-miss-rate% 2448 ± 7% -38.1% 1516 ± 3% perf-stat.overall.cycles-between-cache-misses 0.03 ± 22% -0.0 0.02 ± 16% perf-stat.overall.dTLB-store-miss-rate% 39.36 ± 3% +5.6 44.95 ± 2% perf-stat.overall.iTLB-load-miss-rate% 2201 ± 6% +50.2% 3305 ± 2% perf-stat.overall.instructions-per-iTLB-miss 72.39 ± 2% +5.1 77.46 perf-stat.overall.node-load-miss-rate% 68.27 ± 2% +4.8 73.04 perf-stat.overall.node-store-miss-rate% 4.907e+08 ± 2% +105.0% 1.006e+09 ± 2% perf-stat.ps.branch-instructions 8778182 ± 15% +56.2% 13711296 ± 8% perf-stat.ps.branch-misses 2847343 ± 9% +226.5% 9295762 ± 2% perf-stat.ps.cache-misses 19608519 ± 27% +110.8% 41328950 ± 13% perf-stat.ps.cache-references 10102 +106.1% 20820 perf-stat.ps.context-switches 6.928e+09 ± 4% +103.4% 1.409e+10 ± 2% perf-stat.ps.cpu-cycles 241.52 ± 5% +161.3% 630.99 perf-stat.ps.cpu-migrations 5.712e+08 +98.1% 1.132e+09 ± 2% perf-stat.ps.dTLB-loads 2.646e+08 +85.1% 4.899e+08 perf-stat.ps.dTLB-stores 1080453 ± 5% +33.6% 1443503 ± 2% perf-stat.ps.iTLB-load-misses 2.371e+09 ± 2% +101.2% 4.77e+09 perf-stat.ps.instructions 3719 +7.9% 4011 perf-stat.ps.minor-faults 497421 ± 5% +322.4% 2101134 ± 2% perf-stat.ps.node-load-misses 189239 ± 3% +223.0% 611269 ± 3% perf-stat.ps.node-loads 314328 ± 7% +362.1% 1452522 ± 3% perf-stat.ps.node-store-misses 145941 ± 8% +267.3% 535987 ± 2% perf-stat.ps.node-stores 3779 +9.6% 4143 perf-stat.ps.page-faults 1.551e+11 ± 2% +100.0% 3.101e+11 perf-stat.total.instructions 4763 ± 6% +37.5% 6549 slabinfo.Acpi-Parse.active_objs 4763 ± 6% +37.5% 6549 slabinfo.Acpi-Parse.num_objs 1632 ± 2% +15.1% 1878 slabinfo.bdev_cache.active_objs 1632 ± 2% +15.1% 1878 slabinfo.bdev_cache.num_objs 158287 ± 2% +14.4% 181134 slabinfo.dentry.active_objs 3789 ± 2% +14.6% 4343 slabinfo.dentry.active_slabs 159181 ± 2% +14.6% 182438 slabinfo.dentry.num_objs 3789 ± 2% +14.6% 4343 slabinfo.dentry.num_slabs 2803 ± 3% +20.5% 3376 slabinfo.file_lock_cache.active_objs 2803 ± 3% +20.5% 3376 slabinfo.file_lock_cache.num_objs 29992 ± 3% +50.6% 45158 ± 3% slabinfo.filp.active_objs 956.17 ± 2% +48.2% 1417 ± 3% slabinfo.filp.active_slabs 30617 ± 2% +48.1% 45357 ± 3% slabinfo.filp.num_objs 956.17 ± 2% +48.2% 1417 ± 3% slabinfo.filp.num_slabs 9265 ± 3% +25.3% 11605 slabinfo.fsnotify_mark_connector.active_objs 9265 ± 3% +25.3% 11605 slabinfo.fsnotify_mark_connector.num_objs 132409 +14.3% 151389 slabinfo.inode_cache.active_objs 2413 +15.3% 2782 slabinfo.inode_cache.active_slabs 132752 +15.3% 153089 slabinfo.inode_cache.num_objs 2413 +15.3% 2782 slabinfo.inode_cache.num_slabs 6772 +20.6% 8170 slabinfo.kmalloc-1k.active_objs 7495 +21.7% 9121 slabinfo.kmalloc-1k.num_objs 11467 ± 3% +31.7% 15100 ± 3% slabinfo.kmalloc-256.active_objs 358.00 ± 3% +33.0% 476.14 ± 3% slabinfo.kmalloc-256.active_slabs 11469 ± 3% +33.0% 15250 ± 3% slabinfo.kmalloc-256.num_objs 358.00 ± 3% +33.0% 476.14 ± 3% slabinfo.kmalloc-256.num_slabs 75029 +25.2% 93955 slabinfo.kmalloc-8.active_objs 75415 +24.9% 94226 slabinfo.kmalloc-8.num_objs 3490 ± 5% +70.9% 5965 ± 4% slabinfo.kmalloc-cg-1k.active_objs 3490 ± 5% +75.8% 6135 ± 4% slabinfo.kmalloc-cg-1k.num_objs 850.83 ± 8% +165.4% 2257 ± 11% slabinfo.kmalloc-cg-2k.active_objs 850.83 ± 8% +171.6% 2310 ± 9% slabinfo.kmalloc-cg-2k.num_objs 12149 ± 5% +100.9% 24402 ± 7% slabinfo.kmalloc-rcl-64.active_objs 189.17 ± 5% +101.3% 380.86 ± 7% slabinfo.kmalloc-rcl-64.active_slabs 12155 ± 5% +100.8% 24412 ± 7% slabinfo.kmalloc-rcl-64.num_objs 189.17 ± 5% +101.3% 380.86 ± 7% slabinfo.kmalloc-rcl-64.num_slabs 3547 ± 4% +65.9% 5884 ± 4% slabinfo.kmalloc-rcl-96.active_objs 3547 ± 4% +65.9% 5884 ± 4% slabinfo.kmalloc-rcl-96.num_objs 2926 +10.2% 3226 slabinfo.pool_workqueue.active_objs 1157 ± 2% +15.6% 1338 slabinfo.request_queue.active_objs 1157 ± 2% +15.6% 1338 slabinfo.request_queue.num_objs 6093 ± 2% +26.9% 7731 slabinfo.shmem_inode_cache.active_objs 6093 ± 2% +26.9% 7731 slabinfo.shmem_inode_cache.num_objs 3321 ± 6% +19.1% 3957 ± 4% slabinfo.skbuff_ext_cache.active_objs 3321 ± 6% +19.1% 3957 ± 4% slabinfo.skbuff_ext_cache.num_objs 4430 ± 3% +102.0% 8948 ± 8% slabinfo.skbuff_head_cache.active_objs 138.00 ± 3% +105.3% 283.29 ± 8% slabinfo.skbuff_head_cache.active_slabs 4430 ± 3% +104.9% 9079 ± 8% slabinfo.skbuff_head_cache.num_objs 138.00 ± 3% +105.3% 283.29 ± 8% slabinfo.skbuff_head_cache.num_slabs 3857 ± 3% +24.1% 4787 slabinfo.task_delay_info.active_objs 3857 ± 3% +24.1% 4787 slabinfo.task_delay_info.num_objs 4758 +23.7% 5884 slabinfo.trace_event_file.active_objs 4758 +23.7% 5884 slabinfo.trace_event_file.num_objs 63627 ± 3% +12.1% 71328 ± 4% slabinfo.vm_area_struct.active_objs 1590 ± 3% +12.2% 1784 ± 4% slabinfo.vm_area_struct.active_slabs 63655 ± 3% +12.2% 71398 ± 4% slabinfo.vm_area_struct.num_objs 1590 ± 3% +12.2% 1784 ± 4% slabinfo.vm_area_struct.num_slabs 68516 ± 2% +33.1% 91195 interrupts.CAL:Function_call_interrupts 699.67 ± 29% +81.2% 1267 ± 45% interrupts.CPU0.CAL:Function_call_interrupts 42.00 ± 19% +127.2% 95.43 ± 15% interrupts.CPU0.RES:Rescheduling_interrupts 261.67 ± 38% +82.2% 476.86 ± 24% interrupts.CPU1.NMI:Non-maskable_interrupts 261.67 ± 38% +82.2% 476.86 ± 24% interrupts.CPU1.PMI:Performance_monitoring_interrupts 664.33 ± 9% +47.1% 977.43 ± 6% interrupts.CPU10.CAL:Function_call_interrupts 668.67 ± 6% +46.9% 982.14 ± 6% interrupts.CPU11.CAL:Function_call_interrupts 41.00 ± 43% +128.6% 93.71 ± 19% interrupts.CPU11.RES:Rescheduling_interrupts 664.33 ± 5% +43.3% 952.14 ± 5% interrupts.CPU12.CAL:Function_call_interrupts 652.33 ± 6% +49.3% 973.71 ± 7% interrupts.CPU13.CAL:Function_call_interrupts 669.33 ± 10% +41.7% 948.14 ± 5% interrupts.CPU14.CAL:Function_call_interrupts 682.17 ± 8% +40.5% 958.57 ± 6% interrupts.CPU15.CAL:Function_call_interrupts 704.50 ± 14% +45.8% 1027 ± 7% interrupts.CPU16.CAL:Function_call_interrupts 691.17 ± 10% +40.0% 967.57 ± 5% interrupts.CPU17.CAL:Function_call_interrupts 709.33 ± 8% +36.8% 970.57 ± 4% interrupts.CPU18.CAL:Function_call_interrupts 692.33 ± 14% +36.0% 941.29 ± 2% interrupts.CPU19.CAL:Function_call_interrupts 683.17 ± 9% +32.4% 904.29 ± 6% interrupts.CPU20.CAL:Function_call_interrupts 689.50 ± 14% +41.2% 973.71 ± 5% interrupts.CPU21.CAL:Function_call_interrupts 666.17 ± 7% +45.0% 966.00 ± 6% interrupts.CPU22.CAL:Function_call_interrupts 199.33 ± 37% +94.5% 387.71 ± 29% interrupts.CPU22.NMI:Non-maskable_interrupts 199.33 ± 37% +94.5% 387.71 ± 29% interrupts.CPU22.PMI:Performance_monitoring_interrupts 688.17 ± 12% +44.1% 991.86 ± 5% interrupts.CPU23.CAL:Function_call_interrupts 660.67 ± 7% +45.6% 961.71 ± 3% interrupts.CPU24.CAL:Function_call_interrupts 709.17 ± 10% +33.6% 947.43 ± 3% interrupts.CPU25.CAL:Function_call_interrupts 179.00 ± 37% +102.0% 361.57 ± 15% interrupts.CPU26.NMI:Non-maskable_interrupts 179.00 ± 37% +102.0% 361.57 ± 15% interrupts.CPU26.PMI:Performance_monitoring_interrupts 646.83 ± 6% +41.8% 917.14 ± 4% interrupts.CPU27.CAL:Function_call_interrupts 173.17 ± 36% +188.8% 500.14 ± 69% interrupts.CPU27.NMI:Non-maskable_interrupts 173.17 ± 36% +188.8% 500.14 ± 69% interrupts.CPU27.PMI:Performance_monitoring_interrupts 22.67 ± 58% +292.6% 89.00 ± 18% interrupts.CPU27.RES:Rescheduling_interrupts 230.33 ± 34% +114.0% 492.86 ± 31% interrupts.CPU28.NMI:Non-maskable_interrupts 230.33 ± 34% +114.0% 492.86 ± 31% interrupts.CPU28.PMI:Performance_monitoring_interrupts 26.50 ± 74% +203.5% 80.43 ± 23% interrupts.CPU28.RES:Rescheduling_interrupts 33.00 ± 55% +168.8% 88.71 ± 23% interrupts.CPU3.RES:Rescheduling_interrupts 238.83 ± 34% +148.8% 594.29 ± 63% interrupts.CPU30.NMI:Non-maskable_interrupts 238.83 ± 34% +148.8% 594.29 ± 63% interrupts.CPU30.PMI:Performance_monitoring_interrupts 14.00 ± 37% +388.8% 68.43 ± 25% interrupts.CPU30.RES:Rescheduling_interrupts 681.17 ± 8% +28.6% 876.29 ± 7% interrupts.CPU31.CAL:Function_call_interrupts 22.67 ± 41% +230.9% 75.00 ± 25% interrupts.CPU31.RES:Rescheduling_interrupts 692.33 ± 9% +26.8% 877.71 ± 5% interrupts.CPU33.CAL:Function_call_interrupts 210.00 ± 36% +241.6% 717.43 ± 57% interrupts.CPU33.NMI:Non-maskable_interrupts 210.00 ± 36% +241.6% 717.43 ± 57% interrupts.CPU33.PMI:Performance_monitoring_interrupts 689.50 ± 8% +34.3% 925.71 ± 6% interrupts.CPU35.CAL:Function_call_interrupts 18.50 ± 12% +305.4% 75.00 ± 27% interrupts.CPU35.RES:Rescheduling_interrupts 224.00 ± 10% +78.5% 399.86 ± 34% interrupts.CPU36.NMI:Non-maskable_interrupts 224.00 ± 10% +78.5% 399.86 ± 34% interrupts.CPU36.PMI:Performance_monitoring_interrupts 628.50 ± 5% +46.3% 919.43 ± 2% interrupts.CPU38.CAL:Function_call_interrupts 655.83 ± 7% +40.5% 921.14 ± 4% interrupts.CPU41.CAL:Function_call_interrupts 202.67 ± 26% +228.3% 665.43 ± 70% interrupts.CPU41.NMI:Non-maskable_interrupts 202.67 ± 26% +228.3% 665.43 ± 70% interrupts.CPU41.PMI:Performance_monitoring_interrupts 708.67 ± 12% +29.3% 916.57 ± 6% interrupts.CPU45.CAL:Function_call_interrupts 202.67 ± 23% +105.3% 416.14 ± 21% interrupts.CPU45.NMI:Non-maskable_interrupts 202.67 ± 23% +105.3% 416.14 ± 21% interrupts.CPU45.PMI:Performance_monitoring_interrupts 711.00 ± 11% +28.4% 913.14 ± 4% interrupts.CPU46.CAL:Function_call_interrupts 764.50 ± 12% +25.4% 958.71 ± 4% interrupts.CPU47.CAL:Function_call_interrupts 185.67 ± 48% +129.0% 425.14 ± 24% interrupts.CPU47.NMI:Non-maskable_interrupts 185.67 ± 48% +129.0% 425.14 ± 24% interrupts.CPU47.PMI:Performance_monitoring_interrupts 695.33 ± 7% +30.1% 904.86 ± 3% interrupts.CPU48.CAL:Function_call_interrupts 681.83 ± 10% +34.8% 919.14 ± 6% interrupts.CPU49.CAL:Function_call_interrupts 254.83 ± 32% +118.5% 556.71 ± 23% interrupts.CPU49.NMI:Non-maskable_interrupts 254.83 ± 32% +118.5% 556.71 ± 23% interrupts.CPU49.PMI:Performance_monitoring_interrupts 654.17 ± 7% +34.6% 880.57 ± 6% interrupts.CPU50.CAL:Function_call_interrupts 697.17 ± 9% +31.4% 916.00 ± 3% interrupts.CPU51.CAL:Function_call_interrupts 656.50 ± 6% +43.9% 944.57 ± 4% interrupts.CPU52.CAL:Function_call_interrupts 659.67 ± 4% +39.7% 921.43 ± 3% interrupts.CPU53.CAL:Function_call_interrupts 692.67 ± 6% +30.0% 900.14 ± 3% interrupts.CPU54.CAL:Function_call_interrupts 634.83 ± 3% +39.2% 883.86 ± 3% interrupts.CPU55.CAL:Function_call_interrupts 692.50 ± 14% +35.7% 939.57 ± 10% interrupts.CPU56.CAL:Function_call_interrupts 717.00 ± 10% +26.5% 907.29 ± 6% interrupts.CPU57.CAL:Function_call_interrupts 683.83 ± 6% +30.0% 888.71 ± 4% interrupts.CPU58.CAL:Function_call_interrupts 669.00 ± 9% +35.5% 906.43 ± 4% interrupts.CPU59.CAL:Function_call_interrupts 639.17 ± 4% +42.1% 908.43 ± 4% interrupts.CPU60.CAL:Function_call_interrupts 661.00 ± 5% +37.6% 909.29 ± 5% interrupts.CPU61.CAL:Function_call_interrupts 635.67 ± 5% +46.7% 932.57 ± 4% interrupts.CPU62.CAL:Function_call_interrupts 639.83 ± 8% +43.6% 919.00 ± 2% interrupts.CPU63.CAL:Function_call_interrupts 647.83 ± 6% +39.2% 902.00 ± 3% interrupts.CPU64.CAL:Function_call_interrupts 633.83 ± 2% +49.6% 948.00 ± 4% interrupts.CPU65.CAL:Function_call_interrupts 619.33 ± 5% +56.2% 967.57 ± 5% interrupts.CPU66.CAL:Function_call_interrupts 615.33 ± 4% +53.5% 944.57 ± 7% interrupts.CPU67.CAL:Function_call_interrupts 25.67 ± 41% +198.3% 76.57 ± 28% interrupts.CPU67.RES:Rescheduling_interrupts 590.67 ± 6% +68.6% 995.57 ± 15% interrupts.CPU68.CAL:Function_call_interrupts 649.33 ± 11% +34.3% 872.14 ± 6% interrupts.CPU69.CAL:Function_call_interrupts 623.50 ± 10% +52.1% 948.14 interrupts.CPU7.CAL:Function_call_interrupts 679.17 ± 7% +33.3% 905.29 ± 3% interrupts.CPU70.CAL:Function_call_interrupts 28.00 ± 21% +195.9% 82.86 ± 26% interrupts.CPU70.RES:Rescheduling_interrupts 639.17 ± 8% +39.9% 894.00 ± 8% interrupts.CPU71.CAL:Function_call_interrupts 677.67 ± 8% +31.8% 893.14 ± 4% interrupts.CPU72.CAL:Function_call_interrupts 694.17 ± 12% +28.5% 891.71 ± 3% interrupts.CPU73.CAL:Function_call_interrupts 17.00 ± 40% +345.4% 75.71 ± 31% interrupts.CPU73.RES:Rescheduling_interrupts 649.17 ± 16% +38.2% 897.14 ± 5% interrupts.CPU74.CAL:Function_call_interrupts 148.00 ± 19% +82.3% 269.86 ± 20% interrupts.CPU74.NMI:Non-maskable_interrupts 148.00 ± 19% +82.3% 269.86 ± 20% interrupts.CPU74.PMI:Performance_monitoring_interrupts 220.83 ± 23% +103.1% 448.43 ± 37% interrupts.CPU75.NMI:Non-maskable_interrupts 220.83 ± 23% +103.1% 448.43 ± 37% interrupts.CPU75.PMI:Performance_monitoring_interrupts 709.50 ± 10% +32.7% 941.29 ± 3% interrupts.CPU76.CAL:Function_call_interrupts 663.33 ± 8% +33.1% 883.00 ± 6% interrupts.CPU78.CAL:Function_call_interrupts 610.00 ± 7% +44.2% 879.43 ± 4% interrupts.CPU79.CAL:Function_call_interrupts 189.00 ± 12% +80.0% 340.29 ± 29% interrupts.CPU79.NMI:Non-maskable_interrupts 189.00 ± 12% +80.0% 340.29 ± 29% interrupts.CPU79.PMI:Performance_monitoring_interrupts 643.33 ± 5% +42.2% 915.00 ± 10% interrupts.CPU8.CAL:Function_call_interrupts 694.50 ± 14% +41.2% 980.86 ± 4% interrupts.CPU80.CAL:Function_call_interrupts 21.83 ± 33% +274.9% 81.86 ± 26% interrupts.CPU80.RES:Rescheduling_interrupts 638.33 ± 19% +52.3% 972.29 ± 3% interrupts.CPU81.CAL:Function_call_interrupts 194.33 ± 27% +365.5% 904.57 ± 93% interrupts.CPU81.NMI:Non-maskable_interrupts 194.33 ± 27% +365.5% 904.57 ± 93% interrupts.CPU81.PMI:Performance_monitoring_interrupts 664.00 ± 6% +44.0% 956.29 ± 3% interrupts.CPU82.CAL:Function_call_interrupts 222.33 ± 22% +106.7% 459.57 ± 55% interrupts.CPU82.NMI:Non-maskable_interrupts 222.33 ± 22% +106.7% 459.57 ± 55% interrupts.CPU82.PMI:Performance_monitoring_interrupts 660.83 ± 14% +49.2% 985.71 ± 6% interrupts.CPU83.CAL:Function_call_interrupts 668.50 ± 19% +46.3% 977.86 ± 5% interrupts.CPU85.CAL:Function_call_interrupts 656.00 ± 9% +47.0% 964.57 ± 4% interrupts.CPU86.CAL:Function_call_interrupts 188.17 ± 35% +139.6% 450.86 ± 44% interrupts.CPU86.NMI:Non-maskable_interrupts 188.17 ± 35% +139.6% 450.86 ± 44% interrupts.CPU86.PMI:Performance_monitoring_interrupts 699.83 ± 11% +42.1% 994.29 ± 3% interrupts.CPU87.CAL:Function_call_interrupts 228.67 ± 34% +369.7% 1074 ±107% interrupts.CPU87.NMI:Non-maskable_interrupts 228.67 ± 34% +369.7% 1074 ±107% interrupts.CPU87.PMI:Performance_monitoring_interrupts 677.17 ± 11% +43.6% 972.71 ± 4% interrupts.CPU89.CAL:Function_call_interrupts 149.67 ± 20% +569.4% 1001 ±116% interrupts.CPU89.NMI:Non-maskable_interrupts 149.67 ± 20% +569.4% 1001 ±116% interrupts.CPU89.PMI:Performance_monitoring_interrupts 683.83 ± 11% +44.1% 985.43 ± 12% interrupts.CPU9.CAL:Function_call_interrupts 673.50 ± 22% +45.8% 981.71 ± 3% interrupts.CPU90.CAL:Function_call_interrupts 23.83 ± 71% +233.3% 79.43 ± 21% interrupts.CPU90.RES:Rescheduling_interrupts 691.67 ± 12% +37.4% 950.14 ± 4% interrupts.CPU91.CAL:Function_call_interrupts 755.17 ± 10% +31.9% 996.14 ± 5% interrupts.CPU92.CAL:Function_call_interrupts 679.83 ± 19% +38.5% 941.57 ± 8% interrupts.CPU93.CAL:Function_call_interrupts 173.67 ± 31% +150.9% 435.71 ± 43% interrupts.CPU93.NMI:Non-maskable_interrupts 173.67 ± 31% +150.9% 435.71 ± 43% interrupts.CPU93.PMI:Performance_monitoring_interrupts 704.83 ± 12% +32.3% 932.14 ± 3% interrupts.CPU95.CAL:Function_call_interrupts 24037 ± 5% +106.6% 49655 ± 8% interrupts.NMI:Non-maskable_interrupts 24037 ± 5% +106.6% 49655 ± 8% interrupts.PMI:Performance_monitoring_interrupts 2853 ± 5% +148.0% 7076 ± 4% interrupts.RES:Rescheduling_interrupts 56.16 ± 3% -15.3 40.90 ± 6% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify 55.55 ± 3% -15.1 40.42 ± 5% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 55.55 ± 3% -15.1 40.42 ± 5% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify 55.52 ± 3% -15.1 40.41 ± 5% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 51.46 ± 4% -12.8 38.70 ± 6% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 50.89 ± 4% -12.7 38.18 ± 6% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 38.90 ± 7% -6.8 32.07 ± 8% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 11.55 ± 7% -5.8 5.73 ± 8% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 9.40 ± 7% -4.4 5.02 ± 10% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle 6.16 ± 8% -3.0 3.20 ± 8% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 6.07 ± 8% -2.9 3.15 ± 8% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 3.17 ± 10% -2.0 1.13 ± 19% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 2.65 ± 20% -1.8 0.82 ± 19% perf-profile.calltrace.cycles-pp.mutex_spin_on_owner.__mutex_lock.lo_ioctl.blkdev_ioctl.block_ioctl 2.65 ± 20% -1.8 0.83 ± 19% perf-profile.calltrace.cycles-pp.__mutex_lock.lo_ioctl.blkdev_ioctl.block_ioctl.__x64_sys_ioctl 3.25 ± 8% -1.4 1.84 ± 9% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 1.80 ± 24% -1.1 0.67 ± 79% perf-profile.calltrace.cycles-pp.printk.lo_ioctl.cold.blkdev_ioctl.block_ioctl.__x64_sys_ioctl 1.80 ± 24% -1.1 0.67 ± 79% perf-profile.calltrace.cycles-pp.vprintk_emit.printk.lo_ioctl.cold.blkdev_ioctl.block_ioctl 1.80 ± 24% -1.1 0.67 ± 79% perf-profile.calltrace.cycles-pp.lo_ioctl.cold.blkdev_ioctl.block_ioctl.__x64_sys_ioctl.do_syscall_64 1.90 ± 9% -1.1 0.84 ± 13% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 2.29 ± 7% -1.0 1.29 ± 11% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt 1.99 ± 7% -0.8 1.17 ± 11% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt 1.92 ± 6% -0.8 1.13 ± 12% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt 1.01 ± 4% -0.3 0.67 ± 19% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues 0.00 +0.6 0.61 ± 11% perf-profile.calltrace.cycles-pp.__dentry_kill.dput.simple_recursive_removal.debugfs_remove.blk_mq_debugfs_unregister_hctx 0.00 +0.6 0.64 ± 14% perf-profile.calltrace.cycles-pp.kernfs_remove.__kobject_del.kobject_del.blk_mq_unregister_hctx.blk_mq_unregister_dev 0.00 +0.7 0.68 ± 13% perf-profile.calltrace.cycles-pp.__kobject_del.kobject_del.blk_mq_unregister_hctx.blk_mq_unregister_dev.blk_unregister_queue 0.00 +0.7 0.68 ± 14% perf-profile.calltrace.cycles-pp.kobject_del.blk_mq_unregister_hctx.blk_mq_unregister_dev.blk_unregister_queue.del_gendisk 0.00 +0.7 0.68 ± 13% perf-profile.calltrace.cycles-pp.blk_mq_unregister_hctx.blk_mq_unregister_dev.blk_unregister_queue.del_gendisk.loop_remove 0.68 ± 12% +0.7 1.38 ± 15% perf-profile.calltrace.cycles-pp.unit_file_find_dropin_paths 0.00 +0.7 0.71 ± 13% perf-profile.calltrace.cycles-pp.blk_mq_unregister_dev.blk_unregister_queue.del_gendisk.loop_remove.loop_control_ioctl 0.00 +0.7 0.73 ± 19% perf-profile.calltrace.cycles-pp.new_inode.debugfs_get_inode.__debugfs_create_file.debugfs_create_files.blk_mq_debugfs_register_hctx 0.00 +0.7 0.73 ± 19% perf-profile.calltrace.cycles-pp.debugfs_get_inode.__debugfs_create_file.debugfs_create_files.blk_mq_debugfs_register_hctx.blk_mq_debugfs_register 0.00 +0.7 0.75 ± 9% perf-profile.calltrace.cycles-pp.dput.simple_recursive_removal.debugfs_remove.blk_mq_debugfs_unregister_hctx.blk_mq_exit_queue 0.00 +0.8 0.80 ± 13% perf-profile.calltrace.cycles-pp.blk_unregister_queue.del_gendisk.loop_remove.loop_control_ioctl.__x64_sys_ioctl 0.17 ±141% +0.8 0.99 ± 13% perf-profile.calltrace.cycles-pp.openat64.unit_file_find_dropin_paths 0.00 +0.9 0.90 ± 12% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.openat64 0.00 +0.9 0.90 ± 12% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.openat64.unit_file_find_dropin_paths 0.00 +0.9 0.95 ± 13% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.openat64.unit_file_find_dropin_paths 0.00 +1.0 0.95 ± 12% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.openat64.unit_file_find_dropin_paths 0.00 +1.0 1.03 ± 12% perf-profile.calltrace.cycles-pp.del_gendisk.loop_remove.loop_control_ioctl.__x64_sys_ioctl.do_syscall_64 0.09 ±223% +1.1 1.22 ± 19% perf-profile.calltrace.cycles-pp.io_serial_out.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit 8.56 ± 4% +1.2 9.80 ± 6% perf-profile.calltrace.cycles-pp.io_serial_in.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write 11.20 ± 6% +1.4 12.56 ± 6% perf-profile.calltrace.cycles-pp.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit.printk 0.00 +1.6 1.60 ± 90% perf-profile.calltrace.cycles-pp.start_creating.__debugfs_create_file.debugfs_create_files.blk_mq_debugfs_register_hctx.blk_mq_debugfs_register 0.00 +2.5 2.45 ± 57% perf-profile.calltrace.cycles-pp.__debugfs_create_file.debugfs_create_files.blk_mq_debugfs_register_hctx.blk_mq_debugfs_register.blk_register_queue 0.00 +2.5 2.45 ± 57% perf-profile.calltrace.cycles-pp.debugfs_create_files.blk_mq_debugfs_register_hctx.blk_mq_debugfs_register.blk_register_queue.__device_add_disk 10.15 ± 6% +2.6 12.72 ± 8% perf-profile.calltrace.cycles-pp.serial8250_console_write.console_unlock.vprintk_emit.printk.set_capacity_and_notify.cold 11.12 ± 6% +2.7 13.81 ± 8% perf-profile.calltrace.cycles-pp.console_unlock.vprintk_emit.printk.set_capacity_and_notify.cold.loop_set_size 0.00 +3.1 3.15 ± 73% perf-profile.calltrace.cycles-pp.blk_mq_debugfs_register_hctx.blk_mq_debugfs_register.blk_register_queue.__device_add_disk.loop_add 0.00 +3.2 3.23 ± 71% perf-profile.calltrace.cycles-pp.blk_mq_debugfs_register.blk_register_queue.__device_add_disk.loop_add.loop_control_ioctl 0.09 ±223% +3.6 3.72 ± 61% perf-profile.calltrace.cycles-pp.__mutex_lock.blkdev_get_by_dev.blkdev_open.do_dentry_open.do_open 2.21 ± 9% +3.7 5.93 ± 50% perf-profile.calltrace.cycles-pp.blkdev_open.do_dentry_open.do_open.path_openat.do_filp_open 2.21 ± 9% +3.7 5.93 ± 50% perf-profile.calltrace.cycles-pp.blkdev_get_by_dev.blkdev_open.do_dentry_open.do_open.path_openat 2.22 ± 9% +3.7 5.95 ± 49% perf-profile.calltrace.cycles-pp.do_dentry_open.do_open.path_openat.do_filp_open.do_sys_openat2 2.23 ± 8% +3.7 5.97 ± 49% perf-profile.calltrace.cycles-pp.do_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open 0.00 +3.8 3.78 ± 65% perf-profile.calltrace.cycles-pp.blk_register_queue.__device_add_disk.loop_add.loop_control_ioctl.__x64_sys_ioctl 0.36 ± 70% +3.9 4.24 ± 59% perf-profile.calltrace.cycles-pp.loop_add.loop_control_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +4.0 4.02 ± 62% perf-profile.calltrace.cycles-pp.__device_add_disk.loop_add.loop_control_ioctl.__x64_sys_ioctl.do_syscall_64 2.42 ± 8% +4.2 6.60 ± 44% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.42 ± 8% +4.2 6.60 ± 44% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.40 ± 8% +4.9 7.34 ± 39% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64 2.40 ± 8% +5.0 7.35 ± 39% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +5.7 5.66 ± 15% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.mntput_no_expire.simple_recursive_removal.debugfs_remove 0.00 +5.8 5.75 ± 15% perf-profile.calltrace.cycles-pp._raw_spin_lock.mntput_no_expire.simple_recursive_removal.debugfs_remove.blk_mq_debugfs_unregister_hctx 0.00 +6.5 6.53 ± 13% perf-profile.calltrace.cycles-pp.mntput_no_expire.simple_recursive_removal.debugfs_remove.blk_mq_debugfs_unregister_hctx.blk_mq_exit_queue 0.64 ± 17% +7.8 8.41 ± 13% perf-profile.calltrace.cycles-pp.simple_recursive_removal.debugfs_remove.blk_mq_debugfs_unregister_hctx.blk_mq_exit_queue.blk_cleanup_queue 0.64 ± 17% +7.8 8.41 ± 13% perf-profile.calltrace.cycles-pp.debugfs_remove.blk_mq_debugfs_unregister_hctx.blk_mq_exit_queue.blk_cleanup_queue.blk_cleanup_disk 0.64 ± 17% +7.8 8.42 ± 13% perf-profile.calltrace.cycles-pp.blk_mq_debugfs_unregister_hctx.blk_mq_exit_queue.blk_cleanup_queue.blk_cleanup_disk.loop_remove 0.64 ± 17% +7.8 8.42 ± 13% perf-profile.calltrace.cycles-pp.blk_mq_exit_queue.blk_cleanup_queue.blk_cleanup_disk.loop_remove.loop_control_ioctl 0.66 ± 18% +7.9 8.54 ± 13% perf-profile.calltrace.cycles-pp.blk_cleanup_disk.loop_remove.loop_control_ioctl.__x64_sys_ioctl.do_syscall_64 0.66 ± 18% +7.9 8.54 ± 13% perf-profile.calltrace.cycles-pp.blk_cleanup_queue.blk_cleanup_disk.loop_remove.loop_control_ioctl.__x64_sys_ioctl 0.78 ± 16% +9.3 10.04 ± 11% perf-profile.calltrace.cycles-pp.loop_remove.loop_control_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe 19.72 ± 5% +11.6 31.37 ± 10% perf-profile.calltrace.cycles-pp.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.46 ± 9% +13.0 14.51 ± 23% perf-profile.calltrace.cycles-pp.loop_control_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe 24.55 ± 3% +15.1 39.62 ± 7% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 24.55 ± 3% +15.1 39.63 ± 7% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 56.16 ± 3% -15.3 40.90 ± 6% perf-profile.children.cycles-pp.secondary_startup_64_no_verify 56.16 ± 3% -15.3 40.90 ± 6% perf-profile.children.cycles-pp.cpu_startup_entry 56.16 ± 3% -15.3 40.90 ± 6% perf-profile.children.cycles-pp.do_idle 55.55 ± 3% -15.1 40.42 ± 5% perf-profile.children.cycles-pp.start_secondary 52.03 ± 4% -12.9 39.16 ± 6% perf-profile.children.cycles-pp.cpuidle_enter 52.00 ± 4% -12.9 39.14 ± 6% perf-profile.children.cycles-pp.cpuidle_enter_state 39.12 ± 7% -6.8 32.29 ± 8% perf-profile.children.cycles-pp.intel_idle 11.31 ± 7% -4.8 6.53 ± 8% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 9.72 ± 7% -4.3 5.38 ± 10% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 6.40 ± 7% -3.0 3.42 ± 7% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 6.31 ± 8% -2.9 3.37 ± 7% perf-profile.children.cycles-pp.hrtimer_interrupt 3.22 ± 10% -2.1 1.15 ± 19% perf-profile.children.cycles-pp.menu_select 1.90 ± 7% -1.7 0.23 ± 44% perf-profile.children.cycles-pp.lo_release 1.94 ± 7% -1.7 0.27 ± 39% perf-profile.children.cycles-pp.blkdev_put 1.94 ± 7% -1.7 0.28 ± 38% perf-profile.children.cycles-pp.blkdev_close 2.04 ± 7% -1.6 0.39 ± 27% perf-profile.children.cycles-pp.__fput 2.09 ± 7% -1.6 0.46 ± 25% perf-profile.children.cycles-pp.task_work_run 2.13 ± 7% -1.6 0.50 ± 23% perf-profile.children.cycles-pp.exit_to_user_mode_prepare 2.14 ± 7% -1.6 0.52 ± 23% perf-profile.children.cycles-pp.syscall_exit_to_user_mode 2.63 ± 10% -1.5 1.13 ± 13% perf-profile.children.cycles-pp.ktime_get 3.41 ± 8% -1.4 1.98 ± 9% perf-profile.children.cycles-pp.__hrtimer_run_queues 1.77 ± 10% -1.3 0.46 ± 28% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 1.51 ± 12% -1.1 0.40 ± 31% perf-profile.children.cycles-pp.tick_nohz_next_event 1.95 ± 10% -1.1 0.89 ± 13% perf-profile.children.cycles-pp.clockevents_program_event 2.40 ± 6% -1.0 1.40 ± 11% perf-profile.children.cycles-pp.tick_sched_timer 1.80 ± 24% -1.0 0.80 ± 48% perf-profile.children.cycles-pp.lo_ioctl.cold 2.09 ± 6% -0.8 1.27 ± 11% perf-profile.children.cycles-pp.tick_sched_handle 0.87 ± 16% -0.8 0.06 ± 70% perf-profile.children.cycles-pp.timekeeping_max_deferment 2.03 ± 6% -0.8 1.22 ± 12% perf-profile.children.cycles-pp.update_process_times 0.86 ± 11% -0.5 0.32 ± 15% perf-profile.children.cycles-pp.tick_nohz_irq_exit 1.82 ± 16% -0.4 1.41 ± 15% perf-profile.children.cycles-pp.delay_tsc 0.66 ± 10% -0.3 0.31 ± 8% perf-profile.children.cycles-pp.lapic_next_deadline 1.08 ± 3% -0.3 0.74 ± 18% perf-profile.children.cycles-pp.scheduler_tick 0.58 ± 8% -0.3 0.30 ± 18% perf-profile.children.cycles-pp.native_irq_return_iret 0.54 ± 12% -0.3 0.28 ± 6% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.50 ± 15% -0.3 0.25 ± 6% perf-profile.children.cycles-pp.sched_clock_cpu 0.47 ± 14% -0.2 0.23 ± 11% perf-profile.children.cycles-pp.read_tsc 0.45 ± 9% -0.2 0.21 ± 29% perf-profile.children.cycles-pp.ktime_get_update_offsets_now 0.48 ± 11% -0.2 0.24 ± 21% perf-profile.children.cycles-pp.irq_enter_rcu 0.36 ± 12% -0.2 0.13 ± 17% perf-profile.children.cycles-pp.rcu_sched_clock_irq 0.40 ± 3% -0.2 0.17 ± 5% perf-profile.children.cycles-pp.irqtime_account_irq 0.44 ± 12% -0.2 0.22 ± 22% perf-profile.children.cycles-pp.tick_irq_enter 0.42 ± 16% -0.2 0.21 ± 5% perf-profile.children.cycles-pp.native_sched_clock 0.40 ± 47% -0.2 0.23 ± 15% perf-profile.children.cycles-pp.__close 0.35 ± 13% -0.2 0.19 ± 15% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.20 ± 12% -0.1 0.07 ± 11% perf-profile.children.cycles-pp.__hrtimer_next_event_base 0.22 ± 21% -0.1 0.11 ± 13% perf-profile.children.cycles-pp.__intel_pmu_enable_all 0.21 ± 15% -0.1 0.09 ± 24% perf-profile.children.cycles-pp.rcu_idle_exit 0.42 ± 15% -0.1 0.31 ± 12% perf-profile.children.cycles-pp.poll_idle 0.20 ± 10% -0.1 0.10 ± 17% perf-profile.children.cycles-pp._raw_spin_trylock 0.15 ± 11% -0.1 0.06 ± 45% perf-profile.children.cycles-pp.rcu_eqs_exit 0.23 ± 21% -0.1 0.14 ± 11% perf-profile.children.cycles-pp.hrtimer_update_next_event 0.24 ± 11% -0.1 0.15 ± 14% perf-profile.children.cycles-pp.update_rq_clock 0.19 ± 7% -0.1 0.10 ± 33% perf-profile.children.cycles-pp.arch_scale_freq_tick 0.15 ± 14% -0.1 0.08 ± 21% perf-profile.children.cycles-pp.update_irq_load_avg 0.11 ± 16% -0.1 0.05 ± 64% perf-profile.children.cycles-pp.trigger_load_balance 0.15 ± 18% -0.1 0.10 ± 13% perf-profile.children.cycles-pp.read 0.08 ± 14% -0.1 0.03 ± 89% perf-profile.children.cycles-pp.exc_page_fault 0.08 ± 14% -0.0 0.03 ± 86% perf-profile.children.cycles-pp.epoll_wait 0.09 ± 18% -0.0 0.05 ± 43% perf-profile.children.cycles-pp.asm_exc_page_fault 0.09 ± 13% +0.0 0.13 ± 9% perf-profile.children.cycles-pp.__d_lookup 0.06 ± 46% +0.0 0.10 ± 6% perf-profile.children.cycles-pp.lookup_dcache 0.06 ± 46% +0.0 0.10 ± 6% perf-profile.children.cycles-pp.d_lookup 0.02 ± 99% +0.0 0.07 ± 15% perf-profile.children.cycles-pp.mutex_unlock 0.02 ±141% +0.1 0.07 ± 13% perf-profile.children.cycles-pp.d_add 0.08 ± 18% +0.1 0.13 ± 14% perf-profile.children.cycles-pp.__d_alloc 0.02 ±141% +0.1 0.07 ± 9% perf-profile.children.cycles-pp.simple_lookup 0.07 ± 23% +0.1 0.12 ± 26% perf-profile.children.cycles-pp.vfs_fstat 0.11 ± 13% +0.1 0.16 ± 22% perf-profile.children.cycles-pp.__do_sys_newfstat 0.02 ±144% +0.1 0.08 ± 19% perf-profile.children.cycles-pp.__alloc_pages 0.00 +0.1 0.06 ± 10% perf-profile.children.cycles-pp.blk_throtl_init 0.00 +0.1 0.06 ± 16% perf-profile.children.cycles-pp.blk_mq_init_sched 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.__percpu_counter_init 0.05 ± 76% +0.1 0.11 ± 17% perf-profile.children.cycles-pp.__d_drop 0.04 ± 74% +0.1 0.11 ± 17% perf-profile.children.cycles-pp.___d_drop 0.00 +0.1 0.07 ± 15% perf-profile.children.cycles-pp.kernfs_put 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.d_instantiate 0.06 ± 58% +0.1 0.12 ± 17% perf-profile.children.cycles-pp.mutex_lock 0.02 ±141% +0.1 0.09 ± 11% perf-profile.children.cycles-pp.__list_del_entry_valid 0.00 +0.1 0.07 ± 18% perf-profile.children.cycles-pp.obj_cgroup_uncharge_pages 0.11 ± 29% +0.1 0.18 ± 10% perf-profile.children.cycles-pp.smpboot_thread_fn 0.00 +0.1 0.07 ± 25% perf-profile.children.cycles-pp.internal_create_groups 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.__x64_sys_nanosleep 0.00 +0.1 0.07 ± 10% perf-profile.children.cycles-pp.page_counter_uncharge 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.hrtimer_nanosleep 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.do_nanosleep 0.00 +0.1 0.07 ± 8% perf-profile.children.cycles-pp.elevator_init_mq 0.00 +0.1 0.07 ± 34% perf-profile.children.cycles-pp.obj_cgroup_charge_pages 0.03 ±100% +0.1 0.10 ± 21% perf-profile.children.cycles-pp.__slab_free 0.06 ± 18% +0.1 0.13 ± 18% perf-profile.children.cycles-pp.memset_erms 0.00 +0.1 0.07 ± 23% perf-profile.children.cycles-pp.kernfs_iop_lookup 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.up_write 0.00 +0.1 0.07 ± 6% perf-profile.children.cycles-pp.rcu_cblist_dequeue 0.00 +0.1 0.08 ± 9% perf-profile.children.cycles-pp.__list_add_valid 0.00 +0.1 0.08 ± 11% perf-profile.children.cycles-pp.blkcg_init_queue 0.00 +0.1 0.08 ± 20% perf-profile.children.cycles-pp.remove_files 0.00 +0.1 0.08 ± 25% perf-profile.children.cycles-pp.kernfs_iop_getattr 0.03 ±100% +0.1 0.11 ± 15% perf-profile.children.cycles-pp.run_ksoftirqd 0.08 ± 33% +0.1 0.16 ± 13% perf-profile.children.cycles-pp.d_invalidate 0.00 +0.1 0.09 ± 8% perf-profile.children.cycles-pp.remove_one 0.09 ± 14% +0.1 0.18 ± 13% perf-profile.children.cycles-pp.alloc_inode 0.00 +0.1 0.09 ± 18% perf-profile.children.cycles-pp.path_parentat 0.00 +0.1 0.09 ± 20% perf-profile.children.cycles-pp.sysfs_unmerge_group 0.00 +0.1 0.09 ± 25% perf-profile.children.cycles-pp.obj_cgroup_charge 0.18 ± 13% +0.1 0.26 ± 13% perf-profile.children.cycles-pp.filemap_read 0.00 +0.1 0.09 ± 20% perf-profile.children.cycles-pp.filename_parentat 0.00 +0.1 0.09 ± 22% perf-profile.children.cycles-pp.do_renameat2 0.00 +0.1 0.09 ± 23% perf-profile.children.cycles-pp.__x64_sys_rename 0.00 +0.1 0.09 ± 21% perf-profile.children.cycles-pp.__srcu_read_lock 0.00 +0.1 0.09 ± 19% perf-profile.children.cycles-pp.sysfs_remove_group 0.00 +0.1 0.10 ± 29% perf-profile.children.cycles-pp.rq_qos_exit 0.00 +0.1 0.10 ± 29% perf-profile.children.cycles-pp.blk_mq_debugfs_unregister_queue_rqos 0.00 +0.1 0.10 ± 16% perf-profile.children.cycles-pp.__destroy_inode 0.17 ± 19% +0.1 0.27 ± 12% perf-profile.children.cycles-pp._find_next_bit 0.00 +0.1 0.10 ± 12% perf-profile.children.cycles-pp.destroy_inode 0.00 +0.1 0.10 ± 11% perf-profile.children.cycles-pp.device_unregister 0.12 ± 12% +0.1 0.23 ± 14% perf-profile.children.cycles-pp.d_alloc 0.00 +0.1 0.10 ± 12% perf-profile.children.cycles-pp.blk_alloc_queue 0.01 ±223% +0.1 0.11 ± 17% perf-profile.children.cycles-pp.fsnotify_grab_connector 0.00 +0.1 0.11 ± 17% perf-profile.children.cycles-pp.dpm_sysfs_remove 0.00 +0.1 0.11 ± 44% perf-profile.children.cycles-pp.kernfs_activate 0.01 ±223% +0.1 0.12 ± 18% perf-profile.children.cycles-pp.fsnotify_destroy_marks 0.10 ± 21% +0.1 0.22 ± 18% perf-profile.children.cycles-pp.do_faccessat 0.04 ± 72% +0.1 0.16 ± 14% perf-profile.children.cycles-pp.blk_mq_init_queue_data 0.31 ± 6% +0.1 0.43 ± 14% perf-profile.children.cycles-pp.kmem_cache_alloc 0.01 ±223% +0.1 0.13 ± 17% perf-profile.children.cycles-pp.dentry_unlink_inode 0.00 +0.1 0.13 ± 24% perf-profile.children.cycles-pp.__kernfs_new_node 0.00 +0.1 0.13 ± 29% perf-profile.children.cycles-pp.device_add 0.16 ± 23% +0.1 0.29 ± 10% perf-profile.children.cycles-pp.cpumask_next 0.04 ± 72% +0.1 0.17 ± 11% perf-profile.children.cycles-pp.__blk_mq_alloc_disk 0.14 ± 7% +0.1 0.28 ± 15% perf-profile.children.cycles-pp.d_alloc_parallel 0.00 +0.1 0.14 ± 23% perf-profile.children.cycles-pp.lookup_mnt 0.00 +0.1 0.14 ± 11% perf-profile.children.cycles-pp.lockref_put_or_lock 0.01 ±223% +0.1 0.15 ± 13% perf-profile.children.cycles-pp.complete_walk 0.20 ± 13% +0.1 0.34 ± 18% perf-profile.children.cycles-pp.kmem_cache_free 0.04 ± 71% +0.1 0.18 ± 14% perf-profile.children.cycles-pp.pcpu_alloc 0.00 +0.1 0.14 ± 22% perf-profile.children.cycles-pp.__traverse_mounts 0.12 ± 7% +0.1 0.27 ± 9% perf-profile.children.cycles-pp.new_inode_pseudo 0.00 +0.2 0.15 ± 21% perf-profile.children.cycles-pp.kernfs_new_node 0.05 ± 46% +0.2 0.21 ± 9% perf-profile.children.cycles-pp.try_to_unlazy 0.00 +0.2 0.16 ± 9% perf-profile.children.cycles-pp.bdi_unregister 0.04 ± 72% +0.2 0.20 ± 15% perf-profile.children.cycles-pp.down_write 0.02 ±144% +0.2 0.18 ± 26% perf-profile.children.cycles-pp.kernfs_dop_revalidate 0.08 ± 50% +0.2 0.24 ± 13% perf-profile.children.cycles-pp.step_into 0.02 ±223% +0.2 0.18 ± 23% perf-profile.children.cycles-pp.wait_rcu_exp_gp 0.02 ±223% +0.2 0.18 ± 23% perf-profile.children.cycles-pp.sync_rcu_exp_select_cpus 0.35 ± 11% +0.2 0.53 ± 18% perf-profile.children.cycles-pp.rcu_core 0.02 ±146% +0.2 0.20 ± 22% perf-profile.children.cycles-pp.__do_sys_newstat 0.02 ±144% +0.2 0.20 ± 8% perf-profile.children.cycles-pp.__legitimize_path 0.18 ± 11% +0.2 0.37 ± 12% perf-profile.children.cycles-pp.lookup_one_len 0.20 ± 6% +0.2 0.39 ± 15% perf-profile.children.cycles-pp.__lookup_slow 0.00 +0.2 0.20 ± 15% perf-profile.children.cycles-pp.kernfs_remove_by_name_ns 0.02 ±146% +0.2 0.22 ± 23% perf-profile.children.cycles-pp.vfs_statx 0.12 ± 18% +0.2 0.32 ± 15% perf-profile.children.cycles-pp.lookup_fast 0.00 +0.2 0.22 ± 27% perf-profile.children.cycles-pp.internal_create_group 0.00 +0.2 0.22 ± 19% perf-profile.children.cycles-pp.blk_mq_debugfs_unregister_sched 0.08 ± 15% +0.2 0.30 ± 15% perf-profile.children.cycles-pp.inode_permission 0.00 +0.2 0.23 ± 19% perf-profile.children.cycles-pp.__elevator_exit 0.00 +0.2 0.23 ± 19% perf-profile.children.cycles-pp.blk_mq_exit_sched 0.08 ± 12% +0.2 0.31 ± 17% perf-profile.children.cycles-pp.evict 0.01 ±223% +0.2 0.25 ± 19% perf-profile.children.cycles-pp.kernfs_iop_permission 0.00 +0.2 0.24 ± 12% perf-profile.children.cycles-pp.__legitimize_mnt 0.00 +0.2 0.24 ± 15% perf-profile.children.cycles-pp.device_del 0.00 +0.2 0.25 ± 29% perf-profile.children.cycles-pp.__kernfs_create_file 0.00 +0.2 0.25 ± 29% perf-profile.children.cycles-pp.sysfs_add_file_mode_ns 0.00 +0.3 0.27 ± 26% perf-profile.children.cycles-pp.sysfs_create_dir_ns 0.01 ±223% +0.3 0.28 ± 27% perf-profile.children.cycles-pp.blk_mq_register_hctx 0.01 ±223% +0.3 0.28 ± 14% perf-profile.children.cycles-pp.__kernfs_remove 0.01 ±223% +0.3 0.28 ± 26% perf-profile.children.cycles-pp.__blk_mq_register_dev 0.00 +0.3 0.28 ± 26% perf-profile.children.cycles-pp.kernfs_create_dir_ns 0.22 ± 15% +0.3 0.51 ± 18% perf-profile.children.cycles-pp.rcu_do_batch 0.01 ±223% +0.3 0.29 ± 26% perf-profile.children.cycles-pp.kobject_add 0.00 +0.3 0.29 ± 25% perf-profile.children.cycles-pp.kobject_add_internal 0.01 ±223% +0.3 0.32 ± 17% perf-profile.children.cycles-pp.disk_release 0.01 ±223% +0.3 0.32 ± 17% perf-profile.children.cycles-pp.blk_release_queue 0.01 ±223% +0.3 0.33 ± 17% perf-profile.children.cycles-pp.device_release 0.01 ±223% +0.3 0.35 ± 16% perf-profile.children.cycles-pp.kobject_release 0.28 ± 22% +0.4 0.65 ± 8% perf-profile.children.cycles-pp.mnt_get_count 0.14 ± 26% +0.4 0.50 ± 18% perf-profile.children.cycles-pp.filename_lookup 0.30 ± 15% +0.4 0.68 ± 13% perf-profile.children.cycles-pp.walk_component 0.00 +0.4 0.41 ± 32% perf-profile.children.cycles-pp.kernfs_add_one 0.60 ± 12% +0.4 1.05 ± 13% perf-profile.children.cycles-pp.openat64 0.21 ± 15% +0.5 0.71 ± 11% perf-profile.children.cycles-pp.__dentry_kill 0.22 ± 17% +0.5 0.73 ± 15% perf-profile.children.cycles-pp.link_path_walk 0.96 ± 10% +0.6 1.51 ± 6% perf-profile.children.cycles-pp.io_serial_out 0.02 ±143% +0.6 0.60 ± 19% perf-profile.children.cycles-pp.path_init 0.32 ± 16% +0.6 0.96 ± 9% perf-profile.children.cycles-pp.dput 0.00 +0.6 0.64 ± 25% perf-profile.children.cycles-pp.inode_sb_list_add 0.04 ± 72% +0.7 0.70 ±130% perf-profile.children.cycles-pp.debugfs_create_dir 0.00 +0.7 0.68 ± 13% perf-profile.children.cycles-pp.blk_mq_unregister_hctx 0.68 ± 12% +0.7 1.38 ± 15% perf-profile.children.cycles-pp.unit_file_find_dropin_paths 0.01 ±223% +0.7 0.71 ± 13% perf-profile.children.cycles-pp.blk_mq_unregister_dev 0.00 +0.7 0.74 ±147% perf-profile.children.cycles-pp.simple_release_fs 0.00 +0.8 0.77 ± 14% perf-profile.children.cycles-pp.kernfs_remove 0.13 ± 9% +0.8 0.91 ± 18% perf-profile.children.cycles-pp.new_inode 0.12 ± 10% +0.8 0.91 ± 18% perf-profile.children.cycles-pp.debugfs_get_inode 0.01 ±223% +0.8 0.80 ± 13% perf-profile.children.cycles-pp.blk_unregister_queue 0.01 ±223% +0.8 0.82 ± 14% perf-profile.children.cycles-pp.kobject_del 0.01 ±223% +0.8 0.84 ± 13% perf-profile.children.cycles-pp.__kobject_del 0.05 ± 47% +1.0 1.03 ± 12% perf-profile.children.cycles-pp.del_gendisk 0.38 ± 12% +1.0 1.37 ± 15% perf-profile.children.cycles-pp.path_lookupat 9.05 ± 5% +1.4 10.46 ± 6% perf-profile.children.cycles-pp.io_serial_in 11.41 ± 6% +1.4 12.83 ± 6% perf-profile.children.cycles-pp.uart_console_write 11.87 ± 6% +1.5 13.40 ± 6% perf-profile.children.cycles-pp.serial8250_console_write 12.97 ± 7% +1.6 14.54 ± 6% perf-profile.children.cycles-pp.console_unlock 0.00 +1.8 1.80 ±141% perf-profile.children.cycles-pp.simple_pin_fs 0.20 ± 9% +2.1 2.28 ±111% perf-profile.children.cycles-pp.start_creating 0.30 ± 11% +2.3 2.64 ± 60% perf-profile.children.cycles-pp.__debugfs_create_file 0.30 ± 11% +2.3 2.64 ± 60% perf-profile.children.cycles-pp.debugfs_create_files 0.34 ± 8% +2.8 3.15 ± 73% perf-profile.children.cycles-pp.blk_mq_debugfs_register_hctx 0.35 ± 9% +2.9 3.23 ± 71% perf-profile.children.cycles-pp.blk_mq_debugfs_register 0.41 ± 7% +3.4 3.78 ± 65% perf-profile.children.cycles-pp.blk_register_queue 0.44 ± 5% +3.6 4.02 ± 62% perf-profile.children.cycles-pp.__device_add_disk 2.28 ± 8% +3.7 5.93 ± 49% perf-profile.children.cycles-pp.blkdev_open 2.28 ± 8% +3.7 5.93 ± 49% perf-profile.children.cycles-pp.blkdev_get_by_dev 2.30 ± 8% +3.7 5.96 ± 49% perf-profile.children.cycles-pp.do_dentry_open 2.30 ± 8% +3.7 5.97 ± 49% perf-profile.children.cycles-pp.do_open 0.55 ± 6% +3.7 4.24 ± 58% perf-profile.children.cycles-pp.loop_add 0.10 ± 73% +4.2 4.33 ± 35% perf-profile.children.cycles-pp.osq_lock 2.97 ± 7% +4.7 7.65 ± 37% perf-profile.children.cycles-pp.path_openat 2.98 ± 7% +4.7 7.66 ± 37% perf-profile.children.cycles-pp.do_filp_open 3.17 ± 6% +4.7 7.86 ± 36% perf-profile.children.cycles-pp.do_sys_open 3.16 ± 6% +4.7 7.85 ± 36% perf-profile.children.cycles-pp.do_sys_openat2 0.30 ± 21% +6.6 6.89 ± 13% perf-profile.children.cycles-pp.mntput_no_expire 0.64 ± 17% +7.8 8.42 ± 13% perf-profile.children.cycles-pp.blk_mq_debugfs_unregister_hctx 0.64 ± 17% +7.8 8.42 ± 13% perf-profile.children.cycles-pp.blk_mq_exit_queue 0.66 ± 18% +7.9 8.54 ± 13% perf-profile.children.cycles-pp.blk_cleanup_disk 0.66 ± 18% +7.9 8.54 ± 13% perf-profile.children.cycles-pp.blk_cleanup_queue 0.68 ± 18% +8.1 8.81 ± 12% perf-profile.children.cycles-pp.simple_recursive_removal 0.68 ± 19% +8.1 8.81 ± 12% perf-profile.children.cycles-pp.debugfs_remove 0.78 ± 16% +9.3 10.04 ± 11% perf-profile.children.cycles-pp.loop_remove 0.00 +9.3 9.27 ± 36% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.56 ± 12% +9.6 10.14 ± 33% perf-profile.children.cycles-pp._raw_spin_lock 19.85 ± 6% +11.5 31.37 ± 10% perf-profile.children.cycles-pp.__x64_sys_ioctl 1.46 ± 9% +13.0 14.51 ± 23% perf-profile.children.cycles-pp.loop_control_ioctl 26.59 ± 5% +15.1 41.71 ± 6% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 26.56 ± 5% +15.1 41.69 ± 6% perf-profile.children.cycles-pp.do_syscall_64 39.12 ± 7% -6.8 32.29 ± 8% perf-profile.self.cycles-pp.intel_idle 2.25 ± 9% -1.3 0.95 ± 14% perf-profile.self.cycles-pp.ktime_get 2.78 ± 6% -1.3 1.52 ± 15% perf-profile.self.cycles-pp.vprintk_emit 0.87 ± 16% -0.8 0.06 ± 70% perf-profile.self.cycles-pp.timekeeping_max_deferment 1.48 ± 11% -0.7 0.74 ± 3% perf-profile.self.cycles-pp.cpuidle_enter_state 1.29 ± 19% -0.7 0.62 ± 19% perf-profile.self.cycles-pp.menu_select 1.82 ± 16% -0.4 1.41 ± 15% perf-profile.self.cycles-pp.delay_tsc 0.66 ± 10% -0.3 0.31 ± 8% perf-profile.self.cycles-pp.lapic_next_deadline 0.58 ± 8% -0.3 0.30 ± 18% perf-profile.self.cycles-pp.native_irq_return_iret 0.45 ± 14% -0.2 0.22 ± 12% perf-profile.self.cycles-pp.read_tsc 0.33 ± 11% -0.2 0.12 ± 16% perf-profile.self.cycles-pp.rcu_sched_clock_irq 0.41 ± 16% -0.2 0.20 ± 4% perf-profile.self.cycles-pp.native_sched_clock 0.37 ± 11% -0.2 0.17 ± 35% perf-profile.self.cycles-pp.ktime_get_update_offsets_now 0.34 ± 14% -0.2 0.15 ± 14% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.39 ± 16% -0.2 0.22 ± 33% perf-profile.self.cycles-pp.update_process_times 0.19 ± 6% -0.1 0.07 ± 15% perf-profile.self.cycles-pp.irqtime_account_irq 0.22 ± 21% -0.1 0.11 ± 13% perf-profile.self.cycles-pp.__intel_pmu_enable_all 0.42 ± 15% -0.1 0.31 ± 11% perf-profile.self.cycles-pp.poll_idle 0.18 ± 15% -0.1 0.07 ± 13% perf-profile.self.cycles-pp.__hrtimer_next_event_base 0.24 ± 14% -0.1 0.13 ± 22% perf-profile.self.cycles-pp.do_idle 0.20 ± 11% -0.1 0.10 ± 17% perf-profile.self.cycles-pp._raw_spin_trylock 0.19 ± 7% -0.1 0.10 ± 33% perf-profile.self.cycles-pp.arch_scale_freq_tick 0.12 ± 16% -0.1 0.04 ± 88% perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt 0.15 ± 14% -0.1 0.08 ± 21% perf-profile.self.cycles-pp.update_irq_load_avg 0.13 ± 17% -0.1 0.07 ± 18% perf-profile.self.cycles-pp.hrtimer_interrupt 0.10 ± 11% -0.1 0.04 ± 68% perf-profile.self.cycles-pp.__softirqentry_text_start 0.10 ± 13% -0.1 0.05 ± 65% perf-profile.self.cycles-pp.trigger_load_balance 0.09 ± 21% +0.0 0.12 ± 14% perf-profile.self.cycles-pp.kmem_cache_alloc 0.02 ± 99% +0.0 0.07 ± 15% perf-profile.self.cycles-pp.mutex_unlock 0.08 ± 21% +0.1 0.14 ± 11% perf-profile.self.cycles-pp.cpumask_next 0.06 ± 18% +0.1 0.12 ± 11% perf-profile.self.cycles-pp.memset_erms 0.04 ± 74% +0.1 0.11 ± 17% perf-profile.self.cycles-pp.___d_drop 0.02 ±141% +0.1 0.08 ± 10% perf-profile.self.cycles-pp.__list_del_entry_valid 0.15 ± 18% +0.1 0.21 ± 13% perf-profile.self.cycles-pp._find_next_bit 0.00 +0.1 0.07 ± 22% perf-profile.self.cycles-pp.lookup_mnt 0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.up_write 0.00 +0.1 0.07 ± 9% perf-profile.self.cycles-pp.__list_add_valid 0.00 +0.1 0.07 ± 6% perf-profile.self.cycles-pp.rcu_cblist_dequeue 0.02 ±141% +0.1 0.10 ± 21% perf-profile.self.cycles-pp.__slab_free 0.00 +0.1 0.08 ± 22% perf-profile.self.cycles-pp.__destroy_inode 0.00 +0.1 0.09 ± 8% perf-profile.self.cycles-pp.remove_one 0.01 ±223% +0.1 0.10 ± 16% perf-profile.self.cycles-pp.mutex_lock 0.00 +0.1 0.09 ± 21% perf-profile.self.cycles-pp.__srcu_read_lock 0.00 +0.1 0.10 ± 17% perf-profile.self.cycles-pp.__mutex_lock 0.00 +0.1 0.13 ± 14% perf-profile.self.cycles-pp.lockref_put_or_lock 0.02 ±141% +0.2 0.18 ± 12% perf-profile.self.cycles-pp.down_write 0.00 +0.2 0.19 ± 10% perf-profile.self.cycles-pp.mntput_no_expire 0.15 ± 27% +0.3 0.43 ± 10% perf-profile.self.cycles-pp.mnt_get_count 0.54 ± 12% +0.3 0.88 ± 9% perf-profile.self.cycles-pp._raw_spin_lock 0.02 ±144% +0.5 0.54 ± 19% perf-profile.self.cycles-pp.path_init 0.96 ± 10% +0.6 1.51 ± 6% perf-profile.self.cycles-pp.io_serial_out 9.05 ± 5% +1.4 10.46 ± 6% perf-profile.self.cycles-pp.io_serial_in 0.10 ± 73% +4.2 4.30 ± 36% perf-profile.self.cycles-pp.osq_lock 0.00 +9.2 9.20 ± 35% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath stress-ng.time.system_time 180 +---------------------------------------------------------------------+ | O | 160 |-+ O O O OO | 140 |-O O O O O O O O OO O O | | O O O O O O O O | 120 |-+ O | | | 100 |-+ | | | 80 |-+ | 60 |-+ | | | 40 |.+.++.+.+.+.++.+.+.+.++.+.+.+.++.+.+.++.+.+.+.++.+.+.+.++.+.+.+. +.+.| | + | 20 +---------------------------------------------------------------------+ stress-ng.time.percent_of_cpu_this_job_got 300 +---------------------------------------------------------------------+ | | | O | 250 |-+ O O OO | | O O O O O O O O O OO O O | | O O O O O O O O | 200 |-+ O | | | 150 |-+ | | | | | 100 |-+ | | | |.+.++.+.+.+.++.+.+.+.++.+.+.+.++.+.+.++.+.+.+.++. .+.++.+.+.+. +.+.| 50 +---------------------------------------------------------------------+ stress-ng.time.voluntary_context_switches 160000 +------------------------------------------------------------------+ | O O | 140000 |-+O O O O O O O OO O OO O O OO O O OO O OO | 120000 |-+ O O | | | 100000 |-+ | | | 80000 |-+ | | | 60000 |-+ | 40000 |-+ | | | 20000 |.++.+.+.++.+.++.+.+.++.+.++.+.+.++.+.+.++.+.++.+.+.++.+.++.+.+.++.| | | 0 +------------------------------------------------------------------+ stress-ng.time.involuntary_context_switches 7500 +--------------------------------------------------------------------+ | O | 7000 |-+ | | O O O O OO O O O O O | 6500 |-+ OO O O O O O O O O O OO | | O O | 6000 |-+ | | | 5500 |-+ | | | 5000 |.+ | | +. .+. +. +. + | 4500 |-+ ++.+.+. +. .+.++.+.+.+.++.+ + +.+.+ +.+.+.++.+.+.+ + .+.++.+.| | + + + | 4000 +--------------------------------------------------------------------+ stress-ng.loop.ops 5500 +--------------------------------------------------------------------+ | O | 5000 |-O OO O O O O OO O O O O O OO O OO O O O | 4500 |-+ O O O O | | | 4000 |-+ | | | 3500 |-+ | | | 3000 |-+ | 2500 |-+ | | | 2000 |.+.++.+.+.++. .+.++.+.+.+. +.+.+. +.+.+.++.+.+.+. +.+.+.++.+.+.+ .+.| | + + + + + | 1500 +--------------------------------------------------------------------+ stress-ng.loop.ops_per_sec 90 +----------------------------------------------------------------------+ | O | 80 |-+ OO O O O O OO O O O O O O O O O | | O O OO O O O O O | | | 70 |-+ | | | 60 |-+ | | | 50 |-+ | | | | | 40 |-+ | |.+.+ .+.+.+. +.+. +. .+.+.+. +.+.+. .+.++. .+ .+.+. .+. .| 30 +----------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. --- 0DAY/LKP+ Test Infrastructure Open Source Technology Center https://lists.01.org/hyperkitty/list/lkp@lists.01.org Intel Corporation Thanks, Oliver Sang