* [LKP] [locking/rwsem] b3fd4f03ca0: -11.1% vm-scalability.throughput
@ 2015-03-13 5:36 ` Huang Ying
0 siblings, 0 replies; 4+ messages in thread
From: Huang Ying @ 2015-03-13 5:36 UTC (permalink / raw)
To: LKP; +Cc: LKML, LKP ML
[-- Attachment #1: Type: text/plain, Size: 47441 bytes --]
FYI, we noticed the below changes on
git://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git master
commit b3fd4f03ca0b9952221f39ae6790e698bf4b39e7 ("locking/rwsem: Avoid deceiving lock spinners")
testbox/testcase/testparams: brickland3/vm-scalability/performance-300s-small-allocs
7a215f89a0335582 b3fd4f03ca0b9952221f39ae67
---------------- --------------------------
%stddev %change %stddev
\ | \
2.38 ± 18% +247.4% 8.27 ± 16% vm-scalability.stddev
24226456 ± 0% -23.0% 18650874 ± 1% vm-scalability.time.voluntary_context_switches
1622 ± 0% -15.6% 1369 ± 1% vm-scalability.time.system_time
765 ± 0% -13.1% 665 ± 1% vm-scalability.time.percent_of_cpu_this_job_got
1036 ± 0% -11.9% 914 ± 1% vm-scalability.time.user_time
7.244e+08 ± 0% -11.1% 6.439e+08 ± 1% vm-scalability.time.minor_page_faults
10841276 ± 0% -11.1% 9639981 ± 1% vm-scalability.throughput
8922883 ± 3% -70.2% 2658543 ± 4% cpuidle.C1-IVT-4S.usage
1.19e+10 ± 2% -66.2% 4.016e+09 ± 4% cpuidle.C1-IVT-4S.time
1.97 ± 4% +106.7% 4.08 ± 6% perf-profile.cpu-cycles.intel_idle.cpuidle_enter_state.cpuidle_enter.cpu_startup_entry.start_secondary
58.29 ± 1% -50.2% 29.03 ± 2% turbostat.CPU%c1
34.84 ± 2% +86.6% 65.01 ± 1% turbostat.CPU%c6
170814 ± 7% -39.9% 102682 ± 11% sched_debug.cpu#21.sched_goidle
367762 ± 11% -39.9% 220850 ± 10% sched_debug.cpu#26.sched_count
5.12 ± 2% -39.8% 3.08 ± 5% perf-profile.cpu-cycles.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
342453 ± 7% -39.9% 205985 ± 11% sched_debug.cpu#21.nr_switches
3.14 ± 2% +68.0% 5.28 ± 5% perf-profile.cpu-cycles.cpuidle_enter_state.cpuidle_enter.cpu_startup_entry.start_secondary
170317 ± 6% -39.9% 102389 ± 11% sched_debug.cpu#22.sched_goidle
168710 ± 6% -38.4% 103876 ± 11% sched_debug.cpu#23.sched_goidle
341400 ± 6% -39.8% 205416 ± 11% sched_debug.cpu#22.nr_switches
338590 ± 6% -38.5% 208381 ± 11% sched_debug.cpu#23.nr_switches
165879 ± 4% -36.6% 105178 ± 10% sched_debug.cpu#18.sched_goidle
168958 ± 6% -39.0% 103043 ± 11% sched_debug.cpu#20.sched_goidle
359148 ± 5% -39.2% 218455 ± 11% sched_debug.cpu#20.sched_count
332511 ± 4% -36.5% 211029 ± 10% sched_debug.cpu#18.nr_switches
338875 ± 6% -39.0% 206782 ± 11% sched_debug.cpu#20.nr_switches
359968 ± 6% -39.4% 218057 ± 12% sched_debug.cpu#21.sched_count
166207 ± 4% -38.5% 102168 ± 11% sched_debug.cpu#27.sched_goidle
164881 ± 6% -37.0% 103846 ± 11% sched_debug.cpu#25.sched_goidle
330721 ± 6% -37.0% 208344 ± 11% sched_debug.cpu#25.nr_switches
333161 ± 4% -38.3% 205591 ± 11% sched_debug.cpu#27.nr_switches
362674 ± 7% -40.1% 217123 ± 10% sched_debug.cpu#22.sched_count
350433 ± 7% -37.3% 219595 ± 13% sched_debug.cpu#15.nr_switches
174599 ± 7% -37.4% 109366 ± 13% sched_debug.cpu#15.sched_goidle
174038 ± 9% -36.8% 109941 ± 12% sched_debug.cpu#17.sched_goidle
348896 ± 9% -36.7% 220793 ± 12% sched_debug.cpu#17.nr_switches
327443 ± 6% -36.8% 207015 ± 11% sched_debug.cpu#24.nr_switches
348687 ± 5% -37.2% 219100 ± 11% sched_debug.cpu#27.sched_count
163220 ± 6% -36.9% 103066 ± 11% sched_debug.cpu#24.sched_goidle
167997 ± 5% -35.7% 108017 ± 11% sched_debug.cpu#16.sched_goidle
365757 ± 10% -38.9% 223561 ± 12% sched_debug.cpu#28.sched_count
336756 ± 5% -35.6% 216751 ± 11% sched_debug.cpu#16.nr_switches
174236 ± 12% -40.6% 103542 ± 10% sched_debug.cpu#26.sched_goidle
349494 ± 12% -40.6% 207718 ± 10% sched_debug.cpu#26.nr_switches
175130 ± 10% -39.7% 105573 ± 13% sched_debug.cpu#28.sched_goidle
351090 ± 10% -39.6% 212090 ± 13% sched_debug.cpu#28.nr_switches
350972 ± 5% -35.2% 227402 ± 10% sched_debug.cpu#19.sched_count
343794 ± 5% -36.2% 219297 ± 10% sched_debug.cpu#24.sched_count
347268 ± 5% -36.3% 221228 ± 10% sched_debug.cpu#25.sched_count
352999 ± 5% -34.1% 232554 ± 9% sched_debug.cpu#16.sched_count
354362 ± 7% -37.0% 223292 ± 10% sched_debug.cpu#23.sched_count
166091 ± 7% -36.6% 105356 ± 14% sched_debug.cpu#29.sched_goidle
350840 ± 6% -35.5% 226331 ± 13% sched_debug.cpu#29.sched_count
332928 ± 7% -36.4% 211785 ± 14% sched_debug.cpu#29.nr_switches
369396 ± 7% -36.4% 234822 ± 13% sched_debug.cpu#15.sched_count
364063 ± 9% -34.6% 238151 ± 11% sched_debug.cpu#17.sched_count
349193 ± 4% -35.2% 226315 ± 9% sched_debug.cpu#18.sched_count
3.94 ± 1% +49.9% 5.90 ± 5% perf-profile.cpu-cycles.cpuidle_enter.cpu_startup_entry.start_secondary
5361900 ± 1% +50.5% 8067121 ± 0% cpuidle.C6-IVT-4S.usage
166471 ± 5% -36.3% 106063 ± 10% sched_debug.cpu#19.sched_goidle
334078 ± 5% -36.3% 212767 ± 10% sched_debug.cpu#19.nr_switches
511523 ± 11% +40.1% 716466 ± 9% sched_debug.cpu#38.avg_idle
5141 ± 10% -21.3% 4046 ± 18% sched_debug.cfs_rq[16]:/.avg->runnable_avg_sum
185324 ± 6% -28.9% 131826 ± 11% sched_debug.cpu#43.ttwu_count
111 ± 10% -21.6% 87 ± 18% sched_debug.cfs_rq[16]:/.tg_runnable_contrib
188387 ± 5% -28.4% 134976 ± 11% sched_debug.cpu#35.ttwu_count
182306 ± 7% -28.0% 131276 ± 9% sched_debug.cpu#19.ttwu_count
181618 ± 5% -28.6% 129685 ± 10% sched_debug.cpu#18.ttwu_count
370815 ± 7% -25.5% 276125 ± 11% sched_debug.cpu#38.sched_count
178281 ± 7% -25.9% 132044 ± 11% sched_debug.cpu#38.sched_goidle
181914 ± 5% -28.0% 130970 ± 8% sched_debug.cpu#16.ttwu_count
357347 ± 7% -25.9% 264826 ± 11% sched_debug.cpu#38.nr_switches
546593 ± 7% +38.6% 757389 ± 4% sched_debug.cpu#27.avg_idle
183057 ± 5% -27.7% 132439 ± 8% sched_debug.cpu#17.ttwu_count
174289 ± 8% -25.5% 129871 ± 13% sched_debug.cpu#43.sched_goidle
349323 ± 8% -25.4% 260438 ± 13% sched_debug.cpu#43.nr_switches
187088 ± 5% -27.4% 135758 ± 10% sched_debug.cpu#36.ttwu_count
190589 ± 5% -29.1% 135135 ± 12% sched_debug.cpu#33.ttwu_count
179655 ± 10% -28.6% 128343 ± 13% sched_debug.cpu#44.sched_goidle
367566 ± 11% -26.0% 271924 ± 14% sched_debug.cpu#43.sched_count
360119 ± 10% -28.5% 257380 ± 13% sched_debug.cpu#44.nr_switches
177427 ± 5% -25.5% 132241 ± 9% sched_debug.cpu#20.ttwu_count
187477 ± 6% -28.9% 133263 ± 11% sched_debug.cpu#39.ttwu_count
187313 ± 5% -28.7% 133487 ± 11% sched_debug.cpu#41.ttwu_count
192203 ± 4% -28.3% 137818 ± 10% sched_debug.cpu#31.ttwu_count
183679 ± 5% -28.1% 132147 ± 10% sched_debug.cpu#44.ttwu_count
367665 ± 9% -24.6% 277237 ± 15% sched_debug.cpu#42.sched_count
178211 ± 3% -26.9% 130348 ± 8% sched_debug.cpu#23.ttwu_count
175478 ± 4% -25.6% 130478 ± 9% sched_debug.cpu#22.ttwu_count
186974 ± 6% -27.6% 135310 ± 10% sched_debug.cpu#38.ttwu_count
190431 ± 4% -28.0% 137033 ± 11% sched_debug.cpu#32.ttwu_count
190722 ± 4% -28.4% 136639 ± 10% sched_debug.cpu#34.ttwu_count
175431 ± 8% -25.3% 131079 ± 12% sched_debug.cpu#42.sched_goidle
361690 ± 8% -24.8% 272015 ± 13% sched_debug.cpu#39.sched_count
351619 ± 8% -25.2% 262838 ± 12% sched_debug.cpu#42.nr_switches
175056 ± 6% -24.8% 131564 ± 12% sched_debug.cpu#40.sched_goidle
350873 ± 6% -24.8% 263820 ± 12% sched_debug.cpu#40.nr_switches
173107 ± 6% -25.3% 129289 ± 13% sched_debug.cpu#37.sched_goidle
346966 ± 6% -25.3% 259257 ± 13% sched_debug.cpu#37.nr_switches
171359 ± 7% -24.8% 128941 ± 11% sched_debug.cpu#39.sched_goidle
343474 ± 7% -24.7% 258590 ± 11% sched_debug.cpu#39.nr_switches
375852 ± 12% -28.4% 269206 ± 15% sched_debug.cpu#44.sched_count
180303 ± 8% -25.0% 135309 ± 10% sched_debug.cpu#30.sched_goidle
177803 ± 5% -25.3% 132893 ± 9% sched_debug.cpu#21.ttwu_count
361386 ± 8% -24.9% 271330 ± 10% sched_debug.cpu#30.nr_switches
172414 ± 7% -24.9% 129400 ± 13% sched_debug.cpu#41.sched_goidle
345579 ± 7% -24.9% 259489 ± 13% sched_debug.cpu#41.nr_switches
373591 ± 8% -25.3% 279094 ± 13% sched_debug.cpu#31.sched_count
177533 ± 9% -26.9% 129812 ± 12% sched_debug.cpu#36.sched_goidle
179094 ± 8% -26.3% 131936 ± 11% sched_debug.cpu#35.sched_goidle
376042 ± 8% -26.7% 275458 ± 12% sched_debug.cpu#35.sched_count
355841 ± 9% -26.8% 260341 ± 12% sched_debug.cpu#36.nr_switches
183165 ± 12% -29.4% 129301 ± 13% sched_debug.cpu#33.sched_goidle
371977 ± 9% -27.3% 270521 ± 13% sched_debug.cpu#36.sched_count
184524 ± 5% -27.3% 134078 ± 10% sched_debug.cpu#42.ttwu_count
204591 ± 7% -22.5% 158606 ± 16% sched_debug.cfs_rq[33]:/.min_vruntime
358950 ± 8% -26.3% 264608 ± 11% sched_debug.cpu#35.nr_switches
367143 ± 12% -29.4% 259297 ± 13% sched_debug.cpu#33.nr_switches
184796 ± 5% -26.7% 135370 ± 8% sched_debug.cpu#15.ttwu_count
560186 ± 7% +36.4% 764034 ± 4% sched_debug.cpu#15.avg_idle
192024 ± 5% -27.6% 138984 ± 9% sched_debug.cpu#30.ttwu_count
186661 ± 5% -27.9% 134534 ± 11% sched_debug.cpu#40.ttwu_count
175890 ± 4% -26.4% 129452 ± 8% sched_debug.cpu#26.ttwu_count
366664 ± 8% -24.7% 276276 ± 14% sched_debug.cpu#34.sched_count
186046 ± 5% -26.7% 136338 ± 10% sched_debug.cpu#37.ttwu_count
173138 ± 4% -26.5% 127219 ± 8% sched_debug.cpu#28.ttwu_count
231881 ± 4% -26.0% 171683 ± 6% sched_debug.cpu#48.ttwu_count
229108 ± 4% -24.5% 173024 ± 5% sched_debug.cpu#47.ttwu_count
545213 ± 6% +30.6% 712076 ± 3% sched_debug.cpu#39.avg_idle
175780 ± 8% -25.0% 131911 ± 12% sched_debug.cpu#34.sched_goidle
352325 ± 8% -24.9% 264519 ± 12% sched_debug.cpu#34.nr_switches
368764 ± 7% -25.9% 273326 ± 13% sched_debug.cpu#40.sched_count
178369 ± 7% -25.3% 133316 ± 12% sched_debug.cpu#31.sched_goidle
357523 ± 7% -25.2% 267329 ± 12% sched_debug.cpu#31.nr_switches
445168 ± 6% -21.5% 349498 ± 7% sched_debug.cpu#50.sched_count
178502 ± 3% -27.0% 130326 ± 8% sched_debug.cpu#24.ttwu_count
232438 ± 4% -25.2% 173912 ± 4% sched_debug.cpu#45.ttwu_count
214980 ± 6% -21.3% 169213 ± 7% sched_debug.cpu#50.sched_goidle
430801 ± 6% -21.3% 339213 ± 7% sched_debug.cpu#50.nr_switches
175354 ± 7% -25.0% 131440 ± 12% sched_debug.cpu#32.sched_goidle
351473 ± 7% -25.0% 263573 ± 12% sched_debug.cpu#32.nr_switches
175818 ± 4% -25.5% 131027 ± 9% sched_debug.cpu#25.ttwu_count
562351 ± 4% +33.0% 747969 ± 7% sched_debug.cpu#17.avg_idle
226274 ± 5% -24.6% 170581 ± 5% sched_debug.cpu#54.ttwu_count
566741 ± 5% +33.2% 754744 ± 4% sched_debug.cpu#29.avg_idle
365692 ± 8% -24.7% 275497 ± 14% sched_debug.cpu#32.sched_count
443973 ± 6% -22.1% 345964 ± 7% sched_debug.cpu#51.sched_count
360816 ± 8% -25.3% 269548 ± 14% sched_debug.cpu#41.sched_count
224711 ± 4% -24.6% 169414 ± 6% sched_debug.cpu#53.ttwu_count
380979 ± 13% -28.9% 270783 ± 14% sched_debug.cpu#33.sched_count
174502 ± 4% -27.0% 127311 ± 8% sched_debug.cpu#29.ttwu_count
573889 ± 4% +32.2% 758635 ± 5% sched_debug.cpu#24.avg_idle
523204 ± 10% +29.1% 675536 ± 9% sched_debug.cpu#6.avg_idle
173555 ± 4% -25.7% 128988 ± 8% sched_debug.cpu#27.ttwu_count
228859 ± 4% -25.2% 171229 ± 6% sched_debug.cpu#49.ttwu_count
529356 ± 9% +32.4% 700872 ± 6% sched_debug.cpu#33.avg_idle
565916 ± 5% +33.4% 755047 ± 7% sched_debug.cpu#23.avg_idle
232257 ± 3% -25.1% 173926 ± 5% sched_debug.cpu#46.ttwu_count
227954 ± 4% -24.3% 172631 ± 5% sched_debug.cpu#52.ttwu_count
197241 ± 5% -23.5% 150963 ± 8% sched_debug.cpu#4.ttwu_count
228392 ± 3% -24.8% 171779 ± 6% sched_debug.cpu#51.ttwu_count
542129 ± 5% +28.0% 693751 ± 6% sched_debug.cpu#13.avg_idle
364245 ± 8% -25.1% 272652 ± 15% sched_debug.cpu#37.sched_count
558275 ± 8% +36.1% 759570 ± 6% sched_debug.cpu#26.avg_idle
225027 ± 5% -24.7% 169427 ± 6% sched_debug.cpu#57.ttwu_count
17.06 ± 1% -23.0% 13.13 ± 3% perf-profile.cpu-cycles.call_rwsem_down_write_failed.vma_link.mmap_region.do_mmap_pgoff.vm_mmap_pgoff
197493 ± 5% -22.8% 152503 ± 8% sched_debug.cpu#2.ttwu_count
16.99 ± 1% -23.2% 13.05 ± 3% perf-profile.cpu-cycles.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region.do_mmap_pgoff
223164 ± 4% -24.7% 168105 ± 6% sched_debug.cpu#59.ttwu_count
223884 ± 4% -24.6% 168887 ± 4% sched_debug.cpu#58.ttwu_count
538073 ± 6% +27.8% 687436 ± 8% sched_debug.cpu#43.avg_idle
445916 ± 7% -22.4% 345938 ± 6% sched_debug.cpu#52.sched_count
214967 ± 6% -21.9% 167898 ± 6% sched_debug.cpu#52.sched_goidle
534156 ± 9% +25.2% 668876 ± 5% sched_debug.cpu#11.avg_idle
430800 ± 6% -21.9% 336561 ± 6% sched_debug.cpu#52.nr_switches
117 ± 8% -21.7% 91 ± 5% sched_debug.cfs_rq[36]:/.tg_runnable_contrib
224801 ± 4% -24.0% 170764 ± 5% sched_debug.cpu#55.ttwu_count
225103 ± 4% -24.9% 168953 ± 5% sched_debug.cpu#56.ttwu_count
24226456 ± 0% -23.0% 18650874 ± 1% time.voluntary_context_switches
5411 ± 8% -21.3% 4256 ± 4% sched_debug.cfs_rq[36]:/.avg->runnable_avg_sum
212964 ± 5% -21.5% 167092 ± 6% sched_debug.cpu#51.sched_goidle
426769 ± 5% -21.5% 334967 ± 6% sched_debug.cpu#51.nr_switches
519159 ± 4% +27.0% 659572 ± 7% sched_debug.cpu#52.avg_idle
193464 ± 4% -22.1% 150665 ± 7% sched_debug.cpu#7.ttwu_count
226747 ± 4% -24.4% 171347 ± 6% sched_debug.cpu#50.ttwu_count
572755 ± 6% +29.0% 738639 ± 4% sched_debug.cpu#25.avg_idle
520910 ± 7% +35.0% 703382 ± 6% sched_debug.cpu#32.avg_idle
2.696e+10 ± 1% +29.0% 3.478e+10 ± 0% cpuidle.C6-IVT-4S.time
530311 ± 12% +31.1% 695099 ± 5% sched_debug.cpu#44.avg_idle
204543 ± 8% -20.5% 162661 ± 15% sched_debug.cfs_rq[31]:/.min_vruntime
484242 ± 9% +31.7% 637669 ± 8% sched_debug.cpu#47.avg_idle
6.85 ± 1% -22.4% 5.32 ± 3% perf-profile.cpu-cycles.rwsem_spin_on_owner.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
528770 ± 7% +31.6% 695818 ± 6% sched_debug.cpu#40.avg_idle
223475 ± 4% -20.9% 176718 ± 6% sched_debug.cfs_rq[52]:/.min_vruntime
577331 ± 4% +29.2% 745806 ± 4% sched_debug.cpu#16.avg_idle
192821 ± 4% -23.4% 147763 ± 8% sched_debug.cpu#10.ttwu_count
198393 ± 4% -23.1% 152635 ± 7% sched_debug.cpu#1.ttwu_count
572991 ± 9% +29.0% 738876 ± 3% sched_debug.cpu#18.avg_idle
531346 ± 5% +26.8% 673808 ± 6% sched_debug.cpu#35.avg_idle
531692 ± 8% +30.0% 691275 ± 7% sched_debug.cpu#36.avg_idle
573689 ± 9% +30.1% 746581 ± 3% sched_debug.cpu#28.avg_idle
194767 ± 3% -22.1% 151736 ± 7% sched_debug.cpu#6.ttwu_count
576252 ± 10% +29.8% 748134 ± 5% sched_debug.cpu#19.avg_idle
189779 ± 5% -22.5% 147019 ± 9% sched_debug.cpu#13.ttwu_count
574093 ± 9% +28.0% 734982 ± 4% sched_debug.cpu#22.avg_idle
530896 ± 7% +25.4% 665864 ± 7% sched_debug.cpu#9.avg_idle
222143 ± 5% -19.0% 179889 ± 9% sched_debug.cfs_rq[49]:/.min_vruntime
190106 ± 5% -22.4% 147518 ± 7% sched_debug.cpu#14.ttwu_count
192933 ± 3% -21.8% 150835 ± 8% sched_debug.cpu#8.ttwu_count
193656 ± 4% -22.7% 149678 ± 8% sched_debug.cpu#9.ttwu_count
196739 ± 5% -22.9% 151747 ± 7% sched_debug.cpu#3.ttwu_count
434909 ± 6% -18.4% 354789 ± 6% sched_debug.cpu#55.sched_count
194722 ± 4% -22.0% 151895 ± 8% sched_debug.cpu#5.ttwu_count
439285 ± 7% -19.7% 352534 ± 6% sched_debug.cpu#47.sched_count
585003 ± 7% +31.4% 768551 ± 5% sched_debug.cpu#20.avg_idle
432219 ± 7% -19.5% 347734 ± 7% sched_debug.cpu#48.sched_count
224113 ± 5% -18.9% 181798 ± 8% sched_debug.cfs_rq[48]:/.min_vruntime
534566 ± 7% +30.3% 696442 ± 6% sched_debug.cpu#31.avg_idle
525194 ± 6% +23.5% 648587 ± 7% sched_debug.cpu#7.avg_idle
209128 ± 6% -19.4% 168562 ± 7% sched_debug.cpu#48.sched_goidle
419098 ± 6% -19.4% 337908 ± 7% sched_debug.cpu#48.nr_switches
448417 ± 7% -19.8% 359813 ± 6% sched_debug.cpu#46.sched_count
491962 ± 8% +26.7% 623449 ± 4% sched_debug.cpu#48.avg_idle
212354 ± 6% -19.7% 170477 ± 5% sched_debug.cpu#47.sched_goidle
581409 ± 7% +23.6% 718790 ± 4% sched_debug.cpu#37.avg_idle
194066 ± 6% -17.8% 159565 ± 11% sched_debug.cfs_rq[16]:/.min_vruntime
425571 ± 6% -19.7% 341752 ± 5% sched_debug.cpu#47.nr_switches
215882 ± 7% -19.5% 173827 ± 5% sched_debug.cpu#46.sched_goidle
442267 ± 6% -21.4% 347467 ± 6% sched_debug.cpu#59.sched_count
432617 ± 7% -19.5% 348457 ± 5% sched_debug.cpu#46.nr_switches
569496 ± 11% +32.0% 751590 ± 5% sched_debug.cpu#21.avg_idle
189763 ± 5% -22.2% 147705 ± 8% sched_debug.cpu#12.ttwu_count
223064 ± 4% -19.3% 179906 ± 5% sched_debug.cfs_rq[53]:/.min_vruntime
213869 ± 5% -21.0% 168888 ± 5% sched_debug.cpu#59.sched_goidle
428592 ± 5% -21.0% 338537 ± 5% sched_debug.cpu#59.nr_switches
441291 ± 6% -19.8% 353975 ± 5% sched_debug.cpu#45.sched_count
213493 ± 5% -19.5% 171778 ± 5% sched_debug.cpu#45.sched_goidle
427837 ± 5% -19.5% 344360 ± 5% sched_debug.cpu#45.nr_switches
191795 ± 5% -22.6% 148369 ± 8% sched_debug.cpu#11.ttwu_count
194309 ± 6% -19.3% 156815 ± 8% sched_debug.cfs_rq[17]:/.min_vruntime
221301 ± 5% -20.9% 175025 ± 7% sched_debug.cfs_rq[56]:/.min_vruntime
538571 ± 8% +24.4% 670227 ± 8% sched_debug.cpu#3.avg_idle
223672 ± 5% -18.9% 181388 ± 7% sched_debug.cfs_rq[47]:/.min_vruntime
425387 ± 7% -18.3% 347554 ± 7% sched_debug.cpu#54.sched_count
199287 ± 6% -21.7% 156117 ± 12% sched_debug.cfs_rq[15]:/.min_vruntime
1.00 ± 5% -15.8% 0.84 ± 6% perf-profile.cpu-cycles.kmem_cache_alloc_trace.perf_event_mmap.mmap_region.do_mmap_pgoff.vm_mmap_pgoff
385907 ± 8% -23.7% 294552 ± 10% sched_debug.cpu#6.sched_count
493228 ± 5% +27.4% 628579 ± 8% sched_debug.cpu#54.avg_idle
185090 ± 8% -23.0% 142559 ± 10% sched_debug.cpu#6.sched_goidle
542727 ± 8% +27.5% 691759 ± 4% sched_debug.cpu#42.avg_idle
209830 ± 6% -18.0% 172096 ± 6% sched_debug.cpu#55.sched_goidle
370989 ± 8% -23.0% 285813 ± 10% sched_debug.cpu#6.nr_switches
420473 ± 6% -18.0% 344973 ± 6% sched_debug.cpu#55.nr_switches
201389 ± 4% -20.7% 159785 ± 7% sched_debug.cpu#0.ttwu_count
365245 ± 7% -20.1% 291843 ± 9% sched_debug.cpu#5.sched_count
176316 ± 7% -19.7% 141647 ± 9% sched_debug.cpu#5.sched_goidle
353385 ± 7% -19.6% 284000 ± 9% sched_debug.cpu#5.nr_switches
430699 ± 7% -20.6% 341980 ± 7% sched_debug.cpu#53.sched_count
434688 ± 7% -17.9% 356994 ± 7% sched_debug.cpu#58.sched_count
910 ± 11% -15.6% 767 ± 12% sched_debug.cpu#34.ttwu_local
194153 ± 7% -16.9% 161410 ± 5% sched_debug.cfs_rq[19]:/.min_vruntime
435164 ± 10% -20.0% 348238 ± 7% sched_debug.cpu#56.sched_count
25686 ± 0% -18.8% 20849 ± 1% softirqs.HRTIMER
205841 ± 7% -18.6% 167608 ± 6% sched_debug.cpu#54.sched_goidle
412493 ± 7% -18.5% 335995 ± 6% sched_debug.cpu#54.nr_switches
209629 ± 7% -17.5% 172950 ± 7% sched_debug.cpu#58.sched_goidle
420079 ± 7% -17.5% 346715 ± 7% sched_debug.cpu#58.nr_switches
190909 ± 5% -19.3% 154071 ± 8% sched_debug.cfs_rq[26]:/.min_vruntime
535739 ± 10% +25.8% 674192 ± 3% sched_debug.cpu#41.avg_idle
220505 ± 5% -17.2% 182496 ± 10% sched_debug.cfs_rq[57]:/.min_vruntime
207365 ± 6% -19.9% 166054 ± 7% sched_debug.cpu#53.sched_goidle
415569 ± 6% -19.9% 332885 ± 7% sched_debug.cpu#53.nr_switches
433052 ± 7% -19.5% 348641 ± 8% sched_debug.cpu#57.sched_count
534493 ± 4% +25.6% 671066 ± 4% sched_debug.cpu#2.avg_idle
1.02 ± 2% -20.2% 0.81 ± 8% perf-profile.cpu-cycles.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__run_hrtimer
5217 ± 12% -17.6% 4297 ± 9% sched_debug.cfs_rq[26]:/.avg->runnable_avg_sum
209594 ± 6% -19.1% 169509 ± 8% sched_debug.cpu#57.sched_goidle
420012 ± 6% -19.1% 339802 ± 8% sched_debug.cpu#57.nr_switches
503208 ± 10% +25.5% 631683 ± 7% sched_debug.cpu#55.avg_idle
113 ± 12% -17.9% 92 ± 9% sched_debug.cfs_rq[26]:/.tg_runnable_contrib
549109 ± 5% +22.6% 673144 ± 6% sched_debug.cpu#14.avg_idle
210495 ± 9% -19.7% 169109 ± 7% sched_debug.cpu#56.sched_goidle
421839 ± 9% -19.6% 338979 ± 7% sched_debug.cpu#56.nr_switches
221205 ± 4% -17.6% 182374 ± 7% sched_debug.cfs_rq[50]:/.min_vruntime
502758 ± 6% +23.1% 618755 ± 7% sched_debug.cpu#46.avg_idle
222043 ± 4% -18.6% 180727 ± 10% sched_debug.cfs_rq[51]:/.min_vruntime
221617 ± 4% -18.3% 181127 ± 8% sched_debug.cfs_rq[55]:/.min_vruntime
557533 ± 11% +22.2% 681218 ± 7% sched_debug.cpu#12.avg_idle
187238 ± 6% -17.7% 154099 ± 10% sched_debug.cfs_rq[29]:/.min_vruntime
551333 ± 10% +22.2% 673592 ± 7% sched_debug.cpu#34.avg_idle
224579 ± 4% -16.6% 187288 ± 9% sched_debug.cfs_rq[54]:/.min_vruntime
184873 ± 6% -15.9% 155439 ± 8% sched_debug.cfs_rq[28]:/.min_vruntime
206172 ± 6% -18.2% 168730 ± 7% sched_debug.cpu#49.sched_goidle
413179 ± 6% -18.1% 338238 ± 7% sched_debug.cpu#49.nr_switches
225157 ± 5% -16.4% 188227 ± 9% sched_debug.cfs_rq[46]:/.min_vruntime
175150 ± 5% -16.9% 145619 ± 11% sched_debug.cpu#3.sched_goidle
351054 ± 5% -16.8% 291944 ± 11% sched_debug.cpu#3.nr_switches
564018 ± 3% +21.0% 682616 ± 6% sched_debug.cpu#4.avg_idle
5529 ± 8% -18.1% 4527 ± 11% sched_debug.cfs_rq[39]:/.avg->runnable_avg_sum
600812 ± 5% -15.3% 508926 ± 9% numa-vmstat.node2.numa_local
187471 ± 4% -18.5% 152874 ± 10% sched_debug.cfs_rq[22]:/.min_vruntime
19730 ± 6% -13.7% 17025 ± 9% sched_debug.cfs_rq[26]:/.exec_clock
425149 ± 6% -18.2% 347836 ± 7% sched_debug.cpu#49.sched_count
22908 ± 5% -12.9% 19945 ± 5% sched_debug.cfs_rq[58]:/.exec_clock
191793 ± 4% -16.6% 160031 ± 10% sched_debug.cfs_rq[24]:/.min_vruntime
14.49 ± 0% +16.4% 16.87 ± 2% perf-profile.cpu-cycles.start_secondary
514287 ± 10% +19.7% 615733 ± 6% sched_debug.cpu#58.avg_idle
1622 ± 0% -15.6% 1369 ± 1% time.system_time
14.45 ± 0% +16.2% 16.80 ± 2% perf-profile.cpu-cycles.cpu_startup_entry.start_secondary
1117 ± 6% -12.1% 982 ± 3% proc-vmstat.pgmigrate_success
1117 ± 6% -12.1% 982 ± 3% proc-vmstat.numa_pages_migrated
23520 ± 4% -14.0% 20233 ± 6% sched_debug.cfs_rq[48]:/.exec_clock
372296 ± 1% -18.0% 305136 ± 9% sched_debug.cpu#2.sched_count
218377 ± 6% -16.5% 182283 ± 6% sched_debug.cfs_rq[58]:/.min_vruntime
548860 ± 8% +25.4% 688468 ± 6% sched_debug.cpu#8.avg_idle
224066 ± 5% -17.7% 184445 ± 8% sched_debug.cfs_rq[45]:/.min_vruntime
23172 ± 4% -12.9% 20184 ± 5% sched_debug.cfs_rq[52]:/.exec_clock
947362 ± 3% -14.4% 810580 ± 7% numa-numastat.node2.local_node
22992 ± 5% -12.9% 20026 ± 7% sched_debug.cfs_rq[59]:/.exec_clock
23572 ± 4% -12.3% 20668 ± 5% sched_debug.cfs_rq[46]:/.exec_clock
6293 ± 8% -16.0% 5288 ± 8% sched_debug.cfs_rq[47]:/.avg->runnable_avg_sum
23545 ± 4% -13.3% 20402 ± 6% sched_debug.cfs_rq[47]:/.exec_clock
7 ± 0% -14.3% 6 ± 0% vmstat.procs.r
136 ± 8% -16.3% 114 ± 8% sched_debug.cfs_rq[47]:/.tg_runnable_contrib
952018 ± 3% -14.1% 817562 ± 7% numa-numastat.node2.numa_hit
684874 ± 4% -13.1% 595283 ± 7% numa-vmstat.node2.numa_hit
22864 ± 5% -12.7% 19967 ± 5% sched_debug.cfs_rq[57]:/.exec_clock
190734 ± 5% -16.3% 159695 ± 8% sched_debug.cfs_rq[23]:/.min_vruntime
237300 ± 6% -14.9% 202014 ± 7% numa-vmstat.node3.nr_page_table_pages
949123 ± 6% -14.9% 808058 ± 7% numa-meminfo.node3.PageTables
11.45 ± 4% +12.2% 12.84 ± 7% perf-profile.cpu-cycles.task_numa_work.task_work_run.do_notify_resume.retint_signal
561716 ± 7% +22.7% 689210 ± 5% sched_debug.cpu#10.avg_idle
23421 ± 4% -12.5% 20484 ± 5% sched_debug.cfs_rq[45]:/.exec_clock
23090 ± 4% -13.4% 19999 ± 6% sched_debug.cfs_rq[53]:/.exec_clock
2257945 ± 6% -14.5% 1929848 ± 7% numa-meminfo.node3.SUnreclaim
564591 ± 6% -14.5% 482457 ± 7% numa-vmstat.node3.nr_slab_unreclaimable
7903 ± 0% -13.6% 6830 ± 1% sched_debug.cfs_rq[11]:/.tg->runnable_avg
522411 ± 6% +15.9% 605704 ± 4% sched_debug.cpu#59.avg_idle
7899 ± 0% -13.6% 6827 ± 1% sched_debug.cfs_rq[10]:/.tg->runnable_avg
7884 ± 0% -13.6% 6811 ± 1% sched_debug.cfs_rq[2]:/.tg->runnable_avg
7913 ± 0% -13.6% 6839 ± 1% sched_debug.cfs_rq[14]:/.tg->runnable_avg
2272179 ± 6% -14.4% 1944358 ± 7% numa-meminfo.node3.Slab
7896 ± 0% -13.6% 6826 ± 1% sched_debug.cfs_rq[9]:/.tg->runnable_avg
7894 ± 0% -13.6% 6822 ± 1% sched_debug.cfs_rq[8]:/.tg->runnable_avg
7877 ± 0% -13.6% 6802 ± 1% sched_debug.cfs_rq[0]:/.tg->runnable_avg
7890 ± 0% -13.6% 6817 ± 1% sched_debug.cfs_rq[4]:/.tg->runnable_avg
7891 ± 0% -13.6% 6816 ± 1% sched_debug.cfs_rq[5]:/.tg->runnable_avg
7894 ± 0% -13.6% 6823 ± 1% sched_debug.cfs_rq[7]:/.tg->runnable_avg
512300 ± 6% +18.2% 605480 ± 9% sched_debug.cpu#50.avg_idle
7908 ± 0% -13.6% 6836 ± 1% sched_debug.cfs_rq[13]:/.tg->runnable_avg
7888 ± 0% -13.6% 6814 ± 1% sched_debug.cfs_rq[3]:/.tg->runnable_avg
7916 ± 0% -13.6% 6843 ± 1% sched_debug.cfs_rq[15]:/.tg->runnable_avg
7892 ± 0% -13.6% 6818 ± 1% sched_debug.cfs_rq[6]:/.tg->runnable_avg
178921 ± 1% -17.9% 146921 ± 9% sched_debug.cpu#2.sched_goidle
7918 ± 0% -13.5% 6848 ± 1% sched_debug.cfs_rq[16]:/.tg->runnable_avg
7883 ± 0% -13.6% 6809 ± 1% sched_debug.cfs_rq[1]:/.tg->runnable_avg
7903 ± 0% -13.5% 6832 ± 1% sched_debug.cfs_rq[12]:/.tg->runnable_avg
7930 ± 0% -13.5% 6861 ± 1% sched_debug.cfs_rq[20]:/.tg->runnable_avg
7925 ± 0% -13.5% 6859 ± 1% sched_debug.cfs_rq[19]:/.tg->runnable_avg
7921 ± 0% -13.5% 6852 ± 1% sched_debug.cfs_rq[17]:/.tg->runnable_avg
7932 ± 0% -13.4% 6866 ± 1% sched_debug.cfs_rq[21]:/.tg->runnable_avg
358611 ± 1% -17.9% 294548 ± 9% sched_debug.cpu#2.nr_switches
7922 ± 0% -13.4% 6857 ± 1% sched_debug.cfs_rq[18]:/.tg->runnable_avg
7985 ± 0% -13.4% 6918 ± 1% sched_debug.cfs_rq[36]:/.tg->runnable_avg
555502 ± 4% +16.3% 646081 ± 5% sched_debug.cpu#5.avg_idle
7944 ± 0% -13.5% 6876 ± 1% sched_debug.cfs_rq[24]:/.tg->runnable_avg
7994 ± 0% -13.4% 6926 ± 1% sched_debug.cfs_rq[39]:/.tg->runnable_avg
7959 ± 0% -13.4% 6892 ± 1% sched_debug.cfs_rq[28]:/.tg->runnable_avg
7997 ± 0% -13.3% 6930 ± 1% sched_debug.cfs_rq[40]:/.tg->runnable_avg
7962 ± 0% -13.4% 6895 ± 1% sched_debug.cfs_rq[29]:/.tg->runnable_avg
7935 ± 0% -13.4% 6869 ± 1% sched_debug.cfs_rq[22]:/.tg->runnable_avg
7982 ± 0% -13.4% 6915 ± 1% sched_debug.cfs_rq[35]:/.tg->runnable_avg
8000 ± 0% -13.3% 6932 ± 1% sched_debug.cfs_rq[41]:/.tg->runnable_avg
7951 ± 0% -13.4% 6884 ± 1% sched_debug.cfs_rq[26]:/.tg->runnable_avg
7954 ± 0% -13.4% 6889 ± 1% sched_debug.cfs_rq[27]:/.tg->runnable_avg
7976 ± 0% -13.4% 6911 ± 1% sched_debug.cfs_rq[34]:/.tg->runnable_avg
7937 ± 0% -13.4% 6872 ± 1% sched_debug.cfs_rq[23]:/.tg->runnable_avg
8003 ± 0% -13.3% 6937 ± 1% sched_debug.cfs_rq[43]:/.tg->runnable_avg
765 ± 0% -13.1% 665 ± 1% time.percent_of_cpu_this_job_got
7964 ± 0% -13.4% 6896 ± 1% sched_debug.cfs_rq[30]:/.tg->runnable_avg
7987 ± 0% -13.4% 6919 ± 1% sched_debug.cfs_rq[37]:/.tg->runnable_avg
8027 ± 0% -13.3% 6961 ± 1% sched_debug.cfs_rq[50]:/.tg->runnable_avg
7988 ± 0% -13.4% 6921 ± 1% sched_debug.cfs_rq[38]:/.tg->runnable_avg
7946 ± 0% -13.4% 6883 ± 1% sched_debug.cfs_rq[25]:/.tg->runnable_avg
8025 ± 0% -13.3% 6955 ± 1% sched_debug.cfs_rq[48]:/.tg->runnable_avg
8012 ± 0% -13.3% 6944 ± 1% sched_debug.cfs_rq[45]:/.tg->runnable_avg
7974 ± 0% -13.3% 6909 ± 1% sched_debug.cfs_rq[33]:/.tg->runnable_avg
1.13 ± 1% -14.8% 0.96 ± 7% perf-profile.cpu-cycles.update_process_times.tick_sched_handle.tick_sched_timer.__run_hrtimer.hrtimer_interrupt
8000 ± 0% -13.3% 6933 ± 1% sched_debug.cfs_rq[42]:/.tg->runnable_avg
8035 ± 0% -13.3% 6969 ± 1% sched_debug.cfs_rq[51]:/.tg->runnable_avg
8024 ± 0% -13.3% 6954 ± 1% sched_debug.cfs_rq[47]:/.tg->runnable_avg
8014 ± 0% -13.3% 6950 ± 1% sched_debug.cfs_rq[46]:/.tg->runnable_avg
8026 ± 0% -13.3% 6959 ± 1% sched_debug.cfs_rq[49]:/.tg->runnable_avg
7968 ± 0% -13.4% 6902 ± 1% sched_debug.cfs_rq[31]:/.tg->runnable_avg
37.12 ± 0% -12.9% 32.34 ± 2% perf-profile.cpu-cycles.vma_link.mmap_region.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff
8007 ± 0% -13.4% 6938 ± 1% sched_debug.cfs_rq[44]:/.tg->runnable_avg
8037 ± 0% -13.2% 6973 ± 1% sched_debug.cfs_rq[52]:/.tg->runnable_avg
7968 ± 0% -13.3% 6906 ± 1% sched_debug.cfs_rq[32]:/.tg->runnable_avg
1.13 ± 1% -14.1% 0.97 ± 7% perf-profile.cpu-cycles.tick_sched_handle.isra.18.tick_sched_timer.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt
8068 ± 0% -13.1% 7007 ± 1% sched_debug.cfs_rq[63]:/.tg->runnable_avg
8040 ± 0% -13.2% 6977 ± 1% sched_debug.cfs_rq[53]:/.tg->runnable_avg
8053 ± 0% -13.2% 6990 ± 1% sched_debug.cfs_rq[57]:/.tg->runnable_avg
8064 ± 0% -13.1% 7004 ± 1% sched_debug.cfs_rq[61]:/.tg->runnable_avg
8049 ± 0% -13.2% 6985 ± 1% sched_debug.cfs_rq[56]:/.tg->runnable_avg
8070 ± 0% -13.1% 7009 ± 1% sched_debug.cfs_rq[64]:/.tg->runnable_avg
3595633 ± 5% -12.9% 3133416 ± 6% numa-meminfo.node3.MemUsed
8055 ± 0% -13.2% 6993 ± 1% sched_debug.cfs_rq[58]:/.tg->runnable_avg
8071 ± 0% -13.1% 7014 ± 1% sched_debug.cfs_rq[65]:/.tg->runnable_avg
8046 ± 0% -13.2% 6983 ± 1% sched_debug.cfs_rq[55]:/.tg->runnable_avg
8045 ± 0% -13.3% 6978 ± 1% sched_debug.cfs_rq[54]:/.tg->runnable_avg
8086 ± 0% -13.1% 7027 ± 1% sched_debug.cfs_rq[71]:/.tg->runnable_avg
8137 ± 0% -13.0% 7080 ± 1% sched_debug.cfs_rq[91]:/.tg->runnable_avg
8081 ± 0% -13.1% 7022 ± 1% sched_debug.cfs_rq[68]:/.tg->runnable_avg
8076 ± 0% -13.1% 7017 ± 1% sched_debug.cfs_rq[66]:/.tg->runnable_avg
8062 ± 0% -13.1% 7002 ± 1% sched_debug.cfs_rq[60]:/.tg->runnable_avg
8139 ± 0% -12.9% 7085 ± 1% sched_debug.cfs_rq[92]:/.tg->runnable_avg
8088 ± 0% -13.1% 7031 ± 1% sched_debug.cfs_rq[72]:/.tg->runnable_avg
8064 ± 0% -13.1% 7006 ± 1% sched_debug.cfs_rq[62]:/.tg->runnable_avg
8143 ± 0% -12.9% 7090 ± 1% sched_debug.cfs_rq[94]:/.tg->runnable_avg
41932371 ± 0% -13.0% 36489731 ± 1% slabinfo.vm_area_struct.active_objs
8078 ± 0% -13.1% 7019 ± 1% sched_debug.cfs_rq[67]:/.tg->runnable_avg
8083 ± 0% -13.1% 7025 ± 1% sched_debug.cfs_rq[69]:/.tg->runnable_avg
8058 ± 0% -13.2% 6997 ± 1% sched_debug.cfs_rq[59]:/.tg->runnable_avg
8142 ± 0% -12.9% 7089 ± 1% sched_debug.cfs_rq[93]:/.tg->runnable_avg
8084 ± 0% -13.1% 7028 ± 1% sched_debug.cfs_rq[70]:/.tg->runnable_avg
8134 ± 0% -13.0% 7078 ± 1% sched_debug.cfs_rq[90]:/.tg->runnable_avg
8123 ± 0% -13.1% 7062 ± 1% sched_debug.cfs_rq[84]:/.tg->runnable_avg
3274295 ± 0% -13.0% 2849232 ± 1% meminfo.PageTables
818565 ± 0% -13.0% 712300 ± 1% proc-vmstat.nr_page_table_pages
8094 ± 0% -13.0% 7038 ± 1% sched_debug.cfs_rq[74]:/.tg->runnable_avg
8133 ± 0% -13.0% 7077 ± 1% sched_debug.cfs_rq[89]:/.tg->runnable_avg
8103 ± 0% -13.0% 7046 ± 1% sched_debug.cfs_rq[77]:/.tg->runnable_avg
8144 ± 0% -12.9% 7094 ± 1% sched_debug.cfs_rq[95]:/.tg->runnable_avg
8146 ± 0% -12.9% 7096 ± 1% sched_debug.cfs_rq[96]:/.tg->runnable_avg
8128 ± 0% -13.0% 7070 ± 1% sched_debug.cfs_rq[86]:/.tg->runnable_avg
8091 ± 0% -13.0% 7035 ± 1% sched_debug.cfs_rq[73]:/.tg->runnable_avg
536950 ± 10% +23.4% 662508 ± 6% sched_debug.cpu#30.avg_idle
8096 ± 0% -13.1% 7039 ± 1% sched_debug.cfs_rq[75]:/.tg->runnable_avg
8127 ± 0% -13.0% 7067 ± 1% sched_debug.cfs_rq[85]:/.tg->runnable_avg
8149 ± 0% -12.9% 7097 ± 1% sched_debug.cfs_rq[97]:/.tg->runnable_avg
8151 ± 0% -12.9% 7100 ± 1% sched_debug.cfs_rq[99]:/.tg->runnable_avg
8153 ± 0% -12.9% 7101 ± 1% sched_debug.cfs_rq[100]:/.tg->runnable_avg
8129 ± 0% -13.0% 7074 ± 1% sched_debug.cfs_rq[87]:/.tg->runnable_avg
8118 ± 0% -13.0% 7060 ± 1% sched_debug.cfs_rq[83]:/.tg->runnable_avg
8107 ± 0% -13.1% 7047 ± 1% sched_debug.cfs_rq[78]:/.tg->runnable_avg
8111 ± 0% -13.0% 7054 ± 1% sched_debug.cfs_rq[80]:/.tg->runnable_avg
8098 ± 0% -13.0% 7044 ± 1% sched_debug.cfs_rq[76]:/.tg->runnable_avg
42188778 ± 0% -12.9% 36733179 ± 1% slabinfo.vm_area_struct.num_objs
958835 ± 0% -12.9% 834844 ± 1% slabinfo.vm_area_struct.num_slabs
958835 ± 0% -12.9% 834844 ± 1% slabinfo.vm_area_struct.active_slabs
8154 ± 0% -12.9% 7103 ± 1% sched_debug.cfs_rq[101]:/.tg->runnable_avg
8116 ± 0% -13.0% 7058 ± 1% sched_debug.cfs_rq[82]:/.tg->runnable_avg
8130 ± 0% -12.9% 7077 ± 1% sched_debug.cfs_rq[88]:/.tg->runnable_avg
8171 ± 0% -12.9% 7120 ± 1% sched_debug.cfs_rq[107]:/.tg->runnable_avg
8113 ± 0% -13.0% 7058 ± 1% sched_debug.cfs_rq[81]:/.tg->runnable_avg
8109 ± 0% -13.1% 7051 ± 1% sched_debug.cfs_rq[79]:/.tg->runnable_avg
8155 ± 0% -12.9% 7106 ± 1% sched_debug.cfs_rq[102]:/.tg->runnable_avg
8157 ± 0% -12.8% 7111 ± 1% sched_debug.cfs_rq[103]:/.tg->runnable_avg
8165 ± 0% -12.9% 7115 ± 1% sched_debug.cfs_rq[105]:/.tg->runnable_avg
8159 ± 0% -12.8% 7113 ± 1% sched_debug.cfs_rq[104]:/.tg->runnable_avg
8148 ± 0% -12.9% 7099 ± 1% sched_debug.cfs_rq[98]:/.tg->runnable_avg
8169 ± 0% -12.9% 7118 ± 1% sched_debug.cfs_rq[106]:/.tg->runnable_avg
1.78 ± 2% -11.3% 1.58 ± 4% perf-profile.cpu-cycles.tick_sched_timer.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt
7802174 ± 0% -12.8% 6805780 ± 1% meminfo.SUnreclaim
1950525 ± 0% -12.8% 1701410 ± 1% proc-vmstat.nr_slab_unreclaimable
8198 ± 0% -12.7% 7154 ± 1% sched_debug.cfs_rq[119]:/.tg->runnable_avg
8175 ± 0% -12.8% 7125 ± 1% sched_debug.cfs_rq[109]:/.tg->runnable_avg
8180 ± 0% -12.8% 7136 ± 1% sched_debug.cfs_rq[112]:/.tg->runnable_avg
8188 ± 0% -12.8% 7143 ± 1% sched_debug.cfs_rq[115]:/.tg->runnable_avg
8194 ± 0% -12.7% 7151 ± 1% sched_debug.cfs_rq[117]:/.tg->runnable_avg
8176 ± 0% -12.8% 7129 ± 1% sched_debug.cfs_rq[110]:/.tg->runnable_avg
8189 ± 0% -12.8% 7145 ± 1% sched_debug.cfs_rq[116]:/.tg->runnable_avg
189413 ± 4% -13.7% 163494 ± 8% sched_debug.cfs_rq[25]:/.min_vruntime
8184 ± 0% -12.7% 7141 ± 1% sched_debug.cfs_rq[114]:/.tg->runnable_avg
8182 ± 0% -12.8% 7137 ± 1% sched_debug.cfs_rq[113]:/.tg->runnable_avg
8172 ± 0% -12.8% 7122 ± 1% sched_debug.cfs_rq[108]:/.tg->runnable_avg
8193 ± 0% -12.7% 7152 ± 1% sched_debug.cfs_rq[118]:/.tg->runnable_avg
8178 ± 0% -12.8% 7133 ± 1% sched_debug.cfs_rq[111]:/.tg->runnable_avg
7859652 ± 0% -12.7% 6863230 ± 1% meminfo.Slab
0.95 ± 6% +15.6% 1.10 ± 3% perf-profile.cpu-cycles.__fget.fget.sys_mmap_pgoff.sys_mmap.system_call_fastpath
1.10 ± 2% -10.5% 0.98 ± 4% perf-profile.cpu-cycles.ktime_get.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns
23237 ± 4% -13.3% 20143 ± 6% sched_debug.cfs_rq[51]:/.exec_clock
1.82 ± 2% -11.0% 1.62 ± 4% perf-profile.cpu-cycles.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.97 ± 7% +14.0% 1.11 ± 3% perf-profile.cpu-cycles.fget.sys_mmap_pgoff.sys_mmap.system_call_fastpath
23242 ± 4% -12.9% 20253 ± 6% sched_debug.cfs_rq[49]:/.exec_clock
22886 ± 5% -13.7% 19749 ± 5% sched_debug.cfs_rq[56]:/.exec_clock
1036 ± 0% -11.9% 914 ± 1% time.user_time
8527124 ± 0% -11.6% 7534220 ± 1% vmstat.memory.cache
1695225 ± 0% -10.7% 1513459 ± 1% softirqs.TIMER
23318 ± 6% -13.1% 20269 ± 6% sched_debug.cfs_rq[54]:/.exec_clock
667649 ± 3% -10.0% 600607 ± 4% numa-vmstat.node3.numa_local
7.244e+08 ± 0% -11.1% 6.439e+08 ± 1% time.minor_page_faults
7.254e+08 ± 0% -11.1% 6.449e+08 ± 1% proc-vmstat.pgfault
1.92 ± 2% -10.9% 1.71 ± 4% perf-profile.cpu-cycles.read_hpet.ktime_get.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns
22971 ± 5% -12.9% 19998 ± 5% sched_debug.cfs_rq[55]:/.exec_clock
131 ± 10% -11.7% 115 ± 6% sched_debug.cfs_rq[52]:/.tg_runnable_contrib
42.89 ± 0% -10.4% 38.41 ± 2% perf-profile.cpu-cycles.mmap_region.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap
6053 ± 10% -11.6% 5349 ± 6% sched_debug.cfs_rq[52]:/.avg->runnable_avg_sum
753344 ± 2% -9.0% 685539 ± 4% numa-vmstat.node3.numa_hit
501098 ± 0% -11.4% 443942 ± 2% softirqs.SCHED
1.19 ± 2% -9.0% 1.08 ± 3% perf-profile.cpu-cycles.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns.tick_nohz_restart
90940 ± 2% +9.4% 99459 ± 2% sched_debug.cpu#54.nr_load_updates
88590 ± 2% +9.8% 97229 ± 4% sched_debug.cpu#2.nr_load_updates
90669 ± 2% +9.6% 99355 ± 2% sched_debug.cpu#56.nr_load_updates
91272 ± 2% +9.4% 99833 ± 2% sched_debug.cpu#49.nr_load_updates
1.22 ± 1% +10.5% 1.35 ± 2% perf-profile.cpu-cycles.schedule.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
89287 ± 3% +10.3% 98507 ± 4% sched_debug.cpu#1.nr_load_updates
45.38 ± 0% -9.4% 41.10 ± 2% perf-profile.cpu-cycles.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap.system_call_fastpath
22980 ± 5% -12.4% 20128 ± 6% sched_debug.cfs_rq[50]:/.exec_clock
1.19 ± 2% -8.5% 1.09 ± 4% perf-profile.cpu-cycles.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns.tick_nohz_restart.tick_nohz_idle_exit
5570129 ± 0% -9.4% 5048932 ± 1% proc-vmstat.pgalloc_normal
1100174 ± 3% -6.9% 1024326 ± 3% numa-numastat.node3.local_node
2.06 ± 2% -9.1% 1.87 ± 4% perf-profile.cpu-cycles.print_context_stack.dump_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity
46.01 ± 0% -9.2% 41.78 ± 2% perf-profile.cpu-cycles.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap.system_call_fastpath
91494 ± 2% +10.3% 100902 ± 2% sched_debug.cpu#46.nr_load_updates
20296 ± 3% -24.7% 15293 ± 3% vmstat.system.in
140148 ± 0% -21.9% 109393 ± 1% vmstat.system.cs
191 ± 0% -19.5% 153 ± 0% turbostat.CorWatt
257 ± 0% -14.7% 219 ± 0% turbostat.PkgWatt
218 ± 0% -13.5% 188 ± 1% turbostat.Avg_MHz
6.84 ± 0% -13.6% 5.91 ± 1% turbostat.%Busy
578 ± 0% -8.5% 529 ± 0% pmeter.Average_Active_Power
73.34 ± 0% -3.0% 71.15 ± 0% turbostat.RAMWatt
brickland3: Brickland Ivy Bridge-EX
Memory: 512G
vm-scalability.stddev
16 ++---------------------------------------------------------------------+
| O |
14 ++ O O |
12 ++ O O O O O |
| O OO O O |
10 O+ O O O O O |
| O O O O O O O O O O |
8 ++ O O |
| O O O |
6 ++ O |
4 ++ |
| .* .* *. .* *.|
2 *+**. .*.* .* *.**. * + *.** + : * * *.*. .*.**.* *
| ** *.* *.**.*.* *.* * * *.*.* ** |
0 ++---------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
To reproduce:
apt-get install ruby
git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
cd lkp-tests
bin/setup-local job.yaml # the job file attached in this email
bin/run-local job.yaml
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Ying Huang
[-- Attachment #2: job.yaml --]
[-- Type: text/plain, Size: 1710 bytes --]
---
testcase: vm-scalability
default-monitors:
wait: pre-test
uptime:
iostat:
vmstat:
numa-numastat:
numa-vmstat:
numa-meminfo:
proc-vmstat:
proc-stat:
meminfo:
slabinfo:
interrupts:
lock_stat:
latency_stats:
softirqs:
bdi_dev_mapping:
diskstats:
nfsstat:
cpuidle:
cpufreq-stats:
turbostat:
pmeter:
sched_debug:
interval: 10
default_watchdogs:
watch-oom:
watchdog:
cpufreq_governor: performance
commit: ce43fa581f61c4756301e7fd8609f50579e13d5d
model: Brickland Ivy Bridge-EX
nr_cpu: 120
memory: 512G
hdd_partitions:
swap_partitions:
pmeter_server: lkp-st01
pmeter_device: yokogawa-wt310
perf-profile:
runtime: 300s
size:
vm-scalability:
test: small-allocs
testbox: brickland3
tbox_group: brickland3
kconfig: x86_64-rhel
enqueue_time: 2015-03-08 04:48:33.187343214 +08:00
head_commit: ce43fa581f61c4756301e7fd8609f50579e13d5d
base_commit: 13a7a6ac0a11197edcd0f756a035f472b42cdf8b
branch: linux-devel/devel-hourly-2015030900
kernel: "/kernel/x86_64-rhel/ce43fa581f61c4756301e7fd8609f50579e13d5d/vmlinuz-4.0.0-rc2-00784-gce43fa5"
user: lkp
queue: cyclic
rootfs: debian-x86_64-2015-02-07.cgz
result_root: "/result/brickland3/vm-scalability/performance-300s-small-allocs/debian-x86_64-2015-02-07.cgz/x86_64-rhel/ce43fa581f61c4756301e7fd8609f50579e13d5d/0"
job_file: "/lkp/scheduled/brickland3/cyclic_vm-scalability-performance-300s-small-allocs-x86_64-rhel-HEAD-ce43fa581f61c4756301e7fd8609f50579e13d5d-0-20150308-92360-aeasab.yaml"
dequeue_time: 2015-03-09 06:20:56.728013487 +08:00
job_state: finished
loadavg: 78.64 75.53 36.25 1/953 14075
start_time: '1425853327'
end_time: '1425853675'
version: "/lkp/lkp/.src-20150308-175746"
[-- Attachment #3: reproduce --]
[-- Type: text/plain, Size: 9275 bytes --]
echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu10/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu100/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu101/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu102/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu103/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu104/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu105/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu106/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu107/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu108/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu109/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu11/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu110/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu111/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu112/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu113/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu114/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu115/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu116/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu117/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu118/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu119/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu12/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu13/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu14/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu15/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu16/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu17/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu18/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu19/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu2/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu20/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu21/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu22/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu23/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu24/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu25/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu26/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu27/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu28/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu29/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu3/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu30/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu31/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu32/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu33/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu34/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu35/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu36/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu37/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu38/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu39/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu4/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu40/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu41/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu42/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu43/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu44/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu45/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu46/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu47/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu48/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu49/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu5/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu50/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu51/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu52/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu53/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu54/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu55/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu56/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu57/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu58/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu59/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu6/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu60/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu61/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu62/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu63/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu64/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu65/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu66/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu67/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu68/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu69/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu7/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu70/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu71/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu72/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu73/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu74/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu75/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu76/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu77/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu78/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu79/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu8/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu80/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu81/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu82/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu83/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu84/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu85/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu86/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu87/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu88/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu89/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu9/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu90/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu91/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu92/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu93/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu94/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu95/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu96/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu97/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu98/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu99/cpufreq/scaling_governor
mount -t tmpfs -o size=100% vm-scalability-tmp /tmp/vm-scalability-tmp
truncate -s 540949544960 /tmp/vm-scalability.img
mkfs.xfs -q /tmp/vm-scalability.img
mount -o loop /tmp/vm-scalability.img /tmp/vm-scalability
./case-small-allocs
./usemem --runtime 300 -n 120 --readonly --unit 40960 36650387592
umount /tmp/vm-scalability-tmp
umount /tmp/vm-scalability
rm /tmp/vm-scalability.img
[-- Attachment #4: Type: text/plain, Size: 85 bytes --]
_______________________________________________
LKP mailing list
LKP@linux.intel.com
^ permalink raw reply [flat|nested] 4+ messages in thread
* [locking/rwsem] b3fd4f03ca0: -11.1% vm-scalability.throughput
@ 2015-03-13 5:36 ` Huang Ying
0 siblings, 0 replies; 4+ messages in thread
From: Huang Ying @ 2015-03-13 5:36 UTC (permalink / raw)
To: lkp
[-- Attachment #1: Type: text/plain, Size: 47533 bytes --]
FYI, we noticed the below changes on
git://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git master
commit b3fd4f03ca0b9952221f39ae6790e698bf4b39e7 ("locking/rwsem: Avoid deceiving lock spinners")
testbox/testcase/testparams: brickland3/vm-scalability/performance-300s-small-allocs
7a215f89a0335582 b3fd4f03ca0b9952221f39ae67
---------------- --------------------------
%stddev %change %stddev
\ | \
2.38 ± 18% +247.4% 8.27 ± 16% vm-scalability.stddev
24226456 ± 0% -23.0% 18650874 ± 1% vm-scalability.time.voluntary_context_switches
1622 ± 0% -15.6% 1369 ± 1% vm-scalability.time.system_time
765 ± 0% -13.1% 665 ± 1% vm-scalability.time.percent_of_cpu_this_job_got
1036 ± 0% -11.9% 914 ± 1% vm-scalability.time.user_time
7.244e+08 ± 0% -11.1% 6.439e+08 ± 1% vm-scalability.time.minor_page_faults
10841276 ± 0% -11.1% 9639981 ± 1% vm-scalability.throughput
8922883 ± 3% -70.2% 2658543 ± 4% cpuidle.C1-IVT-4S.usage
1.19e+10 ± 2% -66.2% 4.016e+09 ± 4% cpuidle.C1-IVT-4S.time
1.97 ± 4% +106.7% 4.08 ± 6% perf-profile.cpu-cycles.intel_idle.cpuidle_enter_state.cpuidle_enter.cpu_startup_entry.start_secondary
58.29 ± 1% -50.2% 29.03 ± 2% turbostat.CPU%c1
34.84 ± 2% +86.6% 65.01 ± 1% turbostat.CPU%c6
170814 ± 7% -39.9% 102682 ± 11% sched_debug.cpu#21.sched_goidle
367762 ± 11% -39.9% 220850 ± 10% sched_debug.cpu#26.sched_count
5.12 ± 2% -39.8% 3.08 ± 5% perf-profile.cpu-cycles.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
342453 ± 7% -39.9% 205985 ± 11% sched_debug.cpu#21.nr_switches
3.14 ± 2% +68.0% 5.28 ± 5% perf-profile.cpu-cycles.cpuidle_enter_state.cpuidle_enter.cpu_startup_entry.start_secondary
170317 ± 6% -39.9% 102389 ± 11% sched_debug.cpu#22.sched_goidle
168710 ± 6% -38.4% 103876 ± 11% sched_debug.cpu#23.sched_goidle
341400 ± 6% -39.8% 205416 ± 11% sched_debug.cpu#22.nr_switches
338590 ± 6% -38.5% 208381 ± 11% sched_debug.cpu#23.nr_switches
165879 ± 4% -36.6% 105178 ± 10% sched_debug.cpu#18.sched_goidle
168958 ± 6% -39.0% 103043 ± 11% sched_debug.cpu#20.sched_goidle
359148 ± 5% -39.2% 218455 ± 11% sched_debug.cpu#20.sched_count
332511 ± 4% -36.5% 211029 ± 10% sched_debug.cpu#18.nr_switches
338875 ± 6% -39.0% 206782 ± 11% sched_debug.cpu#20.nr_switches
359968 ± 6% -39.4% 218057 ± 12% sched_debug.cpu#21.sched_count
166207 ± 4% -38.5% 102168 ± 11% sched_debug.cpu#27.sched_goidle
164881 ± 6% -37.0% 103846 ± 11% sched_debug.cpu#25.sched_goidle
330721 ± 6% -37.0% 208344 ± 11% sched_debug.cpu#25.nr_switches
333161 ± 4% -38.3% 205591 ± 11% sched_debug.cpu#27.nr_switches
362674 ± 7% -40.1% 217123 ± 10% sched_debug.cpu#22.sched_count
350433 ± 7% -37.3% 219595 ± 13% sched_debug.cpu#15.nr_switches
174599 ± 7% -37.4% 109366 ± 13% sched_debug.cpu#15.sched_goidle
174038 ± 9% -36.8% 109941 ± 12% sched_debug.cpu#17.sched_goidle
348896 ± 9% -36.7% 220793 ± 12% sched_debug.cpu#17.nr_switches
327443 ± 6% -36.8% 207015 ± 11% sched_debug.cpu#24.nr_switches
348687 ± 5% -37.2% 219100 ± 11% sched_debug.cpu#27.sched_count
163220 ± 6% -36.9% 103066 ± 11% sched_debug.cpu#24.sched_goidle
167997 ± 5% -35.7% 108017 ± 11% sched_debug.cpu#16.sched_goidle
365757 ± 10% -38.9% 223561 ± 12% sched_debug.cpu#28.sched_count
336756 ± 5% -35.6% 216751 ± 11% sched_debug.cpu#16.nr_switches
174236 ± 12% -40.6% 103542 ± 10% sched_debug.cpu#26.sched_goidle
349494 ± 12% -40.6% 207718 ± 10% sched_debug.cpu#26.nr_switches
175130 ± 10% -39.7% 105573 ± 13% sched_debug.cpu#28.sched_goidle
351090 ± 10% -39.6% 212090 ± 13% sched_debug.cpu#28.nr_switches
350972 ± 5% -35.2% 227402 ± 10% sched_debug.cpu#19.sched_count
343794 ± 5% -36.2% 219297 ± 10% sched_debug.cpu#24.sched_count
347268 ± 5% -36.3% 221228 ± 10% sched_debug.cpu#25.sched_count
352999 ± 5% -34.1% 232554 ± 9% sched_debug.cpu#16.sched_count
354362 ± 7% -37.0% 223292 ± 10% sched_debug.cpu#23.sched_count
166091 ± 7% -36.6% 105356 ± 14% sched_debug.cpu#29.sched_goidle
350840 ± 6% -35.5% 226331 ± 13% sched_debug.cpu#29.sched_count
332928 ± 7% -36.4% 211785 ± 14% sched_debug.cpu#29.nr_switches
369396 ± 7% -36.4% 234822 ± 13% sched_debug.cpu#15.sched_count
364063 ± 9% -34.6% 238151 ± 11% sched_debug.cpu#17.sched_count
349193 ± 4% -35.2% 226315 ± 9% sched_debug.cpu#18.sched_count
3.94 ± 1% +49.9% 5.90 ± 5% perf-profile.cpu-cycles.cpuidle_enter.cpu_startup_entry.start_secondary
5361900 ± 1% +50.5% 8067121 ± 0% cpuidle.C6-IVT-4S.usage
166471 ± 5% -36.3% 106063 ± 10% sched_debug.cpu#19.sched_goidle
334078 ± 5% -36.3% 212767 ± 10% sched_debug.cpu#19.nr_switches
511523 ± 11% +40.1% 716466 ± 9% sched_debug.cpu#38.avg_idle
5141 ± 10% -21.3% 4046 ± 18% sched_debug.cfs_rq[16]:/.avg->runnable_avg_sum
185324 ± 6% -28.9% 131826 ± 11% sched_debug.cpu#43.ttwu_count
111 ± 10% -21.6% 87 ± 18% sched_debug.cfs_rq[16]:/.tg_runnable_contrib
188387 ± 5% -28.4% 134976 ± 11% sched_debug.cpu#35.ttwu_count
182306 ± 7% -28.0% 131276 ± 9% sched_debug.cpu#19.ttwu_count
181618 ± 5% -28.6% 129685 ± 10% sched_debug.cpu#18.ttwu_count
370815 ± 7% -25.5% 276125 ± 11% sched_debug.cpu#38.sched_count
178281 ± 7% -25.9% 132044 ± 11% sched_debug.cpu#38.sched_goidle
181914 ± 5% -28.0% 130970 ± 8% sched_debug.cpu#16.ttwu_count
357347 ± 7% -25.9% 264826 ± 11% sched_debug.cpu#38.nr_switches
546593 ± 7% +38.6% 757389 ± 4% sched_debug.cpu#27.avg_idle
183057 ± 5% -27.7% 132439 ± 8% sched_debug.cpu#17.ttwu_count
174289 ± 8% -25.5% 129871 ± 13% sched_debug.cpu#43.sched_goidle
349323 ± 8% -25.4% 260438 ± 13% sched_debug.cpu#43.nr_switches
187088 ± 5% -27.4% 135758 ± 10% sched_debug.cpu#36.ttwu_count
190589 ± 5% -29.1% 135135 ± 12% sched_debug.cpu#33.ttwu_count
179655 ± 10% -28.6% 128343 ± 13% sched_debug.cpu#44.sched_goidle
367566 ± 11% -26.0% 271924 ± 14% sched_debug.cpu#43.sched_count
360119 ± 10% -28.5% 257380 ± 13% sched_debug.cpu#44.nr_switches
177427 ± 5% -25.5% 132241 ± 9% sched_debug.cpu#20.ttwu_count
187477 ± 6% -28.9% 133263 ± 11% sched_debug.cpu#39.ttwu_count
187313 ± 5% -28.7% 133487 ± 11% sched_debug.cpu#41.ttwu_count
192203 ± 4% -28.3% 137818 ± 10% sched_debug.cpu#31.ttwu_count
183679 ± 5% -28.1% 132147 ± 10% sched_debug.cpu#44.ttwu_count
367665 ± 9% -24.6% 277237 ± 15% sched_debug.cpu#42.sched_count
178211 ± 3% -26.9% 130348 ± 8% sched_debug.cpu#23.ttwu_count
175478 ± 4% -25.6% 130478 ± 9% sched_debug.cpu#22.ttwu_count
186974 ± 6% -27.6% 135310 ± 10% sched_debug.cpu#38.ttwu_count
190431 ± 4% -28.0% 137033 ± 11% sched_debug.cpu#32.ttwu_count
190722 ± 4% -28.4% 136639 ± 10% sched_debug.cpu#34.ttwu_count
175431 ± 8% -25.3% 131079 ± 12% sched_debug.cpu#42.sched_goidle
361690 ± 8% -24.8% 272015 ± 13% sched_debug.cpu#39.sched_count
351619 ± 8% -25.2% 262838 ± 12% sched_debug.cpu#42.nr_switches
175056 ± 6% -24.8% 131564 ± 12% sched_debug.cpu#40.sched_goidle
350873 ± 6% -24.8% 263820 ± 12% sched_debug.cpu#40.nr_switches
173107 ± 6% -25.3% 129289 ± 13% sched_debug.cpu#37.sched_goidle
346966 ± 6% -25.3% 259257 ± 13% sched_debug.cpu#37.nr_switches
171359 ± 7% -24.8% 128941 ± 11% sched_debug.cpu#39.sched_goidle
343474 ± 7% -24.7% 258590 ± 11% sched_debug.cpu#39.nr_switches
375852 ± 12% -28.4% 269206 ± 15% sched_debug.cpu#44.sched_count
180303 ± 8% -25.0% 135309 ± 10% sched_debug.cpu#30.sched_goidle
177803 ± 5% -25.3% 132893 ± 9% sched_debug.cpu#21.ttwu_count
361386 ± 8% -24.9% 271330 ± 10% sched_debug.cpu#30.nr_switches
172414 ± 7% -24.9% 129400 ± 13% sched_debug.cpu#41.sched_goidle
345579 ± 7% -24.9% 259489 ± 13% sched_debug.cpu#41.nr_switches
373591 ± 8% -25.3% 279094 ± 13% sched_debug.cpu#31.sched_count
177533 ± 9% -26.9% 129812 ± 12% sched_debug.cpu#36.sched_goidle
179094 ± 8% -26.3% 131936 ± 11% sched_debug.cpu#35.sched_goidle
376042 ± 8% -26.7% 275458 ± 12% sched_debug.cpu#35.sched_count
355841 ± 9% -26.8% 260341 ± 12% sched_debug.cpu#36.nr_switches
183165 ± 12% -29.4% 129301 ± 13% sched_debug.cpu#33.sched_goidle
371977 ± 9% -27.3% 270521 ± 13% sched_debug.cpu#36.sched_count
184524 ± 5% -27.3% 134078 ± 10% sched_debug.cpu#42.ttwu_count
204591 ± 7% -22.5% 158606 ± 16% sched_debug.cfs_rq[33]:/.min_vruntime
358950 ± 8% -26.3% 264608 ± 11% sched_debug.cpu#35.nr_switches
367143 ± 12% -29.4% 259297 ± 13% sched_debug.cpu#33.nr_switches
184796 ± 5% -26.7% 135370 ± 8% sched_debug.cpu#15.ttwu_count
560186 ± 7% +36.4% 764034 ± 4% sched_debug.cpu#15.avg_idle
192024 ± 5% -27.6% 138984 ± 9% sched_debug.cpu#30.ttwu_count
186661 ± 5% -27.9% 134534 ± 11% sched_debug.cpu#40.ttwu_count
175890 ± 4% -26.4% 129452 ± 8% sched_debug.cpu#26.ttwu_count
366664 ± 8% -24.7% 276276 ± 14% sched_debug.cpu#34.sched_count
186046 ± 5% -26.7% 136338 ± 10% sched_debug.cpu#37.ttwu_count
173138 ± 4% -26.5% 127219 ± 8% sched_debug.cpu#28.ttwu_count
231881 ± 4% -26.0% 171683 ± 6% sched_debug.cpu#48.ttwu_count
229108 ± 4% -24.5% 173024 ± 5% sched_debug.cpu#47.ttwu_count
545213 ± 6% +30.6% 712076 ± 3% sched_debug.cpu#39.avg_idle
175780 ± 8% -25.0% 131911 ± 12% sched_debug.cpu#34.sched_goidle
352325 ± 8% -24.9% 264519 ± 12% sched_debug.cpu#34.nr_switches
368764 ± 7% -25.9% 273326 ± 13% sched_debug.cpu#40.sched_count
178369 ± 7% -25.3% 133316 ± 12% sched_debug.cpu#31.sched_goidle
357523 ± 7% -25.2% 267329 ± 12% sched_debug.cpu#31.nr_switches
445168 ± 6% -21.5% 349498 ± 7% sched_debug.cpu#50.sched_count
178502 ± 3% -27.0% 130326 ± 8% sched_debug.cpu#24.ttwu_count
232438 ± 4% -25.2% 173912 ± 4% sched_debug.cpu#45.ttwu_count
214980 ± 6% -21.3% 169213 ± 7% sched_debug.cpu#50.sched_goidle
430801 ± 6% -21.3% 339213 ± 7% sched_debug.cpu#50.nr_switches
175354 ± 7% -25.0% 131440 ± 12% sched_debug.cpu#32.sched_goidle
351473 ± 7% -25.0% 263573 ± 12% sched_debug.cpu#32.nr_switches
175818 ± 4% -25.5% 131027 ± 9% sched_debug.cpu#25.ttwu_count
562351 ± 4% +33.0% 747969 ± 7% sched_debug.cpu#17.avg_idle
226274 ± 5% -24.6% 170581 ± 5% sched_debug.cpu#54.ttwu_count
566741 ± 5% +33.2% 754744 ± 4% sched_debug.cpu#29.avg_idle
365692 ± 8% -24.7% 275497 ± 14% sched_debug.cpu#32.sched_count
443973 ± 6% -22.1% 345964 ± 7% sched_debug.cpu#51.sched_count
360816 ± 8% -25.3% 269548 ± 14% sched_debug.cpu#41.sched_count
224711 ± 4% -24.6% 169414 ± 6% sched_debug.cpu#53.ttwu_count
380979 ± 13% -28.9% 270783 ± 14% sched_debug.cpu#33.sched_count
174502 ± 4% -27.0% 127311 ± 8% sched_debug.cpu#29.ttwu_count
573889 ± 4% +32.2% 758635 ± 5% sched_debug.cpu#24.avg_idle
523204 ± 10% +29.1% 675536 ± 9% sched_debug.cpu#6.avg_idle
173555 ± 4% -25.7% 128988 ± 8% sched_debug.cpu#27.ttwu_count
228859 ± 4% -25.2% 171229 ± 6% sched_debug.cpu#49.ttwu_count
529356 ± 9% +32.4% 700872 ± 6% sched_debug.cpu#33.avg_idle
565916 ± 5% +33.4% 755047 ± 7% sched_debug.cpu#23.avg_idle
232257 ± 3% -25.1% 173926 ± 5% sched_debug.cpu#46.ttwu_count
227954 ± 4% -24.3% 172631 ± 5% sched_debug.cpu#52.ttwu_count
197241 ± 5% -23.5% 150963 ± 8% sched_debug.cpu#4.ttwu_count
228392 ± 3% -24.8% 171779 ± 6% sched_debug.cpu#51.ttwu_count
542129 ± 5% +28.0% 693751 ± 6% sched_debug.cpu#13.avg_idle
364245 ± 8% -25.1% 272652 ± 15% sched_debug.cpu#37.sched_count
558275 ± 8% +36.1% 759570 ± 6% sched_debug.cpu#26.avg_idle
225027 ± 5% -24.7% 169427 ± 6% sched_debug.cpu#57.ttwu_count
17.06 ± 1% -23.0% 13.13 ± 3% perf-profile.cpu-cycles.call_rwsem_down_write_failed.vma_link.mmap_region.do_mmap_pgoff.vm_mmap_pgoff
197493 ± 5% -22.8% 152503 ± 8% sched_debug.cpu#2.ttwu_count
16.99 ± 1% -23.2% 13.05 ± 3% perf-profile.cpu-cycles.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region.do_mmap_pgoff
223164 ± 4% -24.7% 168105 ± 6% sched_debug.cpu#59.ttwu_count
223884 ± 4% -24.6% 168887 ± 4% sched_debug.cpu#58.ttwu_count
538073 ± 6% +27.8% 687436 ± 8% sched_debug.cpu#43.avg_idle
445916 ± 7% -22.4% 345938 ± 6% sched_debug.cpu#52.sched_count
214967 ± 6% -21.9% 167898 ± 6% sched_debug.cpu#52.sched_goidle
534156 ± 9% +25.2% 668876 ± 5% sched_debug.cpu#11.avg_idle
430800 ± 6% -21.9% 336561 ± 6% sched_debug.cpu#52.nr_switches
117 ± 8% -21.7% 91 ± 5% sched_debug.cfs_rq[36]:/.tg_runnable_contrib
224801 ± 4% -24.0% 170764 ± 5% sched_debug.cpu#55.ttwu_count
225103 ± 4% -24.9% 168953 ± 5% sched_debug.cpu#56.ttwu_count
24226456 ± 0% -23.0% 18650874 ± 1% time.voluntary_context_switches
5411 ± 8% -21.3% 4256 ± 4% sched_debug.cfs_rq[36]:/.avg->runnable_avg_sum
212964 ± 5% -21.5% 167092 ± 6% sched_debug.cpu#51.sched_goidle
426769 ± 5% -21.5% 334967 ± 6% sched_debug.cpu#51.nr_switches
519159 ± 4% +27.0% 659572 ± 7% sched_debug.cpu#52.avg_idle
193464 ± 4% -22.1% 150665 ± 7% sched_debug.cpu#7.ttwu_count
226747 ± 4% -24.4% 171347 ± 6% sched_debug.cpu#50.ttwu_count
572755 ± 6% +29.0% 738639 ± 4% sched_debug.cpu#25.avg_idle
520910 ± 7% +35.0% 703382 ± 6% sched_debug.cpu#32.avg_idle
2.696e+10 ± 1% +29.0% 3.478e+10 ± 0% cpuidle.C6-IVT-4S.time
530311 ± 12% +31.1% 695099 ± 5% sched_debug.cpu#44.avg_idle
204543 ± 8% -20.5% 162661 ± 15% sched_debug.cfs_rq[31]:/.min_vruntime
484242 ± 9% +31.7% 637669 ± 8% sched_debug.cpu#47.avg_idle
6.85 ± 1% -22.4% 5.32 ± 3% perf-profile.cpu-cycles.rwsem_spin_on_owner.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
528770 ± 7% +31.6% 695818 ± 6% sched_debug.cpu#40.avg_idle
223475 ± 4% -20.9% 176718 ± 6% sched_debug.cfs_rq[52]:/.min_vruntime
577331 ± 4% +29.2% 745806 ± 4% sched_debug.cpu#16.avg_idle
192821 ± 4% -23.4% 147763 ± 8% sched_debug.cpu#10.ttwu_count
198393 ± 4% -23.1% 152635 ± 7% sched_debug.cpu#1.ttwu_count
572991 ± 9% +29.0% 738876 ± 3% sched_debug.cpu#18.avg_idle
531346 ± 5% +26.8% 673808 ± 6% sched_debug.cpu#35.avg_idle
531692 ± 8% +30.0% 691275 ± 7% sched_debug.cpu#36.avg_idle
573689 ± 9% +30.1% 746581 ± 3% sched_debug.cpu#28.avg_idle
194767 ± 3% -22.1% 151736 ± 7% sched_debug.cpu#6.ttwu_count
576252 ± 10% +29.8% 748134 ± 5% sched_debug.cpu#19.avg_idle
189779 ± 5% -22.5% 147019 ± 9% sched_debug.cpu#13.ttwu_count
574093 ± 9% +28.0% 734982 ± 4% sched_debug.cpu#22.avg_idle
530896 ± 7% +25.4% 665864 ± 7% sched_debug.cpu#9.avg_idle
222143 ± 5% -19.0% 179889 ± 9% sched_debug.cfs_rq[49]:/.min_vruntime
190106 ± 5% -22.4% 147518 ± 7% sched_debug.cpu#14.ttwu_count
192933 ± 3% -21.8% 150835 ± 8% sched_debug.cpu#8.ttwu_count
193656 ± 4% -22.7% 149678 ± 8% sched_debug.cpu#9.ttwu_count
196739 ± 5% -22.9% 151747 ± 7% sched_debug.cpu#3.ttwu_count
434909 ± 6% -18.4% 354789 ± 6% sched_debug.cpu#55.sched_count
194722 ± 4% -22.0% 151895 ± 8% sched_debug.cpu#5.ttwu_count
439285 ± 7% -19.7% 352534 ± 6% sched_debug.cpu#47.sched_count
585003 ± 7% +31.4% 768551 ± 5% sched_debug.cpu#20.avg_idle
432219 ± 7% -19.5% 347734 ± 7% sched_debug.cpu#48.sched_count
224113 ± 5% -18.9% 181798 ± 8% sched_debug.cfs_rq[48]:/.min_vruntime
534566 ± 7% +30.3% 696442 ± 6% sched_debug.cpu#31.avg_idle
525194 ± 6% +23.5% 648587 ± 7% sched_debug.cpu#7.avg_idle
209128 ± 6% -19.4% 168562 ± 7% sched_debug.cpu#48.sched_goidle
419098 ± 6% -19.4% 337908 ± 7% sched_debug.cpu#48.nr_switches
448417 ± 7% -19.8% 359813 ± 6% sched_debug.cpu#46.sched_count
491962 ± 8% +26.7% 623449 ± 4% sched_debug.cpu#48.avg_idle
212354 ± 6% -19.7% 170477 ± 5% sched_debug.cpu#47.sched_goidle
581409 ± 7% +23.6% 718790 ± 4% sched_debug.cpu#37.avg_idle
194066 ± 6% -17.8% 159565 ± 11% sched_debug.cfs_rq[16]:/.min_vruntime
425571 ± 6% -19.7% 341752 ± 5% sched_debug.cpu#47.nr_switches
215882 ± 7% -19.5% 173827 ± 5% sched_debug.cpu#46.sched_goidle
442267 ± 6% -21.4% 347467 ± 6% sched_debug.cpu#59.sched_count
432617 ± 7% -19.5% 348457 ± 5% sched_debug.cpu#46.nr_switches
569496 ± 11% +32.0% 751590 ± 5% sched_debug.cpu#21.avg_idle
189763 ± 5% -22.2% 147705 ± 8% sched_debug.cpu#12.ttwu_count
223064 ± 4% -19.3% 179906 ± 5% sched_debug.cfs_rq[53]:/.min_vruntime
213869 ± 5% -21.0% 168888 ± 5% sched_debug.cpu#59.sched_goidle
428592 ± 5% -21.0% 338537 ± 5% sched_debug.cpu#59.nr_switches
441291 ± 6% -19.8% 353975 ± 5% sched_debug.cpu#45.sched_count
213493 ± 5% -19.5% 171778 ± 5% sched_debug.cpu#45.sched_goidle
427837 ± 5% -19.5% 344360 ± 5% sched_debug.cpu#45.nr_switches
191795 ± 5% -22.6% 148369 ± 8% sched_debug.cpu#11.ttwu_count
194309 ± 6% -19.3% 156815 ± 8% sched_debug.cfs_rq[17]:/.min_vruntime
221301 ± 5% -20.9% 175025 ± 7% sched_debug.cfs_rq[56]:/.min_vruntime
538571 ± 8% +24.4% 670227 ± 8% sched_debug.cpu#3.avg_idle
223672 ± 5% -18.9% 181388 ± 7% sched_debug.cfs_rq[47]:/.min_vruntime
425387 ± 7% -18.3% 347554 ± 7% sched_debug.cpu#54.sched_count
199287 ± 6% -21.7% 156117 ± 12% sched_debug.cfs_rq[15]:/.min_vruntime
1.00 ± 5% -15.8% 0.84 ± 6% perf-profile.cpu-cycles.kmem_cache_alloc_trace.perf_event_mmap.mmap_region.do_mmap_pgoff.vm_mmap_pgoff
385907 ± 8% -23.7% 294552 ± 10% sched_debug.cpu#6.sched_count
493228 ± 5% +27.4% 628579 ± 8% sched_debug.cpu#54.avg_idle
185090 ± 8% -23.0% 142559 ± 10% sched_debug.cpu#6.sched_goidle
542727 ± 8% +27.5% 691759 ± 4% sched_debug.cpu#42.avg_idle
209830 ± 6% -18.0% 172096 ± 6% sched_debug.cpu#55.sched_goidle
370989 ± 8% -23.0% 285813 ± 10% sched_debug.cpu#6.nr_switches
420473 ± 6% -18.0% 344973 ± 6% sched_debug.cpu#55.nr_switches
201389 ± 4% -20.7% 159785 ± 7% sched_debug.cpu#0.ttwu_count
365245 ± 7% -20.1% 291843 ± 9% sched_debug.cpu#5.sched_count
176316 ± 7% -19.7% 141647 ± 9% sched_debug.cpu#5.sched_goidle
353385 ± 7% -19.6% 284000 ± 9% sched_debug.cpu#5.nr_switches
430699 ± 7% -20.6% 341980 ± 7% sched_debug.cpu#53.sched_count
434688 ± 7% -17.9% 356994 ± 7% sched_debug.cpu#58.sched_count
910 ± 11% -15.6% 767 ± 12% sched_debug.cpu#34.ttwu_local
194153 ± 7% -16.9% 161410 ± 5% sched_debug.cfs_rq[19]:/.min_vruntime
435164 ± 10% -20.0% 348238 ± 7% sched_debug.cpu#56.sched_count
25686 ± 0% -18.8% 20849 ± 1% softirqs.HRTIMER
205841 ± 7% -18.6% 167608 ± 6% sched_debug.cpu#54.sched_goidle
412493 ± 7% -18.5% 335995 ± 6% sched_debug.cpu#54.nr_switches
209629 ± 7% -17.5% 172950 ± 7% sched_debug.cpu#58.sched_goidle
420079 ± 7% -17.5% 346715 ± 7% sched_debug.cpu#58.nr_switches
190909 ± 5% -19.3% 154071 ± 8% sched_debug.cfs_rq[26]:/.min_vruntime
535739 ± 10% +25.8% 674192 ± 3% sched_debug.cpu#41.avg_idle
220505 ± 5% -17.2% 182496 ± 10% sched_debug.cfs_rq[57]:/.min_vruntime
207365 ± 6% -19.9% 166054 ± 7% sched_debug.cpu#53.sched_goidle
415569 ± 6% -19.9% 332885 ± 7% sched_debug.cpu#53.nr_switches
433052 ± 7% -19.5% 348641 ± 8% sched_debug.cpu#57.sched_count
534493 ± 4% +25.6% 671066 ± 4% sched_debug.cpu#2.avg_idle
1.02 ± 2% -20.2% 0.81 ± 8% perf-profile.cpu-cycles.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__run_hrtimer
5217 ± 12% -17.6% 4297 ± 9% sched_debug.cfs_rq[26]:/.avg->runnable_avg_sum
209594 ± 6% -19.1% 169509 ± 8% sched_debug.cpu#57.sched_goidle
420012 ± 6% -19.1% 339802 ± 8% sched_debug.cpu#57.nr_switches
503208 ± 10% +25.5% 631683 ± 7% sched_debug.cpu#55.avg_idle
113 ± 12% -17.9% 92 ± 9% sched_debug.cfs_rq[26]:/.tg_runnable_contrib
549109 ± 5% +22.6% 673144 ± 6% sched_debug.cpu#14.avg_idle
210495 ± 9% -19.7% 169109 ± 7% sched_debug.cpu#56.sched_goidle
421839 ± 9% -19.6% 338979 ± 7% sched_debug.cpu#56.nr_switches
221205 ± 4% -17.6% 182374 ± 7% sched_debug.cfs_rq[50]:/.min_vruntime
502758 ± 6% +23.1% 618755 ± 7% sched_debug.cpu#46.avg_idle
222043 ± 4% -18.6% 180727 ± 10% sched_debug.cfs_rq[51]:/.min_vruntime
221617 ± 4% -18.3% 181127 ± 8% sched_debug.cfs_rq[55]:/.min_vruntime
557533 ± 11% +22.2% 681218 ± 7% sched_debug.cpu#12.avg_idle
187238 ± 6% -17.7% 154099 ± 10% sched_debug.cfs_rq[29]:/.min_vruntime
551333 ± 10% +22.2% 673592 ± 7% sched_debug.cpu#34.avg_idle
224579 ± 4% -16.6% 187288 ± 9% sched_debug.cfs_rq[54]:/.min_vruntime
184873 ± 6% -15.9% 155439 ± 8% sched_debug.cfs_rq[28]:/.min_vruntime
206172 ± 6% -18.2% 168730 ± 7% sched_debug.cpu#49.sched_goidle
413179 ± 6% -18.1% 338238 ± 7% sched_debug.cpu#49.nr_switches
225157 ± 5% -16.4% 188227 ± 9% sched_debug.cfs_rq[46]:/.min_vruntime
175150 ± 5% -16.9% 145619 ± 11% sched_debug.cpu#3.sched_goidle
351054 ± 5% -16.8% 291944 ± 11% sched_debug.cpu#3.nr_switches
564018 ± 3% +21.0% 682616 ± 6% sched_debug.cpu#4.avg_idle
5529 ± 8% -18.1% 4527 ± 11% sched_debug.cfs_rq[39]:/.avg->runnable_avg_sum
600812 ± 5% -15.3% 508926 ± 9% numa-vmstat.node2.numa_local
187471 ± 4% -18.5% 152874 ± 10% sched_debug.cfs_rq[22]:/.min_vruntime
19730 ± 6% -13.7% 17025 ± 9% sched_debug.cfs_rq[26]:/.exec_clock
425149 ± 6% -18.2% 347836 ± 7% sched_debug.cpu#49.sched_count
22908 ± 5% -12.9% 19945 ± 5% sched_debug.cfs_rq[58]:/.exec_clock
191793 ± 4% -16.6% 160031 ± 10% sched_debug.cfs_rq[24]:/.min_vruntime
14.49 ± 0% +16.4% 16.87 ± 2% perf-profile.cpu-cycles.start_secondary
514287 ± 10% +19.7% 615733 ± 6% sched_debug.cpu#58.avg_idle
1622 ± 0% -15.6% 1369 ± 1% time.system_time
14.45 ± 0% +16.2% 16.80 ± 2% perf-profile.cpu-cycles.cpu_startup_entry.start_secondary
1117 ± 6% -12.1% 982 ± 3% proc-vmstat.pgmigrate_success
1117 ± 6% -12.1% 982 ± 3% proc-vmstat.numa_pages_migrated
23520 ± 4% -14.0% 20233 ± 6% sched_debug.cfs_rq[48]:/.exec_clock
372296 ± 1% -18.0% 305136 ± 9% sched_debug.cpu#2.sched_count
218377 ± 6% -16.5% 182283 ± 6% sched_debug.cfs_rq[58]:/.min_vruntime
548860 ± 8% +25.4% 688468 ± 6% sched_debug.cpu#8.avg_idle
224066 ± 5% -17.7% 184445 ± 8% sched_debug.cfs_rq[45]:/.min_vruntime
23172 ± 4% -12.9% 20184 ± 5% sched_debug.cfs_rq[52]:/.exec_clock
947362 ± 3% -14.4% 810580 ± 7% numa-numastat.node2.local_node
22992 ± 5% -12.9% 20026 ± 7% sched_debug.cfs_rq[59]:/.exec_clock
23572 ± 4% -12.3% 20668 ± 5% sched_debug.cfs_rq[46]:/.exec_clock
6293 ± 8% -16.0% 5288 ± 8% sched_debug.cfs_rq[47]:/.avg->runnable_avg_sum
23545 ± 4% -13.3% 20402 ± 6% sched_debug.cfs_rq[47]:/.exec_clock
7 ± 0% -14.3% 6 ± 0% vmstat.procs.r
136 ± 8% -16.3% 114 ± 8% sched_debug.cfs_rq[47]:/.tg_runnable_contrib
952018 ± 3% -14.1% 817562 ± 7% numa-numastat.node2.numa_hit
684874 ± 4% -13.1% 595283 ± 7% numa-vmstat.node2.numa_hit
22864 ± 5% -12.7% 19967 ± 5% sched_debug.cfs_rq[57]:/.exec_clock
190734 ± 5% -16.3% 159695 ± 8% sched_debug.cfs_rq[23]:/.min_vruntime
237300 ± 6% -14.9% 202014 ± 7% numa-vmstat.node3.nr_page_table_pages
949123 ± 6% -14.9% 808058 ± 7% numa-meminfo.node3.PageTables
11.45 ± 4% +12.2% 12.84 ± 7% perf-profile.cpu-cycles.task_numa_work.task_work_run.do_notify_resume.retint_signal
561716 ± 7% +22.7% 689210 ± 5% sched_debug.cpu#10.avg_idle
23421 ± 4% -12.5% 20484 ± 5% sched_debug.cfs_rq[45]:/.exec_clock
23090 ± 4% -13.4% 19999 ± 6% sched_debug.cfs_rq[53]:/.exec_clock
2257945 ± 6% -14.5% 1929848 ± 7% numa-meminfo.node3.SUnreclaim
564591 ± 6% -14.5% 482457 ± 7% numa-vmstat.node3.nr_slab_unreclaimable
7903 ± 0% -13.6% 6830 ± 1% sched_debug.cfs_rq[11]:/.tg->runnable_avg
522411 ± 6% +15.9% 605704 ± 4% sched_debug.cpu#59.avg_idle
7899 ± 0% -13.6% 6827 ± 1% sched_debug.cfs_rq[10]:/.tg->runnable_avg
7884 ± 0% -13.6% 6811 ± 1% sched_debug.cfs_rq[2]:/.tg->runnable_avg
7913 ± 0% -13.6% 6839 ± 1% sched_debug.cfs_rq[14]:/.tg->runnable_avg
2272179 ± 6% -14.4% 1944358 ± 7% numa-meminfo.node3.Slab
7896 ± 0% -13.6% 6826 ± 1% sched_debug.cfs_rq[9]:/.tg->runnable_avg
7894 ± 0% -13.6% 6822 ± 1% sched_debug.cfs_rq[8]:/.tg->runnable_avg
7877 ± 0% -13.6% 6802 ± 1% sched_debug.cfs_rq[0]:/.tg->runnable_avg
7890 ± 0% -13.6% 6817 ± 1% sched_debug.cfs_rq[4]:/.tg->runnable_avg
7891 ± 0% -13.6% 6816 ± 1% sched_debug.cfs_rq[5]:/.tg->runnable_avg
7894 ± 0% -13.6% 6823 ± 1% sched_debug.cfs_rq[7]:/.tg->runnable_avg
512300 ± 6% +18.2% 605480 ± 9% sched_debug.cpu#50.avg_idle
7908 ± 0% -13.6% 6836 ± 1% sched_debug.cfs_rq[13]:/.tg->runnable_avg
7888 ± 0% -13.6% 6814 ± 1% sched_debug.cfs_rq[3]:/.tg->runnable_avg
7916 ± 0% -13.6% 6843 ± 1% sched_debug.cfs_rq[15]:/.tg->runnable_avg
7892 ± 0% -13.6% 6818 ± 1% sched_debug.cfs_rq[6]:/.tg->runnable_avg
178921 ± 1% -17.9% 146921 ± 9% sched_debug.cpu#2.sched_goidle
7918 ± 0% -13.5% 6848 ± 1% sched_debug.cfs_rq[16]:/.tg->runnable_avg
7883 ± 0% -13.6% 6809 ± 1% sched_debug.cfs_rq[1]:/.tg->runnable_avg
7903 ± 0% -13.5% 6832 ± 1% sched_debug.cfs_rq[12]:/.tg->runnable_avg
7930 ± 0% -13.5% 6861 ± 1% sched_debug.cfs_rq[20]:/.tg->runnable_avg
7925 ± 0% -13.5% 6859 ± 1% sched_debug.cfs_rq[19]:/.tg->runnable_avg
7921 ± 0% -13.5% 6852 ± 1% sched_debug.cfs_rq[17]:/.tg->runnable_avg
7932 ± 0% -13.4% 6866 ± 1% sched_debug.cfs_rq[21]:/.tg->runnable_avg
358611 ± 1% -17.9% 294548 ± 9% sched_debug.cpu#2.nr_switches
7922 ± 0% -13.4% 6857 ± 1% sched_debug.cfs_rq[18]:/.tg->runnable_avg
7985 ± 0% -13.4% 6918 ± 1% sched_debug.cfs_rq[36]:/.tg->runnable_avg
555502 ± 4% +16.3% 646081 ± 5% sched_debug.cpu#5.avg_idle
7944 ± 0% -13.5% 6876 ± 1% sched_debug.cfs_rq[24]:/.tg->runnable_avg
7994 ± 0% -13.4% 6926 ± 1% sched_debug.cfs_rq[39]:/.tg->runnable_avg
7959 ± 0% -13.4% 6892 ± 1% sched_debug.cfs_rq[28]:/.tg->runnable_avg
7997 ± 0% -13.3% 6930 ± 1% sched_debug.cfs_rq[40]:/.tg->runnable_avg
7962 ± 0% -13.4% 6895 ± 1% sched_debug.cfs_rq[29]:/.tg->runnable_avg
7935 ± 0% -13.4% 6869 ± 1% sched_debug.cfs_rq[22]:/.tg->runnable_avg
7982 ± 0% -13.4% 6915 ± 1% sched_debug.cfs_rq[35]:/.tg->runnable_avg
8000 ± 0% -13.3% 6932 ± 1% sched_debug.cfs_rq[41]:/.tg->runnable_avg
7951 ± 0% -13.4% 6884 ± 1% sched_debug.cfs_rq[26]:/.tg->runnable_avg
7954 ± 0% -13.4% 6889 ± 1% sched_debug.cfs_rq[27]:/.tg->runnable_avg
7976 ± 0% -13.4% 6911 ± 1% sched_debug.cfs_rq[34]:/.tg->runnable_avg
7937 ± 0% -13.4% 6872 ± 1% sched_debug.cfs_rq[23]:/.tg->runnable_avg
8003 ± 0% -13.3% 6937 ± 1% sched_debug.cfs_rq[43]:/.tg->runnable_avg
765 ± 0% -13.1% 665 ± 1% time.percent_of_cpu_this_job_got
7964 ± 0% -13.4% 6896 ± 1% sched_debug.cfs_rq[30]:/.tg->runnable_avg
7987 ± 0% -13.4% 6919 ± 1% sched_debug.cfs_rq[37]:/.tg->runnable_avg
8027 ± 0% -13.3% 6961 ± 1% sched_debug.cfs_rq[50]:/.tg->runnable_avg
7988 ± 0% -13.4% 6921 ± 1% sched_debug.cfs_rq[38]:/.tg->runnable_avg
7946 ± 0% -13.4% 6883 ± 1% sched_debug.cfs_rq[25]:/.tg->runnable_avg
8025 ± 0% -13.3% 6955 ± 1% sched_debug.cfs_rq[48]:/.tg->runnable_avg
8012 ± 0% -13.3% 6944 ± 1% sched_debug.cfs_rq[45]:/.tg->runnable_avg
7974 ± 0% -13.3% 6909 ± 1% sched_debug.cfs_rq[33]:/.tg->runnable_avg
1.13 ± 1% -14.8% 0.96 ± 7% perf-profile.cpu-cycles.update_process_times.tick_sched_handle.tick_sched_timer.__run_hrtimer.hrtimer_interrupt
8000 ± 0% -13.3% 6933 ± 1% sched_debug.cfs_rq[42]:/.tg->runnable_avg
8035 ± 0% -13.3% 6969 ± 1% sched_debug.cfs_rq[51]:/.tg->runnable_avg
8024 ± 0% -13.3% 6954 ± 1% sched_debug.cfs_rq[47]:/.tg->runnable_avg
8014 ± 0% -13.3% 6950 ± 1% sched_debug.cfs_rq[46]:/.tg->runnable_avg
8026 ± 0% -13.3% 6959 ± 1% sched_debug.cfs_rq[49]:/.tg->runnable_avg
7968 ± 0% -13.4% 6902 ± 1% sched_debug.cfs_rq[31]:/.tg->runnable_avg
37.12 ± 0% -12.9% 32.34 ± 2% perf-profile.cpu-cycles.vma_link.mmap_region.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff
8007 ± 0% -13.4% 6938 ± 1% sched_debug.cfs_rq[44]:/.tg->runnable_avg
8037 ± 0% -13.2% 6973 ± 1% sched_debug.cfs_rq[52]:/.tg->runnable_avg
7968 ± 0% -13.3% 6906 ± 1% sched_debug.cfs_rq[32]:/.tg->runnable_avg
1.13 ± 1% -14.1% 0.97 ± 7% perf-profile.cpu-cycles.tick_sched_handle.isra.18.tick_sched_timer.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt
8068 ± 0% -13.1% 7007 ± 1% sched_debug.cfs_rq[63]:/.tg->runnable_avg
8040 ± 0% -13.2% 6977 ± 1% sched_debug.cfs_rq[53]:/.tg->runnable_avg
8053 ± 0% -13.2% 6990 ± 1% sched_debug.cfs_rq[57]:/.tg->runnable_avg
8064 ± 0% -13.1% 7004 ± 1% sched_debug.cfs_rq[61]:/.tg->runnable_avg
8049 ± 0% -13.2% 6985 ± 1% sched_debug.cfs_rq[56]:/.tg->runnable_avg
8070 ± 0% -13.1% 7009 ± 1% sched_debug.cfs_rq[64]:/.tg->runnable_avg
3595633 ± 5% -12.9% 3133416 ± 6% numa-meminfo.node3.MemUsed
8055 ± 0% -13.2% 6993 ± 1% sched_debug.cfs_rq[58]:/.tg->runnable_avg
8071 ± 0% -13.1% 7014 ± 1% sched_debug.cfs_rq[65]:/.tg->runnable_avg
8046 ± 0% -13.2% 6983 ± 1% sched_debug.cfs_rq[55]:/.tg->runnable_avg
8045 ± 0% -13.3% 6978 ± 1% sched_debug.cfs_rq[54]:/.tg->runnable_avg
8086 ± 0% -13.1% 7027 ± 1% sched_debug.cfs_rq[71]:/.tg->runnable_avg
8137 ± 0% -13.0% 7080 ± 1% sched_debug.cfs_rq[91]:/.tg->runnable_avg
8081 ± 0% -13.1% 7022 ± 1% sched_debug.cfs_rq[68]:/.tg->runnable_avg
8076 ± 0% -13.1% 7017 ± 1% sched_debug.cfs_rq[66]:/.tg->runnable_avg
8062 ± 0% -13.1% 7002 ± 1% sched_debug.cfs_rq[60]:/.tg->runnable_avg
8139 ± 0% -12.9% 7085 ± 1% sched_debug.cfs_rq[92]:/.tg->runnable_avg
8088 ± 0% -13.1% 7031 ± 1% sched_debug.cfs_rq[72]:/.tg->runnable_avg
8064 ± 0% -13.1% 7006 ± 1% sched_debug.cfs_rq[62]:/.tg->runnable_avg
8143 ± 0% -12.9% 7090 ± 1% sched_debug.cfs_rq[94]:/.tg->runnable_avg
41932371 ± 0% -13.0% 36489731 ± 1% slabinfo.vm_area_struct.active_objs
8078 ± 0% -13.1% 7019 ± 1% sched_debug.cfs_rq[67]:/.tg->runnable_avg
8083 ± 0% -13.1% 7025 ± 1% sched_debug.cfs_rq[69]:/.tg->runnable_avg
8058 ± 0% -13.2% 6997 ± 1% sched_debug.cfs_rq[59]:/.tg->runnable_avg
8142 ± 0% -12.9% 7089 ± 1% sched_debug.cfs_rq[93]:/.tg->runnable_avg
8084 ± 0% -13.1% 7028 ± 1% sched_debug.cfs_rq[70]:/.tg->runnable_avg
8134 ± 0% -13.0% 7078 ± 1% sched_debug.cfs_rq[90]:/.tg->runnable_avg
8123 ± 0% -13.1% 7062 ± 1% sched_debug.cfs_rq[84]:/.tg->runnable_avg
3274295 ± 0% -13.0% 2849232 ± 1% meminfo.PageTables
818565 ± 0% -13.0% 712300 ± 1% proc-vmstat.nr_page_table_pages
8094 ± 0% -13.0% 7038 ± 1% sched_debug.cfs_rq[74]:/.tg->runnable_avg
8133 ± 0% -13.0% 7077 ± 1% sched_debug.cfs_rq[89]:/.tg->runnable_avg
8103 ± 0% -13.0% 7046 ± 1% sched_debug.cfs_rq[77]:/.tg->runnable_avg
8144 ± 0% -12.9% 7094 ± 1% sched_debug.cfs_rq[95]:/.tg->runnable_avg
8146 ± 0% -12.9% 7096 ± 1% sched_debug.cfs_rq[96]:/.tg->runnable_avg
8128 ± 0% -13.0% 7070 ± 1% sched_debug.cfs_rq[86]:/.tg->runnable_avg
8091 ± 0% -13.0% 7035 ± 1% sched_debug.cfs_rq[73]:/.tg->runnable_avg
536950 ± 10% +23.4% 662508 ± 6% sched_debug.cpu#30.avg_idle
8096 ± 0% -13.1% 7039 ± 1% sched_debug.cfs_rq[75]:/.tg->runnable_avg
8127 ± 0% -13.0% 7067 ± 1% sched_debug.cfs_rq[85]:/.tg->runnable_avg
8149 ± 0% -12.9% 7097 ± 1% sched_debug.cfs_rq[97]:/.tg->runnable_avg
8151 ± 0% -12.9% 7100 ± 1% sched_debug.cfs_rq[99]:/.tg->runnable_avg
8153 ± 0% -12.9% 7101 ± 1% sched_debug.cfs_rq[100]:/.tg->runnable_avg
8129 ± 0% -13.0% 7074 ± 1% sched_debug.cfs_rq[87]:/.tg->runnable_avg
8118 ± 0% -13.0% 7060 ± 1% sched_debug.cfs_rq[83]:/.tg->runnable_avg
8107 ± 0% -13.1% 7047 ± 1% sched_debug.cfs_rq[78]:/.tg->runnable_avg
8111 ± 0% -13.0% 7054 ± 1% sched_debug.cfs_rq[80]:/.tg->runnable_avg
8098 ± 0% -13.0% 7044 ± 1% sched_debug.cfs_rq[76]:/.tg->runnable_avg
42188778 ± 0% -12.9% 36733179 ± 1% slabinfo.vm_area_struct.num_objs
958835 ± 0% -12.9% 834844 ± 1% slabinfo.vm_area_struct.num_slabs
958835 ± 0% -12.9% 834844 ± 1% slabinfo.vm_area_struct.active_slabs
8154 ± 0% -12.9% 7103 ± 1% sched_debug.cfs_rq[101]:/.tg->runnable_avg
8116 ± 0% -13.0% 7058 ± 1% sched_debug.cfs_rq[82]:/.tg->runnable_avg
8130 ± 0% -12.9% 7077 ± 1% sched_debug.cfs_rq[88]:/.tg->runnable_avg
8171 ± 0% -12.9% 7120 ± 1% sched_debug.cfs_rq[107]:/.tg->runnable_avg
8113 ± 0% -13.0% 7058 ± 1% sched_debug.cfs_rq[81]:/.tg->runnable_avg
8109 ± 0% -13.1% 7051 ± 1% sched_debug.cfs_rq[79]:/.tg->runnable_avg
8155 ± 0% -12.9% 7106 ± 1% sched_debug.cfs_rq[102]:/.tg->runnable_avg
8157 ± 0% -12.8% 7111 ± 1% sched_debug.cfs_rq[103]:/.tg->runnable_avg
8165 ± 0% -12.9% 7115 ± 1% sched_debug.cfs_rq[105]:/.tg->runnable_avg
8159 ± 0% -12.8% 7113 ± 1% sched_debug.cfs_rq[104]:/.tg->runnable_avg
8148 ± 0% -12.9% 7099 ± 1% sched_debug.cfs_rq[98]:/.tg->runnable_avg
8169 ± 0% -12.9% 7118 ± 1% sched_debug.cfs_rq[106]:/.tg->runnable_avg
1.78 ± 2% -11.3% 1.58 ± 4% perf-profile.cpu-cycles.tick_sched_timer.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt
7802174 ± 0% -12.8% 6805780 ± 1% meminfo.SUnreclaim
1950525 ± 0% -12.8% 1701410 ± 1% proc-vmstat.nr_slab_unreclaimable
8198 ± 0% -12.7% 7154 ± 1% sched_debug.cfs_rq[119]:/.tg->runnable_avg
8175 ± 0% -12.8% 7125 ± 1% sched_debug.cfs_rq[109]:/.tg->runnable_avg
8180 ± 0% -12.8% 7136 ± 1% sched_debug.cfs_rq[112]:/.tg->runnable_avg
8188 ± 0% -12.8% 7143 ± 1% sched_debug.cfs_rq[115]:/.tg->runnable_avg
8194 ± 0% -12.7% 7151 ± 1% sched_debug.cfs_rq[117]:/.tg->runnable_avg
8176 ± 0% -12.8% 7129 ± 1% sched_debug.cfs_rq[110]:/.tg->runnable_avg
8189 ± 0% -12.8% 7145 ± 1% sched_debug.cfs_rq[116]:/.tg->runnable_avg
189413 ± 4% -13.7% 163494 ± 8% sched_debug.cfs_rq[25]:/.min_vruntime
8184 ± 0% -12.7% 7141 ± 1% sched_debug.cfs_rq[114]:/.tg->runnable_avg
8182 ± 0% -12.8% 7137 ± 1% sched_debug.cfs_rq[113]:/.tg->runnable_avg
8172 ± 0% -12.8% 7122 ± 1% sched_debug.cfs_rq[108]:/.tg->runnable_avg
8193 ± 0% -12.7% 7152 ± 1% sched_debug.cfs_rq[118]:/.tg->runnable_avg
8178 ± 0% -12.8% 7133 ± 1% sched_debug.cfs_rq[111]:/.tg->runnable_avg
7859652 ± 0% -12.7% 6863230 ± 1% meminfo.Slab
0.95 ± 6% +15.6% 1.10 ± 3% perf-profile.cpu-cycles.__fget.fget.sys_mmap_pgoff.sys_mmap.system_call_fastpath
1.10 ± 2% -10.5% 0.98 ± 4% perf-profile.cpu-cycles.ktime_get.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns
23237 ± 4% -13.3% 20143 ± 6% sched_debug.cfs_rq[51]:/.exec_clock
1.82 ± 2% -11.0% 1.62 ± 4% perf-profile.cpu-cycles.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.97 ± 7% +14.0% 1.11 ± 3% perf-profile.cpu-cycles.fget.sys_mmap_pgoff.sys_mmap.system_call_fastpath
23242 ± 4% -12.9% 20253 ± 6% sched_debug.cfs_rq[49]:/.exec_clock
22886 ± 5% -13.7% 19749 ± 5% sched_debug.cfs_rq[56]:/.exec_clock
1036 ± 0% -11.9% 914 ± 1% time.user_time
8527124 ± 0% -11.6% 7534220 ± 1% vmstat.memory.cache
1695225 ± 0% -10.7% 1513459 ± 1% softirqs.TIMER
23318 ± 6% -13.1% 20269 ± 6% sched_debug.cfs_rq[54]:/.exec_clock
667649 ± 3% -10.0% 600607 ± 4% numa-vmstat.node3.numa_local
7.244e+08 ± 0% -11.1% 6.439e+08 ± 1% time.minor_page_faults
7.254e+08 ± 0% -11.1% 6.449e+08 ± 1% proc-vmstat.pgfault
1.92 ± 2% -10.9% 1.71 ± 4% perf-profile.cpu-cycles.read_hpet.ktime_get.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns
22971 ± 5% -12.9% 19998 ± 5% sched_debug.cfs_rq[55]:/.exec_clock
131 ± 10% -11.7% 115 ± 6% sched_debug.cfs_rq[52]:/.tg_runnable_contrib
42.89 ± 0% -10.4% 38.41 ± 2% perf-profile.cpu-cycles.mmap_region.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap
6053 ± 10% -11.6% 5349 ± 6% sched_debug.cfs_rq[52]:/.avg->runnable_avg_sum
753344 ± 2% -9.0% 685539 ± 4% numa-vmstat.node3.numa_hit
501098 ± 0% -11.4% 443942 ± 2% softirqs.SCHED
1.19 ± 2% -9.0% 1.08 ± 3% perf-profile.cpu-cycles.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns.tick_nohz_restart
90940 ± 2% +9.4% 99459 ± 2% sched_debug.cpu#54.nr_load_updates
88590 ± 2% +9.8% 97229 ± 4% sched_debug.cpu#2.nr_load_updates
90669 ± 2% +9.6% 99355 ± 2% sched_debug.cpu#56.nr_load_updates
91272 ± 2% +9.4% 99833 ± 2% sched_debug.cpu#49.nr_load_updates
1.22 ± 1% +10.5% 1.35 ± 2% perf-profile.cpu-cycles.schedule.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
89287 ± 3% +10.3% 98507 ± 4% sched_debug.cpu#1.nr_load_updates
45.38 ± 0% -9.4% 41.10 ± 2% perf-profile.cpu-cycles.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap.system_call_fastpath
22980 ± 5% -12.4% 20128 ± 6% sched_debug.cfs_rq[50]:/.exec_clock
1.19 ± 2% -8.5% 1.09 ± 4% perf-profile.cpu-cycles.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns.tick_nohz_restart.tick_nohz_idle_exit
5570129 ± 0% -9.4% 5048932 ± 1% proc-vmstat.pgalloc_normal
1100174 ± 3% -6.9% 1024326 ± 3% numa-numastat.node3.local_node
2.06 ± 2% -9.1% 1.87 ± 4% perf-profile.cpu-cycles.print_context_stack.dump_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity
46.01 ± 0% -9.2% 41.78 ± 2% perf-profile.cpu-cycles.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap.system_call_fastpath
91494 ± 2% +10.3% 100902 ± 2% sched_debug.cpu#46.nr_load_updates
20296 ± 3% -24.7% 15293 ± 3% vmstat.system.in
140148 ± 0% -21.9% 109393 ± 1% vmstat.system.cs
191 ± 0% -19.5% 153 ± 0% turbostat.CorWatt
257 ± 0% -14.7% 219 ± 0% turbostat.PkgWatt
218 ± 0% -13.5% 188 ± 1% turbostat.Avg_MHz
6.84 ± 0% -13.6% 5.91 ± 1% turbostat.%Busy
578 ± 0% -8.5% 529 ± 0% pmeter.Average_Active_Power
73.34 ± 0% -3.0% 71.15 ± 0% turbostat.RAMWatt
brickland3: Brickland Ivy Bridge-EX
Memory: 512G
vm-scalability.stddev
16 ++---------------------------------------------------------------------+
| O |
14 ++ O O |
12 ++ O O O O O |
| O OO O O |
10 O+ O O O O O |
| O O O O O O O O O O |
8 ++ O O |
| O O O |
6 ++ O |
4 ++ |
| .* .* *. .* *.|
2 *+**. .*.* .* *.**. * + *.** + : * * *.*. .*.**.* *
| ** *.* *.**.*.* *.* * * *.*.* ** |
0 ++---------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
To reproduce:
apt-get install ruby
git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
cd lkp-tests
bin/setup-local job.yaml # the job file attached in this email
bin/run-local job.yaml
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Ying Huang
_______________________________________________
LKP mailing list
LKP(a)linux.intel.com
[-- Attachment #2: job.yaml --]
[-- Type: text/plain, Size: 1710 bytes --]
---
testcase: vm-scalability
default-monitors:
wait: pre-test
uptime:
iostat:
vmstat:
numa-numastat:
numa-vmstat:
numa-meminfo:
proc-vmstat:
proc-stat:
meminfo:
slabinfo:
interrupts:
lock_stat:
latency_stats:
softirqs:
bdi_dev_mapping:
diskstats:
nfsstat:
cpuidle:
cpufreq-stats:
turbostat:
pmeter:
sched_debug:
interval: 10
default_watchdogs:
watch-oom:
watchdog:
cpufreq_governor: performance
commit: ce43fa581f61c4756301e7fd8609f50579e13d5d
model: Brickland Ivy Bridge-EX
nr_cpu: 120
memory: 512G
hdd_partitions:
swap_partitions:
pmeter_server: lkp-st01
pmeter_device: yokogawa-wt310
perf-profile:
runtime: 300s
size:
vm-scalability:
test: small-allocs
testbox: brickland3
tbox_group: brickland3
kconfig: x86_64-rhel
enqueue_time: 2015-03-08 04:48:33.187343214 +08:00
head_commit: ce43fa581f61c4756301e7fd8609f50579e13d5d
base_commit: 13a7a6ac0a11197edcd0f756a035f472b42cdf8b
branch: linux-devel/devel-hourly-2015030900
kernel: "/kernel/x86_64-rhel/ce43fa581f61c4756301e7fd8609f50579e13d5d/vmlinuz-4.0.0-rc2-00784-gce43fa5"
user: lkp
queue: cyclic
rootfs: debian-x86_64-2015-02-07.cgz
result_root: "/result/brickland3/vm-scalability/performance-300s-small-allocs/debian-x86_64-2015-02-07.cgz/x86_64-rhel/ce43fa581f61c4756301e7fd8609f50579e13d5d/0"
job_file: "/lkp/scheduled/brickland3/cyclic_vm-scalability-performance-300s-small-allocs-x86_64-rhel-HEAD-ce43fa581f61c4756301e7fd8609f50579e13d5d-0-20150308-92360-aeasab.yaml"
dequeue_time: 2015-03-09 06:20:56.728013487 +08:00
job_state: finished
loadavg: 78.64 75.53 36.25 1/953 14075
start_time: '1425853327'
end_time: '1425853675'
version: "/lkp/lkp/.src-20150308-175746"
[-- Attachment #3: reproduce.ksh --]
[-- Type: text/plain, Size: 9275 bytes --]
echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu10/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu100/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu101/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu102/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu103/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu104/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu105/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu106/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu107/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu108/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu109/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu11/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu110/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu111/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu112/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu113/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu114/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu115/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu116/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu117/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu118/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu119/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu12/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu13/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu14/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu15/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu16/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu17/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu18/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu19/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu2/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu20/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu21/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu22/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu23/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu24/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu25/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu26/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu27/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu28/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu29/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu3/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu30/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu31/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu32/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu33/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu34/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu35/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu36/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu37/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu38/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu39/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu4/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu40/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu41/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu42/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu43/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu44/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu45/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu46/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu47/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu48/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu49/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu5/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu50/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu51/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu52/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu53/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu54/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu55/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu56/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu57/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu58/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu59/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu6/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu60/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu61/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu62/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu63/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu64/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu65/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu66/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu67/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu68/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu69/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu7/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu70/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu71/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu72/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu73/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu74/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu75/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu76/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu77/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu78/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu79/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu8/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu80/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu81/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu82/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu83/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu84/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu85/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu86/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu87/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu88/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu89/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu9/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu90/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu91/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu92/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu93/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu94/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu95/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu96/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu97/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu98/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu99/cpufreq/scaling_governor
mount -t tmpfs -o size=100% vm-scalability-tmp /tmp/vm-scalability-tmp
truncate -s 540949544960 /tmp/vm-scalability.img
mkfs.xfs -q /tmp/vm-scalability.img
mount -o loop /tmp/vm-scalability.img /tmp/vm-scalability
./case-small-allocs
./usemem --runtime 300 -n 120 --readonly --unit 40960 36650387592
umount /tmp/vm-scalability-tmp
umount /tmp/vm-scalability
rm /tmp/vm-scalability.img
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [LKP] [locking/rwsem] b3fd4f03ca0: -11.1% vm-scalability.throughput
2015-03-13 5:38 [LKP] " Huang Ying
@ 2015-03-13 7:42 ` Ingo Molnar
0 siblings, 0 replies; 4+ messages in thread
From: Ingo Molnar @ 2015-03-13 7:42 UTC (permalink / raw)
To: Huang Ying
Cc: Davidlohr Bueso, LKML, LKP ML, Davidlohr Bueso, Peter Zijlstra,
Jason Low, Linus Torvalds, Michel Lespinasse, Paul E. McKenney,
Tim Chen, Thomas Gleixner, Mike Galbraith
* Huang Ying <ying.huang@intel.com> wrote:
> Sorry for duplicated email. Forget to send to the patch author.
You also forgot to Cc: the gents in the commit log - all those nice
Cc: fields listed there are useful when discussing problems with a
commit, so I've added them.
(Regression report quoted below.)
Thanks,
Ingo
>
> FYI, we noticed the below changes on
>
> git://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git master
> commit b3fd4f03ca0b9952221f39ae6790e698bf4b39e7 ("locking/rwsem: Avoid deceiving lock spinners")
>
>
> testbox/testcase/testparams: brickland3/vm-scalability/performance-300s-small-allocs
>
> 7a215f89a0335582 b3fd4f03ca0b9952221f39ae67
> ---------------- --------------------------
> %stddev %change %stddev
> \ | \
> 2.38 ± 18% +247.4% 8.27 ± 16% vm-scalability.stddev
> 24226456 ± 0% -23.0% 18650874 ± 1% vm-scalability.time.voluntary_context_switches
> 1622 ± 0% -15.6% 1369 ± 1% vm-scalability.time.system_time
> 765 ± 0% -13.1% 665 ± 1% vm-scalability.time.percent_of_cpu_this_job_got
> 1036 ± 0% -11.9% 914 ± 1% vm-scalability.time.user_time
> 7.244e+08 ± 0% -11.1% 6.439e+08 ± 1% vm-scalability.time.minor_page_faults
> 10841276 ± 0% -11.1% 9639981 ± 1% vm-scalability.throughput
> 8922883 ± 3% -70.2% 2658543 ± 4% cpuidle.C1-IVT-4S.usage
> 1.19e+10 ± 2% -66.2% 4.016e+09 ± 4% cpuidle.C1-IVT-4S.time
> 1.97 ± 4% +106.7% 4.08 ± 6% perf-profile.cpu-cycles.intel_idle.cpuidle_enter_state.cpuidle_enter.cpu_startup_entry.start_secondary
> 58.29 ± 1% -50.2% 29.03 ± 2% turbostat.CPU%c1
> 34.84 ± 2% +86.6% 65.01 ± 1% turbostat.CPU%c6
> 170814 ± 7% -39.9% 102682 ± 11% sched_debug.cpu#21.sched_goidle
> 367762 ± 11% -39.9% 220850 ± 10% sched_debug.cpu#26.sched_count
> 5.12 ± 2% -39.8% 3.08 ± 5% perf-profile.cpu-cycles.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
> 342453 ± 7% -39.9% 205985 ± 11% sched_debug.cpu#21.nr_switches
> 3.14 ± 2% +68.0% 5.28 ± 5% perf-profile.cpu-cycles.cpuidle_enter_state.cpuidle_enter.cpu_startup_entry.start_secondary
> 170317 ± 6% -39.9% 102389 ± 11% sched_debug.cpu#22.sched_goidle
> 168710 ± 6% -38.4% 103876 ± 11% sched_debug.cpu#23.sched_goidle
> 341400 ± 6% -39.8% 205416 ± 11% sched_debug.cpu#22.nr_switches
> 338590 ± 6% -38.5% 208381 ± 11% sched_debug.cpu#23.nr_switches
> 165879 ± 4% -36.6% 105178 ± 10% sched_debug.cpu#18.sched_goidle
> 168958 ± 6% -39.0% 103043 ± 11% sched_debug.cpu#20.sched_goidle
> 359148 ± 5% -39.2% 218455 ± 11% sched_debug.cpu#20.sched_count
> 332511 ± 4% -36.5% 211029 ± 10% sched_debug.cpu#18.nr_switches
> 338875 ± 6% -39.0% 206782 ± 11% sched_debug.cpu#20.nr_switches
> 359968 ± 6% -39.4% 218057 ± 12% sched_debug.cpu#21.sched_count
> 166207 ± 4% -38.5% 102168 ± 11% sched_debug.cpu#27.sched_goidle
> 164881 ± 6% -37.0% 103846 ± 11% sched_debug.cpu#25.sched_goidle
> 330721 ± 6% -37.0% 208344 ± 11% sched_debug.cpu#25.nr_switches
> 333161 ± 4% -38.3% 205591 ± 11% sched_debug.cpu#27.nr_switches
> 362674 ± 7% -40.1% 217123 ± 10% sched_debug.cpu#22.sched_count
> 350433 ± 7% -37.3% 219595 ± 13% sched_debug.cpu#15.nr_switches
> 174599 ± 7% -37.4% 109366 ± 13% sched_debug.cpu#15.sched_goidle
> 174038 ± 9% -36.8% 109941 ± 12% sched_debug.cpu#17.sched_goidle
> 348896 ± 9% -36.7% 220793 ± 12% sched_debug.cpu#17.nr_switches
> 327443 ± 6% -36.8% 207015 ± 11% sched_debug.cpu#24.nr_switches
> 348687 ± 5% -37.2% 219100 ± 11% sched_debug.cpu#27.sched_count
> 163220 ± 6% -36.9% 103066 ± 11% sched_debug.cpu#24.sched_goidle
> 167997 ± 5% -35.7% 108017 ± 11% sched_debug.cpu#16.sched_goidle
> 365757 ± 10% -38.9% 223561 ± 12% sched_debug.cpu#28.sched_count
> 336756 ± 5% -35.6% 216751 ± 11% sched_debug.cpu#16.nr_switches
> 174236 ± 12% -40.6% 103542 ± 10% sched_debug.cpu#26.sched_goidle
> 349494 ± 12% -40.6% 207718 ± 10% sched_debug.cpu#26.nr_switches
> 175130 ± 10% -39.7% 105573 ± 13% sched_debug.cpu#28.sched_goidle
> 351090 ± 10% -39.6% 212090 ± 13% sched_debug.cpu#28.nr_switches
> 350972 ± 5% -35.2% 227402 ± 10% sched_debug.cpu#19.sched_count
> 343794 ± 5% -36.2% 219297 ± 10% sched_debug.cpu#24.sched_count
> 347268 ± 5% -36.3% 221228 ± 10% sched_debug.cpu#25.sched_count
> 352999 ± 5% -34.1% 232554 ± 9% sched_debug.cpu#16.sched_count
> 354362 ± 7% -37.0% 223292 ± 10% sched_debug.cpu#23.sched_count
> 166091 ± 7% -36.6% 105356 ± 14% sched_debug.cpu#29.sched_goidle
> 350840 ± 6% -35.5% 226331 ± 13% sched_debug.cpu#29.sched_count
> 332928 ± 7% -36.4% 211785 ± 14% sched_debug.cpu#29.nr_switches
> 369396 ± 7% -36.4% 234822 ± 13% sched_debug.cpu#15.sched_count
> 364063 ± 9% -34.6% 238151 ± 11% sched_debug.cpu#17.sched_count
> 349193 ± 4% -35.2% 226315 ± 9% sched_debug.cpu#18.sched_count
> 3.94 ± 1% +49.9% 5.90 ± 5% perf-profile.cpu-cycles.cpuidle_enter.cpu_startup_entry.start_secondary
> 5361900 ± 1% +50.5% 8067121 ± 0% cpuidle.C6-IVT-4S.usage
> 166471 ± 5% -36.3% 106063 ± 10% sched_debug.cpu#19.sched_goidle
> 334078 ± 5% -36.3% 212767 ± 10% sched_debug.cpu#19.nr_switches
> 511523 ± 11% +40.1% 716466 ± 9% sched_debug.cpu#38.avg_idle
> 5141 ± 10% -21.3% 4046 ± 18% sched_debug.cfs_rq[16]:/.avg->runnable_avg_sum
> 185324 ± 6% -28.9% 131826 ± 11% sched_debug.cpu#43.ttwu_count
> 111 ± 10% -21.6% 87 ± 18% sched_debug.cfs_rq[16]:/.tg_runnable_contrib
> 188387 ± 5% -28.4% 134976 ± 11% sched_debug.cpu#35.ttwu_count
> 182306 ± 7% -28.0% 131276 ± 9% sched_debug.cpu#19.ttwu_count
> 181618 ± 5% -28.6% 129685 ± 10% sched_debug.cpu#18.ttwu_count
> 370815 ± 7% -25.5% 276125 ± 11% sched_debug.cpu#38.sched_count
> 178281 ± 7% -25.9% 132044 ± 11% sched_debug.cpu#38.sched_goidle
> 181914 ± 5% -28.0% 130970 ± 8% sched_debug.cpu#16.ttwu_count
> 357347 ± 7% -25.9% 264826 ± 11% sched_debug.cpu#38.nr_switches
> 546593 ± 7% +38.6% 757389 ± 4% sched_debug.cpu#27.avg_idle
> 183057 ± 5% -27.7% 132439 ± 8% sched_debug.cpu#17.ttwu_count
> 174289 ± 8% -25.5% 129871 ± 13% sched_debug.cpu#43.sched_goidle
> 349323 ± 8% -25.4% 260438 ± 13% sched_debug.cpu#43.nr_switches
> 187088 ± 5% -27.4% 135758 ± 10% sched_debug.cpu#36.ttwu_count
> 190589 ± 5% -29.1% 135135 ± 12% sched_debug.cpu#33.ttwu_count
> 179655 ± 10% -28.6% 128343 ± 13% sched_debug.cpu#44.sched_goidle
> 367566 ± 11% -26.0% 271924 ± 14% sched_debug.cpu#43.sched_count
> 360119 ± 10% -28.5% 257380 ± 13% sched_debug.cpu#44.nr_switches
> 177427 ± 5% -25.5% 132241 ± 9% sched_debug.cpu#20.ttwu_count
> 187477 ± 6% -28.9% 133263 ± 11% sched_debug.cpu#39.ttwu_count
> 187313 ± 5% -28.7% 133487 ± 11% sched_debug.cpu#41.ttwu_count
> 192203 ± 4% -28.3% 137818 ± 10% sched_debug.cpu#31.ttwu_count
> 183679 ± 5% -28.1% 132147 ± 10% sched_debug.cpu#44.ttwu_count
> 367665 ± 9% -24.6% 277237 ± 15% sched_debug.cpu#42.sched_count
> 178211 ± 3% -26.9% 130348 ± 8% sched_debug.cpu#23.ttwu_count
> 175478 ± 4% -25.6% 130478 ± 9% sched_debug.cpu#22.ttwu_count
> 186974 ± 6% -27.6% 135310 ± 10% sched_debug.cpu#38.ttwu_count
> 190431 ± 4% -28.0% 137033 ± 11% sched_debug.cpu#32.ttwu_count
> 190722 ± 4% -28.4% 136639 ± 10% sched_debug.cpu#34.ttwu_count
> 175431 ± 8% -25.3% 131079 ± 12% sched_debug.cpu#42.sched_goidle
> 361690 ± 8% -24.8% 272015 ± 13% sched_debug.cpu#39.sched_count
> 351619 ± 8% -25.2% 262838 ± 12% sched_debug.cpu#42.nr_switches
> 175056 ± 6% -24.8% 131564 ± 12% sched_debug.cpu#40.sched_goidle
> 350873 ± 6% -24.8% 263820 ± 12% sched_debug.cpu#40.nr_switches
> 173107 ± 6% -25.3% 129289 ± 13% sched_debug.cpu#37.sched_goidle
> 346966 ± 6% -25.3% 259257 ± 13% sched_debug.cpu#37.nr_switches
> 171359 ± 7% -24.8% 128941 ± 11% sched_debug.cpu#39.sched_goidle
> 343474 ± 7% -24.7% 258590 ± 11% sched_debug.cpu#39.nr_switches
> 375852 ± 12% -28.4% 269206 ± 15% sched_debug.cpu#44.sched_count
> 180303 ± 8% -25.0% 135309 ± 10% sched_debug.cpu#30.sched_goidle
> 177803 ± 5% -25.3% 132893 ± 9% sched_debug.cpu#21.ttwu_count
> 361386 ± 8% -24.9% 271330 ± 10% sched_debug.cpu#30.nr_switches
> 172414 ± 7% -24.9% 129400 ± 13% sched_debug.cpu#41.sched_goidle
> 345579 ± 7% -24.9% 259489 ± 13% sched_debug.cpu#41.nr_switches
> 373591 ± 8% -25.3% 279094 ± 13% sched_debug.cpu#31.sched_count
> 177533 ± 9% -26.9% 129812 ± 12% sched_debug.cpu#36.sched_goidle
> 179094 ± 8% -26.3% 131936 ± 11% sched_debug.cpu#35.sched_goidle
> 376042 ± 8% -26.7% 275458 ± 12% sched_debug.cpu#35.sched_count
> 355841 ± 9% -26.8% 260341 ± 12% sched_debug.cpu#36.nr_switches
> 183165 ± 12% -29.4% 129301 ± 13% sched_debug.cpu#33.sched_goidle
> 371977 ± 9% -27.3% 270521 ± 13% sched_debug.cpu#36.sched_count
> 184524 ± 5% -27.3% 134078 ± 10% sched_debug.cpu#42.ttwu_count
> 204591 ± 7% -22.5% 158606 ± 16% sched_debug.cfs_rq[33]:/.min_vruntime
> 358950 ± 8% -26.3% 264608 ± 11% sched_debug.cpu#35.nr_switches
> 367143 ± 12% -29.4% 259297 ± 13% sched_debug.cpu#33.nr_switches
> 184796 ± 5% -26.7% 135370 ± 8% sched_debug.cpu#15.ttwu_count
> 560186 ± 7% +36.4% 764034 ± 4% sched_debug.cpu#15.avg_idle
> 192024 ± 5% -27.6% 138984 ± 9% sched_debug.cpu#30.ttwu_count
> 186661 ± 5% -27.9% 134534 ± 11% sched_debug.cpu#40.ttwu_count
> 175890 ± 4% -26.4% 129452 ± 8% sched_debug.cpu#26.ttwu_count
> 366664 ± 8% -24.7% 276276 ± 14% sched_debug.cpu#34.sched_count
> 186046 ± 5% -26.7% 136338 ± 10% sched_debug.cpu#37.ttwu_count
> 173138 ± 4% -26.5% 127219 ± 8% sched_debug.cpu#28.ttwu_count
> 231881 ± 4% -26.0% 171683 ± 6% sched_debug.cpu#48.ttwu_count
> 229108 ± 4% -24.5% 173024 ± 5% sched_debug.cpu#47.ttwu_count
> 545213 ± 6% +30.6% 712076 ± 3% sched_debug.cpu#39.avg_idle
> 175780 ± 8% -25.0% 131911 ± 12% sched_debug.cpu#34.sched_goidle
> 352325 ± 8% -24.9% 264519 ± 12% sched_debug.cpu#34.nr_switches
> 368764 ± 7% -25.9% 273326 ± 13% sched_debug.cpu#40.sched_count
> 178369 ± 7% -25.3% 133316 ± 12% sched_debug.cpu#31.sched_goidle
> 357523 ± 7% -25.2% 267329 ± 12% sched_debug.cpu#31.nr_switches
> 445168 ± 6% -21.5% 349498 ± 7% sched_debug.cpu#50.sched_count
> 178502 ± 3% -27.0% 130326 ± 8% sched_debug.cpu#24.ttwu_count
> 232438 ± 4% -25.2% 173912 ± 4% sched_debug.cpu#45.ttwu_count
> 214980 ± 6% -21.3% 169213 ± 7% sched_debug.cpu#50.sched_goidle
> 430801 ± 6% -21.3% 339213 ± 7% sched_debug.cpu#50.nr_switches
> 175354 ± 7% -25.0% 131440 ± 12% sched_debug.cpu#32.sched_goidle
> 351473 ± 7% -25.0% 263573 ± 12% sched_debug.cpu#32.nr_switches
> 175818 ± 4% -25.5% 131027 ± 9% sched_debug.cpu#25.ttwu_count
> 562351 ± 4% +33.0% 747969 ± 7% sched_debug.cpu#17.avg_idle
> 226274 ± 5% -24.6% 170581 ± 5% sched_debug.cpu#54.ttwu_count
> 566741 ± 5% +33.2% 754744 ± 4% sched_debug.cpu#29.avg_idle
> 365692 ± 8% -24.7% 275497 ± 14% sched_debug.cpu#32.sched_count
> 443973 ± 6% -22.1% 345964 ± 7% sched_debug.cpu#51.sched_count
> 360816 ± 8% -25.3% 269548 ± 14% sched_debug.cpu#41.sched_count
> 224711 ± 4% -24.6% 169414 ± 6% sched_debug.cpu#53.ttwu_count
> 380979 ± 13% -28.9% 270783 ± 14% sched_debug.cpu#33.sched_count
> 174502 ± 4% -27.0% 127311 ± 8% sched_debug.cpu#29.ttwu_count
> 573889 ± 4% +32.2% 758635 ± 5% sched_debug.cpu#24.avg_idle
> 523204 ± 10% +29.1% 675536 ± 9% sched_debug.cpu#6.avg_idle
> 173555 ± 4% -25.7% 128988 ± 8% sched_debug.cpu#27.ttwu_count
> 228859 ± 4% -25.2% 171229 ± 6% sched_debug.cpu#49.ttwu_count
> 529356 ± 9% +32.4% 700872 ± 6% sched_debug.cpu#33.avg_idle
> 565916 ± 5% +33.4% 755047 ± 7% sched_debug.cpu#23.avg_idle
> 232257 ± 3% -25.1% 173926 ± 5% sched_debug.cpu#46.ttwu_count
> 227954 ± 4% -24.3% 172631 ± 5% sched_debug.cpu#52.ttwu_count
> 197241 ± 5% -23.5% 150963 ± 8% sched_debug.cpu#4.ttwu_count
> 228392 ± 3% -24.8% 171779 ± 6% sched_debug.cpu#51.ttwu_count
> 542129 ± 5% +28.0% 693751 ± 6% sched_debug.cpu#13.avg_idle
> 364245 ± 8% -25.1% 272652 ± 15% sched_debug.cpu#37.sched_count
> 558275 ± 8% +36.1% 759570 ± 6% sched_debug.cpu#26.avg_idle
> 225027 ± 5% -24.7% 169427 ± 6% sched_debug.cpu#57.ttwu_count
> 17.06 ± 1% -23.0% 13.13 ± 3% perf-profile.cpu-cycles.call_rwsem_down_write_failed.vma_link.mmap_region.do_mmap_pgoff.vm_mmap_pgoff
> 197493 ± 5% -22.8% 152503 ± 8% sched_debug.cpu#2.ttwu_count
> 16.99 ± 1% -23.2% 13.05 ± 3% perf-profile.cpu-cycles.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region.do_mmap_pgoff
> 223164 ± 4% -24.7% 168105 ± 6% sched_debug.cpu#59.ttwu_count
> 223884 ± 4% -24.6% 168887 ± 4% sched_debug.cpu#58.ttwu_count
> 538073 ± 6% +27.8% 687436 ± 8% sched_debug.cpu#43.avg_idle
> 445916 ± 7% -22.4% 345938 ± 6% sched_debug.cpu#52.sched_count
> 214967 ± 6% -21.9% 167898 ± 6% sched_debug.cpu#52.sched_goidle
> 534156 ± 9% +25.2% 668876 ± 5% sched_debug.cpu#11.avg_idle
> 430800 ± 6% -21.9% 336561 ± 6% sched_debug.cpu#52.nr_switches
> 117 ± 8% -21.7% 91 ± 5% sched_debug.cfs_rq[36]:/.tg_runnable_contrib
> 224801 ± 4% -24.0% 170764 ± 5% sched_debug.cpu#55.ttwu_count
> 225103 ± 4% -24.9% 168953 ± 5% sched_debug.cpu#56.ttwu_count
> 24226456 ± 0% -23.0% 18650874 ± 1% time.voluntary_context_switches
> 5411 ± 8% -21.3% 4256 ± 4% sched_debug.cfs_rq[36]:/.avg->runnable_avg_sum
> 212964 ± 5% -21.5% 167092 ± 6% sched_debug.cpu#51.sched_goidle
> 426769 ± 5% -21.5% 334967 ± 6% sched_debug.cpu#51.nr_switches
> 519159 ± 4% +27.0% 659572 ± 7% sched_debug.cpu#52.avg_idle
> 193464 ± 4% -22.1% 150665 ± 7% sched_debug.cpu#7.ttwu_count
> 226747 ± 4% -24.4% 171347 ± 6% sched_debug.cpu#50.ttwu_count
> 572755 ± 6% +29.0% 738639 ± 4% sched_debug.cpu#25.avg_idle
> 520910 ± 7% +35.0% 703382 ± 6% sched_debug.cpu#32.avg_idle
> 2.696e+10 ± 1% +29.0% 3.478e+10 ± 0% cpuidle.C6-IVT-4S.time
> 530311 ± 12% +31.1% 695099 ± 5% sched_debug.cpu#44.avg_idle
> 204543 ± 8% -20.5% 162661 ± 15% sched_debug.cfs_rq[31]:/.min_vruntime
> 484242 ± 9% +31.7% 637669 ± 8% sched_debug.cpu#47.avg_idle
> 6.85 ± 1% -22.4% 5.32 ± 3% perf-profile.cpu-cycles.rwsem_spin_on_owner.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
> 528770 ± 7% +31.6% 695818 ± 6% sched_debug.cpu#40.avg_idle
> 223475 ± 4% -20.9% 176718 ± 6% sched_debug.cfs_rq[52]:/.min_vruntime
> 577331 ± 4% +29.2% 745806 ± 4% sched_debug.cpu#16.avg_idle
> 192821 ± 4% -23.4% 147763 ± 8% sched_debug.cpu#10.ttwu_count
> 198393 ± 4% -23.1% 152635 ± 7% sched_debug.cpu#1.ttwu_count
> 572991 ± 9% +29.0% 738876 ± 3% sched_debug.cpu#18.avg_idle
> 531346 ± 5% +26.8% 673808 ± 6% sched_debug.cpu#35.avg_idle
> 531692 ± 8% +30.0% 691275 ± 7% sched_debug.cpu#36.avg_idle
> 573689 ± 9% +30.1% 746581 ± 3% sched_debug.cpu#28.avg_idle
> 194767 ± 3% -22.1% 151736 ± 7% sched_debug.cpu#6.ttwu_count
> 576252 ± 10% +29.8% 748134 ± 5% sched_debug.cpu#19.avg_idle
> 189779 ± 5% -22.5% 147019 ± 9% sched_debug.cpu#13.ttwu_count
> 574093 ± 9% +28.0% 734982 ± 4% sched_debug.cpu#22.avg_idle
> 530896 ± 7% +25.4% 665864 ± 7% sched_debug.cpu#9.avg_idle
> 222143 ± 5% -19.0% 179889 ± 9% sched_debug.cfs_rq[49]:/.min_vruntime
> 190106 ± 5% -22.4% 147518 ± 7% sched_debug.cpu#14.ttwu_count
> 192933 ± 3% -21.8% 150835 ± 8% sched_debug.cpu#8.ttwu_count
> 193656 ± 4% -22.7% 149678 ± 8% sched_debug.cpu#9.ttwu_count
> 196739 ± 5% -22.9% 151747 ± 7% sched_debug.cpu#3.ttwu_count
> 434909 ± 6% -18.4% 354789 ± 6% sched_debug.cpu#55.sched_count
> 194722 ± 4% -22.0% 151895 ± 8% sched_debug.cpu#5.ttwu_count
> 439285 ± 7% -19.7% 352534 ± 6% sched_debug.cpu#47.sched_count
> 585003 ± 7% +31.4% 768551 ± 5% sched_debug.cpu#20.avg_idle
> 432219 ± 7% -19.5% 347734 ± 7% sched_debug.cpu#48.sched_count
> 224113 ± 5% -18.9% 181798 ± 8% sched_debug.cfs_rq[48]:/.min_vruntime
> 534566 ± 7% +30.3% 696442 ± 6% sched_debug.cpu#31.avg_idle
> 525194 ± 6% +23.5% 648587 ± 7% sched_debug.cpu#7.avg_idle
> 209128 ± 6% -19.4% 168562 ± 7% sched_debug.cpu#48.sched_goidle
> 419098 ± 6% -19.4% 337908 ± 7% sched_debug.cpu#48.nr_switches
> 448417 ± 7% -19.8% 359813 ± 6% sched_debug.cpu#46.sched_count
> 491962 ± 8% +26.7% 623449 ± 4% sched_debug.cpu#48.avg_idle
> 212354 ± 6% -19.7% 170477 ± 5% sched_debug.cpu#47.sched_goidle
> 581409 ± 7% +23.6% 718790 ± 4% sched_debug.cpu#37.avg_idle
> 194066 ± 6% -17.8% 159565 ± 11% sched_debug.cfs_rq[16]:/.min_vruntime
> 425571 ± 6% -19.7% 341752 ± 5% sched_debug.cpu#47.nr_switches
> 215882 ± 7% -19.5% 173827 ± 5% sched_debug.cpu#46.sched_goidle
> 442267 ± 6% -21.4% 347467 ± 6% sched_debug.cpu#59.sched_count
> 432617 ± 7% -19.5% 348457 ± 5% sched_debug.cpu#46.nr_switches
> 569496 ± 11% +32.0% 751590 ± 5% sched_debug.cpu#21.avg_idle
> 189763 ± 5% -22.2% 147705 ± 8% sched_debug.cpu#12.ttwu_count
> 223064 ± 4% -19.3% 179906 ± 5% sched_debug.cfs_rq[53]:/.min_vruntime
> 213869 ± 5% -21.0% 168888 ± 5% sched_debug.cpu#59.sched_goidle
> 428592 ± 5% -21.0% 338537 ± 5% sched_debug.cpu#59.nr_switches
> 441291 ± 6% -19.8% 353975 ± 5% sched_debug.cpu#45.sched_count
> 213493 ± 5% -19.5% 171778 ± 5% sched_debug.cpu#45.sched_goidle
> 427837 ± 5% -19.5% 344360 ± 5% sched_debug.cpu#45.nr_switches
> 191795 ± 5% -22.6% 148369 ± 8% sched_debug.cpu#11.ttwu_count
> 194309 ± 6% -19.3% 156815 ± 8% sched_debug.cfs_rq[17]:/.min_vruntime
> 221301 ± 5% -20.9% 175025 ± 7% sched_debug.cfs_rq[56]:/.min_vruntime
> 538571 ± 8% +24.4% 670227 ± 8% sched_debug.cpu#3.avg_idle
> 223672 ± 5% -18.9% 181388 ± 7% sched_debug.cfs_rq[47]:/.min_vruntime
> 425387 ± 7% -18.3% 347554 ± 7% sched_debug.cpu#54.sched_count
> 199287 ± 6% -21.7% 156117 ± 12% sched_debug.cfs_rq[15]:/.min_vruntime
> 1.00 ± 5% -15.8% 0.84 ± 6% perf-profile.cpu-cycles.kmem_cache_alloc_trace.perf_event_mmap.mmap_region.do_mmap_pgoff.vm_mmap_pgoff
> 385907 ± 8% -23.7% 294552 ± 10% sched_debug.cpu#6.sched_count
> 493228 ± 5% +27.4% 628579 ± 8% sched_debug.cpu#54.avg_idle
> 185090 ± 8% -23.0% 142559 ± 10% sched_debug.cpu#6.sched_goidle
> 542727 ± 8% +27.5% 691759 ± 4% sched_debug.cpu#42.avg_idle
> 209830 ± 6% -18.0% 172096 ± 6% sched_debug.cpu#55.sched_goidle
> 370989 ± 8% -23.0% 285813 ± 10% sched_debug.cpu#6.nr_switches
> 420473 ± 6% -18.0% 344973 ± 6% sched_debug.cpu#55.nr_switches
> 201389 ± 4% -20.7% 159785 ± 7% sched_debug.cpu#0.ttwu_count
> 365245 ± 7% -20.1% 291843 ± 9% sched_debug.cpu#5.sched_count
> 176316 ± 7% -19.7% 141647 ± 9% sched_debug.cpu#5.sched_goidle
> 353385 ± 7% -19.6% 284000 ± 9% sched_debug.cpu#5.nr_switches
> 430699 ± 7% -20.6% 341980 ± 7% sched_debug.cpu#53.sched_count
> 434688 ± 7% -17.9% 356994 ± 7% sched_debug.cpu#58.sched_count
> 910 ± 11% -15.6% 767 ± 12% sched_debug.cpu#34.ttwu_local
> 194153 ± 7% -16.9% 161410 ± 5% sched_debug.cfs_rq[19]:/.min_vruntime
> 435164 ± 10% -20.0% 348238 ± 7% sched_debug.cpu#56.sched_count
> 25686 ± 0% -18.8% 20849 ± 1% softirqs.HRTIMER
> 205841 ± 7% -18.6% 167608 ± 6% sched_debug.cpu#54.sched_goidle
> 412493 ± 7% -18.5% 335995 ± 6% sched_debug.cpu#54.nr_switches
> 209629 ± 7% -17.5% 172950 ± 7% sched_debug.cpu#58.sched_goidle
> 420079 ± 7% -17.5% 346715 ± 7% sched_debug.cpu#58.nr_switches
> 190909 ± 5% -19.3% 154071 ± 8% sched_debug.cfs_rq[26]:/.min_vruntime
> 535739 ± 10% +25.8% 674192 ± 3% sched_debug.cpu#41.avg_idle
> 220505 ± 5% -17.2% 182496 ± 10% sched_debug.cfs_rq[57]:/.min_vruntime
> 207365 ± 6% -19.9% 166054 ± 7% sched_debug.cpu#53.sched_goidle
> 415569 ± 6% -19.9% 332885 ± 7% sched_debug.cpu#53.nr_switches
> 433052 ± 7% -19.5% 348641 ± 8% sched_debug.cpu#57.sched_count
> 534493 ± 4% +25.6% 671066 ± 4% sched_debug.cpu#2.avg_idle
> 1.02 ± 2% -20.2% 0.81 ± 8% perf-profile.cpu-cycles.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__run_hrtimer
> 5217 ± 12% -17.6% 4297 ± 9% sched_debug.cfs_rq[26]:/.avg->runnable_avg_sum
> 209594 ± 6% -19.1% 169509 ± 8% sched_debug.cpu#57.sched_goidle
> 420012 ± 6% -19.1% 339802 ± 8% sched_debug.cpu#57.nr_switches
> 503208 ± 10% +25.5% 631683 ± 7% sched_debug.cpu#55.avg_idle
> 113 ± 12% -17.9% 92 ± 9% sched_debug.cfs_rq[26]:/.tg_runnable_contrib
> 549109 ± 5% +22.6% 673144 ± 6% sched_debug.cpu#14.avg_idle
> 210495 ± 9% -19.7% 169109 ± 7% sched_debug.cpu#56.sched_goidle
> 421839 ± 9% -19.6% 338979 ± 7% sched_debug.cpu#56.nr_switches
> 221205 ± 4% -17.6% 182374 ± 7% sched_debug.cfs_rq[50]:/.min_vruntime
> 502758 ± 6% +23.1% 618755 ± 7% sched_debug.cpu#46.avg_idle
> 222043 ± 4% -18.6% 180727 ± 10% sched_debug.cfs_rq[51]:/.min_vruntime
> 221617 ± 4% -18.3% 181127 ± 8% sched_debug.cfs_rq[55]:/.min_vruntime
> 557533 ± 11% +22.2% 681218 ± 7% sched_debug.cpu#12.avg_idle
> 187238 ± 6% -17.7% 154099 ± 10% sched_debug.cfs_rq[29]:/.min_vruntime
> 551333 ± 10% +22.2% 673592 ± 7% sched_debug.cpu#34.avg_idle
> 224579 ± 4% -16.6% 187288 ± 9% sched_debug.cfs_rq[54]:/.min_vruntime
> 184873 ± 6% -15.9% 155439 ± 8% sched_debug.cfs_rq[28]:/.min_vruntime
> 206172 ± 6% -18.2% 168730 ± 7% sched_debug.cpu#49.sched_goidle
> 413179 ± 6% -18.1% 338238 ± 7% sched_debug.cpu#49.nr_switches
> 225157 ± 5% -16.4% 188227 ± 9% sched_debug.cfs_rq[46]:/.min_vruntime
> 175150 ± 5% -16.9% 145619 ± 11% sched_debug.cpu#3.sched_goidle
> 351054 ± 5% -16.8% 291944 ± 11% sched_debug.cpu#3.nr_switches
> 564018 ± 3% +21.0% 682616 ± 6% sched_debug.cpu#4.avg_idle
> 5529 ± 8% -18.1% 4527 ± 11% sched_debug.cfs_rq[39]:/.avg->runnable_avg_sum
> 600812 ± 5% -15.3% 508926 ± 9% numa-vmstat.node2.numa_local
> 187471 ± 4% -18.5% 152874 ± 10% sched_debug.cfs_rq[22]:/.min_vruntime
> 19730 ± 6% -13.7% 17025 ± 9% sched_debug.cfs_rq[26]:/.exec_clock
> 425149 ± 6% -18.2% 347836 ± 7% sched_debug.cpu#49.sched_count
> 22908 ± 5% -12.9% 19945 ± 5% sched_debug.cfs_rq[58]:/.exec_clock
> 191793 ± 4% -16.6% 160031 ± 10% sched_debug.cfs_rq[24]:/.min_vruntime
> 14.49 ± 0% +16.4% 16.87 ± 2% perf-profile.cpu-cycles.start_secondary
> 514287 ± 10% +19.7% 615733 ± 6% sched_debug.cpu#58.avg_idle
> 1622 ± 0% -15.6% 1369 ± 1% time.system_time
> 14.45 ± 0% +16.2% 16.80 ± 2% perf-profile.cpu-cycles.cpu_startup_entry.start_secondary
> 1117 ± 6% -12.1% 982 ± 3% proc-vmstat.pgmigrate_success
> 1117 ± 6% -12.1% 982 ± 3% proc-vmstat.numa_pages_migrated
> 23520 ± 4% -14.0% 20233 ± 6% sched_debug.cfs_rq[48]:/.exec_clock
> 372296 ± 1% -18.0% 305136 ± 9% sched_debug.cpu#2.sched_count
> 218377 ± 6% -16.5% 182283 ± 6% sched_debug.cfs_rq[58]:/.min_vruntime
> 548860 ± 8% +25.4% 688468 ± 6% sched_debug.cpu#8.avg_idle
> 224066 ± 5% -17.7% 184445 ± 8% sched_debug.cfs_rq[45]:/.min_vruntime
> 23172 ± 4% -12.9% 20184 ± 5% sched_debug.cfs_rq[52]:/.exec_clock
> 947362 ± 3% -14.4% 810580 ± 7% numa-numastat.node2.local_node
> 22992 ± 5% -12.9% 20026 ± 7% sched_debug.cfs_rq[59]:/.exec_clock
> 23572 ± 4% -12.3% 20668 ± 5% sched_debug.cfs_rq[46]:/.exec_clock
> 6293 ± 8% -16.0% 5288 ± 8% sched_debug.cfs_rq[47]:/.avg->runnable_avg_sum
> 23545 ± 4% -13.3% 20402 ± 6% sched_debug.cfs_rq[47]:/.exec_clock
> 7 ± 0% -14.3% 6 ± 0% vmstat.procs.r
> 136 ± 8% -16.3% 114 ± 8% sched_debug.cfs_rq[47]:/.tg_runnable_contrib
> 952018 ± 3% -14.1% 817562 ± 7% numa-numastat.node2.numa_hit
> 684874 ± 4% -13.1% 595283 ± 7% numa-vmstat.node2.numa_hit
> 22864 ± 5% -12.7% 19967 ± 5% sched_debug.cfs_rq[57]:/.exec_clock
> 190734 ± 5% -16.3% 159695 ± 8% sched_debug.cfs_rq[23]:/.min_vruntime
> 237300 ± 6% -14.9% 202014 ± 7% numa-vmstat.node3.nr_page_table_pages
> 949123 ± 6% -14.9% 808058 ± 7% numa-meminfo.node3.PageTables
> 11.45 ± 4% +12.2% 12.84 ± 7% perf-profile.cpu-cycles.task_numa_work.task_work_run.do_notify_resume.retint_signal
> 561716 ± 7% +22.7% 689210 ± 5% sched_debug.cpu#10.avg_idle
> 23421 ± 4% -12.5% 20484 ± 5% sched_debug.cfs_rq[45]:/.exec_clock
> 23090 ± 4% -13.4% 19999 ± 6% sched_debug.cfs_rq[53]:/.exec_clock
> 2257945 ± 6% -14.5% 1929848 ± 7% numa-meminfo.node3.SUnreclaim
> 564591 ± 6% -14.5% 482457 ± 7% numa-vmstat.node3.nr_slab_unreclaimable
> 7903 ± 0% -13.6% 6830 ± 1% sched_debug.cfs_rq[11]:/.tg->runnable_avg
> 522411 ± 6% +15.9% 605704 ± 4% sched_debug.cpu#59.avg_idle
> 7899 ± 0% -13.6% 6827 ± 1% sched_debug.cfs_rq[10]:/.tg->runnable_avg
> 7884 ± 0% -13.6% 6811 ± 1% sched_debug.cfs_rq[2]:/.tg->runnable_avg
> 7913 ± 0% -13.6% 6839 ± 1% sched_debug.cfs_rq[14]:/.tg->runnable_avg
> 2272179 ± 6% -14.4% 1944358 ± 7% numa-meminfo.node3.Slab
> 7896 ± 0% -13.6% 6826 ± 1% sched_debug.cfs_rq[9]:/.tg->runnable_avg
> 7894 ± 0% -13.6% 6822 ± 1% sched_debug.cfs_rq[8]:/.tg->runnable_avg
> 7877 ± 0% -13.6% 6802 ± 1% sched_debug.cfs_rq[0]:/.tg->runnable_avg
> 7890 ± 0% -13.6% 6817 ± 1% sched_debug.cfs_rq[4]:/.tg->runnable_avg
> 7891 ± 0% -13.6% 6816 ± 1% sched_debug.cfs_rq[5]:/.tg->runnable_avg
> 7894 ± 0% -13.6% 6823 ± 1% sched_debug.cfs_rq[7]:/.tg->runnable_avg
> 512300 ± 6% +18.2% 605480 ± 9% sched_debug.cpu#50.avg_idle
> 7908 ± 0% -13.6% 6836 ± 1% sched_debug.cfs_rq[13]:/.tg->runnable_avg
> 7888 ± 0% -13.6% 6814 ± 1% sched_debug.cfs_rq[3]:/.tg->runnable_avg
> 7916 ± 0% -13.6% 6843 ± 1% sched_debug.cfs_rq[15]:/.tg->runnable_avg
> 7892 ± 0% -13.6% 6818 ± 1% sched_debug.cfs_rq[6]:/.tg->runnable_avg
> 178921 ± 1% -17.9% 146921 ± 9% sched_debug.cpu#2.sched_goidle
> 7918 ± 0% -13.5% 6848 ± 1% sched_debug.cfs_rq[16]:/.tg->runnable_avg
> 7883 ± 0% -13.6% 6809 ± 1% sched_debug.cfs_rq[1]:/.tg->runnable_avg
> 7903 ± 0% -13.5% 6832 ± 1% sched_debug.cfs_rq[12]:/.tg->runnable_avg
> 7930 ± 0% -13.5% 6861 ± 1% sched_debug.cfs_rq[20]:/.tg->runnable_avg
> 7925 ± 0% -13.5% 6859 ± 1% sched_debug.cfs_rq[19]:/.tg->runnable_avg
> 7921 ± 0% -13.5% 6852 ± 1% sched_debug.cfs_rq[17]:/.tg->runnable_avg
> 7932 ± 0% -13.4% 6866 ± 1% sched_debug.cfs_rq[21]:/.tg->runnable_avg
> 358611 ± 1% -17.9% 294548 ± 9% sched_debug.cpu#2.nr_switches
> 7922 ± 0% -13.4% 6857 ± 1% sched_debug.cfs_rq[18]:/.tg->runnable_avg
> 7985 ± 0% -13.4% 6918 ± 1% sched_debug.cfs_rq[36]:/.tg->runnable_avg
> 555502 ± 4% +16.3% 646081 ± 5% sched_debug.cpu#5.avg_idle
> 7944 ± 0% -13.5% 6876 ± 1% sched_debug.cfs_rq[24]:/.tg->runnable_avg
> 7994 ± 0% -13.4% 6926 ± 1% sched_debug.cfs_rq[39]:/.tg->runnable_avg
> 7959 ± 0% -13.4% 6892 ± 1% sched_debug.cfs_rq[28]:/.tg->runnable_avg
> 7997 ± 0% -13.3% 6930 ± 1% sched_debug.cfs_rq[40]:/.tg->runnable_avg
> 7962 ± 0% -13.4% 6895 ± 1% sched_debug.cfs_rq[29]:/.tg->runnable_avg
> 7935 ± 0% -13.4% 6869 ± 1% sched_debug.cfs_rq[22]:/.tg->runnable_avg
> 7982 ± 0% -13.4% 6915 ± 1% sched_debug.cfs_rq[35]:/.tg->runnable_avg
> 8000 ± 0% -13.3% 6932 ± 1% sched_debug.cfs_rq[41]:/.tg->runnable_avg
> 7951 ± 0% -13.4% 6884 ± 1% sched_debug.cfs_rq[26]:/.tg->runnable_avg
> 7954 ± 0% -13.4% 6889 ± 1% sched_debug.cfs_rq[27]:/.tg->runnable_avg
> 7976 ± 0% -13.4% 6911 ± 1% sched_debug.cfs_rq[34]:/.tg->runnable_avg
> 7937 ± 0% -13.4% 6872 ± 1% sched_debug.cfs_rq[23]:/.tg->runnable_avg
> 8003 ± 0% -13.3% 6937 ± 1% sched_debug.cfs_rq[43]:/.tg->runnable_avg
> 765 ± 0% -13.1% 665 ± 1% time.percent_of_cpu_this_job_got
> 7964 ± 0% -13.4% 6896 ± 1% sched_debug.cfs_rq[30]:/.tg->runnable_avg
> 7987 ± 0% -13.4% 6919 ± 1% sched_debug.cfs_rq[37]:/.tg->runnable_avg
> 8027 ± 0% -13.3% 6961 ± 1% sched_debug.cfs_rq[50]:/.tg->runnable_avg
> 7988 ± 0% -13.4% 6921 ± 1% sched_debug.cfs_rq[38]:/.tg->runnable_avg
> 7946 ± 0% -13.4% 6883 ± 1% sched_debug.cfs_rq[25]:/.tg->runnable_avg
> 8025 ± 0% -13.3% 6955 ± 1% sched_debug.cfs_rq[48]:/.tg->runnable_avg
> 8012 ± 0% -13.3% 6944 ± 1% sched_debug.cfs_rq[45]:/.tg->runnable_avg
> 7974 ± 0% -13.3% 6909 ± 1% sched_debug.cfs_rq[33]:/.tg->runnable_avg
> 1.13 ± 1% -14.8% 0.96 ± 7% perf-profile.cpu-cycles.update_process_times.tick_sched_handle.tick_sched_timer.__run_hrtimer.hrtimer_interrupt
> 8000 ± 0% -13.3% 6933 ± 1% sched_debug.cfs_rq[42]:/.tg->runnable_avg
> 8035 ± 0% -13.3% 6969 ± 1% sched_debug.cfs_rq[51]:/.tg->runnable_avg
> 8024 ± 0% -13.3% 6954 ± 1% sched_debug.cfs_rq[47]:/.tg->runnable_avg
> 8014 ± 0% -13.3% 6950 ± 1% sched_debug.cfs_rq[46]:/.tg->runnable_avg
> 8026 ± 0% -13.3% 6959 ± 1% sched_debug.cfs_rq[49]:/.tg->runnable_avg
> 7968 ± 0% -13.4% 6902 ± 1% sched_debug.cfs_rq[31]:/.tg->runnable_avg
> 37.12 ± 0% -12.9% 32.34 ± 2% perf-profile.cpu-cycles.vma_link.mmap_region.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff
> 8007 ± 0% -13.4% 6938 ± 1% sched_debug.cfs_rq[44]:/.tg->runnable_avg
> 8037 ± 0% -13.2% 6973 ± 1% sched_debug.cfs_rq[52]:/.tg->runnable_avg
> 7968 ± 0% -13.3% 6906 ± 1% sched_debug.cfs_rq[32]:/.tg->runnable_avg
> 1.13 ± 1% -14.1% 0.97 ± 7% perf-profile.cpu-cycles.tick_sched_handle.isra.18.tick_sched_timer.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt
> 8068 ± 0% -13.1% 7007 ± 1% sched_debug.cfs_rq[63]:/.tg->runnable_avg
> 8040 ± 0% -13.2% 6977 ± 1% sched_debug.cfs_rq[53]:/.tg->runnable_avg
> 8053 ± 0% -13.2% 6990 ± 1% sched_debug.cfs_rq[57]:/.tg->runnable_avg
> 8064 ± 0% -13.1% 7004 ± 1% sched_debug.cfs_rq[61]:/.tg->runnable_avg
> 8049 ± 0% -13.2% 6985 ± 1% sched_debug.cfs_rq[56]:/.tg->runnable_avg
> 8070 ± 0% -13.1% 7009 ± 1% sched_debug.cfs_rq[64]:/.tg->runnable_avg
> 3595633 ± 5% -12.9% 3133416 ± 6% numa-meminfo.node3.MemUsed
> 8055 ± 0% -13.2% 6993 ± 1% sched_debug.cfs_rq[58]:/.tg->runnable_avg
> 8071 ± 0% -13.1% 7014 ± 1% sched_debug.cfs_rq[65]:/.tg->runnable_avg
> 8046 ± 0% -13.2% 6983 ± 1% sched_debug.cfs_rq[55]:/.tg->runnable_avg
> 8045 ± 0% -13.3% 6978 ± 1% sched_debug.cfs_rq[54]:/.tg->runnable_avg
> 8086 ± 0% -13.1% 7027 ± 1% sched_debug.cfs_rq[71]:/.tg->runnable_avg
> 8137 ± 0% -13.0% 7080 ± 1% sched_debug.cfs_rq[91]:/.tg->runnable_avg
> 8081 ± 0% -13.1% 7022 ± 1% sched_debug.cfs_rq[68]:/.tg->runnable_avg
> 8076 ± 0% -13.1% 7017 ± 1% sched_debug.cfs_rq[66]:/.tg->runnable_avg
> 8062 ± 0% -13.1% 7002 ± 1% sched_debug.cfs_rq[60]:/.tg->runnable_avg
> 8139 ± 0% -12.9% 7085 ± 1% sched_debug.cfs_rq[92]:/.tg->runnable_avg
> 8088 ± 0% -13.1% 7031 ± 1% sched_debug.cfs_rq[72]:/.tg->runnable_avg
> 8064 ± 0% -13.1% 7006 ± 1% sched_debug.cfs_rq[62]:/.tg->runnable_avg
> 8143 ± 0% -12.9% 7090 ± 1% sched_debug.cfs_rq[94]:/.tg->runnable_avg
> 41932371 ± 0% -13.0% 36489731 ± 1% slabinfo.vm_area_struct.active_objs
> 8078 ± 0% -13.1% 7019 ± 1% sched_debug.cfs_rq[67]:/.tg->runnable_avg
> 8083 ± 0% -13.1% 7025 ± 1% sched_debug.cfs_rq[69]:/.tg->runnable_avg
> 8058 ± 0% -13.2% 6997 ± 1% sched_debug.cfs_rq[59]:/.tg->runnable_avg
> 8142 ± 0% -12.9% 7089 ± 1% sched_debug.cfs_rq[93]:/.tg->runnable_avg
> 8084 ± 0% -13.1% 7028 ± 1% sched_debug.cfs_rq[70]:/.tg->runnable_avg
> 8134 ± 0% -13.0% 7078 ± 1% sched_debug.cfs_rq[90]:/.tg->runnable_avg
> 8123 ± 0% -13.1% 7062 ± 1% sched_debug.cfs_rq[84]:/.tg->runnable_avg
> 3274295 ± 0% -13.0% 2849232 ± 1% meminfo.PageTables
> 818565 ± 0% -13.0% 712300 ± 1% proc-vmstat.nr_page_table_pages
> 8094 ± 0% -13.0% 7038 ± 1% sched_debug.cfs_rq[74]:/.tg->runnable_avg
> 8133 ± 0% -13.0% 7077 ± 1% sched_debug.cfs_rq[89]:/.tg->runnable_avg
> 8103 ± 0% -13.0% 7046 ± 1% sched_debug.cfs_rq[77]:/.tg->runnable_avg
> 8144 ± 0% -12.9% 7094 ± 1% sched_debug.cfs_rq[95]:/.tg->runnable_avg
> 8146 ± 0% -12.9% 7096 ± 1% sched_debug.cfs_rq[96]:/.tg->runnable_avg
> 8128 ± 0% -13.0% 7070 ± 1% sched_debug.cfs_rq[86]:/.tg->runnable_avg
> 8091 ± 0% -13.0% 7035 ± 1% sched_debug.cfs_rq[73]:/.tg->runnable_avg
> 536950 ± 10% +23.4% 662508 ± 6% sched_debug.cpu#30.avg_idle
> 8096 ± 0% -13.1% 7039 ± 1% sched_debug.cfs_rq[75]:/.tg->runnable_avg
> 8127 ± 0% -13.0% 7067 ± 1% sched_debug.cfs_rq[85]:/.tg->runnable_avg
> 8149 ± 0% -12.9% 7097 ± 1% sched_debug.cfs_rq[97]:/.tg->runnable_avg
> 8151 ± 0% -12.9% 7100 ± 1% sched_debug.cfs_rq[99]:/.tg->runnable_avg
> 8153 ± 0% -12.9% 7101 ± 1% sched_debug.cfs_rq[100]:/.tg->runnable_avg
> 8129 ± 0% -13.0% 7074 ± 1% sched_debug.cfs_rq[87]:/.tg->runnable_avg
> 8118 ± 0% -13.0% 7060 ± 1% sched_debug.cfs_rq[83]:/.tg->runnable_avg
> 8107 ± 0% -13.1% 7047 ± 1% sched_debug.cfs_rq[78]:/.tg->runnable_avg
> 8111 ± 0% -13.0% 7054 ± 1% sched_debug.cfs_rq[80]:/.tg->runnable_avg
> 8098 ± 0% -13.0% 7044 ± 1% sched_debug.cfs_rq[76]:/.tg->runnable_avg
> 42188778 ± 0% -12.9% 36733179 ± 1% slabinfo.vm_area_struct.num_objs
> 958835 ± 0% -12.9% 834844 ± 1% slabinfo.vm_area_struct.num_slabs
> 958835 ± 0% -12.9% 834844 ± 1% slabinfo.vm_area_struct.active_slabs
> 8154 ± 0% -12.9% 7103 ± 1% sched_debug.cfs_rq[101]:/.tg->runnable_avg
> 8116 ± 0% -13.0% 7058 ± 1% sched_debug.cfs_rq[82]:/.tg->runnable_avg
> 8130 ± 0% -12.9% 7077 ± 1% sched_debug.cfs_rq[88]:/.tg->runnable_avg
> 8171 ± 0% -12.9% 7120 ± 1% sched_debug.cfs_rq[107]:/.tg->runnable_avg
> 8113 ± 0% -13.0% 7058 ± 1% sched_debug.cfs_rq[81]:/.tg->runnable_avg
> 8109 ± 0% -13.1% 7051 ± 1% sched_debug.cfs_rq[79]:/.tg->runnable_avg
> 8155 ± 0% -12.9% 7106 ± 1% sched_debug.cfs_rq[102]:/.tg->runnable_avg
> 8157 ± 0% -12.8% 7111 ± 1% sched_debug.cfs_rq[103]:/.tg->runnable_avg
> 8165 ± 0% -12.9% 7115 ± 1% sched_debug.cfs_rq[105]:/.tg->runnable_avg
> 8159 ± 0% -12.8% 7113 ± 1% sched_debug.cfs_rq[104]:/.tg->runnable_avg
> 8148 ± 0% -12.9% 7099 ± 1% sched_debug.cfs_rq[98]:/.tg->runnable_avg
> 8169 ± 0% -12.9% 7118 ± 1% sched_debug.cfs_rq[106]:/.tg->runnable_avg
> 1.78 ± 2% -11.3% 1.58 ± 4% perf-profile.cpu-cycles.tick_sched_timer.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt
> 7802174 ± 0% -12.8% 6805780 ± 1% meminfo.SUnreclaim
> 1950525 ± 0% -12.8% 1701410 ± 1% proc-vmstat.nr_slab_unreclaimable
> 8198 ± 0% -12.7% 7154 ± 1% sched_debug.cfs_rq[119]:/.tg->runnable_avg
> 8175 ± 0% -12.8% 7125 ± 1% sched_debug.cfs_rq[109]:/.tg->runnable_avg
> 8180 ± 0% -12.8% 7136 ± 1% sched_debug.cfs_rq[112]:/.tg->runnable_avg
> 8188 ± 0% -12.8% 7143 ± 1% sched_debug.cfs_rq[115]:/.tg->runnable_avg
> 8194 ± 0% -12.7% 7151 ± 1% sched_debug.cfs_rq[117]:/.tg->runnable_avg
> 8176 ± 0% -12.8% 7129 ± 1% sched_debug.cfs_rq[110]:/.tg->runnable_avg
> 8189 ± 0% -12.8% 7145 ± 1% sched_debug.cfs_rq[116]:/.tg->runnable_avg
> 189413 ± 4% -13.7% 163494 ± 8% sched_debug.cfs_rq[25]:/.min_vruntime
> 8184 ± 0% -12.7% 7141 ± 1% sched_debug.cfs_rq[114]:/.tg->runnable_avg
> 8182 ± 0% -12.8% 7137 ± 1% sched_debug.cfs_rq[113]:/.tg->runnable_avg
> 8172 ± 0% -12.8% 7122 ± 1% sched_debug.cfs_rq[108]:/.tg->runnable_avg
> 8193 ± 0% -12.7% 7152 ± 1% sched_debug.cfs_rq[118]:/.tg->runnable_avg
> 8178 ± 0% -12.8% 7133 ± 1% sched_debug.cfs_rq[111]:/.tg->runnable_avg
> 7859652 ± 0% -12.7% 6863230 ± 1% meminfo.Slab
> 0.95 ± 6% +15.6% 1.10 ± 3% perf-profile.cpu-cycles.__fget.fget.sys_mmap_pgoff.sys_mmap.system_call_fastpath
> 1.10 ± 2% -10.5% 0.98 ± 4% perf-profile.cpu-cycles.ktime_get.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns
> 23237 ± 4% -13.3% 20143 ± 6% sched_debug.cfs_rq[51]:/.exec_clock
> 1.82 ± 2% -11.0% 1.62 ± 4% perf-profile.cpu-cycles.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
> 0.97 ± 7% +14.0% 1.11 ± 3% perf-profile.cpu-cycles.fget.sys_mmap_pgoff.sys_mmap.system_call_fastpath
> 23242 ± 4% -12.9% 20253 ± 6% sched_debug.cfs_rq[49]:/.exec_clock
> 22886 ± 5% -13.7% 19749 ± 5% sched_debug.cfs_rq[56]:/.exec_clock
> 1036 ± 0% -11.9% 914 ± 1% time.user_time
> 8527124 ± 0% -11.6% 7534220 ± 1% vmstat.memory.cache
> 1695225 ± 0% -10.7% 1513459 ± 1% softirqs.TIMER
> 23318 ± 6% -13.1% 20269 ± 6% sched_debug.cfs_rq[54]:/.exec_clock
> 667649 ± 3% -10.0% 600607 ± 4% numa-vmstat.node3.numa_local
> 7.244e+08 ± 0% -11.1% 6.439e+08 ± 1% time.minor_page_faults
> 7.254e+08 ± 0% -11.1% 6.449e+08 ± 1% proc-vmstat.pgfault
> 1.92 ± 2% -10.9% 1.71 ± 4% perf-profile.cpu-cycles.read_hpet.ktime_get.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns
> 22971 ± 5% -12.9% 19998 ± 5% sched_debug.cfs_rq[55]:/.exec_clock
> 131 ± 10% -11.7% 115 ± 6% sched_debug.cfs_rq[52]:/.tg_runnable_contrib
> 42.89 ± 0% -10.4% 38.41 ± 2% perf-profile.cpu-cycles.mmap_region.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap
> 6053 ± 10% -11.6% 5349 ± 6% sched_debug.cfs_rq[52]:/.avg->runnable_avg_sum
> 753344 ± 2% -9.0% 685539 ± 4% numa-vmstat.node3.numa_hit
> 501098 ± 0% -11.4% 443942 ± 2% softirqs.SCHED
> 1.19 ± 2% -9.0% 1.08 ± 3% perf-profile.cpu-cycles.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns.tick_nohz_restart
> 90940 ± 2% +9.4% 99459 ± 2% sched_debug.cpu#54.nr_load_updates
> 88590 ± 2% +9.8% 97229 ± 4% sched_debug.cpu#2.nr_load_updates
> 90669 ± 2% +9.6% 99355 ± 2% sched_debug.cpu#56.nr_load_updates
> 91272 ± 2% +9.4% 99833 ± 2% sched_debug.cpu#49.nr_load_updates
> 1.22 ± 1% +10.5% 1.35 ± 2% perf-profile.cpu-cycles.schedule.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
> 89287 ± 3% +10.3% 98507 ± 4% sched_debug.cpu#1.nr_load_updates
> 45.38 ± 0% -9.4% 41.10 ± 2% perf-profile.cpu-cycles.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap.system_call_fastpath
> 22980 ± 5% -12.4% 20128 ± 6% sched_debug.cfs_rq[50]:/.exec_clock
> 1.19 ± 2% -8.5% 1.09 ± 4% perf-profile.cpu-cycles.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns.tick_nohz_restart.tick_nohz_idle_exit
> 5570129 ± 0% -9.4% 5048932 ± 1% proc-vmstat.pgalloc_normal
> 1100174 ± 3% -6.9% 1024326 ± 3% numa-numastat.node3.local_node
> 2.06 ± 2% -9.1% 1.87 ± 4% perf-profile.cpu-cycles.print_context_stack.dump_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity
> 46.01 ± 0% -9.2% 41.78 ± 2% perf-profile.cpu-cycles.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap.system_call_fastpath
> 91494 ± 2% +10.3% 100902 ± 2% sched_debug.cpu#46.nr_load_updates
> 20296 ± 3% -24.7% 15293 ± 3% vmstat.system.in
> 140148 ± 0% -21.9% 109393 ± 1% vmstat.system.cs
> 191 ± 0% -19.5% 153 ± 0% turbostat.CorWatt
> 257 ± 0% -14.7% 219 ± 0% turbostat.PkgWatt
> 218 ± 0% -13.5% 188 ± 1% turbostat.Avg_MHz
> 6.84 ± 0% -13.6% 5.91 ± 1% turbostat.%Busy
> 578 ± 0% -8.5% 529 ± 0% pmeter.Average_Active_Power
> 73.34 ± 0% -3.0% 71.15 ± 0% turbostat.RAMWatt
>
> brickland3: Brickland Ivy Bridge-EX
> Memory: 512G
>
>
>
>
> vm-scalability.stddev
>
> 16 ++---------------------------------------------------------------------+
> | O |
> 14 ++ O O |
> 12 ++ O O O O O |
> | O OO O O |
> 10 O+ O O O O O |
> | O O O O O O O O O O |
> 8 ++ O O |
> | O O O |
> 6 ++ O |
> 4 ++ |
> | .* .* *. .* *.|
> 2 *+**. .*.* .* *.**. * + *.** + : * * *.*. .*.**.* *
> | ** *.* *.**.*.* *.* * * *.*.* ** |
> 0 ++---------------------------------------------------------------------+
>
>
> [*] bisect-good sample
> [O] bisect-bad sample
>
> To reproduce:
>
> apt-get install ruby
> git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
> cd lkp-tests
> bin/setup-local job.yaml # the job file attached in this email
> bin/run-local job.yaml
>
>
> Disclaimer:
> Results have been estimated based on internal Intel analysis and are provided
> for informational purposes only. Any difference in system hardware or software
> design or configuration may affect actual performance.
>
>
> Thanks,
> Ying Huang
>
>
> ---
> testcase: vm-scalability
> default-monitors:
> wait: pre-test
> uptime:
> iostat:
> vmstat:
> numa-numastat:
> numa-vmstat:
> numa-meminfo:
> proc-vmstat:
> proc-stat:
> meminfo:
> slabinfo:
> interrupts:
> lock_stat:
> latency_stats:
> softirqs:
> bdi_dev_mapping:
> diskstats:
> nfsstat:
> cpuidle:
> cpufreq-stats:
> turbostat:
> pmeter:
> sched_debug:
> interval: 10
> default_watchdogs:
> watch-oom:
> watchdog:
> cpufreq_governor: performance
> commit: ce43fa581f61c4756301e7fd8609f50579e13d5d
> model: Brickland Ivy Bridge-EX
> nr_cpu: 120
> memory: 512G
> hdd_partitions:
> swap_partitions:
> pmeter_server: lkp-st01
> pmeter_device: yokogawa-wt310
> perf-profile:
> runtime: 300s
> size:
> vm-scalability:
> test: small-allocs
> testbox: brickland3
> tbox_group: brickland3
> kconfig: x86_64-rhel
> enqueue_time: 2015-03-08 04:48:33.187343214 +08:00
> head_commit: ce43fa581f61c4756301e7fd8609f50579e13d5d
> base_commit: 13a7a6ac0a11197edcd0f756a035f472b42cdf8b
> branch: linux-devel/devel-hourly-2015030900
> kernel: "/kernel/x86_64-rhel/ce43fa581f61c4756301e7fd8609f50579e13d5d/vmlinuz-4.0.0-rc2-00784-gce43fa5"
> user: lkp
> queue: cyclic
> rootfs: debian-x86_64-2015-02-07.cgz
> result_root: "/result/brickland3/vm-scalability/performance-300s-small-allocs/debian-x86_64-2015-02-07.cgz/x86_64-rhel/ce43fa581f61c4756301e7fd8609f50579e13d5d/0"
> job_file: "/lkp/scheduled/brickland3/cyclic_vm-scalability-performance-300s-small-allocs-x86_64-rhel-HEAD-ce43fa581f61c4756301e7fd8609f50579e13d5d-0-20150308-92360-aeasab.yaml"
> dequeue_time: 2015-03-09 06:20:56.728013487 +08:00
> job_state: finished
> loadavg: 78.64 75.53 36.25 1/953 14075
> start_time: '1425853327'
> end_time: '1425853675'
> version: "/lkp/lkp/.src-20150308-175746"
> echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu10/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu100/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu101/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu102/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu103/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu104/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu105/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu106/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu107/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu108/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu109/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu11/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu110/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu111/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu112/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu113/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu114/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu115/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu116/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu117/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu118/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu119/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu12/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu13/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu14/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu15/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu16/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu17/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu18/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu19/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu2/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu20/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu21/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu22/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu23/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu24/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu25/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu26/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu27/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu28/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu29/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu3/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu30/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu31/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu32/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu33/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu34/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu35/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu36/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu37/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu38/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu39/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu4/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu40/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu41/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu42/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu43/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu44/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu45/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu46/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu47/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu48/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu49/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu5/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu50/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu51/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu52/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu53/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu54/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu55/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu56/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu57/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu58/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu59/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu6/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu60/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu61/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu62/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu63/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu64/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu65/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu66/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu67/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu68/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu69/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu7/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu70/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu71/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu72/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu73/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu74/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu75/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu76/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu77/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu78/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu79/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu8/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu80/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu81/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu82/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu83/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu84/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu85/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu86/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu87/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu88/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu89/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu9/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu90/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu91/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu92/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu93/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu94/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu95/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu96/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu97/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu98/cpufreq/scaling_governor
> echo performance > /sys/devices/system/cpu/cpu99/cpufreq/scaling_governor
> mount -t tmpfs -o size=100% vm-scalability-tmp /tmp/vm-scalability-tmp
> truncate -s 540949544960 /tmp/vm-scalability.img
> mkfs.xfs -q /tmp/vm-scalability.img
> mount -o loop /tmp/vm-scalability.img /tmp/vm-scalability
> ./case-small-allocs
> ./usemem --runtime 300 -n 120 --readonly --unit 40960 36650387592
> umount /tmp/vm-scalability-tmp
> umount /tmp/vm-scalability
> rm /tmp/vm-scalability.img
> _______________________________________________
> LKP mailing list
> LKP@linux.intel.com
^ permalink raw reply [flat|nested] 4+ messages in thread
* [LKP] [locking/rwsem] b3fd4f03ca0: -11.1% vm-scalability.throughput
@ 2015-03-13 5:38 Huang Ying
2015-03-13 7:42 ` Ingo Molnar
0 siblings, 1 reply; 4+ messages in thread
From: Huang Ying @ 2015-03-13 5:38 UTC (permalink / raw)
To: Davidlohr Bueso; +Cc: LKML, LKP ML, Ingo Molnar
[-- Attachment #1: Type: text/plain, Size: 47511 bytes --]
Sorry for duplicated email. Forget to send to the patch author.
FYI, we noticed the below changes on
git://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git master
commit b3fd4f03ca0b9952221f39ae6790e698bf4b39e7 ("locking/rwsem: Avoid deceiving lock spinners")
testbox/testcase/testparams: brickland3/vm-scalability/performance-300s-small-allocs
7a215f89a0335582 b3fd4f03ca0b9952221f39ae67
---------------- --------------------------
%stddev %change %stddev
\ | \
2.38 ± 18% +247.4% 8.27 ± 16% vm-scalability.stddev
24226456 ± 0% -23.0% 18650874 ± 1% vm-scalability.time.voluntary_context_switches
1622 ± 0% -15.6% 1369 ± 1% vm-scalability.time.system_time
765 ± 0% -13.1% 665 ± 1% vm-scalability.time.percent_of_cpu_this_job_got
1036 ± 0% -11.9% 914 ± 1% vm-scalability.time.user_time
7.244e+08 ± 0% -11.1% 6.439e+08 ± 1% vm-scalability.time.minor_page_faults
10841276 ± 0% -11.1% 9639981 ± 1% vm-scalability.throughput
8922883 ± 3% -70.2% 2658543 ± 4% cpuidle.C1-IVT-4S.usage
1.19e+10 ± 2% -66.2% 4.016e+09 ± 4% cpuidle.C1-IVT-4S.time
1.97 ± 4% +106.7% 4.08 ± 6% perf-profile.cpu-cycles.intel_idle.cpuidle_enter_state.cpuidle_enter.cpu_startup_entry.start_secondary
58.29 ± 1% -50.2% 29.03 ± 2% turbostat.CPU%c1
34.84 ± 2% +86.6% 65.01 ± 1% turbostat.CPU%c6
170814 ± 7% -39.9% 102682 ± 11% sched_debug.cpu#21.sched_goidle
367762 ± 11% -39.9% 220850 ± 10% sched_debug.cpu#26.sched_count
5.12 ± 2% -39.8% 3.08 ± 5% perf-profile.cpu-cycles.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
342453 ± 7% -39.9% 205985 ± 11% sched_debug.cpu#21.nr_switches
3.14 ± 2% +68.0% 5.28 ± 5% perf-profile.cpu-cycles.cpuidle_enter_state.cpuidle_enter.cpu_startup_entry.start_secondary
170317 ± 6% -39.9% 102389 ± 11% sched_debug.cpu#22.sched_goidle
168710 ± 6% -38.4% 103876 ± 11% sched_debug.cpu#23.sched_goidle
341400 ± 6% -39.8% 205416 ± 11% sched_debug.cpu#22.nr_switches
338590 ± 6% -38.5% 208381 ± 11% sched_debug.cpu#23.nr_switches
165879 ± 4% -36.6% 105178 ± 10% sched_debug.cpu#18.sched_goidle
168958 ± 6% -39.0% 103043 ± 11% sched_debug.cpu#20.sched_goidle
359148 ± 5% -39.2% 218455 ± 11% sched_debug.cpu#20.sched_count
332511 ± 4% -36.5% 211029 ± 10% sched_debug.cpu#18.nr_switches
338875 ± 6% -39.0% 206782 ± 11% sched_debug.cpu#20.nr_switches
359968 ± 6% -39.4% 218057 ± 12% sched_debug.cpu#21.sched_count
166207 ± 4% -38.5% 102168 ± 11% sched_debug.cpu#27.sched_goidle
164881 ± 6% -37.0% 103846 ± 11% sched_debug.cpu#25.sched_goidle
330721 ± 6% -37.0% 208344 ± 11% sched_debug.cpu#25.nr_switches
333161 ± 4% -38.3% 205591 ± 11% sched_debug.cpu#27.nr_switches
362674 ± 7% -40.1% 217123 ± 10% sched_debug.cpu#22.sched_count
350433 ± 7% -37.3% 219595 ± 13% sched_debug.cpu#15.nr_switches
174599 ± 7% -37.4% 109366 ± 13% sched_debug.cpu#15.sched_goidle
174038 ± 9% -36.8% 109941 ± 12% sched_debug.cpu#17.sched_goidle
348896 ± 9% -36.7% 220793 ± 12% sched_debug.cpu#17.nr_switches
327443 ± 6% -36.8% 207015 ± 11% sched_debug.cpu#24.nr_switches
348687 ± 5% -37.2% 219100 ± 11% sched_debug.cpu#27.sched_count
163220 ± 6% -36.9% 103066 ± 11% sched_debug.cpu#24.sched_goidle
167997 ± 5% -35.7% 108017 ± 11% sched_debug.cpu#16.sched_goidle
365757 ± 10% -38.9% 223561 ± 12% sched_debug.cpu#28.sched_count
336756 ± 5% -35.6% 216751 ± 11% sched_debug.cpu#16.nr_switches
174236 ± 12% -40.6% 103542 ± 10% sched_debug.cpu#26.sched_goidle
349494 ± 12% -40.6% 207718 ± 10% sched_debug.cpu#26.nr_switches
175130 ± 10% -39.7% 105573 ± 13% sched_debug.cpu#28.sched_goidle
351090 ± 10% -39.6% 212090 ± 13% sched_debug.cpu#28.nr_switches
350972 ± 5% -35.2% 227402 ± 10% sched_debug.cpu#19.sched_count
343794 ± 5% -36.2% 219297 ± 10% sched_debug.cpu#24.sched_count
347268 ± 5% -36.3% 221228 ± 10% sched_debug.cpu#25.sched_count
352999 ± 5% -34.1% 232554 ± 9% sched_debug.cpu#16.sched_count
354362 ± 7% -37.0% 223292 ± 10% sched_debug.cpu#23.sched_count
166091 ± 7% -36.6% 105356 ± 14% sched_debug.cpu#29.sched_goidle
350840 ± 6% -35.5% 226331 ± 13% sched_debug.cpu#29.sched_count
332928 ± 7% -36.4% 211785 ± 14% sched_debug.cpu#29.nr_switches
369396 ± 7% -36.4% 234822 ± 13% sched_debug.cpu#15.sched_count
364063 ± 9% -34.6% 238151 ± 11% sched_debug.cpu#17.sched_count
349193 ± 4% -35.2% 226315 ± 9% sched_debug.cpu#18.sched_count
3.94 ± 1% +49.9% 5.90 ± 5% perf-profile.cpu-cycles.cpuidle_enter.cpu_startup_entry.start_secondary
5361900 ± 1% +50.5% 8067121 ± 0% cpuidle.C6-IVT-4S.usage
166471 ± 5% -36.3% 106063 ± 10% sched_debug.cpu#19.sched_goidle
334078 ± 5% -36.3% 212767 ± 10% sched_debug.cpu#19.nr_switches
511523 ± 11% +40.1% 716466 ± 9% sched_debug.cpu#38.avg_idle
5141 ± 10% -21.3% 4046 ± 18% sched_debug.cfs_rq[16]:/.avg->runnable_avg_sum
185324 ± 6% -28.9% 131826 ± 11% sched_debug.cpu#43.ttwu_count
111 ± 10% -21.6% 87 ± 18% sched_debug.cfs_rq[16]:/.tg_runnable_contrib
188387 ± 5% -28.4% 134976 ± 11% sched_debug.cpu#35.ttwu_count
182306 ± 7% -28.0% 131276 ± 9% sched_debug.cpu#19.ttwu_count
181618 ± 5% -28.6% 129685 ± 10% sched_debug.cpu#18.ttwu_count
370815 ± 7% -25.5% 276125 ± 11% sched_debug.cpu#38.sched_count
178281 ± 7% -25.9% 132044 ± 11% sched_debug.cpu#38.sched_goidle
181914 ± 5% -28.0% 130970 ± 8% sched_debug.cpu#16.ttwu_count
357347 ± 7% -25.9% 264826 ± 11% sched_debug.cpu#38.nr_switches
546593 ± 7% +38.6% 757389 ± 4% sched_debug.cpu#27.avg_idle
183057 ± 5% -27.7% 132439 ± 8% sched_debug.cpu#17.ttwu_count
174289 ± 8% -25.5% 129871 ± 13% sched_debug.cpu#43.sched_goidle
349323 ± 8% -25.4% 260438 ± 13% sched_debug.cpu#43.nr_switches
187088 ± 5% -27.4% 135758 ± 10% sched_debug.cpu#36.ttwu_count
190589 ± 5% -29.1% 135135 ± 12% sched_debug.cpu#33.ttwu_count
179655 ± 10% -28.6% 128343 ± 13% sched_debug.cpu#44.sched_goidle
367566 ± 11% -26.0% 271924 ± 14% sched_debug.cpu#43.sched_count
360119 ± 10% -28.5% 257380 ± 13% sched_debug.cpu#44.nr_switches
177427 ± 5% -25.5% 132241 ± 9% sched_debug.cpu#20.ttwu_count
187477 ± 6% -28.9% 133263 ± 11% sched_debug.cpu#39.ttwu_count
187313 ± 5% -28.7% 133487 ± 11% sched_debug.cpu#41.ttwu_count
192203 ± 4% -28.3% 137818 ± 10% sched_debug.cpu#31.ttwu_count
183679 ± 5% -28.1% 132147 ± 10% sched_debug.cpu#44.ttwu_count
367665 ± 9% -24.6% 277237 ± 15% sched_debug.cpu#42.sched_count
178211 ± 3% -26.9% 130348 ± 8% sched_debug.cpu#23.ttwu_count
175478 ± 4% -25.6% 130478 ± 9% sched_debug.cpu#22.ttwu_count
186974 ± 6% -27.6% 135310 ± 10% sched_debug.cpu#38.ttwu_count
190431 ± 4% -28.0% 137033 ± 11% sched_debug.cpu#32.ttwu_count
190722 ± 4% -28.4% 136639 ± 10% sched_debug.cpu#34.ttwu_count
175431 ± 8% -25.3% 131079 ± 12% sched_debug.cpu#42.sched_goidle
361690 ± 8% -24.8% 272015 ± 13% sched_debug.cpu#39.sched_count
351619 ± 8% -25.2% 262838 ± 12% sched_debug.cpu#42.nr_switches
175056 ± 6% -24.8% 131564 ± 12% sched_debug.cpu#40.sched_goidle
350873 ± 6% -24.8% 263820 ± 12% sched_debug.cpu#40.nr_switches
173107 ± 6% -25.3% 129289 ± 13% sched_debug.cpu#37.sched_goidle
346966 ± 6% -25.3% 259257 ± 13% sched_debug.cpu#37.nr_switches
171359 ± 7% -24.8% 128941 ± 11% sched_debug.cpu#39.sched_goidle
343474 ± 7% -24.7% 258590 ± 11% sched_debug.cpu#39.nr_switches
375852 ± 12% -28.4% 269206 ± 15% sched_debug.cpu#44.sched_count
180303 ± 8% -25.0% 135309 ± 10% sched_debug.cpu#30.sched_goidle
177803 ± 5% -25.3% 132893 ± 9% sched_debug.cpu#21.ttwu_count
361386 ± 8% -24.9% 271330 ± 10% sched_debug.cpu#30.nr_switches
172414 ± 7% -24.9% 129400 ± 13% sched_debug.cpu#41.sched_goidle
345579 ± 7% -24.9% 259489 ± 13% sched_debug.cpu#41.nr_switches
373591 ± 8% -25.3% 279094 ± 13% sched_debug.cpu#31.sched_count
177533 ± 9% -26.9% 129812 ± 12% sched_debug.cpu#36.sched_goidle
179094 ± 8% -26.3% 131936 ± 11% sched_debug.cpu#35.sched_goidle
376042 ± 8% -26.7% 275458 ± 12% sched_debug.cpu#35.sched_count
355841 ± 9% -26.8% 260341 ± 12% sched_debug.cpu#36.nr_switches
183165 ± 12% -29.4% 129301 ± 13% sched_debug.cpu#33.sched_goidle
371977 ± 9% -27.3% 270521 ± 13% sched_debug.cpu#36.sched_count
184524 ± 5% -27.3% 134078 ± 10% sched_debug.cpu#42.ttwu_count
204591 ± 7% -22.5% 158606 ± 16% sched_debug.cfs_rq[33]:/.min_vruntime
358950 ± 8% -26.3% 264608 ± 11% sched_debug.cpu#35.nr_switches
367143 ± 12% -29.4% 259297 ± 13% sched_debug.cpu#33.nr_switches
184796 ± 5% -26.7% 135370 ± 8% sched_debug.cpu#15.ttwu_count
560186 ± 7% +36.4% 764034 ± 4% sched_debug.cpu#15.avg_idle
192024 ± 5% -27.6% 138984 ± 9% sched_debug.cpu#30.ttwu_count
186661 ± 5% -27.9% 134534 ± 11% sched_debug.cpu#40.ttwu_count
175890 ± 4% -26.4% 129452 ± 8% sched_debug.cpu#26.ttwu_count
366664 ± 8% -24.7% 276276 ± 14% sched_debug.cpu#34.sched_count
186046 ± 5% -26.7% 136338 ± 10% sched_debug.cpu#37.ttwu_count
173138 ± 4% -26.5% 127219 ± 8% sched_debug.cpu#28.ttwu_count
231881 ± 4% -26.0% 171683 ± 6% sched_debug.cpu#48.ttwu_count
229108 ± 4% -24.5% 173024 ± 5% sched_debug.cpu#47.ttwu_count
545213 ± 6% +30.6% 712076 ± 3% sched_debug.cpu#39.avg_idle
175780 ± 8% -25.0% 131911 ± 12% sched_debug.cpu#34.sched_goidle
352325 ± 8% -24.9% 264519 ± 12% sched_debug.cpu#34.nr_switches
368764 ± 7% -25.9% 273326 ± 13% sched_debug.cpu#40.sched_count
178369 ± 7% -25.3% 133316 ± 12% sched_debug.cpu#31.sched_goidle
357523 ± 7% -25.2% 267329 ± 12% sched_debug.cpu#31.nr_switches
445168 ± 6% -21.5% 349498 ± 7% sched_debug.cpu#50.sched_count
178502 ± 3% -27.0% 130326 ± 8% sched_debug.cpu#24.ttwu_count
232438 ± 4% -25.2% 173912 ± 4% sched_debug.cpu#45.ttwu_count
214980 ± 6% -21.3% 169213 ± 7% sched_debug.cpu#50.sched_goidle
430801 ± 6% -21.3% 339213 ± 7% sched_debug.cpu#50.nr_switches
175354 ± 7% -25.0% 131440 ± 12% sched_debug.cpu#32.sched_goidle
351473 ± 7% -25.0% 263573 ± 12% sched_debug.cpu#32.nr_switches
175818 ± 4% -25.5% 131027 ± 9% sched_debug.cpu#25.ttwu_count
562351 ± 4% +33.0% 747969 ± 7% sched_debug.cpu#17.avg_idle
226274 ± 5% -24.6% 170581 ± 5% sched_debug.cpu#54.ttwu_count
566741 ± 5% +33.2% 754744 ± 4% sched_debug.cpu#29.avg_idle
365692 ± 8% -24.7% 275497 ± 14% sched_debug.cpu#32.sched_count
443973 ± 6% -22.1% 345964 ± 7% sched_debug.cpu#51.sched_count
360816 ± 8% -25.3% 269548 ± 14% sched_debug.cpu#41.sched_count
224711 ± 4% -24.6% 169414 ± 6% sched_debug.cpu#53.ttwu_count
380979 ± 13% -28.9% 270783 ± 14% sched_debug.cpu#33.sched_count
174502 ± 4% -27.0% 127311 ± 8% sched_debug.cpu#29.ttwu_count
573889 ± 4% +32.2% 758635 ± 5% sched_debug.cpu#24.avg_idle
523204 ± 10% +29.1% 675536 ± 9% sched_debug.cpu#6.avg_idle
173555 ± 4% -25.7% 128988 ± 8% sched_debug.cpu#27.ttwu_count
228859 ± 4% -25.2% 171229 ± 6% sched_debug.cpu#49.ttwu_count
529356 ± 9% +32.4% 700872 ± 6% sched_debug.cpu#33.avg_idle
565916 ± 5% +33.4% 755047 ± 7% sched_debug.cpu#23.avg_idle
232257 ± 3% -25.1% 173926 ± 5% sched_debug.cpu#46.ttwu_count
227954 ± 4% -24.3% 172631 ± 5% sched_debug.cpu#52.ttwu_count
197241 ± 5% -23.5% 150963 ± 8% sched_debug.cpu#4.ttwu_count
228392 ± 3% -24.8% 171779 ± 6% sched_debug.cpu#51.ttwu_count
542129 ± 5% +28.0% 693751 ± 6% sched_debug.cpu#13.avg_idle
364245 ± 8% -25.1% 272652 ± 15% sched_debug.cpu#37.sched_count
558275 ± 8% +36.1% 759570 ± 6% sched_debug.cpu#26.avg_idle
225027 ± 5% -24.7% 169427 ± 6% sched_debug.cpu#57.ttwu_count
17.06 ± 1% -23.0% 13.13 ± 3% perf-profile.cpu-cycles.call_rwsem_down_write_failed.vma_link.mmap_region.do_mmap_pgoff.vm_mmap_pgoff
197493 ± 5% -22.8% 152503 ± 8% sched_debug.cpu#2.ttwu_count
16.99 ± 1% -23.2% 13.05 ± 3% perf-profile.cpu-cycles.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region.do_mmap_pgoff
223164 ± 4% -24.7% 168105 ± 6% sched_debug.cpu#59.ttwu_count
223884 ± 4% -24.6% 168887 ± 4% sched_debug.cpu#58.ttwu_count
538073 ± 6% +27.8% 687436 ± 8% sched_debug.cpu#43.avg_idle
445916 ± 7% -22.4% 345938 ± 6% sched_debug.cpu#52.sched_count
214967 ± 6% -21.9% 167898 ± 6% sched_debug.cpu#52.sched_goidle
534156 ± 9% +25.2% 668876 ± 5% sched_debug.cpu#11.avg_idle
430800 ± 6% -21.9% 336561 ± 6% sched_debug.cpu#52.nr_switches
117 ± 8% -21.7% 91 ± 5% sched_debug.cfs_rq[36]:/.tg_runnable_contrib
224801 ± 4% -24.0% 170764 ± 5% sched_debug.cpu#55.ttwu_count
225103 ± 4% -24.9% 168953 ± 5% sched_debug.cpu#56.ttwu_count
24226456 ± 0% -23.0% 18650874 ± 1% time.voluntary_context_switches
5411 ± 8% -21.3% 4256 ± 4% sched_debug.cfs_rq[36]:/.avg->runnable_avg_sum
212964 ± 5% -21.5% 167092 ± 6% sched_debug.cpu#51.sched_goidle
426769 ± 5% -21.5% 334967 ± 6% sched_debug.cpu#51.nr_switches
519159 ± 4% +27.0% 659572 ± 7% sched_debug.cpu#52.avg_idle
193464 ± 4% -22.1% 150665 ± 7% sched_debug.cpu#7.ttwu_count
226747 ± 4% -24.4% 171347 ± 6% sched_debug.cpu#50.ttwu_count
572755 ± 6% +29.0% 738639 ± 4% sched_debug.cpu#25.avg_idle
520910 ± 7% +35.0% 703382 ± 6% sched_debug.cpu#32.avg_idle
2.696e+10 ± 1% +29.0% 3.478e+10 ± 0% cpuidle.C6-IVT-4S.time
530311 ± 12% +31.1% 695099 ± 5% sched_debug.cpu#44.avg_idle
204543 ± 8% -20.5% 162661 ± 15% sched_debug.cfs_rq[31]:/.min_vruntime
484242 ± 9% +31.7% 637669 ± 8% sched_debug.cpu#47.avg_idle
6.85 ± 1% -22.4% 5.32 ± 3% perf-profile.cpu-cycles.rwsem_spin_on_owner.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
528770 ± 7% +31.6% 695818 ± 6% sched_debug.cpu#40.avg_idle
223475 ± 4% -20.9% 176718 ± 6% sched_debug.cfs_rq[52]:/.min_vruntime
577331 ± 4% +29.2% 745806 ± 4% sched_debug.cpu#16.avg_idle
192821 ± 4% -23.4% 147763 ± 8% sched_debug.cpu#10.ttwu_count
198393 ± 4% -23.1% 152635 ± 7% sched_debug.cpu#1.ttwu_count
572991 ± 9% +29.0% 738876 ± 3% sched_debug.cpu#18.avg_idle
531346 ± 5% +26.8% 673808 ± 6% sched_debug.cpu#35.avg_idle
531692 ± 8% +30.0% 691275 ± 7% sched_debug.cpu#36.avg_idle
573689 ± 9% +30.1% 746581 ± 3% sched_debug.cpu#28.avg_idle
194767 ± 3% -22.1% 151736 ± 7% sched_debug.cpu#6.ttwu_count
576252 ± 10% +29.8% 748134 ± 5% sched_debug.cpu#19.avg_idle
189779 ± 5% -22.5% 147019 ± 9% sched_debug.cpu#13.ttwu_count
574093 ± 9% +28.0% 734982 ± 4% sched_debug.cpu#22.avg_idle
530896 ± 7% +25.4% 665864 ± 7% sched_debug.cpu#9.avg_idle
222143 ± 5% -19.0% 179889 ± 9% sched_debug.cfs_rq[49]:/.min_vruntime
190106 ± 5% -22.4% 147518 ± 7% sched_debug.cpu#14.ttwu_count
192933 ± 3% -21.8% 150835 ± 8% sched_debug.cpu#8.ttwu_count
193656 ± 4% -22.7% 149678 ± 8% sched_debug.cpu#9.ttwu_count
196739 ± 5% -22.9% 151747 ± 7% sched_debug.cpu#3.ttwu_count
434909 ± 6% -18.4% 354789 ± 6% sched_debug.cpu#55.sched_count
194722 ± 4% -22.0% 151895 ± 8% sched_debug.cpu#5.ttwu_count
439285 ± 7% -19.7% 352534 ± 6% sched_debug.cpu#47.sched_count
585003 ± 7% +31.4% 768551 ± 5% sched_debug.cpu#20.avg_idle
432219 ± 7% -19.5% 347734 ± 7% sched_debug.cpu#48.sched_count
224113 ± 5% -18.9% 181798 ± 8% sched_debug.cfs_rq[48]:/.min_vruntime
534566 ± 7% +30.3% 696442 ± 6% sched_debug.cpu#31.avg_idle
525194 ± 6% +23.5% 648587 ± 7% sched_debug.cpu#7.avg_idle
209128 ± 6% -19.4% 168562 ± 7% sched_debug.cpu#48.sched_goidle
419098 ± 6% -19.4% 337908 ± 7% sched_debug.cpu#48.nr_switches
448417 ± 7% -19.8% 359813 ± 6% sched_debug.cpu#46.sched_count
491962 ± 8% +26.7% 623449 ± 4% sched_debug.cpu#48.avg_idle
212354 ± 6% -19.7% 170477 ± 5% sched_debug.cpu#47.sched_goidle
581409 ± 7% +23.6% 718790 ± 4% sched_debug.cpu#37.avg_idle
194066 ± 6% -17.8% 159565 ± 11% sched_debug.cfs_rq[16]:/.min_vruntime
425571 ± 6% -19.7% 341752 ± 5% sched_debug.cpu#47.nr_switches
215882 ± 7% -19.5% 173827 ± 5% sched_debug.cpu#46.sched_goidle
442267 ± 6% -21.4% 347467 ± 6% sched_debug.cpu#59.sched_count
432617 ± 7% -19.5% 348457 ± 5% sched_debug.cpu#46.nr_switches
569496 ± 11% +32.0% 751590 ± 5% sched_debug.cpu#21.avg_idle
189763 ± 5% -22.2% 147705 ± 8% sched_debug.cpu#12.ttwu_count
223064 ± 4% -19.3% 179906 ± 5% sched_debug.cfs_rq[53]:/.min_vruntime
213869 ± 5% -21.0% 168888 ± 5% sched_debug.cpu#59.sched_goidle
428592 ± 5% -21.0% 338537 ± 5% sched_debug.cpu#59.nr_switches
441291 ± 6% -19.8% 353975 ± 5% sched_debug.cpu#45.sched_count
213493 ± 5% -19.5% 171778 ± 5% sched_debug.cpu#45.sched_goidle
427837 ± 5% -19.5% 344360 ± 5% sched_debug.cpu#45.nr_switches
191795 ± 5% -22.6% 148369 ± 8% sched_debug.cpu#11.ttwu_count
194309 ± 6% -19.3% 156815 ± 8% sched_debug.cfs_rq[17]:/.min_vruntime
221301 ± 5% -20.9% 175025 ± 7% sched_debug.cfs_rq[56]:/.min_vruntime
538571 ± 8% +24.4% 670227 ± 8% sched_debug.cpu#3.avg_idle
223672 ± 5% -18.9% 181388 ± 7% sched_debug.cfs_rq[47]:/.min_vruntime
425387 ± 7% -18.3% 347554 ± 7% sched_debug.cpu#54.sched_count
199287 ± 6% -21.7% 156117 ± 12% sched_debug.cfs_rq[15]:/.min_vruntime
1.00 ± 5% -15.8% 0.84 ± 6% perf-profile.cpu-cycles.kmem_cache_alloc_trace.perf_event_mmap.mmap_region.do_mmap_pgoff.vm_mmap_pgoff
385907 ± 8% -23.7% 294552 ± 10% sched_debug.cpu#6.sched_count
493228 ± 5% +27.4% 628579 ± 8% sched_debug.cpu#54.avg_idle
185090 ± 8% -23.0% 142559 ± 10% sched_debug.cpu#6.sched_goidle
542727 ± 8% +27.5% 691759 ± 4% sched_debug.cpu#42.avg_idle
209830 ± 6% -18.0% 172096 ± 6% sched_debug.cpu#55.sched_goidle
370989 ± 8% -23.0% 285813 ± 10% sched_debug.cpu#6.nr_switches
420473 ± 6% -18.0% 344973 ± 6% sched_debug.cpu#55.nr_switches
201389 ± 4% -20.7% 159785 ± 7% sched_debug.cpu#0.ttwu_count
365245 ± 7% -20.1% 291843 ± 9% sched_debug.cpu#5.sched_count
176316 ± 7% -19.7% 141647 ± 9% sched_debug.cpu#5.sched_goidle
353385 ± 7% -19.6% 284000 ± 9% sched_debug.cpu#5.nr_switches
430699 ± 7% -20.6% 341980 ± 7% sched_debug.cpu#53.sched_count
434688 ± 7% -17.9% 356994 ± 7% sched_debug.cpu#58.sched_count
910 ± 11% -15.6% 767 ± 12% sched_debug.cpu#34.ttwu_local
194153 ± 7% -16.9% 161410 ± 5% sched_debug.cfs_rq[19]:/.min_vruntime
435164 ± 10% -20.0% 348238 ± 7% sched_debug.cpu#56.sched_count
25686 ± 0% -18.8% 20849 ± 1% softirqs.HRTIMER
205841 ± 7% -18.6% 167608 ± 6% sched_debug.cpu#54.sched_goidle
412493 ± 7% -18.5% 335995 ± 6% sched_debug.cpu#54.nr_switches
209629 ± 7% -17.5% 172950 ± 7% sched_debug.cpu#58.sched_goidle
420079 ± 7% -17.5% 346715 ± 7% sched_debug.cpu#58.nr_switches
190909 ± 5% -19.3% 154071 ± 8% sched_debug.cfs_rq[26]:/.min_vruntime
535739 ± 10% +25.8% 674192 ± 3% sched_debug.cpu#41.avg_idle
220505 ± 5% -17.2% 182496 ± 10% sched_debug.cfs_rq[57]:/.min_vruntime
207365 ± 6% -19.9% 166054 ± 7% sched_debug.cpu#53.sched_goidle
415569 ± 6% -19.9% 332885 ± 7% sched_debug.cpu#53.nr_switches
433052 ± 7% -19.5% 348641 ± 8% sched_debug.cpu#57.sched_count
534493 ± 4% +25.6% 671066 ± 4% sched_debug.cpu#2.avg_idle
1.02 ± 2% -20.2% 0.81 ± 8% perf-profile.cpu-cycles.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__run_hrtimer
5217 ± 12% -17.6% 4297 ± 9% sched_debug.cfs_rq[26]:/.avg->runnable_avg_sum
209594 ± 6% -19.1% 169509 ± 8% sched_debug.cpu#57.sched_goidle
420012 ± 6% -19.1% 339802 ± 8% sched_debug.cpu#57.nr_switches
503208 ± 10% +25.5% 631683 ± 7% sched_debug.cpu#55.avg_idle
113 ± 12% -17.9% 92 ± 9% sched_debug.cfs_rq[26]:/.tg_runnable_contrib
549109 ± 5% +22.6% 673144 ± 6% sched_debug.cpu#14.avg_idle
210495 ± 9% -19.7% 169109 ± 7% sched_debug.cpu#56.sched_goidle
421839 ± 9% -19.6% 338979 ± 7% sched_debug.cpu#56.nr_switches
221205 ± 4% -17.6% 182374 ± 7% sched_debug.cfs_rq[50]:/.min_vruntime
502758 ± 6% +23.1% 618755 ± 7% sched_debug.cpu#46.avg_idle
222043 ± 4% -18.6% 180727 ± 10% sched_debug.cfs_rq[51]:/.min_vruntime
221617 ± 4% -18.3% 181127 ± 8% sched_debug.cfs_rq[55]:/.min_vruntime
557533 ± 11% +22.2% 681218 ± 7% sched_debug.cpu#12.avg_idle
187238 ± 6% -17.7% 154099 ± 10% sched_debug.cfs_rq[29]:/.min_vruntime
551333 ± 10% +22.2% 673592 ± 7% sched_debug.cpu#34.avg_idle
224579 ± 4% -16.6% 187288 ± 9% sched_debug.cfs_rq[54]:/.min_vruntime
184873 ± 6% -15.9% 155439 ± 8% sched_debug.cfs_rq[28]:/.min_vruntime
206172 ± 6% -18.2% 168730 ± 7% sched_debug.cpu#49.sched_goidle
413179 ± 6% -18.1% 338238 ± 7% sched_debug.cpu#49.nr_switches
225157 ± 5% -16.4% 188227 ± 9% sched_debug.cfs_rq[46]:/.min_vruntime
175150 ± 5% -16.9% 145619 ± 11% sched_debug.cpu#3.sched_goidle
351054 ± 5% -16.8% 291944 ± 11% sched_debug.cpu#3.nr_switches
564018 ± 3% +21.0% 682616 ± 6% sched_debug.cpu#4.avg_idle
5529 ± 8% -18.1% 4527 ± 11% sched_debug.cfs_rq[39]:/.avg->runnable_avg_sum
600812 ± 5% -15.3% 508926 ± 9% numa-vmstat.node2.numa_local
187471 ± 4% -18.5% 152874 ± 10% sched_debug.cfs_rq[22]:/.min_vruntime
19730 ± 6% -13.7% 17025 ± 9% sched_debug.cfs_rq[26]:/.exec_clock
425149 ± 6% -18.2% 347836 ± 7% sched_debug.cpu#49.sched_count
22908 ± 5% -12.9% 19945 ± 5% sched_debug.cfs_rq[58]:/.exec_clock
191793 ± 4% -16.6% 160031 ± 10% sched_debug.cfs_rq[24]:/.min_vruntime
14.49 ± 0% +16.4% 16.87 ± 2% perf-profile.cpu-cycles.start_secondary
514287 ± 10% +19.7% 615733 ± 6% sched_debug.cpu#58.avg_idle
1622 ± 0% -15.6% 1369 ± 1% time.system_time
14.45 ± 0% +16.2% 16.80 ± 2% perf-profile.cpu-cycles.cpu_startup_entry.start_secondary
1117 ± 6% -12.1% 982 ± 3% proc-vmstat.pgmigrate_success
1117 ± 6% -12.1% 982 ± 3% proc-vmstat.numa_pages_migrated
23520 ± 4% -14.0% 20233 ± 6% sched_debug.cfs_rq[48]:/.exec_clock
372296 ± 1% -18.0% 305136 ± 9% sched_debug.cpu#2.sched_count
218377 ± 6% -16.5% 182283 ± 6% sched_debug.cfs_rq[58]:/.min_vruntime
548860 ± 8% +25.4% 688468 ± 6% sched_debug.cpu#8.avg_idle
224066 ± 5% -17.7% 184445 ± 8% sched_debug.cfs_rq[45]:/.min_vruntime
23172 ± 4% -12.9% 20184 ± 5% sched_debug.cfs_rq[52]:/.exec_clock
947362 ± 3% -14.4% 810580 ± 7% numa-numastat.node2.local_node
22992 ± 5% -12.9% 20026 ± 7% sched_debug.cfs_rq[59]:/.exec_clock
23572 ± 4% -12.3% 20668 ± 5% sched_debug.cfs_rq[46]:/.exec_clock
6293 ± 8% -16.0% 5288 ± 8% sched_debug.cfs_rq[47]:/.avg->runnable_avg_sum
23545 ± 4% -13.3% 20402 ± 6% sched_debug.cfs_rq[47]:/.exec_clock
7 ± 0% -14.3% 6 ± 0% vmstat.procs.r
136 ± 8% -16.3% 114 ± 8% sched_debug.cfs_rq[47]:/.tg_runnable_contrib
952018 ± 3% -14.1% 817562 ± 7% numa-numastat.node2.numa_hit
684874 ± 4% -13.1% 595283 ± 7% numa-vmstat.node2.numa_hit
22864 ± 5% -12.7% 19967 ± 5% sched_debug.cfs_rq[57]:/.exec_clock
190734 ± 5% -16.3% 159695 ± 8% sched_debug.cfs_rq[23]:/.min_vruntime
237300 ± 6% -14.9% 202014 ± 7% numa-vmstat.node3.nr_page_table_pages
949123 ± 6% -14.9% 808058 ± 7% numa-meminfo.node3.PageTables
11.45 ± 4% +12.2% 12.84 ± 7% perf-profile.cpu-cycles.task_numa_work.task_work_run.do_notify_resume.retint_signal
561716 ± 7% +22.7% 689210 ± 5% sched_debug.cpu#10.avg_idle
23421 ± 4% -12.5% 20484 ± 5% sched_debug.cfs_rq[45]:/.exec_clock
23090 ± 4% -13.4% 19999 ± 6% sched_debug.cfs_rq[53]:/.exec_clock
2257945 ± 6% -14.5% 1929848 ± 7% numa-meminfo.node3.SUnreclaim
564591 ± 6% -14.5% 482457 ± 7% numa-vmstat.node3.nr_slab_unreclaimable
7903 ± 0% -13.6% 6830 ± 1% sched_debug.cfs_rq[11]:/.tg->runnable_avg
522411 ± 6% +15.9% 605704 ± 4% sched_debug.cpu#59.avg_idle
7899 ± 0% -13.6% 6827 ± 1% sched_debug.cfs_rq[10]:/.tg->runnable_avg
7884 ± 0% -13.6% 6811 ± 1% sched_debug.cfs_rq[2]:/.tg->runnable_avg
7913 ± 0% -13.6% 6839 ± 1% sched_debug.cfs_rq[14]:/.tg->runnable_avg
2272179 ± 6% -14.4% 1944358 ± 7% numa-meminfo.node3.Slab
7896 ± 0% -13.6% 6826 ± 1% sched_debug.cfs_rq[9]:/.tg->runnable_avg
7894 ± 0% -13.6% 6822 ± 1% sched_debug.cfs_rq[8]:/.tg->runnable_avg
7877 ± 0% -13.6% 6802 ± 1% sched_debug.cfs_rq[0]:/.tg->runnable_avg
7890 ± 0% -13.6% 6817 ± 1% sched_debug.cfs_rq[4]:/.tg->runnable_avg
7891 ± 0% -13.6% 6816 ± 1% sched_debug.cfs_rq[5]:/.tg->runnable_avg
7894 ± 0% -13.6% 6823 ± 1% sched_debug.cfs_rq[7]:/.tg->runnable_avg
512300 ± 6% +18.2% 605480 ± 9% sched_debug.cpu#50.avg_idle
7908 ± 0% -13.6% 6836 ± 1% sched_debug.cfs_rq[13]:/.tg->runnable_avg
7888 ± 0% -13.6% 6814 ± 1% sched_debug.cfs_rq[3]:/.tg->runnable_avg
7916 ± 0% -13.6% 6843 ± 1% sched_debug.cfs_rq[15]:/.tg->runnable_avg
7892 ± 0% -13.6% 6818 ± 1% sched_debug.cfs_rq[6]:/.tg->runnable_avg
178921 ± 1% -17.9% 146921 ± 9% sched_debug.cpu#2.sched_goidle
7918 ± 0% -13.5% 6848 ± 1% sched_debug.cfs_rq[16]:/.tg->runnable_avg
7883 ± 0% -13.6% 6809 ± 1% sched_debug.cfs_rq[1]:/.tg->runnable_avg
7903 ± 0% -13.5% 6832 ± 1% sched_debug.cfs_rq[12]:/.tg->runnable_avg
7930 ± 0% -13.5% 6861 ± 1% sched_debug.cfs_rq[20]:/.tg->runnable_avg
7925 ± 0% -13.5% 6859 ± 1% sched_debug.cfs_rq[19]:/.tg->runnable_avg
7921 ± 0% -13.5% 6852 ± 1% sched_debug.cfs_rq[17]:/.tg->runnable_avg
7932 ± 0% -13.4% 6866 ± 1% sched_debug.cfs_rq[21]:/.tg->runnable_avg
358611 ± 1% -17.9% 294548 ± 9% sched_debug.cpu#2.nr_switches
7922 ± 0% -13.4% 6857 ± 1% sched_debug.cfs_rq[18]:/.tg->runnable_avg
7985 ± 0% -13.4% 6918 ± 1% sched_debug.cfs_rq[36]:/.tg->runnable_avg
555502 ± 4% +16.3% 646081 ± 5% sched_debug.cpu#5.avg_idle
7944 ± 0% -13.5% 6876 ± 1% sched_debug.cfs_rq[24]:/.tg->runnable_avg
7994 ± 0% -13.4% 6926 ± 1% sched_debug.cfs_rq[39]:/.tg->runnable_avg
7959 ± 0% -13.4% 6892 ± 1% sched_debug.cfs_rq[28]:/.tg->runnable_avg
7997 ± 0% -13.3% 6930 ± 1% sched_debug.cfs_rq[40]:/.tg->runnable_avg
7962 ± 0% -13.4% 6895 ± 1% sched_debug.cfs_rq[29]:/.tg->runnable_avg
7935 ± 0% -13.4% 6869 ± 1% sched_debug.cfs_rq[22]:/.tg->runnable_avg
7982 ± 0% -13.4% 6915 ± 1% sched_debug.cfs_rq[35]:/.tg->runnable_avg
8000 ± 0% -13.3% 6932 ± 1% sched_debug.cfs_rq[41]:/.tg->runnable_avg
7951 ± 0% -13.4% 6884 ± 1% sched_debug.cfs_rq[26]:/.tg->runnable_avg
7954 ± 0% -13.4% 6889 ± 1% sched_debug.cfs_rq[27]:/.tg->runnable_avg
7976 ± 0% -13.4% 6911 ± 1% sched_debug.cfs_rq[34]:/.tg->runnable_avg
7937 ± 0% -13.4% 6872 ± 1% sched_debug.cfs_rq[23]:/.tg->runnable_avg
8003 ± 0% -13.3% 6937 ± 1% sched_debug.cfs_rq[43]:/.tg->runnable_avg
765 ± 0% -13.1% 665 ± 1% time.percent_of_cpu_this_job_got
7964 ± 0% -13.4% 6896 ± 1% sched_debug.cfs_rq[30]:/.tg->runnable_avg
7987 ± 0% -13.4% 6919 ± 1% sched_debug.cfs_rq[37]:/.tg->runnable_avg
8027 ± 0% -13.3% 6961 ± 1% sched_debug.cfs_rq[50]:/.tg->runnable_avg
7988 ± 0% -13.4% 6921 ± 1% sched_debug.cfs_rq[38]:/.tg->runnable_avg
7946 ± 0% -13.4% 6883 ± 1% sched_debug.cfs_rq[25]:/.tg->runnable_avg
8025 ± 0% -13.3% 6955 ± 1% sched_debug.cfs_rq[48]:/.tg->runnable_avg
8012 ± 0% -13.3% 6944 ± 1% sched_debug.cfs_rq[45]:/.tg->runnable_avg
7974 ± 0% -13.3% 6909 ± 1% sched_debug.cfs_rq[33]:/.tg->runnable_avg
1.13 ± 1% -14.8% 0.96 ± 7% perf-profile.cpu-cycles.update_process_times.tick_sched_handle.tick_sched_timer.__run_hrtimer.hrtimer_interrupt
8000 ± 0% -13.3% 6933 ± 1% sched_debug.cfs_rq[42]:/.tg->runnable_avg
8035 ± 0% -13.3% 6969 ± 1% sched_debug.cfs_rq[51]:/.tg->runnable_avg
8024 ± 0% -13.3% 6954 ± 1% sched_debug.cfs_rq[47]:/.tg->runnable_avg
8014 ± 0% -13.3% 6950 ± 1% sched_debug.cfs_rq[46]:/.tg->runnable_avg
8026 ± 0% -13.3% 6959 ± 1% sched_debug.cfs_rq[49]:/.tg->runnable_avg
7968 ± 0% -13.4% 6902 ± 1% sched_debug.cfs_rq[31]:/.tg->runnable_avg
37.12 ± 0% -12.9% 32.34 ± 2% perf-profile.cpu-cycles.vma_link.mmap_region.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff
8007 ± 0% -13.4% 6938 ± 1% sched_debug.cfs_rq[44]:/.tg->runnable_avg
8037 ± 0% -13.2% 6973 ± 1% sched_debug.cfs_rq[52]:/.tg->runnable_avg
7968 ± 0% -13.3% 6906 ± 1% sched_debug.cfs_rq[32]:/.tg->runnable_avg
1.13 ± 1% -14.1% 0.97 ± 7% perf-profile.cpu-cycles.tick_sched_handle.isra.18.tick_sched_timer.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt
8068 ± 0% -13.1% 7007 ± 1% sched_debug.cfs_rq[63]:/.tg->runnable_avg
8040 ± 0% -13.2% 6977 ± 1% sched_debug.cfs_rq[53]:/.tg->runnable_avg
8053 ± 0% -13.2% 6990 ± 1% sched_debug.cfs_rq[57]:/.tg->runnable_avg
8064 ± 0% -13.1% 7004 ± 1% sched_debug.cfs_rq[61]:/.tg->runnable_avg
8049 ± 0% -13.2% 6985 ± 1% sched_debug.cfs_rq[56]:/.tg->runnable_avg
8070 ± 0% -13.1% 7009 ± 1% sched_debug.cfs_rq[64]:/.tg->runnable_avg
3595633 ± 5% -12.9% 3133416 ± 6% numa-meminfo.node3.MemUsed
8055 ± 0% -13.2% 6993 ± 1% sched_debug.cfs_rq[58]:/.tg->runnable_avg
8071 ± 0% -13.1% 7014 ± 1% sched_debug.cfs_rq[65]:/.tg->runnable_avg
8046 ± 0% -13.2% 6983 ± 1% sched_debug.cfs_rq[55]:/.tg->runnable_avg
8045 ± 0% -13.3% 6978 ± 1% sched_debug.cfs_rq[54]:/.tg->runnable_avg
8086 ± 0% -13.1% 7027 ± 1% sched_debug.cfs_rq[71]:/.tg->runnable_avg
8137 ± 0% -13.0% 7080 ± 1% sched_debug.cfs_rq[91]:/.tg->runnable_avg
8081 ± 0% -13.1% 7022 ± 1% sched_debug.cfs_rq[68]:/.tg->runnable_avg
8076 ± 0% -13.1% 7017 ± 1% sched_debug.cfs_rq[66]:/.tg->runnable_avg
8062 ± 0% -13.1% 7002 ± 1% sched_debug.cfs_rq[60]:/.tg->runnable_avg
8139 ± 0% -12.9% 7085 ± 1% sched_debug.cfs_rq[92]:/.tg->runnable_avg
8088 ± 0% -13.1% 7031 ± 1% sched_debug.cfs_rq[72]:/.tg->runnable_avg
8064 ± 0% -13.1% 7006 ± 1% sched_debug.cfs_rq[62]:/.tg->runnable_avg
8143 ± 0% -12.9% 7090 ± 1% sched_debug.cfs_rq[94]:/.tg->runnable_avg
41932371 ± 0% -13.0% 36489731 ± 1% slabinfo.vm_area_struct.active_objs
8078 ± 0% -13.1% 7019 ± 1% sched_debug.cfs_rq[67]:/.tg->runnable_avg
8083 ± 0% -13.1% 7025 ± 1% sched_debug.cfs_rq[69]:/.tg->runnable_avg
8058 ± 0% -13.2% 6997 ± 1% sched_debug.cfs_rq[59]:/.tg->runnable_avg
8142 ± 0% -12.9% 7089 ± 1% sched_debug.cfs_rq[93]:/.tg->runnable_avg
8084 ± 0% -13.1% 7028 ± 1% sched_debug.cfs_rq[70]:/.tg->runnable_avg
8134 ± 0% -13.0% 7078 ± 1% sched_debug.cfs_rq[90]:/.tg->runnable_avg
8123 ± 0% -13.1% 7062 ± 1% sched_debug.cfs_rq[84]:/.tg->runnable_avg
3274295 ± 0% -13.0% 2849232 ± 1% meminfo.PageTables
818565 ± 0% -13.0% 712300 ± 1% proc-vmstat.nr_page_table_pages
8094 ± 0% -13.0% 7038 ± 1% sched_debug.cfs_rq[74]:/.tg->runnable_avg
8133 ± 0% -13.0% 7077 ± 1% sched_debug.cfs_rq[89]:/.tg->runnable_avg
8103 ± 0% -13.0% 7046 ± 1% sched_debug.cfs_rq[77]:/.tg->runnable_avg
8144 ± 0% -12.9% 7094 ± 1% sched_debug.cfs_rq[95]:/.tg->runnable_avg
8146 ± 0% -12.9% 7096 ± 1% sched_debug.cfs_rq[96]:/.tg->runnable_avg
8128 ± 0% -13.0% 7070 ± 1% sched_debug.cfs_rq[86]:/.tg->runnable_avg
8091 ± 0% -13.0% 7035 ± 1% sched_debug.cfs_rq[73]:/.tg->runnable_avg
536950 ± 10% +23.4% 662508 ± 6% sched_debug.cpu#30.avg_idle
8096 ± 0% -13.1% 7039 ± 1% sched_debug.cfs_rq[75]:/.tg->runnable_avg
8127 ± 0% -13.0% 7067 ± 1% sched_debug.cfs_rq[85]:/.tg->runnable_avg
8149 ± 0% -12.9% 7097 ± 1% sched_debug.cfs_rq[97]:/.tg->runnable_avg
8151 ± 0% -12.9% 7100 ± 1% sched_debug.cfs_rq[99]:/.tg->runnable_avg
8153 ± 0% -12.9% 7101 ± 1% sched_debug.cfs_rq[100]:/.tg->runnable_avg
8129 ± 0% -13.0% 7074 ± 1% sched_debug.cfs_rq[87]:/.tg->runnable_avg
8118 ± 0% -13.0% 7060 ± 1% sched_debug.cfs_rq[83]:/.tg->runnable_avg
8107 ± 0% -13.1% 7047 ± 1% sched_debug.cfs_rq[78]:/.tg->runnable_avg
8111 ± 0% -13.0% 7054 ± 1% sched_debug.cfs_rq[80]:/.tg->runnable_avg
8098 ± 0% -13.0% 7044 ± 1% sched_debug.cfs_rq[76]:/.tg->runnable_avg
42188778 ± 0% -12.9% 36733179 ± 1% slabinfo.vm_area_struct.num_objs
958835 ± 0% -12.9% 834844 ± 1% slabinfo.vm_area_struct.num_slabs
958835 ± 0% -12.9% 834844 ± 1% slabinfo.vm_area_struct.active_slabs
8154 ± 0% -12.9% 7103 ± 1% sched_debug.cfs_rq[101]:/.tg->runnable_avg
8116 ± 0% -13.0% 7058 ± 1% sched_debug.cfs_rq[82]:/.tg->runnable_avg
8130 ± 0% -12.9% 7077 ± 1% sched_debug.cfs_rq[88]:/.tg->runnable_avg
8171 ± 0% -12.9% 7120 ± 1% sched_debug.cfs_rq[107]:/.tg->runnable_avg
8113 ± 0% -13.0% 7058 ± 1% sched_debug.cfs_rq[81]:/.tg->runnable_avg
8109 ± 0% -13.1% 7051 ± 1% sched_debug.cfs_rq[79]:/.tg->runnable_avg
8155 ± 0% -12.9% 7106 ± 1% sched_debug.cfs_rq[102]:/.tg->runnable_avg
8157 ± 0% -12.8% 7111 ± 1% sched_debug.cfs_rq[103]:/.tg->runnable_avg
8165 ± 0% -12.9% 7115 ± 1% sched_debug.cfs_rq[105]:/.tg->runnable_avg
8159 ± 0% -12.8% 7113 ± 1% sched_debug.cfs_rq[104]:/.tg->runnable_avg
8148 ± 0% -12.9% 7099 ± 1% sched_debug.cfs_rq[98]:/.tg->runnable_avg
8169 ± 0% -12.9% 7118 ± 1% sched_debug.cfs_rq[106]:/.tg->runnable_avg
1.78 ± 2% -11.3% 1.58 ± 4% perf-profile.cpu-cycles.tick_sched_timer.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt
7802174 ± 0% -12.8% 6805780 ± 1% meminfo.SUnreclaim
1950525 ± 0% -12.8% 1701410 ± 1% proc-vmstat.nr_slab_unreclaimable
8198 ± 0% -12.7% 7154 ± 1% sched_debug.cfs_rq[119]:/.tg->runnable_avg
8175 ± 0% -12.8% 7125 ± 1% sched_debug.cfs_rq[109]:/.tg->runnable_avg
8180 ± 0% -12.8% 7136 ± 1% sched_debug.cfs_rq[112]:/.tg->runnable_avg
8188 ± 0% -12.8% 7143 ± 1% sched_debug.cfs_rq[115]:/.tg->runnable_avg
8194 ± 0% -12.7% 7151 ± 1% sched_debug.cfs_rq[117]:/.tg->runnable_avg
8176 ± 0% -12.8% 7129 ± 1% sched_debug.cfs_rq[110]:/.tg->runnable_avg
8189 ± 0% -12.8% 7145 ± 1% sched_debug.cfs_rq[116]:/.tg->runnable_avg
189413 ± 4% -13.7% 163494 ± 8% sched_debug.cfs_rq[25]:/.min_vruntime
8184 ± 0% -12.7% 7141 ± 1% sched_debug.cfs_rq[114]:/.tg->runnable_avg
8182 ± 0% -12.8% 7137 ± 1% sched_debug.cfs_rq[113]:/.tg->runnable_avg
8172 ± 0% -12.8% 7122 ± 1% sched_debug.cfs_rq[108]:/.tg->runnable_avg
8193 ± 0% -12.7% 7152 ± 1% sched_debug.cfs_rq[118]:/.tg->runnable_avg
8178 ± 0% -12.8% 7133 ± 1% sched_debug.cfs_rq[111]:/.tg->runnable_avg
7859652 ± 0% -12.7% 6863230 ± 1% meminfo.Slab
0.95 ± 6% +15.6% 1.10 ± 3% perf-profile.cpu-cycles.__fget.fget.sys_mmap_pgoff.sys_mmap.system_call_fastpath
1.10 ± 2% -10.5% 0.98 ± 4% perf-profile.cpu-cycles.ktime_get.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns
23237 ± 4% -13.3% 20143 ± 6% sched_debug.cfs_rq[51]:/.exec_clock
1.82 ± 2% -11.0% 1.62 ± 4% perf-profile.cpu-cycles.__run_hrtimer.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.97 ± 7% +14.0% 1.11 ± 3% perf-profile.cpu-cycles.fget.sys_mmap_pgoff.sys_mmap.system_call_fastpath
23242 ± 4% -12.9% 20253 ± 6% sched_debug.cfs_rq[49]:/.exec_clock
22886 ± 5% -13.7% 19749 ± 5% sched_debug.cfs_rq[56]:/.exec_clock
1036 ± 0% -11.9% 914 ± 1% time.user_time
8527124 ± 0% -11.6% 7534220 ± 1% vmstat.memory.cache
1695225 ± 0% -10.7% 1513459 ± 1% softirqs.TIMER
23318 ± 6% -13.1% 20269 ± 6% sched_debug.cfs_rq[54]:/.exec_clock
667649 ± 3% -10.0% 600607 ± 4% numa-vmstat.node3.numa_local
7.244e+08 ± 0% -11.1% 6.439e+08 ± 1% time.minor_page_faults
7.254e+08 ± 0% -11.1% 6.449e+08 ± 1% proc-vmstat.pgfault
1.92 ± 2% -10.9% 1.71 ± 4% perf-profile.cpu-cycles.read_hpet.ktime_get.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns
22971 ± 5% -12.9% 19998 ± 5% sched_debug.cfs_rq[55]:/.exec_clock
131 ± 10% -11.7% 115 ± 6% sched_debug.cfs_rq[52]:/.tg_runnable_contrib
42.89 ± 0% -10.4% 38.41 ± 2% perf-profile.cpu-cycles.mmap_region.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap
6053 ± 10% -11.6% 5349 ± 6% sched_debug.cfs_rq[52]:/.avg->runnable_avg_sum
753344 ± 2% -9.0% 685539 ± 4% numa-vmstat.node3.numa_hit
501098 ± 0% -11.4% 443942 ± 2% softirqs.SCHED
1.19 ± 2% -9.0% 1.08 ± 3% perf-profile.cpu-cycles.clockevents_program_event.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns.tick_nohz_restart
90940 ± 2% +9.4% 99459 ± 2% sched_debug.cpu#54.nr_load_updates
88590 ± 2% +9.8% 97229 ± 4% sched_debug.cpu#2.nr_load_updates
90669 ± 2% +9.6% 99355 ± 2% sched_debug.cpu#56.nr_load_updates
91272 ± 2% +9.4% 99833 ± 2% sched_debug.cpu#49.nr_load_updates
1.22 ± 1% +10.5% 1.35 ± 2% perf-profile.cpu-cycles.schedule.rwsem_down_write_failed.call_rwsem_down_write_failed.vma_link.mmap_region
89287 ± 3% +10.3% 98507 ± 4% sched_debug.cpu#1.nr_load_updates
45.38 ± 0% -9.4% 41.10 ± 2% perf-profile.cpu-cycles.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap.system_call_fastpath
22980 ± 5% -12.4% 20128 ± 6% sched_debug.cfs_rq[50]:/.exec_clock
1.19 ± 2% -8.5% 1.09 ± 4% perf-profile.cpu-cycles.tick_program_event.__hrtimer_start_range_ns.hrtimer_start_range_ns.tick_nohz_restart.tick_nohz_idle_exit
5570129 ± 0% -9.4% 5048932 ± 1% proc-vmstat.pgalloc_normal
1100174 ± 3% -6.9% 1024326 ± 3% numa-numastat.node3.local_node
2.06 ± 2% -9.1% 1.87 ± 4% perf-profile.cpu-cycles.print_context_stack.dump_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity
46.01 ± 0% -9.2% 41.78 ± 2% perf-profile.cpu-cycles.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap.system_call_fastpath
91494 ± 2% +10.3% 100902 ± 2% sched_debug.cpu#46.nr_load_updates
20296 ± 3% -24.7% 15293 ± 3% vmstat.system.in
140148 ± 0% -21.9% 109393 ± 1% vmstat.system.cs
191 ± 0% -19.5% 153 ± 0% turbostat.CorWatt
257 ± 0% -14.7% 219 ± 0% turbostat.PkgWatt
218 ± 0% -13.5% 188 ± 1% turbostat.Avg_MHz
6.84 ± 0% -13.6% 5.91 ± 1% turbostat.%Busy
578 ± 0% -8.5% 529 ± 0% pmeter.Average_Active_Power
73.34 ± 0% -3.0% 71.15 ± 0% turbostat.RAMWatt
brickland3: Brickland Ivy Bridge-EX
Memory: 512G
vm-scalability.stddev
16 ++---------------------------------------------------------------------+
| O |
14 ++ O O |
12 ++ O O O O O |
| O OO O O |
10 O+ O O O O O |
| O O O O O O O O O O |
8 ++ O O |
| O O O |
6 ++ O |
4 ++ |
| .* .* *. .* *.|
2 *+**. .*.* .* *.**. * + *.** + : * * *.*. .*.**.* *
| ** *.* *.**.*.* *.* * * *.*.* ** |
0 ++---------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
To reproduce:
apt-get install ruby
git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
cd lkp-tests
bin/setup-local job.yaml # the job file attached in this email
bin/run-local job.yaml
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Ying Huang
[-- Attachment #2: job.yaml --]
[-- Type: text/plain, Size: 1710 bytes --]
---
testcase: vm-scalability
default-monitors:
wait: pre-test
uptime:
iostat:
vmstat:
numa-numastat:
numa-vmstat:
numa-meminfo:
proc-vmstat:
proc-stat:
meminfo:
slabinfo:
interrupts:
lock_stat:
latency_stats:
softirqs:
bdi_dev_mapping:
diskstats:
nfsstat:
cpuidle:
cpufreq-stats:
turbostat:
pmeter:
sched_debug:
interval: 10
default_watchdogs:
watch-oom:
watchdog:
cpufreq_governor: performance
commit: ce43fa581f61c4756301e7fd8609f50579e13d5d
model: Brickland Ivy Bridge-EX
nr_cpu: 120
memory: 512G
hdd_partitions:
swap_partitions:
pmeter_server: lkp-st01
pmeter_device: yokogawa-wt310
perf-profile:
runtime: 300s
size:
vm-scalability:
test: small-allocs
testbox: brickland3
tbox_group: brickland3
kconfig: x86_64-rhel
enqueue_time: 2015-03-08 04:48:33.187343214 +08:00
head_commit: ce43fa581f61c4756301e7fd8609f50579e13d5d
base_commit: 13a7a6ac0a11197edcd0f756a035f472b42cdf8b
branch: linux-devel/devel-hourly-2015030900
kernel: "/kernel/x86_64-rhel/ce43fa581f61c4756301e7fd8609f50579e13d5d/vmlinuz-4.0.0-rc2-00784-gce43fa5"
user: lkp
queue: cyclic
rootfs: debian-x86_64-2015-02-07.cgz
result_root: "/result/brickland3/vm-scalability/performance-300s-small-allocs/debian-x86_64-2015-02-07.cgz/x86_64-rhel/ce43fa581f61c4756301e7fd8609f50579e13d5d/0"
job_file: "/lkp/scheduled/brickland3/cyclic_vm-scalability-performance-300s-small-allocs-x86_64-rhel-HEAD-ce43fa581f61c4756301e7fd8609f50579e13d5d-0-20150308-92360-aeasab.yaml"
dequeue_time: 2015-03-09 06:20:56.728013487 +08:00
job_state: finished
loadavg: 78.64 75.53 36.25 1/953 14075
start_time: '1425853327'
end_time: '1425853675'
version: "/lkp/lkp/.src-20150308-175746"
[-- Attachment #3: reproduce --]
[-- Type: text/plain, Size: 9275 bytes --]
echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu10/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu100/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu101/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu102/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu103/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu104/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu105/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu106/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu107/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu108/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu109/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu11/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu110/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu111/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu112/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu113/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu114/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu115/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu116/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu117/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu118/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu119/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu12/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu13/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu14/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu15/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu16/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu17/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu18/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu19/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu2/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu20/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu21/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu22/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu23/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu24/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu25/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu26/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu27/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu28/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu29/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu3/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu30/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu31/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu32/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu33/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu34/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu35/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu36/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu37/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu38/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu39/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu4/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu40/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu41/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu42/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu43/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu44/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu45/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu46/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu47/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu48/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu49/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu5/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu50/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu51/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu52/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu53/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu54/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu55/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu56/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu57/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu58/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu59/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu6/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu60/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu61/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu62/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu63/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu64/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu65/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu66/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu67/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu68/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu69/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu7/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu70/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu71/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu72/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu73/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu74/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu75/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu76/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu77/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu78/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu79/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu8/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu80/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu81/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu82/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu83/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu84/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu85/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu86/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu87/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu88/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu89/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu9/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu90/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu91/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu92/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu93/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu94/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu95/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu96/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu97/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu98/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu99/cpufreq/scaling_governor
mount -t tmpfs -o size=100% vm-scalability-tmp /tmp/vm-scalability-tmp
truncate -s 540949544960 /tmp/vm-scalability.img
mkfs.xfs -q /tmp/vm-scalability.img
mount -o loop /tmp/vm-scalability.img /tmp/vm-scalability
./case-small-allocs
./usemem --runtime 300 -n 120 --readonly --unit 40960 36650387592
umount /tmp/vm-scalability-tmp
umount /tmp/vm-scalability
rm /tmp/vm-scalability.img
[-- Attachment #4: Type: text/plain, Size: 85 bytes --]
_______________________________________________
LKP mailing list
LKP@linux.intel.com
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2015-03-13 7:42 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-03-13 5:36 [LKP] [locking/rwsem] b3fd4f03ca0: -11.1% vm-scalability.throughput Huang Ying
2015-03-13 5:36 ` Huang Ying
2015-03-13 5:38 [LKP] " Huang Ying
2015-03-13 7:42 ` Ingo Molnar
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.