All of lore.kernel.org
 help / color / mirror / Atom feed
* [sched] 0c9ceffc34: +113.2% unixbench.score, +88.1% perf-bench-sched-pipe.ops_per_sec
@ 2016-02-04  1:39 kernel test robot
  0 siblings, 0 replies; only message in thread
From: kernel test robot @ 2016-02-04  1:39 UTC (permalink / raw)
  To: lkp

[-- Attachment #1: Type: text/plain, Size: 14658 bytes --]

FYI, we noticed the below changes on

https://git.kernel.org/pub/scm/linux/kernel/git/mel/linux sched-disable-schedstats-v3r1
commit 0c9ceffc3460e0dd67dd0996bfe90d97771ff6a6 ("sched: Make schedstats a runtime tunable that is disabled by default v3")

Part of change may come from latencytop is disabled too.

=========================================================================================
compiler/kconfig/nr_task/rootfs/tbox_group/test/testcase:
  gcc-4.9/x86_64-rhel/100%/debian-x86_64-2015-02-07.cgz/nhm-white2/context1/unixbench

commit: 
  v4.5-rc1
  0c9ceffc3460e0dd67dd0996bfe90d97771ff6a6

        v4.5-rc1 0c9ceffc3460e0dd67dd0996bf 
---------------- -------------------------- 
         %stddev     %change         %stddev
             \          |                \  
      1514 ±  0%    +113.2%       3229 ±  0%  unixbench.score
     80462 ± 33%    +491.4%     475819 ±  9%  unixbench.time.involuntary_context_switches
    388.27 ±  0%      -3.6%     374.28 ±  0%  unixbench.time.system_time
     10.93 ±  1%    +108.9%      22.83 ±  0%  unixbench.time.user_time
  60435954 ±  0%    +111.1%  1.276e+08 ±  0%  unixbench.time.voluntary_context_switches
    397.30 ± 20%     +79.0%     711.00 ± 26%  cpuidle.C1-NHM.usage
   3200280 ± 39%     -65.8%    1095808 ±  1%  cpuidle.C3-NHM.time
      7.00 ±  0%     +14.3%       8.00 ±  0%  vmstat.procs.r
    906365 ±  2%    +113.9%    1938512 ±  0%  vmstat.system.cs
     80462 ± 33%    +491.4%     475819 ±  9%  time.involuntary_context_switches
     10.93 ±  1%    +108.9%      22.83 ±  0%  time.user_time
  60435954 ±  0%    +111.1%  1.276e+08 ±  0%  time.voluntary_context_switches
      0.95 ± 22%     -35.5%       0.61 ± 18%  turbostat.CPU%c1
      0.51 ± 42%     -68.4%       0.16 ±  4%  turbostat.CPU%c3
      1.04 ± 51%     -73.5%       0.28 ±  9%  turbostat.Pkg%pc3

=========================================================================================
compiler/cpufreq_governor/kconfig/loops/mode/rootfs/tbox_group/testcase:
  gcc-4.9/performance/x86_64-rhel/10000000ops/process/debian-x86_64-2015-02-07.cgz/lkp-bdw01/perf-bench-sched-pipe

commit: 
  v4.5-rc1
  0c9ceffc3460e0dd67dd0996bfe90d97771ff6a6

        v4.5-rc1 0c9ceffc3460e0dd67dd0996bf 
---------------- -------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     96795 ±  0%     +88.1%     182087 ±  0%  perf-bench-sched-pipe.ops_per_sec
    103.32 ±  0%     -46.8%      54.92 ±  0%  perf-bench-sched-pipe.time.elapsed_time
    103.32 ±  0%     -46.8%      54.92 ±  0%  perf-bench-sched-pipe.time.elapsed_time.max
    162.86 ±  0%     -18.5%     132.75 ±  0%  perf-bench-sched-pipe.time.percent_of_cpu_this_job_got
    165.06 ±  1%     -56.6%      71.69 ±  0%  perf-bench-sched-pipe.time.system_time
    123.34 ±  0%     -39.0%      75.19 ±  0%  uptime.boot
    373.78 ±  0%     -38.4%     230.36 ±  1%  uptime.idle
    377958 ±  0%     +84.9%     698794 ±  0%  vmstat.system.cs
      2330 ± 17%    +545.9%      15051 ±  9%  vmstat.system.in
     23710 ± 84%     -67.4%       7725 ± 19%  softirqs.RCU
     58220 ±  6%     -44.7%      32185 ±  0%  softirqs.SCHED
     85302 ±  6%     -32.5%      57603 ±  0%  softirqs.TIMER
    103.32 ±  0%     -46.8%      54.92 ±  0%  time.elapsed_time
    103.32 ±  0%     -46.8%      54.92 ±  0%  time.elapsed_time.max
    162.86 ±  0%     -18.5%     132.75 ±  0%  time.percent_of_cpu_this_job_got
    165.06 ±  1%     -56.6%      71.69 ±  0%  time.system_time
      3.66 ±  8%     -57.5%       1.56 ±  7%  time.user_time
     51.24 ±  1%     +13.9%      58.36 ±  1%  turbostat.%Busy
      1124 ±  1%     +13.9%       1280 ±  1%  turbostat.Avg_MHz
     29.20 ±  6%     -26.1%      21.58 ± 11%  turbostat.CPU%c7
      4.30 ±  0%     +12.5%       4.83 ±  1%  turbostat.CorWatt
      6.00 ±  0%      +8.1%       6.49 ±  1%  turbostat.PkgWatt
    106097 ±  0%     -41.4%      62186 ±  0%  proc-vmstat.numa_hit
    106097 ±  0%     -41.4%      62186 ±  0%  proc-vmstat.numa_local
     75307 ±  0%     -41.3%      44239 ±  1%  proc-vmstat.pgalloc_dma32
     35761 ±  0%     -41.1%      21078 ±  0%  proc-vmstat.pgalloc_normal
    125687 ±  0%     -41.4%      73686 ±  0%  proc-vmstat.pgfault
    108857 ±  0%     -42.0%      63107 ±  0%  proc-vmstat.pgfree
  17894873 ± 18%     -85.3%    2623742 ± 36%  cpuidle.C1-BDW.time
   3765284 ±  8%     -99.9%       4200 ±  3%  cpuidle.C1-BDW.usage
      1755 ±110%     -64.9%     616.75 ± 10%  cpuidle.C1E-BDW.usage
      3915 ±166%     -80.4%     765.75 ±  9%  cpuidle.C3-BDW.usage
      1611 ±186%     -86.7%     214.50 ±  5%  cpuidle.C6-BDW.usage
   8089687 ± 59%     -75.0%    2024751 ± 28%  cpuidle.C7s-BDW.time
      5195 ±173%     -84.4%     811.75 ±  2%  cpuidle.C7s-BDW.usage
      4308 ± 94%     -71.7%       1221 ±  5%  cpuidle.C8-BDW.usage
  39471496 ±103%     -68.0%   12634953 ± 28%  cpuidle.C9-BDW.time
      8325 ±195%     -90.7%     770.50 ±  5%  cpuidle.C9-BDW.usage
  46685007 ±  8%     -51.1%   22808700 ± 11%  cpuidle.POLL.time
  16152326 ±  1%     -60.2%    6434419 ± 12%  cpuidle.POLL.usage


nhm-white2: Nehalem
Memory: 4G

lkp-bdw01: Broadwell ULT
Memory: 4G

                          perf-bench-sched-pipe.ops_per_sec

  200000 ++-----------------------------------------------------------------+
  180000 O+O O  O O O O  O O O O  O O O O  O O O O O  O                     |
         |                                                                  |
  160000 ++                                                                 |
  140000 ++                                                                 |
         |                                                                  |
  120000 ++                                                                 |
  100000 *+*    *.*.*.*..*.*.*.*..*   *.*..*.*.*.*.*..*.*.*.*..*.*.*.*..*.*.*
   80000 ++:    :                 :   :                                     |
         |  :  :                   : :                                      |
   60000 ++ :  :                   : :                                      |
   40000 ++ : :                    : :                                      |
         |  : :                    : :                                      |
   20000 ++  :                      :                                       |
       0 ++--*----------------------*---------------------------------------+


                      perf-bench-sched-pipe.time.system_time

  180 ++--------------------------------------------------------------------+
      *.*        .*.*.*..*.*.*..*   *..*.*.*..*.*.*..*.*.*..*.*.*..*.*.*..*.*
  160 ++:    *.*.               :   :                                       |
  140 ++:    :                  :   :                                       |
      |  :   :                  :   :                                       |
  120 ++ :   :                   : :                                        |
  100 ++ :  :                    : :                                        |
      |  :  :                    : :                                        |
   80 ++  : :     O   O  O O O  O: :O  O O O  O O O  O                      |
   60 O+O :O:O O    O            :O:                                        |
      |   : :                    : :                                        |
   40 ++  : :                     :                                         |
   20 ++   :                      :                                         |
      |    :                      :                                         |
    0 ++---*----------------------*-----------------------------------------+


              perf-bench-sched-pipe.time.percent_of_cpu_this_job_got

  180 ++--------------------------------------------------------------------+
      *.*    *.*..*.*.*..*.*.*..*   *..*.*.*..*.*.*..*.*.*..*.*.*..*.*.*..*.*
  160 ++:    :                  :   :                                       |
  140 ++:    :                  :   :                                       |
      O O: O O O  O O O  O O O  O O O  O O O  O O O  O                      |
  120 ++ :  :                    : :                                        |
  100 ++ :  :                    : :                                        |
      |  :  :                    : :                                        |
   80 ++  : :                    : :                                        |
   60 ++  : :                    : :                                        |
      |   : :                    : :                                        |
   40 ++  ::                      :                                         |
   20 ++   :                      :                                         |
      |    :                      :                                         |
    0 ++---*----------------------*-----------------------------------------+


                                  unixbench.score

  3600 ++-------------------------------------------------------------------+
  3400 ++           O O O O O                                               |
       O O O O               O O O O O O OO O                               |
  3200 ++     O O O                                                         |
  3000 ++                                                                   |
  2800 ++                                                                   |
  2600 ++                                                                   |
       |                                                                    |
  2400 ++                                                                   |
  2200 ++                                                                   |
  2000 ++                                                                   |
  1800 ++                                                                   |
       |                                                                    |
  1600 *+*.*.**.*.*.*.*.*.*.**.*.*.*.*.*.**.*.*.*.*.*.**.*.*.*.*.*.*.**.*.*.*
  1400 ++-------------------------------------------------------------------+


                            unixbench.time.user_time

  24 ++---------------------------------------------------------------------+
     |           O        O   O O O O O OO O                                |
  22 O+  O     O  O O O O   O                                               |
     | O   O                                                                |
  20 ++      O                                                              |
     |                                                                      |
  18 ++                                                                     |
     |                                                                      |
  16 ++                                                                     |
     |                                                                      |
  14 ++                                                                     |
     |               .*.                                                    |
  12 ++         .**.*   *.       .*.                                        |
     *.*.*.*.*.*          *.*.*.*   *.*.**.*.*.*.*.*.*.*.*.*.*.**.*.*.*.*.*.*
  10 ++---------------------------------------------------------------------+


                            unixbench.time.system_time

  390 ++--------------------------------------------------------------------+
      *. .*.*.**.*.*.   .*.*.*.**. .*.*.*.*.*.*.*.**.*.*.*.*.*.*.*.**.*.*.*.*
      | *            *.*          *                                         |
  385 ++                                                                    |
      |                                                                     |
      |                                                                     |
  380 ++                                                                    |
      |              O O     O                                              |
  375 O+                 O O   OO     O O                                   |
      |   O O    O O                O       O                               |
      |        O                  O       O                                 |
  370 ++O                                                                   |
      |                                                                     |
      |       O                                                             |
  365 ++--------------------------------------------------------------------+


                       unixbench.time.voluntary_context_switches

  1.4e+08 ++----------------------------------------------------------------+
          |           O O O O OO                                            |
  1.3e+08 O+  OO                 O O O OO O O O                             |
  1.2e+08 ++O    O O O                                                      |
          |                                                                 |
  1.1e+08 ++                                                                |
          |                                                                 |
    1e+08 ++                                                                |
          |                                                                 |
    9e+07 ++                                                                |
    8e+07 ++                                                                |
          |                                                                 |
    7e+07 ++                                                                |
          *.*.* .*.*.**.   .*.**.*.*.*.**.                                  |
    6e+07 ++---*--------*-*---------------*-*-**-*-*-*-**-*-*-*-**-*-*-**-*-*

	[*] bisect-good sample
	[O] bisect-bad  sample

To reproduce:

        git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml


Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Ying Huang

[-- Attachment #2: job.yaml --]
[-- Type: text/plain, Size: 3319 bytes --]

---
LKP_SERVER: inn
LKP_CGI_PORT: 80
LKP_CIFS_PORT: 139
testcase: unixbench
default-monitors:
  wait: activate-monitor
  kmsg: 
  uptime: 
  iostat: 
  vmstat: 
  numa-numastat: 
  numa-vmstat: 
  numa-meminfo: 
  proc-vmstat: 
  proc-stat:
    interval: 10
  meminfo: 
  slabinfo: 
  interrupts: 
  lock_stat: 
  latency_stats: 
  softirqs: 
  bdi_dev_mapping: 
  diskstats: 
  nfsstat: 
  cpuidle: 
  cpufreq-stats: 
  turbostat: 
  pmeter: 
  sched_debug:
    interval: 60
cpufreq_governor: 
default-watchdogs:
  oom-killer: 
  watchdog: 
commit: 0c9ceffc3460e0dd67dd0996bfe90d97771ff6a6
model: Nehalem
memory: 4G
nr_cpu: 8
hdd_partitions: 
swap_partitions: 
rootfs_partition: 
netconsole_port: 6671
category: benchmark
nr_task: 100%
unixbench:
  test: context1
queue: bisect
testbox: nhm-white2
tbox_group: nhm-white2
kconfig: x86_64-rhel
enqueue_time: 2016-02-03 09:49:34.028532424 +08:00
id: a1a1102e997b7652ded24c9ad1a9b46247794ddc
user: lkp
compiler: gcc-4.9
head_commit: 46d84252fc54959957824a512feabd19b763ef4d
base_commit: 36f90b0a2ddd60823fe193a85e60ff1906c2a9b3
branch: linux-devel/devel-hourly-2016020219
rootfs: debian-x86_64-2015-02-07.cgz
result_root: "/result/unixbench/100%-context1/nhm-white2/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/0c9ceffc3460e0dd67dd0996bfe90d97771ff6a6/0"
job_file: "/lkp/scheduled/nhm-white2/bisect_unixbench-100%-context1-debian-x86_64-2015-02-07.cgz-x86_64-rhel-0c9ceffc3460e0dd67dd0996bfe90d97771ff6a6-20160203-58869-s786hc-0.yaml"
max_uptime: 896.8399999999999
initrd: "/osimage/debian/debian-x86_64-2015-02-07.cgz"
bootloader_append:
- root=/dev/ram0
- user=lkp
- job=/lkp/scheduled/nhm-white2/bisect_unixbench-100%-context1-debian-x86_64-2015-02-07.cgz-x86_64-rhel-0c9ceffc3460e0dd67dd0996bfe90d97771ff6a6-20160203-58869-s786hc-0.yaml
- ARCH=x86_64
- kconfig=x86_64-rhel
- branch=linux-devel/devel-hourly-2016020219
- commit=0c9ceffc3460e0dd67dd0996bfe90d97771ff6a6
- BOOT_IMAGE=/pkg/linux/x86_64-rhel/gcc-4.9/0c9ceffc3460e0dd67dd0996bfe90d97771ff6a6/vmlinuz-4.5.0-rc1-00001-g0c9ceff
- max_uptime=896
- RESULT_ROOT=/result/unixbench/100%-context1/nhm-white2/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/0c9ceffc3460e0dd67dd0996bfe90d97771ff6a6/0
- LKP_SERVER=inn
- |2-


  earlyprintk=ttyS0,115200 systemd.log_level=err
  debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100
  panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0
  console=ttyS0,115200 console=tty0 vga=normal

  rw
lkp_initrd: "/lkp/lkp/lkp-x86_64.cgz"
modules_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/0c9ceffc3460e0dd67dd0996bfe90d97771ff6a6/modules.cgz"
bm_initrd: "/osimage/deps/debian-x86_64-2015-02-07.cgz/lkp.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/run-ipconfig.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/turbostat.cgz,/lkp/benchmarks/turbostat.cgz,/lkp/benchmarks/unixbench.cgz"
linux_headers_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/0c9ceffc3460e0dd67dd0996bfe90d97771ff6a6/linux-headers.cgz"
repeat_to: 2
kernel: "/pkg/linux/x86_64-rhel/gcc-4.9/0c9ceffc3460e0dd67dd0996bfe90d97771ff6a6/vmlinuz-4.5.0-rc1-00001-g0c9ceff"
dequeue_time: 2016-02-03 09:52:13.201835438 +08:00
job_state: finished
loadavg: 6.82 2.69 1.00 1/166 2893
start_time: '1454464357'
end_time: '1454464487'
version: "/lkp/lkp/.src-20160203-092229"

[-- Attachment #3: reproduce.sh --]
[-- Type: application/x-sh, Size: 40 bytes --]

^ permalink raw reply	[flat|nested] only message in thread

only message in thread, other threads:[~2016-02-04  1:39 UTC | newest]

Thread overview: (only message) (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2016-02-04  1:39 [sched] 0c9ceffc34: +113.2% unixbench.score, +88.1% perf-bench-sched-pipe.ops_per_sec kernel test robot

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.