* [lkp] [drm/i915] 0bbca274a3: 3.6% piglit.time.elapsed_time
@ 2016-03-14 2:14 kernel test robot
2016-03-14 13:37 ` Ville Syrjälä
0 siblings, 1 reply; 3+ messages in thread
From: kernel test robot @ 2016-03-14 2:14 UTC (permalink / raw)
To: Ville Syrjälä; +Cc: Jani Nikula, LKML, lkp
[-- Attachment #1: Type: text/plain, Size: 14998 bytes --]
FYI, we noticed that piglit.time.elapsed_time 3.6% regression on
https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git master
commit 0bbca274a31c2366414d8d3f95e03d1c4674d93f ("drm/i915: Actually retry with bit-banging after GMBUS timeout")
=========================================================================================
compiler/group/kconfig/rootfs/tbox_group/testcase:
gcc-4.9/igt-039/x86_64-rhel/debian-x86_64-2015-02-07.cgz/snb-black/piglit
commit:
2f791908a70e95768596f5bb9e6de4f441d7bf13
0bbca274a31c2366414d8d3f95e03d1c4674d93f
2f791908a70e9576 0bbca274a31c2366414d8d3f95
---------------- --------------------------
%stddev %change %stddev
\ | \
188.79 ± 0% +3.6% 195.58 ± 0% piglit.time.elapsed_time
188.79 ± 0% +3.6% 195.58 ± 0% piglit.time.elapsed_time.max
5.00 ± 0% +60.0% 8.00 ± 0% piglit.time.percent_of_cpu_this_job_got
7.86 ± 0% +83.5% 14.42 ± 0% piglit.time.system_time
5.00 ± 0% +60.0% 8.00 ± 0% time.percent_of_cpu_this_job_got
7.86 ± 0% +83.5% 14.42 ± 0% time.system_time
=========================================================================================
compiler/group/kconfig/rootfs/tbox_group/testcase:
gcc-4.9/igt-036/x86_64-rhel/debian-x86_64-2015-02-07.cgz/lkp-u410/piglit
commit:
2f791908a70e95768596f5bb9e6de4f441d7bf13
0bbca274a31c2366414d8d3f95e03d1c4674d93f
2f791908a70e9576 0bbca274a31c2366414d8d3f95
---------------- --------------------------
%stddev %change %stddev
\ | \
141.15 ± 0% +6.9% 150.94 ± 0% piglit.time.elapsed_time
141.15 ± 0% +6.9% 150.94 ± 0% piglit.time.elapsed_time.max
10.00 ± 0% +60.0% 16.00 ± 0% piglit.time.percent_of_cpu_this_job_got
10.61 ± 0% +88.8% 20.04 ± 0% piglit.time.system_time
10.00 ± 0% +60.0% 16.00 ± 0% time.percent_of_cpu_this_job_got
10.61 ± 0% +88.8% 20.04 ± 0% time.system_time
snb-black: Sandy Bridge
Memory: 8G
lkp-u410: Ivy Bridge
Memory: 4G
piglit.time.system_time
21 ++---------------------------------------------------------------------+
20 O+ O O O O O O O O O O O O O O O O O O O O O O |
| |
19 ++ |
18 ++ |
17 ++ |
16 ++ |
| |
15 ++ |
14 ++ |
13 ++ |
12 ++ |
| |
11 *+.*..*..*..*..*..*..*..*..*..*..*..*.*..*..*..*..*..*..*..*..*..*..*..*
10 ++---------------------------------------------------------------------+
piglit.time.percent_of_cpu_this_job_got
16 O+-O--O--O--O--O--O--O--O--O--O--O--O-O--O--O--O--O--O--O--O--O--O-----+
| |
15 ++ |
| |
| |
14 ++ |
| |
13 ++ |
| |
12 ++ |
| |
| |
11 *+. *.. *.. *.. |
| .. .. .. |
10 ++-*--*--*--*--*--*-----*--*--*-----*-*--*--*-----*--*--*--*--*--*--*--*
piglit.time.elapsed_time
152 ++--------------------------------------------------------------------+
| O O O O O O O O O O O O O O O O O O O O O O |
150 O+ |
| |
| |
148 ++ |
| |
146 ++ |
| |
144 ++ |
| |
| |
142 ++ .*.. |
*.. .*..*..*..* *..*..*..*.. .*..*..*.. .*..*..*..*..*..*
140 ++-*--*----------------------------*--*-----------*--*----------------+
piglit.time.elapsed_time.max
152 ++--------------------------------------------------------------------+
| O O O O O O O O O O O O O O O O O O O O O O |
150 O+ |
| |
| |
148 ++ |
| |
146 ++ |
| |
144 ++ |
| |
| |
142 ++ .*.. |
*.. .*..*..*..* *..*..*..*.. .*..*..*.. .*..*..*..*..*..*
140 ++-*--*----------------------------*--*-----------*--*----------------+
time.system_time
21 ++---------------------------------------------------------------------+
20 O+ O O O O O O O O O O O O O O O O O O O O O O |
| |
19 ++ |
18 ++ |
17 ++ |
16 ++ |
| |
15 ++ |
14 ++ |
13 ++ |
12 ++ |
| |
11 *+.*..*..*..*..*..*..*..*..*..*..*..*.*..*..*..*..*..*..*..*..*..*..*..*
10 ++---------------------------------------------------------------------+
time.percent_of_cpu_this_job_got
16 O+-O--O--O--O--O--O--O--O--O--O--O--O-O--O--O--O--O--O--O--O--O--O-----+
| |
15 ++ |
| |
| |
14 ++ |
| |
13 ++ |
| |
12 ++ |
| |
| |
11 *+. *.. *.. *.. |
| .. .. .. |
10 ++-*--*--*--*--*--*-----*--*--*-----*-*--*--*-----*--*--*--*--*--*--*--*
piglit.time.system_time
15 ++---------------------------------------------------------------------+
O O O O O O O O O O O O O O O O O O O O O O O O O |
14 ++ |
13 ++ |
| |
12 ++ |
| |
11 ++ |
| |
10 ++ |
9 ++ |
| |
8 ++ .*..*.. .*.. .*..*. .*..*.*..*.. .*
*..*..*..* *..*. *.*..*..*..*. *..*..*..*. *. |
7 ++---------------------------------------------------------------------+
piglit.time.elapsed_time
450 ++--------------------------------------------------------------------+
| |
400 ++ O |
| |
| |
350 ++ |
| |
300 ++ |
| |
250 ++ |
| |
| |
200 O+.O..O.O..O..O..O..O.O..O..O..O..O.O..*..O..O..O.O..O..O..O..O.O..O..*
| |
150 ++--------------------------------------------------------------------+
piglit.time.elapsed_time.max
450 ++--------------------------------------------------------------------+
| |
400 ++ O |
| |
| |
350 ++ |
| |
300 ++ |
| |
250 ++ |
| |
| |
200 O+.O..O.O..O..O..O..O.O..O..O..O..O.O..*..O..O..O.O..O..O..O..O.O..O..*
| |
150 ++--------------------------------------------------------------------+
time.system_time
15 ++---------------------------------------------------------------------+
O O O O O O O O O O O O O O O O O O O O O O O O O |
14 ++ |
13 ++ |
| |
12 ++ |
| |
11 ++ |
| |
10 ++ |
9 ++ |
| |
8 ++ .*..*.. .*.. .*..*. .*..*.*..*.. .*
*..*..*..* *..*. *.*..*..*..*. *..*..*..*. *. |
7 ++---------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
To reproduce:
git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Xiaolong Ye
[-- Attachment #2: job.yaml --]
[-- Type: text/plain, Size: 2868 bytes --]
---
LKP_SERVER: inn
LKP_CGI_PORT: 80
LKP_CIFS_PORT: 139
testcase: piglit
default-monitors:
wait: activate-monitor
kmsg:
heartbeat:
interval: 10
default-watchdogs:
oom-killer:
watchdog:
commit: 0bbca274a31c2366414d8d3f95e03d1c4674d93f
model: Ivy Bridge
nr_cpu: 4
memory: 4G
nr_hdd_partitions: 0
hdd_partitions:
netconsole_port: 6674
category: functional
timeout: 30m
piglit:
group: igt-036
queue: bisect
testbox: lkp-u410
tbox_group: lkp-u410
kconfig: x86_64-rhel
enqueue_time: 2016-03-12 08:10:38.141424169 +08:00
compiler: gcc-4.9
rootfs: debian-x86_64-2015-02-07.cgz
id: 7ebc10fb2ac0e90fb2e346efbdcda69faf9f4c18
user: lkp
head_commit: 884dcd36fc68f78a12db2ae041eaeadb230b460b
base_commit: f6cede5b49e822ebc41a099fe41ab4989f64e2cb
branch: linux-devel/devel-hourly-2016031201
result_root: "/result/piglit/igt-036/lkp-u410/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/0"
job_file: "/lkp/scheduled/lkp-u410/bisect_piglit-igt-036-debian-x86_64-2015-02-07.cgz-x86_64-rhel-0bbca274a31c2366414d8d3f95e03d1c4674d93f-20160312-31710-1ckf79s-0.yaml"
max_uptime: 1800
initrd: "/osimage/debian/debian-x86_64-2015-02-07.cgz"
bootloader_append:
- root=/dev/ram0
- user=lkp
- job=/lkp/scheduled/lkp-u410/bisect_piglit-igt-036-debian-x86_64-2015-02-07.cgz-x86_64-rhel-0bbca274a31c2366414d8d3f95e03d1c4674d93f-20160312-31710-1ckf79s-0.yaml
- ARCH=x86_64
- kconfig=x86_64-rhel
- branch=linux-devel/devel-hourly-2016031201
- commit=0bbca274a31c2366414d8d3f95e03d1c4674d93f
- BOOT_IMAGE=/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/vmlinuz-4.5.0-rc7-00002-g0bbca27
- max_uptime=1800
- RESULT_ROOT=/result/piglit/igt-036/lkp-u410/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/0
- LKP_SERVER=inn
- |2-
earlyprintk=ttyS0,115200 systemd.log_level=err
debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100
panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0
console=ttyS0,115200 console=tty0 vga=normal
rw
lkp_initrd: "/lkp/lkp/lkp-x86_64.cgz"
modules_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/modules.cgz"
bm_initrd: "/osimage/deps/debian-x86_64-2015-02-07.cgz/lkp.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/run-ipconfig.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/piglit.cgz,/lkp/benchmarks/piglit.cgz"
linux_headers_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/linux-headers.cgz"
repeat_to: 2
kernel: "/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/vmlinuz-4.5.0-rc7-00002-g0bbca27"
dequeue_time: 2016-03-12 08:14:04.556438362 +08:00
job_state: finished
loadavg: 0.81 0.38 0.15 1/116 693
start_time: '1457741713'
end_time: '1457741864'
version: "/lkp/lkp/.src-20160311-183612"
[-- Attachment #3: reproduce --]
[-- Type: text/plain, Size: 179 bytes --]
2016-03-12 08:15:13 piglit run igt -t igt/kms_cursor_crc/cursor-64-sliding /tmp/lkp/piglit-results
2016-03-12 08:17:43 piglit summary console /tmp/lkp/piglit-results/results.json
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [lkp] [drm/i915] 0bbca274a3: 3.6% piglit.time.elapsed_time
2016-03-14 2:14 [lkp] [drm/i915] 0bbca274a3: 3.6% piglit.time.elapsed_time kernel test robot
@ 2016-03-14 13:37 ` Ville Syrjälä
2016-03-15 5:42 ` Ye Xiaolong
0 siblings, 1 reply; 3+ messages in thread
From: Ville Syrjälä @ 2016-03-14 13:37 UTC (permalink / raw)
To: kernel test robot; +Cc: Jani Nikula, LKML, lkp
On Mon, Mar 14, 2016 at 10:14:37AM +0800, kernel test robot wrote:
> FYI, we noticed that piglit.time.elapsed_time 3.6% regression on
>
> https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git master
> commit 0bbca274a31c2366414d8d3f95e03d1c4674d93f ("drm/i915: Actually retry with bit-banging after GMBUS timeout")
Increase in system time is somewhat expected, since we'll do more
bit banging now. Any chance of comparison against bffce907d640^
aka. 0aeb904888f5 ("drm/i915: simplify gmbus xfer error checks") ?
I would hope that the result would be more or less the same as with
0bbca274a31c ("drm/i915: Actually retry with bit-banging after GMBUS timeout")
>
>
> =========================================================================================
> compiler/group/kconfig/rootfs/tbox_group/testcase:
> gcc-4.9/igt-039/x86_64-rhel/debian-x86_64-2015-02-07.cgz/snb-black/piglit
>
> commit:
> 2f791908a70e95768596f5bb9e6de4f441d7bf13
> 0bbca274a31c2366414d8d3f95e03d1c4674d93f
>
> 2f791908a70e9576 0bbca274a31c2366414d8d3f95
> ---------------- --------------------------
> %stddev %change %stddev
> \ | \
> 188.79 ± 0% +3.6% 195.58 ± 0% piglit.time.elapsed_time
> 188.79 ± 0% +3.6% 195.58 ± 0% piglit.time.elapsed_time.max
> 5.00 ± 0% +60.0% 8.00 ± 0% piglit.time.percent_of_cpu_this_job_got
> 7.86 ± 0% +83.5% 14.42 ± 0% piglit.time.system_time
> 5.00 ± 0% +60.0% 8.00 ± 0% time.percent_of_cpu_this_job_got
> 7.86 ± 0% +83.5% 14.42 ± 0% time.system_time
>
> =========================================================================================
> compiler/group/kconfig/rootfs/tbox_group/testcase:
> gcc-4.9/igt-036/x86_64-rhel/debian-x86_64-2015-02-07.cgz/lkp-u410/piglit
>
> commit:
> 2f791908a70e95768596f5bb9e6de4f441d7bf13
> 0bbca274a31c2366414d8d3f95e03d1c4674d93f
>
> 2f791908a70e9576 0bbca274a31c2366414d8d3f95
> ---------------- --------------------------
> %stddev %change %stddev
> \ | \
> 141.15 ± 0% +6.9% 150.94 ± 0% piglit.time.elapsed_time
> 141.15 ± 0% +6.9% 150.94 ± 0% piglit.time.elapsed_time.max
> 10.00 ± 0% +60.0% 16.00 ± 0% piglit.time.percent_of_cpu_this_job_got
> 10.61 ± 0% +88.8% 20.04 ± 0% piglit.time.system_time
> 10.00 ± 0% +60.0% 16.00 ± 0% time.percent_of_cpu_this_job_got
> 10.61 ± 0% +88.8% 20.04 ± 0% time.system_time
>
>
> snb-black: Sandy Bridge
> Memory: 8G
>
> lkp-u410: Ivy Bridge
> Memory: 4G
>
>
>
> piglit.time.system_time
>
> 21 ++---------------------------------------------------------------------+
> 20 O+ O O O O O O O O O O O O O O O O O O O O O O |
> | |
> 19 ++ |
> 18 ++ |
> 17 ++ |
> 16 ++ |
> | |
> 15 ++ |
> 14 ++ |
> 13 ++ |
> 12 ++ |
> | |
> 11 *+.*..*..*..*..*..*..*..*..*..*..*..*.*..*..*..*..*..*..*..*..*..*..*..*
> 10 ++---------------------------------------------------------------------+
>
>
> piglit.time.percent_of_cpu_this_job_got
>
> 16 O+-O--O--O--O--O--O--O--O--O--O--O--O-O--O--O--O--O--O--O--O--O--O-----+
> | |
> 15 ++ |
> | |
> | |
> 14 ++ |
> | |
> 13 ++ |
> | |
> 12 ++ |
> | |
> | |
> 11 *+. *.. *.. *.. |
> | .. .. .. |
> 10 ++-*--*--*--*--*--*-----*--*--*-----*-*--*--*-----*--*--*--*--*--*--*--*
>
>
> piglit.time.elapsed_time
>
> 152 ++--------------------------------------------------------------------+
> | O O O O O O O O O O O O O O O O O O O O O O |
> 150 O+ |
> | |
> | |
> 148 ++ |
> | |
> 146 ++ |
> | |
> 144 ++ |
> | |
> | |
> 142 ++ .*.. |
> *.. .*..*..*..* *..*..*..*.. .*..*..*.. .*..*..*..*..*..*
> 140 ++-*--*----------------------------*--*-----------*--*----------------+
>
>
> piglit.time.elapsed_time.max
>
> 152 ++--------------------------------------------------------------------+
> | O O O O O O O O O O O O O O O O O O O O O O |
> 150 O+ |
> | |
> | |
> 148 ++ |
> | |
> 146 ++ |
> | |
> 144 ++ |
> | |
> | |
> 142 ++ .*.. |
> *.. .*..*..*..* *..*..*..*.. .*..*..*.. .*..*..*..*..*..*
> 140 ++-*--*----------------------------*--*-----------*--*----------------+
>
>
> time.system_time
>
> 21 ++---------------------------------------------------------------------+
> 20 O+ O O O O O O O O O O O O O O O O O O O O O O |
> | |
> 19 ++ |
> 18 ++ |
> 17 ++ |
> 16 ++ |
> | |
> 15 ++ |
> 14 ++ |
> 13 ++ |
> 12 ++ |
> | |
> 11 *+.*..*..*..*..*..*..*..*..*..*..*..*.*..*..*..*..*..*..*..*..*..*..*..*
> 10 ++---------------------------------------------------------------------+
>
>
> time.percent_of_cpu_this_job_got
>
> 16 O+-O--O--O--O--O--O--O--O--O--O--O--O-O--O--O--O--O--O--O--O--O--O-----+
> | |
> 15 ++ |
> | |
> | |
> 14 ++ |
> | |
> 13 ++ |
> | |
> 12 ++ |
> | |
> | |
> 11 *+. *.. *.. *.. |
> | .. .. .. |
> 10 ++-*--*--*--*--*--*-----*--*--*-----*-*--*--*-----*--*--*--*--*--*--*--*
>
>
>
>
> piglit.time.system_time
>
> 15 ++---------------------------------------------------------------------+
> O O O O O O O O O O O O O O O O O O O O O O O O O |
> 14 ++ |
> 13 ++ |
> | |
> 12 ++ |
> | |
> 11 ++ |
> | |
> 10 ++ |
> 9 ++ |
> | |
> 8 ++ .*..*.. .*.. .*..*. .*..*.*..*.. .*
> *..*..*..* *..*. *.*..*..*..*. *..*..*..*. *. |
> 7 ++---------------------------------------------------------------------+
>
>
> piglit.time.elapsed_time
>
> 450 ++--------------------------------------------------------------------+
> | |
> 400 ++ O |
> | |
> | |
> 350 ++ |
> | |
> 300 ++ |
> | |
> 250 ++ |
> | |
> | |
> 200 O+.O..O.O..O..O..O..O.O..O..O..O..O.O..*..O..O..O.O..O..O..O..O.O..O..*
> | |
> 150 ++--------------------------------------------------------------------+
>
>
> piglit.time.elapsed_time.max
>
> 450 ++--------------------------------------------------------------------+
> | |
> 400 ++ O |
> | |
> | |
> 350 ++ |
> | |
> 300 ++ |
> | |
> 250 ++ |
> | |
> | |
> 200 O+.O..O.O..O..O..O..O.O..O..O..O..O.O..*..O..O..O.O..O..O..O..O.O..O..*
> | |
> 150 ++--------------------------------------------------------------------+
>
>
> time.system_time
>
> 15 ++---------------------------------------------------------------------+
> O O O O O O O O O O O O O O O O O O O O O O O O O |
> 14 ++ |
> 13 ++ |
> | |
> 12 ++ |
> | |
> 11 ++ |
> | |
> 10 ++ |
> 9 ++ |
> | |
> 8 ++ .*..*.. .*.. .*..*. .*..*.*..*.. .*
> *..*..*..* *..*. *.*..*..*..*. *..*..*..*. *. |
> 7 ++---------------------------------------------------------------------+
>
> [*] bisect-good sample
> [O] bisect-bad sample
>
> To reproduce:
>
> git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
> cd lkp-tests
> bin/lkp install job.yaml # job file is attached in this email
> bin/lkp run job.yaml
>
>
> Disclaimer:
> Results have been estimated based on internal Intel analysis and are provided
> for informational purposes only. Any difference in system hardware or software
> design or configuration may affect actual performance.
>
>
> Thanks,
> Xiaolong Ye
> ---
> LKP_SERVER: inn
> LKP_CGI_PORT: 80
> LKP_CIFS_PORT: 139
> testcase: piglit
> default-monitors:
> wait: activate-monitor
> kmsg:
> heartbeat:
> interval: 10
> default-watchdogs:
> oom-killer:
> watchdog:
> commit: 0bbca274a31c2366414d8d3f95e03d1c4674d93f
> model: Ivy Bridge
> nr_cpu: 4
> memory: 4G
> nr_hdd_partitions: 0
> hdd_partitions:
> netconsole_port: 6674
> category: functional
> timeout: 30m
> piglit:
> group: igt-036
> queue: bisect
> testbox: lkp-u410
> tbox_group: lkp-u410
> kconfig: x86_64-rhel
> enqueue_time: 2016-03-12 08:10:38.141424169 +08:00
> compiler: gcc-4.9
> rootfs: debian-x86_64-2015-02-07.cgz
> id: 7ebc10fb2ac0e90fb2e346efbdcda69faf9f4c18
> user: lkp
> head_commit: 884dcd36fc68f78a12db2ae041eaeadb230b460b
> base_commit: f6cede5b49e822ebc41a099fe41ab4989f64e2cb
> branch: linux-devel/devel-hourly-2016031201
> result_root: "/result/piglit/igt-036/lkp-u410/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/0"
> job_file: "/lkp/scheduled/lkp-u410/bisect_piglit-igt-036-debian-x86_64-2015-02-07.cgz-x86_64-rhel-0bbca274a31c2366414d8d3f95e03d1c4674d93f-20160312-31710-1ckf79s-0.yaml"
> max_uptime: 1800
> initrd: "/osimage/debian/debian-x86_64-2015-02-07.cgz"
> bootloader_append:
> - root=/dev/ram0
> - user=lkp
> - job=/lkp/scheduled/lkp-u410/bisect_piglit-igt-036-debian-x86_64-2015-02-07.cgz-x86_64-rhel-0bbca274a31c2366414d8d3f95e03d1c4674d93f-20160312-31710-1ckf79s-0.yaml
> - ARCH=x86_64
> - kconfig=x86_64-rhel
> - branch=linux-devel/devel-hourly-2016031201
> - commit=0bbca274a31c2366414d8d3f95e03d1c4674d93f
> - BOOT_IMAGE=/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/vmlinuz-4.5.0-rc7-00002-g0bbca27
> - max_uptime=1800
> - RESULT_ROOT=/result/piglit/igt-036/lkp-u410/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/0
> - LKP_SERVER=inn
> - |2-
>
>
> earlyprintk=ttyS0,115200 systemd.log_level=err
> debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100
> panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0
> console=ttyS0,115200 console=tty0 vga=normal
>
> rw
> lkp_initrd: "/lkp/lkp/lkp-x86_64.cgz"
> modules_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/modules.cgz"
> bm_initrd: "/osimage/deps/debian-x86_64-2015-02-07.cgz/lkp.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/run-ipconfig.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/piglit.cgz,/lkp/benchmarks/piglit.cgz"
> linux_headers_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/linux-headers.cgz"
> repeat_to: 2
> kernel: "/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/vmlinuz-4.5.0-rc7-00002-g0bbca27"
> dequeue_time: 2016-03-12 08:14:04.556438362 +08:00
> job_state: finished
> loadavg: 0.81 0.38 0.15 1/116 693
> start_time: '1457741713'
> end_time: '1457741864'
> version: "/lkp/lkp/.src-20160311-183612"
> 2016-03-12 08:15:13 piglit run igt -t igt/kms_cursor_crc/cursor-64-sliding /tmp/lkp/piglit-results
> 2016-03-12 08:17:43 piglit summary console /tmp/lkp/piglit-results/results.json
--
Ville Syrjälä
Intel OTC
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [lkp] [drm/i915] 0bbca274a3: 3.6% piglit.time.elapsed_time
2016-03-14 13:37 ` Ville Syrjälä
@ 2016-03-15 5:42 ` Ye Xiaolong
0 siblings, 0 replies; 3+ messages in thread
From: Ye Xiaolong @ 2016-03-15 5:42 UTC (permalink / raw)
To: Ville Syrjälä; +Cc: Jani Nikula, LKML, lkp
On Mon, Mar 14, 2016 at 03:37:51PM +0200, Ville Syrjälä wrote:
>On Mon, Mar 14, 2016 at 10:14:37AM +0800, kernel test robot wrote:
>> FYI, we noticed that piglit.time.elapsed_time 3.6% regression on
>>
>> https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git master
>> commit 0bbca274a31c2366414d8d3f95e03d1c4674d93f ("drm/i915: Actually retry with bit-banging after GMBUS timeout")
>
>Increase in system time is somewhat expected, since we'll do more
>bit banging now. Any chance of comparison against bffce907d640^
>aka. 0aeb904888f5 ("drm/i915: simplify gmbus xfer error checks") ?
>I would hope that the result would be more or less the same as with
>0bbca274a31c ("drm/i915: Actually retry with bit-banging after GMBUS timeout")
Hi, ville
FYI, here is the piglit test result of eb904888f52f48 on "lkp-u410: Ivy Bridge 4G".
eb904888f52f48 0bbca274a31c2366414d8d3f95
---------------- --------------------------
%stddev %change %stddev
\ | \
59 ± 0% -73.1% 16 ± 0% piglit.time.percent_of_cpu_this_job_got
4640 ± 1% +209.6% 14363 ± 0% piglit.time.voluntary_context_switches
62.75 ± 0% +140.7% 151.03 ± 0% piglit.time.elapsed_time
62.75 ± 0% +140.7% 151.03 ± 0% piglit.time.elapsed_time.max
33.61 ± 0% -40.3% 20.05 ± 0% piglit.time.system_time
Thanks,
Xiaolong.
>
>>
>>
>> =========================================================================================
>> compiler/group/kconfig/rootfs/tbox_group/testcase:
>> gcc-4.9/igt-039/x86_64-rhel/debian-x86_64-2015-02-07.cgz/snb-black/piglit
>>
>> commit:
>> 2f791908a70e95768596f5bb9e6de4f441d7bf13
>> 0bbca274a31c2366414d8d3f95e03d1c4674d93f
>>
>> 2f791908a70e9576 0bbca274a31c2366414d8d3f95
>> ---------------- --------------------------
>> %stddev %change %stddev
>> \ | \
>> 188.79 ± 0% +3.6% 195.58 ± 0% piglit.time.elapsed_time
>> 188.79 ± 0% +3.6% 195.58 ± 0% piglit.time.elapsed_time.max
>> 5.00 ± 0% +60.0% 8.00 ± 0% piglit.time.percent_of_cpu_this_job_got
>> 7.86 ± 0% +83.5% 14.42 ± 0% piglit.time.system_time
>> 5.00 ± 0% +60.0% 8.00 ± 0% time.percent_of_cpu_this_job_got
>> 7.86 ± 0% +83.5% 14.42 ± 0% time.system_time
>>
>> =========================================================================================
>> compiler/group/kconfig/rootfs/tbox_group/testcase:
>> gcc-4.9/igt-036/x86_64-rhel/debian-x86_64-2015-02-07.cgz/lkp-u410/piglit
>>
>> commit:
>> 2f791908a70e95768596f5bb9e6de4f441d7bf13
>> 0bbca274a31c2366414d8d3f95e03d1c4674d93f
>>
>> 2f791908a70e9576 0bbca274a31c2366414d8d3f95
>> ---------------- --------------------------
>> %stddev %change %stddev
>> \ | \
>> 141.15 ± 0% +6.9% 150.94 ± 0% piglit.time.elapsed_time
>> 141.15 ± 0% +6.9% 150.94 ± 0% piglit.time.elapsed_time.max
>> 10.00 ± 0% +60.0% 16.00 ± 0% piglit.time.percent_of_cpu_this_job_got
>> 10.61 ± 0% +88.8% 20.04 ± 0% piglit.time.system_time
>> 10.00 ± 0% +60.0% 16.00 ± 0% time.percent_of_cpu_this_job_got
>> 10.61 ± 0% +88.8% 20.04 ± 0% time.system_time
>>
>>
>> snb-black: Sandy Bridge
>> Memory: 8G
>>
>> lkp-u410: Ivy Bridge
>> Memory: 4G
>>
>>
>>
>> piglit.time.system_time
>>
>> 21 ++---------------------------------------------------------------------+
>> 20 O+ O O O O O O O O O O O O O O O O O O O O O O |
>> | |
>> 19 ++ |
>> 18 ++ |
>> 17 ++ |
>> 16 ++ |
>> | |
>> 15 ++ |
>> 14 ++ |
>> 13 ++ |
>> 12 ++ |
>> | |
>> 11 *+.*..*..*..*..*..*..*..*..*..*..*..*.*..*..*..*..*..*..*..*..*..*..*..*
>> 10 ++---------------------------------------------------------------------+
>>
>>
>> piglit.time.percent_of_cpu_this_job_got
>>
>> 16 O+-O--O--O--O--O--O--O--O--O--O--O--O-O--O--O--O--O--O--O--O--O--O-----+
>> | |
>> 15 ++ |
>> | |
>> | |
>> 14 ++ |
>> | |
>> 13 ++ |
>> | |
>> 12 ++ |
>> | |
>> | |
>> 11 *+. *.. *.. *.. |
>> | .. .. .. |
>> 10 ++-*--*--*--*--*--*-----*--*--*-----*-*--*--*-----*--*--*--*--*--*--*--*
>>
>>
>> piglit.time.elapsed_time
>>
>> 152 ++--------------------------------------------------------------------+
>> | O O O O O O O O O O O O O O O O O O O O O O |
>> 150 O+ |
>> | |
>> | |
>> 148 ++ |
>> | |
>> 146 ++ |
>> | |
>> 144 ++ |
>> | |
>> | |
>> 142 ++ .*.. |
>> *.. .*..*..*..* *..*..*..*.. .*..*..*.. .*..*..*..*..*..*
>> 140 ++-*--*----------------------------*--*-----------*--*----------------+
>>
>>
>> piglit.time.elapsed_time.max
>>
>> 152 ++--------------------------------------------------------------------+
>> | O O O O O O O O O O O O O O O O O O O O O O |
>> 150 O+ |
>> | |
>> | |
>> 148 ++ |
>> | |
>> 146 ++ |
>> | |
>> 144 ++ |
>> | |
>> | |
>> 142 ++ .*.. |
>> *.. .*..*..*..* *..*..*..*.. .*..*..*.. .*..*..*..*..*..*
>> 140 ++-*--*----------------------------*--*-----------*--*----------------+
>>
>>
>> time.system_time
>>
>> 21 ++---------------------------------------------------------------------+
>> 20 O+ O O O O O O O O O O O O O O O O O O O O O O |
>> | |
>> 19 ++ |
>> 18 ++ |
>> 17 ++ |
>> 16 ++ |
>> | |
>> 15 ++ |
>> 14 ++ |
>> 13 ++ |
>> 12 ++ |
>> | |
>> 11 *+.*..*..*..*..*..*..*..*..*..*..*..*.*..*..*..*..*..*..*..*..*..*..*..*
>> 10 ++---------------------------------------------------------------------+
>>
>>
>> time.percent_of_cpu_this_job_got
>>
>> 16 O+-O--O--O--O--O--O--O--O--O--O--O--O-O--O--O--O--O--O--O--O--O--O-----+
>> | |
>> 15 ++ |
>> | |
>> | |
>> 14 ++ |
>> | |
>> 13 ++ |
>> | |
>> 12 ++ |
>> | |
>> | |
>> 11 *+. *.. *.. *.. |
>> | .. .. .. |
>> 10 ++-*--*--*--*--*--*-----*--*--*-----*-*--*--*-----*--*--*--*--*--*--*--*
>>
>>
>>
>>
>> piglit.time.system_time
>>
>> 15 ++---------------------------------------------------------------------+
>> O O O O O O O O O O O O O O O O O O O O O O O O O |
>> 14 ++ |
>> 13 ++ |
>> | |
>> 12 ++ |
>> | |
>> 11 ++ |
>> | |
>> 10 ++ |
>> 9 ++ |
>> | |
>> 8 ++ .*..*.. .*.. .*..*. .*..*.*..*.. .*
>> *..*..*..* *..*. *.*..*..*..*. *..*..*..*. *. |
>> 7 ++---------------------------------------------------------------------+
>>
>>
>> piglit.time.elapsed_time
>>
>> 450 ++--------------------------------------------------------------------+
>> | |
>> 400 ++ O |
>> | |
>> | |
>> 350 ++ |
>> | |
>> 300 ++ |
>> | |
>> 250 ++ |
>> | |
>> | |
>> 200 O+.O..O.O..O..O..O..O.O..O..O..O..O.O..*..O..O..O.O..O..O..O..O.O..O..*
>> | |
>> 150 ++--------------------------------------------------------------------+
>>
>>
>> piglit.time.elapsed_time.max
>>
>> 450 ++--------------------------------------------------------------------+
>> | |
>> 400 ++ O |
>> | |
>> | |
>> 350 ++ |
>> | |
>> 300 ++ |
>> | |
>> 250 ++ |
>> | |
>> | |
>> 200 O+.O..O.O..O..O..O..O.O..O..O..O..O.O..*..O..O..O.O..O..O..O..O.O..O..*
>> | |
>> 150 ++--------------------------------------------------------------------+
>>
>>
>> time.system_time
>>
>> 15 ++---------------------------------------------------------------------+
>> O O O O O O O O O O O O O O O O O O O O O O O O O |
>> 14 ++ |
>> 13 ++ |
>> | |
>> 12 ++ |
>> | |
>> 11 ++ |
>> | |
>> 10 ++ |
>> 9 ++ |
>> | |
>> 8 ++ .*..*.. .*.. .*..*. .*..*.*..*.. .*
>> *..*..*..* *..*. *.*..*..*..*. *..*..*..*. *. |
>> 7 ++---------------------------------------------------------------------+
>>
>> [*] bisect-good sample
>> [O] bisect-bad sample
>>
>> To reproduce:
>>
>> git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
>> cd lkp-tests
>> bin/lkp install job.yaml # job file is attached in this email
>> bin/lkp run job.yaml
>>
>>
>> Disclaimer:
>> Results have been estimated based on internal Intel analysis and are provided
>> for informational purposes only. Any difference in system hardware or software
>> design or configuration may affect actual performance.
>>
>>
>> Thanks,
>> Xiaolong Ye
>
>> ---
>> LKP_SERVER: inn
>> LKP_CGI_PORT: 80
>> LKP_CIFS_PORT: 139
>> testcase: piglit
>> default-monitors:
>> wait: activate-monitor
>> kmsg:
>> heartbeat:
>> interval: 10
>> default-watchdogs:
>> oom-killer:
>> watchdog:
>> commit: 0bbca274a31c2366414d8d3f95e03d1c4674d93f
>> model: Ivy Bridge
>> nr_cpu: 4
>> memory: 4G
>> nr_hdd_partitions: 0
>> hdd_partitions:
>> netconsole_port: 6674
>> category: functional
>> timeout: 30m
>> piglit:
>> group: igt-036
>> queue: bisect
>> testbox: lkp-u410
>> tbox_group: lkp-u410
>> kconfig: x86_64-rhel
>> enqueue_time: 2016-03-12 08:10:38.141424169 +08:00
>> compiler: gcc-4.9
>> rootfs: debian-x86_64-2015-02-07.cgz
>> id: 7ebc10fb2ac0e90fb2e346efbdcda69faf9f4c18
>> user: lkp
>> head_commit: 884dcd36fc68f78a12db2ae041eaeadb230b460b
>> base_commit: f6cede5b49e822ebc41a099fe41ab4989f64e2cb
>> branch: linux-devel/devel-hourly-2016031201
>> result_root: "/result/piglit/igt-036/lkp-u410/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/0"
>> job_file: "/lkp/scheduled/lkp-u410/bisect_piglit-igt-036-debian-x86_64-2015-02-07.cgz-x86_64-rhel-0bbca274a31c2366414d8d3f95e03d1c4674d93f-20160312-31710-1ckf79s-0.yaml"
>> max_uptime: 1800
>> initrd: "/osimage/debian/debian-x86_64-2015-02-07.cgz"
>> bootloader_append:
>> - root=/dev/ram0
>> - user=lkp
>> - job=/lkp/scheduled/lkp-u410/bisect_piglit-igt-036-debian-x86_64-2015-02-07.cgz-x86_64-rhel-0bbca274a31c2366414d8d3f95e03d1c4674d93f-20160312-31710-1ckf79s-0.yaml
>> - ARCH=x86_64
>> - kconfig=x86_64-rhel
>> - branch=linux-devel/devel-hourly-2016031201
>> - commit=0bbca274a31c2366414d8d3f95e03d1c4674d93f
>> - BOOT_IMAGE=/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/vmlinuz-4.5.0-rc7-00002-g0bbca27
>> - max_uptime=1800
>> - RESULT_ROOT=/result/piglit/igt-036/lkp-u410/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/0
>> - LKP_SERVER=inn
>> - |2-
>>
>>
>> earlyprintk=ttyS0,115200 systemd.log_level=err
>> debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100
>> panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0
>> console=ttyS0,115200 console=tty0 vga=normal
>>
>> rw
>> lkp_initrd: "/lkp/lkp/lkp-x86_64.cgz"
>> modules_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/modules.cgz"
>> bm_initrd: "/osimage/deps/debian-x86_64-2015-02-07.cgz/lkp.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/run-ipconfig.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/piglit.cgz,/lkp/benchmarks/piglit.cgz"
>> linux_headers_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/linux-headers.cgz"
>> repeat_to: 2
>> kernel: "/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/vmlinuz-4.5.0-rc7-00002-g0bbca27"
>> dequeue_time: 2016-03-12 08:14:04.556438362 +08:00
>> job_state: finished
>> loadavg: 0.81 0.38 0.15 1/116 693
>> start_time: '1457741713'
>> end_time: '1457741864'
>> version: "/lkp/lkp/.src-20160311-183612"
>
>> 2016-03-12 08:15:13 piglit run igt -t igt/kms_cursor_crc/cursor-64-sliding /tmp/lkp/piglit-results
>> 2016-03-12 08:17:43 piglit summary console /tmp/lkp/piglit-results/results.json
>
>
>--
>Ville Syrjälä
>Intel OTC
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2016-03-15 5:42 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2016-03-14 2:14 [lkp] [drm/i915] 0bbca274a3: 3.6% piglit.time.elapsed_time kernel test robot
2016-03-14 13:37 ` Ville Syrjälä
2016-03-15 5:42 ` Ye Xiaolong
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).