From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755640AbcCNNh6 (ORCPT ); Mon, 14 Mar 2016 09:37:58 -0400 Received: from mga01.intel.com ([192.55.52.88]:44317 "EHLO mga01.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1755572AbcCNNhz (ORCPT ); Mon, 14 Mar 2016 09:37:55 -0400 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.24,335,1455004800"; d="scan'208";a="923638973" Date: Mon, 14 Mar 2016 15:37:51 +0200 From: Ville =?iso-8859-1?Q?Syrj=E4l=E4?= To: kernel test robot Cc: Jani Nikula , LKML , lkp@01.org Subject: Re: [lkp] [drm/i915] 0bbca274a3: 3.6% piglit.time.elapsed_time Message-ID: <20160314133751.GM4329@intel.com> References: <20160314021437.GA32210@yexl-desktop> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20160314021437.GA32210@yexl-desktop> User-Agent: Mutt/1.5.24 (2015-08-30) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Mar 14, 2016 at 10:14:37AM +0800, kernel test robot wrote: > FYI, we noticed that piglit.time.elapsed_time 3.6% regression on > > https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git master > commit 0bbca274a31c2366414d8d3f95e03d1c4674d93f ("drm/i915: Actually retry with bit-banging after GMBUS timeout") Increase in system time is somewhat expected, since we'll do more bit banging now. Any chance of comparison against bffce907d640^ aka. 0aeb904888f5 ("drm/i915: simplify gmbus xfer error checks") ? I would hope that the result would be more or less the same as with 0bbca274a31c ("drm/i915: Actually retry with bit-banging after GMBUS timeout") > > > ========================================================================================= > compiler/group/kconfig/rootfs/tbox_group/testcase: > gcc-4.9/igt-039/x86_64-rhel/debian-x86_64-2015-02-07.cgz/snb-black/piglit > > commit: > 2f791908a70e95768596f5bb9e6de4f441d7bf13 > 0bbca274a31c2366414d8d3f95e03d1c4674d93f > > 2f791908a70e9576 0bbca274a31c2366414d8d3f95 > ---------------- -------------------------- > %stddev %change %stddev > \ | \ > 188.79 ± 0% +3.6% 195.58 ± 0% piglit.time.elapsed_time > 188.79 ± 0% +3.6% 195.58 ± 0% piglit.time.elapsed_time.max > 5.00 ± 0% +60.0% 8.00 ± 0% piglit.time.percent_of_cpu_this_job_got > 7.86 ± 0% +83.5% 14.42 ± 0% piglit.time.system_time > 5.00 ± 0% +60.0% 8.00 ± 0% time.percent_of_cpu_this_job_got > 7.86 ± 0% +83.5% 14.42 ± 0% time.system_time > > ========================================================================================= > compiler/group/kconfig/rootfs/tbox_group/testcase: > gcc-4.9/igt-036/x86_64-rhel/debian-x86_64-2015-02-07.cgz/lkp-u410/piglit > > commit: > 2f791908a70e95768596f5bb9e6de4f441d7bf13 > 0bbca274a31c2366414d8d3f95e03d1c4674d93f > > 2f791908a70e9576 0bbca274a31c2366414d8d3f95 > ---------------- -------------------------- > %stddev %change %stddev > \ | \ > 141.15 ± 0% +6.9% 150.94 ± 0% piglit.time.elapsed_time > 141.15 ± 0% +6.9% 150.94 ± 0% piglit.time.elapsed_time.max > 10.00 ± 0% +60.0% 16.00 ± 0% piglit.time.percent_of_cpu_this_job_got > 10.61 ± 0% +88.8% 20.04 ± 0% piglit.time.system_time > 10.00 ± 0% +60.0% 16.00 ± 0% time.percent_of_cpu_this_job_got > 10.61 ± 0% +88.8% 20.04 ± 0% time.system_time > > > snb-black: Sandy Bridge > Memory: 8G > > lkp-u410: Ivy Bridge > Memory: 4G > > > > piglit.time.system_time > > 21 ++---------------------------------------------------------------------+ > 20 O+ O O O O O O O O O O O O O O O O O O O O O O | > | | > 19 ++ | > 18 ++ | > 17 ++ | > 16 ++ | > | | > 15 ++ | > 14 ++ | > 13 ++ | > 12 ++ | > | | > 11 *+.*..*..*..*..*..*..*..*..*..*..*..*.*..*..*..*..*..*..*..*..*..*..*..* > 10 ++---------------------------------------------------------------------+ > > > piglit.time.percent_of_cpu_this_job_got > > 16 O+-O--O--O--O--O--O--O--O--O--O--O--O-O--O--O--O--O--O--O--O--O--O-----+ > | | > 15 ++ | > | | > | | > 14 ++ | > | | > 13 ++ | > | | > 12 ++ | > | | > | | > 11 *+. *.. *.. *.. | > | .. .. .. | > 10 ++-*--*--*--*--*--*-----*--*--*-----*-*--*--*-----*--*--*--*--*--*--*--* > > > piglit.time.elapsed_time > > 152 ++--------------------------------------------------------------------+ > | O O O O O O O O O O O O O O O O O O O O O O | > 150 O+ | > | | > | | > 148 ++ | > | | > 146 ++ | > | | > 144 ++ | > | | > | | > 142 ++ .*.. | > *.. .*..*..*..* *..*..*..*.. .*..*..*.. .*..*..*..*..*..* > 140 ++-*--*----------------------------*--*-----------*--*----------------+ > > > piglit.time.elapsed_time.max > > 152 ++--------------------------------------------------------------------+ > | O O O O O O O O O O O O O O O O O O O O O O | > 150 O+ | > | | > | | > 148 ++ | > | | > 146 ++ | > | | > 144 ++ | > | | > | | > 142 ++ .*.. | > *.. .*..*..*..* *..*..*..*.. .*..*..*.. .*..*..*..*..*..* > 140 ++-*--*----------------------------*--*-----------*--*----------------+ > > > time.system_time > > 21 ++---------------------------------------------------------------------+ > 20 O+ O O O O O O O O O O O O O O O O O O O O O O | > | | > 19 ++ | > 18 ++ | > 17 ++ | > 16 ++ | > | | > 15 ++ | > 14 ++ | > 13 ++ | > 12 ++ | > | | > 11 *+.*..*..*..*..*..*..*..*..*..*..*..*.*..*..*..*..*..*..*..*..*..*..*..* > 10 ++---------------------------------------------------------------------+ > > > time.percent_of_cpu_this_job_got > > 16 O+-O--O--O--O--O--O--O--O--O--O--O--O-O--O--O--O--O--O--O--O--O--O-----+ > | | > 15 ++ | > | | > | | > 14 ++ | > | | > 13 ++ | > | | > 12 ++ | > | | > | | > 11 *+. *.. *.. *.. | > | .. .. .. | > 10 ++-*--*--*--*--*--*-----*--*--*-----*-*--*--*-----*--*--*--*--*--*--*--* > > > > > piglit.time.system_time > > 15 ++---------------------------------------------------------------------+ > O O O O O O O O O O O O O O O O O O O O O O O O O | > 14 ++ | > 13 ++ | > | | > 12 ++ | > | | > 11 ++ | > | | > 10 ++ | > 9 ++ | > | | > 8 ++ .*..*.. .*.. .*..*. .*..*.*..*.. .* > *..*..*..* *..*. *.*..*..*..*. *..*..*..*. *. | > 7 ++---------------------------------------------------------------------+ > > > piglit.time.elapsed_time > > 450 ++--------------------------------------------------------------------+ > | | > 400 ++ O | > | | > | | > 350 ++ | > | | > 300 ++ | > | | > 250 ++ | > | | > | | > 200 O+.O..O.O..O..O..O..O.O..O..O..O..O.O..*..O..O..O.O..O..O..O..O.O..O..* > | | > 150 ++--------------------------------------------------------------------+ > > > piglit.time.elapsed_time.max > > 450 ++--------------------------------------------------------------------+ > | | > 400 ++ O | > | | > | | > 350 ++ | > | | > 300 ++ | > | | > 250 ++ | > | | > | | > 200 O+.O..O.O..O..O..O..O.O..O..O..O..O.O..*..O..O..O.O..O..O..O..O.O..O..* > | | > 150 ++--------------------------------------------------------------------+ > > > time.system_time > > 15 ++---------------------------------------------------------------------+ > O O O O O O O O O O O O O O O O O O O O O O O O O | > 14 ++ | > 13 ++ | > | | > 12 ++ | > | | > 11 ++ | > | | > 10 ++ | > 9 ++ | > | | > 8 ++ .*..*.. .*.. .*..*. .*..*.*..*.. .* > *..*..*..* *..*. *.*..*..*..*. *..*..*..*. *. | > 7 ++---------------------------------------------------------------------+ > > [*] bisect-good sample > [O] bisect-bad sample > > To reproduce: > > git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git > cd lkp-tests > bin/lkp install job.yaml # job file is attached in this email > bin/lkp run job.yaml > > > Disclaimer: > Results have been estimated based on internal Intel analysis and are provided > for informational purposes only. Any difference in system hardware or software > design or configuration may affect actual performance. > > > Thanks, > Xiaolong Ye > --- > LKP_SERVER: inn > LKP_CGI_PORT: 80 > LKP_CIFS_PORT: 139 > testcase: piglit > default-monitors: > wait: activate-monitor > kmsg: > heartbeat: > interval: 10 > default-watchdogs: > oom-killer: > watchdog: > commit: 0bbca274a31c2366414d8d3f95e03d1c4674d93f > model: Ivy Bridge > nr_cpu: 4 > memory: 4G > nr_hdd_partitions: 0 > hdd_partitions: > netconsole_port: 6674 > category: functional > timeout: 30m > piglit: > group: igt-036 > queue: bisect > testbox: lkp-u410 > tbox_group: lkp-u410 > kconfig: x86_64-rhel > enqueue_time: 2016-03-12 08:10:38.141424169 +08:00 > compiler: gcc-4.9 > rootfs: debian-x86_64-2015-02-07.cgz > id: 7ebc10fb2ac0e90fb2e346efbdcda69faf9f4c18 > user: lkp > head_commit: 884dcd36fc68f78a12db2ae041eaeadb230b460b > base_commit: f6cede5b49e822ebc41a099fe41ab4989f64e2cb > branch: linux-devel/devel-hourly-2016031201 > result_root: "/result/piglit/igt-036/lkp-u410/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/0" > job_file: "/lkp/scheduled/lkp-u410/bisect_piglit-igt-036-debian-x86_64-2015-02-07.cgz-x86_64-rhel-0bbca274a31c2366414d8d3f95e03d1c4674d93f-20160312-31710-1ckf79s-0.yaml" > max_uptime: 1800 > initrd: "/osimage/debian/debian-x86_64-2015-02-07.cgz" > bootloader_append: > - root=/dev/ram0 > - user=lkp > - job=/lkp/scheduled/lkp-u410/bisect_piglit-igt-036-debian-x86_64-2015-02-07.cgz-x86_64-rhel-0bbca274a31c2366414d8d3f95e03d1c4674d93f-20160312-31710-1ckf79s-0.yaml > - ARCH=x86_64 > - kconfig=x86_64-rhel > - branch=linux-devel/devel-hourly-2016031201 > - commit=0bbca274a31c2366414d8d3f95e03d1c4674d93f > - BOOT_IMAGE=/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/vmlinuz-4.5.0-rc7-00002-g0bbca27 > - max_uptime=1800 > - RESULT_ROOT=/result/piglit/igt-036/lkp-u410/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/0 > - LKP_SERVER=inn > - |2- > > > earlyprintk=ttyS0,115200 systemd.log_level=err > debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 > panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 > console=ttyS0,115200 console=tty0 vga=normal > > rw > lkp_initrd: "/lkp/lkp/lkp-x86_64.cgz" > modules_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/modules.cgz" > bm_initrd: "/osimage/deps/debian-x86_64-2015-02-07.cgz/lkp.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/run-ipconfig.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/piglit.cgz,/lkp/benchmarks/piglit.cgz" > linux_headers_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/linux-headers.cgz" > repeat_to: 2 > kernel: "/pkg/linux/x86_64-rhel/gcc-4.9/0bbca274a31c2366414d8d3f95e03d1c4674d93f/vmlinuz-4.5.0-rc7-00002-g0bbca27" > dequeue_time: 2016-03-12 08:14:04.556438362 +08:00 > job_state: finished > loadavg: 0.81 0.38 0.15 1/116 693 > start_time: '1457741713' > end_time: '1457741864' > version: "/lkp/lkp/.src-20160311-183612" > 2016-03-12 08:15:13 piglit run igt -t igt/kms_cursor_crc/cursor-64-sliding /tmp/lkp/piglit-results > 2016-03-12 08:17:43 piglit summary console /tmp/lkp/piglit-results/results.json -- Ville Syrjälä Intel OTC