[igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[Marta Lofstedt]

Skipping takes time, specifically for the big amount of drrs
related kms_frontbuffer_tracking tests. Since we currently
don't have any system set up with DRRS panels, blacklisting
all those test will save time, and we can avoid the need to
increase the Jenkins timeout in order to solve the Bugzilla
below.

Bugzilla: https://bugs.freedesktop.org/show_bug.cgi?id=105617
Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
---
 tests/intel-ci/blacklist.txt | 1 +
 1 file changed, 1 insertion(+)

diff --git a/tests/intel-ci/blacklist.txt b/tests/intel-ci/blacklist.txt
index 7ca313ac..0a8506ca 100644
--- a/tests/intel-ci/blacklist.txt
+++ b/tests/intel-ci/blacklist.txt
@@ -57,6 +57,7 @@ igt@gem_tiled_swapping@(?!non-threaded).*
 igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
 igt@gem_wait@.*hang.*
 igt@gem_write_read_ring_switch(@.*)?
+igt@kms_frontbuffer_tracking@.*drrs*
 ###############################################
 # Broadcom
 ###############################################
-- 
2.11.0

_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

[igt-dev] ✓ Fi.CI.BAT: success for blacklist: Don't run DRRS test on Intel CI system

[Patchwork]

== Series Details ==

Series: blacklist: Don't run DRRS test on Intel CI system
URL   : https://patchwork.freedesktop.org/series/40646/
State : success

== Summary ==

IGT patchset tested on top of latest successful build
c2ee90774496a9772f17a7a359d7a670bf7d6b85 meson: Chamelium depends on GSL

with latest DRM-Tip kernel build CI_DRM_3978
94f5d9189e61 drm-tip: 2018y-03m-23d-23h-41m-40s UTC integration manifest

No testlist changes.

---- Known issues:

Test gem_mmap_gtt:
        Subgroup basic-small-bo-tiledx:
                pass       -> FAIL       (fi-gdg-551) fdo#102575
Test kms_pipe_crc_basic:
        Subgroup suspend-read-crc-pipe-c:
                incomplete -> PASS       (fi-hsw-4770) fdo#104944

fdo#102575 https://bugs.freedesktop.org/show_bug.cgi?id=102575
fdo#104944 https://bugs.freedesktop.org/show_bug.cgi?id=104944

fi-bdw-5557u     total:285  pass:264  dwarn:0   dfail:0   fail:0   skip:21  time:432s
fi-bdw-gvtdvm    total:285  pass:261  dwarn:0   dfail:0   fail:0   skip:24  time:443s
fi-blb-e6850     total:285  pass:220  dwarn:1   dfail:0   fail:0   skip:64  time:381s
fi-bsw-n3050     total:285  pass:239  dwarn:0   dfail:0   fail:0   skip:46  time:539s
fi-bwr-2160      total:285  pass:180  dwarn:0   dfail:0   fail:0   skip:105 time:296s
fi-bxt-dsi       total:243  pass:216  dwarn:0   dfail:0   fail:0   skip:26 
fi-bxt-j4205     total:285  pass:256  dwarn:0   dfail:0   fail:0   skip:29  time:520s
fi-byt-j1900     total:285  pass:250  dwarn:0   dfail:0   fail:0   skip:35  time:524s
fi-byt-n2820     total:285  pass:246  dwarn:0   dfail:0   fail:0   skip:39  time:516s
fi-cfl-8700k     total:285  pass:257  dwarn:0   dfail:0   fail:0   skip:28  time:414s
fi-cfl-u         total:285  pass:259  dwarn:0   dfail:0   fail:0   skip:26  time:510s
fi-elk-e7500     total:285  pass:225  dwarn:1   dfail:0   fail:0   skip:59  time:429s
fi-gdg-551       total:285  pass:176  dwarn:0   dfail:0   fail:1   skip:108 time:316s
fi-glk-1         total:285  pass:257  dwarn:0   dfail:0   fail:0   skip:28  time:540s
fi-hsw-4770      total:285  pass:258  dwarn:0   dfail:0   fail:0   skip:27  time:407s
fi-ilk-650       total:285  pass:225  dwarn:0   dfail:0   fail:0   skip:60  time:423s
fi-ivb-3520m     total:285  pass:256  dwarn:0   dfail:0   fail:0   skip:29  time:478s
fi-ivb-3770      total:285  pass:252  dwarn:0   dfail:0   fail:0   skip:33  time:431s
fi-kbl-7500u     total:285  pass:260  dwarn:1   dfail:0   fail:0   skip:24  time:475s
fi-kbl-7567u     total:285  pass:265  dwarn:0   dfail:0   fail:0   skip:20  time:470s
fi-kbl-r         total:285  pass:258  dwarn:0   dfail:0   fail:0   skip:27  time:513s
fi-pnv-d510      total:285  pass:219  dwarn:1   dfail:0   fail:0   skip:65  time:657s
fi-skl-6260u     total:285  pass:265  dwarn:0   dfail:0   fail:0   skip:20  time:437s
fi-skl-6600u     total:285  pass:258  dwarn:0   dfail:0   fail:0   skip:27  time:536s
fi-skl-6700k2    total:285  pass:261  dwarn:0   dfail:0   fail:0   skip:24  time:510s
fi-skl-6770hq    total:285  pass:265  dwarn:0   dfail:0   fail:0   skip:20  time:515s
fi-skl-guc       total:285  pass:257  dwarn:0   dfail:0   fail:0   skip:28  time:431s
fi-skl-gvtdvm    total:285  pass:262  dwarn:0   dfail:0   fail:0   skip:23  time:450s
fi-snb-2520m     total:285  pass:245  dwarn:0   dfail:0   fail:0   skip:40  time:575s
fi-snb-2600      total:285  pass:245  dwarn:0   dfail:0   fail:0   skip:40  time:402s
Blacklisted hosts:
fi-cfl-s3        total:285  pass:259  dwarn:0   dfail:0   fail:0   skip:26  time:564s
fi-cnl-psr       total:224  pass:198  dwarn:0   dfail:0   fail:1   skip:24 
fi-glk-j4005     total:285  pass:226  dwarn:30  dfail:0   fail:0   skip:29  time:489s

== Logs ==

For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1188/issues.html
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

[igt-dev] ✗ Fi.CI.IGT: failure for blacklist: Don't run DRRS test on Intel CI system

[Patchwork]

== Series Details ==

Series: blacklist: Don't run DRRS test on Intel CI system
URL   : https://patchwork.freedesktop.org/series/40646/
State : failure

== Summary ==

---- Possible new issues:

Test kms_cursor_legacy:
        Subgroup cursorb-vs-flipa-atomic-transitions:
                pass       -> SKIP       (shard-hsw)
Test kms_frontbuffer_tracking:
        Subgroup fbc-1p-primscrn-spr-indfb-onoff:
                pass       -> FAIL       (shard-apl)

---- Known issues:

Test kms_flip:
        Subgroup 2x-flip-vs-absolute-wf_vblank:
                pass       -> FAIL       (shard-hsw) fdo#100368 +1
        Subgroup 2x-flip-vs-expired-vblank-interruptible:
                fail       -> PASS       (shard-hsw) fdo#102887
        Subgroup dpms-vs-vblank-race-interruptible:
                fail       -> PASS       (shard-hsw) fdo#103060 +3
Test kms_rotation_crc:
        Subgroup sprite-rotation-180:
                fail       -> PASS       (shard-snb) fdo#103925 +1
Test kms_setmode:
        Subgroup basic:
                pass       -> FAIL       (shard-apl) fdo#99912
Test kms_sysfs_edid_timing:
                warn       -> PASS       (shard-apl) fdo#100047
Test kms_vblank:
        Subgroup pipe-b-accuracy-idle:
                pass       -> FAIL       (shard-hsw) fdo#102583

fdo#100368 https://bugs.freedesktop.org/show_bug.cgi?id=100368
fdo#102887 https://bugs.freedesktop.org/show_bug.cgi?id=102887
fdo#103060 https://bugs.freedesktop.org/show_bug.cgi?id=103060
fdo#103925 https://bugs.freedesktop.org/show_bug.cgi?id=103925
fdo#99912 https://bugs.freedesktop.org/show_bug.cgi?id=99912
fdo#100047 https://bugs.freedesktop.org/show_bug.cgi?id=100047
fdo#102583 https://bugs.freedesktop.org/show_bug.cgi?id=102583

shard-apl        total:2914 pass:1820 dwarn:1   dfail:0   fail:8   skip:1085 time:12806s
shard-hsw        total:2914 pass:1770 dwarn:1   dfail:0   fail:4   skip:1138 time:11599s
shard-snb        total:2914 pass:1362 dwarn:1   dfail:0   fail:4   skip:1547 time:6913s
Blacklisted hosts:
shard-kbl        total:2914 pass:1944 dwarn:1   dfail:1   fail:9   skip:959 time:9745s

== Logs ==

For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1188/shards.html
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[Maarten Lankhorst]

Op 26-03-18 om 08:29 schreef Marta Lofstedt:
> Skipping takes time, specifically for the big amount of drrs
> related kms_frontbuffer_tracking tests. Since we currently
> don't have any system set up with DRRS panels, blacklisting
> all those test will save time, and we can avoid the need to
> increase the Jenkins timeout in order to solve the Bugzilla
> below.
>
> Bugzilla: https://bugs.freedesktop.org/show_bug.cgi?id=105617
> Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
> ---
>  tests/intel-ci/blacklist.txt | 1 +
>  1 file changed, 1 insertion(+)
>
> diff --git a/tests/intel-ci/blacklist.txt b/tests/intel-ci/blacklist.txt
> index 7ca313ac..0a8506ca 100644
> --- a/tests/intel-ci/blacklist.txt
> +++ b/tests/intel-ci/blacklist.txt
> @@ -57,6 +57,7 @@ igt@gem_tiled_swapping@(?!non-threaded).*
>  igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
>  igt@gem_wait@.*hang.*
>  igt@gem_write_read_ring_switch(@.*)?
> +igt@kms_frontbuffer_tracking@.*drrs*
>  ###############################################
>  # Broadcom
>  ###############################################
Hm a single skipped test should take about 100 ms, but I do notice we probe all outputs in igt_display_init, so could this also be fixed by https://patchwork.freedesktop.org/patch/212983/ ?
This should reduce probing to the minimum.

~Maarten
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[Lofstedt, Marta]

> -----Original Message-----
> From: Maarten Lankhorst [mailto:maarten.lankhorst@linux.intel.com]
> Sent: Monday, March 26, 2018 4:23 PM
> To: Lofstedt, Marta <marta.lofstedt@intel.com>; igt-
> dev@lists.freedesktop.org
> Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI
> system
> 
> Op 26-03-18 om 08:29 schreef Marta Lofstedt:
> > Skipping takes time, specifically for the big amount of drrs related
> > kms_frontbuffer_tracking tests. Since we currently don't have any
> > system set up with DRRS panels, blacklisting all those test will save
> > time, and we can avoid the need to increase the Jenkins timeout in
> > order to solve the Bugzilla below.
> >
> > Bugzilla: https://bugs.freedesktop.org/show_bug.cgi?id=105617
> > Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
> > ---
> >  tests/intel-ci/blacklist.txt | 1 +
> >  1 file changed, 1 insertion(+)
> >
> > diff --git a/tests/intel-ci/blacklist.txt
> > b/tests/intel-ci/blacklist.txt index 7ca313ac..0a8506ca 100644
> > --- a/tests/intel-ci/blacklist.txt
> > +++ b/tests/intel-ci/blacklist.txt
> > @@ -57,6 +57,7 @@ igt@gem_tiled_swapping@(?!non-threaded).*
> >  igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
> >  igt@gem_wait@.*hang.*
> >  igt@gem_write_read_ring_switch(@.*)?
> > +igt@kms_frontbuffer_tracking@.*drrs*
> >  ###############################################
> >  # Broadcom
> >  ###############################################
> Hm a single skipped test should take about 100 ms, but I do notice we probe
> all outputs in igt_display_init, so could this also be fixed by
> https://patchwork.freedesktop.org/patch/212983/ ?
> This should reduce probing to the minimum.
> 
> ~Maarten

APL-shards runtime was ~120 seconds less on the PW run for this patch compared to the CI_DRM_NNNN run before
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[Arkadiusz Hiler]

On Mon, Mar 26, 2018 at 03:22:56PM +0200, Maarten Lankhorst wrote:
> Op 26-03-18 om 08:29 schreef Marta Lofstedt:
> > Skipping takes time, specifically for the big amount of drrs
> > related kms_frontbuffer_tracking tests. Since we currently
> > don't have any system set up with DRRS panels, blacklisting
> > all those test will save time, and we can avoid the need to
> > increase the Jenkins timeout in order to solve the Bugzilla
> > below.
> >
> > Bugzilla: https://bugs.freedesktop.org/show_bug.cgi?id=105617
> > Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
> > ---
> >  tests/intel-ci/blacklist.txt | 1 +
> >  1 file changed, 1 insertion(+)
> >
> > diff --git a/tests/intel-ci/blacklist.txt b/tests/intel-ci/blacklist.txt
> > index 7ca313ac..0a8506ca 100644
> > --- a/tests/intel-ci/blacklist.txt
> > +++ b/tests/intel-ci/blacklist.txt
> > @@ -57,6 +57,7 @@ igt@gem_tiled_swapping@(?!non-threaded).*
> >  igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
> >  igt@gem_wait@.*hang.*
> >  igt@gem_write_read_ring_switch(@.*)?
> > +igt@kms_frontbuffer_tracking@.*drrs*

I think we should start annotating those, so the reevaluation would be
easier than 'git blame'-ing the file and going through each commit.

> >  ###############################################
> >  # Broadcom
> >  ###############################################
> Hm a single skipped test should take about 100 ms, but I do notice we
> probe all outputs in igt_display_init, so could this also be fixed by
> https://patchwork.freedesktop.org/patch/212983/ ?
> 
> This should reduce probing to the minimum.

Note the discussion around this patch:
http://patchwork.freedesktop.org/patch/204944/

The idea was to start async probe during the boot, so we won't depend on
the fbdev to do the initial probing.

But it seems that, after all, UNKNOWN is still a thing. I should have
checked myself...

I've pulled the numbers for your change:

             CI_DRM_3978      IGTPW_1192
shard-apl         12982s          12783s
shard-hsw         11735s          11560s
shard-snb          7033s           6906s
shard-kbl          9843s           9048s

Looks good.

Note: those are the combined runtimes, so the actual wall-clock time
saving for our CI is less than that (because shading).

-Arek
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[Maarten Lankhorst]

Op 27-03-18 om 11:15 schreef Arkadiusz Hiler:
> On Mon, Mar 26, 2018 at 03:22:56PM +0200, Maarten Lankhorst wrote:
>> Op 26-03-18 om 08:29 schreef Marta Lofstedt:
>>> Skipping takes time, specifically for the big amount of drrs
>>> related kms_frontbuffer_tracking tests. Since we currently
>>> don't have any system set up with DRRS panels, blacklisting
>>> all those test will save time, and we can avoid the need to
>>> increase the Jenkins timeout in order to solve the Bugzilla
>>> below.
>>>
>>> Bugzilla: https://bugs.freedesktop.org/show_bug.cgi?id=105617
>>> Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
>>> ---
>>>  tests/intel-ci/blacklist.txt | 1 +
>>>  1 file changed, 1 insertion(+)
>>>
>>> diff --git a/tests/intel-ci/blacklist.txt b/tests/intel-ci/blacklist.txt
>>> index 7ca313ac..0a8506ca 100644
>>> --- a/tests/intel-ci/blacklist.txt
>>> +++ b/tests/intel-ci/blacklist.txt
>>> @@ -57,6 +57,7 @@ igt@gem_tiled_swapping@(?!non-threaded).*
>>>  igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
>>>  igt@gem_wait@.*hang.*
>>>  igt@gem_write_read_ring_switch(@.*)?
>>> +igt@kms_frontbuffer_tracking@.*drrs*
> I think we should start annotating those, so the reevaluation would be
> easier than 'git blame'-ing the file and going through each commit.
>
>>>  ###############################################
>>>  # Broadcom
>>>  ###############################################
>> Hm a single skipped test should take about 100 ms, but I do notice we
>> probe all outputs in igt_display_init, so could this also be fixed by
>> https://patchwork.freedesktop.org/patch/212983/ ?
>>
>> This should reduce probing to the minimum.
> Note the discussion around this patch:
> http://patchwork.freedesktop.org/patch/204944/
>
> The idea was to start async probe during the boot, so we won't depend on
> the fbdev to do the initial probing.
>
> But it seems that, after all, UNKNOWN is still a thing. I should have
> checked myself...
>
> I've pulled the numbers for your change:
>
>              CI_DRM_3978      IGTPW_1192
> shard-apl         12982s          12783s
> shard-hsw         11735s          11560s
> shard-snb          7033s           6906s
> shard-kbl          9843s           9048s
>
> Looks good.
>
> Note: those are the combined runtimes, so the actual wall-clock time
> saving for our CI is less than that (because shading).
>
> -Arek

https://patchwork.freedesktop.org/patch/212983/ is a better version. :)

But it's good to see it changing probing reduces runtimes on kbl. Now lets see what we can do to reduce runtime even further.

~Maarten

_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[Lofstedt, Marta]

> -----Original Message-----
> From: Hiler, Arkadiusz
> Sent: Tuesday, March 27, 2018 12:15 PM
> To: Maarten Lankhorst <maarten.lankhorst@linux.intel.com>
> Cc: Lofstedt, Marta <marta.lofstedt@intel.com>; igt-
> dev@lists.freedesktop.org; Chris Wilson <chris@chris-wilson.co.uk>; Latvala,
> Petri <petri.latvala@intel.com>; Daniel Vetter <daniel@ffwll.ch>
> Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI
> system
> 
> On Mon, Mar 26, 2018 at 03:22:56PM +0200, Maarten Lankhorst wrote:
> > Op 26-03-18 om 08:29 schreef Marta Lofstedt:
> > > Skipping takes time, specifically for the big amount of drrs related
> > > kms_frontbuffer_tracking tests. Since we currently don't have any
> > > system set up with DRRS panels, blacklisting all those test will
> > > save time, and we can avoid the need to increase the Jenkins timeout
> > > in order to solve the Bugzilla below.
> > >
> > > Bugzilla: https://bugs.freedesktop.org/show_bug.cgi?id=105617
> > > Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
> > > ---
> > >  tests/intel-ci/blacklist.txt | 1 +
> > >  1 file changed, 1 insertion(+)
> > >
> > > diff --git a/tests/intel-ci/blacklist.txt
> > > b/tests/intel-ci/blacklist.txt index 7ca313ac..0a8506ca 100644
> > > --- a/tests/intel-ci/blacklist.txt
> > > +++ b/tests/intel-ci/blacklist.txt
> > > @@ -57,6 +57,7 @@ igt@gem_tiled_swapping@(?!non-threaded).*
> > >  igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
> > >  igt@gem_wait@.*hang.*
> > >  igt@gem_write_read_ring_switch(@.*)?
> > > +igt@kms_frontbuffer_tracking@.*drrs*
> 
> I think we should start annotating those, so the reevaluation would be easier
> than 'git blame'-ing the file and going through each commit.
> 
> > >  ###############################################
> > >  # Broadcom
> > >  ###############################################
> > Hm a single skipped test should take about 100 ms, but I do notice we
> > probe all outputs in igt_display_init, so could this also be fixed by
> > https://patchwork.freedesktop.org/patch/212983/ ?
> >
> > This should reduce probing to the minimum.
> 
> Note the discussion around this patch:
> http://patchwork.freedesktop.org/patch/204944/
> 
> The idea was to start async probe during the boot, so we won't depend on
> the fbdev to do the initial probing.
> 
> But it seems that, after all, UNKNOWN is still a thing. I should have checked
> myself...
> 
> I've pulled the numbers for your change:
> 
>              CI_DRM_3978      IGTPW_1192
> shard-apl         12982s          12783s
> shard-hsw         11735s          11560s
> shard-snb          7033s           6906s
> shard-kbl          9843s           9048s
> 
Thanks for numbers Arek. 

However, my main motivation for doing this is to avoid increasing 18 minutes Jenkins timeout in bug: https://bugs.freedesktop.org/show_bug.cgi?id=105617

> Looks good.
> 
> Note: those are the combined runtimes, so the actual wall-clock time saving
> for our CI is less than that (because shading).
> 
> -Arek
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[Arkadiusz Hiler]

On Tue, Mar 27, 2018 at 11:21:49AM +0200, Maarten Lankhorst wrote:
> Op 27-03-18 om 11:15 schreef Arkadiusz Hiler:
> > On Mon, Mar 26, 2018 at 03:22:56PM +0200, Maarten Lankhorst wrote:
> >> Op 26-03-18 om 08:29 schreef Marta Lofstedt:
> >>> Skipping takes time, specifically for the big amount of drrs
> >>> related kms_frontbuffer_tracking tests. Since we currently
> >>> don't have any system set up with DRRS panels, blacklisting
> >>> all those test will save time, and we can avoid the need to
> >>> increase the Jenkins timeout in order to solve the Bugzilla
> >>> below.
> >>>
> >>> Bugzilla: https://bugs.freedesktop.org/show_bug.cgi?id=105617
> >>> Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
> >>> ---
> >>>  tests/intel-ci/blacklist.txt | 1 +
> >>>  1 file changed, 1 insertion(+)
> >>>
> >>> diff --git a/tests/intel-ci/blacklist.txt b/tests/intel-ci/blacklist.txt
> >>> index 7ca313ac..0a8506ca 100644
> >>> --- a/tests/intel-ci/blacklist.txt
> >>> +++ b/tests/intel-ci/blacklist.txt
> >>> @@ -57,6 +57,7 @@ igt@gem_tiled_swapping@(?!non-threaded).*
> >>>  igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
> >>>  igt@gem_wait@.*hang.*
> >>>  igt@gem_write_read_ring_switch(@.*)?
> >>> +igt@kms_frontbuffer_tracking@.*drrs*
> > I think we should start annotating those, so the reevaluation would be
> > easier than 'git blame'-ing the file and going through each commit.
> >
> >>>  ###############################################
> >>>  # Broadcom
> >>>  ###############################################
> >> Hm a single skipped test should take about 100 ms, but I do notice we
> >> probe all outputs in igt_display_init, so could this also be fixed by
> >> https://patchwork.freedesktop.org/patch/212983/ ?
> >>
> >> This should reduce probing to the minimum.
> > Note the discussion around this patch:
> > http://patchwork.freedesktop.org/patch/204944/
> >
> > The idea was to start async probe during the boot, so we won't depend on
> > the fbdev to do the initial probing.
> >
> > But it seems that, after all, UNKNOWN is still a thing. I should have
> > checked myself...
> >
> > I've pulled the numbers for your change:
> >
> >              CI_DRM_3978      IGTPW_1192
> > shard-apl         12982s          12783s
> > shard-hsw         11735s          11560s
> > shard-snb          7033s           6906s
> > shard-kbl          9843s           9048s
> >
> > Looks good.
> >
> > Note: those are the combined runtimes, so the actual wall-clock time
> > saving for our CI is less than that (because shading).
> >
> > -Arek
> 
> https://patchwork.freedesktop.org/patch/212983/ is a better version. :)

I am not claiming the opposite. The initial patch was just a hax to see
what are the savings and check wheter the test results get affected.

Then the discussion about UNKNOWN has started.

> But it's good to see it changing probing reduces runtimes on kbl. Now
> lets see what we can do to reduce runtime even further.

Yep, especially that the number above are for your, more clever, version.

Somewhere in the process I've also tested a patch that goes through
connectors and reprobes only if all of them are != DRM_MODE_CONNECTED.

I'll review your patch later today, let's continue the discussion there.

Cheers,
Arek
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[Arkadiusz Hiler]

On Tue, Mar 27, 2018 at 01:06:16PM +0300, Lofstedt, Marta wrote:
> > -----Original Message-----
> > From: Hiler, Arkadiusz
> > Sent: Tuesday, March 27, 2018 12:15 PM
> > To: Maarten Lankhorst <maarten.lankhorst@linux.intel.com>
> > Cc: Lofstedt, Marta <marta.lofstedt@intel.com>; igt-
> > dev@lists.freedesktop.org; Chris Wilson <chris@chris-wilson.co.uk>; Latvala,
> > Petri <petri.latvala@intel.com>; Daniel Vetter <daniel@ffwll.ch>
> > Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI
> > system
> > 
> > On Mon, Mar 26, 2018 at 03:22:56PM +0200, Maarten Lankhorst wrote:
> > > Op 26-03-18 om 08:29 schreef Marta Lofstedt:
> > > > Skipping takes time, specifically for the big amount of drrs related
> > > > kms_frontbuffer_tracking tests. Since we currently don't have any
> > > > system set up with DRRS panels, blacklisting all those test will
> > > > save time, and we can avoid the need to increase the Jenkins timeout
> > > > in order to solve the Bugzilla below.
> > > >
> > > > Bugzilla: https://bugs.freedesktop.org/show_bug.cgi?id=105617
> > > > Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
> > > > ---
> > > >  tests/intel-ci/blacklist.txt | 1 +
> > > >  1 file changed, 1 insertion(+)
> > > >
> > > > diff --git a/tests/intel-ci/blacklist.txt
> > > > b/tests/intel-ci/blacklist.txt index 7ca313ac..0a8506ca 100644
> > > > --- a/tests/intel-ci/blacklist.txt
> > > > +++ b/tests/intel-ci/blacklist.txt
> > > > @@ -57,6 +57,7 @@ igt@gem_tiled_swapping@(?!non-threaded).*
> > > >  igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
> > > >  igt@gem_wait@.*hang.*
> > > >  igt@gem_write_read_ring_switch(@.*)?
> > > > +igt@kms_frontbuffer_tracking@.*drrs*
> > 
> > I think we should start annotating those, so the reevaluation would be easier
> > than 'git blame'-ing the file and going through each commit.
> > 
> > > >  ###############################################
> > > >  # Broadcom
> > > >  ###############################################
> > > Hm a single skipped test should take about 100 ms, but I do notice we
> > > probe all outputs in igt_display_init, so could this also be fixed by
> > > https://patchwork.freedesktop.org/patch/212983/ ?
> > >
> > > This should reduce probing to the minimum.
> > 
> > Note the discussion around this patch:
> > http://patchwork.freedesktop.org/patch/204944/
> > 
> > The idea was to start async probe during the boot, so we won't depend on
> > the fbdev to do the initial probing.
> > 
> > But it seems that, after all, UNKNOWN is still a thing. I should have checked
> > myself...
> > 
> > I've pulled the numbers for your change:
> > 
> >              CI_DRM_3978      IGTPW_1192
> > shard-apl         12982s          12783s
> > shard-hsw         11735s          11560s
> > shard-snb          7033s           6906s
> > shard-kbl          9843s           9048s
> > 
> Thanks for numbers Arek. 
> 
> However, my main motivation for doing this is to avoid increasing 18
> minutes Jenkins timeout in bug:
> https://bugs.freedesktop.org/show_bug.cgi?id=105617

Even with Marteen's change the drrs tests take
570 * ~0.185s = ~100s to skip.

Also I think you've meant:
+igt@kms_frontbuffer_tracking@.*drrs.*
instead of:
+igt@kms_frontbuffer_tracking@.*drrs*

I am fine with getting the change in, for now.

Do you know when/if we will get drrs systems? What to do then?

Cheers,
Arek
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[Petri Latvala]

On Tue, Mar 27, 2018 at 01:50:10PM +0300, Arkadiusz Hiler wrote:
> On Tue, Mar 27, 2018 at 01:06:16PM +0300, Lofstedt, Marta wrote:
> > > -----Original Message-----
> > > From: Hiler, Arkadiusz
> > > Sent: Tuesday, March 27, 2018 12:15 PM
> > > To: Maarten Lankhorst <maarten.lankhorst@linux.intel.com>
> > > Cc: Lofstedt, Marta <marta.lofstedt@intel.com>; igt-
> > > dev@lists.freedesktop.org; Chris Wilson <chris@chris-wilson.co.uk>; Latvala,
> > > Petri <petri.latvala@intel.com>; Daniel Vetter <daniel@ffwll.ch>
> > > Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI
> > > system
> > > 
> > > On Mon, Mar 26, 2018 at 03:22:56PM +0200, Maarten Lankhorst wrote:
> > > > Op 26-03-18 om 08:29 schreef Marta Lofstedt:
> > > > > Skipping takes time, specifically for the big amount of drrs related
> > > > > kms_frontbuffer_tracking tests. Since we currently don't have any
> > > > > system set up with DRRS panels, blacklisting all those test will
> > > > > save time, and we can avoid the need to increase the Jenkins timeout
> > > > > in order to solve the Bugzilla below.
> > > > >
> > > > > Bugzilla: https://bugs.freedesktop.org/show_bug.cgi?id=105617
> > > > > Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
> > > > > ---
> > > > >  tests/intel-ci/blacklist.txt | 1 +
> > > > >  1 file changed, 1 insertion(+)
> > > > >
> > > > > diff --git a/tests/intel-ci/blacklist.txt
> > > > > b/tests/intel-ci/blacklist.txt index 7ca313ac..0a8506ca 100644
> > > > > --- a/tests/intel-ci/blacklist.txt
> > > > > +++ b/tests/intel-ci/blacklist.txt
> > > > > @@ -57,6 +57,7 @@ igt@gem_tiled_swapping@(?!non-threaded).*
> > > > >  igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
> > > > >  igt@gem_wait@.*hang.*
> > > > >  igt@gem_write_read_ring_switch(@.*)?
> > > > > +igt@kms_frontbuffer_tracking@.*drrs*
> > > 
> > > I think we should start annotating those, so the reevaluation would be easier
> > > than 'git blame'-ing the file and going through each commit.
> > > 
> > > > >  ###############################################
> > > > >  # Broadcom
> > > > >  ###############################################
> > > > Hm a single skipped test should take about 100 ms, but I do notice we
> > > > probe all outputs in igt_display_init, so could this also be fixed by
> > > > https://patchwork.freedesktop.org/patch/212983/ ?
> > > >
> > > > This should reduce probing to the minimum.
> > > 
> > > Note the discussion around this patch:
> > > http://patchwork.freedesktop.org/patch/204944/
> > > 
> > > The idea was to start async probe during the boot, so we won't depend on
> > > the fbdev to do the initial probing.
> > > 
> > > But it seems that, after all, UNKNOWN is still a thing. I should have checked
> > > myself...
> > > 
> > > I've pulled the numbers for your change:
> > > 
> > >              CI_DRM_3978      IGTPW_1192
> > > shard-apl         12982s          12783s
> > > shard-hsw         11735s          11560s
> > > shard-snb          7033s           6906s
> > > shard-kbl          9843s           9048s
> > > 
> > Thanks for numbers Arek. 
> > 
> > However, my main motivation for doing this is to avoid increasing 18
> > minutes Jenkins timeout in bug:
> > https://bugs.freedesktop.org/show_bug.cgi?id=105617
> 
> Even with Marteen's change the drrs tests take
> 570 * ~0.185s = ~100s to skip.
> 
> Also I think you've meant:
> +igt@kms_frontbuffer_tracking@.*drrs.*
> instead of:
> +igt@kms_frontbuffer_tracking@.*drrs*


Yep, this.



> 
> I am fine with getting the change in, for now.

I commented on IRC earlier, but let's put it in the mailing list also.

This patch needs:

1) Above typo fixed
2) Comment explaining why it's blacklisted
3) Acks from developers working on DRRS, to confirm they know CI won't
be testing their code.



-- 
Petri Latvala
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[Lofstedt, Marta]

> -----Original Message-----
> From: Latvala, Petri
> Sent: Tuesday, March 27, 2018 2:02 PM
> To: Hiler, Arkadiusz <arkadiusz.hiler@intel.com>
> Cc: Lofstedt, Marta <marta.lofstedt@intel.com>; Maarten Lankhorst
> <maarten.lankhorst@linux.intel.com>; igt-dev@lists.freedesktop.org; Chris
> Wilson <chris@chris-wilson.co.uk>; Daniel Vetter <daniel@ffwll.ch>
> Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI
> system
> 
> On Tue, Mar 27, 2018 at 01:50:10PM +0300, Arkadiusz Hiler wrote:
> > On Tue, Mar 27, 2018 at 01:06:16PM +0300, Lofstedt, Marta wrote:
> > > > -----Original Message-----
> > > > From: Hiler, Arkadiusz
> > > > Sent: Tuesday, March 27, 2018 12:15 PM
> > > > To: Maarten Lankhorst <maarten.lankhorst@linux.intel.com>
> > > > Cc: Lofstedt, Marta <marta.lofstedt@intel.com>; igt-
> > > > dev@lists.freedesktop.org; Chris Wilson
> > > > <chris@chris-wilson.co.uk>; Latvala, Petri
> > > > <petri.latvala@intel.com>; Daniel Vetter <daniel@ffwll.ch>
> > > > Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS
> > > > test on Intel CI system
> > > >
> > > > On Mon, Mar 26, 2018 at 03:22:56PM +0200, Maarten Lankhorst wrote:
> > > > > Op 26-03-18 om 08:29 schreef Marta Lofstedt:
> > > > > > Skipping takes time, specifically for the big amount of drrs
> > > > > > related kms_frontbuffer_tracking tests. Since we currently
> > > > > > don't have any system set up with DRRS panels, blacklisting
> > > > > > all those test will save time, and we can avoid the need to
> > > > > > increase the Jenkins timeout in order to solve the Bugzilla below.
> > > > > >
> > > > > > Bugzilla: https://bugs.freedesktop.org/show_bug.cgi?id=105617
> > > > > > Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
> > > > > > ---
> > > > > >  tests/intel-ci/blacklist.txt | 1 +
> > > > > >  1 file changed, 1 insertion(+)
> > > > > >
> > > > > > diff --git a/tests/intel-ci/blacklist.txt
> > > > > > b/tests/intel-ci/blacklist.txt index 7ca313ac..0a8506ca 100644
> > > > > > --- a/tests/intel-ci/blacklist.txt
> > > > > > +++ b/tests/intel-ci/blacklist.txt
> > > > > > @@ -57,6 +57,7 @@ igt@gem_tiled_swapping@(?!non-
> threaded).*
> > > > > >
> igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
> > > > > >  igt@gem_wait@.*hang.*
> > > > > >  igt@gem_write_read_ring_switch(@.*)?
> > > > > > +igt@kms_frontbuffer_tracking@.*drrs*
> > > >
> > > > I think we should start annotating those, so the reevaluation
> > > > would be easier than 'git blame'-ing the file and going through each
> commit.
> > > >
> > > > > >  ###############################################
> > > > > >  # Broadcom
> > > > > >  ###############################################
> > > > > Hm a single skipped test should take about 100 ms, but I do
> > > > > notice we probe all outputs in igt_display_init, so could this
> > > > > also be fixed by https://patchwork.freedesktop.org/patch/212983/ ?
> > > > >
> > > > > This should reduce probing to the minimum.
> > > >
> > > > Note the discussion around this patch:
> > > > http://patchwork.freedesktop.org/patch/204944/
> > > >
> > > > The idea was to start async probe during the boot, so we won't
> > > > depend on the fbdev to do the initial probing.
> > > >
> > > > But it seems that, after all, UNKNOWN is still a thing. I should
> > > > have checked myself...
> > > >
> > > > I've pulled the numbers for your change:
> > > >
> > > >              CI_DRM_3978      IGTPW_1192
> > > > shard-apl         12982s          12783s
> > > > shard-hsw         11735s          11560s
> > > > shard-snb          7033s           6906s
> > > > shard-kbl          9843s           9048s
> > > >
> > > Thanks for numbers Arek.
> > >
> > > However, my main motivation for doing this is to avoid increasing 18
> > > minutes Jenkins timeout in bug:
> > > https://bugs.freedesktop.org/show_bug.cgi?id=105617
> >
> > Even with Marteen's change the drrs tests take
> > 570 * ~0.185s = ~100s to skip.
> >
> > Also I think you've meant:
> > +igt@kms_frontbuffer_tracking@.*drrs.*
> > instead of:
> > +igt@kms_frontbuffer_tracking@.*drrs*
> 
> 
> Yep, this.
> 
> 
> 
> >
> > I am fine with getting the change in, for now.
> 
> I commented on IRC earlier, but let's put it in the mailing list also.
> 
> This patch needs:
> 
> 1) Above typo fixed
> 2) Comment explaining why it's blacklisted
> 3) Acks from developers working on DRRS, to confirm they know CI won't be
> testing their code.
Do we have Acks from all other developers that already have tests on the blacklist because they take too long to execute on our CI system?

> 
> 
> 
> --
> Petri Latvala
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[Saarinen, Jani]

> -----Original Message-----
> From: igt-dev [mailto:igt-dev-bounces@lists.freedesktop.org] On Behalf Of
> Lofstedt, Marta
> Sent: tiistai 27. maaliskuuta 2018 14.05
> To: Latvala, Petri <petri.latvala@intel.com>; Hiler, Arkadiusz
> <arkadiusz.hiler@intel.com>
> Cc: igt-dev@lists.freedesktop.org; Daniel Vetter <daniel@ffwll.ch>
> Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI
> system
> 
> 
> 
> > -----Original Message-----
> > From: Latvala, Petri
> > Sent: Tuesday, March 27, 2018 2:02 PM
> > To: Hiler, Arkadiusz <arkadiusz.hiler@intel.com>
> > Cc: Lofstedt, Marta <marta.lofstedt@intel.com>; Maarten Lankhorst
> > <maarten.lankhorst@linux.intel.com>; igt-dev@lists.freedesktop.org;
> > Chris Wilson <chris@chris-wilson.co.uk>; Daniel Vetter
> > <daniel@ffwll.ch>
> > Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on
> > Intel CI system
> >
> > On Tue, Mar 27, 2018 at 01:50:10PM +0300, Arkadiusz Hiler wrote:
> > > On Tue, Mar 27, 2018 at 01:06:16PM +0300, Lofstedt, Marta wrote:
> > > > > -----Original Message-----
> > > > > From: Hiler, Arkadiusz
> > > > > Sent: Tuesday, March 27, 2018 12:15 PM
> > > > > To: Maarten Lankhorst <maarten.lankhorst@linux.intel.com>
> > > > > Cc: Lofstedt, Marta <marta.lofstedt@intel.com>; igt-
> > > > > dev@lists.freedesktop.org; Chris Wilson
> > > > > <chris@chris-wilson.co.uk>; Latvala, Petri
> > > > > <petri.latvala@intel.com>; Daniel Vetter <daniel@ffwll.ch>
> > > > > Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS
> > > > > test on Intel CI system
> > > > >
> > > > > On Mon, Mar 26, 2018 at 03:22:56PM +0200, Maarten Lankhorst wrote:
> > > > > > Op 26-03-18 om 08:29 schreef Marta Lofstedt:
> > > > > > > Skipping takes time, specifically for the big amount of drrs
> > > > > > > related kms_frontbuffer_tracking tests. Since we currently
> > > > > > > don't have any system set up with DRRS panels, blacklisting
> > > > > > > all those test will save time, and we can avoid the need to
> > > > > > > increase the Jenkins timeout in order to solve the Bugzilla below.
> > > > > > >
> > > > > > > Bugzilla:
> > > > > > > https://bugs.freedesktop.org/show_bug.cgi?id=105617
> > > > > > > Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
> > > > > > > ---
> > > > > > >  tests/intel-ci/blacklist.txt | 1 +
> > > > > > >  1 file changed, 1 insertion(+)
> > > > > > >
> > > > > > > diff --git a/tests/intel-ci/blacklist.txt
> > > > > > > b/tests/intel-ci/blacklist.txt index 7ca313ac..0a8506ca
> > > > > > > 100644
> > > > > > > --- a/tests/intel-ci/blacklist.txt
> > > > > > > +++ b/tests/intel-ci/blacklist.txt
> > > > > > > @@ -57,6 +57,7 @@ igt@gem_tiled_swapping@(?!non-
> > threaded).*
> > > > > > >
> > igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
> > > > > > >  igt@gem_wait@.*hang.*
> > > > > > >  igt@gem_write_read_ring_switch(@.*)?
> > > > > > > +igt@kms_frontbuffer_tracking@.*drrs*
> > > > >
> > > > > I think we should start annotating those, so the reevaluation
> > > > > would be easier than 'git blame'-ing the file and going through
> > > > > each
> > commit.
> > > > >
> > > > > > >  ###############################################
> > > > > > >  # Broadcom
> > > > > > >  ###############################################
> > > > > > Hm a single skipped test should take about 100 ms, but I do
> > > > > > notice we probe all outputs in igt_display_init, so could this
> > > > > > also be fixed by https://patchwork.freedesktop.org/patch/212983/ ?
> > > > > >
> > > > > > This should reduce probing to the minimum.
> > > > >
> > > > > Note the discussion around this patch:
> > > > > http://patchwork.freedesktop.org/patch/204944/
> > > > >
> > > > > The idea was to start async probe during the boot, so we won't
> > > > > depend on the fbdev to do the initial probing.
> > > > >
> > > > > But it seems that, after all, UNKNOWN is still a thing. I should
> > > > > have checked myself...
> > > > >
> > > > > I've pulled the numbers for your change:
> > > > >
> > > > >              CI_DRM_3978      IGTPW_1192
> > > > > shard-apl         12982s          12783s
> > > > > shard-hsw         11735s          11560s
> > > > > shard-snb          7033s           6906s
> > > > > shard-kbl          9843s           9048s
> > > > >
> > > > Thanks for numbers Arek.
> > > >
> > > > However, my main motivation for doing this is to avoid increasing
> > > > 18 minutes Jenkins timeout in bug:
> > > > https://bugs.freedesktop.org/show_bug.cgi?id=105617
> > >
> > > Even with Marteen's change the drrs tests take
> > > 570 * ~0.185s = ~100s to skip.
> > >
> > > Also I think you've meant:
> > > +igt@kms_frontbuffer_tracking@.*drrs.*
> > > instead of:
> > > +igt@kms_frontbuffer_tracking@.*drrs*
> >
> >
> > Yep, this.
> >
> >
> >
> > >
> > > I am fine with getting the change in, for now.
> >
> > I commented on IRC earlier, but let's put it in the mailing list also.
> >
> > This patch needs:
> >
> > 1) Above typo fixed
> > 2) Comment explaining why it's blacklisted
> > 3) Acks from developers working on DRRS, to confirm they know CI won't
> > be testing their code.
> Do we have Acks from all other developers that already have tests on the
> blacklist because they take too long to execute on our CI system?
+ Lohith to comment.
> 
> >
> >
> >
> > --
> > Petri Latvala

_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[Petri Latvala]

On Tue, Mar 27, 2018 at 02:05:28PM +0300, Lofstedt, Marta wrote:
> 
> 
> > -----Original Message-----
> > From: Latvala, Petri
> > Sent: Tuesday, March 27, 2018 2:02 PM
> > To: Hiler, Arkadiusz <arkadiusz.hiler@intel.com>
> > Cc: Lofstedt, Marta <marta.lofstedt@intel.com>; Maarten Lankhorst
> > <maarten.lankhorst@linux.intel.com>; igt-dev@lists.freedesktop.org; Chris
> > Wilson <chris@chris-wilson.co.uk>; Daniel Vetter <daniel@ffwll.ch>
> > Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI
> > system
> > 
> > On Tue, Mar 27, 2018 at 01:50:10PM +0300, Arkadiusz Hiler wrote:
> > > On Tue, Mar 27, 2018 at 01:06:16PM +0300, Lofstedt, Marta wrote:
> > > > > -----Original Message-----
> > > > > From: Hiler, Arkadiusz
> > > > > Sent: Tuesday, March 27, 2018 12:15 PM
> > > > > To: Maarten Lankhorst <maarten.lankhorst@linux.intel.com>
> > > > > Cc: Lofstedt, Marta <marta.lofstedt@intel.com>; igt-
> > > > > dev@lists.freedesktop.org; Chris Wilson
> > > > > <chris@chris-wilson.co.uk>; Latvala, Petri
> > > > > <petri.latvala@intel.com>; Daniel Vetter <daniel@ffwll.ch>
> > > > > Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS
> > > > > test on Intel CI system
> > > > >
> > > > > On Mon, Mar 26, 2018 at 03:22:56PM +0200, Maarten Lankhorst wrote:
> > > > > > Op 26-03-18 om 08:29 schreef Marta Lofstedt:
> > > > > > > Skipping takes time, specifically for the big amount of drrs
> > > > > > > related kms_frontbuffer_tracking tests. Since we currently
> > > > > > > don't have any system set up with DRRS panels, blacklisting
> > > > > > > all those test will save time, and we can avoid the need to
> > > > > > > increase the Jenkins timeout in order to solve the Bugzilla below.
> > > > > > >
> > > > > > > Bugzilla: https://bugs.freedesktop.org/show_bug.cgi?id=105617
> > > > > > > Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
> > > > > > > ---
> > > > > > >  tests/intel-ci/blacklist.txt | 1 +
> > > > > > >  1 file changed, 1 insertion(+)
> > > > > > >
> > > > > > > diff --git a/tests/intel-ci/blacklist.txt
> > > > > > > b/tests/intel-ci/blacklist.txt index 7ca313ac..0a8506ca 100644
> > > > > > > --- a/tests/intel-ci/blacklist.txt
> > > > > > > +++ b/tests/intel-ci/blacklist.txt
> > > > > > > @@ -57,6 +57,7 @@ igt@gem_tiled_swapping@(?!non-
> > threaded).*
> > > > > > >
> > igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
> > > > > > >  igt@gem_wait@.*hang.*
> > > > > > >  igt@gem_write_read_ring_switch(@.*)?
> > > > > > > +igt@kms_frontbuffer_tracking@.*drrs*
> > > > >
> > > > > I think we should start annotating those, so the reevaluation
> > > > > would be easier than 'git blame'-ing the file and going through each
> > commit.
> > > > >
> > > > > > >  ###############################################
> > > > > > >  # Broadcom
> > > > > > >  ###############################################
> > > > > > Hm a single skipped test should take about 100 ms, but I do
> > > > > > notice we probe all outputs in igt_display_init, so could this
> > > > > > also be fixed by https://patchwork.freedesktop.org/patch/212983/ ?
> > > > > >
> > > > > > This should reduce probing to the minimum.
> > > > >
> > > > > Note the discussion around this patch:
> > > > > http://patchwork.freedesktop.org/patch/204944/
> > > > >
> > > > > The idea was to start async probe during the boot, so we won't
> > > > > depend on the fbdev to do the initial probing.
> > > > >
> > > > > But it seems that, after all, UNKNOWN is still a thing. I should
> > > > > have checked myself...
> > > > >
> > > > > I've pulled the numbers for your change:
> > > > >
> > > > >              CI_DRM_3978      IGTPW_1192
> > > > > shard-apl         12982s          12783s
> > > > > shard-hsw         11735s          11560s
> > > > > shard-snb          7033s           6906s
> > > > > shard-kbl          9843s           9048s
> > > > >
> > > > Thanks for numbers Arek.
> > > >
> > > > However, my main motivation for doing this is to avoid increasing 18
> > > > minutes Jenkins timeout in bug:
> > > > https://bugs.freedesktop.org/show_bug.cgi?id=105617
> > >
> > > Even with Marteen's change the drrs tests take
> > > 570 * ~0.185s = ~100s to skip.
> > >
> > > Also I think you've meant:
> > > +igt@kms_frontbuffer_tracking@.*drrs.*
> > > instead of:
> > > +igt@kms_frontbuffer_tracking@.*drrs*
> > 
> > 
> > Yep, this.
> > 
> > 
> > 
> > >
> > > I am fine with getting the change in, for now.
> > 
> > I commented on IRC earlier, but let's put it in the mailing list also.
> > 
> > This patch needs:
> > 
> > 1) Above typo fixed
> > 2) Comment explaining why it's blacklisted
> > 3) Acks from developers working on DRRS, to confirm they know CI won't be
> > testing their code.
> Do we have Acks from all other developers that already have tests on the blacklist because they take too long to execute on our CI system?


We got the original blacklist of GEM tests from the GEM team.



-- 
Petri Latvala



> 
> > 
> > 
> > 
> > --
> > Petri Latvala
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[Lofstedt, Marta]

> -----Original Message-----
> From: Latvala, Petri
> Sent: Tuesday, March 27, 2018 2:38 PM
> To: Lofstedt, Marta <marta.lofstedt@intel.com>
> Cc: Hiler, Arkadiusz <arkadiusz.hiler@intel.com>; Maarten Lankhorst
> <maarten.lankhorst@linux.intel.com>; igt-dev@lists.freedesktop.org; Chris
> Wilson <chris@chris-wilson.co.uk>; Daniel Vetter <daniel@ffwll.ch>
> Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI
> system
> 
> On Tue, Mar 27, 2018 at 02:05:28PM +0300, Lofstedt, Marta wrote:
> >
> >
> > > -----Original Message-----
> > > From: Latvala, Petri
> > > Sent: Tuesday, March 27, 2018 2:02 PM
> > > To: Hiler, Arkadiusz <arkadiusz.hiler@intel.com>
> > > Cc: Lofstedt, Marta <marta.lofstedt@intel.com>; Maarten Lankhorst
> > > <maarten.lankhorst@linux.intel.com>; igt-dev@lists.freedesktop.org;
> > > Chris Wilson <chris@chris-wilson.co.uk>; Daniel Vetter
> > > <daniel@ffwll.ch>
> > > Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test
> > > on Intel CI system
> > >
> > > On Tue, Mar 27, 2018 at 01:50:10PM +0300, Arkadiusz Hiler wrote:
> > > > On Tue, Mar 27, 2018 at 01:06:16PM +0300, Lofstedt, Marta wrote:
> > > > > > -----Original Message-----
> > > > > > From: Hiler, Arkadiusz
> > > > > > Sent: Tuesday, March 27, 2018 12:15 PM
> > > > > > To: Maarten Lankhorst <maarten.lankhorst@linux.intel.com>
> > > > > > Cc: Lofstedt, Marta <marta.lofstedt@intel.com>; igt-
> > > > > > dev@lists.freedesktop.org; Chris Wilson
> > > > > > <chris@chris-wilson.co.uk>; Latvala, Petri
> > > > > > <petri.latvala@intel.com>; Daniel Vetter <daniel@ffwll.ch>
> > > > > > Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS
> > > > > > test on Intel CI system
> > > > > >
> > > > > > On Mon, Mar 26, 2018 at 03:22:56PM +0200, Maarten Lankhorst
> wrote:
> > > > > > > Op 26-03-18 om 08:29 schreef Marta Lofstedt:
> > > > > > > > Skipping takes time, specifically for the big amount of
> > > > > > > > drrs related kms_frontbuffer_tracking tests. Since we
> > > > > > > > currently don't have any system set up with DRRS panels,
> > > > > > > > blacklisting all those test will save time, and we can
> > > > > > > > avoid the need to increase the Jenkins timeout in order to solve
> the Bugzilla below.
> > > > > > > >
> > > > > > > > Bugzilla:
> > > > > > > > https://bugs.freedesktop.org/show_bug.cgi?id=105617
> > > > > > > > Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
> > > > > > > > ---
> > > > > > > >  tests/intel-ci/blacklist.txt | 1 +
> > > > > > > >  1 file changed, 1 insertion(+)
> > > > > > > >
> > > > > > > > diff --git a/tests/intel-ci/blacklist.txt
> > > > > > > > b/tests/intel-ci/blacklist.txt index 7ca313ac..0a8506ca
> > > > > > > > 100644
> > > > > > > > --- a/tests/intel-ci/blacklist.txt
> > > > > > > > +++ b/tests/intel-ci/blacklist.txt
> > > > > > > > @@ -57,6 +57,7 @@ igt@gem_tiled_swapping@(?!non-
> > > threaded).*
> > > > > > > >
> > > igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
> > > > > > > >  igt@gem_wait@.*hang.*
> > > > > > > >  igt@gem_write_read_ring_switch(@.*)?
> > > > > > > > +igt@kms_frontbuffer_tracking@.*drrs*
> > > > > >
> > > > > > I think we should start annotating those, so the reevaluation
> > > > > > would be easier than 'git blame'-ing the file and going
> > > > > > through each
> > > commit.
> > > > > >
> > > > > > > >  ###############################################
> > > > > > > >  # Broadcom
> > > > > > > >  ###############################################
> > > > > > > Hm a single skipped test should take about 100 ms, but I do
> > > > > > > notice we probe all outputs in igt_display_init, so could
> > > > > > > this also be fixed by
> https://patchwork.freedesktop.org/patch/212983/ ?
> > > > > > >
> > > > > > > This should reduce probing to the minimum.
> > > > > >
> > > > > > Note the discussion around this patch:
> > > > > > http://patchwork.freedesktop.org/patch/204944/
> > > > > >
> > > > > > The idea was to start async probe during the boot, so we won't
> > > > > > depend on the fbdev to do the initial probing.
> > > > > >
> > > > > > But it seems that, after all, UNKNOWN is still a thing. I
> > > > > > should have checked myself...
> > > > > >
> > > > > > I've pulled the numbers for your change:
> > > > > >
> > > > > >              CI_DRM_3978      IGTPW_1192
> > > > > > shard-apl         12982s          12783s
> > > > > > shard-hsw         11735s          11560s
> > > > > > shard-snb          7033s           6906s
> > > > > > shard-kbl          9843s           9048s
> > > > > >
> > > > > Thanks for numbers Arek.
> > > > >
> > > > > However, my main motivation for doing this is to avoid
> > > > > increasing 18 minutes Jenkins timeout in bug:
> > > > > https://bugs.freedesktop.org/show_bug.cgi?id=105617
> > > >
> > > > Even with Marteen's change the drrs tests take
> > > > 570 * ~0.185s = ~100s to skip.
> > > >
> > > > Also I think you've meant:
> > > > +igt@kms_frontbuffer_tracking@.*drrs.*
> > > > instead of:
> > > > +igt@kms_frontbuffer_tracking@.*drrs*
> > >
> > >
> > > Yep, this.
> > >
> > >
> > >
> > > >
> > > > I am fine with getting the change in, for now.
> > >
> > > I commented on IRC earlier, but let's put it in the mailing list also.
> > >
> > > This patch needs:
> > >
> > > 1) Above typo fixed
> > > 2) Comment explaining why it's blacklisted
> > > 3) Acks from developers working on DRRS, to confirm they know CI
> > > won't be testing their code.
> > Do we have Acks from all other developers that already have tests on the
> blacklist because they take too long to execute on our CI system?
> 
> 
> We got the original blacklist of GEM tests from the GEM team.

Doesn't cover hibernation

> 
> 
> 
> --
> Petri Latvala
> 
> 
> 
> >
> > >
> > >
> > >
> > > --
> > > Petri Latvala
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI system

[Bs, Lohith]

On 3/27/2018 5:05 PM, Saarinen, Jani wrote:
>
>> -----Original Message-----
>> From: igt-dev [mailto:igt-dev-bounces@lists.freedesktop.org] On Behalf Of
>> Lofstedt, Marta
>> Sent: tiistai 27. maaliskuuta 2018 14.05
>> To: Latvala, Petri <petri.latvala@intel.com>; Hiler, Arkadiusz
>> <arkadiusz.hiler@intel.com>
>> Cc: igt-dev@lists.freedesktop.org; Daniel Vetter <daniel@ffwll.ch>
>> Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on Intel CI
>> system
>>
>>
>>
>>> -----Original Message-----
>>> From: Latvala, Petri
>>> Sent: Tuesday, March 27, 2018 2:02 PM
>>> To: Hiler, Arkadiusz <arkadiusz.hiler@intel.com>
>>> Cc: Lofstedt, Marta <marta.lofstedt@intel.com>; Maarten Lankhorst
>>> <maarten.lankhorst@linux.intel.com>; igt-dev@lists.freedesktop.org;
>>> Chris Wilson <chris@chris-wilson.co.uk>; Daniel Vetter
>>> <daniel@ffwll.ch>
>>> Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS test on
>>> Intel CI system
>>>
>>> On Tue, Mar 27, 2018 at 01:50:10PM +0300, Arkadiusz Hiler wrote:
>>>> On Tue, Mar 27, 2018 at 01:06:16PM +0300, Lofstedt, Marta wrote:
>>>>>> -----Original Message-----
>>>>>> From: Hiler, Arkadiusz
>>>>>> Sent: Tuesday, March 27, 2018 12:15 PM
>>>>>> To: Maarten Lankhorst <maarten.lankhorst@linux.intel.com>
>>>>>> Cc: Lofstedt, Marta <marta.lofstedt@intel.com>; igt-
>>>>>> dev@lists.freedesktop.org; Chris Wilson
>>>>>> <chris@chris-wilson.co.uk>; Latvala, Petri
>>>>>> <petri.latvala@intel.com>; Daniel Vetter <daniel@ffwll.ch>
>>>>>> Subject: Re: [igt-dev] [PATCH i-g-t] blacklist: Don't run DRRS
>>>>>> test on Intel CI system
>>>>>>
>>>>>> On Mon, Mar 26, 2018 at 03:22:56PM +0200, Maarten Lankhorst wrote:
>>>>>>> Op 26-03-18 om 08:29 schreef Marta Lofstedt:
>>>>>>>> Skipping takes time, specifically for the big amount of drrs
>>>>>>>> related kms_frontbuffer_tracking tests. Since we currently
>>>>>>>> don't have any system set up with DRRS panels, blacklisting
>>>>>>>> all those test will save time, and we can avoid the need to
>>>>>>>> increase the Jenkins timeout in order to solve the Bugzilla below.
>>>>>>>>
>>>>>>>> Bugzilla:
>>>>>>>> https://bugs.freedesktop.org/show_bug.cgi?id=105617
>>>>>>>> Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
>>>>>>>> ---
>>>>>>>>   tests/intel-ci/blacklist.txt | 1 +
>>>>>>>>   1 file changed, 1 insertion(+)
>>>>>>>>
>>>>>>>> diff --git a/tests/intel-ci/blacklist.txt
>>>>>>>> b/tests/intel-ci/blacklist.txt index 7ca313ac..0a8506ca
>>>>>>>> 100644
>>>>>>>> --- a/tests/intel-ci/blacklist.txt
>>>>>>>> +++ b/tests/intel-ci/blacklist.txt
>>>>>>>> @@ -57,6 +57,7 @@ igt@gem_tiled_swapping@(?!non-
>>> threaded).*
>>> igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
>>>>>>>>   igt@gem_wait@.*hang.*
>>>>>>>>   igt@gem_write_read_ring_switch(@.*)?
>>>>>>>> +igt@kms_frontbuffer_tracking@.*drrs*
>>>>>> I think we should start annotating those, so the reevaluation
>>>>>> would be easier than 'git blame'-ing the file and going through
>>>>>> each
>>> commit.
>>>>>>>>   ###############################################
>>>>>>>>   # Broadcom
>>>>>>>>   ###############################################
>>>>>>> Hm a single skipped test should take about 100 ms, but I do
>>>>>>> notice we probe all outputs in igt_display_init, so could this
>>>>>>> also be fixed by https://patchwork.freedesktop.org/patch/212983/ ?
>>>>>>>
>>>>>>> This should reduce probing to the minimum.
>>>>>> Note the discussion around this patch:
>>>>>> http://patchwork.freedesktop.org/patch/204944/
>>>>>>
>>>>>> The idea was to start async probe during the boot, so we won't
>>>>>> depend on the fbdev to do the initial probing.
>>>>>>
>>>>>> But it seems that, after all, UNKNOWN is still a thing. I should
>>>>>> have checked myself...
>>>>>>
>>>>>> I've pulled the numbers for your change:
>>>>>>
>>>>>>               CI_DRM_3978      IGTPW_1192
>>>>>> shard-apl         12982s          12783s
>>>>>> shard-hsw         11735s          11560s
>>>>>> shard-snb          7033s           6906s
>>>>>> shard-kbl          9843s           9048s
>>>>>>
>>>>> Thanks for numbers Arek.
>>>>>
>>>>> However, my main motivation for doing this is to avoid increasing
>>>>> 18 minutes Jenkins timeout in bug:
>>>>> https://bugs.freedesktop.org/show_bug.cgi?id=105617
>>>> Even with Marteen's change the drrs tests take
>>>> 570 * ~0.185s = ~100s to skip.
>>>>
>>>> Also I think you've meant:
>>>> +igt@kms_frontbuffer_tracking@.*drrs.*
>>>> instead of:
>>>> +igt@kms_frontbuffer_tracking@.*drrs*
>>>
>>> Yep, this.
>>>
>>>
>>>
>>>> I am fine with getting the change in, for now.
>>> I commented on IRC earlier, but let's put it in the mailing list also.
>>>
>>> This patch needs:
>>>
>>> 1) Above typo fixed
>>> 2) Comment explaining why it's blacklisted
>>> 3) Acks from developers working on DRRS, to confirm they know CI won't
>>> be testing their code.
>> Do we have Acks from all other developers that already have tests on the
>> blacklist because they take too long to execute on our CI system?
> + Lohith to comment.
Hi Jani,
We accept to blacklist 570 DRRS subtests under kms_frontbuffer_tracking 
as we don't
have DRRS supported panel.

I tried to check the time it takes for running 570 DRRS subtests on GLK 
silicon having
non-DRRS edp panel + HDMI. It took "2m 13.834s".
>>>
>>>
>>> --
>>> Petri Latvala

_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

[PATCH i-g-t v2] blacklist: Don't run DRRS test on Intel CI system

[Marta Lofstedt]

Skipping takes time, specifically for the big amount of drrs
related kms_frontbuffer_tracking tests. Since we currently
don't have any system set up with DRRS panels, blacklisting
all those test will save time, and we can avoid the need to
increase the Jenkins timeout in order to solve the Bugzilla
below.

V2: Changed typo and added comment.

Bugzilla: https://bugs.freedesktop.org/show_bug.cgi?id=105617
Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
---
 tests/intel-ci/blacklist.txt | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/tests/intel-ci/blacklist.txt b/tests/intel-ci/blacklist.txt
index 7ca313ac..ef3b45e9 100644
--- a/tests/intel-ci/blacklist.txt
+++ b/tests/intel-ci/blacklist.txt
@@ -58,6 +58,10 @@ igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
 igt@gem_wait@.*hang.*
 igt@gem_write_read_ring_switch(@.*)?
 ###############################################
+# There are no DRRS capable displays in CI lab
+###############################################
+igt@kms_frontbuffer_tracking@.*drrs.*
+###############################################
 # Broadcom
 ###############################################
 igt@vc4_.*
-- 
2.11.0

_______________________________________________
Intel-gfx mailing list
Intel-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/intel-gfx

✓ Fi.CI.BAT: success for blacklist: Don't run DRRS test on Intel CI system

[Patchwork]

== Series Details ==

Series: blacklist: Don't run DRRS test on Intel CI system
URL   : https://patchwork.freedesktop.org/series/40871/
State : success

== Summary ==

IGT patchset tested on top of latest successful build
2cbd4ddf11b3eaf01f33d8bc2ad46411ec6c299a lib/igt_kms: Improve connector probing in igt_display_init(), v2.

with latest DRM-Tip kernel build CI_DRM_4007
d6e43ca115e5 drm-tip: 2018y-03m-29d-12h-46m-03s UTC integration manifest

No testlist changes.

---- Known issues:

Test kms_pipe_crc_basic:
        Subgroup read-crc-pipe-b-frame-sequence:
                fail       -> PASS       (fi-cfl-s3) fdo#103481

fdo#103481 https://bugs.freedesktop.org/show_bug.cgi?id=103481

fi-bdw-5557u     total:285  pass:264  dwarn:0   dfail:0   fail:0   skip:21  time:433s
fi-bdw-gvtdvm    total:285  pass:261  dwarn:0   dfail:0   fail:0   skip:24  time:441s
fi-blb-e6850     total:285  pass:220  dwarn:1   dfail:0   fail:0   skip:64  time:383s
fi-bsw-n3050     total:285  pass:239  dwarn:0   dfail:0   fail:0   skip:46  time:536s
fi-bwr-2160      total:285  pass:180  dwarn:0   dfail:0   fail:0   skip:105 time:296s
fi-bxt-dsi       total:285  pass:255  dwarn:0   dfail:0   fail:0   skip:30  time:515s
fi-bxt-j4205     total:285  pass:256  dwarn:0   dfail:0   fail:0   skip:29  time:514s
fi-byt-j1900     total:285  pass:250  dwarn:0   dfail:0   fail:0   skip:35  time:527s
fi-byt-n2820     total:285  pass:246  dwarn:0   dfail:0   fail:0   skip:39  time:511s
fi-cfl-8700k     total:285  pass:257  dwarn:0   dfail:0   fail:0   skip:28  time:410s
fi-cfl-s3        total:285  pass:259  dwarn:0   dfail:0   fail:0   skip:26  time:560s
fi-cfl-u         total:285  pass:259  dwarn:0   dfail:0   fail:0   skip:26  time:519s
fi-cnl-y3        total:285  pass:259  dwarn:0   dfail:0   fail:0   skip:26  time:585s
fi-elk-e7500     total:285  pass:225  dwarn:1   dfail:0   fail:0   skip:59  time:423s
fi-gdg-551       total:285  pass:176  dwarn:0   dfail:0   fail:1   skip:108 time:315s
fi-glk-1         total:285  pass:257  dwarn:0   dfail:0   fail:0   skip:28  time:538s
fi-hsw-4770      total:285  pass:258  dwarn:0   dfail:0   fail:0   skip:27  time:404s
fi-ilk-650       total:285  pass:225  dwarn:0   dfail:0   fail:0   skip:60  time:422s
fi-ivb-3520m     total:285  pass:256  dwarn:0   dfail:0   fail:0   skip:29  time:470s
fi-ivb-3770      total:285  pass:252  dwarn:0   dfail:0   fail:0   skip:33  time:432s
fi-kbl-7500u     total:285  pass:260  dwarn:1   dfail:0   fail:0   skip:24  time:469s
fi-kbl-7567u     total:285  pass:265  dwarn:0   dfail:0   fail:0   skip:20  time:464s
fi-kbl-r         total:285  pass:258  dwarn:0   dfail:0   fail:0   skip:27  time:512s
fi-pnv-d510      total:285  pass:219  dwarn:1   dfail:0   fail:0   skip:65  time:668s
fi-skl-6260u     total:285  pass:265  dwarn:0   dfail:0   fail:0   skip:20  time:441s
fi-skl-6600u     total:285  pass:258  dwarn:0   dfail:0   fail:0   skip:27  time:531s
fi-skl-6700k2    total:285  pass:261  dwarn:0   dfail:0   fail:0   skip:24  time:508s
fi-skl-6770hq    total:285  pass:265  dwarn:0   dfail:0   fail:0   skip:20  time:504s
fi-skl-guc       total:285  pass:257  dwarn:0   dfail:0   fail:0   skip:28  time:430s
fi-skl-gvtdvm    total:285  pass:262  dwarn:0   dfail:0   fail:0   skip:23  time:445s
fi-snb-2600      total:285  pass:245  dwarn:0   dfail:0   fail:0   skip:40  time:399s
Blacklisted hosts:
fi-cnl-psr       total:285  pass:256  dwarn:3   dfail:0   fail:0   skip:26  time:526s
fi-glk-j4005     total:285  pass:256  dwarn:0   dfail:0   fail:0   skip:29  time:493s

== Logs ==

For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1207/issues.html
_______________________________________________
Intel-gfx mailing list
Intel-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/intel-gfx

✗ Fi.CI.IGT: failure for blacklist: Don't run DRRS test on Intel CI system

[Patchwork]

== Series Details ==

Series: blacklist: Don't run DRRS test on Intel CI system
URL   : https://patchwork.freedesktop.org/series/40871/
State : failure

== Summary ==

---- Possible new issues:

Test kms_frontbuffer_tracking:
        Subgroup fbc-1p-primscrn-cur-indfb-draw-render:
                pass       -> FAIL       (shard-apl)

---- Known issues:

Test kms_flip:
        Subgroup plain-flip-fb-recreate:
                pass       -> FAIL       (shard-hsw) fdo#100368
Test kms_frontbuffer_tracking:
        Subgroup fbc-1p-primscrn-indfb-msflip-blt:
                pass       -> SKIP       (shard-snb) fdo#103167
Test kms_pipe_crc_basic:
        Subgroup suspend-read-crc-pipe-a:
                incomplete -> PASS       (shard-hsw) fdo#103375

fdo#100368 https://bugs.freedesktop.org/show_bug.cgi?id=100368
fdo#103167 https://bugs.freedesktop.org/show_bug.cgi?id=103167
fdo#103375 https://bugs.freedesktop.org/show_bug.cgi?id=103375

shard-apl        total:2925 pass:1830 dwarn:1   dfail:0   fail:8   skip:1085 time:12739s
shard-hsw        total:2925 pass:1782 dwarn:1   dfail:0   fail:2   skip:1139 time:11535s
shard-snb        total:2925 pass:1373 dwarn:1   dfail:0   fail:3   skip:1548 time:6876s
Blacklisted hosts:
shard-kbl        total:2925 pass:1952 dwarn:8   dfail:0   fail:7   skip:958 time:9166s

== Logs ==

For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1207/shards.html
_______________________________________________
Intel-gfx mailing list
Intel-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/intel-gfx

[igt-dev] [PATCH i-g-t v2] blacklist: Don't run DRRS test on Intel CI system

[Marta Lofstedt]

Skipping takes time, specifically for the big amount of drrs
related kms_frontbuffer_tracking tests. Since we currently
don't have any system set up with DRRS panels, blacklisting
all those test will save time, and we can avoid the need to
increase the Jenkins timeout in order to solve the Bugzilla
below.

V2: Changed typo and added comment.

Bugzilla: https://bugs.freedesktop.org/show_bug.cgi?id=105617
Signed-off-by: Marta Lofstedt <marta.lofstedt@intel.com>
---
 tests/intel-ci/blacklist.txt | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/tests/intel-ci/blacklist.txt b/tests/intel-ci/blacklist.txt
index 7ca313ac..ef3b45e9 100644
--- a/tests/intel-ci/blacklist.txt
+++ b/tests/intel-ci/blacklist.txt
@@ -58,6 +58,10 @@ igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
 igt@gem_wait@.*hang.*
 igt@gem_write_read_ring_switch(@.*)?
 ###############################################
+# There are no DRRS capable displays in CI lab
+###############################################
+igt@kms_frontbuffer_tracking@.*drrs.*
+###############################################
 # Broadcom
 ###############################################
 igt@vc4_.*
-- 
2.11.0

_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

[igt-dev] ✓ Fi.CI.BAT: success for blacklist: Don't run DRRS test on Intel CI system (rev2)

[Patchwork]

== Series Details ==

Series: blacklist: Don't run DRRS test on Intel CI system (rev2)
URL   : https://patchwork.freedesktop.org/series/40646/
State : success

== Summary ==

IGT patchset tested on top of latest successful build
da00bf83aba3b516922efa1f338381189461aa4a tests/kms_plane_scaling: fb height to be min 16 for NV12

with latest DRM-Tip kernel build CI_DRM_4013
c46052cde6a5 drm-tip: 2018y-03m-30d-18h-56m-26s UTC integration manifest

No testlist changes.

---- Known issues:

Test kms_flip:
        Subgroup basic-flip-vs-wf_vblank:
                pass       -> FAIL       (fi-skl-6770hq) fdo#100368

fdo#100368 https://bugs.freedesktop.org/show_bug.cgi?id=100368

fi-bdw-5557u     total:285  pass:264  dwarn:0   dfail:0   fail:0   skip:21  time:432s
fi-bdw-gvtdvm    total:285  pass:261  dwarn:0   dfail:0   fail:0   skip:24  time:441s
fi-blb-e6850     total:285  pass:220  dwarn:1   dfail:0   fail:0   skip:64  time:383s
fi-bsw-n3050     total:285  pass:239  dwarn:0   dfail:0   fail:0   skip:46  time:533s
fi-bwr-2160      total:285  pass:180  dwarn:0   dfail:0   fail:0   skip:105 time:296s
fi-bxt-dsi       total:285  pass:255  dwarn:0   dfail:0   fail:0   skip:30  time:517s
fi-bxt-j4205     total:285  pass:256  dwarn:0   dfail:0   fail:0   skip:29  time:515s
fi-byt-j1900     total:285  pass:250  dwarn:0   dfail:0   fail:0   skip:35  time:522s
fi-byt-n2820     total:285  pass:246  dwarn:0   dfail:0   fail:0   skip:39  time:510s
fi-cfl-8700k     total:285  pass:257  dwarn:0   dfail:0   fail:0   skip:28  time:411s
fi-cfl-s3        total:285  pass:259  dwarn:0   dfail:0   fail:0   skip:26  time:563s
fi-cfl-u         total:285  pass:259  dwarn:0   dfail:0   fail:0   skip:26  time:514s
fi-cnl-y3        total:285  pass:259  dwarn:0   dfail:0   fail:0   skip:26  time:590s
fi-elk-e7500     total:285  pass:225  dwarn:1   dfail:0   fail:0   skip:59  time:427s
fi-gdg-551       total:285  pass:176  dwarn:0   dfail:0   fail:1   skip:108 time:320s
fi-glk-1         total:285  pass:257  dwarn:0   dfail:0   fail:0   skip:28  time:540s
fi-hsw-4770      total:285  pass:258  dwarn:0   dfail:0   fail:0   skip:27  time:405s
fi-ilk-650       total:285  pass:225  dwarn:0   dfail:0   fail:0   skip:60  time:422s
fi-ivb-3520m     total:285  pass:256  dwarn:0   dfail:0   fail:0   skip:29  time:468s
fi-ivb-3770      total:285  pass:252  dwarn:0   dfail:0   fail:0   skip:33  time:429s
fi-kbl-7500u     total:285  pass:260  dwarn:1   dfail:0   fail:0   skip:24  time:474s
fi-kbl-7567u     total:285  pass:265  dwarn:0   dfail:0   fail:0   skip:20  time:461s
fi-kbl-r         total:285  pass:258  dwarn:0   dfail:0   fail:0   skip:27  time:509s
fi-pnv-d510      total:285  pass:219  dwarn:1   dfail:0   fail:0   skip:65  time:656s
fi-skl-6260u     total:285  pass:265  dwarn:0   dfail:0   fail:0   skip:20  time:446s
fi-skl-6600u     total:285  pass:258  dwarn:0   dfail:0   fail:0   skip:27  time:535s
fi-skl-6700k2    total:285  pass:261  dwarn:0   dfail:0   fail:0   skip:24  time:507s
fi-skl-6770hq    total:285  pass:264  dwarn:0   dfail:0   fail:1   skip:20  time:501s
fi-skl-guc       total:285  pass:257  dwarn:0   dfail:0   fail:0   skip:28  time:437s
fi-skl-gvtdvm    total:285  pass:262  dwarn:0   dfail:0   fail:0   skip:23  time:446s
fi-snb-2520m     total:285  pass:245  dwarn:0   dfail:0   fail:0   skip:40  time:575s
fi-snb-2600      total:285  pass:245  dwarn:0   dfail:0   fail:0   skip:40  time:400s
Blacklisted hosts:
fi-cnl-psr       total:285  pass:256  dwarn:3   dfail:0   fail:0   skip:26  time:559s
fi-glk-j4005     total:285  pass:256  dwarn:0   dfail:0   fail:0   skip:29  time:485s

== Logs ==

For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1216/issues.html
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

[igt-dev] ✓ Fi.CI.IGT: success for blacklist: Don't run DRRS test on Intel CI system (rev2)

[Patchwork]

== Series Details ==

Series: blacklist: Don't run DRRS test on Intel CI system (rev2)
URL   : https://patchwork.freedesktop.org/series/40646/
State : success

== Summary ==

---- Known issues:

Test drv_selftest:
        Subgroup live_gtt:
                pass       -> FAIL       (shard-apl) fdo#103927
Test kms_cursor_crc:
        Subgroup cursor-64x64-suspend:
                dmesg-warn -> PASS       (shard-snb) fdo#102365
Test kms_frontbuffer_tracking:
        Subgroup fbc-1p-primscrn-shrfb-msflip-blt:
                dmesg-fail -> PASS       (shard-apl) fdo#104727
Test kms_rotation_crc:
        Subgroup sprite-rotation-180:
                fail       -> PASS       (shard-snb) fdo#103925
Test perf:
        Subgroup polling:
                pass       -> FAIL       (shard-hsw) fdo#102252

fdo#103927 https://bugs.freedesktop.org/show_bug.cgi?id=103927
fdo#102365 https://bugs.freedesktop.org/show_bug.cgi?id=102365
fdo#104727 https://bugs.freedesktop.org/show_bug.cgi?id=104727
fdo#103925 https://bugs.freedesktop.org/show_bug.cgi?id=103925
fdo#102252 https://bugs.freedesktop.org/show_bug.cgi?id=102252

shard-apl        total:2926 pass:1831 dwarn:1   dfail:0   fail:8   skip:1085 time:12686s
shard-hsw        total:2873 pass:1743 dwarn:1   dfail:0   fail:2   skip:1125 time:11172s
shard-snb        total:2926 pass:1375 dwarn:1   dfail:0   fail:2   skip:1548 time:6956s
Blacklisted hosts:
shard-kbl        total:2926 pass:1897 dwarn:39  dfail:1   fail:10  skip:979 time:9037s

== Logs ==

For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1216/shards.html
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev