All of lore.kernel.org
 help / color / mirror / Atom feed
* [igt-dev] [PATCH i-g-t 1/3] intel-ci: Document meta.testlist
@ 2018-03-13 10:21 Petri Latvala
  2018-03-13 10:21 ` [igt-dev] [PATCH i-g-t 2/3] intel-ci: Document purpose of fast-feedback.testlist Petri Latvala
                   ` (4 more replies)
  0 siblings, 5 replies; 8+ messages in thread
From: Petri Latvala @ 2018-03-13 10:21 UTC (permalink / raw)
  To: igt-dev

Signed-off-by: Petri Latvala <petri.latvala@intel.com>
Cc: Marta Lofstedt <marta.lofstedt@intel.com>
---
 tests/intel-ci/README | 8 ++++++++
 1 file changed, 8 insertions(+)

diff --git a/tests/intel-ci/README b/tests/intel-ci/README
index 9c08e243..4d7a97eb 100644
--- a/tests/intel-ci/README
+++ b/tests/intel-ci/README
@@ -35,3 +35,11 @@ test per feature.
 
 The string "basic" in a test name means the test probably belongs in
 this list.
+
+=============
+meta.testlist
+=============
+
+Meta-testlist contains tests that are hardcoded to generate various
+different test results. It is used to test CI systems for proper
+result reporting, notification systems, etc.
-- 
2.14.1

_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

^ permalink raw reply related	[flat|nested] 8+ messages in thread

* [igt-dev] [PATCH i-g-t 2/3] intel-ci: Document purpose of fast-feedback.testlist
  2018-03-13 10:21 [igt-dev] [PATCH i-g-t 1/3] intel-ci: Document meta.testlist Petri Latvala
@ 2018-03-13 10:21 ` Petri Latvala
  2018-03-22 11:06   ` Lofstedt, Marta
  2018-03-13 10:21 ` [igt-dev] [PATCH i-g-t 3/3] intel-ci: Add full-suite test round blacklist Petri Latvala
                   ` (3 subsequent siblings)
  4 siblings, 1 reply; 8+ messages in thread
From: Petri Latvala @ 2018-03-13 10:21 UTC (permalink / raw)
  To: igt-dev

Original text was written before shard runs existed. Removed the
criteria for testlist contents; The list is still strictly controlled,
but additions/removals will be considered case-by-case.

Signed-off-by: Petri Latvala <petri.latvala@intel.com>
---
 tests/intel-ci/README | 22 ++++++++--------------
 1 file changed, 8 insertions(+), 14 deletions(-)

diff --git a/tests/intel-ci/README b/tests/intel-ci/README
index 4d7a97eb..2ccbbb1a 100644
--- a/tests/intel-ci/README
+++ b/tests/intel-ci/README
@@ -21,20 +21,14 @@ ask a maintainer (see MAINTAINERS).
 fast-feedback.testlist
 ======================
 
-Fast-feedback is the testlist that is run for Patchwork and Trybot
-testing. It is also run on various drm-intel-* branches.
-
-The results of CI runs on drm-tip can be found in
-https://intel-gfx-ci.01.org/CI/
-
-Time limit: Full run must complete in 15 minutes on all tested
-platforms.
-
-Feature coverage: Should test all working features, with at least 1
-test per feature.
-
-The string "basic" in a test name means the test probably belongs in
-this list.
+Fast-feedback contains tests that roughly tests a wide coverage of
+features in a short time. If the tests in fast-feedback report no
+regressions, the (almost) full suite of IGT tests is executed for
+proper testing. Results of a fast-feedback test round should only be
+considered to mean that the kernel is not obviously broken.
+
+The results of CI runs on drm-tip and various other kernel trees can
+be found in https://intel-gfx-ci.01.org/CI/
 
 =============
 meta.testlist
-- 
2.14.1

_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

^ permalink raw reply related	[flat|nested] 8+ messages in thread

* [igt-dev] [PATCH i-g-t 3/3] intel-ci: Add full-suite test round blacklist
  2018-03-13 10:21 [igt-dev] [PATCH i-g-t 1/3] intel-ci: Document meta.testlist Petri Latvala
  2018-03-13 10:21 ` [igt-dev] [PATCH i-g-t 2/3] intel-ci: Document purpose of fast-feedback.testlist Petri Latvala
@ 2018-03-13 10:21 ` Petri Latvala
  2018-03-15 11:23   ` Lofstedt, Marta
  2018-03-13 10:25 ` [igt-dev] [PATCH i-g-t 1/3] intel-ci: Document meta.testlist Lofstedt, Marta
                   ` (2 subsequent siblings)
  4 siblings, 1 reply; 8+ messages in thread
From: Petri Latvala @ 2018-03-13 10:21 UTC (permalink / raw)
  To: igt-dev

The list of regular expressions for tests that are not to be run in
sharded full test suite rounds, copied from
https://intel-gfx-ci.01.org/blacklist.txt

Signed-off-by: Petri Latvala <petri.latvala@intel.com>
---
 tests/intel-ci/README        |  7 +++++
 tests/intel-ci/blacklist.txt | 75 ++++++++++++++++++++++++++++++++++++++++++++
 2 files changed, 82 insertions(+)
 create mode 100644 tests/intel-ci/blacklist.txt

diff --git a/tests/intel-ci/README b/tests/intel-ci/README
index 2ccbbb1a..e3289933 100644
--- a/tests/intel-ci/README
+++ b/tests/intel-ci/README
@@ -30,6 +30,13 @@ considered to mean that the kernel is not obviously broken.
 The results of CI runs on drm-tip and various other kernel trees can
 be found in https://intel-gfx-ci.01.org/CI/
 
+=============
+blacklist.txt
+=============
+
+This file contains regular expressions (one per line) for tests that
+are not to be executed in full suite test rounds.
+
 =============
 meta.testlist
 =============
diff --git a/tests/intel-ci/blacklist.txt b/tests/intel-ci/blacklist.txt
new file mode 100644
index 00000000..7ca313ac
--- /dev/null
+++ b/tests/intel-ci/blacklist.txt
@@ -0,0 +1,75 @@
+igt@meta_test(@.*)?
+###############################################
+# GEM
+###############################################
+igt@drv_selftest(@.*)?
+igt@drm_mm(@.*)?
+igt@gem_busy@.*hang.*
+igt@gem_close_race@(?!.*basic).*
+igt@gem_concurrent_blit(@.*)?
+igt@gem_cs_prefetch(@.*)?
+igt@gem_ctx_create@(?!.*basic).*
+igt@gem_ctx_exec@(?!.*basic).*
+igt@gem_ctx_switch@(?!.*basic).*
+igt@gem_ctx_thrash(@.*)?
+igt@gem_evict_alignment(@.*)?
+igt@gem_evict_everything(@.*)?
+igt@gem_exec_alignment@(?!.*single).*
+igt@gem_exec_fence@(?!.*basic).*
+igt@gem_exec_flush@(?!.*basic).*
+igt@gem_exec_gttfill@(?!.*basic).*
+igt@gem_exec_latency(@.*)?
+igt@gem_exec_lut_handle(@.*)?
+igt@gem_exec_nop@(?!.*(basic|signal-all)).*
+igt@gem_exec_reloc@(?!.*basic).*
+igt@gem_exec_suspend@(?!.*basic).*
+igt@gem_exec_whisper@(?!normal$).*
+igt@gem_fd_exhaustion(@.*)?
+igt@gem_fence_upload(@.*)?
+igt@gem_gtt_hog(@.*)?
+igt@gem_gtt_speed(@.*)?
+igt@gem_hangcheck_forcewake(@.*)?
+igt@gem_lut_handle(@.*)?
+igt@gem_mmap_gtt@.*(huge|swap|clflush).*
+igt@gem_mmap@.*(swap|huge).*
+igt@gem_mocs_settings@.*(suspend|hibernate).*
+igt@gem_pin(@.*)?
+igt@gem_pread_after_blit(@.*)?
+igt@gem_read_read_speed(@.*)?
+igt@gem_reloc_overflow(@.*)?
+igt@gem_reloc_vs_gpu(@.*)?
+igt@gem_render_linear_blits@(?!.*basic).*
+igt@gem_render_tiled_blits@(?!.*basic).*
+igt@gem_reset_stats(@.*)?
+igt@gem_ringfill@(?!.*basic).*
+igt@gem_ring_sync_copy(@.*)?
+igt@gem_ring_sync_loop(@.*)?
+igt@gem_seqno_wrap(@.*)?
+igt@gem_shrink@(?!reclaim$).*
+igt@gem_softpin@.*(hang|S4).*
+igt@gem_spin_batch(@.*)?
+igt@gem_stolen@.*hibernate.*
+igt@gem_storedw_batches_loop(@.*)?
+igt@gem_storedw_loop(@.*)?
+igt@gem_streaming_writes(@.*)?
+igt@gem_sync@(?!.*basic).*
+igt@gem_tiled_swapping@(?!non-threaded).*
+igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
+igt@gem_wait@.*hang.*
+igt@gem_write_read_ring_switch(@.*)?
+###############################################
+# Broadcom
+###############################################
+igt@vc4_.*
+###############################################
+# AMD
+###############################################
+igt@amdgpu/.*
+###############################################
+# Hibernate: not configured correctly on CI
+###############################################
+igt@.*@.*-hibernate
+igt@gem_softpin@noreloc-s4
+igt@gem_workarounds@hibernate-.*
+igt@gem_exec_suspend@basic-s4$
+igt@gem_ctx_isolation@.*-s4
-- 
2.14.1

_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

^ permalink raw reply related	[flat|nested] 8+ messages in thread

* Re: [igt-dev] [PATCH i-g-t 1/3] intel-ci: Document meta.testlist
  2018-03-13 10:21 [igt-dev] [PATCH i-g-t 1/3] intel-ci: Document meta.testlist Petri Latvala
  2018-03-13 10:21 ` [igt-dev] [PATCH i-g-t 2/3] intel-ci: Document purpose of fast-feedback.testlist Petri Latvala
  2018-03-13 10:21 ` [igt-dev] [PATCH i-g-t 3/3] intel-ci: Add full-suite test round blacklist Petri Latvala
@ 2018-03-13 10:25 ` Lofstedt, Marta
  2018-03-13 11:01 ` [igt-dev] ✓ Fi.CI.BAT: success for series starting with [i-g-t,1/3] " Patchwork
  2018-03-13 12:19 ` [igt-dev] ✗ Fi.CI.IGT: warning " Patchwork
  4 siblings, 0 replies; 8+ messages in thread
From: Lofstedt, Marta @ 2018-03-13 10:25 UTC (permalink / raw)
  To: Latvala, Petri, igt-dev


Reviewed-by: Marta Lofstedt <marta.lofstedt@intel.com>

> -----Original Message-----
> From: Latvala, Petri
> Sent: Tuesday, March 13, 2018 12:22 PM
> To: igt-dev@lists.freedesktop.org
> Cc: Latvala, Petri <petri.latvala@intel.com>; Lofstedt, Marta
> <marta.lofstedt@intel.com>
> Subject: [PATCH i-g-t 1/3] intel-ci: Document meta.testlist
> 
> Signed-off-by: Petri Latvala <petri.latvala@intel.com>
> Cc: Marta Lofstedt <marta.lofstedt@intel.com>
> ---
>  tests/intel-ci/README | 8 ++++++++
>  1 file changed, 8 insertions(+)
> 
> diff --git a/tests/intel-ci/README b/tests/intel-ci/README index
> 9c08e243..4d7a97eb 100644
> --- a/tests/intel-ci/README
> +++ b/tests/intel-ci/README
> @@ -35,3 +35,11 @@ test per feature.
> 
>  The string "basic" in a test name means the test probably belongs in  this list.
> +
> +=============
> +meta.testlist
> +=============
> +
> +Meta-testlist contains tests that are hardcoded to generate various
> +different test results. It is used to test CI systems for proper result
> +reporting, notification systems, etc.
> --
> 2.14.1

_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

^ permalink raw reply	[flat|nested] 8+ messages in thread

* [igt-dev] ✓ Fi.CI.BAT: success for series starting with [i-g-t,1/3] intel-ci: Document meta.testlist
  2018-03-13 10:21 [igt-dev] [PATCH i-g-t 1/3] intel-ci: Document meta.testlist Petri Latvala
                   ` (2 preceding siblings ...)
  2018-03-13 10:25 ` [igt-dev] [PATCH i-g-t 1/3] intel-ci: Document meta.testlist Lofstedt, Marta
@ 2018-03-13 11:01 ` Patchwork
  2018-03-13 12:19 ` [igt-dev] ✗ Fi.CI.IGT: warning " Patchwork
  4 siblings, 0 replies; 8+ messages in thread
From: Patchwork @ 2018-03-13 11:01 UTC (permalink / raw)
  To: Petri Latvala; +Cc: igt-dev

== Series Details ==

Series: series starting with [i-g-t,1/3] intel-ci: Document meta.testlist
URL   : https://patchwork.freedesktop.org/series/39845/
State : success

== Summary ==

IGT patchset tested on top of latest successful build
89b915f5aa465d5c3498b170b1572fae20460491 tests/pm_rpm: Don't try to create an X-tiled ARGB8888 framebuffer

with latest DRM-Tip kernel build CI_DRM_3916
b27e0c360d42 drm-tip: 2018y-03m-13d-09h-56m-18s UTC integration manifest

No testlist changes.

fi-bdw-5557u     total:288  pass:267  dwarn:0   dfail:0   fail:0   skip:21  time:429s
fi-bdw-gvtdvm    total:288  pass:264  dwarn:0   dfail:0   fail:0   skip:24  time:438s
fi-blb-e6850     total:288  pass:223  dwarn:1   dfail:0   fail:0   skip:64  time:384s
fi-bsw-n3050     total:288  pass:242  dwarn:0   dfail:0   fail:0   skip:46  time:534s
fi-bwr-2160      total:288  pass:183  dwarn:0   dfail:0   fail:0   skip:105 time:298s
fi-bxt-dsi       total:288  pass:258  dwarn:0   dfail:0   fail:0   skip:30  time:512s
fi-bxt-j4205     total:288  pass:259  dwarn:0   dfail:0   fail:0   skip:29  time:507s
fi-byt-j1900     total:288  pass:253  dwarn:0   dfail:0   fail:0   skip:35  time:509s
fi-byt-n2820     total:288  pass:249  dwarn:0   dfail:0   fail:0   skip:39  time:512s
fi-cfl-8700k     total:288  pass:260  dwarn:0   dfail:0   fail:0   skip:28  time:414s
fi-cfl-s2        total:288  pass:262  dwarn:0   dfail:0   fail:0   skip:26  time:588s
fi-elk-e7500     total:288  pass:229  dwarn:0   dfail:0   fail:0   skip:59  time:431s
fi-gdg-551       total:288  pass:179  dwarn:0   dfail:0   fail:1   skip:108 time:315s
fi-glk-1         total:288  pass:260  dwarn:0   dfail:0   fail:0   skip:28  time:536s
fi-hsw-4770      total:288  pass:261  dwarn:0   dfail:0   fail:0   skip:27  time:404s
fi-ilk-650       total:288  pass:228  dwarn:0   dfail:0   fail:0   skip:60  time:420s
fi-ivb-3520m     total:288  pass:259  dwarn:0   dfail:0   fail:0   skip:29  time:468s
fi-ivb-3770      total:288  pass:255  dwarn:0   dfail:0   fail:0   skip:33  time:435s
fi-kbl-7500u     total:288  pass:263  dwarn:1   dfail:0   fail:0   skip:24  time:477s
fi-kbl-7567u     total:288  pass:268  dwarn:0   dfail:0   fail:0   skip:20  time:470s
fi-kbl-r         total:288  pass:261  dwarn:0   dfail:0   fail:0   skip:27  time:518s
fi-pnv-d510      total:288  pass:222  dwarn:1   dfail:0   fail:0   skip:65  time:642s
fi-skl-6260u     total:288  pass:268  dwarn:0   dfail:0   fail:0   skip:20  time:439s
fi-skl-6600u     total:288  pass:261  dwarn:0   dfail:0   fail:0   skip:27  time:532s
fi-skl-6700hq    total:288  pass:262  dwarn:0   dfail:0   fail:0   skip:26  time:540s
fi-skl-6700k2    total:288  pass:264  dwarn:0   dfail:0   fail:0   skip:24  time:502s
fi-skl-6770hq    total:288  pass:268  dwarn:0   dfail:0   fail:0   skip:20  time:490s
fi-skl-guc       total:288  pass:260  dwarn:0   dfail:0   fail:0   skip:28  time:426s
fi-skl-gvtdvm    total:288  pass:265  dwarn:0   dfail:0   fail:0   skip:23  time:436s
fi-snb-2520m     total:288  pass:248  dwarn:0   dfail:0   fail:0   skip:40  time:541s
fi-snb-2600      total:288  pass:248  dwarn:0   dfail:0   fail:0   skip:40  time:406s
Blacklisted hosts:
fi-cnl-drrs      total:285  pass:254  dwarn:0   dfail:1   fail:2   skip:27

== Logs ==

For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1115/issues.html
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

^ permalink raw reply	[flat|nested] 8+ messages in thread

* [igt-dev] ✗ Fi.CI.IGT: warning for series starting with [i-g-t,1/3] intel-ci: Document meta.testlist
  2018-03-13 10:21 [igt-dev] [PATCH i-g-t 1/3] intel-ci: Document meta.testlist Petri Latvala
                   ` (3 preceding siblings ...)
  2018-03-13 11:01 ` [igt-dev] ✓ Fi.CI.BAT: success for series starting with [i-g-t,1/3] " Patchwork
@ 2018-03-13 12:19 ` Patchwork
  4 siblings, 0 replies; 8+ messages in thread
From: Patchwork @ 2018-03-13 12:19 UTC (permalink / raw)
  To: Petri Latvala; +Cc: igt-dev

== Series Details ==

Series: series starting with [i-g-t,1/3] intel-ci: Document meta.testlist
URL   : https://patchwork.freedesktop.org/series/39845/
State : warning

== Summary ==

---- Possible new issues:

Test kms_cursor_crc:
        Subgroup cursor-128x128-suspend:
                pass       -> SKIP       (shard-snb)

---- Known issues:

Test drv_suspend:
        Subgroup debugfs-reader:
                pass       -> SKIP       (shard-snb) fdo#102365
Test gem_eio:
        Subgroup in-flight-external:
                pass       -> INCOMPLETE (shard-apl) fdo#105341
Test kms_flip:
        Subgroup 2x-plain-flip-fb-recreate-interruptible:
                pass       -> FAIL       (shard-hsw) fdo#100368
Test kms_plane:
        Subgroup plane-panning-bottom-right-suspend-pipe-a-planes:
                pass       -> FAIL       (shard-apl) fdo#103375 +1
Test kms_rotation_crc:
        Subgroup primary-rotation-180:
                pass       -> FAIL       (shard-snb) fdo#103925
Test kms_setmode:
        Subgroup basic:
                pass       -> FAIL       (shard-apl) fdo#99912

fdo#102365 https://bugs.freedesktop.org/show_bug.cgi?id=102365
fdo#105341 https://bugs.freedesktop.org/show_bug.cgi?id=105341
fdo#100368 https://bugs.freedesktop.org/show_bug.cgi?id=100368
fdo#103375 https://bugs.freedesktop.org/show_bug.cgi?id=103375
fdo#103925 https://bugs.freedesktop.org/show_bug.cgi?id=103925
fdo#99912 https://bugs.freedesktop.org/show_bug.cgi?id=99912

shard-apl        total:3424 pass:1806 dwarn:1   dfail:0   fail:8   skip:1607 time:12764s
shard-hsw        total:3473 pass:1776 dwarn:1   dfail:0   fail:3   skip:1692 time:11969s
shard-snb        total:3473 pass:1362 dwarn:1   dfail:0   fail:4   skip:2106 time:7137s
Blacklisted hosts:
shard-kbl        total:3442 pass:1917 dwarn:18  dfail:0   fail:10  skip:1496 time:9658s

== Logs ==

For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1115/shards.html
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [igt-dev] [PATCH i-g-t 3/3] intel-ci: Add full-suite test round blacklist
  2018-03-13 10:21 ` [igt-dev] [PATCH i-g-t 3/3] intel-ci: Add full-suite test round blacklist Petri Latvala
@ 2018-03-15 11:23   ` Lofstedt, Marta
  0 siblings, 0 replies; 8+ messages in thread
From: Lofstedt, Marta @ 2018-03-15 11:23 UTC (permalink / raw)
  To: Latvala, Petri, igt-dev

Reviewed-by: Marta Lofstedt <marta.lofstedt@intel.com>

> -----Original Message-----
> From: igt-dev [mailto:igt-dev-bounces@lists.freedesktop.org] On Behalf Of
> Petri Latvala
> Sent: Tuesday, March 13, 2018 12:22 PM
> To: igt-dev@lists.freedesktop.org
> Subject: [igt-dev] [PATCH i-g-t 3/3] intel-ci: Add full-suite test round blacklist
> 
> The list of regular expressions for tests that are not to be run in sharded full
> test suite rounds, copied from https://intel-gfx-ci.01.org/blacklist.txt
> 
> Signed-off-by: Petri Latvala <petri.latvala@intel.com>
> ---
>  tests/intel-ci/README        |  7 +++++
>  tests/intel-ci/blacklist.txt | 75
> ++++++++++++++++++++++++++++++++++++++++++++
>  2 files changed, 82 insertions(+)
>  create mode 100644 tests/intel-ci/blacklist.txt
> 
> diff --git a/tests/intel-ci/README b/tests/intel-ci/README index
> 2ccbbb1a..e3289933 100644
> --- a/tests/intel-ci/README
> +++ b/tests/intel-ci/README
> @@ -30,6 +30,13 @@ considered to mean that the kernel is not obviously
> broken.
>  The results of CI runs on drm-tip and various other kernel trees can  be
> found in https://intel-gfx-ci.01.org/CI/
> 
> +=============
> +blacklist.txt
> +=============
> +
> +This file contains regular expressions (one per line) for tests that
> +are not to be executed in full suite test rounds.
> +
>  =============
>  meta.testlist
>  =============
> diff --git a/tests/intel-ci/blacklist.txt b/tests/intel-ci/blacklist.txt new file
> mode 100644 index 00000000..7ca313ac
> --- /dev/null
> +++ b/tests/intel-ci/blacklist.txt
> @@ -0,0 +1,75 @@
> +igt@meta_test(@.*)?
> +###############################################
> +# GEM
> +###############################################
> +igt@drv_selftest(@.*)?
> +igt@drm_mm(@.*)?
> +igt@gem_busy@.*hang.*
> +igt@gem_close_race@(?!.*basic).*
> +igt@gem_concurrent_blit(@.*)?
> +igt@gem_cs_prefetch(@.*)?
> +igt@gem_ctx_create@(?!.*basic).*
> +igt@gem_ctx_exec@(?!.*basic).*
> +igt@gem_ctx_switch@(?!.*basic).*
> +igt@gem_ctx_thrash(@.*)?
> +igt@gem_evict_alignment(@.*)?
> +igt@gem_evict_everything(@.*)?
> +igt@gem_exec_alignment@(?!.*single).*
> +igt@gem_exec_fence@(?!.*basic).*
> +igt@gem_exec_flush@(?!.*basic).*
> +igt@gem_exec_gttfill@(?!.*basic).*
> +igt@gem_exec_latency(@.*)?
> +igt@gem_exec_lut_handle(@.*)?
> +igt@gem_exec_nop@(?!.*(basic|signal-all)).*
> +igt@gem_exec_reloc@(?!.*basic).*
> +igt@gem_exec_suspend@(?!.*basic).*
> +igt@gem_exec_whisper@(?!normal$).*
> +igt@gem_fd_exhaustion(@.*)?
> +igt@gem_fence_upload(@.*)?
> +igt@gem_gtt_hog(@.*)?
> +igt@gem_gtt_speed(@.*)?
> +igt@gem_hangcheck_forcewake(@.*)?
> +igt@gem_lut_handle(@.*)?
> +igt@gem_mmap_gtt@.*(huge|swap|clflush).*
> +igt@gem_mmap@.*(swap|huge).*
> +igt@gem_mocs_settings@.*(suspend|hibernate).*
> +igt@gem_pin(@.*)?
> +igt@gem_pread_after_blit(@.*)?
> +igt@gem_read_read_speed(@.*)?
> +igt@gem_reloc_overflow(@.*)?
> +igt@gem_reloc_vs_gpu(@.*)?
> +igt@gem_render_linear_blits@(?!.*basic).*
> +igt@gem_render_tiled_blits@(?!.*basic).*
> +igt@gem_reset_stats(@.*)?
> +igt@gem_ringfill@(?!.*basic).*
> +igt@gem_ring_sync_copy(@.*)?
> +igt@gem_ring_sync_loop(@.*)?
> +igt@gem_seqno_wrap(@.*)?
> +igt@gem_shrink@(?!reclaim$).*
> +igt@gem_softpin@.*(hang|S4).*
> +igt@gem_spin_batch(@.*)?
> +igt@gem_stolen@.*hibernate.*
> +igt@gem_storedw_batches_loop(@.*)?
> +igt@gem_storedw_loop(@.*)?
> +igt@gem_streaming_writes(@.*)?
> +igt@gem_sync@(?!.*basic).*
> +igt@gem_tiled_swapping@(?!non-threaded).*
> +igt@gem_userptr_blits@(major|minor|forked|mlocked|swapping).*
> +igt@gem_wait@.*hang.*
> +igt@gem_write_read_ring_switch(@.*)?
> +###############################################
> +# Broadcom
> +###############################################
> +igt@vc4_.*
> +###############################################
> +# AMD
> +###############################################
> +igt@amdgpu/.*
> +###############################################
> +# Hibernate: not configured correctly on CI
> +###############################################
> +igt@.*@.*-hibernate
> +igt@gem_softpin@noreloc-s4
> +igt@gem_workarounds@hibernate-.*
> +igt@gem_exec_suspend@basic-s4$
> +igt@gem_ctx_isolation@.*-s4
> --
> 2.14.1
> 
> _______________________________________________
> igt-dev mailing list
> igt-dev@lists.freedesktop.org
> https://lists.freedesktop.org/mailman/listinfo/igt-dev
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [igt-dev] [PATCH i-g-t 2/3] intel-ci: Document purpose of fast-feedback.testlist
  2018-03-13 10:21 ` [igt-dev] [PATCH i-g-t 2/3] intel-ci: Document purpose of fast-feedback.testlist Petri Latvala
@ 2018-03-22 11:06   ` Lofstedt, Marta
  0 siblings, 0 replies; 8+ messages in thread
From: Lofstedt, Marta @ 2018-03-22 11:06 UTC (permalink / raw)
  To: Latvala, Petri, igt-dev

Reviewed-by: Marta Lofstedt <marta.lofstedt@intel.com>

> -----Original Message-----
> From: igt-dev [mailto:igt-dev-bounces@lists.freedesktop.org] On Behalf Of
> Petri Latvala
> Sent: Tuesday, March 13, 2018 12:22 PM
> To: igt-dev@lists.freedesktop.org
> Subject: [igt-dev] [PATCH i-g-t 2/3] intel-ci: Document purpose of fast-
> feedback.testlist
> 
> Original text was written before shard runs existed. Removed the criteria for
> testlist contents; The list is still strictly controlled, but additions/removals will
> be considered case-by-case.
> 
> Signed-off-by: Petri Latvala <petri.latvala@intel.com>
> ---
>  tests/intel-ci/README | 22 ++++++++--------------
>  1 file changed, 8 insertions(+), 14 deletions(-)
> 
> diff --git a/tests/intel-ci/README b/tests/intel-ci/README index
> 4d7a97eb..2ccbbb1a 100644
> --- a/tests/intel-ci/README
> +++ b/tests/intel-ci/README
> @@ -21,20 +21,14 @@ ask a maintainer (see MAINTAINERS).
>  fast-feedback.testlist
>  ======================
> 
> -Fast-feedback is the testlist that is run for Patchwork and Trybot -testing. It
> is also run on various drm-intel-* branches.
> -
> -The results of CI runs on drm-tip can be found in -https://intel-gfx-
> ci.01.org/CI/
> -
> -Time limit: Full run must complete in 15 minutes on all tested -platforms.
> -
> -Feature coverage: Should test all working features, with at least 1 -test per
> feature.
> -
> -The string "basic" in a test name means the test probably belongs in -this list.
> +Fast-feedback contains tests that roughly tests a wide coverage of
> +features in a short time. If the tests in fast-feedback report no
> +regressions, the (almost) full suite of IGT tests is executed for
> +proper testing. Results of a fast-feedback test round should only be
> +considered to mean that the kernel is not obviously broken.
> +
> +The results of CI runs on drm-tip and various other kernel trees can be
> +found in https://intel-gfx-ci.01.org/CI/
> 
>  =============
>  meta.testlist
> --
> 2.14.1
> 
> _______________________________________________
> igt-dev mailing list
> igt-dev@lists.freedesktop.org
> https://lists.freedesktop.org/mailman/listinfo/igt-dev
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

^ permalink raw reply	[flat|nested] 8+ messages in thread

end of thread, other threads:[~2018-03-22 11:06 UTC | newest]

Thread overview: 8+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2018-03-13 10:21 [igt-dev] [PATCH i-g-t 1/3] intel-ci: Document meta.testlist Petri Latvala
2018-03-13 10:21 ` [igt-dev] [PATCH i-g-t 2/3] intel-ci: Document purpose of fast-feedback.testlist Petri Latvala
2018-03-22 11:06   ` Lofstedt, Marta
2018-03-13 10:21 ` [igt-dev] [PATCH i-g-t 3/3] intel-ci: Add full-suite test round blacklist Petri Latvala
2018-03-15 11:23   ` Lofstedt, Marta
2018-03-13 10:25 ` [igt-dev] [PATCH i-g-t 1/3] intel-ci: Document meta.testlist Lofstedt, Marta
2018-03-13 11:01 ` [igt-dev] ✓ Fi.CI.BAT: success for series starting with [i-g-t,1/3] " Patchwork
2018-03-13 12:19 ` [igt-dev] ✗ Fi.CI.IGT: warning " Patchwork

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.