* [Xen-devel] [xen-unstable-smoke bisection] complete build-amd64
@ 2019-06-26 2:40 osstest service owner
0 siblings, 0 replies; 8+ messages in thread
From: osstest service owner @ 2019-06-26 2:40 UTC (permalink / raw)
To: xen-devel, osstest-admin
branch xen-unstable-smoke
xenbranch xen-unstable-smoke
job build-amd64
testid xen-build
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: 1bef4b1efd40b4c8c9e7afcd0155042a47896cb0
Bug not present: e0b77cb77ef2b36b8cbd2273cff833f773208d0a
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/138516/
(Revision log too long, omitted.)
For bisection revision-tuple graph see:
http://logs.test-lab.xenproject.org/osstest/results/bisect/xen-unstable-smoke/build-amd64.xen-build.html
Revision IDs in each graph node refer, respectively, to the Trees above.
----------------------------------------
Running cs-bisection-step --graph-out=/home/logs/results/bisect/xen-unstable-smoke/build-amd64.xen-build --summary-out=tmp/138521.bisection-summary --basis-template=138424 --blessings=real,real-bisect --flight=138521 xen-unstable-smoke build-amd64 xen-build
Searching for failure / basis pass:
138519 fail [host=pinot0] / 138424 [host=albana0] 138355 [host=albana0] 138347 [host=baroque1] 138342 [host=albana1] 138328 [host=chardonnay1] 138317 [host=albana1] 138295 [host=debina1] 138277 [host=godello1] 138257 [host=godello0] 138242 [host=baroque1] 138228 [host=albana1] 138205 [host=godello0] 138176 [host=godello0] 138054 [host=godello1] 138039 [host=albana1] 138020 [host=debina1] 137985 [host=godello1] 137971 [host=chardonnay1] 137904 [host=albana0] 137888 [host=albana1] 137732 [host=al\
bana1] 137726 [host=godello1] 137716 [host=albana0] 137683 [host=debina1] 137679 [host=godello0] 137676 [host=godello0] 137675 [host=pinot1] 137665 [host=godello0] 137662 [host=albana1] 137658 [host=albana1] 137643 [host=albana1] 137587 [host=godello1] 137586 [host=elbling1] 137452 [host=chardonnay0] 137391 [host=pinot1] 137387 [host=fiano1] 137386 [host=italia1] 137380 [host=godello1] 137276 [host=godello1] 137263 [host=chardonnay0] 137250 [host=albana1] 137233 [host=albana1] 137117 [host=godel\
lo1] 137109 [host=godello0] 137079 [host=albana1] 137072 [host=albana1] 137036 [host=godello0] 137007 [host=godello0] 136914 [host=godello1] 136906 [host=godello0] 136891 [host=albana1] 136860 [host=godello1] 136752 [host=chardonnay0] 136699 [host=rimava1] 136687 [host=fiano1] 136665 [host=albana1] 136652 [host=albana1] 136636 [host=debina1] 136633 [host=godello1] 136618 [host=chardonnay0] 136463 [host=godello1] 136453 [host=godello1] 136442 [host=chardonnay1] 136387 [host=pinot1] 136374 [host=g\
odello1] 136364 [host=albana0] 136354 [host=albana0] 136343 [host=debina1] 136330 [host=chardonnay1] 136327 [host=albana0] 136317 [host=godello1] 136309 [host=albana0] 136304 [host=godello0] 136179 [host=albana0] 136178 [host=elbling1] 136170 [host=debina1] 135857 [host=albana0] 135319 [host=italia1] 135316 [host=godello0] 135310 [host=albana1] 135308 [host=debina1] 135306 [host=fiano1] 135305 [host=godello0] 135304 [host=chardonnay0] 135297 [host=albana0] 135294 [host=italia0] 135293 [host=gode\
llo0] 135285 [host=godello0] 135280 [host=debina1] 135277 [host=godello0] 135272 [host=godello0] 135267 [host=rimava1] 135252 [host=italia1] 135245 [host=baroque0] 135228 [host=baroque0] 135215 [host=godello0] 135211 [host=baroque0] 135204 [host=rimava1] 135198 [host=chardonnay1] 135183 [host=chardonnay0] 135173 [host=chardonnay1] 135168 [host=pinot1] 135163 [host=italia1] 135158 [host=debina1] 135155 [host=debina1] 135143 [host=debina1] 135128 [host=godello1] 135118 [host=italia1] 135103 [host=\
godello0] 135096 [host=baroque0] 135080 [host=italia0] 135075 [host=albana1] 135071 [host=chardonnay1] 135062 [host=fiano1] 135052 [host=italia0] 135045 [host=baroque0] 135039 [host=pinot1] 135033 [host=italia0] 135028 [host=italia0] 135025 [host=pinot1] 135022 [host=godello1] 135018 [host=baroque0] 135016 [host=godello1] 135013 [host=baroque0] 135009 [host=debina1] 135007 [host=godello1] 135001 [host=debina1] 134995 [host=albana0] 134992 [host=baroque0] 134988 [host=debina1] 134986 [host=albana\
1] 134983 [host=debina1] 134980 [host=debina1] 134973 [host=baroque0] 134969 [host=godello1] 134966 [host=italia1] 134959 [host=italia1] 134952 [host=elbling1] 134945 [host=albana1] 134937 [host=albana1] 134936 [host=albana1] 134933 [host=italia0] 134928 [host=elbling1] 134924 [host=godello0] 134916 [host=albana0] 134910 [host=italia0] 134903 [host=chardonnay0] 134891 [host=albana1] 134882 [host=debina1] 134869 [host=albana1] 134863 [host=baroque0] 134858 [host=fiano1] 134850 [host=baroque0] 134\
843 [host=godello0] 134838 [host=rimava1] 134834 [host=albana1] 133991 [host=albana0] 133988 [host=godello0] 133977 [host=albana0] 133948 [host=godello0] 133927 [host=godello0] 133911 [host=godello0] 133907 [host=merlot0] 133900 [host=albana0] 133841 [host=albana0] 133837 [host=chardonnay1] 133836 [host=godello0] 133804 [host=godello0] 133802 [host=godello1] 133781 [host=albana0] 133776 [host=albana0] 133771 [host=godello1] 133767 [host=albana0] 133752 [host=albana0] 133747 [host=albana0] 133741\
[host=albana0] 133716 [host=godello1] 133621 [host=godello0] 133607 [host=pinot1] 133599 [host=pinot1] 133592 [host=godello1] 133498 [host=italia0] 133485 [host=godello0] 133478 [host=albana0] 133457 [host=pinot1] 133382 [host=debina0] 133371 [host=joubertin0] 133343 [host=albana0] 133329 [host=godello1] 133312 [host=albana0] 133301 [host=debina1] 133264 [host=pinot1] 133263 [host=debina1] 133005 [host=fiano0] 132977 [host=pinot1] 132967 [host=albana1] 132947 [host=godello0] 132841 [host=godell\
o0] 132712 [host=godello1] 132710 [host=albana1] 132708 [host=albana0] 132702 [host=debina1] 132668 [host=chardonnay0] 132633 [host=debina1] 132627 [host=debina1] 132618 [host=albana1] 132569 [host=godello1] 132562 [host=godello1] 132550 [host=fiano0] 132538 [host=godello1] 132477 [host=godello0] 132471 [host=chardonnay0] 132463 [host=debina1] 132450 [host=debina1] 132436 [host=godello0] 132342 [host=godello0] 132287 [host=godello1] 132269 [host=baroque1] 132059 [host=godello1] 132022 [host=debi\
na1] 131985 [host=baroque1] 131982 [host=godello0] 131968 [host=albana0] 131966 [host=debina1] 131922 [host=godello0] 131920 [host=godello1] 131919 [host=godello1] 131917 [host=godello0] 131881 [host=godello0] 131879 [host=godello1] 131829 [host=debina0] 131803 [host=albana0] 131711 [host=huxelrebe1] 131702 [host=huxelrebe1] 131689 [host=huxelrebe1] 131686 [host=albana0] 131665 [host=godello1] 131623 [host=godello0] 131600 [host=godello1] 131597 [host=godello0] 131515 [host=albana0] 131502 [host\
=huxelrebe1] 131500 [host=rimava1] 131491 [host=godello1] 131486 [host=godello0] 131445 [host=godello1] 131436 [host=albana0] 131434 [host=debina1] 131431 [host=albana0] 131428 [host=baroque0] 131400 [host=baroque1] 131389 [host=baroque0] 131315 [host=rimava1] 131293 [host=albana0] 131284 [host=huxelrebe1] 131274 [host=huxelrebe1] 131246 [host=godello1] 131239 [host=rimava1] 131234 [host=godello0] 131225 [host=godello1] 131212 [host=baroque1] 131210 [host=godello1] 131207 [host=elbling0] 131126 \
[host=debina1] 131124 [host=chardonnay1] 131076 [host=huxelrebe1] 131069 [host=debina1] 131068 [host=albana0] 131013 [host=huxelrebe1] 130877 [host=albana1] 130873 [host=godello1] 130852 [host=albana1] 130850 [host=godello1] 130848 [host=albana1] 130841 [host=huxelrebe1] 130839 [host=albana0] 130819 [host=godello1] 130289 [host=huxelrebe1] 130219 [host=albana0] 130136 [host=godello0] 130122 [host=debina0] 130110 [host=fiano0] 130072 [host=godello0] 130062 [host=fiano0] 129982 [host=godello0] 129\
972 [host=albana0] 129960 [host=godello0] 129852 [host=godello1] 129846 [host=huxelrebe1] 129836 [host=godello0] 129727 [host=godello0] 129713 [host=huxelrebe1] 129702 [host=albana1] 129698 [host=albana1] 129656 [host=godello1] 129650 [host=godello1] 129564 [host=godello1] 129555 [host=godello1] 129539 [host=huxelrebe1] 129519 [host=godello0] 129512 [host=albana0] 129505 [host=debina0] 129473 [host=huxelrebe1] 129467 [host=godello0] 129451 [host=baroque1] 129330 [host=baroque1] 129322 [host=gode\
llo0] 129286 [host=debina0] 129282 [host=debina0] 129254 [host=baroque1] 129202 [host=debina0] 129196 [host=godello0] 129189 [host=huxelrebe1] 129151 [host=albana0] 129141 [host=italia0] 129136 [host=albana0] 129116 [host=debina0] 129111 [host=debina0] 129016 [host=debina0] 129011 [host=albana0] 128969 [host=albana0] 128965 [host=albana0] 128962 [host=italia0] 128951 ok.
Failure / basis pass flights: 138519 / 128951
(tree in basispass but not in latest: minios)
(tree in basispass but not in latest: ovmf)
(tree in basispass but not in latest: qemu)
(tree in basispass but not in latest: seabios)
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
Latest 9cca02d8ffc23e9688a971d858e4ffdff5389b11 1bef4b1efd40b4c8c9e7afcd0155042a47896cb0
Basis pass de5b678ca4dcdfa83e322491d478d66df56c1986 e0b77cb77ef2b36b8cbd2273cff833f773208d0a
Generating revisions with ./adhoc-revtuple-generator git://xenbits.xen.org/qemu-xen.git#de5b678ca4dcdfa83e322491d478d66df56c1986-9cca02d8ffc23e9688a971d858e4ffdff5389b11 git://xenbits.xen.org/xen.git#e0b77cb77ef2b36b8cbd2273cff833f773208d0a-1bef4b1efd40b4c8c9e7afcd0155042a47896cb0
adhoc-revtuple-generator: tree discontiguous: qemu-xen
adhoc-revtuple-generator: tree discontiguous: xen
Loaded 3 nodes in revision graph
Searching for test results:
66392 [host=godello1]
66424 [host=fiano0]
66430 [host=godello1]
66434 [host=godello0]
66464 [host=baroque0]
77012 pass irrelevant
77025 [host=godello1]
66531 [host=baroque0]
66824 [host=godello0]
66842 [host=godello1]
66868 pass irrelevant
66936 pass irrelevant
62352 [host=italia0]
62363 [host=merlot1]
62537 [host=italia0]
62496 [host=italia0]
62505 [host=godello0]
62530 [host=godello0]
62564 [host=italia0]
62572 [host=nocera0]
62599 [host=nocera0]
62622 [host=italia0]
62705 [host=italia0]
62680 [host=nocera0]
62704 [host=nocera0]
62714 [host=nocera0]
62729 [host=nocera0]
62731 [host=nocera0]
62939 [host=nocera0]
62960 [host=fiano0]
62949 [host=nocera0]
63011 [host=nocera1]
62985 [host=nocera1]
63007 [host=nocera1]
63112 [host=nocera0]
63091 [host=fiano0]
63137 [host=chardonnay1]
63218 [host=nocera0]
63260 [host=chardonnay1]
63331 [host=nocera0]
63334 [host=nocera1]
63322 [host=nocera1]
63335 [host=nocera0]
63362 [host=baroque0]
63349 [host=baroque0]
63357 [host=chardonnay1]
63364 [host=nocera0]
63484 [host=godello1]
63542 [host=nocera1]
63544 [host=godello1]
63584 [host=nocera1]
63594 [host=godello1]
63615 [host=godello1]
63624 [host=godello1]
63720 [host=nocera1]
77147 [host=italia0]
77380 [host=italia1]
77413 [host=merlot1]
77507 pass irrelevant
77524 [host=godello0]
77538 [host=italia1]
77890 [host=chardonnay0]
78074 [host=pinot1]
78173 [host=godello0]
78168 [host=chardonnay0]
78183 [host=godello1]
78436 [host=godello1]
78441 [host=pinot1]
78449 [host=godello0]
78454 [host=fiano1]
78548 [host=italia0]
78522 [host=baroque0]
78511 [host=godello0]
78539 [host=godello1]
78553 [host=italia1]
78617 [host=italia0]
78624 [host=italia0]
78630 [host=godello0]
78697 pass irrelevant
78812 [host=rimava1]
78820 [host=italia1]
79031 [host=godello1]
79021 [host=italia1]
79041 [host=godello0]
79103 [host=baroque0]
79429 [host=italia0]
79424 [host=godello1]
79786 [host=fiano1]
79969 [host=pinot1]
79987 [host=godello1]
80205 [host=baroque0]
80228 [host=pinot1]
80441 [host=godello1]
80508 [host=godello1]
81429 [host=huxelrebe1]
81619 [host=godello1]
81805 [host=godello1]
81826 [host=fiano0]
81996 [host=godello1]
82022 [host=huxelrebe1]
82185 [host=fiano0]
82125 [host=godello1]
82717 [host=huxelrebe1]
82684 [host=italia0]
82876 [host=italia0]
83012 [host=baroque0]
83064 [host=italia0]
83214 [host=godello1]
83237 [host=italia1]
83646 pass irrelevant
83671 [host=italia0]
83851 [host=baroque1]
83864 [host=chardonnay1]
83972 [host=italia1]
84134 [host=baroque1]
84160 [host=fiano0]
84174 [host=italia1]
84424 [host=fiano0]
84556 pass irrelevant
84578 [host=godello1]
84930 [host=baroque0]
84962 [host=italia1]
84976 [host=baroque0]
85080 [host=baroque0]
85178 [host=huxelrebe0]
85190 [host=huxelrebe0]
85200 [host=baroque0]
85216 [host=godello1]
85226 [host=godello0]
85238 [host=godello0]
85270 [host=godello0]
85248 [host=huxelrebe0]
85306 [host=rimava1]
85295 [host=godello0]
85259 [host=fiano0]
85286 [host=godello0]
85320 [host=godello0]
85333 [host=godello0]
85354 [host=godello0]
85654 [host=godello1]
85661 [host=italia1]
85838 [host=italia1]
85819 [host=godello1]
85827 pass irrelevant
85920 [host=baroque0]
85936 [host=godello1]
86218 [host=godello1]
86241 [host=godello1]
86337 [host=huxelrebe0]
86310 [host=baroque0]
86322 [host=italia1]
86384 [host=godello1]
86408 [host=italia1]
86477 [host=italia1]
86490 [host=godello1]
86556 pass irrelevant
86572 [host=italia1]
86586 [host=fiano0]
87036 [host=godello0]
87201 [host=godello0]
87212 [host=fiano0]
87229 [host=godello0]
87332 [host=italia1]
87360 [host=godello1]
87376 [host=huxelrebe1]
87926 [host=fiano1]
87899 [host=godello0]
87883 [host=godello0]
87912 [host=godello0]
88027 [host=godello1]
88009 [host=godello0]
88046 [host=godello0]
88144 [host=godello0]
88279 [host=italia1]
88315 [host=italia1]
88299 [host=chardonnay0]
88344 [host=fiano1]
88287 [host=huxelrebe1]
88354 [host=godello0]
88326 [host=italia1]
88337 [host=italia1]
88367 [host=godello0]
88381 [host=godello1]
88440 [host=huxelrebe1]
88411 [host=godello0]
88431 [host=godello0]
88394 [host=godello0]
88426 [host=fiano1]
88449 [host=godello1]
88458 [host=godello1]
88467 [host=italia1]
88488 [host=godello0]
88518 [host=merlot1]
88503 [host=rimava1]
88563 [host=godello0]
88554 [host=huxelrebe0]
88532 [host=chardonnay1]
88544 [host=godello0]
88571 [host=merlot1]
88584 [host=godello0]
88595 [host=godello0]
88608 [host=godello0]
88629 [host=godello1]
88647 [host=rimava1]
88656 [host=godello0]
88672 [host=godello0]
88680 [host=godello0]
88699 [host=godello0]
88802 [host=merlot1]
89250 [host=godello1]
89344 [host=godello0]
89383 [host=huxelrebe0]
89421 [host=fiano1]
90828 [host=italia1]
90970 [host=godello0]
90993 [host=chardonnay1]
91017 [host=elbling1]
91132 [host=elbling1]
91497 [host=godello1]
92171 [host=nocera0]
92192 [host=italia1]
92184 [host=godello1]
92350 [host=godello0]
92375 [host=godello0]
92389 [host=nocera0]
92401 [host=fiano0]
92710 [host=godello1]
92731 [host=rimava0]
92827 [host=godello1]
92847 [host=chardonnay1]
92860 [host=fiano1]
92966 [host=fiano1]
93010 [host=baroque0]
92992 [host=baroque0]
93020 [host=rimava1]
93093 [host=rimava0]
93195 [host=chardonnay0]
93226 [host=italia1]
93229 [host=rimava1]
93352 [host=rimava0]
93361 [host=baroque0]
93366 [host=nocera0]
93406 [host=chardonnay0]
93402 [host=rimava1]
93412 [host=fiano1]
93460 [host=baroque0]
93447 [host=baroque0]
93482 [host=baroque0]
93452 [host=rimava1]
93471 [host=baroque0]
93533 [host=baroque0]
93611 [host=baroque0]
93607 [host=italia1]
93623 [host=chardonnay1]
93908 [host=italia1]
93911 [host=chardonnay1]
93921 [host=italia1]
93999 [host=italia1]
94004 [host=fiano1]
94032 [host=huxelrebe0]
94022 [host=italia1]
94043 [host=chardonnay0]
94028 [host=fiano0]
94058 [host=fiano1]
94060 [host=baroque1]
94112 pass irrelevant
94428 [host=baroque1]
94489 [host=baroque1]
94483 [host=baroque1]
94514 [host=elbling0]
94529 [host=rimava1]
94521 [host=merlot1]
94547 [host=elbling0]
94551 [host=pinot1]
94556 [host=pinot1]
94557 [host=chardonnay1]
94579 [host=baroque0]
94582 [host=fiano1]
94721 [host=chardonnay0]
94666 [host=baroque0]
94723 [host=merlot1]
94725 [host=fiano1]
94767 [host=rimava1]
94744 [host=baroque1]
94769 [host=baroque0]
94764 [host=chardonnay1]
94774 [host=pinot1]
94851 [host=elbling0]
94799 [host=baroque1]
94844 [host=fiano0]
94956 [host=baroque1]
95081 [host=nocera0]
95084 [host=huxelrebe1]
95128 [host=baroque1]
95193 [host=nocera0]
95204 [host=huxelrebe1]
95143 [host=huxelrebe1]
95187 [host=chardonnay1]
95149 [host=elbling0]
95241 [host=chardonnay1]
95214 [host=pinot1]
95246 [host=baroque1]
95236 [host=nocera0]
95239 [host=italia1]
95378 [host=italia1]
95426 [host=italia0]
95449 [host=italia0]
95438 [host=italia0]
95443 [host=baroque0]
95475 [host=nocera1]
95478 [host=nocera0]
95480 [host=baroque1]
95513 [host=fiano0]
95496 [host=baroque0]
95652 [host=italia0]
95662 [host=elbling0]
95732 [host=nocera0]
95735 [host=elbling0]
95786 [host=italia0]
95866 [host=fiano0]
95853 [host=nocera1]
95858 [host=baroque1]
96000 [host=nocera0]
96011 [host=italia1]
96064 [host=godello0]
96071 [host=nocera1]
96055 [host=godello0]
96074 [host=godello1]
96116 [host=huxelrebe1]
96182 [host=godello1]
96214 [host=godello1]
96189 [host=huxelrebe1]
96177 [host=pinot1]
96210 [host=godello1]
96310 [host=baroque1]
96340 [host=godello1]
96349 [host=huxelrebe1]
96382 [host=godello0]
96399 [host=huxelrebe1]
96476 [host=baroque1]
96470 [host=huxelrebe1]
96626 [host=huxelrebe1]
96641 [host=huxelrebe1]
96669 [host=godello1]
96731 [host=pinot1]
96783 [host=huxelrebe1]
96766 [host=huxelrebe0]
96770 [host=baroque0]
96790 [host=huxelrebe0]
96794 [host=baroque0]
97261 [host=baroque1]
97302 [host=chardonnay1]
97269 [host=godello1]
97274 [host=fiano0]
97276 [host=huxelrebe0]
97310 [host=fiano0]
97306 [host=godello0]
97356 [host=godello0]
97382 [host=godello0]
97368 [host=baroque0]
97661 [host=godello0]
97614 [host=baroque1]
97707 [host=huxelrebe1]
97722 [host=fiano1]
97725 [host=fiano1]
99610 [host=godello1]
99654 [host=huxelrebe0]
99642 [host=baroque0]
99722 [host=baroque1]
99729 [host=chardonnay0]
99736 [host=chardonnay1]
99707 [host=huxelrebe1]
99732 [host=godello1]
99740 [host=baroque0]
99745 [host=baroque0]
99750 [host=baroque1]
99768 [host=chardonnay0]
99883 [host=huxelrebe0]
99887 [host=godello0]
99890 [host=baroque1]
99940 [host=fiano1]
99921 [host=godello0]
99900 [host=huxelrebe1]
99907 [host=baroque1]
99909 [host=baroque1]
99926 [host=huxelrebe0]
99929 [host=italia0]
99945 [host=huxelrebe1]
99932 [host=godello1]
99947 [host=godello1]
99958 [host=huxelrebe1]
99948 [host=godello1]
99970 [host=baroque1]
100368 [host=huxelrebe1]
100394 [host=godello0]
100382 [host=chardonnay1]
100370 [host=godello0]
100373 [host=italia1]
100374 [host=fiano1]
100341 [host=pinot1]
100344 [host=huxelrebe0]
100346 [host=elbling0]
100349 [host=italia0]
100375 [host=baroque0]
100396 [host=pinot1]
100387 [host=godello0]
100365 [host=godello0]
100378 [host=godello1]
100391 [host=baroque1]
100417 [host=italia1]
100412 [host=fiano1]
100415 [host=huxelrebe1]
100457 [host=huxelrebe1]
100468 [host=huxelrebe0]
100490 [host=elbling0]
100493 [host=elbling0]
100515 [host=godello1]
100535 [host=baroque1]
100543 [host=godello1]
100548 [host=huxelrebe0]
100606 [host=baroque1]
100561 [host=elbling0]
100621 [host=baroque1]
100564 [host=huxelrebe1]
100568 [host=italia0]
100583 [host=baroque1]
100654 [host=huxelrebe0]
100619 [host=fiano1]
100661 [host=godello1]
100662 [host=huxelrebe0]
100680 [host=baroque1]
100736 [host=huxelrebe0]
100682 [host=godello0]
100695 [host=chardonnay0]
100697 [host=chardonnay0]
100698 [host=godello0]
100718 [host=italia0]
100720 [host=baroque0]
100732 [host=baroque0]
100733 [host=baroque0]
100755 [host=huxelrebe1]
100763 [host=huxelrebe1]
100759 [host=baroque0]
100775 [host=godello1]
100785 [host=italia1]
100791 [host=chardonnay1]
100818 [host=chardonnay0]
100822 [host=italia1]
100800 [host=huxelrebe0]
100840 [host=godello0]
100852 [host=fiano0]
100862 [host=huxelrebe1]
100812 [host=huxelrebe1]
100855 [host=fiano0]
100889 [host=baroque1]
100891 [host=baroque1]
100924 [host=huxelrebe0]
100964 [host=godello1]
100967 [host=fiano0]
100968 [host=fiano1]
100961 [host=baroque1]
100991 [host=godello1]
101009 [host=chardonnay0]
101011 [host=fiano0]
101014 [host=huxelrebe1]
101018 [host=fiano1]
101047 [host=huxelrebe1]
101080 [host=godello1]
101082 [host=fiano0]
101056 [host=italia1]
101083 [host=godello1]
101155 [host=baroque1]
101126 [host=chardonnay0]
101191 [host=godello0]
101193 [host=godello0]
101194 [host=chardonnay0]
101166 [host=chardonnay0]
101153 [host=huxelrebe0]
101183 [host=fiano0]
101184 [host=italia1]
101195 [host=godello0]
101174 [host=huxelrebe0]
101207 [host=chardonnay0]
101187 [host=godello1]
101198 [host=godello1]
101212 [host=italia1]
101226 [host=italia1]
101229 [host=fiano0]
101221 [host=huxelrebe0]
101224 [host=baroque1]
101227 [host=baroque1]
101245 [host=baroque1]
101252 [host=huxelrebe1]
101282 [host=italia1]
101259 [host=fiano0]
101262 [host=huxelrebe0]
101264 [host=godello1]
101323 [host=godello1]
101352 [host=huxelrebe1]
101356 [host=godello1]
101359 [host=baroque1]
101376 [host=huxelrebe1]
101418 [host=godello1]
101403 [host=baroque1]
101422 [host=huxelrebe0]
101445 [host=godello1]
101448 [host=italia1]
101458 [host=elbling1]
101489 [host=godello1]
101492 [host=chardonnay1]
101518 [host=godello0]
101522 [host=huxelrebe1]
101512 [host=fiano1]
101564 [host=italia0]
101567 [host=godello0]
101560 [host=fiano1]
101575 [host=godello0]
101583 [host=baroque0]
101592 [host=chardonnay1]
101643 [host=godello1]
101646 [host=chardonnay1]
101686 [host=elbling1]
101651 [host=baroque0]
101692 [host=godello1]
101689 [host=godello1]
101717 [host=italia0]
101722 [host=godello1]
101752 [host=godello0]
101824 [host=huxelrebe1]
101827 [host=huxelrebe0]
101834 [host=elbling1]
101892 [host=huxelrebe1]
101928 [host=huxelrebe1]
101884 [host=huxelrebe0]
101887 [host=elbling1]
101888 [host=godello1]
101929 [host=godello0]
101996 [host=baroque0]
102022 [host=chardonnay1]
102003 [host=huxelrebe0]
102102 [host=godello1]
102079 [host=pinot1]
102107 [host=huxelrebe0]
102092 [host=baroque0]
102095 [host=pinot1]
102129 [host=godello1]
102149 [host=huxelrebe0]
102210 [host=godello1]
102271 [host=huxelrebe0]
102267 [host=chardonnay1]
102296 [host=godello1]
102308 [host=huxelrebe0]
102390 [host=nobling0]
102485 [host=merlot0]
102490 [host=nobling0]
102516 [host=nobling0]
102526 [host=baroque0]
102568 [host=godello1]
102576 [host=godello0]
102645 [host=merlot0]
102647 [host=nobling0]
102650 [host=godello0]
102693 [host=merlot0]
102719 [host=baroque0]
102713 [host=godello0]
102717 [host=nobling0]
102812 [host=baroque0]
102796 [host=italia1]
102944 [host=chardonnay0]
102948 [host=nobling0]
102959 [host=chardonnay1]
102967 [host=baroque1]
103045 [host=baroque1]
103082 [host=nobling0]
102994 [host=chardonnay1]
103027 [host=chardonnay0]
103012 [host=baroque0]
103037 [host=baroque0]
103062 [host=chardonnay0]
103094 [host=godello0]
103137 [host=nobling0]
103144 [host=godello0]
103167 [host=godello0]
103198 [host=nobling0]
103221 [host=italia1]
103201 [host=fiano0]
103214 [host=baroque1]
103277 [host=italia0]
103254 [host=nobling0]
103265 [host=baroque0]
103284 [host=godello1]
103292 [host=huxelrebe0]
103296 [host=godello0]
103325 [host=huxelrebe0]
103342 [host=nobling0]
103306 [host=nobling0]
103336 [host=chardonnay1]
103317 [host=godello1]
103373 [host=nobling0]
103356 [host=godello0]
103364 [host=italia0]
103378 [host=godello1]
103385 [host=italia1]
103390 [host=merlot1]
103401 [host=nobling0]
103406 [host=italia0]
103456 [host=godello1]
103412 [host=godello0]
103439 [host=godello1]
103417 [host=baroque1]
103422 [host=italia1]
103470 [host=godello0]
103429 [host=huxelrebe0]
103448 [host=godello0]
103463 [host=godello0]
103481 [host=baroque1]
103503 [host=nobling0]
103511 [host=nobling0]
103746 [host=italia1]
103759 [host=godello1]
103760 [host=italia1]
103793 [host=nobling0]
103761 [host=godello0]
103771 [host=fiano1]
103774 [host=nobling0]
103780 [host=fiano1]
103789 [host=chardonnay0]
103804 [host=nobling0]
103806 [host=nobling1]
103808 [host=italia1]
103842 [host=godello0]
103929 [host=baroque1]
103956 [host=baroque1]
104029 [host=nobling1]
104018 [host=godello0]
104007 [host=nobling1]
104033 [host=nobling1]
104010 [host=italia1]
104011 [host=godello0]
104048 [host=italia1]
104042 [host=nobling1]
104050 [host=nobling1]
104046 [host=chardonnay0]
104059 [host=nobling1]
104064 [host=huxelrebe1]
104082 [host=nobling1]
104097 [host=nobling1]
104101 [host=italia1]
104124 [host=nobling1]
104125 [host=nobling1]
104127 [host=nobling1]
104156 [host=italia0]
104171 [host=huxelrebe1]
104166 [host=italia0]
104195 [host=nobling1]
104203 [host=nobling1]
104206 [host=nobling1]
104232 [host=chardonnay0]
104262 [host=italia0]
104252 [host=nobling0]
104276 [host=huxelrebe1]
104293 [host=nobling0]
104352 [host=godello1]
104357 [host=huxelrebe1]
104349 [host=italia1]
104621 [host=huxelrebe0]
104626 [host=baroque0]
104628 [host=baroque0]
104630 [host=godello1]
104682 [host=godello1]
104666 [host=godello0]
104642 [host=fiano0]
104699 [host=nobling1]
104644 [host=huxelrebe0]
104669 [host=nobling0]
104647 [host=baroque0]
104688 [host=italia1]
104648 [host=fiano0]
104671 [host=nobling1]
104649 [host=nobling1]
104651 [host=nobling1]
104673 [host=nobling1]
104655 [host=godello0]
104701 [host=nobling1]
104690 [host=baroque0]
104676 [host=nobling1]
104658 [host=godello0]
104661 [host=nobling1]
104664 [host=fiano0]
104679 [host=nobling1]
104692 [host=nobling0]
104704 [host=nobling1]
104722 [host=nobling1]
104697 [host=godello1]
104713 [host=huxelrebe1]
104707 [host=nobling1]
104716 [host=nobling1]
104709 [host=nobling1]
104725 [host=italia0]
104737 [host=baroque1]
104764 [host=godello1]
105021 [host=godello0]
105009 [host=baroque1]
105036 [host=nobling1]
105047 [host=nobling1]
105158 [host=nobling1]
105207 [host=fiano1]
105212 [host=nobling0]
105218 [host=fiano1]
105283 [host=italia1]
105289 [host=nobling1]
105293 [host=nobling0]
105358 [host=huxelrebe0]
105374 [host=italia1]
105569 [host=huxelrebe1]
105584 [host=nobling0]
105605 [host=godello0]
105609 [host=italia1]
105644 [host=godello1]
105645 [host=godello1]
105666 [host=baroque1]
105647 [host=huxelrebe0]
105650 [host=baroque0]
105635 [host=baroque1]
105653 [host=baroque0]
105670 [host=nobling1]
105637 [host=baroque0]
105642 [host=huxelrebe1]
105692 [host=godello0]
105764 [host=huxelrebe0]
105797 [host=nobling1]
105769 [host=nobling0]
105771 [host=baroque1]
105788 [host=huxelrebe0]
105792 [host=godello0]
105836 [host=huxelrebe1]
105825 [host=nobling1]
105820 [host=godello0]
105822 [host=nobling1]
105830 [host=nobling0]
105879 [host=godello0]
105880 [host=nobling1]
105852 [host=godello0]
105857 [host=merlot0]
105858 [host=rimava0]
105881 [host=rimava1]
105860 [host=rimava0]
105930 [host=nobling1]
105862 [host=rimava1]
105864 [host=godello0]
105866 [host=italia1]
105871 [host=merlot0]
105888 [host=baroque1]
105872 [host=baroque0]
105892 [host=nobling1]
105932 [host=baroque1]
105927 [host=merlot0]
105950 [host=nobling0]
105953 [host=godello1]
106016 [host=godello1]
105987 [host=italia1]
105985 [host=italia1]
105993 [host=rimava0]
105986 [host=nobling0]
106000 [host=baroque1]
106032 [host=godello0]
106060 [host=godello1]
106071 [host=godello1]
106084 [host=huxelrebe1]
106089 [host=godello1]
106208 [host=italia1]
106269 [host=godello0]
106196 [host=huxelrebe0]
106199 [host=baroque1]
106258 [host=baroque0]
106273 [host=huxelrebe0]
106297 [host=huxelrebe0]
106301 [host=huxelrebe1]
106361 [host=fiano1]
106310 [host=italia0]
106374 [host=fiano1]
106320 [host=italia0]
106366 [host=godello0]
106380 [host=godello0]
106368 [host=fiano1]
106402 [host=huxelrebe1]
106417 [host=godello1]
106413 [host=baroque0]
106408 [host=huxelrebe1]
106419 [host=rimava0]
106497 [host=fiano1]
106505 [host=fiano0]
106536 [host=fiano1]
106530 [host=godello0]
106569 [host=godello1]
106551 [host=italia1]
106573 [host=merlot0]
106555 [host=merlot0]
106557 [host=fiano0]
106558 [host=huxelrebe1]
106639 [host=huxelrebe0]
106658 [host=huxelrebe0]
106748 [host=godello1]
106664 [host=godello1]
106666 [host=godello1]
106667 [host=italia1]
106690 [host=baroque0]
106670 [host=italia0]
106672 [host=rimava0]
106673 [host=rimava0]
106675 [host=huxelrebe1]
106693 [host=godello1]
106677 [host=godello1]
106680 [host=huxelrebe1]
106723 [host=baroque0]
106683 [host=baroque0]
106726 [host=godello0]
106742 [host=italia1]
106817 [host=fiano1]
106783 [host=godello0]
106789 [host=huxelrebe1]
106791 [host=fiano1]
106811 [host=fiano1]
106841 [host=huxelrebe0]
106868 [host=chardonnay1]
106851 [host=italia0]
106871 [host=godello0]
106869 [host=godello1]
106935 [host=huxelrebe1]
106887 [host=baroque0]
106890 [host=rimava1]
106936 [host=chardonnay1]
106940 [host=huxelrebe0]
106974 [host=godello1]
106984 [host=huxelrebe1]
106982 [host=baroque0]
107000 [host=italia1]
107033 [host=godello1]
107006 [host=italia0]
107044 [host=godello1]
107030 [host=godello1]
107046 [host=huxelrebe1]
107218 [host=godello1]
107202 [host=italia1]
107163 [host=huxelrebe1]
107177 [host=fiano1]
107167 [host=italia1]
107194 [host=huxelrebe1]
107157 [host=godello0]
107182 [host=huxelrebe1]
107204 [host=huxelrebe1]
107257 [host=italia0]
107287 [host=huxelrebe1]
107276 [host=fiano1]
107229 [host=baroque0]
107242 [host=godello1]
107245 [host=godello0]
107252 [host=huxelrebe0]
107267 [host=chardonnay0]
107271 [host=italia0]
107273 [host=fiano1]
107274 [host=chardonnay0]
107281 [host=godello1]
107340 [host=huxelrebe0]
107355 [host=godello0]
107399 [host=italia0]
107436 [host=italia0]
107401 [host=huxelrebe0]
107430 [host=baroque0]
107433 [host=godello1]
107540 [host=godello0]
107527 [host=godello0]
107549 [host=huxelrebe1]
107544 [host=godello0]
107547 [host=godello0]
107563 [host=huxelrebe0]
107569 [host=huxelrebe1]
107583 [host=chardonnay0]
107588 [host=huxelrebe1]
107589 [host=huxelrebe1]
107631 [host=huxelrebe1]
107650 [host=pinot1]
107709 [host=godello1]
107720 [host=huxelrebe0]
107904 [host=godello1]
108135 [host=elbling1]
108144 [host=godello0]
108232 [host=huxelrebe0]
108235 [host=rimava1]
109014 [host=godello0]
109036 [host=rimava1]
109178 [host=nobling0]
109174 [host=godello0]
109185 [host=godello0]
109189 [host=godello0]
109232 [host=elbling1]
109263 [host=godello0]
109353 [host=godello1]
109359 [host=huxelrebe0]
109498 [host=godello1]
109495 [host=godello1]
109503 [host=godello1]
109537 [host=godello1]
109543 [host=godello0]
109547 [host=godello1]
109579 [host=godello0]
109570 [host=huxelrebe0]
109577 [host=godello0]
109619 [host=godello0]
109624 [host=godello1]
109609 [host=godello1]
109621 [host=elbling1]
109725 [host=godello0]
109745 [host=godello0]
109740 [host=godello0]
109860 [host=merlot0]
109864 [host=huxelrebe0]
109887 [host=godello0]
109890 [host=baroque1]
109900 [host=huxelrebe0]
109902 [host=italia1]
109935 [host=baroque0]
109907 [host=nobling0]
109912 [host=nobling0]
109924 [host=godello0]
109929 [host=rimava1]
110043 [host=chardonnay0]
110068 [host=baroque0]
110052 [host=rimava1]
110083 [host=italia1]
110035 [host=nobling0]
110057 [host=nobling0]
110062 [host=godello1]
110066 [host=chardonnay0]
110087 [host=baroque1]
110074 [host=godello0]
110097 [host=godello1]
110092 [host=nobling1]
110187 [host=nobling1]
110201 [host=huxelrebe0]
110408 [host=nobling1]
110365 [host=elbling0]
110412 [host=huxelrebe0]
110375 [host=nobling0]
110440 [host=godello1]
110415 [host=elbling0]
110402 [host=elbling0]
110416 [host=godello0]
110436 [host=nobling0]
110406 [host=godello1]
110455 [host=elbling1]
110476 [host=nobling1]
110492 [host=nobling1]
110567 [host=godello0]
110573 [host=elbling1]
110907 [host=nobling0]
110940 [host=nobling0]
110948 [host=nobling0]
110976 [host=godello1]
110964 [host=merlot1]
111006 [host=chardonnay0]
111020 [host=godello1]
111009 [host=nobling1]
111075 [host=rimava1]
111121 [host=godello0]
111116 [host=fiano0]
111119 [host=fiano0]
111154 [host=godello1]
111146 [host=merlot1]
111159 [host=fiano0]
111226 [host=nobling1]
111187 [host=godello1]
111241 [host=nobling1]
111234 [host=godello1]
111237 [host=chardonnay0]
111244 [host=elbling1]
111372 [host=nobling1]
111376 [host=nobling0]
111364 [host=godello0]
111371 [host=nobling1]
111535 [host=rimava0]
111733 [host=huxelrebe1]
111804 [host=rimava0]
111978 [host=huxelrebe1]
111993 [host=huxelrebe1]
112023 [host=nobling1]
112012 [host=nobling1]
112017 [host=nobling1]
112058 [host=chardonnay1]
112062 [host=nobling1]
112104 [host=huxelrebe0]
112270 [host=nobling1]
112331 [host=huxelrebe0]
112284 [host=huxelrebe0]
112297 [host=nobling1]
112328 [host=nobling1]
112341 [host=nobling1]
112345 [host=huxelrebe0]
112346 [host=nobling1]
112365 [host=huxelrebe1]
112402 [host=huxelrebe0]
113147 [host=godello0]
113142 [host=baroque1]
113152 [host=godello1]
113321 [host=huxelrebe1]
113362 [host=godello1]
113372 [host=chardonnay1]
113440 [host=chardonnay1]
113450 [host=godello1]
113410 [host=godello1]
113429 [host=nobling1]
113384 [host=godello0]
113414 [host=godello1]
113451 [host=godello0]
113417 [host=nobling1]
113403 [host=nocera0]
113433 [host=huxelrebe0]
113421 [host=chardonnay0]
113427 [host=chardonnay0]
113442 [host=godello1]
113438 pass irrelevant
113449 [host=elbling0]
113456 pass irrelevant
113480 [host=godello0]
113493 [host=nocera0]
113579 [host=rimava1]
113584 [host=nobling0]
113581 [host=huxelrebe1]
113612 [host=nobling0]
113610 [host=huxelrebe1]
113637 [host=huxelrebe1]
113643 [host=huxelrebe1]
113662 [host=rimava1]
113669 [host=godello1]
113721 [host=huxelrebe0]
113732 [host=godello0]
113737 [host=godello0]
113811 [host=nobling1]
113814 [host=huxelrebe0]
113815 [host=nobling0]
113833 [host=nobling1]
113830 [host=rimava1]
113865 [host=nobling0]
113912 [host=godello1]
113914 [host=nobling0]
113879 [host=nobling0]
113883 [host=nocera0]
113887 [host=huxelrebe0]
113911 [host=nobling0]
113949 [host=nobling1]
113951 [host=nobling0]
113948 [host=huxelrebe0]
113952 [host=nobling1]
113971 [host=italia0]
113972 [host=italia0]
113979 [host=nobling1]
114047 [host=baroque1]
113986 [host=chardonnay0]
113989 [host=godello1]
114035 [host=baroque0]
113991 [host=huxelrebe1]
114079 [host=godello0]
114015 [host=elbling0]
113992 [host=chardonnay0]
114020 pass irrelevant
113995 [host=huxelrebe1]
114021 [host=baroque0]
113997 [host=huxelrebe1]
114001 [host=baroque0]
114022 pass irrelevant
114005 [host=nobling1]
114007 [host=godello1]
114008 [host=baroque0]
114039 [host=baroque1]
114049 [host=fiano0]
114025 [host=elbling0]
114010 [host=nobling0]
114056 [host=huxelrebe0]
114065 [host=italia0]
114090 [host=merlot1]
114028 [host=huxelrebe1]
114041 [host=godello1]
114032 [host=nobling1]
114053 [host=fiano0]
114094 [host=fiano0]
114044 [host=nobling1]
114059 [host=godello1]
114054 [host=baroque1]
114062 [host=huxelrebe0]
114067 [host=baroque0]
114098 [host=chardonnay0]
114095 [host=godello0]
114077 [host=rimava1]
114082 [host=baroque0]
114084 [host=godello1]
114085 [host=elbling0]
114087 [host=italia0]
114131 [host=italia0]
114159 [host=italia0]
114182 [host=godello0]
114104 [host=huxelrebe1]
114108 [host=merlot0]
114149 [host=godello0]
114110 [host=fiano0]
114112 [host=merlot0]
114137 [host=godello0]
114121 [host=nobling0]
114201 [host=godello1]
114153 [host=huxelrebe1]
114166 [host=baroque0]
114144 [host=godello0]
114177 [host=baroque0]
114188 [host=baroque1]
114193 [host=nobling0]
114199 [host=huxelrebe0]
114267 [host=huxelrebe0]
114289 [host=baroque1]
114299 [host=baroque1]
114308 [host=rimava1]
114318 [host=rimava1]
114332 [host=nobling1]
114335 [host=nobling1]
114376 [host=godello0]
114393 [host=nobling1]
114346 [host=godello1]
114371 [host=huxelrebe1]
114354 [host=fiano0]
114360 [host=huxelrebe1]
114389 [host=elbling0]
114404 [host=baroque1]
114418 [host=godello1]
114426 [host=godello0]
114460 [host=huxelrebe0]
114544 [host=italia0]
114547 [host=huxelrebe0]
114653 [host=nocera1]
114683 [host=godello0]
114696 [host=godello0]
114756 [host=huxelrebe0]
114776 [host=godello0]
114780 [host=huxelrebe0]
114792 [host=nobling1]
114800 [host=huxelrebe0]
115156 [host=merlot0]
115148 [host=nobling0]
115217 [host=godello0]
115187 [host=fiano0]
115192 [host=nobling1]
115298 [host=nobling1]
115301 [host=godello0]
115303 [host=godello0]
115505 [host=elbling1]
115502 [host=huxelrebe1]
115490 [host=huxelrebe1]
115497 [host=elbling1]
115500 [host=nobling0]
115512 [host=huxelrebe1]
115515 [host=italia1]
115519 [host=rimava1]
115522 [host=nocera0]
115524 [host=nocera0]
115527 [host=nobling0]
115534 [host=nocera0]
115531 [host=nocera0]
115616 [host=nobling1]
115645 [host=godello0]
115704 [host=godello1]
115676 [host=rimava1]
116158 [host=godello0]
116143 [host=nobling1]
116162 [host=nobling1]
116137 [host=godello0]
116213 [host=nobling0]
116218 [host=huxelrebe1]
116232 [host=pinot1]
116406 [host=italia1]
116472 [host=pinot1]
116483 [host=nocera1]
116587 [host=nobling1]
116639 [host=nobling1]
116621 [host=nocera0]
116635 [host=baroque0]
116655 [host=chardonnay0]
116650 [host=nobling1]
116645 [host=huxelrebe1]
116659 [host=pinot1]
116667 [host=chardonnay0]
116673 [host=huxelrebe1]
116757 [host=merlot0]
116752 [host=italia0]
116761 [host=italia0]
116756 [host=merlot0]
116764 [host=italia0]
116828 [host=italia0]
116877 [host=italia0]
116916 [host=godello0]
116943 [host=huxelrebe1]
116956 [host=godello0]
117015 [host=merlot0]
117017 [host=nocera0]
117022 [host=elbling0]
117027 [host=godello0]
117178 [host=elbling0]
117145 [host=godello1]
117124 [host=godello1]
117169 [host=godello1]
117127 [host=godello1]
117201 [host=elbling0]
117152 [host=godello1]
117183 [host=godello0]
117139 [host=godello0]
117173 [host=huxelrebe0]
117157 [host=godello1]
117175 [host=godello1]
117162 [host=godello0]
117166 [host=huxelrebe0]
117193 [host=godello0]
117187 [host=huxelrebe1]
117200 [host=godello1]
117203 [host=huxelrebe1]
117208 [host=godello1]
117339 [host=godello1]
117372 [host=godello0]
117384 [host=godello0]
117600 [host=godello0]
117564 [host=godello0]
117568 [host=godello0]
117569 [host=godello0]
117604 [host=pinot1]
117570 [host=godello0]
117572 [host=godello0]
117565 [host=godello0]
117576 [host=godello0]
117606 [host=rimava1]
117634 [host=chardonnay0]
117663 [host=rimava0]
117728 [host=godello1]
117771 [host=fiano1]
117843 [host=elbling0]
117834 [host=godello1]
117924 [host=chardonnay0]
117927 [host=rimava1]
118105 [host=godello1]
118056 [host=elbling0]
118110 [host=pinot1]
118113 [host=chardonnay0]
118121 [host=elbling0]
118150 [host=godello1]
118173 [host=godello0]
118127 [host=fiano1]
118158 [host=fiano1]
118133 [host=godello1]
118197 [host=baroque0]
118160 [host=chardonnay1]
118139 [host=godello1]
118146 [host=godello0]
118162 [host=chardonnay0]
118187 [host=chardonnay1]
118226 fail irrelevant
118178 [host=godello1]
118194 [host=rimava0]
118199 [host=italia0]
118203 [host=godello0]
118206 [host=italia0]
118210 [host=italia0]
118219 [host=elbling0]
118229 [host=rimava0]
118228 pass irrelevant
118234 [host=rimava0]
118232 [host=rimava0]
118233 [host=rimava0]
118231 [host=rimava0]
118235 [host=elbling1]
118310 [host=godello0]
118331 [host=italia0]
118271 [host=pinot1]
118274 [host=godello0]
118290 [host=godello0]
118282 [host=godello1]
118305 [host=italia1]
118312 [host=huxelrebe1]
118326 [host=huxelrebe1]
118327 [host=fiano1]
118453 [host=baroque0]
118459 pass irrelevant
118460 [host=italia1]
118419 [host=godello0]
118361 [host=italia0]
118381 [host=huxelrebe1]
118391 [host=fiano0]
118363 [host=godello0]
118339 [host=huxelrebe1]
118366 [host=huxelrebe1]
118344 [host=godello0]
118346 [host=italia0]
118404 [host=baroque0]
118348 [host=fiano0]
118349 [host=rimava0]
118350 [host=italia0]
118382 pass irrelevant
118395 [host=baroque0]
118351 [host=godello0]
118385 [host=godello0]
118354 [host=baroque0]
118359 [host=fiano0]
118372 [host=godello0]
118397 [host=baroque0]
118386 [host=godello1]
118376 [host=godello1]
118388 [host=fiano0]
118390 [host=baroque0]
118409 [host=italia1]
118427 [host=baroque0]
118421 [host=fiano0]
118405 [host=huxelrebe1]
118399 [host=godello0]
118408 [host=pinot1]
118418 [host=elbling0]
118433 [host=godello1]
118413 [host=godello0]
118425 [host=huxelrebe1]
118429 [host=huxelrebe1]
118424 [host=godello0]
118426 [host=baroque0]
118432 [host=italia0]
118434 [host=baroque0]
118437 [host=chardonnay1]
118439 [host=baroque0]
118442 [host=fiano0]
118541 [host=godello0]
118479 [host=godello1]
118485 [host=baroque0]
118542 [host=godello1]
118509 [host=chardonnay1]
118537 [host=chardonnay0]
118543 [host=italia0]
118539 [host=chardonnay0]
118544 [host=godello1]
118547 [host=pinot1]
118656 [host=godello0]
118591 [host=godello0]
118649 [host=godello0]
118597 [host=italia1]
118620 [host=huxelrebe1]
118651 [host=godello0]
118626 [host=godello1]
118652 [host=godello0]
118653 [host=godello0]
118660 [host=huxelrebe1]
118654 [host=godello0]
118641 [host=godello0]
118650 [host=godello0]
118665 [host=chardonnay0]
118690 [host=baroque0]
118704 [host=godello0]
118713 [host=italia0]
118995 [host=godello0]
119123 [host=baroque1]
119170 [host=baroque1]
119079 [host=godello1]
119127 [host=baroque1]
119157 [host=baroque1]
119129 [host=baroque1]
119138 [host=baroque1]
119124 [host=baroque1]
119098 [host=chardonnay0]
119130 [host=baroque1]
119108 [host=pinot1]
119146 [host=baroque1]
119114 [host=baroque1]
119116 [host=pinot1]
119134 [host=baroque1]
119152 [host=baroque1]
119139 [host=baroque1]
119150 [host=baroque1]
119141 [host=baroque1]
119144 [host=baroque1]
119154 [host=baroque1]
119160 [host=baroque1]
119155 [host=baroque1]
119167 [host=baroque1]
119190 [host=italia1]
119174 [host=baroque1]
119175 [host=baroque1]
119208 [host=godello0]
119270 [host=godello0]
119295 [host=baroque1]
119308 [host=baroque0]
119436 [host=baroque1]
119657 [host=baroque1]
119669 [host=pinot1]
119721 [host=pinot1]
119783 [host=godello1]
119752 [host=huxelrebe1]
119834 [host=baroque0]
119959 [host=baroque0]
119966 [host=baroque0]
120058 [host=godello0]
120051 [host=baroque1]
120078 [host=huxelrebe1]
120071 [host=huxelrebe1]
120044 [host=huxelrebe1]
120066 [host=baroque0]
120098 [host=huxelrebe1]
120130 pass irrelevant
120106 [host=italia1]
120107 [host=godello1]
120164 [host=baroque1]
120134 [host=godello1]
120151 [host=godello1]
120126 [host=italia1]
120169 [host=godello1]
120177 [host=italia1]
120271 [host=italia1]
120282 [host=italia1]
120313 [host=italia0]
120263 [host=italia1]
120304 [host=godello1]
120268 [host=elbling0]
120286 [host=baroque1]
120288 [host=italia1]
120316 [host=italia0]
120370 [host=chardonnay1]
120321 [host=chardonnay0]
120347 [host=chardonnay0]
120329 [host=huxelrebe1]
120354 [host=italia0]
120334 [host=godello0]
120342 pass irrelevant
120372 [host=godello1]
120582 [host=italia0]
120679 [host=godello0]
120685 [host=huxelrebe1]
120688 [host=godello0]
120699 [host=italia1]
120709 [host=rimava0]
120721 [host=huxelrebe1]
120759 [host=italia0]
120745 [host=godello0]
120733 [host=huxelrebe1]
120751 [host=rimava0]
120794 [host=baroque1]
120812 [host=italia0]
120805 [host=chardonnay1]
120838 [host=huxelrebe1]
120844 [host=huxelrebe1]
120851 [host=italia1]
120854 [host=godello1]
120949 [host=huxelrebe1]
121014 [host=italia0]
121004 [host=italia0]
121043 [host=italia1]
120993 [host=baroque1]
120987 [host=godello1]
121009 [host=baroque0]
121001 [host=godello0]
121017 [host=italia1]
121021 [host=godello0]
121028 [host=baroque0]
121036 [host=godello0]
121084 [host=baroque0]
121065 [host=italia1]
121068 [host=godello1]
121090 [host=godello1]
121316 [host=baroque0]
121317 [host=elbling0]
121319 [host=godello0]
121348 [host=godello1]
121297 [host=godello0]
121301 [host=baroque1]
121306 [host=baroque0]
121312 [host=chardonnay1]
121329 [host=elbling0]
121334 [host=huxelrebe1]
121344 [host=italia0]
121346 [host=italia1]
121354 [host=fiano1]
121369 [host=huxelrebe1]
121377 [host=elbling1]
121675 [host=godello0]
121776 [host=godello0]
121747 [host=godello1]
121752 [host=godello1]
121791 [host=baroque1]
121876 [host=elbling1]
121889 [host=baroque0]
121905 [host=chardonnay0]
121920 [host=baroque1]
121936 [host=pinot1]
121947 [host=godello1]
121953 [host=chardonnay1]
121960 [host=italia1]
121971 [host=italia1]
122021 [host=godello0]
122014 [host=godello1]
121978 [host=godello0]
122077 [host=huxelrebe1]
122003 [host=godello0]
122002 [host=pinot1]
121982 [host=fiano1]
122056 [host=italia1]
121986 [host=pinot1]
122025 [host=baroque1]
122008 [host=godello0]
121989 [host=pinot1]
122010 [host=godello0]
121990 [host=pinot1]
122036 [host=huxelrebe1]
121992 [host=pinot1]
122011 [host=godello0]
121996 [host=pinot1]
121997 [host=pinot1]
122000 [host=pinot1]
122013 [host=godello0]
122017 [host=godello0]
122027 [host=godello1]
122019 [host=godello0]
122034 [host=huxelrebe1]
122047 [host=godello0]
122042 [host=italia1]
122066 [host=huxelrebe1]
122083 [host=huxelrebe1]
122087 [host=huxelrebe1]
122122 [host=baroque0]
122157 [host=chardonnay0]
122097 [host=godello1]
122106 [host=rimava0]
122107 [host=huxelrebe1]
122126 [host=baroque1]
122146 [host=godello1]
122108 [host=huxelrebe1]
122113 [host=baroque0]
122191 [host=fiano0]
122117 [host=fiano0]
122133 [host=godello1]
122159 [host=huxelrebe1]
122119 [host=fiano0]
122150 [host=godello1]
122149 [host=pinot1]
122136 [host=godello0]
122152 [host=rimava0]
122162 [host=italia1]
122141 [host=baroque0]
122153 [host=godello1]
122156 [host=godello0]
122171 [host=italia1]
122174 [host=godello1]
122193 [host=italia1]
122221 fail irrelevant
122223 fail irrelevant
122264 pass irrelevant
122227 pass irrelevant
122198 [host=godello1]
122258 fail irrelevant
122228 pass irrelevant
122207 [host=godello0]
122259 pass irrelevant
122230 fail irrelevant
122232 pass irrelevant
122215 fail irrelevant
122246 fail irrelevant
122218 pass irrelevant
122247 fail irrelevant
122219 fail irrelevant
122262 fail irrelevant
122251 pass irrelevant
122238 pass irrelevant
122239 fail irrelevant
122242 fail irrelevant
122243 pass irrelevant
122252 fail irrelevant
122257 fail irrelevant
122266 pass irrelevant
122352 [host=huxelrebe1]
122331 pass irrelevant
122366 [host=baroque0]
122371 pass irrelevant
122412 [host=huxelrebe1]
122392 [host=huxelrebe1]
122416 [host=godello0]
122421 [host=baroque0]
122471 [host=fiano0]
122470 [host=fiano0]
122457 [host=italia1]
122446 pass irrelevant
122468 [host=elbling1]
122540 [host=fiano0]
122543 [host=italia1]
122587 pass irrelevant
122553 [host=huxelrebe1]
122579 [host=baroque0]
122620 [host=baroque0]
122635 [host=godello0]
122632 [host=baroque0]
122642 [host=godello1]
122654 [host=baroque0]
122662 [host=godello0]
122664 [host=huxelrebe1]
122665 [host=chardonnay0]
122677 [host=italia1]
122809 [host=italia1]
122848 [host=fiano0]
122852 [host=godello1]
122868 [host=elbling1]
122877 [host=baroque1]
122879 [host=baroque0]
122888 [host=godello1]
122944 [host=godello1]
122959 [host=chardonnay0]
123024 [host=godello1]
123053 [host=baroque0]
123036 [host=italia1]
123068 [host=godello0]
123071 [host=pinot1]
123313 [host=chardonnay0]
123296 [host=huxelrebe1]
123300 [host=godello0]
123303 [host=godello1]
123306 [host=godello1]
123319 [host=godello0]
123321 [host=godello1]
123328 [host=italia0]
123333 [host=italia0]
123352 [host=joubertin1]
123340 [host=elbling1]
123360 [host=debina0]
123798 [host=chardonnay0]
123894 [host=huxelrebe0]
123945 [host=huxelrebe0]
124108 [host=elbling1]
124182 [host=baroque0]
124213 [host=huxelrebe1]
124353 [host=chardonnay0]
124502 [host=baroque0]
124849 [host=chardonnay0]
124927 [host=godello0]
124916 [host=godello0]
124971 [host=albana1]
124963 [host=baroque0]
124986 [host=godello0]
124997 [host=albana1]
125058 [host=debina1]
125078 [host=albana0]
125029 [host=albana1]
125067 [host=chardonnay1]
125030 [host=albana1]
125068 [host=pinot1]
125063 [host=debina1]
125076 [host=albana0]
125074 [host=baroque0]
125080 [host=pinot1]
125149 [host=fiano1]
125101 [host=debina1]
125153 [host=debina1]
125135 [host=godello1]
125155 [host=albana1]
125140 [host=albana1]
125117 [host=albana0]
125142 [host=godello1]
125125 [host=albana0]
125237 [host=albana0]
125247 [host=debina1]
125269 [host=godello0]
125311 [host=godello0]
125324 [host=albana1]
125341 [host=fiano1]
125412 [host=godello0]
125432 [host=baroque0]
125421 [host=elbling0]
125439 [host=chardonnay0]
125442 [host=chardonnay0]
125444 [host=chardonnay0]
125447 [host=chardonnay0]
125445 [host=chardonnay0]
125448 [host=chardonnay0]
125449 [host=chardonnay0]
125450 [host=chardonnay0]
125473 [host=godello1]
125479 [host=godello1]
125451 [host=chardonnay0]
125456 [host=chardonnay0]
125453 [host=godello1]
125457 [host=chardonnay0]
125459 [host=godello1]
125460 [host=godello1]
125458 [host=chardonnay0]
125461 [host=godello1]
125464 [host=chardonnay0]
125469 [host=chardonnay0]
125463 [host=godello1]
125470 [host=chardonnay0]
125471 [host=godello1]
125474 [host=godello1]
125475 [host=godello1]
125476 [host=godello1]
125516 [host=chardonnay0]
125521 [host=godello1]
125543 [host=debina1]
125541 [host=fiano1]
125549 [host=albana0]
125571 [host=huxelrebe1]
125617 [host=godello1]
125572 [host=huxelrebe1]
125687 [host=godello0]
125690 [host=albana0]
125694 [host=albana1]
125704 [host=godello0]
125729 [host=albana0]
125897 [host=godello1]
125910 [host=debina0]
125943 [host=debina1]
125918 [host=godello1]
125920 [host=debina1]
125923 [host=baroque0]
125928 [host=albana1]
125930 [host=debina0]
125932 [host=baroque0]
125990 [host=godello0]
125936 [host=baroque0]
125939 [host=godello1]
125941 [host=huxelrebe1]
125950 [host=debina0]
125967 [host=albana0]
126000 [host=albana0]
126009 [host=godello1]
126015 [host=rimava1]
126019 [host=elbling1]
126021 [host=baroque0]
126043 [host=baroque0]
126063 pass irrelevant
126049 [host=baroque0]
126054 [host=elbling1]
126253 [host=albana0]
126261 [host=albana1]
126316 [host=godello0]
126329 [host=elbling1]
126324 [host=albana1]
126333 [host=godello0]
126397 [host=debina1]
126469 [host=huxelrebe1]
126702 pass irrelevant
126690 [host=chardonnay0]
126763 [host=albana1]
126769 [host=albana1]
126771 [host=albana1]
126774 [host=albana1]
126777 [host=albana1]
126782 [host=albana1]
126779 [host=debina0]
126785 [host=albana1]
126858 [host=huxelrebe1]
126867 [host=godello1]
126887 [host=baroque1]
126948 [host=joubertin0]
126956 [host=debina1]
126961 [host=baroque1]
126985 [host=godello1]
126991 [host=huxelrebe1]
127047 [host=huxelrebe1]
126996 [host=debina0]
127052 [host=albana0]
127066 [host=debina1]
127042 [host=albana0]
127059 [host=chardonnay0]
127073 [host=debina0]
127079 [host=godello1]
127085 [host=albana1]
127112 [host=godello1]
127130 [host=huxelrebe1]
127091 [host=albana1]
127145 [host=albana1]
127098 [host=debina1]
127104 [host=huxelrebe1]
127118 [host=debina0]
127126 [host=albana1]
127136 [host=huxelrebe1]
127157 [host=albana0]
127154 [host=huxelrebe1]
127164 [host=huxelrebe1]
127173 [host=baroque1]
127180 [host=baroque1]
127184 [host=albana0]
127188 [host=baroque1]
127215 [host=albana0]
127192 [host=baroque1]
127218 [host=albana0]
127222 [host=albana0]
127198 [host=debina0]
127219 [host=albana0]
127236 [host=godello1]
127234 [host=godello1]
127203 [host=baroque1]
127247 [host=huxelrebe1]
127210 [host=albana1]
127225 [host=albana0]
127239 [host=baroque1]
127212 [host=albana1]
127252 [host=godello0]
127224 [host=albana0]
127228 [host=albana1]
127242 [host=albana0]
127246 [host=huxelrebe1]
127265 [host=baroque1]
127260 [host=albana0]
127307 [host=godello0]
127312 [host=baroque1]
127341 [host=godello0]
127347 [host=elbling1]
127368 [host=debina0]
127384 [host=huxelrebe1]
127496 [host=joubertin0]
127499 [host=debina0]
127503 [host=albana0]
127508 [host=godello1]
127542 [host=baroque1]
127575 [host=debina1]
127581 [host=debina1]
127585 [host=albana0]
127587 [host=huxelrebe1]
127615 [host=baroque1]
127774 [host=godello1]
127730 [host=baroque1]
127765 [host=baroque1]
127819 [host=godello0]
127835 [host=debina0]
127881 [host=chardonnay0]
127891 [host=godello0]
127928 [host=godello1]
128013 [host=baroque1]
128019 [host=italia0]
128067 [host=baroque1]
128068 [host=baroque1]
128048 [host=godello1]
128025 [host=albana0]
128069 [host=baroque1]
128029 [host=italia0]
128052 [host=albana0]
128070 [host=baroque1]
128071 [host=baroque1]
128038 [host=baroque1]
128072 [host=baroque1]
128057 [host=baroque1]
128045 [host=godello0]
128061 [host=baroque1]
128063 [host=baroque1]
128073 [host=baroque1]
128080 [host=debina0]
128064 [host=baroque1]
128062 [host=baroque1]
128066 [host=baroque1]
128076 [host=baroque1]
128075 [host=baroque1]
128100 [host=debina0]
128087 [host=debina0]
128093 [host=albana0]
128135 [host=albana0]
128173 [host=fiano1]
128152 [host=albana0]
128191 [host=debina0]
128186 [host=baroque1]
128209 [host=albana0]
128279 [host=baroque1]
128283 [host=huxelrebe1]
128296 [host=godello1]
128323 [host=debina0]
128288 [host=huxelrebe1]
128318 [host=huxelrebe1]
128347 [host=godello1]
128375 [host=baroque1]
128380 [host=godello0]
128426 [host=baroque1]
128422 [host=albana0]
128415 [host=italia0]
128509 [host=baroque1]
128513 pass irrelevant
128500 [host=baroque1]
128527 [host=chardonnay0]
128540 [host=elbling1]
128534 [host=italia0]
128557 [host=albana1]
128552 [host=albana1]
128546 [host=fiano0]
128551 [host=elbling1]
128556 [host=albana1]
128555 [host=fiano0]
128558 [host=godello1]
128561 [host=fiano0]
128568 [host=albana0]
128593 [host=chardonnay0]
128628 [host=godello0]
128579 [host=albana0]
128602 [host=huxelrebe1]
128587 [host=albana1]
128636 [host=debina0]
128780 [host=albana1]
128852 [host=italia0]
128884 [host=godello0]
128854 [host=debina0]
128840 [host=albana0]
128825 [host=baroque1]
128827 [host=debina0]
128857 [host=debina0]
128878 [host=debina0]
128879 [host=godello0]
128882 [host=godello0]
128883 [host=godello0]
128946 [host=elbling1]
128947 [host=baroque1]
128951 pass de5b678ca4dcdfa83e322491d478d66df56c1986 e0b77cb77ef2b36b8cbd2273cff833f773208d0a
128969 [host=albana0]
128931 pass irrelevant
128934 [host=huxelrebe1]
128937 [host=debina0]
128962 [host=italia0]
128965 [host=albana0]
129016 [host=debina0]
129011 [host=albana0]
129116 [host=debina0]
129111 [host=debina0]
129136 [host=albana0]
129141 [host=italia0]
129151 [host=albana0]
129196 [host=godello0]
129189 [host=huxelrebe1]
129202 [host=debina0]
129254 [host=baroque1]
129282 [host=debina0]
129330 [host=baroque1]
129286 [host=debina0]
129322 [host=godello0]
129512 [host=albana0]
129451 [host=baroque1]
129467 [host=godello0]
129473 [host=huxelrebe1]
129505 [host=debina0]
129519 [host=godello0]
129539 [host=huxelrebe1]
129555 [host=godello1]
129564 [host=godello1]
129656 [host=godello1]
129650 [host=godello1]
129698 [host=albana1]
129713 [host=huxelrebe1]
129702 [host=albana1]
129727 [host=godello0]
129852 [host=godello1]
129846 [host=huxelrebe1]
129836 [host=godello0]
129871 [host=albana1]
129879 [host=albana1]
129867 [host=albana1]
129886 [host=albana1]
129873 [host=albana1]
129861 [host=albana1]
129869 [host=albana1]
129874 [host=albana1]
129877 [host=albana1]
129880 [host=albana1]
129884 [host=albana1]
129887 [host=albana1]
129888 [host=albana1]
129870 [host=albana1]
129900 [host=albana0]
129927 [host=albana1]
129909 [host=godello0]
129916 [host=baroque1]
129934 [host=albana1]
129944 [host=debina0]
129960 [host=godello0]
129972 [host=albana0]
129982 [host=godello0]
130072 [host=godello0]
130062 [host=fiano0]
130110 [host=fiano0]
130122 [host=debina0]
130136 [host=godello0]
130219 [host=albana0]
130289 [host=huxelrebe1]
130839 [host=albana0]
130811 [host=godello1]
130813 [host=godello1]
130815 [host=godello1]
130850 [host=godello1]
130841 [host=huxelrebe1]
130816 [host=godello1]
130814 [host=godello1]
130817 [host=godello1]
130852 [host=albana1]
130818 [host=godello1]
130821 [host=godello1]
130822 [host=godello1]
130819 [host=godello1]
130823 [host=godello1]
130873 [host=godello1]
130848 [host=albana1]
130877 [host=albana1]
131013 [host=huxelrebe1]
131068 [host=albana0]
131076 [host=huxelrebe1]
131069 [host=debina1]
131212 [host=baroque1]
131124 [host=chardonnay1]
131126 [host=debina1]
131210 [host=godello1]
131207 [host=elbling0]
131284 [host=huxelrebe1]
131225 [host=godello1]
131234 [host=godello0]
131237 [host=rimava1]
131239 [host=rimava1]
131243 [host=rimava1]
131246 [host=godello1]
131274 [host=huxelrebe1]
131293 [host=albana0]
131315 [host=rimava1]
131389 [host=baroque0]
131434 [host=debina1]
131400 [host=baroque1]
131428 [host=baroque0]
131431 [host=albana0]
131436 [host=albana0]
131445 [host=godello1]
131502 [host=huxelrebe1]
131515 [host=albana0]
131486 [host=godello0]
131491 [host=godello1]
131500 [host=rimava1]
131600 [host=godello1]
131623 [host=godello0]
131597 [host=godello0]
131686 [host=albana0]
131665 [host=godello1]
131689 [host=huxelrebe1]
131692 [host=godello1]
131693 [host=godello1]
131695 [host=godello1]
131696 [host=godello1]
131697 [host=godello1]
131694 [host=godello1]
131698 [host=godello1]
131699 [host=godello1]
131700 [host=godello1]
131701 [host=godello1]
131703 [host=godello1]
131702 [host=huxelrebe1]
131711 [host=huxelrebe1]
131803 [host=albana0]
131829 [host=debina0]
131879 [host=godello1]
131968 [host=albana0]
131881 [host=godello0]
131917 [host=godello0]
131919 [host=godello1]
131920 [host=godello1]
131922 [host=godello0]
131966 [host=debina1]
131982 [host=godello0]
131985 [host=baroque1]
132022 [host=debina1]
132059 [host=godello1]
132269 [host=baroque1]
132287 [host=godello1]
132342 [host=godello0]
132436 [host=godello0]
132477 [host=godello0]
132450 [host=debina1]
132463 [host=debina1]
132471 [host=chardonnay0]
132538 [host=godello1]
132550 [host=fiano0]
132668 [host=chardonnay0]
132618 [host=albana1]
132562 [host=godello1]
132569 [host=godello1]
132633 [host=debina1]
132627 [host=debina1]
132712 [host=godello1]
132702 [host=debina1]
132708 [host=albana0]
132710 [host=albana1]
132711 [host=godello1]
132716 [host=baroque1]
132841 [host=godello0]
132967 [host=albana1]
132947 [host=godello0]
132977 [host=pinot1]
133005 [host=fiano0]
133263 [host=debina1]
133264 [host=pinot1]
133301 [host=debina1]
133312 [host=albana0]
133336 [host=albana1]
133329 [host=godello1]
133343 [host=albana0]
133371 [host=joubertin0]
133382 [host=debina0]
133387 [host=debina0]
133457 [host=pinot1]
133469 [host=albana0]
133472 [host=albana0]
133480 [host=albana0]
133481 [host=albana0]
133482 [host=albana0]
133478 [host=albana0]
133483 [host=albana0]
133485 [host=godello0]
133498 [host=italia0]
133604 [host=pinot1]
133606 [host=pinot1]
133608 [host=pinot1]
133607 [host=pinot1]
133592 [host=godello1]
133599 [host=pinot1]
133621 [host=godello0]
133776 [host=albana0]
133741 [host=albana0]
133771 [host=godello1]
133716 [host=godello1]
133747 [host=albana0]
133752 [host=albana0]
133802 [host=godello1]
133804 [host=godello0]
133767 [host=albana0]
133781 [host=albana0]
133836 [host=godello0]
133837 [host=chardonnay1]
133841 [host=albana0]
133900 [host=albana0]
133907 [host=merlot0]
133911 [host=godello0]
133948 [host=godello0]
133927 [host=godello0]
133991 [host=albana0]
133977 [host=albana0]
133988 [host=godello0]
134655 [host=debina1]
134661 [host=debina1]
134650 [host=baroque0]
134669 [host=albana1]
134674 [host=fiano1]
134686 [host=godello1]
134696 [host=italia0]
134702 [host=italia0]
134748 [host=fiano0]
134731 [host=italia0]
134733 [host=italia0]
134772 [host=albana1]
134734 [host=italia0]
134713 [host=italia0]
134715 [host=italia0]
134716 [host=italia0]
134714 [host=italia0]
134786 [host=albana0]
134737 [host=italia0]
134718 [host=italia0]
134722 [host=italia0]
134752 [host=albana1]
134732 [host=italia0]
134723 [host=italia0]
134725 [host=italia0]
134739 [host=italia0]
134726 [host=italia0]
134720 [host=italia0]
134728 [host=italia0]
134729 [host=italia0]
134764 [host=italia1]
134755 [host=italia1]
134741 [host=italia0]
134789 [host=baroque0]
134759 [host=albana0]
134769 [host=godello0]
134782 [host=godello1]
134778 [host=godello1]
134800 [host=italia1]
134796 [host=debina1]
134805 [host=chardonnay0]
134809 [host=rimava1]
134843 [host=godello0]
134822 [host=godello1]
134891 [host=albana1]
134863 [host=baroque0]
134827 [host=elbling1]
134834 [host=albana1]
134850 [host=baroque0]
134882 [host=debina1]
134837 [host=rimava1]
134838 [host=rimava1]
134858 [host=fiano1]
134869 [host=albana1]
134903 [host=chardonnay0]
134910 [host=italia0]
134980 [host=debina1]
134916 [host=albana0]
134945 [host=albana1]
134924 [host=godello0]
135009 [host=debina1]
134966 [host=italia1]
134928 [host=elbling1]
134933 [host=italia0]
134936 [host=albana1]
134952 [host=elbling1]
134937 [host=albana1]
134992 [host=baroque0]
134969 [host=godello1]
134983 [host=debina1]
135028 [host=italia0]
134959 [host=italia1]
134986 [host=albana1]
134973 [host=baroque0]
135007 [host=godello1]
134988 [host=debina1]
134995 [host=albana0]
135001 [host=debina1]
135013 [host=baroque0]
135018 [host=baroque0]
135016 [host=godello1]
135022 [host=godello1]
135025 [host=pinot1]
135033 [host=italia0]
135039 [host=pinot1]
135062 [host=fiano1]
135045 [host=baroque0]
135052 [host=italia0]
135071 [host=chardonnay1]
135103 [host=godello0]
135075 [host=albana1]
135080 [host=italia0]
135096 [host=baroque0]
135158 [host=debina1]
135118 [host=italia1]
135163 [host=italia1]
135128 [host=godello1]
135143 [host=debina1]
135155 [host=debina1]
135173 [host=chardonnay1]
135168 [host=pinot1]
135183 [host=chardonnay0]
135198 [host=chardonnay1]
135204 [host=rimava1]
135211 [host=baroque0]
135215 [host=godello0]
135285 [host=godello0]
135272 [host=godello0]
135228 [host=baroque0]
135277 [host=godello0]
135252 [host=italia1]
135245 [host=baroque0]
135297 [host=albana0]
135267 [host=rimava1]
135293 [host=godello0]
135280 [host=debina1]
135306 [host=fiano1]
135294 [host=italia0]
135304 [host=chardonnay0]
135308 [host=debina1]
135305 [host=godello0]
135310 [host=albana1]
135316 [host=godello0]
135319 [host=italia1]
136291 [host=chardonnay1]
135857 [host=albana0]
136179 [host=albana0]
136280 [host=chardonnay1]
136170 [host=debina1]
136178 [host=elbling1]
136254 [host=chardonnay1]
136227 [host=chardonnay1]
136240 [host=chardonnay1]
136260 [host=chardonnay1]
136241 [host=chardonnay1]
136250 [host=chardonnay1]
136237 [host=chardonnay1]
136247 [host=chardonnay1]
136261 [host=chardonnay1]
136271 [host=chardonnay1]
136258 [host=chardonnay1]
136267 [host=chardonnay1]
136270 [host=chardonnay1]
136276 [host=chardonnay1]
136277 [host=chardonnay1]
136288 [host=chardonnay1]
136282 [host=chardonnay1]
136285 [host=chardonnay1]
136286 [host=chardonnay1]
136317 [host=godello1]
136304 [host=godello0]
136327 [host=albana0]
136337 [host=chardonnay1]
136309 [host=albana0]
136328 [host=chardonnay1]
136356 [host=godello1]
136346 [host=debina1]
136330 [host=chardonnay1]
136354 [host=albana0]
136343 [host=debina1]
136372 [host=baroque1]
136364 [host=albana0]
136378 [host=debina1]
136376 [host=godello1]
136374 [host=godello1]
136380 [host=fiano0]
136387 [host=pinot1]
136453 [host=godello1]
136442 [host=chardonnay1]
136463 [host=godello1]
136618 [host=chardonnay0]
136633 [host=godello1]
136652 [host=albana1]
136636 [host=debina1]
136665 [host=albana1]
136687 [host=fiano1]
136699 [host=rimava1]
136752 [host=chardonnay0]
136914 [host=godello1]
136891 [host=albana1]
136860 [host=godello1]
136906 [host=godello0]
137036 [host=godello0]
137007 [host=godello0]
137079 [host=albana1]
137117 [host=godello1]
137072 [host=albana1]
137109 [host=godello0]
137250 [host=albana1]
137233 [host=albana1]
137263 [host=chardonnay0]
137276 [host=godello1]
137380 [host=godello1]
137386 [host=italia1]
137391 [host=pinot1]
137387 [host=fiano1]
137452 [host=chardonnay0]
137586 [host=elbling1]
137587 [host=godello1]
137683 [host=debina1]
137675 [host=pinot1]
137643 [host=albana1]
137676 [host=godello0]
137658 [host=albana1]
137662 [host=albana1]
137665 [host=godello0]
137679 [host=godello0]
137732 [host=albana1]
137716 [host=albana0]
137726 [host=godello1]
137904 [host=albana0]
137888 [host=albana1]
137971 [host=chardonnay1]
138020 [host=debina1]
137985 [host=godello1]
138039 [host=albana1]
138054 [host=godello1]
138176 [host=godello0]
138205 [host=godello0]
138228 [host=albana1]
138257 [host=godello0]
138242 [host=baroque1]
138277 [host=godello1]
138295 [host=debina1]
138355 [host=albana0]
138328 [host=chardonnay1]
138317 [host=albana1]
138347 [host=baroque1]
138342 [host=albana1]
138424 [host=albana0]
138493 fail 9cca02d8ffc23e9688a971d858e4ffdff5389b11 1bef4b1efd40b4c8c9e7afcd0155042a47896cb0
138482 fail irrelevant
138489 [host=pinot1]
138499 pass de5b678ca4dcdfa83e322491d478d66df56c1986 e0b77cb77ef2b36b8cbd2273cff833f773208d0a
138485 [host=godello1]
138484 pass de5b678ca4dcdfa83e322491d478d66df56c1986 e0b77cb77ef2b36b8cbd2273cff833f773208d0a
138495 [host=pinot1]
138497 [host=pinot1]
138501 fail 9cca02d8ffc23e9688a971d858e4ffdff5389b11 1bef4b1efd40b4c8c9e7afcd0155042a47896cb0
138505 fail 9cca02d8ffc23e9688a971d858e4ffdff5389b11 1bef4b1efd40b4c8c9e7afcd0155042a47896cb0
138504 pass 9cca02d8ffc23e9688a971d858e4ffdff5389b11 e0b77cb77ef2b36b8cbd2273cff833f773208d0a
138510 fail 9cca02d8ffc23e9688a971d858e4ffdff5389b11 1bef4b1efd40b4c8c9e7afcd0155042a47896cb0
138507 pass 9cca02d8ffc23e9688a971d858e4ffdff5389b11 e0b77cb77ef2b36b8cbd2273cff833f773208d0a
138516 fail 9cca02d8ffc23e9688a971d858e4ffdff5389b11 1bef4b1efd40b4c8c9e7afcd0155042a47896cb0
138515 pass 9cca02d8ffc23e9688a971d858e4ffdff5389b11 e0b77cb77ef2b36b8cbd2273cff833f773208d0a
138517 [host=albana0]
138519 fail 9cca02d8ffc23e9688a971d858e4ffdff5389b11 1bef4b1efd40b4c8c9e7afcd0155042a47896cb0
64060 [host=godello1]
64180 [host=nocera1]
64221 [host=merlot1]
64466 [host=nocera1]
64453 [host=godello1]
64568 [host=nocera0]
64861 [host=rimava1]
64959 [host=pinot1]
64953 [host=godello1]
65037 [host=rimava1]
64956 [host=rimava1]
65072 [host=rimava1]
65074 [host=nocera0]
65090 [host=pinot1]
65076 [host=godello1]
65104 [host=rimava1]
65135 [host=godello1]
65083 [host=godello1]
65108 [host=rimava1]
65113 [host=godello1]
65138 [host=fiano0]
65255 [host=godello0]
65313 [host=rimava1]
65279 [host=merlot1]
65335 [host=pinot1]
65307 [host=godello1]
65332 [host=italia0]
65545 [host=godello0]
65569 [host=godello0]
65561 [host=godello0]
65572 [host=italia1]
65648 [host=godello0]
65630 [host=godello0]
65637 [host=italia1]
65622 [host=pinot1]
65641 [host=italia1]
65657 [host=godello0]
65627 [host=godello0]
65662 [host=rimava1]
65672 [host=italia0]
65687 [host=fiano0]
65617 [host=italia1]
Searching for interesting versions
Result found: flight 128951 (pass), for basis pass
Result found: flight 138493 (fail), for basis failure
Repro found: flight 138499 (pass), for basis pass
Repro found: flight 138501 (fail), for basis failure
0 revisions at 9cca02d8ffc23e9688a971d858e4ffdff5389b11 e0b77cb77ef2b36b8cbd2273cff833f773208d0a
No revisions left to test, checking graph state.
Result found: flight 138504 (pass), for last pass
Result found: flight 138505 (fail), for first failure
Repro found: flight 138507 (pass), for last pass
Repro found: flight 138510 (fail), for first failure
Repro found: flight 138515 (pass), for last pass
Repro found: flight 138516 (fail), for first failure
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: 1bef4b1efd40b4c8c9e7afcd0155042a47896cb0
Bug not present: e0b77cb77ef2b36b8cbd2273cff833f773208d0a
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/138516/
(Revision log too long, omitted.)
Revision graph left in /home/logs/results/bisect/xen-unstable-smoke/build-amd64.xen-build.{dot,ps,png,html,svg}.
No revision to test.
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 8+ messages in thread
* [Xen-devel] [xen-unstable-smoke bisection] complete build-amd64
@ 2019-12-20 19:31 osstest service owner
0 siblings, 0 replies; 8+ messages in thread
From: osstest service owner @ 2019-12-20 19:31 UTC (permalink / raw)
To: xen-devel, osstest-admin
branch xen-unstable-smoke
xenbranch xen-unstable-smoke
job build-amd64
testid xen-build/dist-test
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: 25164571fc11ed3010c5885a98a68fac3b891d33
Bug not present: 0cd791c499bdc698d14a24050ec56d60b45732e0
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/145039/
commit 25164571fc11ed3010c5885a98a68fac3b891d33
Merge: 0cd791c499 5083e0ff93
Author: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Date: Thu Dec 19 20:16:43 2019 -0500
Merge branch 'livepatch.aws.v6' into staging
* livepatch.aws.v6:
livepatch: Add metadata runtime retrieval mechanism
livepatch: Handle arbitrary size names with the list operation
livepatch: Add support for modules .modinfo section metadata
livepatch: Add support for inline asm livepatching expectations
livepatch: Add per-function applied/reverted state tracking marker
livepatch: Do not enforce ELF_LIVEPATCH_FUNC section presence
livepatch: Add support for apply|revert action replacement hooks
livepatch: Implement pre-|post- apply|revert hooks
livepatch: Export payload structure via livepatch_payload.h
livepatch: Allow to override inter-modules buildid dependency
livepatch: Always check hypervisor build ID upon livepatch upload
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
commit 5083e0ff939d149860db40e0da54ea2048749471
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:08:00 2019 +0000
livepatch: Add metadata runtime retrieval mechanism
Extend the livepatch list operation to fetch also payloads' metadata.
This is achieved by extending the sysctl list interface with 2 extra
guest handles:
* metadata - an array of arbitrary size strings
* metadata_len - an array of metadata strings' lengths (uin32_t each)
Payloads' metadata is a string of arbitrary size and does not have an
upper bound limit. It may also vary in size between payloads.
In order to let the userland allocate enough space for the incoming
data add a metadata total size field to the list sysctl operation and
fill it with total size of all payloads' metadata.
Extend the libxc to handle the metadata back-to-back data transfers
as well as metadata length array data transfers.
The xen-livepatch userland tool is extended to always display the
metadata for each received module. The metadata is received with the
following format: key=value\0key=value\0...key=value\0. The format is
modified to the following one: key=value;key=value;...key=value.
The new format allows to easily parse the metadata for a given module
by a machine.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Reviewed-by: Norbert Manthey <nmanthey@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit b145b4a39c1324186b1b43313a9fefc19b7aa43f
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:59 2019 +0000
livepatch: Handle arbitrary size names with the list operation
The payloads' name strings can be of arbitrary size (typically small
with an upper bound of XEN_LIVEPATCH_NAME_SIZE).
Current implementation of the list operation interface allows to copy
names in the XEN_LIVEPATCH_NAME_SIZE chunks regardless of its actual
size and enforces space allocation requirements on userland tools.
To unify and simplify the interface, handle the name strings of
arbitrary size by copying them in adhering chunks to the userland.
In order to let the userland allocate enough space for the incoming
data add an auxiliary interface xc_livepatch_list_get_sizes() that
provides the current number of payload entries and the total size of
all name strings. This is achieved by extending the sysctl list
interface with an extra fields: name_total_size.
The xc_livepatch_list_get_sizes() issues the livepatch sysctl list
operation with the nr field set to 0. In this mode the operation
returns the number of payload entries and calculates the total sizes
for all payloads' names.
When the sysctl operation is issued with a non-zero nr field (for
instance with a value obtained earlier with the prior call to the
xc_livepatch_list_get_sizes()) the new field name_total_size provides
the total size of actually copied data.
Extend the libxc to handle the name back-to-back data transfers.
The xen-livepatch tool is modified to start the list operation with a
call to the xc_livepatch_list_get_sizes() to obtain the actual number
of payloads as well as the necessary space for names.
The tool now always requests the actual number of entries and leaves
the preemption handling to the libxc routine. The libxc still returns
'done' and 'left' parameters with the same semantic allowing the tool
to detect anomalies and react to them. At the moment it is expected
that the tool receives the exact number of entries as requested.
The xen-livepatch tool has been also modified to handle the name
back-to-back transfers correctly.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Bjoern Doebel <doebel@amazon.de>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit 4848297ad42135ee8e7e1e6e14b3855ceaf3eb08
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:58 2019 +0000
livepatch: Add support for modules .modinfo section metadata
Having detailed livepatch metadata helps to properly identify module's
origin and version. It also allows to keep track of the history of
livepatch loads in the system (at least within dmesg buffer size
limits).
The livepatch metadata are embedded in a form of .modinfo section.
Each such section contains data of the following format:
key=value\0key=value\0...key=value\0
The .modinfo section may be generated and appended to the resulting
livepatch ELF file optionally as an extra step of a higher level
livepatch build system.
The metadata section pointer and the section length is stored in the
livepatch payload structure and is used to display the content upon
livepatch apply operation.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Bjoern Doebel <doebel@amazon.de>
Reviewed-by: Leonard Foerster <foersleo@amazon.de>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Reviewed-by: Norbert Manthey <nmanthey@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit 8e24c887887a95cb2dda0017569ed19b65670152
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:57 2019 +0000
livepatch: Add support for inline asm livepatching expectations
This is the initial implementation of the expectations enhancement
to improve inline asm livepatching.
Expectations are designed as optional feature, since the main use of
them is planned for inline asm livepatching. The flag enabled allows
to control the expectation state.
Each expectation has data and len fields that describe the data
that is expected to be found at a given patching (old_addr) location.
The len must not exceed the data array size. The data array size
follows the size of the opaque array, since the opaque array holds
the original data and therefore must match what is specified in the
expectation (if enabled).
The payload structure is modified as each expectation structure is
part of the livepatch_func structure and hence extends the payload.
Each expectation is checked prior to the apply action (i.e. as late
as possible to check against the most current state of the code).
For the replace action a new payload's expectations are checked AFTER
all applied payloads are successfully reverted, but BEFORE new payload
is applied. That breaks the replace action's atomicity and in case of
an expectation check failure would leave a system with all payloads
reverted. That is obviously insecure. Use it with caution and act
upon replace errors!
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Reviewed-by: Norbert Manthey <nmanthey@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit 6047104c3ccc50205464a9b6a90daa85d21a4798
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:56 2019 +0000
livepatch: Add per-function applied/reverted state tracking marker
Livepatch only tracks an entire payload applied/reverted state. But,
with an option to supply the apply_payload() and/or revert_payload()
functions as optional hooks, it becomes possible to intermix the
execution of the original apply_payload()/revert_payload() functions
with their dynamically supplied counterparts.
It is important then to track the current state of every function
being patched and prevent situations of unintentional double-apply
or unapplied revert.
To support that, it is necessary to extend public interface of the
livepatch. The struct livepatch_func gets additional field holding
the applied/reverted state marker.
To reflect the livepatch payload ABI change, bump the version flag
LIVEPATCH_PAYLOAD_VERSION up to 2.
[And also update the top of the design document]
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Bjoern Doebel <doebel@amazon.de>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Acked-by: Julien Grall <julien.grall@arm.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit 76b3d4098a92a323a43bc250c67c721c1eed0acb
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:55 2019 +0000
livepatch: Do not enforce ELF_LIVEPATCH_FUNC section presence
With default implementation the ELF_LIVEPATCH_FUNC section containing
all functions to be replaced or added must be part of the livepatch
payload, otherwise the payload is rejected (with -EINVAL).
However, with the extended hooks implementation, a livepatch may be
constructed of only hooks to perform certain actions without any code
to be added or replaced.
Therefore, do not always expect the functions section and allow it to
be missing, provided there is at least one section containing hooks
present. The functions section, when present in a payload, must be a
single, non-empty section.
Check also all extended hooks sections if they are a single, non-empty
sections each.
At least one of the functions or hooks section must be present in a
valid payload.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Bjoern Doebel <doebel@amazon.de>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit ef87efee9d38b61624f25c1a056d386a70ba99aa
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:54 2019 +0000
livepatch: Add support for apply|revert action replacement hooks
By default, in the quiescing zone, a livepatch payload is applied with
apply_payload() and reverted with revert_payload() functions. Both of
the functions receive the payload struct pointer as a parameter. The
functions are also a place where standard 'load' and 'unload' module
hooks are executed.
To increase livepatching system's agility and provide more flexible
long-term livepatch solution, allow to overwrite the default apply
and revert action functions with hook-like supplied alternatives.
The alternative functions are optional and the default functions are
used by default.
Since the alternative functions have direct access to the livepatch
payload structure, they can better control context of the 'load' and
'unload' hooks execution as well as exact instructions replacement
workflows. They can be also easily extended to support extra features
in the future.
To simplify the alternative function generation move code responsible
for payload and livepatch region registration outside of the function.
That way it is guaranteed that the registration step occurs even for
newly supplied functions.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Petre Eftime <epetre@amazon.com>
Reviewed-by: Martin Pohlack <mpohlack@amazon.com>
Reviewed-by: Norbert Manthey <nmanthey@amazon.com>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Bjoern Doebel <doebel@amazon.com>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit 8313c864fa95074c2176f19af711b7e13bf20504
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:53 2019 +0000
livepatch: Implement pre-|post- apply|revert hooks
This is an implementation of 4 new livepatch module vetoing hooks,
that can be optionally supplied along with modules.
Hooks that currently exists in the livepatch mechanism aren't agile
enough and have various limitations:
* run only from within a quiescing zone
* cannot conditionally prevent applying or reverting
* do not have access to the module context
To address these limitations the following has been implemented:
1) pre-apply hook
runs before the apply action is scheduled for execution. Its main
purpose is to prevent from applying a livepatch when certain
expected conditions aren't met or when mutating actions implemented
in the hook fail or cannot be executed.
2) post-apply hook
runs after the apply action has been executed and quiescing zone
exited. Its main purpose is to provide an ability to follow-up on
actions performed by the pre- hook, when module application was
successful or undo certain preparation steps of the pre- hook in
case of a failure. The success/failure error code is provided to
the post- hooks via the rc field of the payload structure.
3) pre-revert hook
runs before the revert action is scheduled for execution. Its main
purpose is to prevent from reverting a livepatch when certain
expected conditions aren't met or when mutating actions implemented
in the hook fail or cannot be executed.
4) post-revert hook
runs after the revert action has been executed and quiescing zone
exited. Its main purpose is to perform cleanup of all previously
executed mutating actions in order to restore the original system
state from before the current module application.
The success/failure error code is provided to the post- hooks via
the rc field of the payload structure.
The replace action performs atomically the following actions:
- revert all applied modules
- apply a single replacement module.
With the vetoing hooks in place various inter-hook dependencies may
arise. Also, during the revert part of the operation certain vetoing
hooks may detect failing conditions that previously were satisfied.
That could in turn lead to situation when the revert part must be
rolled back with all the pre- and post- hooks re-applied, which again
can't be guaranteed to always succeed.
The simplest response to this complication is to disallow the replace
action completely on modules with vetoing hooks.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Petre Eftime <epetre@amazon.com>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Reviewed-by: Norbert Manthey <nmanthey@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit 3bafe4a06051de1d7abfffe77c8b9cb58594f39f
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:52 2019 +0000
livepatch: Export payload structure via livepatch_payload.h
The payload structure will be used by the new hooks implementation and
therefore its definition has to be exported via the livepatch_payload
header.
The new hooks will make use of the payload structure fields and the
hooks' pointers will also be defined in the payload structure, so
the structure along with all field definitions needs to be available
to the code being patched in.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Eslam Elnikety <elnikety@amazon.de>
Reviewed-by: Leonard Foerster <foersleo@amazon.de>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
commit b274989b610d37f0775e93c08343d30ec267a80f
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:51 2019 +0000
livepatch: Allow to override inter-modules buildid dependency
By default Livepatch enforces the following buildid-based dependency
chain between livepatch modules:
1) first module depends on given hypervisor buildid
2) every consecutive module depends on previous module's buildid
This way proper livepatch stack order is maintained and enforced.
While it is important for production livepatches it limits agility and
blocks usage of testing or debug livepatches. These kinds of livepatch
modules are typically expected to be loaded at any time irrespective
of current state of the modules stack.
To enable testing and debug livepatches allow user dynamically ignore
the inter-modules dependency. In this case only hypervisor buildid
match is verified and enforced.
To allow userland pass additional paremeters for livepatch actions
add support for action flags.
Each of the apply, revert, unload and revert action gets additional
32-bit parameter 'flags' where extra flags can be applied in a mask
form.
Initially only one flag '--nodeps' is added for the apply action.
This flag modifies the default buildid dependency check as described
above.
The global sysctl interface input flag parameter is defined with a
single corresponding flag macro:
LIVEPATCH_ACTION_APPLY_NODEPS (1 << 0)
The userland xen-livepatch tool is modified to support the '--nodeps'
flag for apply and load commands. A general mechanism for specifying
more flags in the future for apply and other action is however added.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Eslam Elnikety <elnikety@amazon.de>
Reviewed-by: Petre Eftime <epetre@amazon.com>
Reviewed-by: Leonard Foerster <foersleo@amazon.de>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Reviewed-by: Norbert Manthey <nmanthey@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit 879615f5db1d0a86afd99a67d284a8df6fd85be4
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:50 2019 +0000
livepatch: Always check hypervisor build ID upon livepatch upload
This change is part of a independant stacked livepatch modules
feature. This feature allows to bypass dependencies between modules
upon loading, but still verifies Xen build ID matching.
In order to prevent (up)loading any livepatches built for different
hypervisor version as indicated by the Xen Build ID, add checking for
the payload's vs Xen's build id match.
To achieve that embed into every livepatch another section with a
dedicated hypervisor build id in it. After the payload is loaded and
the .livepatch.xen_depends section becomes available, perform the
check and reject the payload if there is no match.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Bjoern Doebel <doebel@amazon.de>
Reviewed-by: Eslam Elnikety <elnikety@amazon.de>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
For bisection revision-tuple graph see:
http://logs.test-lab.xenproject.org/osstest/results/bisect/xen-unstable-smoke/build-amd64.xen-build--dist-test.html
Revision IDs in each graph node refer, respectively, to the Trees above.
----------------------------------------
Running cs-bisection-step --graph-out=/home/logs/results/bisect/xen-unstable-smoke/build-amd64.xen-build--dist-test --summary-out=tmp/145039.bisection-summary --basis-template=144983 --blessings=real,real-bisect xen-unstable-smoke build-amd64 xen-build/dist-test
Searching for failure / basis pass:
145027 fail [host=italia0] / 144983 [host=huxelrebe0] 144934 [host=huxelrebe0] 144931 ok.
Failure / basis pass flights: 145027 / 144931
(tree with no url: minios)
(tree with no url: ovmf)
(tree with no url: seabios)
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
Latest d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 2a62c22715bf81c5695ae0511f89a940c7c6a492
Basis pass d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 0e7c69bd3c0b35a677d73843b39522787ccf5a3f
Generating revisions with ./adhoc-revtuple-generator git://xenbits.xen.org/qemu-xen-traditional.git#d0d8ad39ecb51cd7497cd524484fe09f50876798-d0d8ad39ecb51cd7497cd524484fe09f50876798 git://xenbits.xen.org/qemu-xen.git#933ebad2470a169504799a1d95b8e410bd9847ef-933ebad2470a169504799a1d95b8e410bd9847ef git://xenbits.xen.org/xen.git#0e7c69bd3c0b35a677d73843b39522787ccf5a3f-2a62c22715bf81c5695ae0511f89a940c7c6a492
Loaded 5001 nodes in revision graph
Searching for test results:
144931 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 0e7c69bd3c0b35a677d73843b39522787ccf5a3f
144934 [host=huxelrebe0]
144983 [host=huxelrebe0]
144991 [host=godello0]
144999 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 25164571fc11ed3010c5885a98a68fac3b891d33
145005 [host=godello0]
145008 [host=godello0]
145009 [host=godello0]
145010 [host=godello0]
145035 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 0e7c69bd3c0b35a677d73843b39522787ccf5a3f
145011 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 0e7c69bd3c0b35a677d73843b39522787ccf5a3f
145014 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 25164571fc11ed3010c5885a98a68fac3b891d33
145038 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 2a62c22715bf81c5695ae0511f89a940c7c6a492
145015 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef e09aa1dbf38b7b4252fe15c906d11f69bdc66a5a
145039 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 25164571fc11ed3010c5885a98a68fac3b891d33
145018 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef ca14eba3ccb92a1219a12e8fe671f8e5a96ccf31
145019 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 0cd791c499bdc698d14a24050ec56d60b45732e0
145013 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 25164571fc11ed3010c5885a98a68fac3b891d33
145021 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 25164571fc11ed3010c5885a98a68fac3b891d33
145023 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 0cd791c499bdc698d14a24050ec56d60b45732e0
145024 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 25164571fc11ed3010c5885a98a68fac3b891d33
145027 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 2a62c22715bf81c5695ae0511f89a940c7c6a492
145030 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 0cd791c499bdc698d14a24050ec56d60b45732e0
Searching for interesting versions
Result found: flight 144931 (pass), for basis pass
Result found: flight 145027 (fail), for basis failure
Repro found: flight 145035 (pass), for basis pass
Repro found: flight 145038 (fail), for basis failure
0 revisions at d0d8ad39ecb51cd7497cd524484fe09f50876798 933ebad2470a169504799a1d95b8e410bd9847ef 0cd791c499bdc698d14a24050ec56d60b45732e0
No revisions left to test, checking graph state.
Result found: flight 145019 (pass), for last pass
Result found: flight 145021 (fail), for first failure
Repro found: flight 145023 (pass), for last pass
Repro found: flight 145024 (fail), for first failure
Repro found: flight 145030 (pass), for last pass
Repro found: flight 145039 (fail), for first failure
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: 25164571fc11ed3010c5885a98a68fac3b891d33
Bug not present: 0cd791c499bdc698d14a24050ec56d60b45732e0
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/145039/
commit 25164571fc11ed3010c5885a98a68fac3b891d33
Merge: 0cd791c499 5083e0ff93
Author: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Date: Thu Dec 19 20:16:43 2019 -0500
Merge branch 'livepatch.aws.v6' into staging
* livepatch.aws.v6:
livepatch: Add metadata runtime retrieval mechanism
livepatch: Handle arbitrary size names with the list operation
livepatch: Add support for modules .modinfo section metadata
livepatch: Add support for inline asm livepatching expectations
livepatch: Add per-function applied/reverted state tracking marker
livepatch: Do not enforce ELF_LIVEPATCH_FUNC section presence
livepatch: Add support for apply|revert action replacement hooks
livepatch: Implement pre-|post- apply|revert hooks
livepatch: Export payload structure via livepatch_payload.h
livepatch: Allow to override inter-modules buildid dependency
livepatch: Always check hypervisor build ID upon livepatch upload
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
commit 5083e0ff939d149860db40e0da54ea2048749471
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:08:00 2019 +0000
livepatch: Add metadata runtime retrieval mechanism
Extend the livepatch list operation to fetch also payloads' metadata.
This is achieved by extending the sysctl list interface with 2 extra
guest handles:
* metadata - an array of arbitrary size strings
* metadata_len - an array of metadata strings' lengths (uin32_t each)
Payloads' metadata is a string of arbitrary size and does not have an
upper bound limit. It may also vary in size between payloads.
In order to let the userland allocate enough space for the incoming
data add a metadata total size field to the list sysctl operation and
fill it with total size of all payloads' metadata.
Extend the libxc to handle the metadata back-to-back data transfers
as well as metadata length array data transfers.
The xen-livepatch userland tool is extended to always display the
metadata for each received module. The metadata is received with the
following format: key=value\0key=value\0...key=value\0. The format is
modified to the following one: key=value;key=value;...key=value.
The new format allows to easily parse the metadata for a given module
by a machine.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Reviewed-by: Norbert Manthey <nmanthey@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit b145b4a39c1324186b1b43313a9fefc19b7aa43f
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:59 2019 +0000
livepatch: Handle arbitrary size names with the list operation
The payloads' name strings can be of arbitrary size (typically small
with an upper bound of XEN_LIVEPATCH_NAME_SIZE).
Current implementation of the list operation interface allows to copy
names in the XEN_LIVEPATCH_NAME_SIZE chunks regardless of its actual
size and enforces space allocation requirements on userland tools.
To unify and simplify the interface, handle the name strings of
arbitrary size by copying them in adhering chunks to the userland.
In order to let the userland allocate enough space for the incoming
data add an auxiliary interface xc_livepatch_list_get_sizes() that
provides the current number of payload entries and the total size of
all name strings. This is achieved by extending the sysctl list
interface with an extra fields: name_total_size.
The xc_livepatch_list_get_sizes() issues the livepatch sysctl list
operation with the nr field set to 0. In this mode the operation
returns the number of payload entries and calculates the total sizes
for all payloads' names.
When the sysctl operation is issued with a non-zero nr field (for
instance with a value obtained earlier with the prior call to the
xc_livepatch_list_get_sizes()) the new field name_total_size provides
the total size of actually copied data.
Extend the libxc to handle the name back-to-back data transfers.
The xen-livepatch tool is modified to start the list operation with a
call to the xc_livepatch_list_get_sizes() to obtain the actual number
of payloads as well as the necessary space for names.
The tool now always requests the actual number of entries and leaves
the preemption handling to the libxc routine. The libxc still returns
'done' and 'left' parameters with the same semantic allowing the tool
to detect anomalies and react to them. At the moment it is expected
that the tool receives the exact number of entries as requested.
The xen-livepatch tool has been also modified to handle the name
back-to-back transfers correctly.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Bjoern Doebel <doebel@amazon.de>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit 4848297ad42135ee8e7e1e6e14b3855ceaf3eb08
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:58 2019 +0000
livepatch: Add support for modules .modinfo section metadata
Having detailed livepatch metadata helps to properly identify module's
origin and version. It also allows to keep track of the history of
livepatch loads in the system (at least within dmesg buffer size
limits).
The livepatch metadata are embedded in a form of .modinfo section.
Each such section contains data of the following format:
key=value\0key=value\0...key=value\0
The .modinfo section may be generated and appended to the resulting
livepatch ELF file optionally as an extra step of a higher level
livepatch build system.
The metadata section pointer and the section length is stored in the
livepatch payload structure and is used to display the content upon
livepatch apply operation.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Bjoern Doebel <doebel@amazon.de>
Reviewed-by: Leonard Foerster <foersleo@amazon.de>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Reviewed-by: Norbert Manthey <nmanthey@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit 8e24c887887a95cb2dda0017569ed19b65670152
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:57 2019 +0000
livepatch: Add support for inline asm livepatching expectations
This is the initial implementation of the expectations enhancement
to improve inline asm livepatching.
Expectations are designed as optional feature, since the main use of
them is planned for inline asm livepatching. The flag enabled allows
to control the expectation state.
Each expectation has data and len fields that describe the data
that is expected to be found at a given patching (old_addr) location.
The len must not exceed the data array size. The data array size
follows the size of the opaque array, since the opaque array holds
the original data and therefore must match what is specified in the
expectation (if enabled).
The payload structure is modified as each expectation structure is
part of the livepatch_func structure and hence extends the payload.
Each expectation is checked prior to the apply action (i.e. as late
as possible to check against the most current state of the code).
For the replace action a new payload's expectations are checked AFTER
all applied payloads are successfully reverted, but BEFORE new payload
is applied. That breaks the replace action's atomicity and in case of
an expectation check failure would leave a system with all payloads
reverted. That is obviously insecure. Use it with caution and act
upon replace errors!
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Reviewed-by: Norbert Manthey <nmanthey@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit 6047104c3ccc50205464a9b6a90daa85d21a4798
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:56 2019 +0000
livepatch: Add per-function applied/reverted state tracking marker
Livepatch only tracks an entire payload applied/reverted state. But,
with an option to supply the apply_payload() and/or revert_payload()
functions as optional hooks, it becomes possible to intermix the
execution of the original apply_payload()/revert_payload() functions
with their dynamically supplied counterparts.
It is important then to track the current state of every function
being patched and prevent situations of unintentional double-apply
or unapplied revert.
To support that, it is necessary to extend public interface of the
livepatch. The struct livepatch_func gets additional field holding
the applied/reverted state marker.
To reflect the livepatch payload ABI change, bump the version flag
LIVEPATCH_PAYLOAD_VERSION up to 2.
[And also update the top of the design document]
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Bjoern Doebel <doebel@amazon.de>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Acked-by: Julien Grall <julien.grall@arm.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit 76b3d4098a92a323a43bc250c67c721c1eed0acb
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:55 2019 +0000
livepatch: Do not enforce ELF_LIVEPATCH_FUNC section presence
With default implementation the ELF_LIVEPATCH_FUNC section containing
all functions to be replaced or added must be part of the livepatch
payload, otherwise the payload is rejected (with -EINVAL).
However, with the extended hooks implementation, a livepatch may be
constructed of only hooks to perform certain actions without any code
to be added or replaced.
Therefore, do not always expect the functions section and allow it to
be missing, provided there is at least one section containing hooks
present. The functions section, when present in a payload, must be a
single, non-empty section.
Check also all extended hooks sections if they are a single, non-empty
sections each.
At least one of the functions or hooks section must be present in a
valid payload.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Bjoern Doebel <doebel@amazon.de>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit ef87efee9d38b61624f25c1a056d386a70ba99aa
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:54 2019 +0000
livepatch: Add support for apply|revert action replacement hooks
By default, in the quiescing zone, a livepatch payload is applied with
apply_payload() and reverted with revert_payload() functions. Both of
the functions receive the payload struct pointer as a parameter. The
functions are also a place where standard 'load' and 'unload' module
hooks are executed.
To increase livepatching system's agility and provide more flexible
long-term livepatch solution, allow to overwrite the default apply
and revert action functions with hook-like supplied alternatives.
The alternative functions are optional and the default functions are
used by default.
Since the alternative functions have direct access to the livepatch
payload structure, they can better control context of the 'load' and
'unload' hooks execution as well as exact instructions replacement
workflows. They can be also easily extended to support extra features
in the future.
To simplify the alternative function generation move code responsible
for payload and livepatch region registration outside of the function.
That way it is guaranteed that the registration step occurs even for
newly supplied functions.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Petre Eftime <epetre@amazon.com>
Reviewed-by: Martin Pohlack <mpohlack@amazon.com>
Reviewed-by: Norbert Manthey <nmanthey@amazon.com>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Bjoern Doebel <doebel@amazon.com>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit 8313c864fa95074c2176f19af711b7e13bf20504
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:53 2019 +0000
livepatch: Implement pre-|post- apply|revert hooks
This is an implementation of 4 new livepatch module vetoing hooks,
that can be optionally supplied along with modules.
Hooks that currently exists in the livepatch mechanism aren't agile
enough and have various limitations:
* run only from within a quiescing zone
* cannot conditionally prevent applying or reverting
* do not have access to the module context
To address these limitations the following has been implemented:
1) pre-apply hook
runs before the apply action is scheduled for execution. Its main
purpose is to prevent from applying a livepatch when certain
expected conditions aren't met or when mutating actions implemented
in the hook fail or cannot be executed.
2) post-apply hook
runs after the apply action has been executed and quiescing zone
exited. Its main purpose is to provide an ability to follow-up on
actions performed by the pre- hook, when module application was
successful or undo certain preparation steps of the pre- hook in
case of a failure. The success/failure error code is provided to
the post- hooks via the rc field of the payload structure.
3) pre-revert hook
runs before the revert action is scheduled for execution. Its main
purpose is to prevent from reverting a livepatch when certain
expected conditions aren't met or when mutating actions implemented
in the hook fail or cannot be executed.
4) post-revert hook
runs after the revert action has been executed and quiescing zone
exited. Its main purpose is to perform cleanup of all previously
executed mutating actions in order to restore the original system
state from before the current module application.
The success/failure error code is provided to the post- hooks via
the rc field of the payload structure.
The replace action performs atomically the following actions:
- revert all applied modules
- apply a single replacement module.
With the vetoing hooks in place various inter-hook dependencies may
arise. Also, during the revert part of the operation certain vetoing
hooks may detect failing conditions that previously were satisfied.
That could in turn lead to situation when the revert part must be
rolled back with all the pre- and post- hooks re-applied, which again
can't be guaranteed to always succeed.
The simplest response to this complication is to disallow the replace
action completely on modules with vetoing hooks.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Petre Eftime <epetre@amazon.com>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Reviewed-by: Norbert Manthey <nmanthey@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit 3bafe4a06051de1d7abfffe77c8b9cb58594f39f
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:52 2019 +0000
livepatch: Export payload structure via livepatch_payload.h
The payload structure will be used by the new hooks implementation and
therefore its definition has to be exported via the livepatch_payload
header.
The new hooks will make use of the payload structure fields and the
hooks' pointers will also be defined in the payload structure, so
the structure along with all field definitions needs to be available
to the code being patched in.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Eslam Elnikety <elnikety@amazon.de>
Reviewed-by: Leonard Foerster <foersleo@amazon.de>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
commit b274989b610d37f0775e93c08343d30ec267a80f
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:51 2019 +0000
livepatch: Allow to override inter-modules buildid dependency
By default Livepatch enforces the following buildid-based dependency
chain between livepatch modules:
1) first module depends on given hypervisor buildid
2) every consecutive module depends on previous module's buildid
This way proper livepatch stack order is maintained and enforced.
While it is important for production livepatches it limits agility and
blocks usage of testing or debug livepatches. These kinds of livepatch
modules are typically expected to be loaded at any time irrespective
of current state of the modules stack.
To enable testing and debug livepatches allow user dynamically ignore
the inter-modules dependency. In this case only hypervisor buildid
match is verified and enforced.
To allow userland pass additional paremeters for livepatch actions
add support for action flags.
Each of the apply, revert, unload and revert action gets additional
32-bit parameter 'flags' where extra flags can be applied in a mask
form.
Initially only one flag '--nodeps' is added for the apply action.
This flag modifies the default buildid dependency check as described
above.
The global sysctl interface input flag parameter is defined with a
single corresponding flag macro:
LIVEPATCH_ACTION_APPLY_NODEPS (1 << 0)
The userland xen-livepatch tool is modified to support the '--nodeps'
flag for apply and load commands. A general mechanism for specifying
more flags in the future for apply and other action is however added.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Eslam Elnikety <elnikety@amazon.de>
Reviewed-by: Petre Eftime <epetre@amazon.com>
Reviewed-by: Leonard Foerster <foersleo@amazon.de>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Reviewed-by: Norbert Manthey <nmanthey@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
commit 879615f5db1d0a86afd99a67d284a8df6fd85be4
Author: Pawel Wieczorkiewicz <wipawel@amazon.de>
Date: Tue Nov 26 10:07:50 2019 +0000
livepatch: Always check hypervisor build ID upon livepatch upload
This change is part of a independant stacked livepatch modules
feature. This feature allows to bypass dependencies between modules
upon loading, but still verifies Xen build ID matching.
In order to prevent (up)loading any livepatches built for different
hypervisor version as indicated by the Xen Build ID, add checking for
the payload's vs Xen's build id match.
To achieve that embed into every livepatch another section with a
dedicated hypervisor build id in it. After the payload is loaded and
the .livepatch.xen_depends section becomes available, perform the
check and reject the payload if there is no match.
Signed-off-by: Pawel Wieczorkiewicz <wipawel@amazon.de>
Reviewed-by: Andra-Irina Paraschiv <andraprs@amazon.com>
Reviewed-by: Bjoern Doebel <doebel@amazon.de>
Reviewed-by: Eslam Elnikety <elnikety@amazon.de>
Reviewed-by: Martin Pohlack <mpohlack@amazon.de>
Signed-off-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Reviewed-by: Ross Lagerwall <ross.lagerwall@citrix.com>
Revision graph left in /home/logs/results/bisect/xen-unstable-smoke/build-amd64.xen-build--dist-test.{dot,ps,png,html,svg}.
----------------------------------------
145039: tolerable all pass
flight 145039 xen-unstable-smoke real-bisect [real]
http://logs.test-lab.xenproject.org/osstest/logs/145039/
Failures :-/ but no regressions.
Tests which did not succeed,
including tests which could not be run:
build-amd64 7 xen-build/dist-test fail baseline untested
jobs:
build-amd64 pass
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 8+ messages in thread
* [Xen-devel] [xen-unstable-smoke bisection] complete build-amd64
@ 2019-09-21 6:27 osstest service owner
0 siblings, 0 replies; 8+ messages in thread
From: osstest service owner @ 2019-09-21 6:27 UTC (permalink / raw)
To: xen-devel, osstest-admin
branch xen-unstable-smoke
xenbranch xen-unstable-smoke
job build-amd64
testid xen-build
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: edaa631ddcee665cdfae1cf6bc7492c791e01ef4
Bug not present: d6c7cd918adcfdc8ae41cf89e6a47ef4e4d3c1f6
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/141560/
commit edaa631ddcee665cdfae1cf6bc7492c791e01ef4
Author: Anthony PERARD <anthony.perard@citrix.com>
Date: Thu May 23 11:54:52 2019 +0100
libxl: Make libxl_domain_unpause async
libxl_domain_unpause needs to make QMP calls, which are asynchronous,
change the API to reflect that.
Do the same with libxl_domain_pause async, even if it will keep
completing synchronously.
Also fix some coding style issue in those functions.
Signed-off-by: Anthony PERARD <anthony.perard@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
For bisection revision-tuple graph see:
http://logs.test-lab.xenproject.org/osstest/results/bisect/xen-unstable-smoke/build-amd64.xen-build.html
Revision IDs in each graph node refer, respectively, to the Trees above.
----------------------------------------
Running cs-bisection-step --graph-out=/home/logs/results/bisect/xen-unstable-smoke/build-amd64.xen-build --summary-out=tmp/141571.bisection-summary --basis-template=141253 --blessings=real,real-bisect xen-unstable-smoke build-amd64 xen-build
Searching for failure / basis pass:
141563 fail [host=godello0] / 141498 [host=godello1] 141494 ok.
Failure / basis pass flights: 141563 / 141494
(tree with no url: minios)
(tree with no url: ovmf)
(tree with no url: seabios)
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
Latest d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 ae84f55353475f569daddb9a81ac0a6bc7772c90
Basis pass d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 ce44fd015e55d0ecc47c160fb5ce69070aa4991b
Generating revisions with ./adhoc-revtuple-generator git://xenbits.xen.org/qemu-xen-traditional.git#d0d8ad39ecb51cd7497cd524484fe09f50876798-d0d8ad39ecb51cd7497cd524484fe09f50876798 git://xenbits.xen.org/qemu-xen.git#cef9660618a880ced798375a0fd16a8ad80bd0f0-cef9660618a880ced798375a0fd16a8ad80bd0f0 git://xenbits.xen.org/xen.git#ce44fd015e55d0ecc47c160fb5ce69070aa4991b-ae84f55353475f569daddb9a81ac0a6bc7772c90
Loaded 1001 nodes in revision graph
Searching for test results:
141513 [host=godello1]
141489 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 ce44fd015e55d0ecc47c160fb5ce69070aa4991b
141498 [host=godello1]
141494 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 ce44fd015e55d0ecc47c160fb5ce69070aa4991b
141508 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 a30910bfd71a64895f0d6ddbb301cf1b5ed6c2f4
141545 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 edaa631ddcee665cdfae1cf6bc7492c791e01ef4
141565 [host=baroque0]
141521 [host=huxelrebe0]
141549 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 4750c9237bd49a2179d5bd28e7259df9c46de25a
141551 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 d6c7cd918adcfdc8ae41cf89e6a47ef4e4d3c1f6
141546 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 ae84f55353475f569daddb9a81ac0a6bc7772c90
141552 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 edaa631ddcee665cdfae1cf6bc7492c791e01ef4
141531 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 ae84f55353475f569daddb9a81ac0a6bc7772c90
141536 [host=huxelrebe0]
141568 [host=baroque0]
141537 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 ce44fd015e55d0ecc47c160fb5ce69070aa4991b
141540 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 ae84f55353475f569daddb9a81ac0a6bc7772c90
141541 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 ffc664dcb09654c9d34df68f3faf4d0b00642140
141539 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 ae84f55353475f569daddb9a81ac0a6bc7772c90
141553 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 d6c7cd918adcfdc8ae41cf89e6a47ef4e4d3c1f6
141542 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 1d1800ed347de5da7d45523758e33561d0b3c72f
141543 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 1e3304005ef0d30a117a2f120e643bd2c0cb9813
141563 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 ae84f55353475f569daddb9a81ac0a6bc7772c90
141558 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 edaa631ddcee665cdfae1cf6bc7492c791e01ef4
141559 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 d6c7cd918adcfdc8ae41cf89e6a47ef4e4d3c1f6
141554 [host=baroque0]
141560 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 edaa631ddcee665cdfae1cf6bc7492c791e01ef4
141571 [host=baroque0]
Searching for interesting versions
Result found: flight 141489 (pass), for basis pass
Result found: flight 141531 (fail), for basis failure
Repro found: flight 141537 (pass), for basis pass
Repro found: flight 141539 (fail), for basis failure
0 revisions at d0d8ad39ecb51cd7497cd524484fe09f50876798 cef9660618a880ced798375a0fd16a8ad80bd0f0 d6c7cd918adcfdc8ae41cf89e6a47ef4e4d3c1f6
No revisions left to test, checking graph state.
Result found: flight 141551 (pass), for last pass
Result found: flight 141552 (fail), for first failure
Repro found: flight 141553 (pass), for last pass
Repro found: flight 141558 (fail), for first failure
Repro found: flight 141559 (pass), for last pass
Repro found: flight 141560 (fail), for first failure
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: edaa631ddcee665cdfae1cf6bc7492c791e01ef4
Bug not present: d6c7cd918adcfdc8ae41cf89e6a47ef4e4d3c1f6
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/141560/
commit edaa631ddcee665cdfae1cf6bc7492c791e01ef4
Author: Anthony PERARD <anthony.perard@citrix.com>
Date: Thu May 23 11:54:52 2019 +0100
libxl: Make libxl_domain_unpause async
libxl_domain_unpause needs to make QMP calls, which are asynchronous,
change the API to reflect that.
Do the same with libxl_domain_pause async, even if it will keep
completing synchronously.
Also fix some coding style issue in those functions.
Signed-off-by: Anthony PERARD <anthony.perard@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
Revision graph left in /home/logs/results/bisect/xen-unstable-smoke/build-amd64.xen-build.{dot,ps,png,html,svg}.
----------------------------------------
141571: truncated
flight 141571 xen-unstable-smoke real-bisect [real]
http://logs.test-lab.xenproject.org/osstest/logs/141571/
Perfect :-)
All tests in this flight passed as required
jobs:
build-amd64 truncated
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 8+ messages in thread
* [Xen-devel] [xen-unstable-smoke bisection] complete build-amd64
@ 2019-07-29 6:52 osstest service owner
0 siblings, 0 replies; 8+ messages in thread
From: osstest service owner @ 2019-07-29 6:52 UTC (permalink / raw)
To: xen-devel, osstest-admin
branch xen-unstable-smoke
xenbranch xen-unstable-smoke
job build-amd64
testid xen-build
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: b4c8a27d5bc0f7c91d04af8584b55aafc104a0a9
Bug not present: 174db28bb823e8c98c319fdbdc6d4cbe1050ba14
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/139482/
commit b4c8a27d5bc0f7c91d04af8584b55aafc104a0a9
Author: Dario Faggioli <dfaggioli@suse.com>
Date: Sat Jul 27 00:13:49 2019 +0200
tools: ipxe: update for fixing build with GCC9
Building with GCC9 (on openSUSE Tubmleweed) generates a lot of errors of
the "taking address of packed member of ... may result in an unaligned
pointer value" kind.
Updating to upstream commit 1dd56dbd11082 ("[build] Workaround compilation
error with gcc 9.1") seems to fix the problem.
For more info, see:
https://git.ipxe.org/ipxe.git/commit/1dd56dbd11082fb622c2ed21cfaced4f47d798a6
Signed-off-by: Dario Faggioli <dfaggioli@suse.com>
Acked-by: Wei Liu <wl@xen.org>
For bisection revision-tuple graph see:
http://logs.test-lab.xenproject.org/osstest/results/bisect/xen-unstable-smoke/build-amd64.xen-build.html
Revision IDs in each graph node refer, respectively, to the Trees above.
----------------------------------------
Running cs-bisection-step --graph-out=/home/logs/results/bisect/xen-unstable-smoke/build-amd64.xen-build --summary-out=tmp/139482.bisection-summary --basis-template=139380 --blessings=real,real-bisect xen-unstable-smoke build-amd64 xen-build
Searching for failure / basis pass:
139470 fail [host=godello0] / 139380 [host=italia0] 139365 [host=chardonnay1] 139343 [host=chardonnay0] 139340 ok.
Failure / basis pass flights: 139470 / 139340
(tree with no url: minios)
(tree with no url: ovmf)
(tree with no url: seabios)
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
Latest d0d8ad39ecb51cd7497cd524484fe09f50876798 1bcf484fa9f451cc8c290fe80fd0e764199ca81c b4c8a27d5bc0f7c91d04af8584b55aafc104a0a9
Basis pass d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 c1681c394348636c5a7fbaa949623cef5eb9e9d5
Generating revisions with ./adhoc-revtuple-generator git://xenbits.xen.org/qemu-xen-traditional.git#d0d8ad39ecb51cd7497cd524484fe09f50876798-d0d8ad39ecb51cd7497cd524484fe09f50876798 git://xenbits.xen.org/qemu-xen.git#9cca02d8ffc23e9688a971d858e4ffdff5389b11-1bcf484fa9f451cc8c290fe80fd0e764199ca81c git://xenbits.xen.org/xen.git#c1681c394348636c5a7fbaa949623cef5eb9e9d5-b4c8a27d5bc0f7c91d04af8584b55aafc104a0a9
Loaded 2005 nodes in revision graph
Searching for test results:
139340 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 c1681c394348636c5a7fbaa949623cef5eb9e9d5
139343 [host=chardonnay0]
139365 [host=chardonnay1]
139380 [host=italia0]
139446 [host=italia1]
139467 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 1bcf484fa9f451cc8c290fe80fd0e764199ca81c 22ec7474348fea2c4a32b0872dd3385bf3785a26
139477 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 1bcf484fa9f451cc8c290fe80fd0e764199ca81c b4c8a27d5bc0f7c91d04af8584b55aafc104a0a9
139448 [host=italia1]
139445 [host=italia1]
139472 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 1bcf484fa9f451cc8c290fe80fd0e764199ca81c 174db28bb823e8c98c319fdbdc6d4cbe1050ba14
139459 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 c1681c394348636c5a7fbaa949623cef5eb9e9d5
139450 [host=italia1]
139464 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 1bcf484fa9f451cc8c290fe80fd0e764199ca81c b4c8a27d5bc0f7c91d04af8584b55aafc104a0a9
139454 [host=italia1]
139441 [host=italia1]
139461 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 1bcf484fa9f451cc8c290fe80fd0e764199ca81c b4c8a27d5bc0f7c91d04af8584b55aafc104a0a9
139444 [host=italia1]
139455 [host=italia1]
139465 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 a7c6859ec982f94e899629e2e7985caa60e3833e
139466 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 1bcf484fa9f451cc8c290fe80fd0e764199ca81c 612d476e74a314be514ee6a9744eea8db09d32e5
139452 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 1bcf484fa9f451cc8c290fe80fd0e764199ca81c b4c8a27d5bc0f7c91d04af8584b55aafc104a0a9
139456 [host=italia1]
139473 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 1bcf484fa9f451cc8c290fe80fd0e764199ca81c b4c8a27d5bc0f7c91d04af8584b55aafc104a0a9
139479 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 1bcf484fa9f451cc8c290fe80fd0e764199ca81c 174db28bb823e8c98c319fdbdc6d4cbe1050ba14
139475 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 1bcf484fa9f451cc8c290fe80fd0e764199ca81c 174db28bb823e8c98c319fdbdc6d4cbe1050ba14
139470 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 1bcf484fa9f451cc8c290fe80fd0e764199ca81c b4c8a27d5bc0f7c91d04af8584b55aafc104a0a9
139482 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 1bcf484fa9f451cc8c290fe80fd0e764199ca81c b4c8a27d5bc0f7c91d04af8584b55aafc104a0a9
Searching for interesting versions
Result found: flight 139340 (pass), for basis pass
Result found: flight 139452 (fail), for basis failure
Repro found: flight 139459 (pass), for basis pass
Repro found: flight 139461 (fail), for basis failure
0 revisions at d0d8ad39ecb51cd7497cd524484fe09f50876798 1bcf484fa9f451cc8c290fe80fd0e764199ca81c 174db28bb823e8c98c319fdbdc6d4cbe1050ba14
No revisions left to test, checking graph state.
Result found: flight 139472 (pass), for last pass
Result found: flight 139473 (fail), for first failure
Repro found: flight 139475 (pass), for last pass
Repro found: flight 139477 (fail), for first failure
Repro found: flight 139479 (pass), for last pass
Repro found: flight 139482 (fail), for first failure
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: b4c8a27d5bc0f7c91d04af8584b55aafc104a0a9
Bug not present: 174db28bb823e8c98c319fdbdc6d4cbe1050ba14
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/139482/
commit b4c8a27d5bc0f7c91d04af8584b55aafc104a0a9
Author: Dario Faggioli <dfaggioli@suse.com>
Date: Sat Jul 27 00:13:49 2019 +0200
tools: ipxe: update for fixing build with GCC9
Building with GCC9 (on openSUSE Tubmleweed) generates a lot of errors of
the "taking address of packed member of ... may result in an unaligned
pointer value" kind.
Updating to upstream commit 1dd56dbd11082 ("[build] Workaround compilation
error with gcc 9.1") seems to fix the problem.
For more info, see:
https://git.ipxe.org/ipxe.git/commit/1dd56dbd11082fb622c2ed21cfaced4f47d798a6
Signed-off-by: Dario Faggioli <dfaggioli@suse.com>
Acked-by: Wei Liu <wl@xen.org>
Revision graph left in /home/logs/results/bisect/xen-unstable-smoke/build-amd64.xen-build.{dot,ps,png,html,svg}.
----------------------------------------
139482: tolerable ALL FAIL
flight 139482 xen-unstable-smoke real-bisect [real]
http://logs.test-lab.xenproject.org/osstest/logs/139482/
Failures :-/ but no regressions.
Tests which did not succeed,
including tests which could not be run:
build-amd64 6 xen-build fail baseline untested
jobs:
build-amd64 fail
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 8+ messages in thread
* [Xen-devel] [xen-unstable-smoke bisection] complete build-amd64
@ 2019-05-15 8:13 ` osstest service owner
0 siblings, 0 replies; 8+ messages in thread
From: osstest service owner @ 2019-05-15 8:13 UTC (permalink / raw)
To: xen-devel, osstest-admin
branch xen-unstable-smoke
xenbranch xen-unstable-smoke
job build-amd64
testid xen-build
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: b81813dfb36fde9bd47c2e1b806e368cb9d6cbdb
Bug not present: 99bb45e684283b3bc621dbc99b1b93c856b4dd1c
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/136288/
commit b81813dfb36fde9bd47c2e1b806e368cb9d6cbdb
Author: Jan Beulich <jbeulich@suse.com>
Date: Tue May 14 16:18:58 2019 +0200
x86/mm: short-circuit HVM-only mode flags when !HVM
#define-ing them to zero allows better code generation in this case,
and paves the way for more DCE, allowing to leave certain functions just
declared, but not defined.
Signed-off-by: Jan Beulich <jbeulich@suse.com>
Reviewed-by: Wei Liu <wei.liu2@citrix.com>
Reviewed-by: George Dunlap <george.dunlap@citrix.com>
For bisection revision-tuple graph see:
http://logs.test-lab.xenproject.org/osstest/results/bisect/xen-unstable-smoke/build-amd64.xen-build.html
Revision IDs in each graph node refer, respectively, to the Trees above.
----------------------------------------
Running cs-bisection-step --graph-out=/home/logs/results/bisect/xen-unstable-smoke/build-amd64.xen-build --summary-out=tmp/136288.bisection-summary --basis-template=136179 --blessings=real,real-bisect xen-unstable-smoke build-amd64 xen-build
Searching for failure / basis pass:
136280 fail [host=chardonnay1] / 136179 [host=albana0] 136178 [host=elbling1] 136170 [host=debina1] 135857 [host=albana0] 135319 [host=italia1] 135316 [host=godello0] 135310 [host=albana1] 135308 [host=debina1] 135306 [host=fiano1] 135305 [host=godello0] 135304 [host=chardonnay0] 135297 [host=albana0] 135294 [host=italia0] 135293 [host=godello0] 135285 [host=godello0] 135280 [host=debina1] 135277 [host=godello0] 135272 [host=godello0] 135267 [host=rimava1] 135252 [host=italia1] 135245 [host=bar\
oque0] 135228 [host=baroque0] 135215 [host=godello0] 135211 [host=baroque0] 135204 [host=rimava1] 135198 ok.
Failure / basis pass flights: 136280 / 135198
(tree with no url: minios)
(tree with no url: ovmf)
(tree with no url: seabios)
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
Latest d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 3c04c258ab40405a74e194d9889a4cbc7abe94b4
Basis pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 dc497635d93f6672f82727ad97a55205177be2aa
Generating revisions with ./adhoc-revtuple-generator git://xenbits.xen.org/qemu-xen-traditional.git#d0d8ad39ecb51cd7497cd524484fe09f50876798-d0d8ad39ecb51cd7497cd524484fe09f50876798 git://xenbits.xen.org/qemu-xen.git#de5b678ca4dcdfa83e322491d478d66df56c1986-9cca02d8ffc23e9688a971d858e4ffdff5389b11 git://xenbits.xen.org/xen.git#dc497635d93f6672f82727ad97a55205177be2aa-3c04c258ab40405a74e194d9889a4cbc7abe94b4
adhoc-revtuple-generator: tree discontiguous: qemu-xen
Loaded 1002 nodes in revision graph
Searching for test results:
135198 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 dc497635d93f6672f82727ad97a55205177be2aa
135204 [host=rimava1]
135211 [host=baroque0]
135215 [host=godello0]
135285 [host=godello0]
135272 [host=godello0]
135228 [host=baroque0]
135277 [host=godello0]
135252 [host=italia1]
135245 [host=baroque0]
135297 [host=albana0]
135267 [host=rimava1]
135293 [host=godello0]
135280 [host=debina1]
135306 [host=fiano1]
135294 [host=italia0]
135304 [host=chardonnay0]
135308 [host=debina1]
135305 [host=godello0]
135310 [host=albana1]
135316 [host=godello0]
135319 [host=italia1]
135857 [host=albana0]
136179 [host=albana0]
136280 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 3c04c258ab40405a74e194d9889a4cbc7abe94b4
136170 [host=debina1]
136178 [host=elbling1]
136254 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 dc497635d93f6672f82727ad97a55205177be2aa
136227 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 14e122fcc45d8a86e27be9663cbd7bcea1602b25
136240 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 14e122fcc45d8a86e27be9663cbd7bcea1602b25
136260 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 3c04c258ab40405a74e194d9889a4cbc7abe94b4
136241 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 3c04c258ab40405a74e194d9889a4cbc7abe94b4
136250 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 c492e19fdd05273417a1b116a90b26587738810c
136237 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 dc497635d93f6672f82727ad97a55205177be2aa
136247 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 30596213617fcf4dd7b71d244e16c8fc0acf456b
136261 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 a0f981451509bf83af153038d35079c4e62dc1cf
136271 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 b81813dfb36fde9bd47c2e1b806e368cb9d6cbdb
136258 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 3c04c258ab40405a74e194d9889a4cbc7abe94b4
136267 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 f3694f3acba92d46479e2455fd74b32799a9eb02
136270 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 3c04c258ab40405a74e194d9889a4cbc7abe94b4
136276 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 99bb45e684283b3bc621dbc99b1b93c856b4dd1c
136277 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 b81813dfb36fde9bd47c2e1b806e368cb9d6cbdb
136288 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 b81813dfb36fde9bd47c2e1b806e368cb9d6cbdb
136282 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 99bb45e684283b3bc621dbc99b1b93c856b4dd1c
136285 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 b81813dfb36fde9bd47c2e1b806e368cb9d6cbdb
136286 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 99bb45e684283b3bc621dbc99b1b93c856b4dd1c
Searching for interesting versions
Result found: flight 135198 (pass), for basis pass
Result found: flight 136241 (fail), for basis failure
Repro found: flight 136254 (pass), for basis pass
Repro found: flight 136258 (fail), for basis failure
0 revisions at d0d8ad39ecb51cd7497cd524484fe09f50876798 9cca02d8ffc23e9688a971d858e4ffdff5389b11 99bb45e684283b3bc621dbc99b1b93c856b4dd1c
No revisions left to test, checking graph state.
Result found: flight 136276 (pass), for last pass
Result found: flight 136277 (fail), for first failure
Repro found: flight 136282 (pass), for last pass
Repro found: flight 136285 (fail), for first failure
Repro found: flight 136286 (pass), for last pass
Repro found: flight 136288 (fail), for first failure
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: b81813dfb36fde9bd47c2e1b806e368cb9d6cbdb
Bug not present: 99bb45e684283b3bc621dbc99b1b93c856b4dd1c
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/136288/
commit b81813dfb36fde9bd47c2e1b806e368cb9d6cbdb
Author: Jan Beulich <jbeulich@suse.com>
Date: Tue May 14 16:18:58 2019 +0200
x86/mm: short-circuit HVM-only mode flags when !HVM
#define-ing them to zero allows better code generation in this case,
and paves the way for more DCE, allowing to leave certain functions just
declared, but not defined.
Signed-off-by: Jan Beulich <jbeulich@suse.com>
Reviewed-by: Wei Liu <wei.liu2@citrix.com>
Reviewed-by: George Dunlap <george.dunlap@citrix.com>
Revision graph left in /home/logs/results/bisect/xen-unstable-smoke/build-amd64.xen-build.{dot,ps,png,html,svg}.
----------------------------------------
136288: tolerable ALL FAIL
flight 136288 xen-unstable-smoke real-bisect [real]
http://logs.test-lab.xenproject.org/osstest/logs/136288/
Failures :-/ but no regressions.
Tests which did not succeed,
including tests which could not be run:
build-amd64 6 xen-build fail baseline untested
jobs:
build-amd64 fail
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [Xen-devel] [xen-unstable-smoke bisection] complete build-amd64
@ 2019-04-13 15:53 ` Andrew Cooper
0 siblings, 0 replies; 8+ messages in thread
From: Andrew Cooper @ 2019-04-13 15:53 UTC (permalink / raw)
To: Julien Grall, osstest service owner, xen-devel, Jan Beulich,
Paul Durrant
On 13/04/2019 16:51, Julien Grall wrote:
> Hi,
>
> It looks like the amd64 build is broken on staging:
>
> http://logs.test-lab.xenproject.org/osstest/logs/134748/build-amd64/6.ts-xen-build.log
Yes it is. There is currently a patch out on xen-devel.
~Andrew
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [Xen-devel] [xen-unstable-smoke bisection] complete build-amd64
@ 2019-04-13 15:51 ` Julien Grall
2019-04-13 15:53 ` Andrew Cooper
0 siblings, 1 reply; 8+ messages in thread
From: Julien Grall @ 2019-04-13 15:51 UTC (permalink / raw)
To: osstest service owner, xen-devel, Andrew Cooper, Jan Beulich,
Paul Durrant
Hi,
It looks like the amd64 build is broken on staging:
http://logs.test-lab.xenproject.org/osstest/logs/134748/build-amd64/6.ts-xen-build.log
Cheers,
On 4/13/19 6:09 AM, osstest service owner wrote:
> branch xen-unstable-smoke
> xenbranch xen-unstable-smoke
> job build-amd64
> testid xen-build
>
> Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
> Tree: qemuu git://xenbits.xen.org/qemu-xen.git
> Tree: xen git://xenbits.xen.org/xen.git
>
> *** Found and reproduced problem changeset ***
>
> Bug is in tree: xen git://xenbits.xen.org/xen.git
> Bug introduced: 832c1803ca71fdb1526384d43c24b158a25f4639
> Bug not present: 5ba1c5d0641cf63086b3058e547fcd28c3c4a011
> Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/134739/
>
>
> commit 832c1803ca71fdb1526384d43c24b158a25f4639
> Author: Paul Durrant <paul.durrant@citrix.com>
> Date: Thu Mar 14 14:56:00 2019 +0100
>
> x86: stop handling MSR_IA32_BNDCFGS save/restore in implementation code
>
> Saving and restoring the value of this MSR is currently handled by
> implementation-specific code despite it being architectural. This patch
> moves handling of accesses to this MSR from hvm.c into the msr.c, thus
> allowing the common MSR save/restore code to handle it.
>
> NOTE: Because vmx_get/set_guest_bndcfgs() call vmx_vmcs_enter(), the
> struct vcpu pointer passed in, and hence the vcpu pointer passed to
> guest_rdmsr() cannot be const.
>
> Signed-off-by: Paul Durrant <paul.durrant@citrix.com>
> Reviewed-by: Jan Beulich <jbeulich@suse.com>
> Reviewed-by: Kevin Tian <kevin.tian@intel.com>
>
>
> For bisection revision-tuple graph see:
> http://logs.test-lab.xenproject.org/osstest/results/bisect/xen-unstable-smoke/build-amd64.xen-build.html
> Revision IDs in each graph node refer, respectively, to the Trees above.
>
> ----------------------------------------
> Running cs-bisection-step --graph-out=/home/logs/results/bisect/xen-unstable-smoke/build-amd64.xen-build --summary-out=tmp/134739.bisection-summary --basis-template=133991 --blessings=real,real-bisect xen-unstable-smoke build-amd64 xen-build
> Searching for failure / basis pass:
> 134732 fail [host=italia0] / 133991 [host=albana0] 133988 [host=godello0] 133977 [host=albana0] 133948 [host=godello0] 133927 [host=godello0] 133911 [host=godello0] 133907 [host=merlot0] 133900 [host=albana0] 133841 [host=albana0] 133837 [host=chardonnay1] 133836 [host=godello0] 133804 [host=godello0] 133802 [host=godello1] 133781 [host=albana0] 133776 [host=albana0] 133771 [host=godello1] 133767 [host=albana0] 133752 [host=albana0] 133747 [host=albana0] 133741 [host=albana0] 133716 [host=godel\
> lo1] 133621 [host=godello0] 133607 [host=pinot1] 133599 [host=pinot1] 133592 [host=godello1] 133498 ok.
> Failure / basis pass flights: 134732 / 133498
> (tree with no url: minios)
> (tree with no url: ovmf)
> (tree with no url: seabios)
> Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
> Tree: qemuu git://xenbits.xen.org/qemu-xen.git
> Tree: xen git://xenbits.xen.org/xen.git
> Latest d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 860d6e158dbb581c3aabc6a20ae8d83b325bffd8
> Basis pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 f393b82fe5ba3ed9cfe2b306ffa53368e55b75af
> Generating revisions with ./adhoc-revtuple-generator git://xenbits.xen.org/qemu-xen-traditional.git#d0d8ad39ecb51cd7497cd524484fe09f50876798-d0d8ad39ecb51cd7497cd524484fe09f50876798 git://xenbits.xen.org/qemu-xen.git#de5b678ca4dcdfa83e322491d478d66df56c1986-de5b678ca4dcdfa83e322491d478d66df56c1986 git://xenbits.xen.org/xen.git#f393b82fe5ba3ed9cfe2b306ffa53368e55b75af-860d6e158dbb581c3aabc6a20ae8d83b325bffd8
> Loaded 1001 nodes in revision graph
> Searching for test results:
> 133498 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 f393b82fe5ba3ed9cfe2b306ffa53368e55b75af
> 133604 [host=pinot1]
> 133606 [host=pinot1]
> 133608 [host=pinot1]
> 133607 [host=pinot1]
> 133592 [host=godello1]
> 133599 [host=pinot1]
> 133621 [host=godello0]
> 133776 [host=albana0]
> 133741 [host=albana0]
> 133771 [host=godello1]
> 133716 [host=godello1]
> 133747 [host=albana0]
> 133752 [host=albana0]
> 133802 [host=godello1]
> 133804 [host=godello0]
> 133767 [host=albana0]
> 133781 [host=albana0]
> 133836 [host=godello0]
> 133837 [host=chardonnay1]
> 133841 [host=albana0]
> 133900 [host=albana0]
> 133907 [host=merlot0]
> 133911 [host=godello0]
> 133948 [host=godello0]
> 133927 [host=godello0]
> 133991 [host=albana0]
> 133977 [host=albana0]
> 133988 [host=godello0]
> 134655 [host=debina1]
> 134661 [host=debina1]
> 134650 [host=baroque0]
> 134669 [host=albana1]
> 134674 [host=fiano1]
> 134686 [host=godello1]
> 134696 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 85aea83d46d24eb420235b172cd3f427a8153c18
> 134702 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 860d6e158dbb581c3aabc6a20ae8d83b325bffd8
> 134731 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 832c1803ca71fdb1526384d43c24b158a25f4639
> 134733 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 5ba1c5d0641cf63086b3058e547fcd28c3c4a011
> 134734 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 832c1803ca71fdb1526384d43c24b158a25f4639
> 134713 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 f393b82fe5ba3ed9cfe2b306ffa53368e55b75af
> 134715 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 860d6e158dbb581c3aabc6a20ae8d83b325bffd8
> 134716 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 9b8b3f300f1f8aa93d7d4590d92bc746ce6412cb
> 134714 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 860d6e158dbb581c3aabc6a20ae8d83b325bffd8
> 134737 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 5ba1c5d0641cf63086b3058e547fcd28c3c4a011
> 134718 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 c37db16ccb3426e2d22ec7731649770b56984b27
> 134722 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 64933920c9b34129d8c868347da0ed396b50e3a8
> 134732 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 860d6e158dbb581c3aabc6a20ae8d83b325bffd8
> 134723 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 1b3cc8000c82edc9761c1e595928d6584e11f9f5
> 134725 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 943c474283a34e48e5088af2ad67d7a56320fbd7
> 134739 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 832c1803ca71fdb1526384d43c24b158a25f4639
> 134726 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 a6448adfd3d537aacbbd784e5bf1777ab3ff5f85
> 134720 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 860d6e158dbb581c3aabc6a20ae8d83b325bffd8
> 134728 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 e28c0ee3356f52f589bbae54e89aaed25c1f599d
> 134729 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 5ba1c5d0641cf63086b3058e547fcd28c3c4a011
> Searching for interesting versions
> Result found: flight 133498 (pass), for basis pass
> Result found: flight 134702 (fail), for basis failure
> Repro found: flight 134713 (pass), for basis pass
> Repro found: flight 134714 (fail), for basis failure
> 0 revisions at d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 5ba1c5d0641cf63086b3058e547fcd28c3c4a011
> No revisions left to test, checking graph state.
> Result found: flight 134729 (pass), for last pass
> Result found: flight 134731 (fail), for first failure
> Repro found: flight 134733 (pass), for last pass
> Repro found: flight 134734 (fail), for first failure
> Repro found: flight 134737 (pass), for last pass
> Repro found: flight 134739 (fail), for first failure
>
> *** Found and reproduced problem changeset ***
>
> Bug is in tree: xen git://xenbits.xen.org/xen.git
> Bug introduced: 832c1803ca71fdb1526384d43c24b158a25f4639
> Bug not present: 5ba1c5d0641cf63086b3058e547fcd28c3c4a011
> Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/134739/
>
>
> commit 832c1803ca71fdb1526384d43c24b158a25f4639
> Author: Paul Durrant <paul.durrant@citrix.com>
> Date: Thu Mar 14 14:56:00 2019 +0100
>
> x86: stop handling MSR_IA32_BNDCFGS save/restore in implementation code
>
> Saving and restoring the value of this MSR is currently handled by
> implementation-specific code despite it being architectural. This patch
> moves handling of accesses to this MSR from hvm.c into the msr.c, thus
> allowing the common MSR save/restore code to handle it.
>
> NOTE: Because vmx_get/set_guest_bndcfgs() call vmx_vmcs_enter(), the
> struct vcpu pointer passed in, and hence the vcpu pointer passed to
> guest_rdmsr() cannot be const.
>
> Signed-off-by: Paul Durrant <paul.durrant@citrix.com>
> Reviewed-by: Jan Beulich <jbeulich@suse.com>
> Reviewed-by: Kevin Tian <kevin.tian@intel.com>
>
> pnmtopng: 203 colors found
> Revision graph left in /home/logs/results/bisect/xen-unstable-smoke/build-amd64.xen-build.{dot,ps,png,html,svg}.
> ----------------------------------------
> 134739: tolerable ALL FAIL
>
> flight 134739 xen-unstable-smoke real-bisect [real]
> http://logs.test-lab.xenproject.org/osstest/logs/134739/
>
> Failures :-/ but no regressions.
>
> Tests which did not succeed,
> including tests which could not be run:
> build-amd64 6 xen-build fail baseline untested
>
>
> jobs:
> build-amd64 fail
>
>
> ------------------------------------------------------------
> sg-report-flight on osstest.test-lab.xenproject.org
> logs: /home/logs/logs
> images: /home/logs/images
>
> Logs, config files, etc. are available at
> http://logs.test-lab.xenproject.org/osstest/logs
>
> Explanation of these reports, and of osstest in general, is at
> http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
> http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
>
> Test harness code can be found at
> http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
>
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xenproject.org
> https://lists.xenproject.org/mailman/listinfo/xen-devel
>
--
Julien Grall
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 8+ messages in thread
* [Xen-devel] [xen-unstable-smoke bisection] complete build-amd64
@ 2019-04-13 5:09 ` osstest service owner
2019-04-13 15:51 ` Julien Grall
0 siblings, 1 reply; 8+ messages in thread
From: osstest service owner @ 2019-04-13 5:09 UTC (permalink / raw)
To: xen-devel, osstest-admin
branch xen-unstable-smoke
xenbranch xen-unstable-smoke
job build-amd64
testid xen-build
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: 832c1803ca71fdb1526384d43c24b158a25f4639
Bug not present: 5ba1c5d0641cf63086b3058e547fcd28c3c4a011
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/134739/
commit 832c1803ca71fdb1526384d43c24b158a25f4639
Author: Paul Durrant <paul.durrant@citrix.com>
Date: Thu Mar 14 14:56:00 2019 +0100
x86: stop handling MSR_IA32_BNDCFGS save/restore in implementation code
Saving and restoring the value of this MSR is currently handled by
implementation-specific code despite it being architectural. This patch
moves handling of accesses to this MSR from hvm.c into the msr.c, thus
allowing the common MSR save/restore code to handle it.
NOTE: Because vmx_get/set_guest_bndcfgs() call vmx_vmcs_enter(), the
struct vcpu pointer passed in, and hence the vcpu pointer passed to
guest_rdmsr() cannot be const.
Signed-off-by: Paul Durrant <paul.durrant@citrix.com>
Reviewed-by: Jan Beulich <jbeulich@suse.com>
Reviewed-by: Kevin Tian <kevin.tian@intel.com>
For bisection revision-tuple graph see:
http://logs.test-lab.xenproject.org/osstest/results/bisect/xen-unstable-smoke/build-amd64.xen-build.html
Revision IDs in each graph node refer, respectively, to the Trees above.
----------------------------------------
Running cs-bisection-step --graph-out=/home/logs/results/bisect/xen-unstable-smoke/build-amd64.xen-build --summary-out=tmp/134739.bisection-summary --basis-template=133991 --blessings=real,real-bisect xen-unstable-smoke build-amd64 xen-build
Searching for failure / basis pass:
134732 fail [host=italia0] / 133991 [host=albana0] 133988 [host=godello0] 133977 [host=albana0] 133948 [host=godello0] 133927 [host=godello0] 133911 [host=godello0] 133907 [host=merlot0] 133900 [host=albana0] 133841 [host=albana0] 133837 [host=chardonnay1] 133836 [host=godello0] 133804 [host=godello0] 133802 [host=godello1] 133781 [host=albana0] 133776 [host=albana0] 133771 [host=godello1] 133767 [host=albana0] 133752 [host=albana0] 133747 [host=albana0] 133741 [host=albana0] 133716 [host=godel\
lo1] 133621 [host=godello0] 133607 [host=pinot1] 133599 [host=pinot1] 133592 [host=godello1] 133498 ok.
Failure / basis pass flights: 134732 / 133498
(tree with no url: minios)
(tree with no url: ovmf)
(tree with no url: seabios)
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
Latest d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 860d6e158dbb581c3aabc6a20ae8d83b325bffd8
Basis pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 f393b82fe5ba3ed9cfe2b306ffa53368e55b75af
Generating revisions with ./adhoc-revtuple-generator git://xenbits.xen.org/qemu-xen-traditional.git#d0d8ad39ecb51cd7497cd524484fe09f50876798-d0d8ad39ecb51cd7497cd524484fe09f50876798 git://xenbits.xen.org/qemu-xen.git#de5b678ca4dcdfa83e322491d478d66df56c1986-de5b678ca4dcdfa83e322491d478d66df56c1986 git://xenbits.xen.org/xen.git#f393b82fe5ba3ed9cfe2b306ffa53368e55b75af-860d6e158dbb581c3aabc6a20ae8d83b325bffd8
Loaded 1001 nodes in revision graph
Searching for test results:
133498 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 f393b82fe5ba3ed9cfe2b306ffa53368e55b75af
133604 [host=pinot1]
133606 [host=pinot1]
133608 [host=pinot1]
133607 [host=pinot1]
133592 [host=godello1]
133599 [host=pinot1]
133621 [host=godello0]
133776 [host=albana0]
133741 [host=albana0]
133771 [host=godello1]
133716 [host=godello1]
133747 [host=albana0]
133752 [host=albana0]
133802 [host=godello1]
133804 [host=godello0]
133767 [host=albana0]
133781 [host=albana0]
133836 [host=godello0]
133837 [host=chardonnay1]
133841 [host=albana0]
133900 [host=albana0]
133907 [host=merlot0]
133911 [host=godello0]
133948 [host=godello0]
133927 [host=godello0]
133991 [host=albana0]
133977 [host=albana0]
133988 [host=godello0]
134655 [host=debina1]
134661 [host=debina1]
134650 [host=baroque0]
134669 [host=albana1]
134674 [host=fiano1]
134686 [host=godello1]
134696 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 85aea83d46d24eb420235b172cd3f427a8153c18
134702 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 860d6e158dbb581c3aabc6a20ae8d83b325bffd8
134731 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 832c1803ca71fdb1526384d43c24b158a25f4639
134733 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 5ba1c5d0641cf63086b3058e547fcd28c3c4a011
134734 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 832c1803ca71fdb1526384d43c24b158a25f4639
134713 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 f393b82fe5ba3ed9cfe2b306ffa53368e55b75af
134715 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 860d6e158dbb581c3aabc6a20ae8d83b325bffd8
134716 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 9b8b3f300f1f8aa93d7d4590d92bc746ce6412cb
134714 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 860d6e158dbb581c3aabc6a20ae8d83b325bffd8
134737 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 5ba1c5d0641cf63086b3058e547fcd28c3c4a011
134718 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 c37db16ccb3426e2d22ec7731649770b56984b27
134722 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 64933920c9b34129d8c868347da0ed396b50e3a8
134732 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 860d6e158dbb581c3aabc6a20ae8d83b325bffd8
134723 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 1b3cc8000c82edc9761c1e595928d6584e11f9f5
134725 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 943c474283a34e48e5088af2ad67d7a56320fbd7
134739 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 832c1803ca71fdb1526384d43c24b158a25f4639
134726 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 a6448adfd3d537aacbbd784e5bf1777ab3ff5f85
134720 fail d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 860d6e158dbb581c3aabc6a20ae8d83b325bffd8
134728 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 e28c0ee3356f52f589bbae54e89aaed25c1f599d
134729 pass d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 5ba1c5d0641cf63086b3058e547fcd28c3c4a011
Searching for interesting versions
Result found: flight 133498 (pass), for basis pass
Result found: flight 134702 (fail), for basis failure
Repro found: flight 134713 (pass), for basis pass
Repro found: flight 134714 (fail), for basis failure
0 revisions at d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 5ba1c5d0641cf63086b3058e547fcd28c3c4a011
No revisions left to test, checking graph state.
Result found: flight 134729 (pass), for last pass
Result found: flight 134731 (fail), for first failure
Repro found: flight 134733 (pass), for last pass
Repro found: flight 134734 (fail), for first failure
Repro found: flight 134737 (pass), for last pass
Repro found: flight 134739 (fail), for first failure
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: 832c1803ca71fdb1526384d43c24b158a25f4639
Bug not present: 5ba1c5d0641cf63086b3058e547fcd28c3c4a011
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/134739/
commit 832c1803ca71fdb1526384d43c24b158a25f4639
Author: Paul Durrant <paul.durrant@citrix.com>
Date: Thu Mar 14 14:56:00 2019 +0100
x86: stop handling MSR_IA32_BNDCFGS save/restore in implementation code
Saving and restoring the value of this MSR is currently handled by
implementation-specific code despite it being architectural. This patch
moves handling of accesses to this MSR from hvm.c into the msr.c, thus
allowing the common MSR save/restore code to handle it.
NOTE: Because vmx_get/set_guest_bndcfgs() call vmx_vmcs_enter(), the
struct vcpu pointer passed in, and hence the vcpu pointer passed to
guest_rdmsr() cannot be const.
Signed-off-by: Paul Durrant <paul.durrant@citrix.com>
Reviewed-by: Jan Beulich <jbeulich@suse.com>
Reviewed-by: Kevin Tian <kevin.tian@intel.com>
pnmtopng: 203 colors found
Revision graph left in /home/logs/results/bisect/xen-unstable-smoke/build-amd64.xen-build.{dot,ps,png,html,svg}.
----------------------------------------
134739: tolerable ALL FAIL
flight 134739 xen-unstable-smoke real-bisect [real]
http://logs.test-lab.xenproject.org/osstest/logs/134739/
Failures :-/ but no regressions.
Tests which did not succeed,
including tests which could not be run:
build-amd64 6 xen-build fail baseline untested
jobs:
build-amd64 fail
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2019-12-20 19:32 UTC | newest]
Thread overview: 8+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-06-26 2:40 [Xen-devel] [xen-unstable-smoke bisection] complete build-amd64 osstest service owner
-- strict thread matches above, loose matches on Subject: below --
2019-12-20 19:31 osstest service owner
2019-09-21 6:27 osstest service owner
2019-07-29 6:52 osstest service owner
2019-05-15 8:13 osstest service owner
2019-05-15 8:13 ` osstest service owner
2019-04-13 5:09 osstest service owner
2019-04-13 5:09 ` osstest service owner
2019-04-13 15:51 ` Julien Grall
2019-04-13 15:51 ` Julien Grall
2019-04-13 15:53 ` Andrew Cooper
2019-04-13 15:53 ` Andrew Cooper
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.