* [xen-4.6-testing bisection] complete test-amd64-amd64-xl-pvh-intel
@ 2016-08-06 16:24 osstest service owner
2016-08-06 16:55 ` Andrew Cooper
0 siblings, 1 reply; 3+ messages in thread
From: osstest service owner @ 2016-08-06 16:24 UTC (permalink / raw)
To: xen-devel, osstest-admin
branch xen-4.6-testing
xenbranch xen-4.6-testing
job test-amd64-amd64-xl-pvh-intel
testid xen-boot
Tree: linux git://xenbits.xen.org/linux-pvops.git
Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: 477080fc560a3025d451175b69995e62a2ce1a8d
Bug not present: ec712ba0838b7d7fb11229d1a5ab42978c14a782
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/99995/
commit 477080fc560a3025d451175b69995e62a2ce1a8d
Author: George Dunlap <george.dunlap@citrix.com>
Date: Fri Aug 5 13:47:04 2016 +0200
xen: Have schedulers revise initial placement
The generic domain creation logic in
xen/common/domctl.c:default_vcpu0_location() attempts to try to do
initial placement load-balancing by placing vcpu 0 on the least-busy
non-primary hyperthread available. Unfortunately, the logic can end
up picking a pcpu that's not in the online mask. When this is passed
to a scheduler such which assumes that the initial assignment is
valid, it causes a null pointer dereference looking up the runqueue.
Furthermore, this initial placement doesn't take into account hard or
soft affinity, or any scheduler-specific knowledge (such as historic
runqueue load, as in credit2).
To solve this, when inserting a vcpu, always call the per-scheduler
"pick" function to revise the initial placement. This will
automatically take all knowledge the scheduler has into account.
csched2_cpu_pick ASSERTs that the vcpu's pcpu scheduler lock has been
taken. Grab and release the lock to minimize time spend with irqs
disabled.
Signed-off-by: George Dunlap <george.dunlap@citrix.com>
Reviewed-by: Meng Xu <mengxu@cis.upenn.edu>
Reviwed-by: Dario Faggioli <dario.faggioli@citrix.com>
master commit: 9f358ddd69463fa8fb65cf67beb5f6f0d3350e32
master date: 2016-07-26 10:42:49 +0100
For bisection revision-tuple graph see:
http://logs.test-lab.xenproject.org/osstest/results/bisect/xen-4.6-testing/test-amd64-amd64-xl-pvh-intel.xen-boot.html
Revision IDs in each graph node refer, respectively, to the Trees above.
----------------------------------------
Running cs-bisection-step --graph-out=/home/logs/results/bisect/xen-4.6-testing/test-amd64-amd64-xl-pvh-intel.xen-boot --summary-out=tmp/99995.bisection-summary --basis-template=99902 --blessings=real,real-bisect xen-4.6-testing test-amd64-amd64-xl-pvh-intel xen-boot
Searching for failure / basis pass:
99962 fail [host=italia1] / 99902 ok.
Failure / basis pass flights: 99962 / 99902
(tree with no url: minios)
(tree with no url: ovmf)
(tree with no url: seabios)
Tree: linux git://xenbits.xen.org/linux-pvops.git
Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
Latest da99423b3cd3e48c42c0d64b79aba58d828f9648 c530a75c1e6a472b0eb9558310b518f0dfcd8860 29b39dac29529b9989e4f597adb354f7879b6f63 ebfc90b51d09e0a3330a4702bb23223cf088eabd ff49c274e93cf5524b7d108aea8c792b13fe27c8
Basis pass da99423b3cd3e48c42c0d64b79aba58d828f9648 c530a75c1e6a472b0eb9558310b518f0dfcd8860 29b39dac29529b9989e4f597adb354f7879b6f63 ebfc90b51d09e0a3330a4702bb23223cf088eabd 625c3e47e077129b0bc903e8db03bdf1cbbeb413
Generating revisions with ./adhoc-revtuple-generator git://xenbits.xen.org/linux-pvops.git#da99423b3cd3e48c42c0d64b79aba58d828f9648-da99423b3cd3e48c42c0d64b79aba58d828f9648 git://xenbits.xen.org/osstest/linux-firmware.git#c530a75c1e6a472b0eb9558310b518f0dfcd8860-c530a75c1e6a472b0eb9558310b518f0dfcd8860 git://xenbits.xen.org/qemu-xen-traditional.git#29b39dac29529b9989e4f597adb354f7879b6f63-29b39dac29529b9989e4f597adb354f7879b6f63 git://xenbits.xen.org/qemu-xen.git#ebfc90b51d09e0a3330a4702bb23223cf088eabd-ebfc90b51d09e0a3330a4702bb23223cf088eabd git://xenbits.xen.org/xen.git#625c3e47e077129b0bc903e8db03bdf1cbbeb413-ff49c274e93cf5524b7d108aea8c792b13fe27c8
Loaded 1001 nodes in revision graph
Searching for test results:
99894 pass da99423b3cd3e48c42c0d64b79aba58d828f9648 c530a75c1e6a472b0eb9558310b518f0dfcd8860 29b39dac29529b9989e4f597adb354f7879b6f63 ebfc90b51d09e0a3330a4702bb23223cf088eabd 625c3e47e077129b0bc903e8db03bdf1cbbeb413
99995 fail da99423b3cd3e48c42c0d64b79aba58d828f9648 c530a75c1e6a472b0eb9558310b518f0dfcd8860 29b39dac29529b9989e4f597adb354f7879b6f63 ebfc90b51d09e0a3330a4702bb23223cf088eabd 477080fc560a3025d451175b69995e62a2ce1a8d
99902 pass da99423b3cd3e48c42c0d64b79aba58d828f9648 c530a75c1e6a472b0eb9558310b518f0dfcd8860 29b39dac29529b9989e4f597adb354f7879b6f63 ebfc90b51d09e0a3330a4702bb23223cf088eabd 625c3e47e077129b0bc903e8db03bdf1cbbeb413
99990 pass da99423b3cd3e48c42c0d64b79aba58d828f9648 c530a75c1e6a472b0eb9558310b518f0dfcd8860 29b39dac29529b9989e4f597adb354f7879b6f63 ebfc90b51d09e0a3330a4702bb23223cf088eabd ec712ba0838b7d7fb11229d1a5ab42978c14a782
99962 fail da99423b3cd3e48c42c0d64b79aba58d828f9648 c530a75c1e6a472b0eb9558310b518f0dfcd8860 29b39dac29529b9989e4f597adb354f7879b6f63 ebfc90b51d09e0a3330a4702bb23223cf088eabd ff49c274e93cf5524b7d108aea8c792b13fe27c8
99986 pass da99423b3cd3e48c42c0d64b79aba58d828f9648 c530a75c1e6a472b0eb9558310b518f0dfcd8860 29b39dac29529b9989e4f597adb354f7879b6f63 ebfc90b51d09e0a3330a4702bb23223cf088eabd ec712ba0838b7d7fb11229d1a5ab42978c14a782
99984 fail da99423b3cd3e48c42c0d64b79aba58d828f9648 c530a75c1e6a472b0eb9558310b518f0dfcd8860 29b39dac29529b9989e4f597adb354f7879b6f63 ebfc90b51d09e0a3330a4702bb23223cf088eabd ff49c274e93cf5524b7d108aea8c792b13fe27c8
99975 pass da99423b3cd3e48c42c0d64b79aba58d828f9648 c530a75c1e6a472b0eb9558310b518f0dfcd8860 29b39dac29529b9989e4f597adb354f7879b6f63 ebfc90b51d09e0a3330a4702bb23223cf088eabd 625c3e47e077129b0bc903e8db03bdf1cbbeb413
99988 fail da99423b3cd3e48c42c0d64b79aba58d828f9648 c530a75c1e6a472b0eb9558310b518f0dfcd8860 29b39dac29529b9989e4f597adb354f7879b6f63 ebfc90b51d09e0a3330a4702bb23223cf088eabd 477080fc560a3025d451175b69995e62a2ce1a8d
99991 fail da99423b3cd3e48c42c0d64b79aba58d828f9648 c530a75c1e6a472b0eb9558310b518f0dfcd8860 29b39dac29529b9989e4f597adb354f7879b6f63 ebfc90b51d09e0a3330a4702bb23223cf088eabd 477080fc560a3025d451175b69995e62a2ce1a8d
99993 pass da99423b3cd3e48c42c0d64b79aba58d828f9648 c530a75c1e6a472b0eb9558310b518f0dfcd8860 29b39dac29529b9989e4f597adb354f7879b6f63 ebfc90b51d09e0a3330a4702bb23223cf088eabd ec712ba0838b7d7fb11229d1a5ab42978c14a782
Searching for interesting versions
Result found: flight 99894 (pass), for basis pass
Result found: flight 99962 (fail), for basis failure
Repro found: flight 99975 (pass), for basis pass
Repro found: flight 99984 (fail), for basis failure
0 revisions at da99423b3cd3e48c42c0d64b79aba58d828f9648 c530a75c1e6a472b0eb9558310b518f0dfcd8860 29b39dac29529b9989e4f597adb354f7879b6f63 ebfc90b51d09e0a3330a4702bb23223cf088eabd ec712ba0838b7d7fb11229d1a5ab42978c14a782
No revisions left to test, checking graph state.
Result found: flight 99986 (pass), for last pass
Result found: flight 99988 (fail), for first failure
Repro found: flight 99990 (pass), for last pass
Repro found: flight 99991 (fail), for first failure
Repro found: flight 99993 (pass), for last pass
Repro found: flight 99995 (fail), for first failure
*** Found and reproduced problem changeset ***
Bug is in tree: xen git://xenbits.xen.org/xen.git
Bug introduced: 477080fc560a3025d451175b69995e62a2ce1a8d
Bug not present: ec712ba0838b7d7fb11229d1a5ab42978c14a782
Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/99995/
commit 477080fc560a3025d451175b69995e62a2ce1a8d
Author: George Dunlap <george.dunlap@citrix.com>
Date: Fri Aug 5 13:47:04 2016 +0200
xen: Have schedulers revise initial placement
The generic domain creation logic in
xen/common/domctl.c:default_vcpu0_location() attempts to try to do
initial placement load-balancing by placing vcpu 0 on the least-busy
non-primary hyperthread available. Unfortunately, the logic can end
up picking a pcpu that's not in the online mask. When this is passed
to a scheduler such which assumes that the initial assignment is
valid, it causes a null pointer dereference looking up the runqueue.
Furthermore, this initial placement doesn't take into account hard or
soft affinity, or any scheduler-specific knowledge (such as historic
runqueue load, as in credit2).
To solve this, when inserting a vcpu, always call the per-scheduler
"pick" function to revise the initial placement. This will
automatically take all knowledge the scheduler has into account.
csched2_cpu_pick ASSERTs that the vcpu's pcpu scheduler lock has been
taken. Grab and release the lock to minimize time spend with irqs
disabled.
Signed-off-by: George Dunlap <george.dunlap@citrix.com>
Reviewed-by: Meng Xu <mengxu@cis.upenn.edu>
Reviwed-by: Dario Faggioli <dario.faggioli@citrix.com>
master commit: 9f358ddd69463fa8fb65cf67beb5f6f0d3350e32
master date: 2016-07-26 10:42:49 +0100
Revision graph left in /home/logs/results/bisect/xen-4.6-testing/test-amd64-amd64-xl-pvh-intel.xen-boot.{dot,ps,png,html,svg}.
----------------------------------------
99995: tolerable ALL FAIL
flight 99995 xen-4.6-testing real-bisect [real]
http://logs.test-lab.xenproject.org/osstest/logs/99995/
Failures :-/ but no regressions.
Tests which did not succeed,
including tests which could not be run:
test-amd64-amd64-xl-pvh-intel 6 xen-boot fail baseline untested
jobs:
test-amd64-amd64-xl-pvh-intel fail
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [xen-4.6-testing bisection] complete test-amd64-amd64-xl-pvh-intel
2016-08-06 16:24 [xen-4.6-testing bisection] complete test-amd64-amd64-xl-pvh-intel osstest service owner
@ 2016-08-06 16:55 ` Andrew Cooper
2016-08-08 6:14 ` Jan Beulich
0 siblings, 1 reply; 3+ messages in thread
From: Andrew Cooper @ 2016-08-06 16:55 UTC (permalink / raw)
To: Jan Beulich, xen-devel
On 06/08/16 17:24, osstest service owner wrote:
> branch xen-4.6-testing
> xenbranch xen-4.6-testing
> job test-amd64-amd64-xl-pvh-intel
> testid xen-boot
>
> Tree: linux git://xenbits.xen.org/linux-pvops.git
> Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
> Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
> Tree: qemuu git://xenbits.xen.org/qemu-xen.git
> Tree: xen git://xenbits.xen.org/xen.git
>
> *** Found and reproduced problem changeset ***
>
> Bug is in tree: xen git://xenbits.xen.org/xen.git
> Bug introduced: 477080fc560a3025d451175b69995e62a2ce1a8d
> Bug not present: ec712ba0838b7d7fb11229d1a5ab42978c14a782
> Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/99995/
>
>
> commit 477080fc560a3025d451175b69995e62a2ce1a8d
> Author: George Dunlap <george.dunlap@citrix.com>
> Date: Fri Aug 5 13:47:04 2016 +0200
>
> xen: Have schedulers revise initial placement
More fallout from backports. Perhaps it would be safer not to backport
this change.
From
http://logs.test-lab.xenproject.org/osstest/logs/99995/test-amd64-amd64-xl-pvh-intel/serial-italia1.log
Aug 6 14:38:19.678087 (XEN) xstate_init: using cntxt_size: 0x340 and
states: 0x7
Aug 6 14:38:19.686011 (XEN) mce_intel.c:735: MCA Capability: BCAST 1
SER 0 CMCI 1 firstbank 0 extended MCE MSR 0
Aug 6 14:38:19.694125 (XEN) Intel machine check reporting enabled
Aug 6 14:38:19.702168 (XEN) Using scheduler: SMP Credit Scheduler (credit)
Aug 6 14:38:19.710065 (XEN) Assertion 'cpu < nr_cpu_ids' failed at
...99976.build-amd64/xen/xen/include/xen/cpumask.h:97
Aug 6 14:38:19.718016 (XEN) ----[ Xen-4.6.3 x86_64 debug=y Not
tainted ]----
Aug 6 14:38:19.726088 (XEN) CPU: 0
Aug 6 14:38:19.726139 (XEN) RIP: e008:[<ffff82d08012365a>]
_csched_cpu_pick+0x156/0x62c
Aug 6 14:38:19.734081 (XEN) RFLAGS: 0000000000010046 CONTEXT: hypervisor
Aug 6 14:38:19.742114 (XEN) rax: 0000000000000080 rbx:
0000000000000080 rcx: 0000000000000000
Aug 6 14:38:19.750181 (XEN) rdx: 000000000000003f rsi:
0000000000000080 rdi: 0000000000000080
Aug 6 14:38:19.758006 (XEN) rbp: ffff82d0802f7d48 rsp:
ffff82d0802f7c58 r8: 0000000000000000
Aug 6 14:38:19.765989 (XEN) r9: 0000000000000002 r10:
0000000000000002 r11: ffff82e0017cdfc0
Aug 6 14:38:19.773984 (XEN) r12: 0000000000000080 r13:
ffff8300beaf9000 r14: ffff830237cf3800
Aug 6 14:38:19.789963 (XEN) r15: ffff82d08033b340 cr0:
0000000080050033 cr4: 00000000001506e0
Aug 6 14:38:19.798048 (XEN) cr3: 00000000be8a1000 cr2: 0000000000000000
Aug 6 14:38:19.798083 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000
ss: 0000 cs: e008
Aug 6 14:38:19.806157 (XEN) Xen stack trace from rsp=ffff82d0802f7c58:
Aug 6 14:38:19.813988 (XEN) ffff82d0802f7c88 0000000280144a19
ffff82d08033b348 ffff82d08033b340
Aug 6 14:38:19.822002 (XEN) ffff82d08028d800 ffff82d0802ff040
0000000100000001 0000000000000000
Aug 6 14:38:19.830006 (XEN) ffff82d08012cf3e 0000000000000000
0000000000000097 ffff82d0802f7cc8
Aug 6 14:38:19.838196 (XEN) 0000000000000006 ffff82d0802f7cd8
ffff82d08012cf3e ffff83023d842000
Aug 6 14:38:19.846013 (XEN) ffff82d0802f7d18 ffff82d08013c82b
0000000000000000 0000000000000010
Aug 6 14:38:19.854266 (XEN) 0000000000000000 0000000000000000
0000000000000000 0000000000000000
Aug 6 14:38:19.870148 (XEN) ffff82d0802f7d68 ffff8300beaf9000
ffff830237cf2000 0000000000000000
Aug 6 14:38:19.878018 (XEN) ffff830237cf3800 0000000000000000
ffff82d0802f7d58 ffff82d080123b3e
Aug 6 14:38:19.886025 (XEN) ffff82d0802f7da8 ffff82d080123b60
ffff82d0802f7d88 ffff82d08013ce5c
Aug 6 14:38:19.894016 (XEN) ffff830237cf2000 ffff8300beaf9000
ffff830237cf2000 0000000000000000
Aug 6 14:38:19.902095 (XEN) 0000000000000000 0000000000000000
ffff82d0802f7dd8 ffff82d080129d58
Aug 6 14:38:19.910094 (XEN) ffff82d0802f7dd8 ffff82d08013ce5c
ffff8300beaf9000 ffff830237cf2000
Aug 6 14:38:19.917992 (XEN) ffff82d0802f7e18 ffff82d080105d3c
ffff82d08012d02e ffff82d0802a3700
Aug 6 14:38:19.926215 (XEN) ffff82d0802a36f8 ffff82d0802a3700
000000000000001e 0000000000000003
Aug 6 14:38:19.934012 (XEN) ffff82d0802f7e48 ffff82d0802aa113
0000000000000001 ffff830237cf1eb0
Aug 6 14:38:19.942016 (XEN) 0000000000000002 0000000000000002
ffff82d0802f7f08 ffff82d0802c7de0
Aug 6 14:38:19.950031 (XEN) 0000000000000000 0000000000100000
00000000011f3000 0000000000240000
Aug 6 14:38:19.958051 (XEN) 0080016300000000 00000000011f3001
0000000000000000 0000000000000006
Aug 6 14:38:19.973992 (XEN) ffff83000008ac50 ffff83000008af20
0000000100000002 ffff83000008afb0
Aug 6 14:38:19.981975 (XEN) 0000000800000000 000000010000006e
0000000000000003 00000000000002f8
Aug 6 14:38:19.989973 (XEN) Xen call trace:
Aug 6 14:38:19.990009 (XEN) [<ffff82d08012365a>]
_csched_cpu_pick+0x156/0x62c
Aug 6 14:38:19.998119 (XEN) [<ffff82d080123b3e>]
csched_cpu_pick+0xe/0x10
Aug 6 14:38:20.005960 (XEN) [<ffff82d080123b60>]
csched_vcpu_insert+0x20/0x161
Aug 6 14:38:20.014035 (XEN) [<ffff82d080129d58>]
sched_init_vcpu+0x1d1/0x218
Aug 6 14:38:20.022056 (XEN) [<ffff82d080105d3c>] alloc_vcpu+0x1c4/0x2b4
Aug 6 14:38:20.022124 (XEN) [<ffff82d0802aa113>]
scheduler_init+0x1b1/0x272
Aug 6 14:38:20.030009 (XEN) [<ffff82d0802c7de0>]
__start_xen+0x1f71/0x255f
Aug 6 14:38:20.037985 (XEN) [<ffff82d080100073>] __high_start+0x53/0x55
Aug 6 14:38:20.045953 (XEN)
Aug 6 14:38:20.045988 (XEN)
Aug 6 14:38:20.046025 (XEN) ****************************************
Aug 6 14:38:20.053978 (XEN) Panic on CPU 0:
Aug 6 14:38:20.054013 (XEN) Assertion 'cpu < nr_cpu_ids' failed at
...99976.build-amd64/xen/xen/include/xen/cpumask.h:97
Aug 6 14:38:20.070100 (XEN) ****************************************
Aug 6 14:38:20.078024 (XEN)
Aug 6 14:38:20.078053 (XEN) Reboot in five seconds...
Aug 6 14:38:20.085956 (XEN) Resetting with ACPI MEMORY or I/O RESET_REG.
~Andrew
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [xen-4.6-testing bisection] complete test-amd64-amd64-xl-pvh-intel
2016-08-06 16:55 ` Andrew Cooper
@ 2016-08-08 6:14 ` Jan Beulich
0 siblings, 0 replies; 3+ messages in thread
From: Jan Beulich @ 2016-08-08 6:14 UTC (permalink / raw)
To: Andrew Cooper; +Cc: xen-devel
>>> On 06.08.16 at 18:55, <andrew.cooper3@citrix.com> wrote:
> On 06/08/16 17:24, osstest service owner wrote:
>> branch xen-4.6-testing
>> xenbranch xen-4.6-testing
>> job test-amd64-amd64-xl-pvh-intel
>> testid xen-boot
>>
>> Tree: linux git://xenbits.xen.org/linux-pvops.git
>> Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
>> Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
>> Tree: qemuu git://xenbits.xen.org/qemu-xen.git
>> Tree: xen git://xenbits.xen.org/xen.git
>>
>> *** Found and reproduced problem changeset ***
>>
>> Bug is in tree: xen git://xenbits.xen.org/xen.git
>> Bug introduced: 477080fc560a3025d451175b69995e62a2ce1a8d
>> Bug not present: ec712ba0838b7d7fb11229d1a5ab42978c14a782
>> Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/99995/
>>
>>
>> commit 477080fc560a3025d451175b69995e62a2ce1a8d
>> Author: George Dunlap <george.dunlap@citrix.com>
>> Date: Fri Aug 5 13:47:04 2016 +0200
>>
>> xen: Have schedulers revise initial placement
>
> More fallout from backports. Perhaps it would be safer not to backport
> this change.
As (mostly) expected (see the mail I had sent to George and
Dario); I'll revert it on 4.6 too, but I think ultimately (once its
prereqs have been identified) we want this backported.
Jan
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2016-08-08 6:14 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2016-08-06 16:24 [xen-4.6-testing bisection] complete test-amd64-amd64-xl-pvh-intel osstest service owner
2016-08-06 16:55 ` Andrew Cooper
2016-08-08 6:14 ` Jan Beulich
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).