On 7. Aug 2019, at 14:20, Jan Beulich > wrote: On 07.08.2019 14:07, Elnikety, Eslam wrote: On 7. Aug 2019, at 13:40, Andrew Cooper > wrote: On 07/08/2019 12:20, Eslam Elnikety wrote: Adding support for FIFO event channel ABI was first introduced in Xen 4.4 (see 88910061ec6). Make this support tunable, since the choice of which event channel ABI has implications for hibernation. Consider resuming a pre Xen 4.4 hibernated Linux guest. The guest boot kernel defaults to FIFO ABI, whereas the resume kernel assumes 2L. This, in turn, results in Xen and the resumed kernel talking past each other (due to different protocols FIFO vs 2L). I'm afraid I don't follow. We have a Linux kernel which knows about FIFO, which was first booted on Xen < 4.4, so configured 2L mode. It is then suspended, and resumed on a newer Xen >= 4.4. The guest now has a choice between 2L mode, and FIFO mode. What is the problem? When resuming, the guest in question should continue to use 2L mode, because that is what it was using previously. After resuming (i.e., Linux's software_resume), the guest will indeed continue to use 2L. However, Xen has already done evtchn_fifo_init_control as part of the boot kernel init (before the guest's software_resume). Then, we reach the point where guest assumes 2L and Xen assumes FIFO. This involvement of two distinct kernels wasn't obvious at all from the initial posting, despite the use of the terms "guest boot kernel" and "resumed kernel". In any event - isn't this an issue to be solved between the two kernels, without (as far as possible) Xen's involvement, and without restricting guest capabilities? Jan I think a re-write for the commit message is in order, given that the distinction between boot and resume kernels was not clear. I will do that, along with other changes if needed, subject to the maintainers being happy with the patch at a high level. In principle, we can instruct the boot kernel to not use FIFO. Yet, this will be needed when resuming on Xen >= 4.4, but not needed when resuming on Xen < 4.4. I think this is grounds to introduce the knob. Thanks, Eslam