All of lore.kernel.org
 help / color / mirror / Atom feed
* Re: [Xen-devel] [Xen-users] 4.13RC3 and PVHVM makes drive drops just after boot
       [not found] <63a86773-8b9c-0634-2157-ea71cb6eff74@donehue.net>
@ 2019-11-27 10:38 ` George Dunlap
  2019-11-27 12:54   ` Andrew
  0 siblings, 1 reply; 4+ messages in thread
From: George Dunlap @ 2019-11-27 10:38 UTC (permalink / raw)
  To: Andrew; +Cc: Anthony Perard, xen-devel, xen-users

Andrew, thanks for the report.  Redirecting to xen-devel, as it looks
like a bug in a development version of Xen.
 -George

On Wed, Nov 27, 2019 at 4:27 AM Andrew <andrew@donehue.net> wrote:
>
> Hi Everyone,
>
> We have been trying to get Xen + QEMU 4.x working with Ceph/rbd.  A like-for-like build process works with Xen 4.11 & 4.12 + QEMU 3.1.  So we think it is a QEMU 4.x + Xen issue.
>
> The guest starts the boot process in a full hvm guest (ie, gets to grub, then disk drops, and we end up in busy box and not being able to boot the guest). So the ceph/rbd config starts to be read, then stops/drops.
>
> These entries are in the logs many times:
> qemu-system-i386: failed to create 'qdisk' device '768': failed to create drive: Could not open 'rbd:testvms/testvm-disk0:id=admin:key=AQB20M1dsjYmKRAAV7vhmyH/jFhfP22vaEQAvw==:conf=/etc/ceph/ceph.conf': No such file or directory
>
>
> If we set: xen_platform_pci=0
> Then it boots fine (all other config is like for like).  Qemu was compiled with rbd support, and this is confirmed as not working when not using xen_platform_pci.
>
> The problem is that xen_platform_pci=0 is a massive hit on network performance.
>
> Is anyone aware of a way to enable the above without the drive dropping?
>
> Many thanks for any input/advice/directions.
>
>
> Best Regards,
>
> Andrew.
>
>
> Other notes:
>
>
> Within the guest, we see:
>
> xenbus_probe_frontend: Waiting for devices to initialise: (then a time-out/count in seconds)
>
> xenbus_probe_frontend: Timeout connecting to device: device/vbd/768 (local state 1, remote state 1)
>
> [20191127T04:19:27.998Z]  A85          newconn
> [20191127T04:19:28.000Z]  A85.1        rm        /local/domain/7
> [20191127T04:19:28.000Z]  A85.1        write     /local/domain/7
> [20191127T04:19:28.001Z]  A85.1        setperms  /local/domain/7 n0 r7
> [20191127T04:19:28.001Z]  A85.1        rm        /vm/4f17921c-5198-44f9-89c1-e67188586ba4
> [20191127T04:19:28.001Z]  A85.1        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4
> [20191127T04:19:28.001Z]  A85.1        setperms  /vm/4f17921c-5198-44f9-89c1-e67188586ba4 n0 r7
> [20191127T04:19:28.002Z]  A85.1        rm        /libxl/7
> [20191127T04:19:28.002Z]  A85.1        write     /libxl/7
> [20191127T04:19:28.002Z]  A85.1        setperms  /libxl/7 n0
> [20191127T04:19:28.002Z]  A85.1        write     /libxl/7/device
> [20191127T04:19:28.003Z]  A85.1        setperms  /libxl/7/device n0
> [20191127T04:19:28.003Z]  A85.1        write     /local/domain/7/vm /vm/4f17921c-5198-44f9-89c1-e67188586ba4
> [20191127T04:19:28.005Z]  A85.1        write     /local/domain/7/name test
> [20191127T04:19:28.005Z]  A85.1        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4/name test
> [20191127T04:19:28.005Z]  A85.1        write     /local/domain/7/cpu
> [20191127T04:19:28.006Z]  A85.1        setperms  /local/domain/7/cpu n0 r7
> [20191127T04:19:28.006Z]  A85.1        write     /local/domain/7/memory
> [20191127T04:19:28.006Z]  A85.1        setperms  /local/domain/7/memory n0 r7
> [20191127T04:19:28.006Z]  A85.1        write     /local/domain/7/device
> [20191127T04:19:28.006Z]  A85.1        setperms  /local/domain/7/device n0 r7
> [20191127T04:19:28.007Z]  A85.1        write     /local/domain/7/control
> [20191127T04:19:28.007Z]  A85.1        setperms  /local/domain/7/control n0 r7
> [20191127T04:19:28.007Z]  A85.1        write     /local/domain/7/hvmloader
> [20191127T04:19:28.007Z]  A85.1        setperms  /local/domain/7/hvmloader n0 r7
> [20191127T04:19:28.007Z]  A85.1        write     /local/domain/7/control/shutdown
> [20191127T04:19:28.008Z]  A85.1        setperms  /local/domain/7/control/shutdown n7
> [20191127T04:19:28.008Z]  A85.1        write     /local/domain/7/control/feature-poweroff
> [20191127T04:19:28.008Z]  A85.1        setperms  /local/domain/7/control/feature-poweroff n7
> [20191127T04:19:28.008Z]  A85.1        write     /local/domain/7/control/feature-reboot
> [20191127T04:19:28.008Z]  A85.1        setperms  /local/domain/7/control/feature-reboot n7
> [20191127T04:19:28.009Z]  A85.1        write     /local/domain/7/control/feature-suspend
> [20191127T04:19:28.009Z]  A85.1        setperms  /local/domain/7/control/feature-suspend n7
> [20191127T04:19:28.009Z]  A85.1        write     /local/domain/7/control/feature-s3
> [20191127T04:19:28.009Z]  A85.1        setperms  /local/domain/7/control/feature-s3 n7
> [20191127T04:19:28.010Z]  A85.1        write     /local/domain/7/control/feature-s4
> [20191127T04:19:28.010Z]  A85.1        setperms  /local/domain/7/control/feature-s4 n7
> [20191127T04:19:28.010Z]  A85.1        write     /local/domain/7/control/sysrq
> [20191127T04:19:28.010Z]  A85.1        setperms  /local/domain/7/control/sysrq n7
> [20191127T04:19:28.010Z]  A85.1        write     /local/domain/7/device/suspend/event-channel
> [20191127T04:19:28.011Z]  A85.1        setperms  /local/domain/7/device/suspend/event-channel n7
> [20191127T04:19:28.011Z]  A85.1        write     /local/domain/7/data
> [20191127T04:19:28.011Z]  A85.1        setperms  /local/domain/7/data n7
> [20191127T04:19:28.011Z]  A85.1        write     /local/domain/7/drivers
> [20191127T04:19:28.011Z]  A85.1        setperms  /local/domain/7/drivers n7
> [20191127T04:19:28.012Z]  A85.1        write     /local/domain/7/feature
> [20191127T04:19:28.012Z]  A85.1        setperms  /local/domain/7/feature n7
> [20191127T04:19:28.012Z]  A85.1        write     /local/domain/7/attr
> [20191127T04:19:28.012Z]  A85.1        setperms  /local/domain/7/attr n7
> [20191127T04:19:28.014Z]  A85.1        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4/uuid 4f17921c-5198-44f9-89c1-e67188586ba4
> [20191127T04:19:28.014Z]  A85.1        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4/name test
> [20191127T04:19:28.014Z]  A85.1        write     /local/domain/7/control/platform-feature-multiprocessor-suspend 1
> [20191127T04:19:28.014Z]  A85.1        write     /local/domain/7/control/platform-feature-xs_reset_watches 1
> [20191127T04:19:28.015Z]  A85.1        write     /libxl/7/type hvm
> [20191127T04:19:28.015Z]  A85.1        commit
> [20191127T04:19:28.015Z]  A85          write     /libxl/7/dm-version qemu_xen
> [20191127T04:19:28.253Z]  A85.2        write     /local/domain/7/memory/static-max 2097152
> [20191127T04:19:28.253Z]  A85.2        write     /local/domain/7/memory/target 2088960
> [20191127T04:19:28.253Z]  A85.2        write     /local/domain/7/memory/videoram 8192
> [20191127T04:19:28.254Z]  A85.2        write     /local/domain/7/domid 7
> [20191127T04:19:28.254Z]  A85.2        write     /local/domain/7/store/port 1
> [20191127T04:19:28.254Z]  A85.2        write     /local/domain/7/store/ring-ref 1044476
> [20191127T04:19:28.254Z]  A85.2        write     /local/domain/7/cpu/0/availability online
> [20191127T04:19:28.254Z]  A85.2        write     /local/domain/7/cpu/1/availability online
> [20191127T04:19:28.255Z]  A85.2        write     /local/domain/7/cpu/2/availability online
> [20191127T04:19:28.255Z]  A85.2        write     /local/domain/7/cpu/3/availability online
> [20191127T04:19:28.255Z]  A85.2        write     /local/domain/7/platform/acpi 1
> [20191127T04:19:28.255Z]  A85.2        write     /local/domain/7/platform/acpi_s3 1
> [20191127T04:19:28.256Z]  A85.2        write     /local/domain/7/platform/acpi_s4 1
> [20191127T04:19:28.256Z]  A85.2        write     /local/domain/7/platform/acpi_laptop_slate 0
> [20191127T04:19:28.256Z]  A85.2        write     /local/domain/7/platform/device-model qemu_xen
> [20191127T04:19:28.256Z]  A85.2        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4/rtc/timeoffset
> [20191127T04:19:28.256Z]  A85.2        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4/image/ostype hvm
> [20191127T04:19:28.257Z]  A85.2        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4/start_time 1574828368.01
> [20191127T04:19:28.257Z]  A85.2        commit
> [20191127T04:19:28.257Z]  D7           newconn
> [20191127T04:19:28.257Z]  A4           w event   @introduceDomain domlist
> [20191127T04:19:28.258Z]  A85          write     /libxl/7/dm-version qemu_xen
> [20191127T04:19:28.258Z]  A4           watch     /local/domain/7/console dom7
> [20191127T04:19:28.258Z]  A4           w event   /local/domain/7/console dom7
> [20191127T04:19:28.259Z]  A85.3        rm        /libxl/7/device/vbd/768
> [20191127T04:19:28.259Z]  A85.3        write     /libxl/7/device/vbd/768/frontend /local/domain/7/device/vbd/768
> [20191127T04:19:28.259Z]  A85.3        write     /libxl/7/device/vbd/768/backend /local/domain/0/backend/qdisk/7/768
> [20191127T04:19:28.260Z]  A85.3        rm        /local/domain/7/device/vbd/768
> [20191127T04:19:28.260Z]  A85.3        mkdir     /local/domain/7/device/vbd/768
> [20191127T04:19:28.260Z]  A85.3        setperms  /local/domain/7/device/vbd/768 n7 r0
> [20191127T04:19:28.260Z]  A85.3        write     /local/domain/7/device/vbd/768/backend /local/domain/0/backend/qdisk/7/768
> [20191127T04:19:28.260Z]  A85.3        write     /local/domain/7/device/vbd/768/backend-id 0
> [20191127T04:19:28.261Z]  A85.3        setperms  /local/domain/7/device/vbd/768/backend-id n7 r0
> [20191127T04:19:28.261Z]  A85.3        write     /local/domain/7/device/vbd/768/state 1
> [20191127T04:19:28.261Z]  A85.3        setperms  /local/domain/7/device/vbd/768/state n7 r0
> [20191127T04:19:28.261Z]  A85.3        write     /local/domain/7/device/vbd/768/virtual-device 768
> [20191127T04:19:28.261Z]  A85.3        setperms  /local/domain/7/device/vbd/768/virtual-device n7 r0
> [20191127T04:19:28.262Z]  A85.3        write     /local/domain/7/device/vbd/768/device-type disk
> [20191127T04:19:28.262Z]  A85.3        setperms  /local/domain/7/device/vbd/768/device-type n7 r0
> [20191127T04:19:28.262Z]  A85.3        rm        /local/domain/0/backend/qdisk/7/768
> [20191127T04:19:28.262Z]  A85.3        mkdir     /local/domain/0/backend/qdisk/7/768
> [20191127T04:19:28.263Z]  A85.3        setperms  /local/domain/0/backend/qdisk/7/768 n0 r7
> [20191127T04:19:28.263Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/frontend /local/domain/7/device/vbd/768
> [20191127T04:19:28.263Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/params aio:rbd:testvms/testvm-disk0:id=admin:key=AQB20M1dsjYmKRAAV7vhmyH/jFhfP22vaEQAvw==:co..
> [20191127T04:19:28.263Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/frontend-id 7
> [20191127T04:19:28.263Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/online 1
> [20191127T04:19:28.264Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/removable 0
> [20191127T04:19:28.264Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/bootable 1
> [20191127T04:19:28.264Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/state 1
> [20191127T04:19:28.264Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/dev hda
> [20191127T04:19:28.264Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/type qdisk
> [20191127T04:19:28.265Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/mode w
> [20191127T04:19:28.265Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/device-type disk
> [20191127T04:19:28.265Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/discard-enable 1
> [20191127T04:19:28.265Z]  A85.3        write     /libxl/7/device/vbd/768/params aio:rbd:testvms/testvm-disk0:id=admin:key=AQB20M1dsjYmKRAAV7vhmyH/jFhfP22vaEQAvw==:conf=/etc/ceph..
> [20191127T04:19:28.266Z]  A85.3        write     /libxl/7/device/vbd/768/frontend-id 7
> [20191127T04:19:28.266Z]  A85.3        write     /libxl/7/device/vbd/768/online 1
> [20191127T04:19:28.266Z]  A85.3        write     /libxl/7/device/vbd/768/removable 0
> [20191127T04:19:28.266Z]  A85.3        write     /libxl/7/device/vbd/768/bootable 1
> [20191127T04:19:28.266Z]  A85.3        write     /libxl/7/device/vbd/768/state 1
> [20191127T04:19:28.267Z]  A85.3        write     /libxl/7/device/vbd/768/dev hda
> [20191127T04:19:28.267Z]  A85.3        write     /libxl/7/device/vbd/768/type qdisk
> [20191127T04:19:28.267Z]  A85.3        write     /libxl/7/device/vbd/768/mode w
> [20191127T04:19:28.267Z]  A85.3        write     /libxl/7/device/vbd/768/device-type disk
> [20191127T04:19:28.267Z]  A85.3        write     /libxl/7/device/vbd/768/discard-enable 1
> [20191127T04:19:28.268Z]  A85.3        commit
> [20191127T04:19:28.268Z]  A8           w event   backend/qdisk/7/768 c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.268Z]  D0           w event   backend/qdisk/7/768 FFFFFFFF820BD980
> [20191127T04:19:28.268Z]  A8           w event   backend/qdisk/7/768 c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.268Z]  D0           w event   backend/qdisk/7/768 FFFFFFFF820BD980
> [20191127T04:19:28.268Z]  A8           w event   backend/qdisk/7/768/frontend c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.268Z]  D0           w event   backend/qdisk/7/768/frontend FFFFFFFF820BD980
> [20191127T04:19:28.268Z]  A8           w event   backend/qdisk/7/768/params c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.268Z]  D0           w event   backend/qdisk/7/768/params FFFFFFFF820BD980
> [20191127T04:19:28.269Z]  A8           w event   backend/qdisk/7/768/frontend-id c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.269Z]  D0           w event   backend/qdisk/7/768/frontend-id FFFFFFFF820BD980
> [20191127T04:19:28.269Z]  A8           w event   backend/qdisk/7/768/online c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.269Z]  D0           w event   backend/qdisk/7/768/online FFFFFFFF820BD980
> [20191127T04:19:28.269Z]  A8           w event   backend/qdisk/7/768/removable c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.269Z]  D0           w event   backend/qdisk/7/768/removable FFFFFFFF820BD980
> [20191127T04:19:28.269Z]  A8           w event   backend/qdisk/7/768/bootable c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.269Z]  D0           w event   backend/qdisk/7/768/bootable FFFFFFFF820BD980
> [20191127T04:19:28.269Z]  A8           w event   backend/qdisk/7/768/state c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.269Z]  D0           w event   backend/qdisk/7/768/state FFFFFFFF820BD980
> [20191127T04:19:28.269Z]  A8           w event   backend/qdisk/7/768/dev c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.269Z]  D0           w event   backend/qdisk/7/768/dev FFFFFFFF820BD980
> [20191127T04:19:28.269Z]  A8           w event   backend/qdisk/7/768/type c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.270Z]  D0           w event   backend/qdisk/7/768/type FFFFFFFF820BD980
> [20191127T04:19:28.270Z]  A8           w event   backend/qdisk/7/768/mode c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.270Z]  D0           w event   backend/qdisk/7/768/mode FFFFFFFF820BD980
> [20191127T04:19:28.270Z]  A8           w event   backend/qdisk/7/768/device-type c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.270Z]  D0           w event   backend/qdisk/7/768/device-type FFFFFFFF820BD980
> [20191127T04:19:28.270Z]  A8           w event   backend/qdisk/7/768/discard-enable c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.270Z]  D0           w event   backend/qdisk/7/768/discard-enable FFFFFFFF820BD980
> [20191127T04:19:28.271Z]  A85.4        rm        /libxl/7/device/console/0
> [20191127T04:19:28.271Z]  A85.4        write     /libxl/7/device/console/0/frontend /local/domain/7/console
> [20191127T04:19:28.272Z]  A85.4        write     /libxl/7/device/console/0/backend /local/domain/0/backend/console/7/0
> [20191127T04:19:28.272Z]  A85.4        rm        /local/domain/7/console
> [20191127T04:19:28.272Z]  A85.4        mkdir     /local/domain/7/console
> [20191127T04:19:28.273Z]  A85.4        setperms  /local/domain/7/console n0 r7
> [20191127T04:19:28.273Z]  A85.4        write     /local/domain/7/console/backend /local/domain/0/backend/console/7/0
> [20191127T04:19:28.274Z]  A85.4        write     /local/domain/7/console/backend-id 0
> [20191127T04:19:28.274Z]  A85.4        setperms  /local/domain/7/console/backend-id n7 r0
> [20191127T04:19:28.275Z]  A85.4        write     /local/domain/7/console/limit 1048576
> [20191127T04:19:28.275Z]  A85.4        setperms  /local/domain/7/console/limit n0 r7
> [20191127T04:19:28.275Z]  A85.4        write     /local/domain/7/console/type xenconsoled
> [20191127T04:19:28.276Z]  A85.4        setperms  /local/domain/7/console/type n0 r7
> [20191127T04:19:28.276Z]  A85.4        write     /local/domain/7/console/output pty
> [20191127T04:19:28.276Z]  A85.4        setperms  /local/domain/7/console/output n0 r7
> [20191127T04:19:28.277Z]  A85.4        write     /local/domain/7/console/tty
> [20191127T04:19:28.277Z]  A85.4        setperms  /local/domain/7/console/tty n0 r7
> [20191127T04:19:28.277Z]  A85.4        write     /local/domain/7/console/port 2
> [20191127T04:19:28.278Z]  A85.4        setperms  /local/domain/7/console/port n0 r7
> [20191127T04:19:28.278Z]  A85.4        write     /local/domain/7/console/ring-ref 1044479
> [20191127T04:19:28.278Z]  A85.4        setperms  /local/domain/7/console/ring-ref n0 r7
> [20191127T04:19:28.278Z]  A85.4        rm        /local/domain/0/backend/console/7/0
> [20191127T04:19:28.279Z]  A85.4        mkdir     /local/domain/0/backend/console/7/0
> [20191127T04:19:28.279Z]  A85.4        setperms  /local/domain/0/backend/console/7/0 n0 r7
> [20191127T04:19:28.279Z]  A85.4        write     /local/domain/0/backend/console/7/0/frontend /local/domain/7/console
> [20191127T04:19:28.279Z]  A85.4        write     /local/domain/0/backend/console/7/0/frontend-id 7
> [20191127T04:19:28.280Z]  A85.4        write     /local/domain/0/backend/console/7/0/online 1
> [20191127T04:19:28.280Z]  A85.4        write     /local/domain/0/backend/console/7/0/state 1
> [20191127T04:19:28.280Z]  A85.4        write     /local/domain/0/backend/console/7/0/protocol vt100
> [20191127T04:19:28.280Z]  A85.4        write     /libxl/7/device/console/0/frontend-id 7
> [20191127T04:19:28.281Z]  A85.4        write     /libxl/7/device/console/0/online 1
> [20191127T04:19:28.281Z]  A85.4        write     /libxl/7/device/console/0/state 1
> [20191127T04:19:28.281Z]  A85.4        write     /libxl/7/device/console/0/protocol vt100
> [20191127T04:19:28.281Z]  A85.4        commit
> [20191127T04:19:28.281Z]  A8           w event   backend/console/7/0 c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.281Z]  A4           w event   /local/domain/7/console dom7
> [20191127T04:19:28.282Z]  D0           w event   backend/console/7/0 FFFFFFFF820BD980
> [20191127T04:19:28.282Z]  A8           w event   backend/console/7/0 c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.282Z]  A4           w event   /local/domain/7/console dom7
> [20191127T04:19:28.282Z]  D0           w event   backend/console/7/0 FFFFFFFF820BD980
> [20191127T04:19:28.282Z]  A8           w event   backend/console/7/0/frontend c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.282Z]  A4           w event   /local/domain/7/console/backend dom7
> [20191127T04:19:28.282Z]  D0           w event   backend/console/7/0/frontend FFFFFFFF820BD980
> [20191127T04:19:28.282Z]  A8           w event   backend/console/7/0/frontend-id c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.282Z]  A4           w event   /local/domain/7/console/backend-id dom7
> [20191127T04:19:28.282Z]  D0           w event   backend/console/7/0/frontend-id FFFFFFFF820BD980
> [20191127T04:19:28.282Z]  A8           w event   backend/console/7/0/online c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.282Z]  A4           w event   /local/domain/7/console/backend-id dom7
> [20191127T04:19:28.282Z]  D0           w event   backend/console/7/0/online FFFFFFFF820BD980
> [20191127T04:19:28.283Z]  A8           w event   backend/console/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.283Z]  A4           w event   /local/domain/7/console/limit dom7
> [20191127T04:19:28.283Z]  D0           w event   backend/console/7/0/state FFFFFFFF820BD980
> [20191127T04:19:28.283Z]  A8           w event   backend/console/7/0/protocol c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.283Z]  A4           w event   /local/domain/7/console/limit dom7
> [20191127T04:19:28.283Z]  D0           w event   backend/console/7/0/protocol FFFFFFFF820BD980
> [20191127T04:19:28.283Z]  A4           w event   /local/domain/7/console/type dom7
> [20191127T04:19:28.283Z]  A4           w event   /local/domain/7/console/type dom7
> [20191127T04:19:28.283Z]  A4           w event   /local/domain/7/console/output dom7
> [20191127T04:19:28.283Z]  A4           w event   /local/domain/7/console/output dom7
> [20191127T04:19:28.283Z]  A4           w event   /local/domain/7/console/tty dom7
> [20191127T04:19:28.284Z]  A4           w event   /local/domain/7/console/tty dom7
> [20191127T04:19:28.284Z]  A4           w event   /local/domain/7/console/port dom7
> [20191127T04:19:28.284Z]  A4           w event   /local/domain/7/console/port dom7
> [20191127T04:19:28.284Z]  A4           w event   /local/domain/7/console/ring-ref dom7
> [20191127T04:19:28.284Z]  A4           w event   /local/domain/7/console/ring-ref dom7
> [20191127T04:19:28.285Z]  A85.5        rm        /libxl/7/device/vkbd/0
> [20191127T04:19:28.285Z]  A85.5        write     /libxl/7/device/vkbd/0/frontend /local/domain/7/device/vkbd/0
> [20191127T04:19:28.286Z]  A85.5        write     /libxl/7/device/vkbd/0/backend /local/domain/0/backend/vkbd/7/0
> [20191127T04:19:28.286Z]  A4           write     /local/domain/7/console/tty /dev/pts/1
> [20191127T04:19:28.286Z]  A85.5        rm        /local/domain/7/device/vkbd/0
> [20191127T04:19:28.286Z]  A4           w event   /local/domain/7/console/tty dom7
> [20191127T04:19:28.287Z]  A85.5        mkdir     /local/domain/7/device/vkbd/0
> [20191127T04:19:28.287Z]  A85.5        setperms  /local/domain/7/device/vkbd/0 n7 r0
> [20191127T04:19:28.287Z]  A85.5        write     /local/domain/7/device/vkbd/0/backend /local/domain/0/backend/vkbd/7/0
> [20191127T04:19:28.288Z]  A85.5        write     /local/domain/7/device/vkbd/0/backend-id 0
> [20191127T04:19:28.288Z]  A85.5        setperms  /local/domain/7/device/vkbd/0/backend-id n7 r0
> [20191127T04:19:28.288Z]  A85.5        write     /local/domain/7/device/vkbd/0/state 1
> [20191127T04:19:28.289Z]  A85.5        setperms  /local/domain/7/device/vkbd/0/state n7 r0
> [20191127T04:19:28.289Z]  A85.5        rm        /local/domain/0/backend/vkbd/7/0
> [20191127T04:19:28.289Z]  A85.5        mkdir     /local/domain/0/backend/vkbd/7/0
> [20191127T04:19:28.290Z]  A85.5        setperms  /local/domain/0/backend/vkbd/7/0 n0 r7
> [20191127T04:19:28.290Z]  A85.5        write     /local/domain/0/backend/vkbd/7/0/frontend /local/domain/7/device/vkbd/0
> [20191127T04:19:28.290Z]  A85.5        write     /local/domain/0/backend/vkbd/7/0/frontend-id 7
> [20191127T04:19:28.290Z]  A85.5        write     /local/domain/0/backend/vkbd/7/0/online 1
> [20191127T04:19:28.291Z]  A85.5        write     /local/domain/0/backend/vkbd/7/0/state 1
> [20191127T04:19:28.291Z]  A85.5        write     /local/domain/0/backend/vkbd/7/0/backend-type qemu
> [20191127T04:19:28.291Z]  A85.5        write     /libxl/7/device/vkbd/0/frontend-id 7
> [20191127T04:19:28.291Z]  A85.5        write     /libxl/7/device/vkbd/0/online 1
> [20191127T04:19:28.292Z]  A85.5        write     /libxl/7/device/vkbd/0/state 1
> [20191127T04:19:28.292Z]  A85.5        write     /libxl/7/device/vkbd/0/backend-type qemu
> [20191127T04:19:28.292Z]  A85.5        conflict
> [20191127T04:19:28.292Z]  r(5):A85.6   rm        /libxl/7/device/vkbd/0
> [20191127T04:19:28.292Z]  r(5):A85.6   write     /libxl/7/device/vkbd/0/frontend /local/domain/7/device/vkbd/0
> [20191127T04:19:28.292Z]  r(5):A85.6   write     /libxl/7/device/vkbd/0/backend /local/domain/0/backend/vkbd/7/0
> [20191127T04:19:28.292Z]  r(5):A85.6   rm        /local/domain/7/device/vkbd/0
> [20191127T04:19:28.292Z]  r(5):A85.6   mkdir     /local/domain/7/device/vkbd/0
> [20191127T04:19:28.292Z]  r(5):A85.6   setperms  /local/domain/7/device/vkbd/0 n7 r0
> [20191127T04:19:28.292Z]  r(5):A85.6   write     /local/domain/7/device/vkbd/0/backend /local/domain/0/backend/vkbd/7/0
> [20191127T04:19:28.292Z]  r(5):A85.6   write     /local/domain/7/device/vkbd/0/backend-id 0
> [20191127T04:19:28.293Z]  r(5):A85.6   setperms  /local/domain/7/device/vkbd/0/backend-id n7 r0
> [20191127T04:19:28.293Z]  r(5):A85.6   write     /local/domain/7/device/vkbd/0/state 1
> [20191127T04:19:28.293Z]  r(5):A85.6   setperms  /local/domain/7/device/vkbd/0/state n7 r0
> [20191127T04:19:28.293Z]  r(5):A85.6   rm        /local/domain/0/backend/vkbd/7/0
> [20191127T04:19:28.293Z]  r(5):A85.6   mkdir     /local/domain/0/backend/vkbd/7/0
> [20191127T04:19:28.293Z]  r(5):A85.6   setperms  /local/domain/0/backend/vkbd/7/0 n0 r7
> [20191127T04:19:28.293Z]  r(5):A85.6   write     /local/domain/0/backend/vkbd/7/0/frontend /local/domain/7/device/vkbd/0
> [20191127T04:19:28.293Z]  r(5):A85.6   write     /local/domain/0/backend/vkbd/7/0/frontend-id 7
> [20191127T04:19:28.293Z]  r(5):A85.6   write     /local/domain/0/backend/vkbd/7/0/online 1
> [20191127T04:19:28.293Z]  r(5):A85.6   write     /local/domain/0/backend/vkbd/7/0/state 1
> [20191127T04:19:28.293Z]  r(5):A85.6   write     /local/domain/0/backend/vkbd/7/0/backend-type qemu
> [20191127T04:19:28.293Z]  r(5):A85.6   write     /libxl/7/device/vkbd/0/frontend-id 7
> [20191127T04:19:28.293Z]  r(5):A85.6   write     /libxl/7/device/vkbd/0/online 1
> [20191127T04:19:28.293Z]  r(5):A85.6   write     /libxl/7/device/vkbd/0/state 1
> [20191127T04:19:28.293Z]  r(5):A85.6   write     /libxl/7/device/vkbd/0/backend-type qemu
> [20191127T04:19:28.293Z]  r(5):A85.6   commit
> [20191127T04:19:28.293Z]  A8           w event   backend/vkbd/7/0 c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.293Z]  D0           w event   backend/vkbd/7/0 FFFFFFFF820BD980
> [20191127T04:19:28.293Z]  A8           w event   backend/vkbd/7/0 c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.293Z]  D0           w event   backend/vkbd/7/0 FFFFFFFF820BD980
> [20191127T04:19:28.294Z]  A8           w event   backend/vkbd/7/0/frontend c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.294Z]  D0           w event   backend/vkbd/7/0/frontend FFFFFFFF820BD980
> [20191127T04:19:28.294Z]  A8           w event   backend/vkbd/7/0/frontend-id c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.294Z]  D0           w event   backend/vkbd/7/0/frontend-id FFFFFFFF820BD980
> [20191127T04:19:28.294Z]  A8           w event   backend/vkbd/7/0/online c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.294Z]  D0           w event   backend/vkbd/7/0/online FFFFFFFF820BD980
> [20191127T04:19:28.294Z]  A8           w event   backend/vkbd/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.294Z]  D0           w event   backend/vkbd/7/0/state FFFFFFFF820BD980
> [20191127T04:19:28.294Z]  A8           w event   backend/vkbd/7/0/backend-type c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.294Z]  D0           w event   backend/vkbd/7/0/backend-type FFFFFFFF820BD980
> [20191127T04:19:28.295Z]  A85          write     /local/domain/7/hvmloader/bios seabios
> [20191127T04:19:28.295Z]  A85          write     /local/domain/7/hvmloader/allow-memory-relocate 0
> [20191127T04:19:28.295Z]  A85          mkdir     /local/domain/0/device-model/7
> [20191127T04:19:28.297Z]  A85.7        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4/vncpasswd testp
> [20191127T04:19:28.298Z]  A85.7        commit
> [20191127T04:19:28.298Z]  A85          watch     /local/domain/0/device-model/7/state 3/0
> [20191127T04:19:28.298Z]  A85          w event   /local/domain/0/device-model/7/state 3/0
> [20191127T04:19:28.303Z]  A86          newconn
> [20191127T04:19:28.303Z]  A86          write     /local/domain/7/image/device-model-pid 2703
> [20191127T04:19:28.413Z]  A87          newconn
> [20191127T04:19:28.415Z]  A88          newconn
> [20191127T04:19:28.416Z]  A88          watch     backend ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.416Z]  A88          w event   backend ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.416Z]  A89          newconn
> [20191127T04:19:28.416Z]  A89          mkdir     device-model/7/backends/console
> [20191127T04:19:28.417Z]  A89          setperms  device-model/7/backends/console n0 n7
> [20191127T04:19:28.417Z]  A89          watch     backend/console/7 be:0x559ad15eeea7:7:0x559ad1921760
> [20191127T04:19:28.417Z]  A89          w event   backend/console/7 be:0x559ad15eeea7:7:0x559ad1921760
> [20191127T04:19:28.418Z]  A89          watch     /local/domain/7/console fe:0x559ad21399a0
> [20191127T04:19:28.418Z]  A89          w event   /local/domain/7/console fe:0x559ad21399a0
> [20191127T04:19:28.418Z]  A89          write     backend/console/7/0/state 1
> [20191127T04:19:28.419Z]  A88          w event   backend/console/7/0/state ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.419Z]  A8           w event   backend/console/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.419Z]  D0           w event   backend/console/7/0/state FFFFFFFF820BD980
> [20191127T04:19:28.419Z]  A89          w event   backend/console/7/0/state be:0x559ad15eeea7:7:0x559ad1921760
> [20191127T04:19:28.420Z]  A89          mkdir     device-model/7/backends/vkbd
> [20191127T04:19:28.421Z]  A89          setperms  device-model/7/backends/vkbd n0 n7
> [20191127T04:19:28.421Z]  A89          watch     backend/vkbd/7 be:0x559ad15eeeaf:7:0x559ad1923dc0
> [20191127T04:19:28.421Z]  A89          w event   backend/vkbd/7 be:0x559ad15eeeaf:7:0x559ad1923dc0
> [20191127T04:19:28.422Z]  A89          watch     /local/domain/7/device/vkbd/0 fe:0x559ad213a800
> [20191127T04:19:28.422Z]  A89          w event   /local/domain/7/device/vkbd/0 fe:0x559ad213a800
> [20191127T04:19:28.423Z]  A89          write     backend/vkbd/7/0/state 1
> [20191127T04:19:28.423Z]  A88          w event   backend/vkbd/7/0/state ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.423Z]  A8           w event   backend/vkbd/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.423Z]  D0           w event   backend/vkbd/7/0/state FFFFFFFF820BD980
> [20191127T04:19:28.423Z]  A89          w event   backend/vkbd/7/0/state be:0x559ad15eeeaf:7:0x559ad1923dc0
> [20191127T04:19:28.424Z]  A89          write     backend/vkbd/7/0/feature-abs-pointer 1
> [20191127T04:19:28.424Z]  A88          w event   backend/vkbd/7/0/feature-abs-pointer ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.424Z]  A8           w event   backend/vkbd/7/0/feature-abs-pointer c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.424Z]  D0           w event   backend/vkbd/7/0/feature-abs-pointer FFFFFFFF820BD980
> [20191127T04:19:28.424Z]  A89          w event   backend/vkbd/7/0/feature-abs-pointer be:0x559ad15eeeaf:7:0x559ad1923dc0
> [20191127T04:19:28.424Z]  A89          write     backend/vkbd/7/0/feature-raw-pointer 1
> [20191127T04:19:28.425Z]  D0           w event   backend/vkbd/7/0/feature-raw-pointer FFFFFFFF820BD980
> [20191127T04:19:28.425Z]  A88          w event   backend/vkbd/7/0/feature-raw-pointer ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.425Z]  A8           w event   backend/vkbd/7/0/feature-raw-pointer c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.425Z]  A89          w event   backend/vkbd/7/0/feature-raw-pointer be:0x559ad15eeeaf:7:0x559ad1923dc0
> [20191127T04:19:28.425Z]  A89          write     backend/vkbd/7/0/hotplug-status connected
> [20191127T04:19:28.425Z]  D0           w event   backend/vkbd/7/0/hotplug-status FFFFFFFF820BD980
> [20191127T04:19:28.425Z]  A88          w event   backend/vkbd/7/0/hotplug-status ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.425Z]  A8           w event   backend/vkbd/7/0/hotplug-status c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.425Z]  A89          w event   backend/vkbd/7/0/hotplug-status be:0x559ad15eeeaf:7:0x559ad1923dc0
> [20191127T04:19:28.429Z]  A89          write     backend/vkbd/7/0/state 2
> [20191127T04:19:28.429Z]  A88          w event   backend/vkbd/7/0/state ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.429Z]  A8           w event   backend/vkbd/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.429Z]  D0           w event   backend/vkbd/7/0/state FFFFFFFF820BD980
> [20191127T04:19:28.429Z]  A89          w event   backend/vkbd/7/0/state be:0x559ad15eeeaf:7:0x559ad1923dc0
> [20191127T04:19:28.488Z]  A89          write     device-model/7/state running
> [20191127T04:19:28.488Z]  A85          w event   /local/domain/0/device-model/7/state 3/0
> [20191127T04:19:28.489Z]  A85          unwatch   /local/domain/0/device-model/7/state 3/0
> [20191127T04:19:28.489Z]  A86          endconn
> [20191127T04:19:28.501Z]  A85          write     /local/domain/7/serial/0/tty /dev/pts/2
> [20191127T04:19:28.507Z]  A85          write     /local/domain/7/console/vnc-listen 192.168.0.159
> [20191127T04:19:28.507Z]  A89          w event   /local/domain/7/console/vnc-listen fe:0x559ad21399a0
> [20191127T04:19:28.507Z]  A4           w event   /local/domain/7/console/vnc-listen dom7
> [20191127T04:19:28.507Z]  A85          write     /local/domain/7/console/vnc-port 5901
> [20191127T04:19:28.508Z]  A89          w event   /local/domain/7/console/vnc-port fe:0x559ad21399a0
> [20191127T04:19:28.508Z]  A4           w event   /local/domain/7/console/vnc-port dom7
> [20191127T04:19:28.513Z]  A85          write     /local/domain/7/console/vnc-pass testpass
> [20191127T04:19:28.513Z]  A89          w event   /local/domain/7/console/vnc-pass fe:0x559ad21399a0
> [20191127T04:19:28.513Z]  A4           w event   /local/domain/7/console/vnc-pass dom7
> [20191127T04:19:28.515Z]  A85.8        rm        /libxl/7/device/vif/0
> [20191127T04:19:28.516Z]  A85.8        write     /libxl/7/device/vif/0/frontend /local/domain/7/device/vif/0
> [20191127T04:19:28.516Z]  A85.8        write     /libxl/7/device/vif/0/backend /local/domain/0/backend/vif/7/0
> [20191127T04:19:28.516Z]  A85.8        rm        /local/domain/7/device/vif/0
> [20191127T04:19:28.517Z]  A85.8        mkdir     /local/domain/7/device/vif/0
> [20191127T04:19:28.517Z]  A85.8        setperms  /local/domain/7/device/vif/0 n7 r0
> [20191127T04:19:28.517Z]  A85.8        write     /local/domain/7/device/vif/0/backend /local/domain/0/backend/vif/7/0
> [20191127T04:19:28.518Z]  A85.8        write     /local/domain/7/device/vif/0/backend-id 0
> [20191127T04:19:28.518Z]  A85.8        setperms  /local/domain/7/device/vif/0/backend-id n7 r0
> [20191127T04:19:28.518Z]  A85.8        write     /local/domain/7/device/vif/0/state 1
> [20191127T04:19:28.519Z]  A85.8        setperms  /local/domain/7/device/vif/0/state n7 r0
> [20191127T04:19:28.519Z]  A85.8        write     /local/domain/7/device/vif/0/handle 0
> [20191127T04:19:28.519Z]  A85.8        setperms  /local/domain/7/device/vif/0/handle n7 r0
> [20191127T04:19:28.520Z]  A85.8        write     /local/domain/7/device/vif/0/mac 00:16:3e:bb:de:ca
> [20191127T04:19:28.520Z]  A85.8        setperms  /local/domain/7/device/vif/0/mac n7 r0
> [20191127T04:19:28.520Z]  A85.8        rm        /local/domain/0/backend/vif/7/0
> [20191127T04:19:28.521Z]  A85.8        mkdir     /local/domain/0/backend/vif/7/0
> [20191127T04:19:28.521Z]  A85.8        setperms  /local/domain/0/backend/vif/7/0 n0 r7
> [20191127T04:19:28.521Z]  A85.8        write     /local/domain/0/backend/vif/7/0/frontend /local/domain/7/device/vif/0
> [20191127T04:19:28.521Z]  A85.8        write     /local/domain/0/backend/vif/7/0/frontend-id 7
> [20191127T04:19:28.522Z]  A85.8        write     /local/domain/0/backend/vif/7/0/online 1
> [20191127T04:19:28.522Z]  A85.8        write     /local/domain/0/backend/vif/7/0/state 1
> [20191127T04:19:28.522Z]  A85.8        write     /local/domain/0/backend/vif/7/0/script /etc/xen/scripts/vif-bridge
> [20191127T04:19:28.523Z]  A85.8        write     /local/domain/0/backend/vif/7/0/mac 00:16:3e:bb:de:ca
> [20191127T04:19:28.523Z]  A85.8        write     /local/domain/0/backend/vif/7/0/bridge xenbr1
> [20191127T04:19:28.523Z]  A85.8        write     /local/domain/0/backend/vif/7/0/handle 0
> [20191127T04:19:28.524Z]  A85.8        write     /local/domain/0/backend/vif/7/0/type vif_ioemu
> [20191127T04:19:28.524Z]  A85.8        write     /libxl/7/device/vif/0/frontend-id 7
> [20191127T04:19:28.524Z]  A85.8        write     /libxl/7/device/vif/0/online 1
> [20191127T04:19:28.525Z]  A85.8        write     /libxl/7/device/vif/0/state 1
> [20191127T04:19:28.525Z]  A85.8        write     /libxl/7/device/vif/0/script /etc/xen/scripts/vif-bridge
> [20191127T04:19:28.525Z]  A85.8        write     /libxl/7/device/vif/0/mac 00:16:3e:bb:de:ca
> [20191127T04:19:28.525Z]  A85.8        write     /libxl/7/device/vif/0/bridge xenbr1
> [20191127T04:19:28.526Z]  A85.8        write     /libxl/7/device/vif/0/handle 0
> [20191127T04:19:28.526Z]  A85.8        write     /libxl/7/device/vif/0/type vif_ioemu
> [20191127T04:19:28.526Z]  A85.8        commit
> [20191127T04:19:28.526Z]  A88          w event   backend/vif/7/0 ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.526Z]  A8           w event   backend/vif/7/0 c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.527Z]  D0           w event   backend/vif/7/0 FFFFFFFF820BD980
> [20191127T04:19:28.527Z]  A88          w event   backend/vif/7/0 ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.527Z]  A8           w event   backend/vif/7/0 c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.527Z]  D0           w event   backend/vif/7/0 FFFFFFFF820BD980
> [20191127T04:19:28.527Z]  A88          w event   backend/vif/7/0/frontend ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.527Z]  A8           w event   backend/vif/7/0/frontend c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.527Z]  D0           w event   backend/vif/7/0/frontend FFFFFFFF820BD980
> [20191127T04:19:28.527Z]  A88          w event   backend/vif/7/0/frontend-id ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.527Z]  A8           w event   backend/vif/7/0/frontend-id c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.527Z]  D0           w event   backend/vif/7/0/frontend-id FFFFFFFF820BD980
> [20191127T04:19:28.527Z]  A88          w event   backend/vif/7/0/online ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.527Z]  A8           w event   backend/vif/7/0/online c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.527Z]  D0           w event   backend/vif/7/0/online FFFFFFFF820BD980
> [20191127T04:19:28.527Z]  A88          w event   backend/vif/7/0/state ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.528Z]  A8           w event   backend/vif/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.528Z]  D0           w event   backend/vif/7/0/state FFFFFFFF820BD980
> [20191127T04:19:28.528Z]  A88          w event   backend/vif/7/0/script ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.528Z]  A8           w event   backend/vif/7/0/script c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.528Z]  D0           w event   backend/vif/7/0/script FFFFFFFF820BD980
> [20191127T04:19:28.528Z]  A85          watch     /local/domain/0/backend/vif/7/0/state 3/1
> [20191127T04:19:28.528Z]  A88          w event   backend/vif/7/0/mac ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.528Z]  A8           w event   backend/vif/7/0/mac c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.528Z]  D0           w event   backend/vif/7/0/mac FFFFFFFF820BD980
> [20191127T04:19:28.528Z]  A88          w event   backend/vif/7/0/bridge ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.528Z]  A8           w event   backend/vif/7/0/bridge c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.528Z]  D0           w event   backend/vif/7/0/bridge FFFFFFFF820BD980
> [20191127T04:19:28.528Z]  A88          w event   backend/vif/7/0/handle ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.528Z]  A8           w event   backend/vif/7/0/handle c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.528Z]  A85          w event   /local/domain/0/backend/vif/7/0/state 3/1
> [20191127T04:19:28.528Z]  D0           w event   backend/vif/7/0/handle FFFFFFFF820BD980
> [20191127T04:19:28.528Z]  A88          w event   backend/vif/7/0/type ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.528Z]  A8           w event   backend/vif/7/0/type c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.528Z]  D0           w event   backend/vif/7/0/type FFFFFFFF820BD980
> [20191127T04:19:28.530Z]  D0.17        write     backend/vif/7/0/feature-sg 1
> [20191127T04:19:28.530Z]  D0.17        write     backend/vif/7/0/feature-gso-tcpv4 1
> [20191127T04:19:28.531Z]  D0.17        write     backend/vif/7/0/feature-gso-tcpv6 1
> [20191127T04:19:28.531Z]  D0.17        write     backend/vif/7/0/feature-ipv6-csum-offload 1
> [20191127T04:19:28.531Z]  D0.17        write     backend/vif/7/0/feature-rx-copy 1
> [20191127T04:19:28.531Z]  D0.17        write     backend/vif/7/0/feature-rx-flip 0
> [20191127T04:19:28.532Z]  D0.17        write     backend/vif/7/0/feature-multicast-control 1
> [20191127T04:19:28.532Z]  D0.17        write     backend/vif/7/0/feature-dynamic-multicast-control 1
> [20191127T04:19:28.532Z]  D0.17        commit
> [20191127T04:19:28.532Z]  D0           w event   backend/vif/7/0/feature-sg FFFFFFFF820BD980
> [20191127T04:19:28.532Z]  A88          w event   backend/vif/7/0/feature-sg ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.532Z]  A8           w event   backend/vif/7/0/feature-sg c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.532Z]  D0           w event   backend/vif/7/0/feature-gso-tcpv4 FFFFFFFF820BD980
> [20191127T04:19:28.532Z]  A88          w event   backend/vif/7/0/feature-gso-tcpv4 ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.532Z]  A8           w event   backend/vif/7/0/feature-gso-tcpv4 c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.532Z]  D0           w event   backend/vif/7/0/feature-gso-tcpv6 FFFFFFFF820BD980
> [20191127T04:19:28.533Z]  A88          w event   backend/vif/7/0/feature-gso-tcpv6 ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.533Z]  A8           w event   backend/vif/7/0/feature-gso-tcpv6 c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.533Z]  D0           w event   backend/vif/7/0/feature-ipv6-csum-offload FFFFFFFF820BD980
> [20191127T04:19:28.533Z]  A88          w event   backend/vif/7/0/feature-ipv6-csum-offload ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.533Z]  A8           w event   backend/vif/7/0/feature-ipv6-csum-offload c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.533Z]  D0           w event   backend/vif/7/0/feature-rx-copy FFFFFFFF820BD980
> [20191127T04:19:28.533Z]  A88          w event   backend/vif/7/0/feature-rx-copy ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.533Z]  A8           w event   backend/vif/7/0/feature-rx-copy c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.533Z]  D0           w event   backend/vif/7/0/feature-rx-flip FFFFFFFF820BD980
> [20191127T04:19:28.533Z]  A88          w event   backend/vif/7/0/feature-rx-flip ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.533Z]  A8           w event   backend/vif/7/0/feature-rx-flip c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.533Z]  D0           w event   backend/vif/7/0/feature-multicast-control FFFFFFFF820BD980
> [20191127T04:19:28.533Z]  A88          w event   backend/vif/7/0/feature-multicast-control ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.533Z]  A8           w event   backend/vif/7/0/feature-multicast-control c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.533Z]  D0           w event   backend/vif/7/0/feature-dynamic-multicast-control FFFFFFFF820BD980
> [20191127T04:19:28.533Z]  A88          w event   backend/vif/7/0/feature-dynamic-multicast-control ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.533Z]  A8           w event   backend/vif/7/0/feature-dynamic-multicast-control c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.534Z]  D0           write     backend/vif/7/0/feature-split-event-channels 1
> [20191127T04:19:28.534Z]  A88          w event   backend/vif/7/0/feature-split-event-channels ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.534Z]  A8           w event   backend/vif/7/0/feature-split-event-channels c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.534Z]  D0           w event   backend/vif/7/0/feature-split-event-channels FFFFFFFF820BD980
> [20191127T04:19:28.534Z]  D0           write     backend/vif/7/0/multi-queue-max-queues 4
> [20191127T04:19:28.534Z]  A88          w event   backend/vif/7/0/multi-queue-max-queues ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.534Z]  D0           w event   backend/vif/7/0/multi-queue-max-queues FFFFFFFF820BD980
> [20191127T04:19:28.534Z]  A8           w event   backend/vif/7/0/multi-queue-max-queues c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.534Z]  D0           write     backend/vif/7/0/feature-ctrl-ring 1
> [20191127T04:19:28.534Z]  A88          w event   backend/vif/7/0/feature-ctrl-ring ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.535Z]  A8           w event   backend/vif/7/0/feature-ctrl-ring c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.535Z]  D0           w event   backend/vif/7/0/feature-ctrl-ring FFFFFFFF820BD980
> [20191127T04:19:28.535Z]  D0           watch     /local/domain/7/device/vif/0/state FFFF888005DD2420
> [20191127T04:19:28.535Z]  D0           w event   /local/domain/7/device/vif/0/state FFFF888005DD2420
> [20191127T04:19:28.546Z]  D0.18        write     backend/vif/7/0/state 2
> [20191127T04:19:28.546Z]  D0.18        commit
> [20191127T04:19:28.546Z]  D0           w event   backend/vif/7/0/state FFFFFFFF820BD980
> [20191127T04:19:28.546Z]  A88          w event   backend/vif/7/0/state ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.547Z]  A8           w event   backend/vif/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.547Z]  A85          w event   /local/domain/0/backend/vif/7/0/state 3/1
> [20191127T04:19:28.547Z]  A85          unwatch   /local/domain/0/backend/vif/7/0/state 3/1
> [20191127T04:19:28.675Z]  A90          newconn
> [20191127T04:19:28.675Z]  A90          endconn
> [20191127T04:19:28.686Z]  A91          newconn
> [20191127T04:19:28.687Z]  A91          endconn
> [20191127T04:19:28.699Z]  A92          newconn
> [20191127T04:19:28.700Z]  A92          endconn
> [20191127T04:19:28.843Z]  A93          newconn
> [20191127T04:19:28.843Z]  A93          write     backend/vif/7/0/hotplug-status connected
> [20191127T04:19:28.843Z]  A88          w event   backend/vif/7/0/hotplug-status ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:28.843Z]  A8           w event   backend/vif/7/0/hotplug-status c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:28.844Z]  D0           w event   backend/vif/7/0/hotplug-status FFFFFFFF820BD980
> [20191127T04:19:28.844Z]  A93          endconn
> [20191127T04:19:28.920Z]  A94          newconn
> [20191127T04:19:28.920Z]  A94          endconn
> [20191127T04:19:28.929Z]  A95          newconn
> [20191127T04:19:28.930Z]  A95          endconn
> [20191127T04:19:28.940Z]  A96          newconn
> [20191127T04:19:28.940Z]  A96          endconn
> [20191127T04:19:29.076Z]  A97          newconn
> [20191127T04:19:29.080Z]  A97          watch     @releaseDomain 3/0
> [20191127T04:19:29.080Z]  A97          w event   @releaseDomain 3/0
> [20191127T04:19:40.434Z]  D7           invalid
> [20191127T04:19:40.434Z]  D7           error     ENOSYS
> [20191127T04:19:40.544Z]  D7           watch     memory/target FFFFFFFF824BE2C0
> [20191127T04:19:40.544Z]  D7           w event   memory/target FFFFFFFF824BE2C0
> [20191127T04:19:40.544Z]  D7           watch     control/shutdown FFFFFFFF824BD4A0
> [20191127T04:19:40.544Z]  D7           w event   control/shutdown FFFFFFFF824BD4A0
> [20191127T04:19:40.544Z]  D7           watch     control/sysrq FFFFFFFF824BD4C0
> [20191127T04:19:40.544Z]  D7           w event   control/sysrq FFFFFFFF824BD4C0
> [20191127T04:19:40.566Z]  D7           write     control/feature-poweroff 1
> [20191127T04:19:40.566Z]  D7           write     control/feature-reboot 1
> [20191127T04:19:40.566Z]  D7           write     control/feature-suspend 1
> [20191127T04:19:40.567Z]  D7           watch     backend FFFFFFFF824BD980
> [20191127T04:19:40.567Z]  D7           w event   backend FFFFFFFF824BD980
> [20191127T04:19:40.570Z]  D7           watch     device FFFFFFFF824BDB80
> [20191127T04:19:40.570Z]  D7           w event   device FFFFFFFF824BDB80
> [20191127T04:19:41.250Z]  D7           write     device/vkbd/0/request-abs-pointer 1
> [20191127T04:19:41.250Z]  A89          w event   /local/domain/7/device/vkbd/0/request-abs-pointer fe:0x559ad213a800
> [20191127T04:19:41.250Z]  D7           w event   device/vkbd/0/request-abs-pointer FFFFFFFF824BDB80
> [20191127T04:19:41.250Z]  D7.3         write     device/vkbd/0/page-ref 482975
> [20191127T04:19:41.251Z]  D7.3         write     device/vkbd/0/page-gref 8
> [20191127T04:19:41.251Z]  D7.3         write     device/vkbd/0/event-channel 35
> [20191127T04:19:41.251Z]  D7.3         commit
> [20191127T04:19:41.251Z]  D7           w event   device/vkbd/0/page-ref FFFFFFFF824BDB80
> [20191127T04:19:41.251Z]  A89          w event   /local/domain/7/device/vkbd/0/page-ref fe:0x559ad213a800
> [20191127T04:19:41.251Z]  D7           w event   device/vkbd/0/page-gref FFFFFFFF824BDB80
> [20191127T04:19:41.251Z]  A89          w event   /local/domain/7/device/vkbd/0/page-gref fe:0x559ad213a800
> [20191127T04:19:41.251Z]  D7           w event   device/vkbd/0/event-channel FFFFFFFF824BDB80
> [20191127T04:19:41.251Z]  A89          w event   /local/domain/7/device/vkbd/0/event-channel fe:0x559ad213a800
> [20191127T04:19:41.252Z]  D7.4         write     device/vkbd/0/state 3
> [20191127T04:19:41.252Z]  D7.4         commit
> [20191127T04:19:41.252Z]  D7           w event   device/vkbd/0/state FFFFFFFF824BDB80
> [20191127T04:19:41.252Z]  A89          w event   /local/domain/7/device/vkbd/0/state fe:0x559ad213a800
> [20191127T04:19:41.253Z]  D7           watch     /local/domain/0/backend/vkbd/7/0/state FFFF9B607C781820
> [20191127T04:19:41.253Z]  D7           w event   /local/domain/0/backend/vkbd/7/0/state FFFF9B607C781820
> [20191127T04:19:41.253Z]  D7.5         write     device/vkbd/0/state 4
> [20191127T04:19:41.253Z]  D7.5         commit
> [20191127T04:19:41.253Z]  D7           w event   device/vkbd/0/state FFFFFFFF824BDB80
> [20191127T04:19:41.254Z]  A89          w event   /local/domain/7/device/vkbd/0/state fe:0x559ad213a800
> [20191127T04:19:41.254Z]  A89          write     backend/vkbd/7/0/state 4
> [20191127T04:19:41.254Z]  D7           w event   /local/domain/0/backend/vkbd/7/0/state FFFF9B607C781820
> [20191127T04:19:41.254Z]  A88          w event   backend/vkbd/7/0/state ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:41.254Z]  A8           w event   backend/vkbd/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:41.254Z]  D0           w event   backend/vkbd/7/0/state FFFFFFFF820BD980
> [20191127T04:19:41.254Z]  A89          w event   backend/vkbd/7/0/state be:0x559ad15eeeaf:7:0x559ad1923dc0
> [20191127T04:19:41.465Z]  D7           watch     /local/domain/0/backend/qdisk/7/768/state FFFF9B607C780020
> [20191127T04:19:41.465Z]  D7           w event   /local/domain/0/backend/qdisk/7/768/state FFFF9B607C780020
> [20191127T04:19:41.472Z]  D7           watch     /local/domain/0/backend/vif/7/0/state FFFF9B607C783420
> [20191127T04:19:41.472Z]  D7           w event   /local/domain/0/backend/vif/7/0/state FFFF9B607C783420
> [20191127T04:19:41.478Z]  D7.6         write     device/vif/0/multi-queue-num-queues 4
> [20191127T04:19:41.478Z]  D7.6         write     device/vif/0/queue-0/tx-ring-ref 2304
> [20191127T04:19:41.479Z]  D7.6         write     device/vif/0/queue-0/rx-ring-ref 2305
> [20191127T04:19:41.479Z]  D7.6         write     device/vif/0/queue-0/event-channel-tx 38
> [20191127T04:19:41.479Z]  D7.6         write     device/vif/0/queue-0/event-channel-rx 39
> [20191127T04:19:41.480Z]  D7.6         write     device/vif/0/queue-1/tx-ring-ref 2306
> [20191127T04:19:41.480Z]  D7.6         write     device/vif/0/queue-1/rx-ring-ref 2307
> [20191127T04:19:41.480Z]  D7.6         write     device/vif/0/queue-1/event-channel-tx 40
> [20191127T04:19:41.481Z]  D7.6         write     device/vif/0/queue-1/event-channel-rx 41
> [20191127T04:19:41.481Z]  D7.6         write     device/vif/0/queue-2/tx-ring-ref 2308
> [20191127T04:19:41.481Z]  D7.6         write     device/vif/0/queue-2/rx-ring-ref 2309
> [20191127T04:19:41.481Z]  D7.6         write     device/vif/0/queue-2/event-channel-tx 42
> [20191127T04:19:41.482Z]  D7.6         write     device/vif/0/queue-2/event-channel-rx 43
> [20191127T04:19:41.482Z]  D7.6         write     device/vif/0/queue-3/tx-ring-ref 2310
> [20191127T04:19:41.482Z]  D7.6         write     device/vif/0/queue-3/rx-ring-ref 2311
> [20191127T04:19:41.482Z]  D7.6         write     device/vif/0/queue-3/event-channel-tx 44
> [20191127T04:19:41.483Z]  D7.6         write     device/vif/0/queue-3/event-channel-rx 45
> [20191127T04:19:41.483Z]  D7.6         write     device/vif/0/request-rx-copy 1
> [20191127T04:19:41.483Z]  D7.6         write     device/vif/0/feature-rx-notify 1
> [20191127T04:19:41.483Z]  D7.6         write     device/vif/0/feature-sg 1
> [20191127T04:19:41.483Z]  D7.6         write     device/vif/0/feature-gso-tcpv4 1
> [20191127T04:19:41.484Z]  D7.6         write     device/vif/0/feature-gso-tcpv6 1
> [20191127T04:19:41.484Z]  D7.6         write     device/vif/0/feature-ipv6-csum-offload 1
> [20191127T04:19:41.484Z]  D7.6         commit
> [20191127T04:19:41.484Z]  D7           w event   device/vif/0/multi-queue-num-queues FFFFFFFF824BDB80
> [20191127T04:19:41.484Z]  D7           w event   device/vif/0/queue-0/tx-ring-ref FFFFFFFF824BDB80
> [20191127T04:19:41.484Z]  D7           w event   device/vif/0/queue-0/rx-ring-ref FFFFFFFF824BDB80
> [20191127T04:19:41.484Z]  D7           w event   device/vif/0/queue-0/event-channel-tx FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-0/event-channel-rx FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-1/tx-ring-ref FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-1/rx-ring-ref FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-1/event-channel-tx FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-1/event-channel-rx FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-2/tx-ring-ref FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-2/rx-ring-ref FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-2/event-channel-tx FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-2/event-channel-rx FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-3/tx-ring-ref FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-3/rx-ring-ref FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-3/event-channel-tx FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-3/event-channel-rx FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/request-rx-copy FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/feature-rx-notify FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/feature-sg FFFFFFFF824BDB80
> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/feature-gso-tcpv4 FFFFFFFF824BDB80
> [20191127T04:19:41.486Z]  D7           w event   device/vif/0/feature-gso-tcpv6 FFFFFFFF824BDB80
> [20191127T04:19:41.486Z]  D7           w event   device/vif/0/feature-ipv6-csum-offload FFFFFFFF824BDB80
> [20191127T04:19:41.488Z]  D7.7         write     device/vif/0/state 4
> [20191127T04:19:41.488Z]  D7.7         commit
> [20191127T04:19:41.489Z]  D7           w event   device/vif/0/state FFFFFFFF824BDB80
> [20191127T04:19:41.489Z]  D0           w event   /local/domain/7/device/vif/0/state FFFF888005DD2420
> [20191127T04:19:41.490Z]  D0           watch     backend/vif/7/0/rate FFFF888005837D70
> [20191127T04:19:41.490Z]  D0           w event   backend/vif/7/0/rate FFFF888005837D70
> [20191127T04:19:41.490Z]  D0           watch     /local/domain/7/device/vif/0/request-multicast-control FFFF888005837D90
> [20191127T04:19:41.490Z]  D0           w event   /local/domain/7/device/vif/0/request-multicast-control FFFF888005837D90
> [20191127T04:19:41.496Z]  D0           watch     backend/vif/7/0/hotplug-status FFFF8881239B6798
> [20191127T04:19:41.496Z]  D0           w event   backend/vif/7/0/hotplug-status FFFF8881239B6798
> [20191127T04:19:41.497Z]  D0.19        write     backend/vif/7/0/state 4
> [20191127T04:19:41.497Z]  D0.19        commit
> [20191127T04:19:41.497Z]  D0           w event   backend/vif/7/0/state FFFFFFFF820BD980
> [20191127T04:19:41.498Z]  A88          w event   backend/vif/7/0/state ef1f3b0d-207c-4caf-84da-91485e427459
> [20191127T04:19:41.498Z]  A8           w event   backend/vif/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
> [20191127T04:19:41.498Z]  D7           w event   /local/domain/0/backend/vif/7/0/state FFFF9B607C783420
> [20191127T04:19:41.498Z]  D0           unwatch   backend/vif/7/0/hotplug-status FFFF8881239B6798
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xenproject.org
> https://lists.xenproject.org/mailman/listinfo/xen-users

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: [Xen-devel] [Xen-users] 4.13RC3 and PVHVM makes drive drops just after boot
  2019-11-27 10:38 ` [Xen-devel] [Xen-users] 4.13RC3 and PVHVM makes drive drops just after boot George Dunlap
@ 2019-11-27 12:54   ` Andrew
  2019-11-28 10:42     ` Anthony PERARD
  0 siblings, 1 reply; 4+ messages in thread
From: Andrew @ 2019-11-27 12:54 UTC (permalink / raw)
  To: George Dunlap; +Cc: Anthony Perard, xen-devel, xen-users

Thanks George,

I have the system setup for testing, so happy to test any patches that 
may come out.


Best Regards,

Andrew.

On 27/11/19 20:38, George Dunlap wrote:
> Andrew, thanks for the report.  Redirecting to xen-devel, as it looks
> like a bug in a development version of Xen.
>   -George
>
> On Wed, Nov 27, 2019 at 4:27 AM Andrew <andrew@donehue.net> wrote:
>> Hi Everyone,
>>
>> We have been trying to get Xen + QEMU 4.x working with Ceph/rbd.  A like-for-like build process works with Xen 4.11 & 4.12 + QEMU 3.1.  So we think it is a QEMU 4.x + Xen issue.
>>
>> The guest starts the boot process in a full hvm guest (ie, gets to grub, then disk drops, and we end up in busy box and not being able to boot the guest). So the ceph/rbd config starts to be read, then stops/drops.
>>
>> These entries are in the logs many times:
>> qemu-system-i386: failed to create 'qdisk' device '768': failed to create drive: Could not open 'rbd:testvms/testvm-disk0:id=admin:key=AQB20M1dsjYmKRAAV7vhmyH/jFhfP22vaEQAvw==:conf=/etc/ceph/ceph.conf': No such file or directory
>>
>>
>> If we set: xen_platform_pci=0
>> Then it boots fine (all other config is like for like).  Qemu was compiled with rbd support, and this is confirmed as not working when not using xen_platform_pci.
>>
>> The problem is that xen_platform_pci=0 is a massive hit on network performance.
>>
>> Is anyone aware of a way to enable the above without the drive dropping?
>>
>> Many thanks for any input/advice/directions.
>>
>>
>> Best Regards,
>>
>> Andrew.
>>
>>
>> Other notes:
>>
>>
>> Within the guest, we see:
>>
>> xenbus_probe_frontend: Waiting for devices to initialise: (then a time-out/count in seconds)
>>
>> xenbus_probe_frontend: Timeout connecting to device: device/vbd/768 (local state 1, remote state 1)
>>
>> [20191127T04:19:27.998Z]  A85          newconn
>> [20191127T04:19:28.000Z]  A85.1        rm        /local/domain/7
>> [20191127T04:19:28.000Z]  A85.1        write     /local/domain/7
>> [20191127T04:19:28.001Z]  A85.1        setperms  /local/domain/7 n0 r7
>> [20191127T04:19:28.001Z]  A85.1        rm        /vm/4f17921c-5198-44f9-89c1-e67188586ba4
>> [20191127T04:19:28.001Z]  A85.1        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4
>> [20191127T04:19:28.001Z]  A85.1        setperms  /vm/4f17921c-5198-44f9-89c1-e67188586ba4 n0 r7
>> [20191127T04:19:28.002Z]  A85.1        rm        /libxl/7
>> [20191127T04:19:28.002Z]  A85.1        write     /libxl/7
>> [20191127T04:19:28.002Z]  A85.1        setperms  /libxl/7 n0
>> [20191127T04:19:28.002Z]  A85.1        write     /libxl/7/device
>> [20191127T04:19:28.003Z]  A85.1        setperms  /libxl/7/device n0
>> [20191127T04:19:28.003Z]  A85.1        write     /local/domain/7/vm /vm/4f17921c-5198-44f9-89c1-e67188586ba4
>> [20191127T04:19:28.005Z]  A85.1        write     /local/domain/7/name test
>> [20191127T04:19:28.005Z]  A85.1        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4/name test
>> [20191127T04:19:28.005Z]  A85.1        write     /local/domain/7/cpu
>> [20191127T04:19:28.006Z]  A85.1        setperms  /local/domain/7/cpu n0 r7
>> [20191127T04:19:28.006Z]  A85.1        write     /local/domain/7/memory
>> [20191127T04:19:28.006Z]  A85.1        setperms  /local/domain/7/memory n0 r7
>> [20191127T04:19:28.006Z]  A85.1        write     /local/domain/7/device
>> [20191127T04:19:28.006Z]  A85.1        setperms  /local/domain/7/device n0 r7
>> [20191127T04:19:28.007Z]  A85.1        write     /local/domain/7/control
>> [20191127T04:19:28.007Z]  A85.1        setperms  /local/domain/7/control n0 r7
>> [20191127T04:19:28.007Z]  A85.1        write     /local/domain/7/hvmloader
>> [20191127T04:19:28.007Z]  A85.1        setperms  /local/domain/7/hvmloader n0 r7
>> [20191127T04:19:28.007Z]  A85.1        write     /local/domain/7/control/shutdown
>> [20191127T04:19:28.008Z]  A85.1        setperms  /local/domain/7/control/shutdown n7
>> [20191127T04:19:28.008Z]  A85.1        write     /local/domain/7/control/feature-poweroff
>> [20191127T04:19:28.008Z]  A85.1        setperms  /local/domain/7/control/feature-poweroff n7
>> [20191127T04:19:28.008Z]  A85.1        write     /local/domain/7/control/feature-reboot
>> [20191127T04:19:28.008Z]  A85.1        setperms  /local/domain/7/control/feature-reboot n7
>> [20191127T04:19:28.009Z]  A85.1        write     /local/domain/7/control/feature-suspend
>> [20191127T04:19:28.009Z]  A85.1        setperms  /local/domain/7/control/feature-suspend n7
>> [20191127T04:19:28.009Z]  A85.1        write     /local/domain/7/control/feature-s3
>> [20191127T04:19:28.009Z]  A85.1        setperms  /local/domain/7/control/feature-s3 n7
>> [20191127T04:19:28.010Z]  A85.1        write     /local/domain/7/control/feature-s4
>> [20191127T04:19:28.010Z]  A85.1        setperms  /local/domain/7/control/feature-s4 n7
>> [20191127T04:19:28.010Z]  A85.1        write     /local/domain/7/control/sysrq
>> [20191127T04:19:28.010Z]  A85.1        setperms  /local/domain/7/control/sysrq n7
>> [20191127T04:19:28.010Z]  A85.1        write     /local/domain/7/device/suspend/event-channel
>> [20191127T04:19:28.011Z]  A85.1        setperms  /local/domain/7/device/suspend/event-channel n7
>> [20191127T04:19:28.011Z]  A85.1        write     /local/domain/7/data
>> [20191127T04:19:28.011Z]  A85.1        setperms  /local/domain/7/data n7
>> [20191127T04:19:28.011Z]  A85.1        write     /local/domain/7/drivers
>> [20191127T04:19:28.011Z]  A85.1        setperms  /local/domain/7/drivers n7
>> [20191127T04:19:28.012Z]  A85.1        write     /local/domain/7/feature
>> [20191127T04:19:28.012Z]  A85.1        setperms  /local/domain/7/feature n7
>> [20191127T04:19:28.012Z]  A85.1        write     /local/domain/7/attr
>> [20191127T04:19:28.012Z]  A85.1        setperms  /local/domain/7/attr n7
>> [20191127T04:19:28.014Z]  A85.1        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4/uuid 4f17921c-5198-44f9-89c1-e67188586ba4
>> [20191127T04:19:28.014Z]  A85.1        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4/name test
>> [20191127T04:19:28.014Z]  A85.1        write     /local/domain/7/control/platform-feature-multiprocessor-suspend 1
>> [20191127T04:19:28.014Z]  A85.1        write     /local/domain/7/control/platform-feature-xs_reset_watches 1
>> [20191127T04:19:28.015Z]  A85.1        write     /libxl/7/type hvm
>> [20191127T04:19:28.015Z]  A85.1        commit
>> [20191127T04:19:28.015Z]  A85          write     /libxl/7/dm-version qemu_xen
>> [20191127T04:19:28.253Z]  A85.2        write     /local/domain/7/memory/static-max 2097152
>> [20191127T04:19:28.253Z]  A85.2        write     /local/domain/7/memory/target 2088960
>> [20191127T04:19:28.253Z]  A85.2        write     /local/domain/7/memory/videoram 8192
>> [20191127T04:19:28.254Z]  A85.2        write     /local/domain/7/domid 7
>> [20191127T04:19:28.254Z]  A85.2        write     /local/domain/7/store/port 1
>> [20191127T04:19:28.254Z]  A85.2        write     /local/domain/7/store/ring-ref 1044476
>> [20191127T04:19:28.254Z]  A85.2        write     /local/domain/7/cpu/0/availability online
>> [20191127T04:19:28.254Z]  A85.2        write     /local/domain/7/cpu/1/availability online
>> [20191127T04:19:28.255Z]  A85.2        write     /local/domain/7/cpu/2/availability online
>> [20191127T04:19:28.255Z]  A85.2        write     /local/domain/7/cpu/3/availability online
>> [20191127T04:19:28.255Z]  A85.2        write     /local/domain/7/platform/acpi 1
>> [20191127T04:19:28.255Z]  A85.2        write     /local/domain/7/platform/acpi_s3 1
>> [20191127T04:19:28.256Z]  A85.2        write     /local/domain/7/platform/acpi_s4 1
>> [20191127T04:19:28.256Z]  A85.2        write     /local/domain/7/platform/acpi_laptop_slate 0
>> [20191127T04:19:28.256Z]  A85.2        write     /local/domain/7/platform/device-model qemu_xen
>> [20191127T04:19:28.256Z]  A85.2        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4/rtc/timeoffset
>> [20191127T04:19:28.256Z]  A85.2        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4/image/ostype hvm
>> [20191127T04:19:28.257Z]  A85.2        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4/start_time 1574828368.01
>> [20191127T04:19:28.257Z]  A85.2        commit
>> [20191127T04:19:28.257Z]  D7           newconn
>> [20191127T04:19:28.257Z]  A4           w event   @introduceDomain domlist
>> [20191127T04:19:28.258Z]  A85          write     /libxl/7/dm-version qemu_xen
>> [20191127T04:19:28.258Z]  A4           watch     /local/domain/7/console dom7
>> [20191127T04:19:28.258Z]  A4           w event   /local/domain/7/console dom7
>> [20191127T04:19:28.259Z]  A85.3        rm        /libxl/7/device/vbd/768
>> [20191127T04:19:28.259Z]  A85.3        write     /libxl/7/device/vbd/768/frontend /local/domain/7/device/vbd/768
>> [20191127T04:19:28.259Z]  A85.3        write     /libxl/7/device/vbd/768/backend /local/domain/0/backend/qdisk/7/768
>> [20191127T04:19:28.260Z]  A85.3        rm        /local/domain/7/device/vbd/768
>> [20191127T04:19:28.260Z]  A85.3        mkdir     /local/domain/7/device/vbd/768
>> [20191127T04:19:28.260Z]  A85.3        setperms  /local/domain/7/device/vbd/768 n7 r0
>> [20191127T04:19:28.260Z]  A85.3        write     /local/domain/7/device/vbd/768/backend /local/domain/0/backend/qdisk/7/768
>> [20191127T04:19:28.260Z]  A85.3        write     /local/domain/7/device/vbd/768/backend-id 0
>> [20191127T04:19:28.261Z]  A85.3        setperms  /local/domain/7/device/vbd/768/backend-id n7 r0
>> [20191127T04:19:28.261Z]  A85.3        write     /local/domain/7/device/vbd/768/state 1
>> [20191127T04:19:28.261Z]  A85.3        setperms  /local/domain/7/device/vbd/768/state n7 r0
>> [20191127T04:19:28.261Z]  A85.3        write     /local/domain/7/device/vbd/768/virtual-device 768
>> [20191127T04:19:28.261Z]  A85.3        setperms  /local/domain/7/device/vbd/768/virtual-device n7 r0
>> [20191127T04:19:28.262Z]  A85.3        write     /local/domain/7/device/vbd/768/device-type disk
>> [20191127T04:19:28.262Z]  A85.3        setperms  /local/domain/7/device/vbd/768/device-type n7 r0
>> [20191127T04:19:28.262Z]  A85.3        rm        /local/domain/0/backend/qdisk/7/768
>> [20191127T04:19:28.262Z]  A85.3        mkdir     /local/domain/0/backend/qdisk/7/768
>> [20191127T04:19:28.263Z]  A85.3        setperms  /local/domain/0/backend/qdisk/7/768 n0 r7
>> [20191127T04:19:28.263Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/frontend /local/domain/7/device/vbd/768
>> [20191127T04:19:28.263Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/params aio:rbd:testvms/testvm-disk0:id=admin:key=AQB20M1dsjYmKRAAV7vhmyH/jFhfP22vaEQAvw==:co..
>> [20191127T04:19:28.263Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/frontend-id 7
>> [20191127T04:19:28.263Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/online 1
>> [20191127T04:19:28.264Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/removable 0
>> [20191127T04:19:28.264Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/bootable 1
>> [20191127T04:19:28.264Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/state 1
>> [20191127T04:19:28.264Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/dev hda
>> [20191127T04:19:28.264Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/type qdisk
>> [20191127T04:19:28.265Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/mode w
>> [20191127T04:19:28.265Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/device-type disk
>> [20191127T04:19:28.265Z]  A85.3        write     /local/domain/0/backend/qdisk/7/768/discard-enable 1
>> [20191127T04:19:28.265Z]  A85.3        write     /libxl/7/device/vbd/768/params aio:rbd:testvms/testvm-disk0:id=admin:key=AQB20M1dsjYmKRAAV7vhmyH/jFhfP22vaEQAvw==:conf=/etc/ceph..
>> [20191127T04:19:28.266Z]  A85.3        write     /libxl/7/device/vbd/768/frontend-id 7
>> [20191127T04:19:28.266Z]  A85.3        write     /libxl/7/device/vbd/768/online 1
>> [20191127T04:19:28.266Z]  A85.3        write     /libxl/7/device/vbd/768/removable 0
>> [20191127T04:19:28.266Z]  A85.3        write     /libxl/7/device/vbd/768/bootable 1
>> [20191127T04:19:28.266Z]  A85.3        write     /libxl/7/device/vbd/768/state 1
>> [20191127T04:19:28.267Z]  A85.3        write     /libxl/7/device/vbd/768/dev hda
>> [20191127T04:19:28.267Z]  A85.3        write     /libxl/7/device/vbd/768/type qdisk
>> [20191127T04:19:28.267Z]  A85.3        write     /libxl/7/device/vbd/768/mode w
>> [20191127T04:19:28.267Z]  A85.3        write     /libxl/7/device/vbd/768/device-type disk
>> [20191127T04:19:28.267Z]  A85.3        write     /libxl/7/device/vbd/768/discard-enable 1
>> [20191127T04:19:28.268Z]  A85.3        commit
>> [20191127T04:19:28.268Z]  A8           w event   backend/qdisk/7/768 c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.268Z]  D0           w event   backend/qdisk/7/768 FFFFFFFF820BD980
>> [20191127T04:19:28.268Z]  A8           w event   backend/qdisk/7/768 c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.268Z]  D0           w event   backend/qdisk/7/768 FFFFFFFF820BD980
>> [20191127T04:19:28.268Z]  A8           w event   backend/qdisk/7/768/frontend c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.268Z]  D0           w event   backend/qdisk/7/768/frontend FFFFFFFF820BD980
>> [20191127T04:19:28.268Z]  A8           w event   backend/qdisk/7/768/params c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.268Z]  D0           w event   backend/qdisk/7/768/params FFFFFFFF820BD980
>> [20191127T04:19:28.269Z]  A8           w event   backend/qdisk/7/768/frontend-id c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.269Z]  D0           w event   backend/qdisk/7/768/frontend-id FFFFFFFF820BD980
>> [20191127T04:19:28.269Z]  A8           w event   backend/qdisk/7/768/online c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.269Z]  D0           w event   backend/qdisk/7/768/online FFFFFFFF820BD980
>> [20191127T04:19:28.269Z]  A8           w event   backend/qdisk/7/768/removable c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.269Z]  D0           w event   backend/qdisk/7/768/removable FFFFFFFF820BD980
>> [20191127T04:19:28.269Z]  A8           w event   backend/qdisk/7/768/bootable c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.269Z]  D0           w event   backend/qdisk/7/768/bootable FFFFFFFF820BD980
>> [20191127T04:19:28.269Z]  A8           w event   backend/qdisk/7/768/state c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.269Z]  D0           w event   backend/qdisk/7/768/state FFFFFFFF820BD980
>> [20191127T04:19:28.269Z]  A8           w event   backend/qdisk/7/768/dev c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.269Z]  D0           w event   backend/qdisk/7/768/dev FFFFFFFF820BD980
>> [20191127T04:19:28.269Z]  A8           w event   backend/qdisk/7/768/type c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.270Z]  D0           w event   backend/qdisk/7/768/type FFFFFFFF820BD980
>> [20191127T04:19:28.270Z]  A8           w event   backend/qdisk/7/768/mode c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.270Z]  D0           w event   backend/qdisk/7/768/mode FFFFFFFF820BD980
>> [20191127T04:19:28.270Z]  A8           w event   backend/qdisk/7/768/device-type c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.270Z]  D0           w event   backend/qdisk/7/768/device-type FFFFFFFF820BD980
>> [20191127T04:19:28.270Z]  A8           w event   backend/qdisk/7/768/discard-enable c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.270Z]  D0           w event   backend/qdisk/7/768/discard-enable FFFFFFFF820BD980
>> [20191127T04:19:28.271Z]  A85.4        rm        /libxl/7/device/console/0
>> [20191127T04:19:28.271Z]  A85.4        write     /libxl/7/device/console/0/frontend /local/domain/7/console
>> [20191127T04:19:28.272Z]  A85.4        write     /libxl/7/device/console/0/backend /local/domain/0/backend/console/7/0
>> [20191127T04:19:28.272Z]  A85.4        rm        /local/domain/7/console
>> [20191127T04:19:28.272Z]  A85.4        mkdir     /local/domain/7/console
>> [20191127T04:19:28.273Z]  A85.4        setperms  /local/domain/7/console n0 r7
>> [20191127T04:19:28.273Z]  A85.4        write     /local/domain/7/console/backend /local/domain/0/backend/console/7/0
>> [20191127T04:19:28.274Z]  A85.4        write     /local/domain/7/console/backend-id 0
>> [20191127T04:19:28.274Z]  A85.4        setperms  /local/domain/7/console/backend-id n7 r0
>> [20191127T04:19:28.275Z]  A85.4        write     /local/domain/7/console/limit 1048576
>> [20191127T04:19:28.275Z]  A85.4        setperms  /local/domain/7/console/limit n0 r7
>> [20191127T04:19:28.275Z]  A85.4        write     /local/domain/7/console/type xenconsoled
>> [20191127T04:19:28.276Z]  A85.4        setperms  /local/domain/7/console/type n0 r7
>> [20191127T04:19:28.276Z]  A85.4        write     /local/domain/7/console/output pty
>> [20191127T04:19:28.276Z]  A85.4        setperms  /local/domain/7/console/output n0 r7
>> [20191127T04:19:28.277Z]  A85.4        write     /local/domain/7/console/tty
>> [20191127T04:19:28.277Z]  A85.4        setperms  /local/domain/7/console/tty n0 r7
>> [20191127T04:19:28.277Z]  A85.4        write     /local/domain/7/console/port 2
>> [20191127T04:19:28.278Z]  A85.4        setperms  /local/domain/7/console/port n0 r7
>> [20191127T04:19:28.278Z]  A85.4        write     /local/domain/7/console/ring-ref 1044479
>> [20191127T04:19:28.278Z]  A85.4        setperms  /local/domain/7/console/ring-ref n0 r7
>> [20191127T04:19:28.278Z]  A85.4        rm        /local/domain/0/backend/console/7/0
>> [20191127T04:19:28.279Z]  A85.4        mkdir     /local/domain/0/backend/console/7/0
>> [20191127T04:19:28.279Z]  A85.4        setperms  /local/domain/0/backend/console/7/0 n0 r7
>> [20191127T04:19:28.279Z]  A85.4        write     /local/domain/0/backend/console/7/0/frontend /local/domain/7/console
>> [20191127T04:19:28.279Z]  A85.4        write     /local/domain/0/backend/console/7/0/frontend-id 7
>> [20191127T04:19:28.280Z]  A85.4        write     /local/domain/0/backend/console/7/0/online 1
>> [20191127T04:19:28.280Z]  A85.4        write     /local/domain/0/backend/console/7/0/state 1
>> [20191127T04:19:28.280Z]  A85.4        write     /local/domain/0/backend/console/7/0/protocol vt100
>> [20191127T04:19:28.280Z]  A85.4        write     /libxl/7/device/console/0/frontend-id 7
>> [20191127T04:19:28.281Z]  A85.4        write     /libxl/7/device/console/0/online 1
>> [20191127T04:19:28.281Z]  A85.4        write     /libxl/7/device/console/0/state 1
>> [20191127T04:19:28.281Z]  A85.4        write     /libxl/7/device/console/0/protocol vt100
>> [20191127T04:19:28.281Z]  A85.4        commit
>> [20191127T04:19:28.281Z]  A8           w event   backend/console/7/0 c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.281Z]  A4           w event   /local/domain/7/console dom7
>> [20191127T04:19:28.282Z]  D0           w event   backend/console/7/0 FFFFFFFF820BD980
>> [20191127T04:19:28.282Z]  A8           w event   backend/console/7/0 c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.282Z]  A4           w event   /local/domain/7/console dom7
>> [20191127T04:19:28.282Z]  D0           w event   backend/console/7/0 FFFFFFFF820BD980
>> [20191127T04:19:28.282Z]  A8           w event   backend/console/7/0/frontend c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.282Z]  A4           w event   /local/domain/7/console/backend dom7
>> [20191127T04:19:28.282Z]  D0           w event   backend/console/7/0/frontend FFFFFFFF820BD980
>> [20191127T04:19:28.282Z]  A8           w event   backend/console/7/0/frontend-id c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.282Z]  A4           w event   /local/domain/7/console/backend-id dom7
>> [20191127T04:19:28.282Z]  D0           w event   backend/console/7/0/frontend-id FFFFFFFF820BD980
>> [20191127T04:19:28.282Z]  A8           w event   backend/console/7/0/online c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.282Z]  A4           w event   /local/domain/7/console/backend-id dom7
>> [20191127T04:19:28.282Z]  D0           w event   backend/console/7/0/online FFFFFFFF820BD980
>> [20191127T04:19:28.283Z]  A8           w event   backend/console/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.283Z]  A4           w event   /local/domain/7/console/limit dom7
>> [20191127T04:19:28.283Z]  D0           w event   backend/console/7/0/state FFFFFFFF820BD980
>> [20191127T04:19:28.283Z]  A8           w event   backend/console/7/0/protocol c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.283Z]  A4           w event   /local/domain/7/console/limit dom7
>> [20191127T04:19:28.283Z]  D0           w event   backend/console/7/0/protocol FFFFFFFF820BD980
>> [20191127T04:19:28.283Z]  A4           w event   /local/domain/7/console/type dom7
>> [20191127T04:19:28.283Z]  A4           w event   /local/domain/7/console/type dom7
>> [20191127T04:19:28.283Z]  A4           w event   /local/domain/7/console/output dom7
>> [20191127T04:19:28.283Z]  A4           w event   /local/domain/7/console/output dom7
>> [20191127T04:19:28.283Z]  A4           w event   /local/domain/7/console/tty dom7
>> [20191127T04:19:28.284Z]  A4           w event   /local/domain/7/console/tty dom7
>> [20191127T04:19:28.284Z]  A4           w event   /local/domain/7/console/port dom7
>> [20191127T04:19:28.284Z]  A4           w event   /local/domain/7/console/port dom7
>> [20191127T04:19:28.284Z]  A4           w event   /local/domain/7/console/ring-ref dom7
>> [20191127T04:19:28.284Z]  A4           w event   /local/domain/7/console/ring-ref dom7
>> [20191127T04:19:28.285Z]  A85.5        rm        /libxl/7/device/vkbd/0
>> [20191127T04:19:28.285Z]  A85.5        write     /libxl/7/device/vkbd/0/frontend /local/domain/7/device/vkbd/0
>> [20191127T04:19:28.286Z]  A85.5        write     /libxl/7/device/vkbd/0/backend /local/domain/0/backend/vkbd/7/0
>> [20191127T04:19:28.286Z]  A4           write     /local/domain/7/console/tty /dev/pts/1
>> [20191127T04:19:28.286Z]  A85.5        rm        /local/domain/7/device/vkbd/0
>> [20191127T04:19:28.286Z]  A4           w event   /local/domain/7/console/tty dom7
>> [20191127T04:19:28.287Z]  A85.5        mkdir     /local/domain/7/device/vkbd/0
>> [20191127T04:19:28.287Z]  A85.5        setperms  /local/domain/7/device/vkbd/0 n7 r0
>> [20191127T04:19:28.287Z]  A85.5        write     /local/domain/7/device/vkbd/0/backend /local/domain/0/backend/vkbd/7/0
>> [20191127T04:19:28.288Z]  A85.5        write     /local/domain/7/device/vkbd/0/backend-id 0
>> [20191127T04:19:28.288Z]  A85.5        setperms  /local/domain/7/device/vkbd/0/backend-id n7 r0
>> [20191127T04:19:28.288Z]  A85.5        write     /local/domain/7/device/vkbd/0/state 1
>> [20191127T04:19:28.289Z]  A85.5        setperms  /local/domain/7/device/vkbd/0/state n7 r0
>> [20191127T04:19:28.289Z]  A85.5        rm        /local/domain/0/backend/vkbd/7/0
>> [20191127T04:19:28.289Z]  A85.5        mkdir     /local/domain/0/backend/vkbd/7/0
>> [20191127T04:19:28.290Z]  A85.5        setperms  /local/domain/0/backend/vkbd/7/0 n0 r7
>> [20191127T04:19:28.290Z]  A85.5        write     /local/domain/0/backend/vkbd/7/0/frontend /local/domain/7/device/vkbd/0
>> [20191127T04:19:28.290Z]  A85.5        write     /local/domain/0/backend/vkbd/7/0/frontend-id 7
>> [20191127T04:19:28.290Z]  A85.5        write     /local/domain/0/backend/vkbd/7/0/online 1
>> [20191127T04:19:28.291Z]  A85.5        write     /local/domain/0/backend/vkbd/7/0/state 1
>> [20191127T04:19:28.291Z]  A85.5        write     /local/domain/0/backend/vkbd/7/0/backend-type qemu
>> [20191127T04:19:28.291Z]  A85.5        write     /libxl/7/device/vkbd/0/frontend-id 7
>> [20191127T04:19:28.291Z]  A85.5        write     /libxl/7/device/vkbd/0/online 1
>> [20191127T04:19:28.292Z]  A85.5        write     /libxl/7/device/vkbd/0/state 1
>> [20191127T04:19:28.292Z]  A85.5        write     /libxl/7/device/vkbd/0/backend-type qemu
>> [20191127T04:19:28.292Z]  A85.5        conflict
>> [20191127T04:19:28.292Z]  r(5):A85.6   rm        /libxl/7/device/vkbd/0
>> [20191127T04:19:28.292Z]  r(5):A85.6   write     /libxl/7/device/vkbd/0/frontend /local/domain/7/device/vkbd/0
>> [20191127T04:19:28.292Z]  r(5):A85.6   write     /libxl/7/device/vkbd/0/backend /local/domain/0/backend/vkbd/7/0
>> [20191127T04:19:28.292Z]  r(5):A85.6   rm        /local/domain/7/device/vkbd/0
>> [20191127T04:19:28.292Z]  r(5):A85.6   mkdir     /local/domain/7/device/vkbd/0
>> [20191127T04:19:28.292Z]  r(5):A85.6   setperms  /local/domain/7/device/vkbd/0 n7 r0
>> [20191127T04:19:28.292Z]  r(5):A85.6   write     /local/domain/7/device/vkbd/0/backend /local/domain/0/backend/vkbd/7/0
>> [20191127T04:19:28.292Z]  r(5):A85.6   write     /local/domain/7/device/vkbd/0/backend-id 0
>> [20191127T04:19:28.293Z]  r(5):A85.6   setperms  /local/domain/7/device/vkbd/0/backend-id n7 r0
>> [20191127T04:19:28.293Z]  r(5):A85.6   write     /local/domain/7/device/vkbd/0/state 1
>> [20191127T04:19:28.293Z]  r(5):A85.6   setperms  /local/domain/7/device/vkbd/0/state n7 r0
>> [20191127T04:19:28.293Z]  r(5):A85.6   rm        /local/domain/0/backend/vkbd/7/0
>> [20191127T04:19:28.293Z]  r(5):A85.6   mkdir     /local/domain/0/backend/vkbd/7/0
>> [20191127T04:19:28.293Z]  r(5):A85.6   setperms  /local/domain/0/backend/vkbd/7/0 n0 r7
>> [20191127T04:19:28.293Z]  r(5):A85.6   write     /local/domain/0/backend/vkbd/7/0/frontend /local/domain/7/device/vkbd/0
>> [20191127T04:19:28.293Z]  r(5):A85.6   write     /local/domain/0/backend/vkbd/7/0/frontend-id 7
>> [20191127T04:19:28.293Z]  r(5):A85.6   write     /local/domain/0/backend/vkbd/7/0/online 1
>> [20191127T04:19:28.293Z]  r(5):A85.6   write     /local/domain/0/backend/vkbd/7/0/state 1
>> [20191127T04:19:28.293Z]  r(5):A85.6   write     /local/domain/0/backend/vkbd/7/0/backend-type qemu
>> [20191127T04:19:28.293Z]  r(5):A85.6   write     /libxl/7/device/vkbd/0/frontend-id 7
>> [20191127T04:19:28.293Z]  r(5):A85.6   write     /libxl/7/device/vkbd/0/online 1
>> [20191127T04:19:28.293Z]  r(5):A85.6   write     /libxl/7/device/vkbd/0/state 1
>> [20191127T04:19:28.293Z]  r(5):A85.6   write     /libxl/7/device/vkbd/0/backend-type qemu
>> [20191127T04:19:28.293Z]  r(5):A85.6   commit
>> [20191127T04:19:28.293Z]  A8           w event   backend/vkbd/7/0 c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.293Z]  D0           w event   backend/vkbd/7/0 FFFFFFFF820BD980
>> [20191127T04:19:28.293Z]  A8           w event   backend/vkbd/7/0 c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.293Z]  D0           w event   backend/vkbd/7/0 FFFFFFFF820BD980
>> [20191127T04:19:28.294Z]  A8           w event   backend/vkbd/7/0/frontend c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.294Z]  D0           w event   backend/vkbd/7/0/frontend FFFFFFFF820BD980
>> [20191127T04:19:28.294Z]  A8           w event   backend/vkbd/7/0/frontend-id c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.294Z]  D0           w event   backend/vkbd/7/0/frontend-id FFFFFFFF820BD980
>> [20191127T04:19:28.294Z]  A8           w event   backend/vkbd/7/0/online c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.294Z]  D0           w event   backend/vkbd/7/0/online FFFFFFFF820BD980
>> [20191127T04:19:28.294Z]  A8           w event   backend/vkbd/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.294Z]  D0           w event   backend/vkbd/7/0/state FFFFFFFF820BD980
>> [20191127T04:19:28.294Z]  A8           w event   backend/vkbd/7/0/backend-type c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.294Z]  D0           w event   backend/vkbd/7/0/backend-type FFFFFFFF820BD980
>> [20191127T04:19:28.295Z]  A85          write     /local/domain/7/hvmloader/bios seabios
>> [20191127T04:19:28.295Z]  A85          write     /local/domain/7/hvmloader/allow-memory-relocate 0
>> [20191127T04:19:28.295Z]  A85          mkdir     /local/domain/0/device-model/7
>> [20191127T04:19:28.297Z]  A85.7        write     /vm/4f17921c-5198-44f9-89c1-e67188586ba4/vncpasswd testp
>> [20191127T04:19:28.298Z]  A85.7        commit
>> [20191127T04:19:28.298Z]  A85          watch     /local/domain/0/device-model/7/state 3/0
>> [20191127T04:19:28.298Z]  A85          w event   /local/domain/0/device-model/7/state 3/0
>> [20191127T04:19:28.303Z]  A86          newconn
>> [20191127T04:19:28.303Z]  A86          write     /local/domain/7/image/device-model-pid 2703
>> [20191127T04:19:28.413Z]  A87          newconn
>> [20191127T04:19:28.415Z]  A88          newconn
>> [20191127T04:19:28.416Z]  A88          watch     backend ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.416Z]  A88          w event   backend ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.416Z]  A89          newconn
>> [20191127T04:19:28.416Z]  A89          mkdir     device-model/7/backends/console
>> [20191127T04:19:28.417Z]  A89          setperms  device-model/7/backends/console n0 n7
>> [20191127T04:19:28.417Z]  A89          watch     backend/console/7 be:0x559ad15eeea7:7:0x559ad1921760
>> [20191127T04:19:28.417Z]  A89          w event   backend/console/7 be:0x559ad15eeea7:7:0x559ad1921760
>> [20191127T04:19:28.418Z]  A89          watch     /local/domain/7/console fe:0x559ad21399a0
>> [20191127T04:19:28.418Z]  A89          w event   /local/domain/7/console fe:0x559ad21399a0
>> [20191127T04:19:28.418Z]  A89          write     backend/console/7/0/state 1
>> [20191127T04:19:28.419Z]  A88          w event   backend/console/7/0/state ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.419Z]  A8           w event   backend/console/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.419Z]  D0           w event   backend/console/7/0/state FFFFFFFF820BD980
>> [20191127T04:19:28.419Z]  A89          w event   backend/console/7/0/state be:0x559ad15eeea7:7:0x559ad1921760
>> [20191127T04:19:28.420Z]  A89          mkdir     device-model/7/backends/vkbd
>> [20191127T04:19:28.421Z]  A89          setperms  device-model/7/backends/vkbd n0 n7
>> [20191127T04:19:28.421Z]  A89          watch     backend/vkbd/7 be:0x559ad15eeeaf:7:0x559ad1923dc0
>> [20191127T04:19:28.421Z]  A89          w event   backend/vkbd/7 be:0x559ad15eeeaf:7:0x559ad1923dc0
>> [20191127T04:19:28.422Z]  A89          watch     /local/domain/7/device/vkbd/0 fe:0x559ad213a800
>> [20191127T04:19:28.422Z]  A89          w event   /local/domain/7/device/vkbd/0 fe:0x559ad213a800
>> [20191127T04:19:28.423Z]  A89          write     backend/vkbd/7/0/state 1
>> [20191127T04:19:28.423Z]  A88          w event   backend/vkbd/7/0/state ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.423Z]  A8           w event   backend/vkbd/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.423Z]  D0           w event   backend/vkbd/7/0/state FFFFFFFF820BD980
>> [20191127T04:19:28.423Z]  A89          w event   backend/vkbd/7/0/state be:0x559ad15eeeaf:7:0x559ad1923dc0
>> [20191127T04:19:28.424Z]  A89          write     backend/vkbd/7/0/feature-abs-pointer 1
>> [20191127T04:19:28.424Z]  A88          w event   backend/vkbd/7/0/feature-abs-pointer ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.424Z]  A8           w event   backend/vkbd/7/0/feature-abs-pointer c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.424Z]  D0           w event   backend/vkbd/7/0/feature-abs-pointer FFFFFFFF820BD980
>> [20191127T04:19:28.424Z]  A89          w event   backend/vkbd/7/0/feature-abs-pointer be:0x559ad15eeeaf:7:0x559ad1923dc0
>> [20191127T04:19:28.424Z]  A89          write     backend/vkbd/7/0/feature-raw-pointer 1
>> [20191127T04:19:28.425Z]  D0           w event   backend/vkbd/7/0/feature-raw-pointer FFFFFFFF820BD980
>> [20191127T04:19:28.425Z]  A88          w event   backend/vkbd/7/0/feature-raw-pointer ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.425Z]  A8           w event   backend/vkbd/7/0/feature-raw-pointer c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.425Z]  A89          w event   backend/vkbd/7/0/feature-raw-pointer be:0x559ad15eeeaf:7:0x559ad1923dc0
>> [20191127T04:19:28.425Z]  A89          write     backend/vkbd/7/0/hotplug-status connected
>> [20191127T04:19:28.425Z]  D0           w event   backend/vkbd/7/0/hotplug-status FFFFFFFF820BD980
>> [20191127T04:19:28.425Z]  A88          w event   backend/vkbd/7/0/hotplug-status ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.425Z]  A8           w event   backend/vkbd/7/0/hotplug-status c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.425Z]  A89          w event   backend/vkbd/7/0/hotplug-status be:0x559ad15eeeaf:7:0x559ad1923dc0
>> [20191127T04:19:28.429Z]  A89          write     backend/vkbd/7/0/state 2
>> [20191127T04:19:28.429Z]  A88          w event   backend/vkbd/7/0/state ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.429Z]  A8           w event   backend/vkbd/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.429Z]  D0           w event   backend/vkbd/7/0/state FFFFFFFF820BD980
>> [20191127T04:19:28.429Z]  A89          w event   backend/vkbd/7/0/state be:0x559ad15eeeaf:7:0x559ad1923dc0
>> [20191127T04:19:28.488Z]  A89          write     device-model/7/state running
>> [20191127T04:19:28.488Z]  A85          w event   /local/domain/0/device-model/7/state 3/0
>> [20191127T04:19:28.489Z]  A85          unwatch   /local/domain/0/device-model/7/state 3/0
>> [20191127T04:19:28.489Z]  A86          endconn
>> [20191127T04:19:28.501Z]  A85          write     /local/domain/7/serial/0/tty /dev/pts/2
>> [20191127T04:19:28.507Z]  A85          write     /local/domain/7/console/vnc-listen 192.168.0.159
>> [20191127T04:19:28.507Z]  A89          w event   /local/domain/7/console/vnc-listen fe:0x559ad21399a0
>> [20191127T04:19:28.507Z]  A4           w event   /local/domain/7/console/vnc-listen dom7
>> [20191127T04:19:28.507Z]  A85          write     /local/domain/7/console/vnc-port 5901
>> [20191127T04:19:28.508Z]  A89          w event   /local/domain/7/console/vnc-port fe:0x559ad21399a0
>> [20191127T04:19:28.508Z]  A4           w event   /local/domain/7/console/vnc-port dom7
>> [20191127T04:19:28.513Z]  A85          write     /local/domain/7/console/vnc-pass testpass
>> [20191127T04:19:28.513Z]  A89          w event   /local/domain/7/console/vnc-pass fe:0x559ad21399a0
>> [20191127T04:19:28.513Z]  A4           w event   /local/domain/7/console/vnc-pass dom7
>> [20191127T04:19:28.515Z]  A85.8        rm        /libxl/7/device/vif/0
>> [20191127T04:19:28.516Z]  A85.8        write     /libxl/7/device/vif/0/frontend /local/domain/7/device/vif/0
>> [20191127T04:19:28.516Z]  A85.8        write     /libxl/7/device/vif/0/backend /local/domain/0/backend/vif/7/0
>> [20191127T04:19:28.516Z]  A85.8        rm        /local/domain/7/device/vif/0
>> [20191127T04:19:28.517Z]  A85.8        mkdir     /local/domain/7/device/vif/0
>> [20191127T04:19:28.517Z]  A85.8        setperms  /local/domain/7/device/vif/0 n7 r0
>> [20191127T04:19:28.517Z]  A85.8        write     /local/domain/7/device/vif/0/backend /local/domain/0/backend/vif/7/0
>> [20191127T04:19:28.518Z]  A85.8        write     /local/domain/7/device/vif/0/backend-id 0
>> [20191127T04:19:28.518Z]  A85.8        setperms  /local/domain/7/device/vif/0/backend-id n7 r0
>> [20191127T04:19:28.518Z]  A85.8        write     /local/domain/7/device/vif/0/state 1
>> [20191127T04:19:28.519Z]  A85.8        setperms  /local/domain/7/device/vif/0/state n7 r0
>> [20191127T04:19:28.519Z]  A85.8        write     /local/domain/7/device/vif/0/handle 0
>> [20191127T04:19:28.519Z]  A85.8        setperms  /local/domain/7/device/vif/0/handle n7 r0
>> [20191127T04:19:28.520Z]  A85.8        write     /local/domain/7/device/vif/0/mac 00:16:3e:bb:de:ca
>> [20191127T04:19:28.520Z]  A85.8        setperms  /local/domain/7/device/vif/0/mac n7 r0
>> [20191127T04:19:28.520Z]  A85.8        rm        /local/domain/0/backend/vif/7/0
>> [20191127T04:19:28.521Z]  A85.8        mkdir     /local/domain/0/backend/vif/7/0
>> [20191127T04:19:28.521Z]  A85.8        setperms  /local/domain/0/backend/vif/7/0 n0 r7
>> [20191127T04:19:28.521Z]  A85.8        write     /local/domain/0/backend/vif/7/0/frontend /local/domain/7/device/vif/0
>> [20191127T04:19:28.521Z]  A85.8        write     /local/domain/0/backend/vif/7/0/frontend-id 7
>> [20191127T04:19:28.522Z]  A85.8        write     /local/domain/0/backend/vif/7/0/online 1
>> [20191127T04:19:28.522Z]  A85.8        write     /local/domain/0/backend/vif/7/0/state 1
>> [20191127T04:19:28.522Z]  A85.8        write     /local/domain/0/backend/vif/7/0/script /etc/xen/scripts/vif-bridge
>> [20191127T04:19:28.523Z]  A85.8        write     /local/domain/0/backend/vif/7/0/mac 00:16:3e:bb:de:ca
>> [20191127T04:19:28.523Z]  A85.8        write     /local/domain/0/backend/vif/7/0/bridge xenbr1
>> [20191127T04:19:28.523Z]  A85.8        write     /local/domain/0/backend/vif/7/0/handle 0
>> [20191127T04:19:28.524Z]  A85.8        write     /local/domain/0/backend/vif/7/0/type vif_ioemu
>> [20191127T04:19:28.524Z]  A85.8        write     /libxl/7/device/vif/0/frontend-id 7
>> [20191127T04:19:28.524Z]  A85.8        write     /libxl/7/device/vif/0/online 1
>> [20191127T04:19:28.525Z]  A85.8        write     /libxl/7/device/vif/0/state 1
>> [20191127T04:19:28.525Z]  A85.8        write     /libxl/7/device/vif/0/script /etc/xen/scripts/vif-bridge
>> [20191127T04:19:28.525Z]  A85.8        write     /libxl/7/device/vif/0/mac 00:16:3e:bb:de:ca
>> [20191127T04:19:28.525Z]  A85.8        write     /libxl/7/device/vif/0/bridge xenbr1
>> [20191127T04:19:28.526Z]  A85.8        write     /libxl/7/device/vif/0/handle 0
>> [20191127T04:19:28.526Z]  A85.8        write     /libxl/7/device/vif/0/type vif_ioemu
>> [20191127T04:19:28.526Z]  A85.8        commit
>> [20191127T04:19:28.526Z]  A88          w event   backend/vif/7/0 ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.526Z]  A8           w event   backend/vif/7/0 c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.527Z]  D0           w event   backend/vif/7/0 FFFFFFFF820BD980
>> [20191127T04:19:28.527Z]  A88          w event   backend/vif/7/0 ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.527Z]  A8           w event   backend/vif/7/0 c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.527Z]  D0           w event   backend/vif/7/0 FFFFFFFF820BD980
>> [20191127T04:19:28.527Z]  A88          w event   backend/vif/7/0/frontend ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.527Z]  A8           w event   backend/vif/7/0/frontend c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.527Z]  D0           w event   backend/vif/7/0/frontend FFFFFFFF820BD980
>> [20191127T04:19:28.527Z]  A88          w event   backend/vif/7/0/frontend-id ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.527Z]  A8           w event   backend/vif/7/0/frontend-id c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.527Z]  D0           w event   backend/vif/7/0/frontend-id FFFFFFFF820BD980
>> [20191127T04:19:28.527Z]  A88          w event   backend/vif/7/0/online ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.527Z]  A8           w event   backend/vif/7/0/online c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.527Z]  D0           w event   backend/vif/7/0/online FFFFFFFF820BD980
>> [20191127T04:19:28.527Z]  A88          w event   backend/vif/7/0/state ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.528Z]  A8           w event   backend/vif/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.528Z]  D0           w event   backend/vif/7/0/state FFFFFFFF820BD980
>> [20191127T04:19:28.528Z]  A88          w event   backend/vif/7/0/script ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.528Z]  A8           w event   backend/vif/7/0/script c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.528Z]  D0           w event   backend/vif/7/0/script FFFFFFFF820BD980
>> [20191127T04:19:28.528Z]  A85          watch     /local/domain/0/backend/vif/7/0/state 3/1
>> [20191127T04:19:28.528Z]  A88          w event   backend/vif/7/0/mac ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.528Z]  A8           w event   backend/vif/7/0/mac c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.528Z]  D0           w event   backend/vif/7/0/mac FFFFFFFF820BD980
>> [20191127T04:19:28.528Z]  A88          w event   backend/vif/7/0/bridge ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.528Z]  A8           w event   backend/vif/7/0/bridge c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.528Z]  D0           w event   backend/vif/7/0/bridge FFFFFFFF820BD980
>> [20191127T04:19:28.528Z]  A88          w event   backend/vif/7/0/handle ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.528Z]  A8           w event   backend/vif/7/0/handle c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.528Z]  A85          w event   /local/domain/0/backend/vif/7/0/state 3/1
>> [20191127T04:19:28.528Z]  D0           w event   backend/vif/7/0/handle FFFFFFFF820BD980
>> [20191127T04:19:28.528Z]  A88          w event   backend/vif/7/0/type ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.528Z]  A8           w event   backend/vif/7/0/type c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.528Z]  D0           w event   backend/vif/7/0/type FFFFFFFF820BD980
>> [20191127T04:19:28.530Z]  D0.17        write     backend/vif/7/0/feature-sg 1
>> [20191127T04:19:28.530Z]  D0.17        write     backend/vif/7/0/feature-gso-tcpv4 1
>> [20191127T04:19:28.531Z]  D0.17        write     backend/vif/7/0/feature-gso-tcpv6 1
>> [20191127T04:19:28.531Z]  D0.17        write     backend/vif/7/0/feature-ipv6-csum-offload 1
>> [20191127T04:19:28.531Z]  D0.17        write     backend/vif/7/0/feature-rx-copy 1
>> [20191127T04:19:28.531Z]  D0.17        write     backend/vif/7/0/feature-rx-flip 0
>> [20191127T04:19:28.532Z]  D0.17        write     backend/vif/7/0/feature-multicast-control 1
>> [20191127T04:19:28.532Z]  D0.17        write     backend/vif/7/0/feature-dynamic-multicast-control 1
>> [20191127T04:19:28.532Z]  D0.17        commit
>> [20191127T04:19:28.532Z]  D0           w event   backend/vif/7/0/feature-sg FFFFFFFF820BD980
>> [20191127T04:19:28.532Z]  A88          w event   backend/vif/7/0/feature-sg ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.532Z]  A8           w event   backend/vif/7/0/feature-sg c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.532Z]  D0           w event   backend/vif/7/0/feature-gso-tcpv4 FFFFFFFF820BD980
>> [20191127T04:19:28.532Z]  A88          w event   backend/vif/7/0/feature-gso-tcpv4 ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.532Z]  A8           w event   backend/vif/7/0/feature-gso-tcpv4 c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.532Z]  D0           w event   backend/vif/7/0/feature-gso-tcpv6 FFFFFFFF820BD980
>> [20191127T04:19:28.533Z]  A88          w event   backend/vif/7/0/feature-gso-tcpv6 ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.533Z]  A8           w event   backend/vif/7/0/feature-gso-tcpv6 c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.533Z]  D0           w event   backend/vif/7/0/feature-ipv6-csum-offload FFFFFFFF820BD980
>> [20191127T04:19:28.533Z]  A88          w event   backend/vif/7/0/feature-ipv6-csum-offload ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.533Z]  A8           w event   backend/vif/7/0/feature-ipv6-csum-offload c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.533Z]  D0           w event   backend/vif/7/0/feature-rx-copy FFFFFFFF820BD980
>> [20191127T04:19:28.533Z]  A88          w event   backend/vif/7/0/feature-rx-copy ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.533Z]  A8           w event   backend/vif/7/0/feature-rx-copy c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.533Z]  D0           w event   backend/vif/7/0/feature-rx-flip FFFFFFFF820BD980
>> [20191127T04:19:28.533Z]  A88          w event   backend/vif/7/0/feature-rx-flip ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.533Z]  A8           w event   backend/vif/7/0/feature-rx-flip c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.533Z]  D0           w event   backend/vif/7/0/feature-multicast-control FFFFFFFF820BD980
>> [20191127T04:19:28.533Z]  A88          w event   backend/vif/7/0/feature-multicast-control ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.533Z]  A8           w event   backend/vif/7/0/feature-multicast-control c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.533Z]  D0           w event   backend/vif/7/0/feature-dynamic-multicast-control FFFFFFFF820BD980
>> [20191127T04:19:28.533Z]  A88          w event   backend/vif/7/0/feature-dynamic-multicast-control ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.533Z]  A8           w event   backend/vif/7/0/feature-dynamic-multicast-control c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.534Z]  D0           write     backend/vif/7/0/feature-split-event-channels 1
>> [20191127T04:19:28.534Z]  A88          w event   backend/vif/7/0/feature-split-event-channels ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.534Z]  A8           w event   backend/vif/7/0/feature-split-event-channels c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.534Z]  D0           w event   backend/vif/7/0/feature-split-event-channels FFFFFFFF820BD980
>> [20191127T04:19:28.534Z]  D0           write     backend/vif/7/0/multi-queue-max-queues 4
>> [20191127T04:19:28.534Z]  A88          w event   backend/vif/7/0/multi-queue-max-queues ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.534Z]  D0           w event   backend/vif/7/0/multi-queue-max-queues FFFFFFFF820BD980
>> [20191127T04:19:28.534Z]  A8           w event   backend/vif/7/0/multi-queue-max-queues c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.534Z]  D0           write     backend/vif/7/0/feature-ctrl-ring 1
>> [20191127T04:19:28.534Z]  A88          w event   backend/vif/7/0/feature-ctrl-ring ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.535Z]  A8           w event   backend/vif/7/0/feature-ctrl-ring c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.535Z]  D0           w event   backend/vif/7/0/feature-ctrl-ring FFFFFFFF820BD980
>> [20191127T04:19:28.535Z]  D0           watch     /local/domain/7/device/vif/0/state FFFF888005DD2420
>> [20191127T04:19:28.535Z]  D0           w event   /local/domain/7/device/vif/0/state FFFF888005DD2420
>> [20191127T04:19:28.546Z]  D0.18        write     backend/vif/7/0/state 2
>> [20191127T04:19:28.546Z]  D0.18        commit
>> [20191127T04:19:28.546Z]  D0           w event   backend/vif/7/0/state FFFFFFFF820BD980
>> [20191127T04:19:28.546Z]  A88          w event   backend/vif/7/0/state ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.547Z]  A8           w event   backend/vif/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.547Z]  A85          w event   /local/domain/0/backend/vif/7/0/state 3/1
>> [20191127T04:19:28.547Z]  A85          unwatch   /local/domain/0/backend/vif/7/0/state 3/1
>> [20191127T04:19:28.675Z]  A90          newconn
>> [20191127T04:19:28.675Z]  A90          endconn
>> [20191127T04:19:28.686Z]  A91          newconn
>> [20191127T04:19:28.687Z]  A91          endconn
>> [20191127T04:19:28.699Z]  A92          newconn
>> [20191127T04:19:28.700Z]  A92          endconn
>> [20191127T04:19:28.843Z]  A93          newconn
>> [20191127T04:19:28.843Z]  A93          write     backend/vif/7/0/hotplug-status connected
>> [20191127T04:19:28.843Z]  A88          w event   backend/vif/7/0/hotplug-status ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:28.843Z]  A8           w event   backend/vif/7/0/hotplug-status c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:28.844Z]  D0           w event   backend/vif/7/0/hotplug-status FFFFFFFF820BD980
>> [20191127T04:19:28.844Z]  A93          endconn
>> [20191127T04:19:28.920Z]  A94          newconn
>> [20191127T04:19:28.920Z]  A94          endconn
>> [20191127T04:19:28.929Z]  A95          newconn
>> [20191127T04:19:28.930Z]  A95          endconn
>> [20191127T04:19:28.940Z]  A96          newconn
>> [20191127T04:19:28.940Z]  A96          endconn
>> [20191127T04:19:29.076Z]  A97          newconn
>> [20191127T04:19:29.080Z]  A97          watch     @releaseDomain 3/0
>> [20191127T04:19:29.080Z]  A97          w event   @releaseDomain 3/0
>> [20191127T04:19:40.434Z]  D7           invalid
>> [20191127T04:19:40.434Z]  D7           error     ENOSYS
>> [20191127T04:19:40.544Z]  D7           watch     memory/target FFFFFFFF824BE2C0
>> [20191127T04:19:40.544Z]  D7           w event   memory/target FFFFFFFF824BE2C0
>> [20191127T04:19:40.544Z]  D7           watch     control/shutdown FFFFFFFF824BD4A0
>> [20191127T04:19:40.544Z]  D7           w event   control/shutdown FFFFFFFF824BD4A0
>> [20191127T04:19:40.544Z]  D7           watch     control/sysrq FFFFFFFF824BD4C0
>> [20191127T04:19:40.544Z]  D7           w event   control/sysrq FFFFFFFF824BD4C0
>> [20191127T04:19:40.566Z]  D7           write     control/feature-poweroff 1
>> [20191127T04:19:40.566Z]  D7           write     control/feature-reboot 1
>> [20191127T04:19:40.566Z]  D7           write     control/feature-suspend 1
>> [20191127T04:19:40.567Z]  D7           watch     backend FFFFFFFF824BD980
>> [20191127T04:19:40.567Z]  D7           w event   backend FFFFFFFF824BD980
>> [20191127T04:19:40.570Z]  D7           watch     device FFFFFFFF824BDB80
>> [20191127T04:19:40.570Z]  D7           w event   device FFFFFFFF824BDB80
>> [20191127T04:19:41.250Z]  D7           write     device/vkbd/0/request-abs-pointer 1
>> [20191127T04:19:41.250Z]  A89          w event   /local/domain/7/device/vkbd/0/request-abs-pointer fe:0x559ad213a800
>> [20191127T04:19:41.250Z]  D7           w event   device/vkbd/0/request-abs-pointer FFFFFFFF824BDB80
>> [20191127T04:19:41.250Z]  D7.3         write     device/vkbd/0/page-ref 482975
>> [20191127T04:19:41.251Z]  D7.3         write     device/vkbd/0/page-gref 8
>> [20191127T04:19:41.251Z]  D7.3         write     device/vkbd/0/event-channel 35
>> [20191127T04:19:41.251Z]  D7.3         commit
>> [20191127T04:19:41.251Z]  D7           w event   device/vkbd/0/page-ref FFFFFFFF824BDB80
>> [20191127T04:19:41.251Z]  A89          w event   /local/domain/7/device/vkbd/0/page-ref fe:0x559ad213a800
>> [20191127T04:19:41.251Z]  D7           w event   device/vkbd/0/page-gref FFFFFFFF824BDB80
>> [20191127T04:19:41.251Z]  A89          w event   /local/domain/7/device/vkbd/0/page-gref fe:0x559ad213a800
>> [20191127T04:19:41.251Z]  D7           w event   device/vkbd/0/event-channel FFFFFFFF824BDB80
>> [20191127T04:19:41.251Z]  A89          w event   /local/domain/7/device/vkbd/0/event-channel fe:0x559ad213a800
>> [20191127T04:19:41.252Z]  D7.4         write     device/vkbd/0/state 3
>> [20191127T04:19:41.252Z]  D7.4         commit
>> [20191127T04:19:41.252Z]  D7           w event   device/vkbd/0/state FFFFFFFF824BDB80
>> [20191127T04:19:41.252Z]  A89          w event   /local/domain/7/device/vkbd/0/state fe:0x559ad213a800
>> [20191127T04:19:41.253Z]  D7           watch     /local/domain/0/backend/vkbd/7/0/state FFFF9B607C781820
>> [20191127T04:19:41.253Z]  D7           w event   /local/domain/0/backend/vkbd/7/0/state FFFF9B607C781820
>> [20191127T04:19:41.253Z]  D7.5         write     device/vkbd/0/state 4
>> [20191127T04:19:41.253Z]  D7.5         commit
>> [20191127T04:19:41.253Z]  D7           w event   device/vkbd/0/state FFFFFFFF824BDB80
>> [20191127T04:19:41.254Z]  A89          w event   /local/domain/7/device/vkbd/0/state fe:0x559ad213a800
>> [20191127T04:19:41.254Z]  A89          write     backend/vkbd/7/0/state 4
>> [20191127T04:19:41.254Z]  D7           w event   /local/domain/0/backend/vkbd/7/0/state FFFF9B607C781820
>> [20191127T04:19:41.254Z]  A88          w event   backend/vkbd/7/0/state ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:41.254Z]  A8           w event   backend/vkbd/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:41.254Z]  D0           w event   backend/vkbd/7/0/state FFFFFFFF820BD980
>> [20191127T04:19:41.254Z]  A89          w event   backend/vkbd/7/0/state be:0x559ad15eeeaf:7:0x559ad1923dc0
>> [20191127T04:19:41.465Z]  D7           watch     /local/domain/0/backend/qdisk/7/768/state FFFF9B607C780020
>> [20191127T04:19:41.465Z]  D7           w event   /local/domain/0/backend/qdisk/7/768/state FFFF9B607C780020
>> [20191127T04:19:41.472Z]  D7           watch     /local/domain/0/backend/vif/7/0/state FFFF9B607C783420
>> [20191127T04:19:41.472Z]  D7           w event   /local/domain/0/backend/vif/7/0/state FFFF9B607C783420
>> [20191127T04:19:41.478Z]  D7.6         write     device/vif/0/multi-queue-num-queues 4
>> [20191127T04:19:41.478Z]  D7.6         write     device/vif/0/queue-0/tx-ring-ref 2304
>> [20191127T04:19:41.479Z]  D7.6         write     device/vif/0/queue-0/rx-ring-ref 2305
>> [20191127T04:19:41.479Z]  D7.6         write     device/vif/0/queue-0/event-channel-tx 38
>> [20191127T04:19:41.479Z]  D7.6         write     device/vif/0/queue-0/event-channel-rx 39
>> [20191127T04:19:41.480Z]  D7.6         write     device/vif/0/queue-1/tx-ring-ref 2306
>> [20191127T04:19:41.480Z]  D7.6         write     device/vif/0/queue-1/rx-ring-ref 2307
>> [20191127T04:19:41.480Z]  D7.6         write     device/vif/0/queue-1/event-channel-tx 40
>> [20191127T04:19:41.481Z]  D7.6         write     device/vif/0/queue-1/event-channel-rx 41
>> [20191127T04:19:41.481Z]  D7.6         write     device/vif/0/queue-2/tx-ring-ref 2308
>> [20191127T04:19:41.481Z]  D7.6         write     device/vif/0/queue-2/rx-ring-ref 2309
>> [20191127T04:19:41.481Z]  D7.6         write     device/vif/0/queue-2/event-channel-tx 42
>> [20191127T04:19:41.482Z]  D7.6         write     device/vif/0/queue-2/event-channel-rx 43
>> [20191127T04:19:41.482Z]  D7.6         write     device/vif/0/queue-3/tx-ring-ref 2310
>> [20191127T04:19:41.482Z]  D7.6         write     device/vif/0/queue-3/rx-ring-ref 2311
>> [20191127T04:19:41.482Z]  D7.6         write     device/vif/0/queue-3/event-channel-tx 44
>> [20191127T04:19:41.483Z]  D7.6         write     device/vif/0/queue-3/event-channel-rx 45
>> [20191127T04:19:41.483Z]  D7.6         write     device/vif/0/request-rx-copy 1
>> [20191127T04:19:41.483Z]  D7.6         write     device/vif/0/feature-rx-notify 1
>> [20191127T04:19:41.483Z]  D7.6         write     device/vif/0/feature-sg 1
>> [20191127T04:19:41.483Z]  D7.6         write     device/vif/0/feature-gso-tcpv4 1
>> [20191127T04:19:41.484Z]  D7.6         write     device/vif/0/feature-gso-tcpv6 1
>> [20191127T04:19:41.484Z]  D7.6         write     device/vif/0/feature-ipv6-csum-offload 1
>> [20191127T04:19:41.484Z]  D7.6         commit
>> [20191127T04:19:41.484Z]  D7           w event   device/vif/0/multi-queue-num-queues FFFFFFFF824BDB80
>> [20191127T04:19:41.484Z]  D7           w event   device/vif/0/queue-0/tx-ring-ref FFFFFFFF824BDB80
>> [20191127T04:19:41.484Z]  D7           w event   device/vif/0/queue-0/rx-ring-ref FFFFFFFF824BDB80
>> [20191127T04:19:41.484Z]  D7           w event   device/vif/0/queue-0/event-channel-tx FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-0/event-channel-rx FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-1/tx-ring-ref FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-1/rx-ring-ref FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-1/event-channel-tx FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-1/event-channel-rx FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-2/tx-ring-ref FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-2/rx-ring-ref FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-2/event-channel-tx FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-2/event-channel-rx FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-3/tx-ring-ref FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-3/rx-ring-ref FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-3/event-channel-tx FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/queue-3/event-channel-rx FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/request-rx-copy FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/feature-rx-notify FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/feature-sg FFFFFFFF824BDB80
>> [20191127T04:19:41.485Z]  D7           w event   device/vif/0/feature-gso-tcpv4 FFFFFFFF824BDB80
>> [20191127T04:19:41.486Z]  D7           w event   device/vif/0/feature-gso-tcpv6 FFFFFFFF824BDB80
>> [20191127T04:19:41.486Z]  D7           w event   device/vif/0/feature-ipv6-csum-offload FFFFFFFF824BDB80
>> [20191127T04:19:41.488Z]  D7.7         write     device/vif/0/state 4
>> [20191127T04:19:41.488Z]  D7.7         commit
>> [20191127T04:19:41.489Z]  D7           w event   device/vif/0/state FFFFFFFF824BDB80
>> [20191127T04:19:41.489Z]  D0           w event   /local/domain/7/device/vif/0/state FFFF888005DD2420
>> [20191127T04:19:41.490Z]  D0           watch     backend/vif/7/0/rate FFFF888005837D70
>> [20191127T04:19:41.490Z]  D0           w event   backend/vif/7/0/rate FFFF888005837D70
>> [20191127T04:19:41.490Z]  D0           watch     /local/domain/7/device/vif/0/request-multicast-control FFFF888005837D90
>> [20191127T04:19:41.490Z]  D0           w event   /local/domain/7/device/vif/0/request-multicast-control FFFF888005837D90
>> [20191127T04:19:41.496Z]  D0           watch     backend/vif/7/0/hotplug-status FFFF8881239B6798
>> [20191127T04:19:41.496Z]  D0           w event   backend/vif/7/0/hotplug-status FFFF8881239B6798
>> [20191127T04:19:41.497Z]  D0.19        write     backend/vif/7/0/state 4
>> [20191127T04:19:41.497Z]  D0.19        commit
>> [20191127T04:19:41.497Z]  D0           w event   backend/vif/7/0/state FFFFFFFF820BD980
>> [20191127T04:19:41.498Z]  A88          w event   backend/vif/7/0/state ef1f3b0d-207c-4caf-84da-91485e427459
>> [20191127T04:19:41.498Z]  A8           w event   backend/vif/7/0/state c4b33c29-a75e-4c7c-8407-c05c0477af71
>> [20191127T04:19:41.498Z]  D7           w event   /local/domain/0/backend/vif/7/0/state FFFF9B607C783420
>> [20191127T04:19:41.498Z]  D0           unwatch   backend/vif/7/0/hotplug-status FFFF8881239B6798
>>
>> _______________________________________________
>> Xen-users mailing list
>> Xen-users@lists.xenproject.org
>> https://lists.xenproject.org/mailman/listinfo/xen-users
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xenproject.org
> https://lists.xenproject.org/mailman/listinfo/xen-users

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: [Xen-devel] [Xen-users] 4.13RC3 and PVHVM makes drive drops just after boot
  2019-11-27 12:54   ` Andrew
@ 2019-11-28 10:42     ` Anthony PERARD
       [not found]       ` <14702767-e4dd-2fbe-50be-7f5c0737f389@donehue.net>
  0 siblings, 1 reply; 4+ messages in thread
From: Anthony PERARD @ 2019-11-28 10:42 UTC (permalink / raw)
  To: Andrew; +Cc: xen-devel, George Dunlap, xen-users

On Wed, Nov 27, 2019 at 10:54:42PM +1000, Andrew wrote:
> I have the system setup for testing, so happy to test any patches that may
> come out.

Thanks Andrew for the report, I think I understand the issue. I'll work
on a fix.

Cheers,

-- 
Anthony PERARD

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: [Xen-devel] [Xen-users] 4.13RC3 and PVHVM makes drive drops just after boot
       [not found]       ` <14702767-e4dd-2fbe-50be-7f5c0737f389@donehue.net>
@ 2020-01-17 13:38         ` Anthony PERARD
  0 siblings, 0 replies; 4+ messages in thread
From: Anthony PERARD @ 2020-01-17 13:38 UTC (permalink / raw)
  To: Andrew; +Cc: xen-devel

[-- Attachment #1: Type: text/plain, Size: 822 bytes --]

On Sat, Jan 04, 2020 at 10:24:37PM +1000, Andrew wrote:
> Hi Anthony,
> 
> 
> I have been trying to keep an eye on the mailing list, but I might have
> missed it. Do you mind if I ask if you had any luck with the below (and/or
> if there is a subject line or content I should be keeping an eye on to see
> if a patch has been released so we can re-test?)

CCing xen-devel

Hi Andrew,

Sorry, I haven't sent anything yet.

I've managed to workaround one part of the problem, but when I test it
with an nbd backend, my patch isn't enought. But it might work with
Ceph/rbd., I've attatch a patch that you could try.

The issue it that now QEMU wants to connect twice at the same time to
the backend (rbd, nbd) for the same disk. There were only one connection
at a time before, most of the time.

Cheers,

-- 
Anthony PERARD

[-- Attachment #2: 0001-xen-block-Fix-parsing-of-legacy-options.patch --]
[-- Type: text/plain, Size: 4031 bytes --]

From 1b8d700007f1f8709a6ef1960111ea022cfb6d74 Mon Sep 17 00:00:00 2001
From: Anthony PERARD <anthony.perard@citrix.com>
Date: Fri, 17 Jan 2020 12:05:09 +0000
Subject: [PATCH] xen-block: Fix parsing of legacy options

Even though the xen-disk PV backend can be instantiated via QMP, we
still need to handle the case where the backend is created via
xenstore. This means that we need to be able to parse legacy disk
options such as "aio:nbd://host:1234/disk".

Signed-off-by: Anthony PERARD <anthony.perard@citrix.com>
---
 block.c                        |  6 ++++++
 hw/block/xen-block.c           | 25 +++++++++++++++++++++----
 include/sysemu/block-backend.h |  3 +++
 3 files changed, 30 insertions(+), 4 deletions(-)

diff --git a/block.c b/block.c
index ecd09dbbfd89..13b8690e5006 100644
--- a/block.c
+++ b/block.c
@@ -1705,6 +1705,12 @@ static int bdrv_fill_options(QDict **options, const char *filename,
 
     return 0;
 }
+int bdrv_fill_options_legacy(QDict **options, const char *filename,
+                             int *flags, Error **errp)
+{
+    return bdrv_fill_options(options, filename, flags, errp);
+}
+
 
 static int bdrv_child_check_perm(BdrvChild *c, BlockReopenQueue *q,
                                  uint64_t perm, uint64_t shared,
diff --git a/hw/block/xen-block.c b/hw/block/xen-block.c
index 879fc310a4c5..1cc97a001e1f 100644
--- a/hw/block/xen-block.c
+++ b/hw/block/xen-block.c
@@ -28,6 +28,7 @@
 #include "sysemu/iothread.h"
 #include "dataplane/xen-block.h"
 #include "trace.h"
+#include "include/block/qdict.h"
 
 static char *xen_block_get_name(XenDevice *xendev, Error **errp)
 {
@@ -687,7 +688,12 @@ static char *xen_block_blockdev_add(const char *id, QDict *qdict,
 
     trace_xen_block_blockdev_add(node_name);
 
-    v = qobject_input_visitor_new(QOBJECT(qdict));
+    qdict_flatten(qdict);
+    v = qobject_input_visitor_new_flat_confused(qdict, &local_err);
+    if (local_err) {
+        error_propagate(errp, local_err);
+        goto fail;
+    }
     visit_type_BlockdevOptions(v, NULL, &options, &local_err);
     visit_free(v);
 
@@ -782,8 +788,14 @@ static XenBlockDrive *xen_block_drive_create(const char *id,
     file_layer = qdict_new();
     driver_layer = qdict_new();
 
-    qdict_put_str(file_layer, "driver", "file");
-    qdict_put_str(file_layer, "filename", filename);
+    int flags = BDRV_O_PROTOCOL | BDRV_O_RDWR;
+    if (mode && *mode != 'w') {
+        flags &= ~BDRV_O_RDWR;
+    }
+    bdrv_fill_options_legacy(&file_layer, filename, &flags, &local_err);
+    if (local_err)
+        goto done;
+
     g_free(filename);
 
     if (mode && *mode != 'w') {
@@ -816,7 +828,12 @@ static XenBlockDrive *xen_block_drive_create(const char *id,
      * It is necessary to turn file locking off as an emulated device
      * may have already opened the same image file.
      */
-    qdict_put_str(file_layer, "locking", "off");
+    const char *file_driver = qdict_get_str(file_layer, "driver");
+    if (!strcmp("file", file_driver) ||
+        !strcmp("host_device", file_driver) ||
+        !strcmp("host_cdrom", file_driver)
+        )
+        qdict_put_str(file_layer, "locking", "off");
 
     qdict_put_str(driver_layer, "driver", driver);
     g_free(driver);
diff --git a/include/sysemu/block-backend.h b/include/sysemu/block-backend.h
index b198deca0b24..93efded0ab61 100644
--- a/include/sysemu/block-backend.h
+++ b/include/sysemu/block-backend.h
@@ -98,6 +98,9 @@ void blk_remove_bs(BlockBackend *blk);
 int blk_insert_bs(BlockBackend *blk, BlockDriverState *bs, Error **errp);
 bool bdrv_has_blk(BlockDriverState *bs);
 bool bdrv_is_root_node(BlockDriverState *bs);
+/* deprecated, not to be used for new backends */
+int bdrv_fill_options_legacy(QDict **options, const char *filename,
+                             int *flags, Error **errp);
 int blk_set_perm(BlockBackend *blk, uint64_t perm, uint64_t shared_perm,
                  Error **errp);
 void blk_get_perm(BlockBackend *blk, uint64_t *perm, uint64_t *shared_perm);
-- 
Anthony PERARD


[-- Attachment #3: Type: text/plain, Size: 157 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply related	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2020-01-17 13:39 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
     [not found] <63a86773-8b9c-0634-2157-ea71cb6eff74@donehue.net>
2019-11-27 10:38 ` [Xen-devel] [Xen-users] 4.13RC3 and PVHVM makes drive drops just after boot George Dunlap
2019-11-27 12:54   ` Andrew
2019-11-28 10:42     ` Anthony PERARD
     [not found]       ` <14702767-e4dd-2fbe-50be-7f5c0737f389@donehue.net>
2020-01-17 13:38         ` Anthony PERARD

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.