[ kvm-Bugs-2490866 ] repeatable corruption with qcow2 on kvm-79

[ kvm-Bugs-2490866 ] repeatable corruption with qcow2 on kvm-79

[SourceForge.net]

Bugs item #2490866, was opened at 2009-01-07 06:10
Message generated for change (Comment added) made by danv
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: qemu
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Adrian Bridgett (abridgett)
Assigned to: Nobody/Anonymous (nobody)
Summary: repeatable corruption with qcow2 on kvm-79

Initial Comment:
Creating a qcow2 image, mkfs.ext3, sometimes mounting it would fail immediately, but in all cases it would corrupt (overwritten with zeros) after starting up backuppc on it.   This is KVM-79 on a Debian lenny host and guest.

This occured using virtio or not.  Swapping to a raw file or LV worked flawlessly.  I've tested the box with memtest and I don't have issues elsewhere but I've seen corruptions on other images.  host and guest are both 2.6.26-1-adm64 kernel (debian lenny) I'm running 32-bit userspace everywhere.  Dual core Intel Core2 E6300.

I see KVM-81 has "improve qcow2 data integrity with cache=writethrough" which _might_ be what I'm hitting - but I can't find more details about this to check (and backport patch to debian package or wait for newer debian package).

thanks.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 16:48

Message:
Confirmed on kvm-82. I am getting reproducible qcow2 corruption on my
Windows images.

Host: Ubuntu 8.04.1 amd64   (Intel(R) Core(TM)2 Quad CPU    Q6600  @
2.40GHz)
Guest: Multiple (see below)

Summary is:
1. Boot working Windows image (qcow2)
2. Use Windows and then shut down the VM cleanly.
3. Image file is now corrupt and unusable. Won't boot again and qemu-img
reports invalid information.

Confirmed with multiple Windows Server 2003 guests and now Windows 7 beta
too:

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: qcow2
virtual size: 20G (21474836480 bytes)
disk size: 5.0G
cluster_size: 4096
Snapshot list:
ID        TAG                 VM SIZE                DATE       VM CLOCK
1         Fresh_install          1.3M 2009-01-09 15:34:31   00:00:00.000
2         Activated_kvm-82       1.3M 2009-01-09 15:43:27   00:00:00.000

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
&
(use and then shut down windows)

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: raw   <---------------------------- INVALID
virtual size: 5.0G (5353566208 bytes) <--------- INVALID
disk size: 5.0G

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
-S &
(qemu) info snapshots
Snapshot devices: ide0-hd0
bdrv_snapshot_list: error -95



----------------------------------------------------------------------

Comment By: roy anonymous (roy-anonymous)
Date: 2009-01-08 02:14

Message:
I am not quite sure it's true or not, for my case, I get corruption if I
have a new FC9 Guest installation with qcow2 with virtio_blk. But it won't
have any problem if I install with a FC8 qcow2 installation, then upgrade
to FC9 with virtio_blk

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-07 16:42

Message:
Same problem here.

With Lenny and vanilla 2.6.28 kernel, with KVM 79, and with KVM 82 user
tools.
Tried with KVM 82 module compile for 2.6.28 and with 2.6.28 builtin KVM
sources.
32-bit userspace and kernel, Intel C2D T7100.

Another effect:
With empty qcow2, vmdk disk image formats, when I try to create a
partition and save the new partition table, they can't save it until
reboot. With raw image format there is no such problem.

I liked to try with qcow, but:
qemu: could not open disk image teszt.qcow

I switched all of my disk images to raw, until the problem fixed.

PS: The host filesystem is ext4, but I tested under ext3 filesystem too
and the problem wasn't disappeared.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

[ kvm-Bugs-2490866 ] repeatable corruption with qcow2 on kvm-79

[SourceForge.net]

Bugs item #2490866, was opened at 2009-01-06 21:10
Message generated for change (Comment added) made by sf-robot
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: qemu
Group: None
>Status: Closed
Resolution: Fixed
Priority: 5
Private: No
Submitted By: Adrian Bridgett (abridgett)
Assigned to: Nobody/Anonymous (nobody)
Summary: repeatable corruption with qcow2 on kvm-79

Initial Comment:
Creating a qcow2 image, mkfs.ext3, sometimes mounting it would fail immediately, but in all cases it would corrupt (overwritten with zeros) after starting up backuppc on it.   This is KVM-79 on a Debian lenny host and guest.

This occured using virtio or not.  Swapping to a raw file or LV worked flawlessly.  I've tested the box with memtest and I don't have issues elsewhere but I've seen corruptions on other images.  host and guest are both 2.6.26-1-adm64 kernel (debian lenny) I'm running 32-bit userspace everywhere.  Dual core Intel Core2 E6300.

I see KVM-81 has "improve qcow2 data integrity with cache=writethrough" which _might_ be what I'm hitting - but I can't find more details about this to check (and backport patch to debian package or wait for newer debian package).

thanks.

----------------------------------------------------------------------

>Comment By: SourceForge Robot (sf-robot)
Date: 2009-08-25 02:20

Message:
This Tracker item was closed automatically by the system. It was
previously set to a Pending status, and the original submitter
did not respond within 14 days (the time period specified by
the administrator of this Tracker).

----------------------------------------------------------------------

Comment By: Avi Kivity (avik)
Date: 2009-08-10 12:18

Message:
Should be fixed in kvm-88.

----------------------------------------------------------------------

Comment By: Adrian Bridgett (abridgett)
Date: 2009-01-24 14:17

Message:
I've tested with new debian KVM-83 package - which also removes that fedora
patch.  I can't reproduce the corruption I had anymore.  Feel free to close
this bug. Thanks.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-21 06:47

Message:
As the original problem is resolved, it's description now inaccurate, and
my problem is ongoing, please close this bug. I will open a new one.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-15 01:47

Message:
Reproduced qcow2 corruption again, using kvm-83 now. Same steps as before.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 11:50

Message:
My problem is kvm-82 vanilla, compiled with no special options.

It happens consistently with kvm-82, but is not necessarily new to kvm-82
because I haven't used these images extensively with prior kvm releases.

No, I do not do anything dangerous like run multiple guests with the same
image or manage snapshots while the guest is up (only at pre-boot, when
stopped).

To reproduce repeatedly in the two cases I've seen it recently:

Case A: Windows Server 2003 (standard and enterprise) x86:
1. Boot guest (previously created under kvm-81)
2. Let Windows detect the new hardware (kvm-82 changes)
3. Reboot as instructed
4. Windows guest continues to work after multiple reboots and the console
shows snapshots intact
5. Shut down the Windows guest properly
6. Image is now invalid as soon as qemu(kvm) exits (not recognizable as
qcow2, not bootable and no snapshots reported by qemu-img info)

Case B: Windows 7 beta x86
1. Installed under kvm-82
2. Boot guest
3. Shut down guest
4. Image is now invalid as described.

This is a very serious problem. Thought it sounds like a new separate bug
may be required...

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-13 10:23

Message:
I narrowed down my problem to one Fedora patch, which include in Debian
too, but not in vanilla kvm, so vanilla kvm isn't effected.
The Fedora patch:
http://cvs.fedoraproject.org/viewvc/rpms/kvm/devel/kvm-62-block-rw-range-check.patch?revision=1.7&view=markup
I removed the CVE-2008-0928-fedora.patch from the debian source package
and recompiled it, the partitioning problem solved.
Fedora bugzilla entry: https://bugzilla.redhat.com/show_bug.cgi?id=433560
A question. Is this vulnerability confirmed by qemu devels or why only
distributions fixed this? Their fix seems to  cause problems with qcow2,
qcow, vmdk formats.

The patch works well last in debian before 79+dfsg-3, when they started to
use Fedora's updated patch. Perhaps the packagers modified the patch for
newer kvms badly.
Debian kvm git repo's commit:
http://git.debian.org/?p=collab-maint/kvm.git;a=commitdiff;h=bae731aae2195651090517903f338635117fbd36


----------------------------------------------------------------------

Comment By: Dor Laor (thekozmo)
Date: 2009-01-13 08:23

Message:
danv, can you please specify more details - does this corruption is
consistent or happens rarely?
Do you create/manage snapshots while the image is up?
If no special snapshot action taken, what's the guest do between the boot
and the shutdown?
(Just to make sure, you do not run multiple guests with the same image
right?)

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 07:48

Message:
Confirmed on kvm-82. I am getting reproducible qcow2 corruption on my
Windows images.

Host: Ubuntu 8.04.1 amd64   (Intel(R) Core(TM)2 Quad CPU    Q6600  @
2.40GHz)
Guest: Multiple (see below)

Summary is:
1. Boot working Windows image (qcow2)
2. Use Windows and then shut down the VM cleanly.
3. Image file is now corrupt and unusable. Won't boot again and qemu-img
reports invalid information.

Confirmed with multiple Windows Server 2003 guests and now Windows 7 beta
too:

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: qcow2
virtual size: 20G (21474836480 bytes)
disk size: 5.0G
cluster_size: 4096
Snapshot list:
ID        TAG                 VM SIZE                DATE       VM CLOCK
1         Fresh_install          1.3M 2009-01-09 15:34:31   00:00:00.000
2         Activated_kvm-82       1.3M 2009-01-09 15:43:27   00:00:00.000

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
&
(use and then shut down windows)

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: raw   <---------------------------- INVALID
virtual size: 5.0G (5353566208 bytes) <--------- INVALID
disk size: 5.0G

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
-S &
(qemu) info snapshots
Snapshot devices: ide0-hd0
bdrv_snapshot_list: error -95



----------------------------------------------------------------------

Comment By: roy anonymous (roy-anonymous)
Date: 2009-01-07 17:14

Message:
I am not quite sure it's true or not, for my case, I get corruption if I
have a new FC9 Guest installation with qcow2 with virtio_blk. But it won't
have any problem if I install with a FC8 qcow2 installation, then upgrade
to FC9 with virtio_blk

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-07 07:42

Message:
Same problem here.

With Lenny and vanilla 2.6.28 kernel, with KVM 79, and with KVM 82 user
tools.
Tried with KVM 82 module compile for 2.6.28 and with 2.6.28 builtin KVM
sources.
32-bit userspace and kernel, Intel C2D T7100.

Another effect:
With empty qcow2, vmdk disk image formats, when I try to create a
partition and save the new partition table, they can't save it until
reboot. With raw image format there is no such problem.

I liked to try with qcow, but:
qemu: could not open disk image teszt.qcow

I switched all of my disk images to raw, until the problem fixed.

PS: The host filesystem is ext4, but I tested under ext3 filesystem too
and the problem wasn't disappeared.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

[ kvm-Bugs-2490866 ] repeatable corruption with qcow2 on kvm-79

[SourceForge.net]

Bugs item #2490866, was opened at 2009-01-06 23:10
Message generated for change (Comment added) made by avik
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: qemu
Group: None
>Status: Pending
>Resolution: Fixed
Priority: 5
Private: No
Submitted By: Adrian Bridgett (abridgett)
Assigned to: Nobody/Anonymous (nobody)
Summary: repeatable corruption with qcow2 on kvm-79

Initial Comment:
Creating a qcow2 image, mkfs.ext3, sometimes mounting it would fail immediately, but in all cases it would corrupt (overwritten with zeros) after starting up backuppc on it.   This is KVM-79 on a Debian lenny host and guest.

This occured using virtio or not.  Swapping to a raw file or LV worked flawlessly.  I've tested the box with memtest and I don't have issues elsewhere but I've seen corruptions on other images.  host and guest are both 2.6.26-1-adm64 kernel (debian lenny) I'm running 32-bit userspace everywhere.  Dual core Intel Core2 E6300.

I see KVM-81 has "improve qcow2 data integrity with cache=writethrough" which _might_ be what I'm hitting - but I can't find more details about this to check (and backport patch to debian package or wait for newer debian package).

thanks.

----------------------------------------------------------------------

>Comment By: Avi Kivity (avik)
Date: 2009-08-10 15:18

Message:
Should be fixed in kvm-88.

----------------------------------------------------------------------

Comment By: Adrian Bridgett (abridgett)
Date: 2009-01-24 16:17

Message:
I've tested with new debian KVM-83 package - which also removes that fedora
patch.  I can't reproduce the corruption I had anymore.  Feel free to close
this bug. Thanks.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-21 08:47

Message:
As the original problem is resolved, it's description now inaccurate, and
my problem is ongoing, please close this bug. I will open a new one.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-15 03:47

Message:
Reproduced qcow2 corruption again, using kvm-83 now. Same steps as before.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 13:50

Message:
My problem is kvm-82 vanilla, compiled with no special options.

It happens consistently with kvm-82, but is not necessarily new to kvm-82
because I haven't used these images extensively with prior kvm releases.

No, I do not do anything dangerous like run multiple guests with the same
image or manage snapshots while the guest is up (only at pre-boot, when
stopped).

To reproduce repeatedly in the two cases I've seen it recently:

Case A: Windows Server 2003 (standard and enterprise) x86:
1. Boot guest (previously created under kvm-81)
2. Let Windows detect the new hardware (kvm-82 changes)
3. Reboot as instructed
4. Windows guest continues to work after multiple reboots and the console
shows snapshots intact
5. Shut down the Windows guest properly
6. Image is now invalid as soon as qemu(kvm) exits (not recognizable as
qcow2, not bootable and no snapshots reported by qemu-img info)

Case B: Windows 7 beta x86
1. Installed under kvm-82
2. Boot guest
3. Shut down guest
4. Image is now invalid as described.

This is a very serious problem. Thought it sounds like a new separate bug
may be required...

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-13 12:23

Message:
I narrowed down my problem to one Fedora patch, which include in Debian
too, but not in vanilla kvm, so vanilla kvm isn't effected.
The Fedora patch:
http://cvs.fedoraproject.org/viewvc/rpms/kvm/devel/kvm-62-block-rw-range-check.patch?revision=1.7&view=markup
I removed the CVE-2008-0928-fedora.patch from the debian source package
and recompiled it, the partitioning problem solved.
Fedora bugzilla entry: https://bugzilla.redhat.com/show_bug.cgi?id=433560
A question. Is this vulnerability confirmed by qemu devels or why only
distributions fixed this? Their fix seems to  cause problems with qcow2,
qcow, vmdk formats.

The patch works well last in debian before 79+dfsg-3, when they started to
use Fedora's updated patch. Perhaps the packagers modified the patch for
newer kvms badly.
Debian kvm git repo's commit:
http://git.debian.org/?p=collab-maint/kvm.git;a=commitdiff;h=bae731aae2195651090517903f338635117fbd36


----------------------------------------------------------------------

Comment By: Dor Laor (thekozmo)
Date: 2009-01-13 10:23

Message:
danv, can you please specify more details - does this corruption is
consistent or happens rarely?
Do you create/manage snapshots while the image is up?
If no special snapshot action taken, what's the guest do between the boot
and the shutdown?
(Just to make sure, you do not run multiple guests with the same image
right?)

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 09:48

Message:
Confirmed on kvm-82. I am getting reproducible qcow2 corruption on my
Windows images.

Host: Ubuntu 8.04.1 amd64   (Intel(R) Core(TM)2 Quad CPU    Q6600  @
2.40GHz)
Guest: Multiple (see below)

Summary is:
1. Boot working Windows image (qcow2)
2. Use Windows and then shut down the VM cleanly.
3. Image file is now corrupt and unusable. Won't boot again and qemu-img
reports invalid information.

Confirmed with multiple Windows Server 2003 guests and now Windows 7 beta
too:

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: qcow2
virtual size: 20G (21474836480 bytes)
disk size: 5.0G
cluster_size: 4096
Snapshot list:
ID        TAG                 VM SIZE                DATE       VM CLOCK
1         Fresh_install          1.3M 2009-01-09 15:34:31   00:00:00.000
2         Activated_kvm-82       1.3M 2009-01-09 15:43:27   00:00:00.000

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
&
(use and then shut down windows)

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: raw   <---------------------------- INVALID
virtual size: 5.0G (5353566208 bytes) <--------- INVALID
disk size: 5.0G

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
-S &
(qemu) info snapshots
Snapshot devices: ide0-hd0
bdrv_snapshot_list: error -95



----------------------------------------------------------------------

Comment By: roy anonymous (roy-anonymous)
Date: 2009-01-07 19:14

Message:
I am not quite sure it's true or not, for my case, I get corruption if I
have a new FC9 Guest installation with qcow2 with virtio_blk. But it won't
have any problem if I install with a FC8 qcow2 installation, then upgrade
to FC9 with virtio_blk

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-07 09:42

Message:
Same problem here.

With Lenny and vanilla 2.6.28 kernel, with KVM 79, and with KVM 82 user
tools.
Tried with KVM 82 module compile for 2.6.28 and with 2.6.28 builtin KVM
sources.
32-bit userspace and kernel, Intel C2D T7100.

Another effect:
With empty qcow2, vmdk disk image formats, when I try to create a
partition and save the new partition table, they can't save it until
reboot. With raw image format there is no such problem.

I liked to try with qcow, but:
qemu: could not open disk image teszt.qcow

I switched all of my disk images to raw, until the problem fixed.

PS: The host filesystem is ext4, but I tested under ext3 filesystem too
and the problem wasn't disappeared.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

[ kvm-Bugs-2490866 ] repeatable corruption with qcow2 on kvm-79

[SourceForge.net]

Bugs item #2490866, was opened at 2009-01-06 21:10
Message generated for change (Comment added) made by abridgett
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: qemu
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Adrian Bridgett (abridgett)
Assigned to: Nobody/Anonymous (nobody)
Summary: repeatable corruption with qcow2 on kvm-79

Initial Comment:
Creating a qcow2 image, mkfs.ext3, sometimes mounting it would fail immediately, but in all cases it would corrupt (overwritten with zeros) after starting up backuppc on it.   This is KVM-79 on a Debian lenny host and guest.

This occured using virtio or not.  Swapping to a raw file or LV worked flawlessly.  I've tested the box with memtest and I don't have issues elsewhere but I've seen corruptions on other images.  host and guest are both 2.6.26-1-adm64 kernel (debian lenny) I'm running 32-bit userspace everywhere.  Dual core Intel Core2 E6300.

I see KVM-81 has "improve qcow2 data integrity with cache=writethrough" which _might_ be what I'm hitting - but I can't find more details about this to check (and backport patch to debian package or wait for newer debian package).

thanks.

----------------------------------------------------------------------

>Comment By: Adrian Bridgett (abridgett)
Date: 2009-01-24 14:17

Message:
I've tested with new debian KVM-83 package - which also removes that fedora
patch.  I can't reproduce the corruption I had anymore.  Feel free to close
this bug. Thanks.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-21 06:47

Message:
As the original problem is resolved, it's description now inaccurate, and
my problem is ongoing, please close this bug. I will open a new one.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-15 01:47

Message:
Reproduced qcow2 corruption again, using kvm-83 now. Same steps as before.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 11:50

Message:
My problem is kvm-82 vanilla, compiled with no special options.

It happens consistently with kvm-82, but is not necessarily new to kvm-82
because I haven't used these images extensively with prior kvm releases.

No, I do not do anything dangerous like run multiple guests with the same
image or manage snapshots while the guest is up (only at pre-boot, when
stopped).

To reproduce repeatedly in the two cases I've seen it recently:

Case A: Windows Server 2003 (standard and enterprise) x86:
1. Boot guest (previously created under kvm-81)
2. Let Windows detect the new hardware (kvm-82 changes)
3. Reboot as instructed
4. Windows guest continues to work after multiple reboots and the console
shows snapshots intact
5. Shut down the Windows guest properly
6. Image is now invalid as soon as qemu(kvm) exits (not recognizable as
qcow2, not bootable and no snapshots reported by qemu-img info)

Case B: Windows 7 beta x86
1. Installed under kvm-82
2. Boot guest
3. Shut down guest
4. Image is now invalid as described.

This is a very serious problem. Thought it sounds like a new separate bug
may be required...

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-13 10:23

Message:
I narrowed down my problem to one Fedora patch, which include in Debian
too, but not in vanilla kvm, so vanilla kvm isn't effected.
The Fedora patch:
http://cvs.fedoraproject.org/viewvc/rpms/kvm/devel/kvm-62-block-rw-range-check.patch?revision=1.7&view=markup
I removed the CVE-2008-0928-fedora.patch from the debian source package
and recompiled it, the partitioning problem solved.
Fedora bugzilla entry: https://bugzilla.redhat.com/show_bug.cgi?id=433560
A question. Is this vulnerability confirmed by qemu devels or why only
distributions fixed this? Their fix seems to  cause problems with qcow2,
qcow, vmdk formats.

The patch works well last in debian before 79+dfsg-3, when they started to
use Fedora's updated patch. Perhaps the packagers modified the patch for
newer kvms badly.
Debian kvm git repo's commit:
http://git.debian.org/?p=collab-maint/kvm.git;a=commitdiff;h=bae731aae2195651090517903f338635117fbd36


----------------------------------------------------------------------

Comment By: Dor Laor (thekozmo)
Date: 2009-01-13 08:23

Message:
danv, can you please specify more details - does this corruption is
consistent or happens rarely?
Do you create/manage snapshots while the image is up?
If no special snapshot action taken, what's the guest do between the boot
and the shutdown?
(Just to make sure, you do not run multiple guests with the same image
right?)

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 07:48

Message:
Confirmed on kvm-82. I am getting reproducible qcow2 corruption on my
Windows images.

Host: Ubuntu 8.04.1 amd64   (Intel(R) Core(TM)2 Quad CPU    Q6600  @
2.40GHz)
Guest: Multiple (see below)

Summary is:
1. Boot working Windows image (qcow2)
2. Use Windows and then shut down the VM cleanly.
3. Image file is now corrupt and unusable. Won't boot again and qemu-img
reports invalid information.

Confirmed with multiple Windows Server 2003 guests and now Windows 7 beta
too:

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: qcow2
virtual size: 20G (21474836480 bytes)
disk size: 5.0G
cluster_size: 4096
Snapshot list:
ID        TAG                 VM SIZE                DATE       VM CLOCK
1         Fresh_install          1.3M 2009-01-09 15:34:31   00:00:00.000
2         Activated_kvm-82       1.3M 2009-01-09 15:43:27   00:00:00.000

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
&
(use and then shut down windows)

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: raw   <---------------------------- INVALID
virtual size: 5.0G (5353566208 bytes) <--------- INVALID
disk size: 5.0G

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
-S &
(qemu) info snapshots
Snapshot devices: ide0-hd0
bdrv_snapshot_list: error -95



----------------------------------------------------------------------

Comment By: roy anonymous (roy-anonymous)
Date: 2009-01-07 17:14

Message:
I am not quite sure it's true or not, for my case, I get corruption if I
have a new FC9 Guest installation with qcow2 with virtio_blk. But it won't
have any problem if I install with a FC8 qcow2 installation, then upgrade
to FC9 with virtio_blk

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-07 07:42

Message:
Same problem here.

With Lenny and vanilla 2.6.28 kernel, with KVM 79, and with KVM 82 user
tools.
Tried with KVM 82 module compile for 2.6.28 and with 2.6.28 builtin KVM
sources.
32-bit userspace and kernel, Intel C2D T7100.

Another effect:
With empty qcow2, vmdk disk image formats, when I try to create a
partition and save the new partition table, they can't save it until
reboot. With raw image format there is no such problem.

I liked to try with qcow, but:
qemu: could not open disk image teszt.qcow

I switched all of my disk images to raw, until the problem fixed.

PS: The host filesystem is ext4, but I tested under ext3 filesystem too
and the problem wasn't disappeared.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

[ kvm-Bugs-2490866 ] repeatable corruption with qcow2 on kvm-79

[SourceForge.net]

Bugs item #2490866, was opened at 2009-01-07 06:10
Message generated for change (Comment added) made by danv
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: qemu
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Adrian Bridgett (abridgett)
Assigned to: Nobody/Anonymous (nobody)
Summary: repeatable corruption with qcow2 on kvm-79

Initial Comment:
Creating a qcow2 image, mkfs.ext3, sometimes mounting it would fail immediately, but in all cases it would corrupt (overwritten with zeros) after starting up backuppc on it.   This is KVM-79 on a Debian lenny host and guest.

This occured using virtio or not.  Swapping to a raw file or LV worked flawlessly.  I've tested the box with memtest and I don't have issues elsewhere but I've seen corruptions on other images.  host and guest are both 2.6.26-1-adm64 kernel (debian lenny) I'm running 32-bit userspace everywhere.  Dual core Intel Core2 E6300.

I see KVM-81 has "improve qcow2 data integrity with cache=writethrough" which _might_ be what I'm hitting - but I can't find more details about this to check (and backport patch to debian package or wait for newer debian package).

thanks.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-21 15:47

Message:
As the original problem is resolved, it's description now inaccurate, and
my problem is ongoing, please close this bug. I will open a new one.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-15 10:47

Message:
Reproduced qcow2 corruption again, using kvm-83 now. Same steps as before.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 20:50

Message:
My problem is kvm-82 vanilla, compiled with no special options.

It happens consistently with kvm-82, but is not necessarily new to kvm-82
because I haven't used these images extensively with prior kvm releases.

No, I do not do anything dangerous like run multiple guests with the same
image or manage snapshots while the guest is up (only at pre-boot, when
stopped).

To reproduce repeatedly in the two cases I've seen it recently:

Case A: Windows Server 2003 (standard and enterprise) x86:
1. Boot guest (previously created under kvm-81)
2. Let Windows detect the new hardware (kvm-82 changes)
3. Reboot as instructed
4. Windows guest continues to work after multiple reboots and the console
shows snapshots intact
5. Shut down the Windows guest properly
6. Image is now invalid as soon as qemu(kvm) exits (not recognizable as
qcow2, not bootable and no snapshots reported by qemu-img info)

Case B: Windows 7 beta x86
1. Installed under kvm-82
2. Boot guest
3. Shut down guest
4. Image is now invalid as described.

This is a very serious problem. Thought it sounds like a new separate bug
may be required...

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-13 19:23

Message:
I narrowed down my problem to one Fedora patch, which include in Debian
too, but not in vanilla kvm, so vanilla kvm isn't effected.
The Fedora patch:
http://cvs.fedoraproject.org/viewvc/rpms/kvm/devel/kvm-62-block-rw-range-check.patch?revision=1.7&view=markup
I removed the CVE-2008-0928-fedora.patch from the debian source package
and recompiled it, the partitioning problem solved.
Fedora bugzilla entry: https://bugzilla.redhat.com/show_bug.cgi?id=433560
A question. Is this vulnerability confirmed by qemu devels or why only
distributions fixed this? Their fix seems to  cause problems with qcow2,
qcow, vmdk formats.

The patch works well last in debian before 79+dfsg-3, when they started to
use Fedora's updated patch. Perhaps the packagers modified the patch for
newer kvms badly.
Debian kvm git repo's commit:
http://git.debian.org/?p=collab-maint/kvm.git;a=commitdiff;h=bae731aae2195651090517903f338635117fbd36


----------------------------------------------------------------------

Comment By: Dor Laor (thekozmo)
Date: 2009-01-13 17:23

Message:
danv, can you please specify more details - does this corruption is
consistent or happens rarely?
Do you create/manage snapshots while the image is up?
If no special snapshot action taken, what's the guest do between the boot
and the shutdown?
(Just to make sure, you do not run multiple guests with the same image
right?)

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 16:48

Message:
Confirmed on kvm-82. I am getting reproducible qcow2 corruption on my
Windows images.

Host: Ubuntu 8.04.1 amd64   (Intel(R) Core(TM)2 Quad CPU    Q6600  @
2.40GHz)
Guest: Multiple (see below)

Summary is:
1. Boot working Windows image (qcow2)
2. Use Windows and then shut down the VM cleanly.
3. Image file is now corrupt and unusable. Won't boot again and qemu-img
reports invalid information.

Confirmed with multiple Windows Server 2003 guests and now Windows 7 beta
too:

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: qcow2
virtual size: 20G (21474836480 bytes)
disk size: 5.0G
cluster_size: 4096
Snapshot list:
ID        TAG                 VM SIZE                DATE       VM CLOCK
1         Fresh_install          1.3M 2009-01-09 15:34:31   00:00:00.000
2         Activated_kvm-82       1.3M 2009-01-09 15:43:27   00:00:00.000

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
&
(use and then shut down windows)

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: raw   <---------------------------- INVALID
virtual size: 5.0G (5353566208 bytes) <--------- INVALID
disk size: 5.0G

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
-S &
(qemu) info snapshots
Snapshot devices: ide0-hd0
bdrv_snapshot_list: error -95



----------------------------------------------------------------------

Comment By: roy anonymous (roy-anonymous)
Date: 2009-01-08 02:14

Message:
I am not quite sure it's true or not, for my case, I get corruption if I
have a new FC9 Guest installation with qcow2 with virtio_blk. But it won't
have any problem if I install with a FC8 qcow2 installation, then upgrade
to FC9 with virtio_blk

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-07 16:42

Message:
Same problem here.

With Lenny and vanilla 2.6.28 kernel, with KVM 79, and with KVM 82 user
tools.
Tried with KVM 82 module compile for 2.6.28 and with 2.6.28 builtin KVM
sources.
32-bit userspace and kernel, Intel C2D T7100.

Another effect:
With empty qcow2, vmdk disk image formats, when I try to create a
partition and save the new partition table, they can't save it until
reboot. With raw image format there is no such problem.

I liked to try with qcow, but:
qemu: could not open disk image teszt.qcow

I switched all of my disk images to raw, until the problem fixed.

PS: The host filesystem is ext4, but I tested under ext3 filesystem too
and the problem wasn't disappeared.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

[ kvm-Bugs-2490866 ] repeatable corruption with qcow2 on kvm-79

[SourceForge.net]

Bugs item #2490866, was opened at 2009-01-07 06:10
Message generated for change (Comment added) made by danv
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: qemu
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Adrian Bridgett (abridgett)
Assigned to: Nobody/Anonymous (nobody)
Summary: repeatable corruption with qcow2 on kvm-79

Initial Comment:
Creating a qcow2 image, mkfs.ext3, sometimes mounting it would fail immediately, but in all cases it would corrupt (overwritten with zeros) after starting up backuppc on it.   This is KVM-79 on a Debian lenny host and guest.

This occured using virtio or not.  Swapping to a raw file or LV worked flawlessly.  I've tested the box with memtest and I don't have issues elsewhere but I've seen corruptions on other images.  host and guest are both 2.6.26-1-adm64 kernel (debian lenny) I'm running 32-bit userspace everywhere.  Dual core Intel Core2 E6300.

I see KVM-81 has "improve qcow2 data integrity with cache=writethrough" which _might_ be what I'm hitting - but I can't find more details about this to check (and backport patch to debian package or wait for newer debian package).

thanks.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-15 10:47

Message:
Reproduced qcow2 corruption again, using kvm-83 now. Same steps as before.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 20:50

Message:
My problem is kvm-82 vanilla, compiled with no special options.

It happens consistently with kvm-82, but is not necessarily new to kvm-82
because I haven't used these images extensively with prior kvm releases.

No, I do not do anything dangerous like run multiple guests with the same
image or manage snapshots while the guest is up (only at pre-boot, when
stopped).

To reproduce repeatedly in the two cases I've seen it recently:

Case A: Windows Server 2003 (standard and enterprise) x86:
1. Boot guest (previously created under kvm-81)
2. Let Windows detect the new hardware (kvm-82 changes)
3. Reboot as instructed
4. Windows guest continues to work after multiple reboots and the console
shows snapshots intact
5. Shut down the Windows guest properly
6. Image is now invalid as soon as qemu(kvm) exits (not recognizable as
qcow2, not bootable and no snapshots reported by qemu-img info)

Case B: Windows 7 beta x86
1. Installed under kvm-82
2. Boot guest
3. Shut down guest
4. Image is now invalid as described.

This is a very serious problem. Thought it sounds like a new separate bug
may be required...

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-13 19:23

Message:
I narrowed down my problem to one Fedora patch, which include in Debian
too, but not in vanilla kvm, so vanilla kvm isn't effected.
The Fedora patch:
http://cvs.fedoraproject.org/viewvc/rpms/kvm/devel/kvm-62-block-rw-range-check.patch?revision=1.7&view=markup
I removed the CVE-2008-0928-fedora.patch from the debian source package
and recompiled it, the partitioning problem solved.
Fedora bugzilla entry: https://bugzilla.redhat.com/show_bug.cgi?id=433560
A question. Is this vulnerability confirmed by qemu devels or why only
distributions fixed this? Their fix seems to  cause problems with qcow2,
qcow, vmdk formats.

The patch works well last in debian before 79+dfsg-3, when they started to
use Fedora's updated patch. Perhaps the packagers modified the patch for
newer kvms badly.
Debian kvm git repo's commit:
http://git.debian.org/?p=collab-maint/kvm.git;a=commitdiff;h=bae731aae2195651090517903f338635117fbd36


----------------------------------------------------------------------

Comment By: Dor Laor (thekozmo)
Date: 2009-01-13 17:23

Message:
danv, can you please specify more details - does this corruption is
consistent or happens rarely?
Do you create/manage snapshots while the image is up?
If no special snapshot action taken, what's the guest do between the boot
and the shutdown?
(Just to make sure, you do not run multiple guests with the same image
right?)

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 16:48

Message:
Confirmed on kvm-82. I am getting reproducible qcow2 corruption on my
Windows images.

Host: Ubuntu 8.04.1 amd64   (Intel(R) Core(TM)2 Quad CPU    Q6600  @
2.40GHz)
Guest: Multiple (see below)

Summary is:
1. Boot working Windows image (qcow2)
2. Use Windows and then shut down the VM cleanly.
3. Image file is now corrupt and unusable. Won't boot again and qemu-img
reports invalid information.

Confirmed with multiple Windows Server 2003 guests and now Windows 7 beta
too:

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: qcow2
virtual size: 20G (21474836480 bytes)
disk size: 5.0G
cluster_size: 4096
Snapshot list:
ID        TAG                 VM SIZE                DATE       VM CLOCK
1         Fresh_install          1.3M 2009-01-09 15:34:31   00:00:00.000
2         Activated_kvm-82       1.3M 2009-01-09 15:43:27   00:00:00.000

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
&
(use and then shut down windows)

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: raw   <---------------------------- INVALID
virtual size: 5.0G (5353566208 bytes) <--------- INVALID
disk size: 5.0G

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
-S &
(qemu) info snapshots
Snapshot devices: ide0-hd0
bdrv_snapshot_list: error -95



----------------------------------------------------------------------

Comment By: roy anonymous (roy-anonymous)
Date: 2009-01-08 02:14

Message:
I am not quite sure it's true or not, for my case, I get corruption if I
have a new FC9 Guest installation with qcow2 with virtio_blk. But it won't
have any problem if I install with a FC8 qcow2 installation, then upgrade
to FC9 with virtio_blk

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-07 16:42

Message:
Same problem here.

With Lenny and vanilla 2.6.28 kernel, with KVM 79, and with KVM 82 user
tools.
Tried with KVM 82 module compile for 2.6.28 and with 2.6.28 builtin KVM
sources.
32-bit userspace and kernel, Intel C2D T7100.

Another effect:
With empty qcow2, vmdk disk image formats, when I try to create a
partition and save the new partition table, they can't save it until
reboot. With raw image format there is no such problem.

I liked to try with qcow, but:
qemu: could not open disk image teszt.qcow

I switched all of my disk images to raw, until the problem fixed.

PS: The host filesystem is ext4, but I tested under ext3 filesystem too
and the problem wasn't disappeared.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

[ kvm-Bugs-2490866 ] repeatable corruption with qcow2 on kvm-79

[SourceForge.net]

Bugs item #2490866, was opened at 2009-01-07 06:10
Message generated for change (Comment added) made by danv
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: qemu
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Adrian Bridgett (abridgett)
Assigned to: Nobody/Anonymous (nobody)
Summary: repeatable corruption with qcow2 on kvm-79

Initial Comment:
Creating a qcow2 image, mkfs.ext3, sometimes mounting it would fail immediately, but in all cases it would corrupt (overwritten with zeros) after starting up backuppc on it.   This is KVM-79 on a Debian lenny host and guest.

This occured using virtio or not.  Swapping to a raw file or LV worked flawlessly.  I've tested the box with memtest and I don't have issues elsewhere but I've seen corruptions on other images.  host and guest are both 2.6.26-1-adm64 kernel (debian lenny) I'm running 32-bit userspace everywhere.  Dual core Intel Core2 E6300.

I see KVM-81 has "improve qcow2 data integrity with cache=writethrough" which _might_ be what I'm hitting - but I can't find more details about this to check (and backport patch to debian package or wait for newer debian package).

thanks.

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 20:50

Message:
My problem is kvm-82 vanilla, compiled with no special options.

It happens consistently with kvm-82, but is not necessarily new to kvm-82
because I haven't used these images extensively with prior kvm releases.

No, I do not do anything dangerous like run multiple guests with the same
image or manage snapshots while the guest is up (only at pre-boot, when
stopped).

To reproduce repeatedly in the two cases I've seen it recently:

Case A: Windows Server 2003 (standard and enterprise) x86:
1. Boot guest (previously created under kvm-81)
2. Let Windows detect the new hardware (kvm-82 changes)
3. Reboot as instructed
4. Windows guest continues to work after multiple reboots and the console
shows snapshots intact
5. Shut down the Windows guest properly
6. Image is now invalid as soon as qemu(kvm) exits (not recognizable as
qcow2, not bootable and no snapshots reported by qemu-img info)

Case B: Windows 7 beta x86
1. Installed under kvm-82
2. Boot guest
3. Shut down guest
4. Image is now invalid as described.

This is a very serious problem. Thought it sounds like a new separate bug
may be required...

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-13 19:23

Message:
I narrowed down my problem to one Fedora patch, which include in Debian
too, but not in vanilla kvm, so vanilla kvm isn't effected.
The Fedora patch:
http://cvs.fedoraproject.org/viewvc/rpms/kvm/devel/kvm-62-block-rw-range-check.patch?revision=1.7&view=markup
I removed the CVE-2008-0928-fedora.patch from the debian source package
and recompiled it, the partitioning problem solved.
Fedora bugzilla entry: https://bugzilla.redhat.com/show_bug.cgi?id=433560
A question. Is this vulnerability confirmed by qemu devels or why only
distributions fixed this? Their fix seems to  cause problems with qcow2,
qcow, vmdk formats.

The patch works well last in debian before 79+dfsg-3, when they started to
use Fedora's updated patch. Perhaps the packagers modified the patch for
newer kvms badly.
Debian kvm git repo's commit:
http://git.debian.org/?p=collab-maint/kvm.git;a=commitdiff;h=bae731aae2195651090517903f338635117fbd36


----------------------------------------------------------------------

Comment By: Dor Laor (thekozmo)
Date: 2009-01-13 17:23

Message:
danv, can you please specify more details - does this corruption is
consistent or happens rarely?
Do you create/manage snapshots while the image is up?
If no special snapshot action taken, what's the guest do between the boot
and the shutdown?
(Just to make sure, you do not run multiple guests with the same image
right?)

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 16:48

Message:
Confirmed on kvm-82. I am getting reproducible qcow2 corruption on my
Windows images.

Host: Ubuntu 8.04.1 amd64   (Intel(R) Core(TM)2 Quad CPU    Q6600  @
2.40GHz)
Guest: Multiple (see below)

Summary is:
1. Boot working Windows image (qcow2)
2. Use Windows and then shut down the VM cleanly.
3. Image file is now corrupt and unusable. Won't boot again and qemu-img
reports invalid information.

Confirmed with multiple Windows Server 2003 guests and now Windows 7 beta
too:

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: qcow2
virtual size: 20G (21474836480 bytes)
disk size: 5.0G
cluster_size: 4096
Snapshot list:
ID        TAG                 VM SIZE                DATE       VM CLOCK
1         Fresh_install          1.3M 2009-01-09 15:34:31   00:00:00.000
2         Activated_kvm-82       1.3M 2009-01-09 15:43:27   00:00:00.000

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
&
(use and then shut down windows)

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: raw   <---------------------------- INVALID
virtual size: 5.0G (5353566208 bytes) <--------- INVALID
disk size: 5.0G

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
-S &
(qemu) info snapshots
Snapshot devices: ide0-hd0
bdrv_snapshot_list: error -95



----------------------------------------------------------------------

Comment By: roy anonymous (roy-anonymous)
Date: 2009-01-08 02:14

Message:
I am not quite sure it's true or not, for my case, I get corruption if I
have a new FC9 Guest installation with qcow2 with virtio_blk. But it won't
have any problem if I install with a FC8 qcow2 installation, then upgrade
to FC9 with virtio_blk

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-07 16:42

Message:
Same problem here.

With Lenny and vanilla 2.6.28 kernel, with KVM 79, and with KVM 82 user
tools.
Tried with KVM 82 module compile for 2.6.28 and with 2.6.28 builtin KVM
sources.
32-bit userspace and kernel, Intel C2D T7100.

Another effect:
With empty qcow2, vmdk disk image formats, when I try to create a
partition and save the new partition table, they can't save it until
reboot. With raw image format there is no such problem.

I liked to try with qcow, but:
qemu: could not open disk image teszt.qcow

I switched all of my disk images to raw, until the problem fixed.

PS: The host filesystem is ext4, but I tested under ext3 filesystem too
and the problem wasn't disappeared.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

[ kvm-Bugs-2490866 ] repeatable corruption with qcow2 on kvm-79

[SourceForge.net]

Bugs item #2490866, was opened at 2009-01-06 22:10
Message generated for change (Comment added) made by ldvornik
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: qemu
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Adrian Bridgett (abridgett)
Assigned to: Nobody/Anonymous (nobody)
Summary: repeatable corruption with qcow2 on kvm-79

Initial Comment:
Creating a qcow2 image, mkfs.ext3, sometimes mounting it would fail immediately, but in all cases it would corrupt (overwritten with zeros) after starting up backuppc on it.   This is KVM-79 on a Debian lenny host and guest.

This occured using virtio or not.  Swapping to a raw file or LV worked flawlessly.  I've tested the box with memtest and I don't have issues elsewhere but I've seen corruptions on other images.  host and guest are both 2.6.26-1-adm64 kernel (debian lenny) I'm running 32-bit userspace everywhere.  Dual core Intel Core2 E6300.

I see KVM-81 has "improve qcow2 data integrity with cache=writethrough" which _might_ be what I'm hitting - but I can't find more details about this to check (and backport patch to debian package or wait for newer debian package).

thanks.

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-13 11:23

Message:
I narrowed down my problem to one Fedora patch, which include in Debian
too, but not in vanilla kvm, so vanilla kvm isn't effected.
The Fedora patch:
http://cvs.fedoraproject.org/viewvc/rpms/kvm/devel/kvm-62-block-rw-range-check.patch?revision=1.7&view=markup
I removed the CVE-2008-0928-fedora.patch from the debian source package
and recompiled it, the partitioning problem solved.
Fedora bugzilla entry: https://bugzilla.redhat.com/show_bug.cgi?id=433560
A question. Is this vulnerability confirmed by qemu devels or why only
distributions fixed this? Their fix seems to  cause problems with qcow2,
qcow, vmdk formats.

The patch works well last in debian before 79+dfsg-3, when they started to
use Fedora's updated patch. Perhaps the packagers modified the patch for
newer kvms badly.
Debian kvm git repo's commit:
http://git.debian.org/?p=collab-maint/kvm.git;a=commitdiff;h=bae731aae2195651090517903f338635117fbd36


----------------------------------------------------------------------

Comment By: Dor Laor (thekozmo)
Date: 2009-01-13 09:23

Message:
danv, can you please specify more details - does this corruption is
consistent or happens rarely?
Do you create/manage snapshots while the image is up?
If no special snapshot action taken, what's the guest do between the boot
and the shutdown?
(Just to make sure, you do not run multiple guests with the same image
right?)

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 08:48

Message:
Confirmed on kvm-82. I am getting reproducible qcow2 corruption on my
Windows images.

Host: Ubuntu 8.04.1 amd64   (Intel(R) Core(TM)2 Quad CPU    Q6600  @
2.40GHz)
Guest: Multiple (see below)

Summary is:
1. Boot working Windows image (qcow2)
2. Use Windows and then shut down the VM cleanly.
3. Image file is now corrupt and unusable. Won't boot again and qemu-img
reports invalid information.

Confirmed with multiple Windows Server 2003 guests and now Windows 7 beta
too:

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: qcow2
virtual size: 20G (21474836480 bytes)
disk size: 5.0G
cluster_size: 4096
Snapshot list:
ID        TAG                 VM SIZE                DATE       VM CLOCK
1         Fresh_install          1.3M 2009-01-09 15:34:31   00:00:00.000
2         Activated_kvm-82       1.3M 2009-01-09 15:43:27   00:00:00.000

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
&
(use and then shut down windows)

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: raw   <---------------------------- INVALID
virtual size: 5.0G (5353566208 bytes) <--------- INVALID
disk size: 5.0G

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
-S &
(qemu) info snapshots
Snapshot devices: ide0-hd0
bdrv_snapshot_list: error -95



----------------------------------------------------------------------

Comment By: roy anonymous (roy-anonymous)
Date: 2009-01-07 18:14

Message:
I am not quite sure it's true or not, for my case, I get corruption if I
have a new FC9 Guest installation with qcow2 with virtio_blk. But it won't
have any problem if I install with a FC8 qcow2 installation, then upgrade
to FC9 with virtio_blk

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-07 08:42

Message:
Same problem here.

With Lenny and vanilla 2.6.28 kernel, with KVM 79, and with KVM 82 user
tools.
Tried with KVM 82 module compile for 2.6.28 and with 2.6.28 builtin KVM
sources.
32-bit userspace and kernel, Intel C2D T7100.

Another effect:
With empty qcow2, vmdk disk image formats, when I try to create a
partition and save the new partition table, they can't save it until
reboot. With raw image format there is no such problem.

I liked to try with qcow, but:
qemu: could not open disk image teszt.qcow

I switched all of my disk images to raw, until the problem fixed.

PS: The host filesystem is ext4, but I tested under ext3 filesystem too
and the problem wasn't disappeared.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

[ kvm-Bugs-2490866 ] repeatable corruption with qcow2 on kvm-79

[SourceForge.net]

Bugs item #2490866, was opened at 2009-01-06 23:10
Message generated for change (Comment added) made by thekozmo
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: qemu
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Adrian Bridgett (abridgett)
Assigned to: Nobody/Anonymous (nobody)
Summary: repeatable corruption with qcow2 on kvm-79

Initial Comment:
Creating a qcow2 image, mkfs.ext3, sometimes mounting it would fail immediately, but in all cases it would corrupt (overwritten with zeros) after starting up backuppc on it.   This is KVM-79 on a Debian lenny host and guest.

This occured using virtio or not.  Swapping to a raw file or LV worked flawlessly.  I've tested the box with memtest and I don't have issues elsewhere but I've seen corruptions on other images.  host and guest are both 2.6.26-1-adm64 kernel (debian lenny) I'm running 32-bit userspace everywhere.  Dual core Intel Core2 E6300.

I see KVM-81 has "improve qcow2 data integrity with cache=writethrough" which _might_ be what I'm hitting - but I can't find more details about this to check (and backport patch to debian package or wait for newer debian package).

thanks.

----------------------------------------------------------------------

Comment By: Dor Laor (thekozmo)
Date: 2009-01-13 10:23

Message:
danv, can you please specify more details - does this corruption is
consistent or happens rarely?
Do you create/manage snapshots while the image is up?
If no special snapshot action taken, what's the guest do between the boot
and the shutdown?
(Just to make sure, you do not run multiple guests with the same image
right?)

----------------------------------------------------------------------

Comment By: Daniel van Vugt (danv)
Date: 2009-01-13 09:48

Message:
Confirmed on kvm-82. I am getting reproducible qcow2 corruption on my
Windows images.

Host: Ubuntu 8.04.1 amd64   (Intel(R) Core(TM)2 Quad CPU    Q6600  @
2.40GHz)
Guest: Multiple (see below)

Summary is:
1. Boot working Windows image (qcow2)
2. Use Windows and then shut down the VM cleanly.
3. Image file is now corrupt and unusable. Won't boot again and qemu-img
reports invalid information.

Confirmed with multiple Windows Server 2003 guests and now Windows 7 beta
too:

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: qcow2
virtual size: 20G (21474836480 bytes)
disk size: 5.0G
cluster_size: 4096
Snapshot list:
ID        TAG                 VM SIZE                DATE       VM CLOCK
1         Fresh_install          1.3M 2009-01-09 15:34:31   00:00:00.000
2         Activated_kvm-82       1.3M 2009-01-09 15:43:27   00:00:00.000

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
&
(use and then shut down windows)

$ qemu-img info windows7beta.qcow2
image: windows7beta.qcow2
file format: raw   <---------------------------- INVALID
virtual size: 5.0G (5353566208 bytes) <--------- INVALID
disk size: 5.0G

$ qemu -m 512 -usbdevice tablet -redir tcp:3389::3389 windows7beta.qcow2
-S &
(qemu) info snapshots
Snapshot devices: ide0-hd0
bdrv_snapshot_list: error -95



----------------------------------------------------------------------

Comment By: roy anonymous (roy-anonymous)
Date: 2009-01-07 19:14

Message:
I am not quite sure it's true or not, for my case, I get corruption if I
have a new FC9 Guest installation with qcow2 with virtio_blk. But it won't
have any problem if I install with a FC8 qcow2 installation, then upgrade
to FC9 with virtio_blk

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-07 09:42

Message:
Same problem here.

With Lenny and vanilla 2.6.28 kernel, with KVM 79, and with KVM 82 user
tools.
Tried with KVM 82 module compile for 2.6.28 and with 2.6.28 builtin KVM
sources.
32-bit userspace and kernel, Intel C2D T7100.

Another effect:
With empty qcow2, vmdk disk image formats, when I try to create a
partition and save the new partition table, they can't save it until
reboot. With raw image format there is no such problem.

I liked to try with qcow, but:
qemu: could not open disk image teszt.qcow

I switched all of my disk images to raw, until the problem fixed.

PS: The host filesystem is ext4, but I tested under ext3 filesystem too
and the problem wasn't disappeared.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

[ kvm-Bugs-2490866 ] repeatable corruption with qcow2 on kvm-79

[SourceForge.net]

Bugs item #2490866, was opened at 2009-01-07 05:10
Message generated for change (Comment added) made by roy-anonymous
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: qemu
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Adrian Bridgett (abridgett)
Assigned to: Nobody/Anonymous (nobody)
Summary: repeatable corruption with qcow2 on kvm-79

Initial Comment:
Creating a qcow2 image, mkfs.ext3, sometimes mounting it would fail immediately, but in all cases it would corrupt (overwritten with zeros) after starting up backuppc on it.   This is KVM-79 on a Debian lenny host and guest.

This occured using virtio or not.  Swapping to a raw file or LV worked flawlessly.  I've tested the box with memtest and I don't have issues elsewhere but I've seen corruptions on other images.  host and guest are both 2.6.26-1-adm64 kernel (debian lenny) I'm running 32-bit userspace everywhere.  Dual core Intel Core2 E6300.

I see KVM-81 has "improve qcow2 data integrity with cache=writethrough" which _might_ be what I'm hitting - but I can't find more details about this to check (and backport patch to debian package or wait for newer debian package).

thanks.

----------------------------------------------------------------------

Comment By: roy anonymous (roy-anonymous)
Date: 2009-01-08 01:14

Message:
I am not quite sure it's true or not, for my case, I get corruption if I
have a new FC9 Guest installation with qcow2 with virtio_blk. But it won't
have any problem if I install with a FC8 qcow2 installation, then upgrade
to FC9 with virtio_blk

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-07 15:42

Message:
Same problem here.

With Lenny and vanilla 2.6.28 kernel, with KVM 79, and with KVM 82 user
tools.
Tried with KVM 82 module compile for 2.6.28 and with 2.6.28 builtin KVM
sources.
32-bit userspace and kernel, Intel C2D T7100.

Another effect:
With empty qcow2, vmdk disk image formats, when I try to create a
partition and save the new partition table, they can't save it until
reboot. With raw image format there is no such problem.

I liked to try with qcow, but:
qemu: could not open disk image teszt.qcow

I switched all of my disk images to raw, until the problem fixed.

PS: The host filesystem is ext4, but I tested under ext3 filesystem too
and the problem wasn't disappeared.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

[ kvm-Bugs-2490866 ] repeatable corruption with qcow2 on kvm-79

[SourceForge.net]

Bugs item #2490866, was opened at 2009-01-06 22:10
Message generated for change (Comment added) made by ldvornik
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: qemu
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Adrian Bridgett (abridgett)
Assigned to: Nobody/Anonymous (nobody)
Summary: repeatable corruption with qcow2 on kvm-79

Initial Comment:
Creating a qcow2 image, mkfs.ext3, sometimes mounting it would fail immediately, but in all cases it would corrupt (overwritten with zeros) after starting up backuppc on it.   This is KVM-79 on a Debian lenny host and guest.

This occured using virtio or not.  Swapping to a raw file or LV worked flawlessly.  I've tested the box with memtest and I don't have issues elsewhere but I've seen corruptions on other images.  host and guest are both 2.6.26-1-adm64 kernel (debian lenny) I'm running 32-bit userspace everywhere.  Dual core Intel Core2 E6300.

I see KVM-81 has "improve qcow2 data integrity with cache=writethrough" which _might_ be what I'm hitting - but I can't find more details about this to check (and backport patch to debian package or wait for newer debian package).

thanks.

----------------------------------------------------------------------

Comment By: Laszlo Dvornik (ldvornik)
Date: 2009-01-07 08:42

Message:
Same problem here.

With Lenny and vanilla 2.6.28 kernel, with KVM 79, and with KVM 82 user
tools.
Tried with KVM 82 module compile for 2.6.28 and with 2.6.28 builtin KVM
sources.
32-bit userspace and kernel, Intel C2D T7100.

Another effect:
With empty qcow2, vmdk disk image formats, when I try to create a
partition and save the new partition table, they can't save it until
reboot. With raw image format there is no such problem.

I liked to try with qcow, but:
qemu: could not open disk image teszt.qcow

I switched all of my disk images to raw, until the problem fixed.

PS: The host filesystem is ext4, but I tested under ext3 filesystem too
and the problem wasn't disappeared.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

[ kvm-Bugs-2490866 ] repeatable corruption with qcow2 on kvm-79

[SourceForge.net]

Bugs item #2490866, was opened at 2009-01-06 21:10
Message generated for change (Tracker Item Submitted) made by Item Submitter
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: qemu
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Adrian Bridgett (abridgett)
Assigned to: Nobody/Anonymous (nobody)
Summary: repeatable corruption with qcow2 on kvm-79

Initial Comment:
Creating a qcow2 image, mkfs.ext3, sometimes mounting it would fail immediately, but in all cases it would corrupt (overwritten with zeros) after starting up backuppc on it.   This is KVM-79 on a Debian lenny host and guest.

This occured using virtio or not.  Swapping to a raw file or LV worked flawlessly.  I've tested the box with memtest and I don't have issues elsewhere but I've seen corruptions on other images.  host and guest are both 2.6.26-1-adm64 kernel (debian lenny) I'm running 32-bit userspace everywhere.  Dual core Intel Core2 E6300.

I see KVM-81 has "improve qcow2 data integrity with cache=writethrough" which _might_ be what I'm hitting - but I can't find more details about this to check (and backport patch to debian package or wait for newer debian package).

thanks.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=2490866&group_id=180599