From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:60116) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1bFg43-0005FD-43 for qemu-devel@nongnu.org; Wed, 22 Jun 2016 07:11:27 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1bFg3y-0001PY-9B for qemu-devel@nongnu.org; Wed, 22 Jun 2016 07:11:22 -0400 Received: from indium.canonical.com ([91.189.90.7]:49144) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1bFg3y-0001PI-0Y for qemu-devel@nongnu.org; Wed, 22 Jun 2016 07:11:18 -0400 Received: from loganberry.canonical.com ([91.189.90.37]) by indium.canonical.com with esmtp (Exim 4.76 #1 (Debian)) id 1bFg3x-0005Lz-AF for ; Wed, 22 Jun 2016 11:11:17 +0000 Received: from loganberry.canonical.com (localhost [127.0.0.1]) by loganberry.canonical.com (Postfix) with ESMTP id 499482E80C2 for ; Wed, 22 Jun 2016 11:11:17 +0000 (UTC) MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Date: Wed, 22 Jun 2016 11:03:53 -0000 From: "T. Huth" <1490611@bugs.launchpad.net> Reply-To: Bug 1490611 <1490611@bugs.launchpad.net> Sender: bounces@canonical.com References: <20150831152901.21817.58033.malonedeb@gac.canonical.com> Message-Id: <20160622110353.17435.6183.malone@wampee.canonical.com> Errors-To: bounces@canonical.com Subject: [Qemu-devel] [Bug 1490611] Re: Using qemu >=2.2.1 to convert raw->VHD (fixed) adds extra padding to the result file, which Microsoft Azure rejects as invalid List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: qemu-devel@nongnu.org Fix is available with QEMU 2.6: http://git.qemu.org/?p=3Dqemu.git;a=3Dcommitdiff;h=3Dfb9245c2610932d33ce14 -- = You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1490611 Title: Using qemu >=3D2.2.1 to convert raw->VHD (fixed) adds extra padding to the result file, which Microsoft Azure rejects as invalid Status in QEMU: Fix Released Bug description: Starting with a raw disk image, using "qemu-img convert" to convert from raw to VHD results in the output VHD file's virtual size being aligned to the nearest 516096 bytes (16 heads x 63 sectors per head x 512 bytes per sector), instead of preserving the input file's size as the output VHD's virtual disk size. Microsoft Azure requires that disk images (VHDs) submitted for upload have virtual sizes aligned to a megabyte boundary. (Ex. 4096MB, 4097MB, 4098MB, etc. are OK, 4096.5MB is rejected with an error.) This is reflected in Microsoft's documentation: https://azure.microsoft.com /en-us/documentation/articles/virtual-machines-linux-create-upload- vhd-generic/ This is reproducible with the following set of commands (including the Azure command line tools from https://github.com/Azure/azure-xplat- cli). For the following example, I used qemu version 2.2.1: $ dd if=3D/dev/zero of=3Dsource-disk.img bs=3D1M count=3D4096 $ stat source-disk.img = File: =E2=80=98source-disk.img=E2=80=99 Size: 4294967296 Blocks: 798656 IO Block: 4096 regular file Device: fc01h/64513d Inode: 13247963 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 1000/ smkent) Gid: ( 1000/ smkent) Access: 2015-08-18 09:48:02.613988480 -0700 Modify: 2015-08-18 09:48:02.825985646 -0700 Change: 2015-08-18 09:48:02.825985646 -0700 Birth: - $ qemu-img convert -f raw -o subformat=3Dfixed -O vpc source-disk.img dest-disk.vhd $ stat dest-disk.vhd = File: =E2=80=98dest-disk.vhd=E2=80=99 Size: 4296499712 Blocks: 535216 IO Block: 4096 regular file Device: fc01h/64513d Inode: 13247964 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 1000/ smkent) Gid: ( 1000/ smkent) Access: 2015-08-18 09:50:22.252077624 -0700 Modify: 2015-08-18 09:49:24.424868868 -0700 Change: 2015-08-18 09:49:24.424868868 -0700 Birth: - $ azure vm image create testimage1 dest-disk.vhd -o linux -l "West US" info: Executing command vm image create + Retrieving storage accounts = = info: VHD size : 4097 MB info: Uploading 4195800.5 KB Requested:100.0% Completed:100.0% Running: 0 Time: 1m 0s Speed: 6744 K= B/s = info: https://[redacted].blob.core.windows.net/vm-images/dest-disk.vhd= was uploaded successfully error: The VHD https://[redacted].blob.core.windows.net/vm-images/dest-= disk.vhd has an unsupported virtual size of 4296499200 bytes. The size mus= t be a whole number (in MBs). info: Error information has been recorded to /home/smkent/.azure/azure= .err error: vm image create command failed I also ran the above commands using qemu 2.4.0, which resulted in the same error as the conversion behavior is the same. However, qemu 2.1.1 and earlier (including qemu 2.0.0 installed by Ubuntu 14.04) does not pad the virtual disk size during conversion. Using qemu-img convert from qemu versions <=3D2.1.1 results in a VHD that is exactly the size of the raw input file plus 512 bytes (for the VHD footer). Those qemu versions do not attempt to realign the disk. As a result, Azure accepts VHD files created using those versions of qemu-img convert for upload. Is there a reason why newer qemu realigns the converted VHD file? It would be useful if an option were added to disable this feature, as current versions of qemu cannot be used to create VHD files for Azure using Microsoft's official instructions. To manage notifications about this bug go to: https://bugs.launchpad.net/qemu/+bug/1490611/+subscriptions