From: Eric Blake <eblake@redhat.com>
To: Kevin Wolf <kwolf@redhat.com>, qemu-block@nongnu.org
Cc: vsementsov@virtuozzo.com, qemu-devel@nongnu.org,
stefanha@redhat.com, mreitz@redhat.com
Subject: Re: [PATCH v2 2/6] block: truncate: Don't make backing file data visible
Date: Wed, 20 Nov 2019 15:15:57 -0600 [thread overview]
Message-ID: <96c2c681-851d-4b83-2acd-3952fa850e5f@redhat.com> (raw)
In-Reply-To: <20191120184501.28159-3-kwolf@redhat.com>
On 11/20/19 12:44 PM, Kevin Wolf wrote:
> When extending the size of an image that has a backing file larger than
> its old size, make sure that the backing file data doesn't become
> visible in the guest, but the added area is properly zeroed out.
>
> Consider the following scenario where the overlay is shorter than its
> backing file:
>
> base.qcow2: AAAAAAAA
> overlay.qcow2: BBBB
>
> When resizing (extending) overlay.qcow2, the new blocks should not stay
> unallocated and make the additional As from base.qcow2 visible like
> before this patch, but zeros should be read.
>
> A similar case happens with the various variants of a commit job when an
> intermediate file is short (- for unallocated):
>
> base.qcow2: A-A-AAAA
> mid.qcow2: BB-B
> top.qcow2: C--C--C-
>
> After commit top.qcow2 to mid.qcow2, the following happens:
>
> mid.qcow2: CB-C00C0 (correct result)
> mid.qcow2: CB-C--C- (before this fix)
>
> Without the fix, blocks that previously read as zeros on top.qcow2
> suddenly turn into A.
>
> Signed-off-by: Kevin Wolf <kwolf@redhat.com>
> ---
> block/io.c | 32 ++++++++++++++++++++++++++++++++
> 1 file changed, 32 insertions(+)
>
> + if (new_bytes && bs->backing && prealloc == PREALLOC_MODE_OFF) {
> + int64_t backing_len;
> +
> + backing_len = bdrv_getlength(backing_bs(bs));
> + if (backing_len < 0) {
> + ret = backing_len;
> + goto out;
> + }
> +
> + if (backing_len > old_size) {
> + ret = bdrv_co_do_pwrite_zeroes(
> + bs, old_size, MIN(new_bytes, backing_len - old_size),
> + BDRV_REQ_ZERO_WRITE | BDRV_REQ_MAY_UNMAP);
> + if (ret < 0) {
> + goto out;
> + }
> + }
> + }
Note that if writing zeroes is not fast, and it turns out that we copy a
lot of data rather than unallocated sections from the image being
committed, that this can actually slow things down (doing a bulk
pre-zero doubles up data I/O unless it is fast, which is why we added
BDRV_REQ_NO_FALLBACK to avoid slow pre-zeroing). However, the
complication of zeroing only the unallocated clusters rather than a bulk
pre-zeroing for something that is an unlikely corner case (how often do
you create an overlay shorter than the backing file?) is not worth the
extra code maintenance (unlike in the 'qemu-img convert' case where it
was worth the optimization). So I'm fine with how you fixed it here.
Reviewed-by: Eric Blake <eblake@redhat.com>
--
Eric Blake, Principal Software Engineer
Red Hat, Inc. +1-919-301-3226
Virtualization: qemu.org | libvirt.org
next prev parent reply other threads:[~2019-11-20 21:18 UTC|newest]
Thread overview: 28+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-11-20 18:44 [PATCH for-4.2? v2 0/6] block: Fix resize (extending) of short overlays Kevin Wolf
2019-11-20 18:44 ` [PATCH v2 1/6] block: bdrv_co_do_pwrite_zeroes: 64 bit 'bytes' parameter Kevin Wolf
2019-11-20 18:44 ` [PATCH v2 2/6] block: truncate: Don't make backing file data visible Kevin Wolf
2019-11-20 21:15 ` Eric Blake [this message]
2019-11-21 11:22 ` Kevin Wolf
2019-11-21 8:59 ` Max Reitz
2019-11-21 9:46 ` Vladimir Sementsov-Ogievskiy
2019-11-21 11:34 ` Kevin Wolf
2019-11-21 12:21 ` Max Reitz
2019-11-21 14:33 ` Kevin Wolf
2019-11-21 15:25 ` Max Reitz
2019-11-22 14:07 ` Alberto Garcia
2019-11-22 14:27 ` Alberto Garcia
2019-11-20 18:44 ` [PATCH v2 3/6] iotests: Add qemu_io_log() Kevin Wolf
2019-11-21 13:35 ` Alberto Garcia
2019-11-20 18:44 ` [PATCH v2 4/6] iotests: Fix timeout in run_job() Kevin Wolf
2019-11-21 13:34 ` Alberto Garcia
2019-11-20 18:45 ` [PATCH v2 5/6] iotests: Support job-complete " Kevin Wolf
2019-11-21 13:35 ` Alberto Garcia
2019-11-20 18:45 ` [PATCH v2 6/6] iotests: Test committing to short backing file Kevin Wolf
2019-11-20 21:27 ` Eric Blake
2019-11-21 9:36 ` Vladimir Sementsov-Ogievskiy
2019-11-21 10:24 ` Vladimir Sementsov-Ogievskiy
2019-11-21 10:28 ` Vladimir Sementsov-Ogievskiy
2019-11-21 10:30 ` Vladimir Sementsov-Ogievskiy
2019-11-21 11:39 ` Kevin Wolf
2019-11-21 13:02 ` Vladimir Sementsov-Ogievskiy
2019-11-21 14:09 ` [PATCH for-4.2? v2 0/6] block: Fix resize (extending) of short overlays Stefan Hajnoczi
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=96c2c681-851d-4b83-2acd-3952fa850e5f@redhat.com \
--to=eblake@redhat.com \
--cc=kwolf@redhat.com \
--cc=mreitz@redhat.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
--cc=stefanha@redhat.com \
--cc=vsementsov@virtuozzo.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.