All of lore.kernel.org
 help / color / mirror / Atom feed
From: Eric Blake <eblake@redhat.com>
To: Kevin Wolf <kwolf@redhat.com>, qemu-block@nongnu.org
Cc: vsementsov@virtuozzo.com, qemu-devel@nongnu.org,
	stefanha@redhat.com, mreitz@redhat.com
Subject: Re: [PATCH v2 2/6] block: truncate: Don't make backing file data visible
Date: Wed, 20 Nov 2019 15:15:57 -0600	[thread overview]
Message-ID: <96c2c681-851d-4b83-2acd-3952fa850e5f@redhat.com> (raw)
In-Reply-To: <20191120184501.28159-3-kwolf@redhat.com>

On 11/20/19 12:44 PM, Kevin Wolf wrote:
> When extending the size of an image that has a backing file larger than
> its old size, make sure that the backing file data doesn't become
> visible in the guest, but the added area is properly zeroed out.
> 
> Consider the following scenario where the overlay is shorter than its
> backing file:
> 
>      base.qcow2:     AAAAAAAA
>      overlay.qcow2:  BBBB
> 
> When resizing (extending) overlay.qcow2, the new blocks should not stay
> unallocated and make the additional As from base.qcow2 visible like
> before this patch, but zeros should be read.
> 
> A similar case happens with the various variants of a commit job when an
> intermediate file is short (- for unallocated):
> 
>      base.qcow2:     A-A-AAAA
>      mid.qcow2:      BB-B
>      top.qcow2:      C--C--C-
> 
> After commit top.qcow2 to mid.qcow2, the following happens:
> 
>      mid.qcow2:      CB-C00C0 (correct result)
>      mid.qcow2:      CB-C--C- (before this fix)
> 
> Without the fix, blocks that previously read as zeros on top.qcow2
> suddenly turn into A.
> 
> Signed-off-by: Kevin Wolf <kwolf@redhat.com>
> ---
>   block/io.c | 32 ++++++++++++++++++++++++++++++++
>   1 file changed, 32 insertions(+)
> 

> +    if (new_bytes && bs->backing && prealloc == PREALLOC_MODE_OFF) {
> +        int64_t backing_len;
> +
> +        backing_len = bdrv_getlength(backing_bs(bs));
> +        if (backing_len < 0) {
> +            ret = backing_len;
> +            goto out;
> +        }
> +
> +        if (backing_len > old_size) {
> +            ret = bdrv_co_do_pwrite_zeroes(
> +                    bs, old_size, MIN(new_bytes, backing_len - old_size),
> +                    BDRV_REQ_ZERO_WRITE | BDRV_REQ_MAY_UNMAP);
> +            if (ret < 0) {
> +                goto out;
> +            }
> +        }
> +    }

Note that if writing zeroes is not fast, and it turns out that we copy a 
lot of data rather than unallocated sections from the image being 
committed, that this can actually slow things down (doing a bulk 
pre-zero doubles up data I/O unless it is fast, which is why we added 
BDRV_REQ_NO_FALLBACK to avoid slow pre-zeroing).  However, the 
complication of zeroing only the unallocated clusters rather than a bulk 
pre-zeroing for something that is an unlikely corner case (how often do 
you create an overlay shorter than the backing file?) is not worth the 
extra code maintenance (unlike in the 'qemu-img convert' case where it 
was worth the optimization). So I'm fine with how you fixed it here.

Reviewed-by: Eric Blake <eblake@redhat.com>

-- 
Eric Blake, Principal Software Engineer
Red Hat, Inc.           +1-919-301-3226
Virtualization:  qemu.org | libvirt.org



  reply	other threads:[~2019-11-20 21:18 UTC|newest]

Thread overview: 28+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-11-20 18:44 [PATCH for-4.2? v2 0/6] block: Fix resize (extending) of short overlays Kevin Wolf
2019-11-20 18:44 ` [PATCH v2 1/6] block: bdrv_co_do_pwrite_zeroes: 64 bit 'bytes' parameter Kevin Wolf
2019-11-20 18:44 ` [PATCH v2 2/6] block: truncate: Don't make backing file data visible Kevin Wolf
2019-11-20 21:15   ` Eric Blake [this message]
2019-11-21 11:22     ` Kevin Wolf
2019-11-21  8:59   ` Max Reitz
2019-11-21  9:46     ` Vladimir Sementsov-Ogievskiy
2019-11-21 11:34     ` Kevin Wolf
2019-11-21 12:21       ` Max Reitz
2019-11-21 14:33         ` Kevin Wolf
2019-11-21 15:25           ` Max Reitz
2019-11-22 14:07           ` Alberto Garcia
2019-11-22 14:27   ` Alberto Garcia
2019-11-20 18:44 ` [PATCH v2 3/6] iotests: Add qemu_io_log() Kevin Wolf
2019-11-21 13:35   ` Alberto Garcia
2019-11-20 18:44 ` [PATCH v2 4/6] iotests: Fix timeout in run_job() Kevin Wolf
2019-11-21 13:34   ` Alberto Garcia
2019-11-20 18:45 ` [PATCH v2 5/6] iotests: Support job-complete " Kevin Wolf
2019-11-21 13:35   ` Alberto Garcia
2019-11-20 18:45 ` [PATCH v2 6/6] iotests: Test committing to short backing file Kevin Wolf
2019-11-20 21:27   ` Eric Blake
2019-11-21  9:36     ` Vladimir Sementsov-Ogievskiy
2019-11-21 10:24   ` Vladimir Sementsov-Ogievskiy
2019-11-21 10:28   ` Vladimir Sementsov-Ogievskiy
2019-11-21 10:30     ` Vladimir Sementsov-Ogievskiy
2019-11-21 11:39       ` Kevin Wolf
2019-11-21 13:02         ` Vladimir Sementsov-Ogievskiy
2019-11-21 14:09 ` [PATCH for-4.2? v2 0/6] block: Fix resize (extending) of short overlays Stefan Hajnoczi

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=96c2c681-851d-4b83-2acd-3952fa850e5f@redhat.com \
    --to=eblake@redhat.com \
    --cc=kwolf@redhat.com \
    --cc=mreitz@redhat.com \
    --cc=qemu-block@nongnu.org \
    --cc=qemu-devel@nongnu.org \
    --cc=stefanha@redhat.com \
    --cc=vsementsov@virtuozzo.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.