From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:59271) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aaIyb-0008M2-Tt for qemu-devel@nongnu.org; Mon, 29 Feb 2016 03:14:46 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1aaIyW-0006CW-UY for qemu-devel@nongnu.org; Mon, 29 Feb 2016 03:14:45 -0500 Received: from mx1.redhat.com ([209.132.183.28]:40902) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aaIyW-0006CP-NM for qemu-devel@nongnu.org; Mon, 29 Feb 2016 03:14:40 -0500 From: Markus Armbruster References: <1454151394-52320-1-git-send-email-vsementsov@virtuozzo.com> <20160203081418.GC25746@ad.usersys.redhat.com> <56B45D3A.405@virtuozzo.com> <20160209142852.GA13149@stefanha-x1.localdomain> <56B9FAAE.8040503@virtuozzo.com> <20160210101004.GB7317@stefanha-x1.localdomain> <20160216170943.GA31393@stefanha-x1.localdomain> <56C4B21F.9030006@virtuozzo.com> <20160218121114.GC12470@redhat.com> <20160218164148.GB13271@stefanha-x1.localdomain> <20160219020826.GA23506@ad.usersys.redhat.com> <87povtulpt.fsf@blackfin.pond.sub.org> <56D0ADBD.20000@redhat.com> Date: Mon, 29 Feb 2016 09:14:37 +0100 In-Reply-To: <56D0ADBD.20000@redhat.com> (Paolo Bonzini's message of "Fri, 26 Feb 2016 20:55:41 +0100") Message-ID: <87vb583pci.fsf@blackfin.pond.sub.org> MIME-Version: 1.0 Content-Type: text/plain Subject: Re: [Qemu-devel] [PATCH v2 0/6] external backup api List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Paolo Bonzini Cc: kwolf@redhat.com, Vladimir Sementsov-Ogievskiy , Fam Zheng , "Denis V. Lunev" , Stefan Hajnoczi , qemu-devel@nongnu.org, jsnow@redhat.com Paolo Bonzini writes: > On 19/02/2016 09:51, Markus Armbruster wrote: >>> Is it an abuse to "Get LBA Status" to return dirty information? Because in SCSI >>> the command reports "mapped", "allocated" and "anchored" statuses. Does that >>> mean NBD will use a different status set? >> >> Perhaps some conceptual gymnastics can get us to standard semantics. >> >> Incremental backup wants to copy out an image's "dirty" blocks. >> >> We can view this as a bitmap telling us which of the image's blocks are >> dirty. >> >> An alternative view would be base image + dirty delta image. In the the >> dirty delta, exactly the dirty blocks are allocated. The delta image >> may be conceptual. > > I see a problem here. On one hand I agree that the "GET LBA STATUS" is > a natural extension to the NBD protocol. > > On the other hand, the Get LBA Status command in SCSI reflects the > state over the whole chain, not only the top element. It is the > equivalent of bdrv_get_block_status_above(bs, NULL, ...), rather than > bdrv_get_block_status(bs, ...). My understanding is that the dirty > block information would require the latter, especially in the > "conceptual delta image" model that Markus describes above. > > Having NBD implement subtly different semantics compared to SCSI is a > bad idea in my opinion. I completely agree with you that Get LBA Status cannot just reflect the top layer. But that's not what I meant to propose. Let me try to explain myself more clearly. Consider a QCOW2 image D (for delta) with a backing file B (for base). If you open it normally, you see "D over B". Get LBA Status should certainly claim the "deallocated" state only for blocks that are allocated neither in D nor B. However, you can also open D *without* its backing file. Then you see "D over nothing". Here, get LBA Status should claim "deallocated" state for anything not allocated in D. My proposal is to expose a "just the dirty blocks" view of a block backend similarly: it's a *separate* backend that contains *only* the dirty blocks. Attempts to read a clean block behave exactly like reading an unmapped block from any other thinly provisioned backend (QCOW2 gives you zeroes, if I remember correctly). I think it's only natural to make Get LBA Status claim "deallocated" for exactly the clean blocks then. > Of course if we call it "READ DIRTY BLOCKS" that would work, but I > don't think such a command would be something that it makes sense to > have in the general purpose NBD spec, so you would need a mechanism > for vendor-specific extensions. > > Paolo > >> Now, consider the dirty delta *without* its backing image. You can find >> its allocated blocks with Get LBA Status. As usual, you can read even >> unallocated blocks, see SBC3 table 9. >> >> If we NBD-export exactly that, we can use standard semantics, can't we?