From: Vladimir Sementsov-Ogievskiy <vsementsov@virtuozzo.com>
To: qemu-block@nongnu.org
Cc: qemu-devel@nongnu.org, armbru@redhat.com,
xiechanglong.d@gmail.com, wencongyang2@huawei.com,
fam@euphon.net, stefanha@redhat.com, eblake@redhat.com,
hreitz@redhat.com, kwolf@redhat.com, vsementsov@virtuozzo.com,
jsnow@redhat.com, nikita.lapshin@virtuozzo.com
Subject: [PATCH v4 00/18] Make image fleecing more usable
Date: Wed, 16 Feb 2022 20:45:59 +0100 [thread overview]
Message-ID: <20220216194617.126484-1-vsementsov@virtuozzo.com> (raw)
v4: Switch to new fleecing scheme, more native for Qemu's block-layer,
see new patches 10-12 for details.
01,02: add Hanna's r-b
03: add const, add forgotten bdrv_release_dirty_bitmap()
04: rewrite bitmap parameter parsing
05: add Hanna's r-b
06: tiny wording fixes
07: new
08: fix comments, improve interface of new functions
09: fix grammar, add Hanna's and Nikita's r-bs
10-12: new fleecing scheme
tests: updated to use new fleecing scheme
===
These series brings several improvements to fleecing scheme:
1. support bitmap in copy-before-write filter
2. introduce snapshot-access API and filter, to make a new fleecing
scheme. See "block: copy-before-write: realize snapshot-access API"
commit message for details.
3. support "push backup with fleecing" scheme, when backup job is a
client of common fleecing scheme. That helps when writes to final
backup target are slow and we don't want guest writes hang waiting
for copy-before-write operations to final target.
Vladimir Sementsov-Ogievskiy (18):
block/block-copy: move copy_bitmap initialization to
block_copy_state_new()
block/dirty-bitmap: bdrv_merge_dirty_bitmap(): add return value
block/block-copy: block_copy_state_new(): add bitmap parameter
block/copy-before-write: add bitmap open parameter
block/block-copy: add block_copy_reset()
block: intoduce reqlist
block/reqlist: reqlist_find_conflict(): use ranges_overlap()
block/dirty-bitmap: introduce bdrv_dirty_bitmap_status()
block/reqlist: add reqlist_wait_all()
block/io: introduce block driver snapshot-access API
block: introduce snapshot-access filter
block: copy-before-write: realize snapshot-access API
iotests/image-fleecing: add test-case for fleecing format node
iotests.py: add qemu_io_pipe_and_status()
iotests/image-fleecing: add test case with bitmap
block: blk_root(): return non-const pointer
qapi: backup: add immutable-source parameter
iotests/image-fleecing: test push backup with fleecing
qapi/block-core.json | 25 +-
include/block/block-copy.h | 2 +
include/block/block_int.h | 28 +++
include/block/dirty-bitmap.h | 4 +-
include/block/reqlist.h | 75 ++++++
include/qemu/hbitmap.h | 12 +
include/sysemu/block-backend.h | 2 +-
block/backup.c | 61 ++++-
block/block-backend.c | 2 +-
block/block-copy.c | 150 +++++------
block/copy-before-write.c | 265 +++++++++++++++++++-
block/dirty-bitmap.c | 15 +-
block/io.c | 69 +++++
block/monitor/bitmap-qmp-cmds.c | 5 +-
block/replication.c | 2 +-
block/reqlist.c | 85 +++++++
block/snapshot-access.c | 132 ++++++++++
blockdev.c | 1 +
util/hbitmap.c | 33 +++
MAINTAINERS | 5 +-
block/meson.build | 2 +
tests/qemu-iotests/iotests.py | 4 +
tests/qemu-iotests/tests/image-fleecing | 175 ++++++++++---
tests/qemu-iotests/tests/image-fleecing.out | 223 +++++++++++++++-
24 files changed, 1227 insertions(+), 150 deletions(-)
create mode 100644 include/block/reqlist.h
create mode 100644 block/reqlist.c
create mode 100644 block/snapshot-access.c
--
2.31.1
next reply other threads:[~2022-02-16 19:52 UTC|newest]
Thread overview: 36+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-02-16 19:45 Vladimir Sementsov-Ogievskiy [this message]
2022-02-16 19:46 ` [PATCH v4 01/18] block/block-copy: move copy_bitmap initialization to block_copy_state_new() Vladimir Sementsov-Ogievskiy
2022-02-16 19:46 ` [PATCH v4 02/18] block/dirty-bitmap: bdrv_merge_dirty_bitmap(): add return value Vladimir Sementsov-Ogievskiy
2022-02-16 19:46 ` [PATCH v4 03/18] block/block-copy: block_copy_state_new(): add bitmap parameter Vladimir Sementsov-Ogievskiy
2022-02-24 12:01 ` Hanna Reitz
2022-02-16 19:46 ` [PATCH v4 04/18] block/copy-before-write: add bitmap open parameter Vladimir Sementsov-Ogievskiy
2022-02-24 12:07 ` Hanna Reitz
2022-02-24 13:27 ` Vladimir Sementsov-Ogievskiy
2022-02-16 19:46 ` [PATCH v4 05/18] block/block-copy: add block_copy_reset() Vladimir Sementsov-Ogievskiy
2022-02-16 19:46 ` [PATCH v4 06/18] block: intoduce reqlist Vladimir Sementsov-Ogievskiy
2022-02-24 12:08 ` Hanna Reitz
2022-02-16 19:46 ` [PATCH v4 07/18] block/reqlist: reqlist_find_conflict(): use ranges_overlap() Vladimir Sementsov-Ogievskiy
2022-02-24 12:08 ` Hanna Reitz
2022-02-16 19:46 ` [PATCH v4 08/18] block/dirty-bitmap: introduce bdrv_dirty_bitmap_status() Vladimir Sementsov-Ogievskiy
2022-02-24 12:20 ` Hanna Reitz
2022-02-16 19:46 ` [PATCH v4 09/18] block/reqlist: add reqlist_wait_all() Vladimir Sementsov-Ogievskiy
2022-02-16 19:46 ` [PATCH v4 10/18] block/io: introduce block driver snapshot-access API Vladimir Sementsov-Ogievskiy
2022-02-24 12:24 ` Hanna Reitz
2022-02-16 19:46 ` [PATCH v4 11/18] block: introduce snapshot-access filter Vladimir Sementsov-Ogievskiy
2022-02-24 12:29 ` Hanna Reitz
2022-02-16 19:46 ` [PATCH v4 12/18] block: copy-before-write: realize snapshot-access API Vladimir Sementsov-Ogievskiy
2022-02-24 12:46 ` Hanna Reitz
2022-02-24 13:42 ` Vladimir Sementsov-Ogievskiy
2022-02-16 19:46 ` [PATCH v4 13/18] iotests/image-fleecing: add test-case for fleecing format node Vladimir Sementsov-Ogievskiy
2022-02-24 12:48 ` Hanna Reitz
2022-02-16 19:46 ` [PATCH v4 14/18] iotests.py: add qemu_io_pipe_and_status() Vladimir Sementsov-Ogievskiy
2022-02-24 12:52 ` Hanna Reitz
2022-02-24 13:42 ` Vladimir Sementsov-Ogievskiy
2022-02-16 19:46 ` [PATCH v4 15/18] iotests/image-fleecing: add test case with bitmap Vladimir Sementsov-Ogievskiy
2022-02-24 12:58 ` Hanna Reitz
2022-02-24 14:07 ` Vladimir Sementsov-Ogievskiy
2022-02-16 19:46 ` [PATCH v4 16/18] block: blk_root(): return non-const pointer Vladimir Sementsov-Ogievskiy
2022-02-16 19:46 ` [PATCH v4 17/18] qapi: backup: add immutable-source parameter Vladimir Sementsov-Ogievskiy
2022-02-24 13:05 ` Hanna Reitz
2022-02-24 14:14 ` Vladimir Sementsov-Ogievskiy
2022-02-16 19:46 ` [PATCH v4 18/18] iotests/image-fleecing: test push backup with fleecing Vladimir Sementsov-Ogievskiy
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20220216194617.126484-1-vsementsov@virtuozzo.com \
--to=vsementsov@virtuozzo.com \
--cc=armbru@redhat.com \
--cc=eblake@redhat.com \
--cc=fam@euphon.net \
--cc=hreitz@redhat.com \
--cc=jsnow@redhat.com \
--cc=kwolf@redhat.com \
--cc=nikita.lapshin@virtuozzo.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
--cc=stefanha@redhat.com \
--cc=wencongyang2@huawei.com \
--cc=xiechanglong.d@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.