From: Vladimir Sementsov-Ogievskiy <vsementsov@virtuozzo.com>
To: qemu-block@nongnu.org
Cc: qemu-devel@nongnu.org, armbru@redhat.com, jsnow@redhat.com,
mreitz@redhat.com, kwolf@redhat.com, vsementsov@virtuozzo.com,
den@openvz.org
Subject: [PATCH v2 00/36] block: update graph permissions update
Date: Fri, 27 Nov 2020 17:44:46 +0300 [thread overview]
Message-ID: <20201127144522.29991-1-vsementsov@virtuozzo.com> (raw)
Hi all!
Here is a proposal of updating graph changing procedures.
The thing brought me here is a question about "activating" filters after
insertion, which is done in mirror_top and backup_top. The problem is
that we can't simply avoid permission conflict when inserting the
filter: during insertion old permissions of relations to be removed
conflicting with new permissions of new created relations. And current
solution is supporting additional "inactive" mode for the filter when it
doesn't require any permissions.
I suggest to change the order of operations: let's first do all graph
relations modifications and then refresh permissions. Of course we'll
need a way to restore old graph if refresh fails.
Another problem with permission update is that we update permissions in
order of DFS which is not always correct. Better is update node when all
its parents already updated and require correct permissions. This needs
a topological sort of nodes prior to permission update, see more in
patches later.
Patches plan:
01,02 - add failing tests to illustrate conceptual problems of current
permission update system.
[Here is side suggestion: we usually add tests after fix, so careful
reviewer has to change order of patches to check that test fails before
fix. I add tests in the way the may be simply executed but not yet take
part in make check. It seems more native: first show the problem, then
fix it. And when fixed, make tests available for make check]
03-09 - some perparations, refactorings which may go in separate
10 - new transaction API
15 - toplogical sort implemented for permission update, one of new tests
now pass
19 - improve bdrv_replace_node. second new test now pass
26 - drop .active field and activation procedure for backup-top!
30 - update bdrv_reopen_multiple. At this point everything is using new
paradigm of permission update
31-36 - post refactoring, drop old interfaces, we are done.
Note, that this series does nothing with another graph-update problem
discussed under "[PATCH RFC 0/5] Fix accidental crash in iotest 30".
The series based on block-next Max's branch and can be found here:
git: https://src.openvz.org/scm/~vsementsov/qemu.git
tag: up-block-topologic-perm-v2
Vladimir Sementsov-Ogievskiy (36):
tests/test-bdrv-graph-mod: add test_parallel_exclusive_write
tests/test-bdrv-graph-mod: add test_parallel_perm_update
block: bdrv_append(): don't consume reference
block: bdrv_append(): return status
block: add bdrv_parent_try_set_aio_context
block: BdrvChildClass: add .get_parent_aio_context handler
block: drop ctx argument from bdrv_root_attach_child
block: make bdrv_reopen_{prepare,commit,abort} private
block: return value from bdrv_replace_node()
util: add transactions.c
block: bdrv_refresh_perms: check parents compliance
block: refactor bdrv_child* permission functions
block: rewrite bdrv_child_try_set_perm() using bdrv_refresh_perms()
block: inline bdrv_child_*() permission functions calls
block: use topological sort for permission update
block: add bdrv_drv_set_perm transaction action
block: add bdrv_list_* permission update functions
block: add bdrv_replace_child_safe() transaction action
block: fix bdrv_replace_node_common
block: add bdrv_attach_child_common() transaction action
block: add bdrv_attach_child_noperm() transaction action
block: split out bdrv_replace_node_noperm()
block: adapt bdrv_append() for inserting filters
block: add bdrv_remove_backing transaction action
block: introduce bdrv_drop_filter()
block/backup-top: drop .active
block: drop ignore_children for permission update functions
block: add bdrv_set_backing_noperm() transaction action
blockdev: qmp_x_blockdev_reopen: acquire all contexts
block: bdrv_reopen_multiple: refresh permissions on updated graph
block: drop unused permission update functions
block: inline bdrv_check_perm_common()
block: inline bdrv_replace_child()
block: refactor bdrv_child_set_perm_safe() transaction action
block: rename bdrv_replace_child_safe() to bdrv_replace_child()
block: refactor bdrv_node_check_perm()
include/block/block.h | 20 +-
include/block/block_int.h | 8 +-
include/qemu/transactions.h | 46 ++
block.c | 1319 ++++++++++++++++++++---------------
block/backup-top.c | 39 +-
block/block-backend.c | 13 +-
block/commit.c | 7 +-
block/file-posix.c | 84 +--
block/mirror.c | 9 +-
blockdev.c | 33 +-
blockjob.c | 11 +-
tests/test-bdrv-drain.c | 2 +-
tests/test-bdrv-graph-mod.c | 122 +++-
util/transactions.c | 81 +++
tests/qemu-iotests/283.out | 2 +-
util/meson.build | 1 +
16 files changed, 1100 insertions(+), 697 deletions(-)
create mode 100644 include/qemu/transactions.h
create mode 100644 util/transactions.c
--
2.21.3
next reply other threads:[~2020-11-27 14:50 UTC|newest]
Thread overview: 108+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-11-27 14:44 Vladimir Sementsov-Ogievskiy [this message]
2020-11-27 14:44 ` [PATCH v2 01/36] tests/test-bdrv-graph-mod: add test_parallel_exclusive_write Vladimir Sementsov-Ogievskiy
2020-11-27 14:44 ` [PATCH v2 02/36] tests/test-bdrv-graph-mod: add test_parallel_perm_update Vladimir Sementsov-Ogievskiy
2021-01-18 14:05 ` Kevin Wolf
2021-01-18 17:13 ` Vladimir Sementsov-Ogievskiy
2020-11-27 14:44 ` [PATCH v2 03/36] block: bdrv_append(): don't consume reference Vladimir Sementsov-Ogievskiy
2021-01-18 14:18 ` Kevin Wolf
2021-01-18 17:21 ` Vladimir Sementsov-Ogievskiy
2021-01-18 17:59 ` Kevin Wolf
2020-11-27 14:44 ` [PATCH v2 04/36] block: bdrv_append(): return status Vladimir Sementsov-Ogievskiy
2020-12-14 15:49 ` Alberto Garcia
2021-01-18 14:32 ` Kevin Wolf
2020-11-27 14:44 ` [PATCH v2 05/36] block: add bdrv_parent_try_set_aio_context Vladimir Sementsov-Ogievskiy
2021-01-18 15:08 ` Kevin Wolf
2021-01-18 17:26 ` Vladimir Sementsov-Ogievskiy
2020-11-27 14:44 ` [PATCH v2 06/36] block: BdrvChildClass: add .get_parent_aio_context handler Vladimir Sementsov-Ogievskiy
2021-01-18 15:13 ` Kevin Wolf
2021-01-18 17:36 ` Vladimir Sementsov-Ogievskiy
2021-01-19 16:38 ` Kevin Wolf
2021-01-22 11:04 ` Vladimir Sementsov-Ogievskiy
2021-01-22 11:18 ` Kevin Wolf
2021-01-22 11:26 ` Vladimir Sementsov-Ogievskiy
2020-11-27 14:44 ` [PATCH v2 07/36] block: drop ctx argument from bdrv_root_attach_child Vladimir Sementsov-Ogievskiy
2020-11-27 14:44 ` [PATCH v2 08/36] block: make bdrv_reopen_{prepare, commit, abort} private Vladimir Sementsov-Ogievskiy via
2020-12-15 17:28 ` Alberto Garcia
2021-01-18 15:24 ` [PATCH v2 08/36] block: make bdrv_reopen_{prepare,commit,abort} private Kevin Wolf
2020-11-27 14:44 ` [PATCH v2 09/36] block: return value from bdrv_replace_node() Vladimir Sementsov-Ogievskiy
2020-12-15 17:30 ` Alberto Garcia
2021-01-18 15:40 ` Kevin Wolf
2020-11-27 14:44 ` [PATCH v2 10/36] util: add transactions.c Vladimir Sementsov-Ogievskiy
2021-01-18 16:50 ` Kevin Wolf
2021-01-18 17:41 ` Vladimir Sementsov-Ogievskiy
2020-11-27 14:44 ` [PATCH v2 11/36] block: bdrv_refresh_perms: check parents compliance Vladimir Sementsov-Ogievskiy
2021-01-19 17:42 ` Kevin Wolf
2021-01-19 18:10 ` Vladimir Sementsov-Ogievskiy
2020-11-27 14:44 ` [PATCH v2 12/36] block: refactor bdrv_child* permission functions Vladimir Sementsov-Ogievskiy
2021-01-19 18:09 ` Kevin Wolf
2021-01-19 18:30 ` Vladimir Sementsov-Ogievskiy
2021-01-20 9:09 ` Kevin Wolf
2021-01-20 9:56 ` Vladimir Sementsov-Ogievskiy
2021-01-20 10:06 ` Kevin Wolf
2020-11-27 14:44 ` [PATCH v2 13/36] block: rewrite bdrv_child_try_set_perm() using bdrv_refresh_perms() Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 14/36] block: inline bdrv_child_*() permission functions calls Vladimir Sementsov-Ogievskiy
2020-12-16 17:16 ` Alberto Garcia
2020-11-27 14:45 ` [PATCH v2 15/36] block: use topological sort for permission update Vladimir Sementsov-Ogievskiy
2021-01-27 18:38 ` Kevin Wolf
2021-01-28 9:34 ` Vladimir Sementsov-Ogievskiy
2021-01-28 17:13 ` Kevin Wolf
2021-01-28 18:04 ` Vladimir Sementsov-Ogievskiy
2021-02-03 18:38 ` Kevin Wolf
2021-02-04 7:16 ` Vladimir Sementsov-Ogievskiy
2021-03-10 11:08 ` Vladimir Sementsov-Ogievskiy
2021-03-10 11:55 ` Kevin Wolf
2020-11-27 14:45 ` [PATCH v2 16/36] block: add bdrv_drv_set_perm transaction action Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 17/36] block: add bdrv_list_* permission update functions Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 18/36] block: add bdrv_replace_child_safe() transaction action Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 19/36] block: fix bdrv_replace_node_common Vladimir Sementsov-Ogievskiy
2021-02-03 18:23 ` Kevin Wolf
2021-02-04 7:24 ` Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 20/36] block: add bdrv_attach_child_common() transaction action Vladimir Sementsov-Ogievskiy
2021-02-03 21:01 ` Kevin Wolf
2021-02-04 7:34 ` Vladimir Sementsov-Ogievskiy
2021-02-04 7:50 ` Kevin Wolf
2020-11-27 14:45 ` [PATCH v2 21/36] block: add bdrv_attach_child_noperm() " Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 22/36] block: split out bdrv_replace_node_noperm() Vladimir Sementsov-Ogievskiy
2021-02-03 21:16 ` Kevin Wolf
2020-11-27 14:45 ` [PATCH v2 23/36] block: adapt bdrv_append() for inserting filters Vladimir Sementsov-Ogievskiy
2021-02-03 21:33 ` Kevin Wolf
2021-02-04 8:30 ` Vladimir Sementsov-Ogievskiy
2021-02-04 9:05 ` Kevin Wolf
2021-02-04 11:54 ` Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 24/36] block: add bdrv_remove_backing transaction action Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 25/36] block: introduce bdrv_drop_filter() Vladimir Sementsov-Ogievskiy
2021-02-04 11:31 ` Kevin Wolf
2021-02-04 12:27 ` Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 26/36] block/backup-top: drop .active Vladimir Sementsov-Ogievskiy
2021-02-04 12:26 ` Kevin Wolf
2021-02-04 12:33 ` Vladimir Sementsov-Ogievskiy
2021-02-04 13:25 ` Kevin Wolf
2021-02-04 13:46 ` Vladimir Sementsov-Ogievskiy
2021-02-04 14:31 ` Kevin Wolf
2020-11-27 14:45 ` [PATCH v2 27/36] block: drop ignore_children for permission update functions Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 28/36] block: add bdrv_set_backing_noperm() transaction action Vladimir Sementsov-Ogievskiy
2021-02-05 14:00 ` Kevin Wolf
2021-02-05 16:06 ` Vladimir Sementsov-Ogievskiy
2021-02-05 16:30 ` Kevin Wolf
2021-03-11 18:29 ` Vladimir Sementsov-Ogievskiy
2021-02-05 16:26 ` Kevin Wolf
2021-02-08 9:34 ` Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 29/36] blockdev: qmp_x_blockdev_reopen: acquire all contexts Vladimir Sementsov-Ogievskiy
2021-02-05 16:01 ` Kevin Wolf
2021-02-05 16:16 ` Vladimir Sementsov-Ogievskiy
2021-02-05 16:36 ` Kevin Wolf
2020-11-27 14:45 ` [PATCH v2 30/36] block: bdrv_reopen_multiple: refresh permissions on updated graph Vladimir Sementsov-Ogievskiy
2021-02-05 17:57 ` Kevin Wolf
2021-02-08 11:21 ` Vladimir Sementsov-Ogievskiy
2021-02-10 14:13 ` Kevin Wolf
2021-02-10 14:38 ` Kevin Wolf
2020-11-27 14:45 ` [PATCH v2 31/36] block: drop unused permission update functions Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 32/36] block: inline bdrv_check_perm_common() Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 33/36] block: inline bdrv_replace_child() Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 34/36] block: refactor bdrv_child_set_perm_safe() transaction action Vladimir Sementsov-Ogievskiy
2021-02-10 14:51 ` Kevin Wolf
2020-11-27 14:45 ` [PATCH v2 35/36] block: rename bdrv_replace_child_safe() to bdrv_replace_child() Vladimir Sementsov-Ogievskiy
2020-11-27 14:45 ` [PATCH v2 36/36] block: refactor bdrv_node_check_perm() Vladimir Sementsov-Ogievskiy
2021-02-10 15:07 ` Kevin Wolf
2021-02-11 9:50 ` Vladimir Sementsov-Ogievskiy
2021-01-09 10:12 ` [PATCH v2 00/36] block: update graph permissions update Vladimir Sementsov-Ogievskiy
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20201127144522.29991-1-vsementsov@virtuozzo.com \
--to=vsementsov@virtuozzo.com \
--cc=armbru@redhat.com \
--cc=den@openvz.org \
--cc=jsnow@redhat.com \
--cc=kwolf@redhat.com \
--cc=mreitz@redhat.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.