From: Anton Nefedov <anton.nefedov@virtuozzo.com>
To: qemu-block@nongnu.org
Cc: kwolf@redhat.com, vsementsov@virtuozzo.com, berto@igalia.com,
den@virtuozzo.com, qemu-devel@nongnu.org, mreitz@redhat.com,
Anton Nefedov <anton.nefedov@virtuozzo.com>,
pbonzini@redhat.com, jsnow@redhat.com
Subject: [Qemu-devel] [PATCH v8 0/9] discard blockstats
Date: Thu, 16 May 2019 17:33:05 +0300 [thread overview]
Message-ID: <20190516143314.81302-1-anton.nefedov@virtuozzo.com> (raw)
..apparently v7 ended up in a weird base64 that would not easily git-am.
Resending.
----
hi,
yet another take for this patch series; please kindly consider these for 4.1
Just a few cosmetic comments were received for v6 so this is mostly
a rebase+ping.
new in v7:
- general rebase
- since clauses -> 4.1
- patch 8: not completely trivial rebase: raw_account_discard moved to
common raw_do_pdiscard()
- patch 9: comment wording fixed
v6: http://lists.nongnu.org/archive/html/qemu-devel/2018-11/msg06633.html
v5: http://lists.nongnu.org/archive/html/qemu-devel/2018-10/msg06828.html
v4: http://lists.nongnu.org/archive/html/qemu-devel/2018-08/msg04308.html
v3: http://lists.nongnu.org/archive/html/qemu-devel/2018-06/msg03688.html
----
qmp query-blockstats provides stats info for write/read/flush ops.
Patches 1-7 implement the similar for discard (unmap) command for scsi
and ide disks.
Discard stat "unmap_ops / unmap_bytes" is supposed to account the ops that
have completed without an error.
However, discard operation is advisory. Specifically,
- common block layer ignores ENOTSUP error code.
That might be returned if the block driver does not support discard,
or discard has been configured to be ignored.
- format drivers such as qcow2 may ignore discard if they were configured
to ignore that, or if the corresponding area is already marked unused
(unallocated / zero clusters).
And what is actually useful is the number of bytes actually discarded
down on the host filesystem.
To achieve that, driver-specific statistics has been added to blockstats
(patch 9).
With patch 8, file-posix driver accounts discard operations on its level too.
query-blockstat result:
(note the difference between blockdevice unmap and file discard stats. qcow2
sends fewer ops down to the file as the clusters are actually unallocated
on qcow2 level)
{
"device": "drive-scsi0-0-0-0",
"node-name": "#block159",
"stats": {
> "invalid_unmap_operations": 0,
> "failed_unmap_operations": 0,
"wr_highest_offset": 13411688448,
"rd_total_time_ns": 2859566315,
"rd_bytes": 103182336,
"rd_merged": 0,
"flush_operations": 19,
"invalid_wr_operations": 0,
"flush_total_time_ns": 23111608,
"failed_rd_operations": 0,
"failed_flush_operations": 0,
"invalid_flush_operations": 0,
"timed_stats": [
],
"wr_merged": 0,
"wr_bytes": 1702912,
> "unmap_bytes": 11954954240,
> "unmap_operations": 865,
"idle_time_ns": 2669508623,
"account_invalid": true,
> "unmap_total_time_ns": 19698002,
"wr_operations": 143,
"failed_wr_operations": 0,
"rd_operations": 4816,
"account_failed": true,
> "unmap_merged": 0,
"wr_total_time_ns": 1262686124,
"invalid_rd_operations": 0
},
"parent": {
> "driver-specific": {
> "discard-nb-failed": 0,
> "discard-bytes-ok": 720896,
> "driver": "file",
> "discard-nb-ok": 8
> },
"node-name": "#block009",
"stats": {
[..]
}
}
},
{
"device": "floppy0",
Anton Nefedov (9):
qapi: group BlockDeviceStats fields
qapi: add unmap to BlockDeviceStats
block: add empty account cookie type
ide: account UNMAP (TRIM) operations
scsi: store unmap offset and nb_sectors in request struct
scsi: move unmap error checking to the complete callback
scsi: account unmap operations
file-posix: account discard operations
qapi: query-blockstat: add driver specific file-posix stats
qapi/block-core.json | 81 ++++++++++++++++++++++++++++++++------
include/block/accounting.h | 2 +
include/block/block.h | 1 +
include/block/block_int.h | 1 +
block.c | 9 +++++
block/accounting.c | 6 +++
block/file-posix.c | 54 ++++++++++++++++++++++++-
block/qapi.c | 11 ++++++
hw/ide/core.c | 12 ++++++
hw/scsi/scsi-disk.c | 32 +++++++++------
tests/qemu-iotests/227.out | 18 +++++++++
11 files changed, 204 insertions(+), 23 deletions(-)
--
2.17.1
next reply other threads:[~2019-05-16 14:43 UTC|newest]
Thread overview: 21+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-05-16 14:33 Anton Nefedov [this message]
2019-05-16 14:33 ` [Qemu-devel] [PATCH v8 1/9] qapi: group BlockDeviceStats fields Anton Nefedov
2019-05-16 14:33 ` [Qemu-devel] [PATCH v8 2/9] qapi: add unmap to BlockDeviceStats Anton Nefedov
2019-05-16 14:33 ` [Qemu-devel] [PATCH v8 3/9] block: add empty account cookie type Anton Nefedov
2019-05-16 15:34 ` Vladimir Sementsov-Ogievskiy
2019-05-16 16:00 ` Anton Nefedov
2019-05-16 14:33 ` [Qemu-devel] [PATCH v8 4/9] ide: account UNMAP (TRIM) operations Anton Nefedov
2019-08-12 18:16 ` Max Reitz
2019-08-21 11:06 ` Anton Nefedov
2019-05-16 14:33 ` [Qemu-devel] [PATCH v8 5/9] scsi: store unmap offset and nb_sectors in request struct Anton Nefedov
2019-08-12 17:58 ` Max Reitz
2019-08-21 11:03 ` Anton Nefedov
2019-05-16 14:33 ` [Qemu-devel] [PATCH v8 6/9] scsi: move unmap error checking to the complete callback Anton Nefedov
2019-05-16 14:33 ` [Qemu-devel] [PATCH v8 7/9] scsi: account unmap operations Anton Nefedov
2019-05-16 14:33 ` [Qemu-devel] [PATCH v8 8/9] file-posix: account discard operations Anton Nefedov
2019-05-16 15:23 ` Vladimir Sementsov-Ogievskiy
2019-05-16 14:33 ` [Qemu-devel] [PATCH v8 9/9] qapi: query-blockstat: add driver specific file-posix stats Anton Nefedov
2019-08-12 19:04 ` Max Reitz
2019-08-21 11:00 ` Anton Nefedov
2019-08-21 11:21 ` Max Reitz
2019-08-21 12:22 ` Anton Nefedov
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20190516143314.81302-1-anton.nefedov@virtuozzo.com \
--to=anton.nefedov@virtuozzo.com \
--cc=berto@igalia.com \
--cc=den@virtuozzo.com \
--cc=jsnow@redhat.com \
--cc=kwolf@redhat.com \
--cc=mreitz@redhat.com \
--cc=pbonzini@redhat.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
--cc=vsementsov@virtuozzo.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.