From: Al Viro <viro@ZenIV.linux.org.uk>
To: Christoph Hellwig <hch@lst.de>
Cc: Avi Kivity <avi@scylladb.com>,
linux-aio@kvack.org, linux-fsdevel@vger.kernel.org,
linux-api@vger.kernel.org, linux-kernel@vger.kernel.org
Subject: Re: io_pgetevents & aio fsync V2
Date: Fri, 6 Apr 2018 04:16:30 +0100 [thread overview]
Message-ID: <20180406031630.GU30522@ZenIV.linux.org.uk> (raw)
In-Reply-To: <20180328072639.16885-1-hch@lst.de>
On Wed, Mar 28, 2018 at 09:26:33AM +0200, Christoph Hellwig wrote:
> Hi all,
>
> this patch adds workqueue based fsync offload. Version of this
> patch have been floating around for a couple years, but we now
> have a user with seastar used by ScyllaDB (who sponsored this
> work) that really wants this in addition to the aio poll support.
> More details are in the patch itself.
>
> Because the iocb types have been defined sine day one (and probably
> were supported by RHEL3) libaio already supports these calls as-is.
>
> This also pulls in the aio cleanups and io_pgetevents support previously
> submitted and review as part of the aio poll series. The aio poll
> series will be resubmitted on top of this series
BTW, this is only tangentially related, but... does *anything* call
io_submit() for huge amounts of iocb? Check in do_io_submit() is
insane - "no more than MAX_LONG total of _pointers_". Compat variant
goes for "no more than a page worth of pointers" and there's
a hard limit in ioctx_alloc() - we can't ever get more than
8M slots in ring buffer...
WARNING: multiple messages have this Message-ID (diff)
From: Al Viro <viro@ZenIV.linux.org.uk>
To: Christoph Hellwig <hch@lst.de>
Cc: Avi Kivity <avi@scylladb.com>,
linux-aio@kvack.org, linux-fsdevel@vger.kernel.org,
linux-api@vger.kernel.org, linux-kernel@vger.kernel.org
Subject: Re: io_pgetevents & aio fsync V2
Date: Fri, 6 Apr 2018 04:16:30 +0100 [thread overview]
Message-ID: <20180406031630.GU30522@ZenIV.linux.org.uk> (raw)
In-Reply-To: <20180328072639.16885-1-hch@lst.de>
On Wed, Mar 28, 2018 at 09:26:33AM +0200, Christoph Hellwig wrote:
> Hi all,
>
> this patch adds workqueue based fsync offload. Version of this
> patch have been floating around for a couple years, but we now
> have a user with seastar used by ScyllaDB (who sponsored this
> work) that really wants this in addition to the aio poll support.
> More details are in the patch itself.
>
> Because the iocb types have been defined sine day one (and probably
> were supported by RHEL3) libaio already supports these calls as-is.
>
> This also pulls in the aio cleanups and io_pgetevents support previously
> submitted and review as part of the aio poll series. The aio poll
> series will be resubmitted on top of this series
BTW, this is only tangentially related, but... does *anything* call
io_submit() for huge amounts of iocb? Check in do_io_submit() is
insane - "no more than MAX_LONG total of _pointers_". Compat variant
goes for "no more than a page worth of pointers" and there's
a hard limit in ioctx_alloc() - we can't ever get more than
8M slots in ring buffer...
--
To unsubscribe, send a message with 'unsubscribe linux-aio' in
the body to majordomo@kvack.org. For more info on Linux AIO,
see: http://www.kvack.org/aio/
Don't email: <a href=mailto:"aart@kvack.org">aart@kvack.org</a>
next prev parent reply other threads:[~2018-04-06 3:16 UTC|newest]
Thread overview: 32+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-03-28 7:26 io_pgetevents & aio fsync V2 Christoph Hellwig
2018-03-28 7:26 ` Christoph Hellwig
2018-03-28 7:26 ` [PATCH 1/6] aio: don't print the page size at boot time Christoph Hellwig
2018-03-28 7:26 ` Christoph Hellwig
2018-03-28 7:26 ` [PATCH 2/6] aio: remove an outdated comment in aio_complete Christoph Hellwig
2018-03-28 7:26 ` Christoph Hellwig
2018-03-28 16:05 ` Darrick J. Wong
2018-03-28 16:05 ` Darrick J. Wong
2018-03-28 17:05 ` Matthew Wilcox
2018-03-28 17:05 ` Matthew Wilcox
2018-03-28 7:26 ` [PATCH 3/6] aio: refactor read/write iocb setup Christoph Hellwig
2018-03-28 7:26 ` Christoph Hellwig
2018-04-06 3:21 ` Al Viro
2018-04-06 3:21 ` Al Viro
2018-04-06 7:10 ` Christoph Hellwig
2018-04-06 7:10 ` Christoph Hellwig
2018-04-06 12:28 ` Al Viro
2018-04-06 12:28 ` Al Viro
2018-03-28 7:26 ` [PATCH 4/6] aio: sanitize ki_list handling Christoph Hellwig
2018-03-28 7:26 ` Christoph Hellwig
2018-03-28 7:26 ` [PATCH 5/6] aio: implement IOCB_CMD_FSYNC and IOCB_CMD_FDSYNC Christoph Hellwig
2018-03-28 7:26 ` Christoph Hellwig
2018-04-06 2:59 ` Al Viro
2018-04-06 2:59 ` Al Viro
2018-03-28 7:26 ` [PATCH 6/6] aio: implement io_pgetevents Christoph Hellwig
2018-03-28 7:26 ` Christoph Hellwig
2018-04-06 3:16 ` Al Viro [this message]
2018-04-06 3:16 ` io_pgetevents & aio fsync V2 Al Viro
2018-04-06 6:27 ` Christoph Hellwig
2018-04-06 6:27 ` Christoph Hellwig
2018-04-06 12:57 ` Jeff Moyer
2018-04-06 12:57 ` Jeff Moyer
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20180406031630.GU30522@ZenIV.linux.org.uk \
--to=viro@zeniv.linux.org.uk \
--cc=avi@scylladb.com \
--cc=hch@lst.de \
--cc=linux-aio@kvack.org \
--cc=linux-api@vger.kernel.org \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.