From: Amir Goldstein <firstname.lastname@example.org> To: Jan Kara <email@example.com> Cc: Dave Chinner <firstname.lastname@example.org>, "Darrick J . Wong" <email@example.com>, Christoph Hellwig <firstname.lastname@example.org>, Matthew Wilcox <email@example.com>, linux-xfs <firstname.lastname@example.org>, linux-fsdevel <email@example.com>, Ext4 <firstname.lastname@example.org>, Lukas Czerner <email@example.com>, Theodore Tso <firstname.lastname@example.org> Subject: Re: [POC][PATCH] xfs: reduce ilock contention on buffered randrw workload Date: Mon, 8 Apr 2019 20:41:09 +0300 [thread overview] Message-ID: <CAOQ4uxhxgYASST1k-UaqfbLL9ERquHaKL2jtydB2+iF9aT8SRQ@mail.gmail.com> (raw) In-Reply-To: <20190408141114.GC15023@quack2.suse.cz> On Mon, Apr 8, 2019 at 5:11 PM Jan Kara <email@example.com> wrote: > > On Mon 08-04-19 12:02:34, Amir Goldstein wrote: > > On Mon, Apr 8, 2019 at 2:27 AM Dave Chinner <firstname.lastname@example.org> wrote: > > > > > > On Fri, Apr 05, 2019 at 05:02:33PM +0300, Amir Goldstein wrote: > > > > On Fri, Apr 5, 2019 at 12:17 AM Dave Chinner <email@example.com> wrote: > > > > > > > > > > On Thu, Apr 04, 2019 at 07:57:37PM +0300, Amir Goldstein wrote: > > > > > > This patch improves performance of mixed random rw workload > > > > > > on xfs without relaxing the atomic buffered read/write guaranty > > > > > > that xfs has always provided. > > > > > > > > > > > > We achieve that by calling generic_file_read_iter() twice. > > > > > > Once with a discard iterator to warm up page cache before taking > > > > > > the shared ilock and once again under shared ilock. > > > > > > > > > > This will race with thing like truncate, hole punching, etc that > > > > > serialise IO and invalidate the page cache for data integrity > > > > > reasons under the IOLOCK. These rely on there being no IO to the > > > > > inode in progress at all to work correctly, which this patch > > > > > violates. IOWs, while this is fast, it is not safe and so not a > > > > > viable approach to solving the problem. > > > > > > > > > > > > > This statement leaves me wondering, if ext4 does not takes > > > > i_rwsem on generic_file_read_iter(), how does ext4 (or any other > > > > fs for that matter) guaranty buffered read synchronization with > > > > truncate, hole punching etc? > > > > The answer in ext4 case is i_mmap_sem, which is read locked > > > > in the page fault handler. > > > > > > Nope, the i_mmap_sem is for serialisation of /page faults/ against > > > truncate, holepunching, etc. Completely irrelevant to the read() > > > path. > > > > > > > I'm at lost here. Why are page faults completely irrelevant to read() > > path? Aren't full pages supposed to be faulted in on read() after > > truncate_pagecache_range()? > > During read(2), pages are not "faulted in". Just look at > what generic_file_buffered_read() does. It uses completely separate code to > add page to page cache, trigger readahead, and possibly call ->readpage() to > fill the page with data. "fault" path (handled by filemap_fault()) applies > only to accesses from userspace to mmaps. > Oh! thanks for fixing my blind spot. So if you agree with Dave that ext4, and who knows what other fs, are vulnerable to populating page cache with stale "uptodate" data, then it seems to me that also xfs is vulnerable via readahead(2) and posix_fadvise(). Mind you, I recently added an fadvise f_op, so it could be used by xfs to synchronize with IOLOCK. Perhaps a better solution would be for truncate_pagecache_range() to leave zeroed or Unwritten (i.e. lazy zeroed by read) pages in page cache. When we have shared pages for files, these pages could be deduped. Thanks, Amir.
next prev parent reply other threads:[~2019-04-08 17:41 UTC|newest] Thread overview: 19+ messages / expand[flat|nested] mbox.gz Atom feed top 2019-04-04 16:57 Amir Goldstein 2019-04-04 21:17 ` Dave Chinner 2019-04-05 14:02 ` Amir Goldstein 2019-04-07 23:27 ` Dave Chinner 2019-04-08 9:02 ` Amir Goldstein 2019-04-08 14:11 ` Jan Kara 2019-04-08 17:41 ` Amir Goldstein [this message] 2019-04-09 8:26 ` Jan Kara 2019-04-08 11:03 ` Jan Kara 2019-04-22 10:55 ` Boaz Harrosh 2019-04-08 10:33 ` Jan Kara 2019-04-08 16:37 ` Davidlohr Bueso 2019-04-11 1:11 ` Dave Chinner 2019-04-16 12:22 ` Dave Chinner 2019-04-18 3:10 ` Dave Chinner 2019-04-18 18:21 ` Davidlohr Bueso 2019-04-20 23:54 ` Dave Chinner 2019-05-03 4:17 ` Dave Chinner 2019-05-03 5:17 ` Dave Chinner
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=CAOQ4uxhxgYASST1k-UaqfbLL9ERquHaKL2jtydB2+iF9aT8SRQ@mail.gmail.com \ --firstname.lastname@example.org \ --email@example.com \ --firstname.lastname@example.org \ --email@example.com \ --firstname.lastname@example.org \ --email@example.com \ --firstname.lastname@example.org \ --email@example.com \ --firstname.lastname@example.org \ --email@example.com \ --firstname.lastname@example.org \ --subject='Re: [POC][PATCH] xfs: reduce ilock contention on buffered randrw workload' \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).