From: Jan Kara <email@example.com> To: Ian Abbott <firstname.lastname@example.org> Cc: Jan Kara <email@example.com>, Ian Abbott <firstname.lastname@example.org>, lkml <email@example.com>, "firstname.lastname@example.org" <email@example.com> Subject: Re: [PATCH v3] UDF: Add support for O_DIRECT Date: Wed, 5 Sep 2012 14:05:20 +0200 [thread overview] Message-ID: <20120905120520.GA18051@quack.suse.cz> (raw) In-Reply-To: <50461A24.firstname.lastname@example.org> On Tue 04-09-12 16:11:32, Ian Abbott wrote: > On 2012-09-04 15:39, Jan Kara wrote: > > Hello, > > > > first, you have my address wrong (you had suze instead of suse) which is > >why I wasn't getting your email and not replying (missed the patch in LKML > >traffic). Second, it's good to CC also linux-fsdevel for UDF related > >matters (I tend to use that for UDF announcements etc. so people caring > >about UDF can watch there and don't have to read high-volume LKML). > > Oops, sorry about the misspelling. Also, I've noted the > linux-fsdevel for future (I was just following what it said in > MAINTAINERS). I see. Actually I thought linux-fsdevel is inherited from the default of fs/ directory. But now I tried get_maintainer.pl script and I can see that it's not. I'll update MAINTAINERS. > >On Tue 04-09-12 10:49:39, Ian Abbott wrote: > >>Add support for the O_DIRECT flag. There are two cases to deal with: > > Out of curiosity, do you have a use for this feature or is it mostly > >academic interest? > > I'm planning to use it for an embedded project that needs to stream > large files off a CompactFlash card, but the data doesn't need to be > in the buffer cache as its only read once, and the system has very > limited memory bandwidth so I can't afford the the extra copy. The > old version of this project only supported FAT, but that limited the > file size to about 4GiB. The filesystem needs to be something > reasonably Windows-friendly, at least for adding the files to the > CompactFlash card in the first place. OK, that sounds reasonably. > >>1. Small files stored in the ICB (inode control block?): just return 0 > >>from the new udf_adinicb_direct_IO() handler to fall back to buffered > >>I/O. For direct writes, there is a "gotcha" to deal with when > >>generic_file_direct_write() in mm/filemap.c invalidates the pages. In > >>the udf_adinicb_writepage() handler, only part of the page data will be > >>valid and the rest will be zeroed out, so only copy the valid part into > >>the ICB. (This is actually a bit inefficient as udf_adinicb_write_end() > >>will have already copied the data into the ICB once, but it's pretty > >>likely that the file will grow to the point where its data can no longer > >>be stored in the ICB and will be moved to a different area of the file > >>system. At that point, a different direct_IO handler will be used - see > >>below.) > > Sorry, I didn't quite get this. What is the problem with copying all the > >data to inode in udf_adinicb_writepage() as it is now? > > Part of the good data in the ICB outside the range being addressed > would get overwritten by zeroes. This can be tested by creating a > UDF filesystem with 4KiB blocks and with small files stored in the > ICB, backed by a block device with 512 byte sectors. Create a 2KiB > file with random (or non-zero) data on the file system so that its > data gets stored in the ICB. Then open the file for writing without > truncation and with the O_DIRECT flag set, write 512 bytes at some > 512 byte offset within the 2KiB file and close it. If you then > hexdump the file, you'll find some of the old random data has been > zeroed out. But don't you fall back to buffered IO for files in ICB? So then no zeroing should happen? Honza -- Jan Kara <email@example.com> SUSE Labs, CR
next prev parent reply other threads:[~2012-09-05 12:05 UTC|newest] Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top 2012-07-24 12:17 [PATCH] " Ian Abbott 2012-07-31 10:40 ` [PATCH v2] " Ian Abbott 2012-09-04 9:49 ` [PATCH v3] " Ian Abbott 2012-09-04 14:39 ` Jan Kara 2012-09-04 15:11 ` Ian Abbott 2012-09-05 9:03 ` Ian Abbott 2012-09-05 12:05 ` Jan Kara [this message] 2012-09-05 12:55 ` Jan Kara 2012-09-05 16:00 ` Jan Kara 2012-09-05 16:44 ` [PATCH v4] " Ian Abbott 2012-09-05 19:02 ` Jan Kara 2012-09-06 10:08 ` [PATCH] UDF: Fix incorrect error handling in udf_direct_IO() Ian Abbott 2012-09-06 14:22 ` Jan Kara
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=20120905120520.GA18051@quack.suse.cz \ --firstname.lastname@example.org \ --email@example.com \ --firstname.lastname@example.org \ --email@example.com \ --firstname.lastname@example.org \ --subject='Re: [PATCH v3] UDF: Add support for O_DIRECT' \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).