All of lore.kernel.org
 help / color / mirror / Atom feed
From: Dan Williams <dan.j.williams@intel.com>
To: Matthew Wilcox <mawilcox@microsoft.com>
Cc: Ross Zwisler <ross.zwisler@linux.intel.com>,
	Theodore Ts'o <tytso@mit.edu>,
	Christoph Hellwig <hch@infradead.org>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	"linux-nvdimm@ml01.01.org" <linux-nvdimm@ml01.01.org>,
	Dave Chinner <david@fromorbit.com>,
	"linux-mm@kvack.org" <linux-mm@kvack.org>,
	Andreas Dilger <adilger.kernel@dilger.ca>,
	Alexander Viro <viro@zeniv.linux.org.uk>,
	Jan Kara <jack@suse.com>,
	"linux-fsdevel@vger.kernel.org" <linux-fsdevel@vger.kernel.org>,
	"linux-ext4@vger.kernel.org" <linux-ext4@vger.kernel.org>
Subject: Re: [PATCH v2 2/9] ext2: tell DAX the size of allocation holes
Date: Sat, 10 Sep 2016 07:56:43 -0700	[thread overview]
Message-ID: <CAPcyv4hKHen_YuY+vEqRocuaE11sptGWWF6kkX1nG8jptvRr+Q@mail.gmail.com> (raw)
In-Reply-To: <DM2PR21MB00899C835BC0AF476B6683CDCBFD0@DM2PR21MB0089.namprd21.prod.outlook.com>

On Sat, Sep 10, 2016 at 1:15 AM, Matthew Wilcox <mawilcox@microsoft.com> wrote:
> From: Dan Williams [mailto:dan.j.williams@intel.com]
>> /me grumbles about top-posting...
>
> Let's see if this does any better .. there's lots of new features, but I don't see a 'wrap lines at 80 columns' option.  Unfortunately.

Much appreciated.

[..]
>> So the current dax implementation is still struggling to get right (pmd faulting,
>> dirty entry cleaning, etc) and this seems like a rewrite that sets us up for future
>> features without addressing the current bugs and todo items.  In comparison
>> the iomap conversion work seems incremental and conserving of current
>> development momentum.
>
> I believe your assessment is incorrect.  If converting the current DAX code to
> use iomap forces converting ext2, then it's time to get rid of all the half-measures
> currently in place.  You left off one todo item that this does get us a step closer to
> fixing -- support for DMA to mmaped DAX files.

I didn't leave that off, DMA is solved with devm_memremap_pages().
Now, DMA without the ~1.6% capacity tax for the memmap array is
interesting, but that's a new feature.

> I think it also puts us in a better
> position to fix the 2MB support, locking, and dirtiness tracking.  Oh, and it does
> fix the multivolume support (because the sectors in the radix tree could be
> interpreted as being from the wrong volume).
>
>> I agree with you that continuing to touch ext2 is not a good idea, but I'm not
>> yet convinced that now is the time to go do dax-2.0 when we haven't finished
>> shipping dax-1.0.
>
> dax-1.0 died long ago ... I think we're up to at least DAX version 4 by now.

My point is that I want to address the current slate of problems
before solving new questions like "how do we support non-block based
filesystems?".  We just happened to land DAX in the middle of the
in-progress buffer_head removal effort, so DAX should not stand in the
way of where filesystems were already going.  I'm arguing to complete
all the false starts and half measures that are presently in DAX and
then look to incrementally evolve the interfaces to something new
without regressing any of it.

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Dan Williams <dan.j.williams@intel.com>
To: Matthew Wilcox <mawilcox@microsoft.com>
Cc: Ross Zwisler <ross.zwisler@linux.intel.com>,
	"Theodore Ts'o" <tytso@mit.edu>,
	Christoph Hellwig <hch@infradead.org>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	"linux-nvdimm@ml01.01.org" <linux-nvdimm@ml01.01.org>,
	Dave Chinner <david@fromorbit.com>,
	"linux-mm@kvack.org" <linux-mm@kvack.org>,
	Andreas Dilger <adilger.kernel@dilger.ca>,
	Alexander Viro <viro@zeniv.linux.org.uk>,
	Jan Kara <jack@suse.com>,
	"linux-fsdevel@vger.kernel.org" <linux-fsdevel@vger.kernel.org>,
	"linux-ext4@vger.kernel.org" <linux-ext4@vger.kernel.org>
Subject: Re: [PATCH v2 2/9] ext2: tell DAX the size of allocation holes
Date: Sat, 10 Sep 2016 07:56:43 -0700	[thread overview]
Message-ID: <CAPcyv4hKHen_YuY+vEqRocuaE11sptGWWF6kkX1nG8jptvRr+Q@mail.gmail.com> (raw)
In-Reply-To: <DM2PR21MB00899C835BC0AF476B6683CDCBFD0@DM2PR21MB0089.namprd21.prod.outlook.com>

On Sat, Sep 10, 2016 at 1:15 AM, Matthew Wilcox <mawilcox@microsoft.com> wrote:
> From: Dan Williams [mailto:dan.j.williams@intel.com]
>> /me grumbles about top-posting...
>
> Let's see if this does any better .. there's lots of new features, but I don't see a 'wrap lines at 80 columns' option.  Unfortunately.

Much appreciated.

[..]
>> So the current dax implementation is still struggling to get right (pmd faulting,
>> dirty entry cleaning, etc) and this seems like a rewrite that sets us up for future
>> features without addressing the current bugs and todo items.  In comparison
>> the iomap conversion work seems incremental and conserving of current
>> development momentum.
>
> I believe your assessment is incorrect.  If converting the current DAX code to
> use iomap forces converting ext2, then it's time to get rid of all the half-measures
> currently in place.  You left off one todo item that this does get us a step closer to
> fixing -- support for DMA to mmaped DAX files.

I didn't leave that off, DMA is solved with devm_memremap_pages().
Now, DMA without the ~1.6% capacity tax for the memmap array is
interesting, but that's a new feature.

> I think it also puts us in a better
> position to fix the 2MB support, locking, and dirtiness tracking.  Oh, and it does
> fix the multivolume support (because the sectors in the radix tree could be
> interpreted as being from the wrong volume).
>
>> I agree with you that continuing to touch ext2 is not a good idea, but I'm not
>> yet convinced that now is the time to go do dax-2.0 when we haven't finished
>> shipping dax-1.0.
>
> dax-1.0 died long ago ... I think we're up to at least DAX version 4 by now.

My point is that I want to address the current slate of problems
before solving new questions like "how do we support non-block based
filesystems?".  We just happened to land DAX in the middle of the
in-progress buffer_head removal effort, so DAX should not stand in the
way of where filesystems were already going.  I'm arguing to complete
all the false starts and half measures that are presently in DAX and
then look to incrementally evolve the interfaces to something new
without regressing any of it.

  reply	other threads:[~2016-09-10 14:56 UTC|newest]

Thread overview: 135+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-08-23 22:04 [PATCH v2 0/9] re-enable DAX PMD support Ross Zwisler
2016-08-23 22:04 ` Ross Zwisler
2016-08-23 22:04 ` Ross Zwisler
2016-08-23 22:04 ` Ross Zwisler
2016-08-23 22:04 ` [PATCH v2 1/9] ext4: allow DAX writeback for hole punch Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-09-21 15:22   ` Ross Zwisler
2016-09-21 15:22     ` Ross Zwisler
2016-09-21 15:22     ` Ross Zwisler
2016-09-21 15:22     ` Ross Zwisler
2016-09-21 15:22     ` Ross Zwisler
2016-09-22  6:59     ` Jan Kara
2016-09-22  6:59       ` Jan Kara
2016-09-22  6:59       ` Jan Kara
2016-09-22  6:59       ` Jan Kara
2016-09-22 15:51     ` Theodore Ts'o
2016-09-22 15:51       ` Theodore Ts'o
2016-08-23 22:04 ` [PATCH v2 2/9] ext2: tell DAX the size of allocation holes Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
     [not found]   ` <20160823220419.11717-3-ross.zwisler-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2016-08-25  7:57     ` Christoph Hellwig
2016-08-25  7:57       ` Christoph Hellwig
2016-08-25  7:57       ` Christoph Hellwig
     [not found]       ` <20160825075728.GA11235-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2016-08-25 19:25         ` Ross Zwisler
2016-08-25 19:25           ` Ross Zwisler
2016-08-25 19:25           ` Ross Zwisler
2016-08-26 21:29         ` Ross Zwisler
2016-08-26 21:29           ` Ross Zwisler
2016-08-26 21:29           ` Ross Zwisler
2016-08-29  0:42           ` Dave Chinner
2016-08-29  0:42             ` Dave Chinner
     [not found]           ` <20160826212934.GA11265-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2016-08-29  7:41             ` Christoph Hellwig
2016-08-29  7:41               ` Christoph Hellwig
2016-08-29  7:41               ` Christoph Hellwig
     [not found]               ` <20160829074116.GA16491-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2016-08-29 12:57                 ` Theodore Ts'o
2016-08-29 12:57                   ` Theodore Ts'o
2016-08-29 12:57                   ` Theodore Ts'o
     [not found]                   ` <20160829125741.cdnbb2uaditcmnw2-AKGzg7BKzIDYtjvyW6yDsg@public.gmane.org>
2016-08-30  7:21                     ` Christoph Hellwig
2016-08-30  7:21                       ` Christoph Hellwig
2016-08-30  7:21                       ` Christoph Hellwig
2016-09-09 16:48                     ` Ross Zwisler
2016-09-09 16:48                       ` Ross Zwisler
2016-09-09 16:48                       ` Ross Zwisler
2016-09-09 20:35                       ` Matthew Wilcox
2016-09-09 20:35                         ` Matthew Wilcox
     [not found]                         ` <DM2PR21MB0089BCA980B67D8C53B25A1BCBFA0-B2pw06WL+/BAVFCO9/lqPs1VXTxX1y3OvxpqHgZTriW3zl9H0oFU5g@public.gmane.org>
2016-09-09 22:34                           ` Dan Williams
2016-09-09 22:34                             ` Dan Williams
2016-09-09 22:34                             ` Dan Williams
     [not found]                             ` <CAPcyv4hjna08+Yw23w_V2f-RbBE6ar220+YGCuBVA-TACKWNug-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2016-09-10  7:31                               ` Christoph Hellwig
2016-09-10  7:31                                 ` Christoph Hellwig
2016-09-10  7:31                                 ` Christoph Hellwig
2016-09-10  7:50                                 ` Matthew Wilcox
2016-09-10  7:50                                   ` Matthew Wilcox
2016-09-10 17:49                                 ` Theodore Ts'o
2016-09-10 17:49                                   ` Theodore Ts'o
     [not found]                                   ` <20160910174910.yyirb7smiob7evt5-AKGzg7BKzIDYtjvyW6yDsg@public.gmane.org>
2016-09-11  0:42                                     ` Matthew Wilcox
2016-09-11  0:42                                       ` Matthew Wilcox
2016-09-11  0:42                                       ` Matthew Wilcox
2016-09-10  8:15                               ` Matthew Wilcox
2016-09-10  8:15                                 ` Matthew Wilcox
2016-09-10  8:15                                 ` Matthew Wilcox
2016-09-10 14:56                                 ` Dan Williams [this message]
2016-09-10 14:56                                   ` Dan Williams
2016-09-10  7:30                         ` Christoph Hellwig
2016-09-10  7:30                           ` Christoph Hellwig
2016-09-10  7:33                           ` Matthew Wilcox
2016-09-10  7:33                             ` Matthew Wilcox
2016-09-10  7:42                             ` Christoph Hellwig
2016-09-10  7:42                               ` Christoph Hellwig
2016-09-10  7:52                               ` Matthew Wilcox
2016-09-10  7:52                                 ` Matthew Wilcox
     [not found]                                 ` <DM2PR21MB0089C20EF469AA91A916867CCBFD0-B2pw06WL+/BAVFCO9/lqPs1VXTxX1y3OvxpqHgZTriW3zl9H0oFU5g@public.gmane.org>
2016-09-11 12:47                                   ` Christoph Hellwig
2016-09-11 12:47                                     ` Christoph Hellwig
2016-09-11 12:47                                     ` Christoph Hellwig
2016-09-11 22:57                                     ` Ross Zwisler
2016-09-11 22:57                                       ` Ross Zwisler
2016-09-10 15:55                           ` Matthew Wilcox
2016-09-10 15:55                             ` Matthew Wilcox
2016-09-15 20:09   ` Ross Zwisler
2016-09-15 20:09     ` Ross Zwisler
2016-09-15 20:09     ` Ross Zwisler
2016-08-23 22:04 ` [PATCH v2 3/9] ext4: " Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04 ` [PATCH v2 4/9] dax: remove buffer_size_valid() Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04 ` [PATCH v2 5/9] dax: make 'wait_table' global variable static Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04 ` [PATCH v2 6/9] dax: consistent variable naming for DAX entries Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04 ` [PATCH v2 7/9] dax: coordinate locking for offsets in PMD range Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04 ` [PATCH v2 8/9] dax: re-enable DAX PMD support Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04 ` [PATCH v2 9/9] dax: remove "depends on BROKEN" from FS_DAX_PMD Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-23 22:04   ` Ross Zwisler
2016-08-30 23:01 ` [PATCH v2 0/9] re-enable DAX PMD support Ross Zwisler
2016-08-30 23:01   ` Ross Zwisler
2016-08-30 23:01   ` Ross Zwisler
2016-08-30 23:01   ` Ross Zwisler
2016-08-31 20:20   ` Kani, Toshimitsu
2016-08-31 20:20     ` Kani, Toshimitsu
2016-08-31 20:20     ` Kani, Toshimitsu
2016-08-31 21:36     ` Ross Zwisler
2016-08-31 21:36       ` Ross Zwisler
2016-08-31 21:36       ` Ross Zwisler
2016-08-31 21:36       ` Ross Zwisler
2016-08-31 21:36       ` Ross Zwisler
2016-08-31 22:08       ` Kani, Toshimitsu
2016-08-31 22:08         ` Kani, Toshimitsu
2016-08-31 22:08         ` Kani, Toshimitsu
2016-08-31 22:08         ` Kani, Toshimitsu
2016-09-01 16:21         ` Ross Zwisler
2016-09-01 16:21           ` Ross Zwisler
2016-09-01 16:21           ` Ross Zwisler
2016-09-01 16:21           ` Ross Zwisler
2016-09-01 16:21           ` Ross Zwisler

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=CAPcyv4hKHen_YuY+vEqRocuaE11sptGWWF6kkX1nG8jptvRr+Q@mail.gmail.com \
    --to=dan.j.williams@intel.com \
    --cc=adilger.kernel@dilger.ca \
    --cc=akpm@linux-foundation.org \
    --cc=david@fromorbit.com \
    --cc=hch@infradead.org \
    --cc=jack@suse.com \
    --cc=linux-ext4@vger.kernel.org \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=linux-nvdimm@ml01.01.org \
    --cc=mawilcox@microsoft.com \
    --cc=ross.zwisler@linux.intel.com \
    --cc=tytso@mit.edu \
    --cc=viro@zeniv.linux.org.uk \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.