From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Date: Mon, 10 Dec 2018 11:28:46 +0100 From: Jan Kara To: Jerome Glisse Cc: John Hubbard , Matthew Wilcox , Dan Williams , John Hubbard , Andrew Morton , Linux MM , Jan Kara , tom@talpey.com, Al Viro , benve@cisco.com, Christoph Hellwig , Christopher Lameter , "Dalessandro, Dennis" , Doug Ledford , Jason Gunthorpe , Michal Hocko , mike.marciniszyn@intel.com, rcampbell@nvidia.com, Linux Kernel Mailing List , linux-fsdevel Subject: Re: [PATCH 1/2] mm: introduce put_user_page*(), placeholder versions Message-ID: <20181210102846.GC29289@quack2.suse.cz> References: <3c91d335-921c-4704-d159-2975ff3a5f20@nvidia.com> <20181205011519.GV10377@bombadil.infradead.org> <20181205014441.GA3045@redhat.com> <59ca5c4b-fd5b-1fc6-f891-c7986d91908e@nvidia.com> <7b4733be-13d3-c790-ff1b-ac51b505e9a6@nvidia.com> <20181207191620.GD3293@redhat.com> <3c4d46c0-aced-f96f-1bf3-725d02f11b60@nvidia.com> <20181208022445.GA7024@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181208022445.GA7024@redhat.com> Sender: owner-linux-mm@kvack.org List-ID: On Fri 07-12-18 21:24:46, Jerome Glisse wrote: > Another crazy idea, why not treating GUP as another mapping of the page > and caller of GUP would have to provide either a fake anon_vma struct or > a fake vma struct (or both for PRIVATE mapping of a file where you can > have a mix of both private and file page thus only if it is a read only > GUP) that would get added to the list of existing mapping. > > So the flow would be: > somefunction_thatuse_gup() > { > ... > GUP(_fast)(vma, ..., fake_anon, fake_vma); > ... > } > > GUP(vma, ..., fake_anon, fake_vma) > { > if (vma->flags == ANON) { > // Add the fake anon vma to the anon vma chain as a child > // of current vma > } else { > // Add the fake vma to the mapping tree > } > > // The existing GUP except that now it inc mapcount and not > // refcount > GUP_old(..., &nanonymous, &nfiles); > > atomic_add(&fake_anon->refcount, nanonymous); > atomic_add(&fake_vma->refcount, nfiles); > > return nanonymous + nfiles; > } Thanks for your idea! This is actually something like I was suggesting back at LSF/MM in Deer Valley. There were two downsides to this I remember people pointing out: 1) This cannot really work with __get_user_pages_fast(). You're not allowed to get necessary locks to insert new entry into the VMA tree in that context. So essentially we'd loose get_user_pages_fast() functionality. 2) The overhead e.g. for direct IO may be noticeable. You need to allocate the fake tracking VMA, get VMA interval tree lock, insert into the tree. Then on IO completion you need to queue work to unpin the pages again as you cannot remove the fake VMA directly from interrupt context where the IO is completed. You are right that the cost could be amortized if gup() is called for multiple consecutive pages however for small IOs there's no help... So this approach doesn't look like a win to me over using counter in struct page and I'd rather try looking into squeezing HMM public page usage of struct page so that we can fit that gup counter there as well. I know that it may be easier said than done... Honza -- Jan Kara SUSE Labs, CR