From: "Aneesh Kumar K.V" <aneesh.kumar@linux.vnet.ibm.com> To: "Kirill A. Shutemov" <kirill@shutemov.name>, Matthew Wilcox <willy@linux.intel.com> Cc: "Kirill A. Shutemov" <kirill.shutemov@linux.intel.com>, Hugh Dickins <hughd@google.com>, Andrea Arcangeli <aarcange@redhat.com>, Andrew Morton <akpm@linux-foundation.org>, Dave Hansen <dave.hansen@intel.com>, Vlastimil Babka <vbabka@suse.cz>, Christoph Lameter <cl@gentwo.org>, Naoya Horiguchi <n-horiguchi@ah.jp.nec.com>, Jerome Marchand <jmarchan@redhat.com>, Yang Shi <yang.shi@linaro.org>, Sasha Levin <sasha.levin@oracle.com>, linux-kernel@vger.kernel.org, linux-mm@kvack.org, linux-fsdevel@vger.kernel.org Subject: Re: [PATCHv4 08/25] thp: support file pages in zap_huge_pmd() Date: Mon, 21 Mar 2016 22:12:00 +0530 [thread overview] Message-ID: <87vb4fu6jr.fsf@linux.vnet.ibm.com> (raw) In-Reply-To: <20160321143900.GA12917@node.shutemov.name> "Kirill A. Shutemov" <kirill@shutemov.name> writes: > [ text/plain ] > On Mon, Mar 21, 2016 at 10:03:29AM +0530, Aneesh Kumar K.V wrote: >> "Kirill A. Shutemov" <kirill@shutemov.name> writes: >> >> > [ text/plain ] >> > On Fri, Mar 18, 2016 at 07:23:41PM +0530, Aneesh Kumar K.V wrote: >> >> "Kirill A. Shutemov" <kirill.shutemov@linux.intel.com> writes: >> >> >> >> > [ text/plain ] >> >> > split_huge_pmd() for file mappings (and DAX too) is implemented by just >> >> > clearing pmd entry as we can re-fill this area from page cache on pte >> >> > level later. >> >> > >> >> > This means we don't need deposit page tables when file THP is mapped. >> >> > Therefore we shouldn't try to withdraw a page table on zap_huge_pmd() >> >> > file THP PMD. >> >> >> >> Archs like ppc64 use deposited page table to track the hardware page >> >> table slot information. We probably may want to add hooks which arch can >> >> use to achieve the same even with file THP >> > >> > Could you describe more on what kind of information you're talking about? >> > >> >> Hardware page table in ppc64 requires us to map each subpage of the huge >> page. This is needed because at low level we use segment base page size >> to find the hash slot and on TLB miss, we use the faulting address and >> base page size (which is 64k even with THP) to find whether we have >> the page mapped in hash page table. Since we use base page size of 64K, >> we need to make sure that subpages are mapped (on demand) in hash page >> table. If we have then mapped we also need to track their hash table >> slot information so that we can clear it on invalidate of hugepage. >> >> With THP we used the deposited page table to store the hash slot >> information. > > Could you prepare the patch with these hooks so we can discuss it details? > I still have hard time wrap my had around this. ok > > I think you have the same problem with DAX huge pages. Or you don't care > about DAX? > Yes, DAX hugepage will not be working on ppc64. It is there in the TODO list to get it working :). -aneesh
WARNING: multiple messages have this Message-ID (diff)
From: "Aneesh Kumar K.V" <aneesh.kumar@linux.vnet.ibm.com> To: "Kirill A. Shutemov" <kirill@shutemov.name>, Matthew Wilcox <willy@linux.intel.com> Cc: "Kirill A. Shutemov" <kirill.shutemov@linux.intel.com>, Hugh Dickins <hughd@google.com>, Andrea Arcangeli <aarcange@redhat.com>, Andrew Morton <akpm@linux-foundation.org>, Dave Hansen <dave.hansen@intel.com>, Vlastimil Babka <vbabka@suse.cz>, Christoph Lameter <cl@gentwo.org>, Naoya Horiguchi <n-horiguchi@ah.jp.nec.com>, Jerome Marchand <jmarchan@redhat.com>, Yang Shi <yang.shi@linaro.org>, Sasha Levin <sasha.levin@oracle.com>, linux-kernel@vger.kernel.org, linux-mm@kvack.org, linux-fsdevel@vger.kernel.org Subject: Re: [PATCHv4 08/25] thp: support file pages in zap_huge_pmd() Date: Mon, 21 Mar 2016 22:12:00 +0530 [thread overview] Message-ID: <87vb4fu6jr.fsf@linux.vnet.ibm.com> (raw) In-Reply-To: <20160321143900.GA12917@node.shutemov.name> "Kirill A. Shutemov" <kirill@shutemov.name> writes: > [ text/plain ] > On Mon, Mar 21, 2016 at 10:03:29AM +0530, Aneesh Kumar K.V wrote: >> "Kirill A. Shutemov" <kirill@shutemov.name> writes: >> >> > [ text/plain ] >> > On Fri, Mar 18, 2016 at 07:23:41PM +0530, Aneesh Kumar K.V wrote: >> >> "Kirill A. Shutemov" <kirill.shutemov@linux.intel.com> writes: >> >> >> >> > [ text/plain ] >> >> > split_huge_pmd() for file mappings (and DAX too) is implemented by just >> >> > clearing pmd entry as we can re-fill this area from page cache on pte >> >> > level later. >> >> > >> >> > This means we don't need deposit page tables when file THP is mapped. >> >> > Therefore we shouldn't try to withdraw a page table on zap_huge_pmd() >> >> > file THP PMD. >> >> >> >> Archs like ppc64 use deposited page table to track the hardware page >> >> table slot information. We probably may want to add hooks which arch can >> >> use to achieve the same even with file THP >> > >> > Could you describe more on what kind of information you're talking about? >> > >> >> Hardware page table in ppc64 requires us to map each subpage of the huge >> page. This is needed because at low level we use segment base page size >> to find the hash slot and on TLB miss, we use the faulting address and >> base page size (which is 64k even with THP) to find whether we have >> the page mapped in hash page table. Since we use base page size of 64K, >> we need to make sure that subpages are mapped (on demand) in hash page >> table. If we have then mapped we also need to track their hash table >> slot information so that we can clear it on invalidate of hugepage. >> >> With THP we used the deposited page table to store the hash slot >> information. > > Could you prepare the patch with these hooks so we can discuss it details? > I still have hard time wrap my had around this. ok > > I think you have the same problem with DAX huge pages. Or you don't care > about DAX? > Yes, DAX hugepage will not be working on ppc64. It is there in the TODO list to get it working :). -aneesh -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2016-03-21 16:42 UTC|newest] Thread overview: 88+ messages / expand[flat|nested] mbox.gz Atom feed top 2016-03-11 22:58 [PATCHv4 00/25] THP-enabled tmpfs/shmem Kirill A. Shutemov 2016-03-11 22:58 ` Kirill A. Shutemov 2016-03-11 22:58 ` [PATCHv4 01/25] mm: do not pass mm_struct into handle_mm_fault Kirill A. Shutemov 2016-03-11 22:58 ` Kirill A. Shutemov 2016-03-11 22:58 ` [PATCHv4 02/25] mm: introduce fault_env Kirill A. Shutemov 2016-03-11 22:58 ` Kirill A. Shutemov 2016-03-11 22:58 ` [PATCHv4 03/25] mm: postpone page table allocation until we have page to map Kirill A. Shutemov 2016-03-11 22:58 ` Kirill A. Shutemov 2016-03-11 22:58 ` [PATCHv4 04/25] rmap: support file thp Kirill A. Shutemov 2016-03-11 22:58 ` Kirill A. Shutemov 2016-03-18 9:40 ` Aneesh Kumar K.V 2016-03-18 9:40 ` Aneesh Kumar K.V 2016-03-18 9:40 ` Aneesh Kumar K.V 2016-03-19 1:01 ` Kirill A. Shutemov 2016-03-19 1:01 ` Kirill A. Shutemov 2016-03-11 22:58 ` [PATCHv4 05/25] mm: introduce do_set_pmd() Kirill A. Shutemov 2016-03-11 22:58 ` Kirill A. Shutemov 2016-03-11 22:58 ` [PATCHv4 06/25] mm, rmap: account file thp pages Kirill A. Shutemov 2016-03-11 22:58 ` Kirill A. Shutemov 2016-03-15 15:30 ` [PATCHv5 " Kirill A. Shutemov 2016-03-15 15:30 ` Kirill A. Shutemov 2016-03-11 22:58 ` [PATCHv4 07/25] thp, vmstats: add counters for huge file pages Kirill A. Shutemov 2016-03-11 22:58 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 08/25] thp: support file pages in zap_huge_pmd() Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-18 13:53 ` Aneesh Kumar K.V 2016-03-18 13:53 ` Aneesh Kumar K.V 2016-03-18 13:53 ` Aneesh Kumar K.V 2016-03-19 1:02 ` Kirill A. Shutemov 2016-03-19 1:02 ` Kirill A. Shutemov 2016-03-21 4:33 ` Aneesh Kumar K.V 2016-03-21 4:33 ` Aneesh Kumar K.V 2016-03-21 14:39 ` Kirill A. Shutemov 2016-03-21 14:39 ` Kirill A. Shutemov 2016-03-21 16:42 ` Aneesh Kumar K.V [this message] 2016-03-21 16:42 ` Aneesh Kumar K.V 2016-03-11 22:59 ` [PATCHv4 09/25] thp: handle file pages in split_huge_pmd() Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 10/25] thp: handle file COW faults Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 11/25] thp: handle file pages in mremap() Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 12/25] thp: skip file huge pmd on copy_huge_pmd() Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 13/25] thp: prepare change_huge_pmd() for file thp Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 14/25] thp: run vma_adjust_trans_huge() outside i_mmap_rwsem Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 15/25] thp: file pages support for split_huge_page() Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 16/25] thp, mlock: do not mlock PTE-mapped file huge pages Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 17/25] vmscan: split file huge pages before paging them out Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 18/25] page-flags: relax policy for PG_mappedtodisk and PG_reclaim Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 19/25] radix-tree: implement radix_tree_maybe_preload_order() Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 20/25] filemap: prepare find and delete operations for huge pages Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 21/25] truncate: handle file thp Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 22/25] shmem: prepare huge= mount option and sysfs knob Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 23/25] shmem: get_unmapped_area align huge page Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 24/25] shmem: add huge pages support Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-11 22:59 ` [PATCHv4 25/25] shmem, thp: respect MADV_{NO,}HUGEPAGE for file mappings Kirill A. Shutemov 2016-03-11 22:59 ` Kirill A. Shutemov 2016-03-15 15:52 ` [PATCHv5 26/25] thp: update Documentation/vm/transhuge.txt Kirill A. Shutemov 2016-03-15 15:52 ` Kirill A. Shutemov 2016-03-23 20:09 ` [PATCHv4 00/25] THP-enabled tmpfs/shmem Hugh Dickins 2016-03-23 20:09 ` Hugh Dickins 2016-03-24 9:17 ` Kirill A. Shutemov 2016-03-24 9:17 ` Kirill A. Shutemov 2016-03-24 19:08 ` Hugh Dickins 2016-03-24 19:08 ` Hugh Dickins 2016-03-25 15:04 ` Kirill A. Shutemov 2016-03-25 15:04 ` Kirill A. Shutemov 2016-03-26 0:00 ` Hugh Dickins 2016-03-26 0:00 ` Hugh Dickins 2016-03-28 18:00 ` Kirill A. Shutemov 2016-03-28 18:00 ` Kirill A. Shutemov 2016-03-28 18:42 ` Hugh Dickins 2016-03-28 18:42 ` Hugh Dickins 2016-03-28 12:29 ` Kirill A. Shutemov 2016-03-28 12:29 ` Kirill A. Shutemov
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=87vb4fu6jr.fsf@linux.vnet.ibm.com \ --to=aneesh.kumar@linux.vnet.ibm.com \ --cc=aarcange@redhat.com \ --cc=akpm@linux-foundation.org \ --cc=cl@gentwo.org \ --cc=dave.hansen@intel.com \ --cc=hughd@google.com \ --cc=jmarchan@redhat.com \ --cc=kirill.shutemov@linux.intel.com \ --cc=kirill@shutemov.name \ --cc=linux-fsdevel@vger.kernel.org \ --cc=linux-kernel@vger.kernel.org \ --cc=linux-mm@kvack.org \ --cc=n-horiguchi@ah.jp.nec.com \ --cc=sasha.levin@oracle.com \ --cc=vbabka@suse.cz \ --cc=willy@linux.intel.com \ --cc=yang.shi@linaro.org \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: linkBe sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.