From: Vivek Kasireddy <vivek.kasireddy@intel.com>
To: dri-devel@lists.freedesktop.org, linux-mm@kvack.org
Cc: Vivek Kasireddy <vivek.kasireddy@intel.com>,
David Hildenbrand <david@redhat.com>,
Matthew Wilcox <willy@infradead.org>,
Christoph Hellwig <hch@infradead.org>,
Daniel Vetter <daniel.vetter@ffwll.ch>,
Mike Kravetz <mike.kravetz@oracle.com>,
Hugh Dickins <hughd@google.com>, Peter Xu <peterx@redhat.com>,
Jason Gunthorpe <jgg@nvidia.com>,
Gerd Hoffmann <kraxel@redhat.com>,
Dongwon Kim <dongwon.kim@intel.com>,
Junxiao Chang <junxiao.chang@intel.com>
Subject: [PATCH v9 0/6] mm/gup: Introduce memfd_pin_folios() for pinning memfd folios (v9)
Date: Tue, 26 Dec 2023 23:38:16 -0800 [thread overview]
Message-ID: <20231227073822.390518-1-vivek.kasireddy@intel.com> (raw)
The first two patches were previously reviewed but not yet merged.
These ones need to be merged first as the fourth patch depends on
the changes introduced in them and they also fix bugs seen in
very specific scenarios (running Qemu with hugetlb=on, blob=true
and rebooting guest VM).
The third patch introduces memfd_pin_folios() API and the fourth
patch converts udmabuf driver to use folios. The fifth patch shows
how the udmabuf driver can make use of the new API to longterm-pin
the folios. The last patch adds two new udmabuf selftests to verify
data coherency after potential page migration.
v2:
- Updated the first patch to include review feedback from David and
Jason. The main change in this series is the allocation of page
in the case of hugetlbfs if it is not found in the page cache.
v3:
- Made changes to include review feedback from David to improve the
comments and readability of code
- Enclosed the hugepage alloc code with #ifdef CONFIG_HUGETLB_PAGE
v4:
- Augmented the commit message of the udmabuf patch that uses
pin_user_pages_fd()
- Added previously reviewed but unmerged udmabuf patches to this
series
v5:
- Updated the patch that adds pin_user_pages_fd() to include feedback
from David to handle simultaneous users trying to add a huge page
to the mapping
- Replaced find_get_page_flags() with __filemap_get_folio() in the
second and third patches to ensure that we only obtain head pages
from the mapping
v6: (Christoph)
- Renamed the new API to memfd_pin_user_pages()
- Improved the page cache lookup efficiency by using
filemap_get_folios_contig() which uses batches
v7:
- Rename the new API to memfd_pin_folios() and make it return folios
and offsets (David)
- Added a new preparatory patch to this series to convert udmabuf
driver to use folios
v8:
- Addressed review comments from Matthew in patches 4 and 5
- Included David's suggestions to have the caller of memfd_pin_folios()
pass a range [stard, end], max_folios instead of start, nr_pages
- Ensured that a folio is pinned and unpinned only once (David)
v9:
- Drop the extern and fix the return type in the declaration of
memfd_alloc_folio() (Matthew)
- Use a list to track the folios that need to be unpinned (patch 5)
This series is tested using following methods:
- Run the subtests added in the fifth patch
- Run Qemu (master) with the following options and a few additional
patches to Spice:
qemu-system-x86_64 -m 4096m....
-device virtio-gpu-pci,max_outputs=1,blob=true,xres=1920,yres=1080
-spice port=3001,gl=on,disable-ticketing=on,preferred-codec=gstreamer:h264
-object memory-backend-memfd,hugetlb=on,id=mem1,size=4096M
-machine memory-backend=mem1
Cc: David Hildenbrand <david@redhat.com>
Cc: Matthew Wilcox (Oracle) <willy@infradead.org>
Cc: Christoph Hellwig <hch@infradead.org>
Cc: Daniel Vetter <daniel.vetter@ffwll.ch>
Cc: Mike Kravetz <mike.kravetz@oracle.com>
Cc: Hugh Dickins <hughd@google.com>
Cc: Peter Xu <peterx@redhat.com>
Cc: Jason Gunthorpe <jgg@nvidia.com>
Cc: Gerd Hoffmann <kraxel@redhat.com>
Cc: Dongwon Kim <dongwon.kim@intel.com>
Cc: Junxiao Chang <junxiao.chang@intel.com>
Vivek Kasireddy (6):
udmabuf: Use vmf_insert_pfn and VM_PFNMAP for handling mmap
udmabuf: Add back support for mapping hugetlb pages (v6)
mm/gup: Introduce memfd_pin_folios() for pinning memfd folios (v9)
udmabuf: Convert udmabuf driver to use folios (v2)
udmabuf: Pin the pages using memfd_pin_folios() API (v7)
selftests/dma-buf/udmabuf: Add tests to verify data after page
migration
drivers/dma-buf/udmabuf.c | 231 +++++++++++++-----
include/linux/memfd.h | 5 +
include/linux/mm.h | 3 +
mm/gup.c | 149 +++++++++++
mm/memfd.c | 34 +++
.../selftests/drivers/dma-buf/udmabuf.c | 151 +++++++++++-
6 files changed, 509 insertions(+), 64 deletions(-)
--
2.39.2
next reply other threads:[~2023-12-27 8:02 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-12-27 7:38 Vivek Kasireddy [this message]
2023-12-27 7:38 ` [PATCH v9 1/6] udmabuf: Use vmf_insert_pfn and VM_PFNMAP for handling mmap Vivek Kasireddy
2023-12-27 7:38 ` [PATCH v9 2/6] udmabuf: Add back support for mapping hugetlb pages (v6) Vivek Kasireddy
2023-12-27 7:38 ` [PATCH v9 3/6] mm/gup: Introduce memfd_pin_folios() for pinning memfd folios (v9) Vivek Kasireddy
2023-12-27 7:38 ` [PATCH v9 4/6] udmabuf: Convert udmabuf driver to use folios (v2) Vivek Kasireddy
2023-12-27 7:38 ` [PATCH v9 5/6] udmabuf: Pin the pages using memfd_pin_folios() API (v7) Vivek Kasireddy
2023-12-27 7:38 ` [PATCH v9 6/6] selftests/dma-buf/udmabuf: Add tests to verify data after page migration Vivek Kasireddy
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20231227073822.390518-1-vivek.kasireddy@intel.com \
--to=vivek.kasireddy@intel.com \
--cc=daniel.vetter@ffwll.ch \
--cc=david@redhat.com \
--cc=dongwon.kim@intel.com \
--cc=dri-devel@lists.freedesktop.org \
--cc=hch@infradead.org \
--cc=hughd@google.com \
--cc=jgg@nvidia.com \
--cc=junxiao.chang@intel.com \
--cc=kraxel@redhat.com \
--cc=linux-mm@kvack.org \
--cc=mike.kravetz@oracle.com \
--cc=peterx@redhat.com \
--cc=willy@infradead.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).