From: Christoph Hellwig <hch@infradead.org>
To: Max Gurtovoy <mgurtovoy@nvidia.com>
Cc: Christoph Hellwig <hch@infradead.org>,
Chuck Lever III <chuck.lever@oracle.com>,
linux-rdma <linux-rdma@vger.kernel.org>,
"Kornievskaia, Olga" <Olga.Kornievskaia@netapp.com>
Subject: Re: IB_MR_TYPE_SG_GAPS support
Date: Mon, 30 Aug 2021 09:29:51 +0100 [thread overview]
Message-ID: <YSyW/3T4w6LfrDdZ@infradead.org> (raw)
In-Reply-To: <e271256b-0276-eba0-ede9-ecebf8bb56ce@nvidia.com>
On Sun, Aug 29, 2021 at 04:46:52PM +0300, Max Gurtovoy wrote:
> > > I have a report that net/sunrpc/xprtrdma/frwr_ops.c::frwr_map()
> > > is attempting to register a mix of GPU and CPU pages with a
> > > single MR during an NFSv4 READ.
> > What GPU pages?
>
> I guess it's GPU device memory.
>
> But as Jason mentioned, This is still not supported in RDMA. So there should
> be a bounce buffer in the IO path between GPU and CPU memory subsystems.
Well, the RDMA stack does support P2P pages, which can be exported by
GPUs. It also supports device private pages by migrating them back to
the CPU through hmm_range_fault. But none of this should require
SG_GAPS.
prev parent reply other threads:[~2021-08-30 8:30 UTC|newest]
Thread overview: 5+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-08-26 17:26 IB_MR_TYPE_SG_GAPS support Chuck Lever III
2021-08-26 23:45 ` Jason Gunthorpe
2021-08-27 6:27 ` Christoph Hellwig
2021-08-29 13:46 ` Max Gurtovoy
2021-08-30 8:29 ` Christoph Hellwig [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=YSyW/3T4w6LfrDdZ@infradead.org \
--to=hch@infradead.org \
--cc=Olga.Kornievskaia@netapp.com \
--cc=chuck.lever@oracle.com \
--cc=linux-rdma@vger.kernel.org \
--cc=mgurtovoy@nvidia.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).