All of lore.kernel.org
 help / color / mirror / Atom feed
From: Pankaj Gupta <pagupta@redhat.com>
To: Rik van Riel <riel@redhat.com>
Cc: Kevin Wolf <kwolf@redhat.com>, Jan Kara <jack@suse.cz>,
	xiaoguangrong eric <xiaoguangrong.eric@gmail.com>,
	kvm-devel <kvm@vger.kernel.org>,
	Stefan Hajnoczi <stefanha@gmail.com>,
	Ross Zwisler <ross.zwisler@intel.com>,
	Qemu Developers <qemu-devel@nongnu.org>,
	Stefan Hajnoczi <stefanha@redhat.com>,
	"linux-nvdimm@lists.01.org" <linux-nvdimm@ml01.01.org>,
	Paolo Bonzini <pbonzini@redhat.com>,
	Nitesh Narayan Lal <nilal@redhat.com>
Subject: Re: KVM "fake DAX" flushing interface - discussion
Date: Wed, 26 Jul 2017 09:47:21 -0400 (EDT)	[thread overview]
Message-ID: <1063764405.34607875.1501076841865.JavaMail.zimbra@redhat.com> (raw)
In-Reply-To: <1501016375.26846.21.camel@redhat.com>


> 
> On Tue, 2017-07-25 at 07:46 -0700, Dan Williams wrote:
> > On Tue, Jul 25, 2017 at 7:27 AM, Pankaj Gupta <pagupta@redhat.com>
> > wrote:
> > > 
> > > Looks like only way to send flush(blk dev) from guest to host with
> > > nvdimm
> > > is using flush hint addresses. Is this the correct interface I am
> > > looking?
> > > 
> > > blkdev_issue_flush
> > >  submit_bio_wait
> > >   submit_bio
> > >     generic_make_request
> > >       pmem_make_request
> > >       ...
> > >            if (bio->bi_opf & REQ_FLUSH)
> > >                 nvdimm_flush(nd_region);
> > 
> > I would inject a paravirtualized version of pmem_make_request() that
> > sends an async flush operation over virtio to the host. Don't try to
> > use flush hint addresses for this, they don't have the proper
> > semantics. The guest should be allowed to issue the flush and receive
> > the completion asynchronously rather than taking a vm exist and
> > blocking on that request.
> 
> That is my feeling, too. A slower IO device benefits
> greatly from an asynchronous flush mechanism.

Thanks for all the suggestions!

Just want to summarize here(high level):

This will require implementing new 'virtio-pmem' device which presents 
a DAX address range(like pmem) to guest with read/write(direct access)
& device flush functionality. Also, qemu should implement corresponding
support for flush using virtio.

Thanks,
Pankaj
> 
> --
> All rights reversed
_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm

WARNING: multiple messages have this Message-ID (diff)
From: Pankaj Gupta <pagupta-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
To: Rik van Riel <riel-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
Cc: Kevin Wolf <kwolf-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>,
	Jan Kara <jack-AlSwsSmVLrQ@public.gmane.org>,
	xiaoguangrong eric
	<xiaoguangrong.eric-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>,
	kvm-devel <kvm-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
	Stefan Hajnoczi
	<stefanha-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>,
	Ross Zwisler
	<ross.zwisler-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org>,
	Qemu Developers
	<qemu-devel-qX2TKyscuCcdnm+yROfE0A@public.gmane.org>,
	Stefan Hajnoczi
	<stefanha-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>,
	"linux-nvdimm-hn68Rpc1hR1g9hUCZPvPmw@public.gmane.org"
	<linux-nvdimm-y27Ovi1pjclAfugRpC6u6w@public.gmane.org>,
	Paolo Bonzini <pbonzini-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>,
	Nitesh Narayan Lal
	<nilal-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
Subject: Re: KVM "fake DAX" flushing interface - discussion
Date: Wed, 26 Jul 2017 09:47:21 -0400 (EDT)	[thread overview]
Message-ID: <1063764405.34607875.1501076841865.JavaMail.zimbra@redhat.com> (raw)
In-Reply-To: <1501016375.26846.21.camel-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>


> 
> On Tue, 2017-07-25 at 07:46 -0700, Dan Williams wrote:
> > On Tue, Jul 25, 2017 at 7:27 AM, Pankaj Gupta <pagupta@redhat.com>
> > wrote:
> > > 
> > > Looks like only way to send flush(blk dev) from guest to host with
> > > nvdimm
> > > is using flush hint addresses. Is this the correct interface I am
> > > looking?
> > > 
> > > blkdev_issue_flush
> > >  submit_bio_wait
> > >   submit_bio
> > >     generic_make_request
> > >       pmem_make_request
> > >       ...
> > >            if (bio->bi_opf & REQ_FLUSH)
> > >                 nvdimm_flush(nd_region);
> > 
> > I would inject a paravirtualized version of pmem_make_request() that
> > sends an async flush operation over virtio to the host. Don't try to
> > use flush hint addresses for this, they don't have the proper
> > semantics. The guest should be allowed to issue the flush and receive
> > the completion asynchronously rather than taking a vm exist and
> > blocking on that request.
> 
> That is my feeling, too. A slower IO device benefits
> greatly from an asynchronous flush mechanism.

Thanks for all the suggestions!

Just want to summarize here(high level):

This will require implementing new 'virtio-pmem' device which presents 
a DAX address range(like pmem) to guest with read/write(direct access)
& device flush functionality. Also, qemu should implement corresponding
support for flush using virtio.

Thanks,
Pankaj
> 
> --
> All rights reversed
_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm

WARNING: multiple messages have this Message-ID (diff)
From: Pankaj Gupta <pagupta@redhat.com>
To: Rik van Riel <riel@redhat.com>
Cc: Dan Williams <dan.j.williams@intel.com>, Jan Kara <jack@suse.cz>,
	Stefan Hajnoczi <stefanha@redhat.com>,
	Stefan Hajnoczi <stefanha@gmail.com>,
	kvm-devel <kvm@vger.kernel.org>,
	Qemu Developers <qemu-devel@nongnu.org>,
	"linux-nvdimm@lists.01.org" <linux-nvdimm@ml01.01.org>,
	ross zwisler <ross.zwisler@linux.intel.com>,
	Paolo Bonzini <pbonzini@redhat.com>,
	Kevin Wolf <kwolf@redhat.com>,
	Nitesh Narayan Lal <nilal@redhat.com>,
	xiaoguangrong eric <xiaoguangrong.eric@gmail.com>,
	Haozhong Zhang <haozhong.zhang@intel.com>,
	Ross Zwisler <ross.zwisler@intel.com>
Subject: Re: [Qemu-devel] KVM "fake DAX" flushing interface - discussion
Date: Wed, 26 Jul 2017 09:47:21 -0400 (EDT)	[thread overview]
Message-ID: <1063764405.34607875.1501076841865.JavaMail.zimbra@redhat.com> (raw)
In-Reply-To: <1501016375.26846.21.camel@redhat.com>


> 
> On Tue, 2017-07-25 at 07:46 -0700, Dan Williams wrote:
> > On Tue, Jul 25, 2017 at 7:27 AM, Pankaj Gupta <pagupta@redhat.com>
> > wrote:
> > > 
> > > Looks like only way to send flush(blk dev) from guest to host with
> > > nvdimm
> > > is using flush hint addresses. Is this the correct interface I am
> > > looking?
> > > 
> > > blkdev_issue_flush
> > >  submit_bio_wait
> > >   submit_bio
> > >     generic_make_request
> > >       pmem_make_request
> > >       ...
> > >            if (bio->bi_opf & REQ_FLUSH)
> > >                 nvdimm_flush(nd_region);
> > 
> > I would inject a paravirtualized version of pmem_make_request() that
> > sends an async flush operation over virtio to the host. Don't try to
> > use flush hint addresses for this, they don't have the proper
> > semantics. The guest should be allowed to issue the flush and receive
> > the completion asynchronously rather than taking a vm exist and
> > blocking on that request.
> 
> That is my feeling, too. A slower IO device benefits
> greatly from an asynchronous flush mechanism.

Thanks for all the suggestions!

Just want to summarize here(high level):

This will require implementing new 'virtio-pmem' device which presents 
a DAX address range(like pmem) to guest with read/write(direct access)
& device flush functionality. Also, qemu should implement corresponding
support for flush using virtio.

Thanks,
Pankaj
> 
> --
> All rights reversed

  reply	other threads:[~2017-07-26 13:47 UTC|newest]

Thread overview: 176+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <1455443283.33337333.1500618150787.JavaMail.zimbra@redhat.com>
2017-07-21  6:56 ` KVM "fake DAX" flushing interface - discussion Pankaj Gupta
2017-07-21  6:56   ` [Qemu-devel] " Pankaj Gupta
2017-07-21  6:56   ` Pankaj Gupta
2017-07-21  9:51   ` Haozhong Zhang
2017-07-21  9:51     ` [Qemu-devel] " Haozhong Zhang
2017-07-21  9:51     ` Haozhong Zhang
2017-07-21 10:21     ` Pankaj Gupta
2017-07-21 10:21       ` [Qemu-devel] " Pankaj Gupta
2017-07-21 10:21       ` Pankaj Gupta
2017-07-21 12:12   ` Stefan Hajnoczi
2017-07-21 12:12     ` [Qemu-devel] " Stefan Hajnoczi
2017-07-21 13:29     ` Pankaj Gupta
2017-07-21 13:29       ` [Qemu-devel] " Pankaj Gupta
2017-07-21 13:29       ` Pankaj Gupta
2017-07-21 14:00       ` Rik van Riel
2017-07-21 14:00         ` [Qemu-devel] " Rik van Riel
2017-07-21 14:00         ` Rik van Riel
2017-07-21 15:58       ` Stefan Hajnoczi
2017-07-21 15:58         ` [Qemu-devel] " Stefan Hajnoczi
2017-07-22 19:34         ` Dan Williams
2017-07-22 19:34           ` [Qemu-devel] " Dan Williams
2017-07-22 19:34           ` Dan Williams
2017-07-23 14:04           ` Rik van Riel
2017-07-23 14:04             ` [Qemu-devel] " Rik van Riel
2017-07-23 14:04             ` Rik van Riel
2017-07-23 16:01             ` Dan Williams
2017-07-23 16:01               ` [Qemu-devel] " Dan Williams
2017-07-23 16:01               ` Dan Williams
2017-07-23 18:10               ` Rik van Riel
2017-07-23 18:10                 ` [Qemu-devel] " Rik van Riel
2017-07-23 18:10                 ` Rik van Riel
2017-07-23 20:10                 ` Dan Williams
2017-07-23 20:10                   ` [Qemu-devel] " Dan Williams
2017-07-23 20:10                   ` Dan Williams
2017-07-24 10:23                   ` Jan Kara
2017-07-24 10:23                     ` [Qemu-devel] " Jan Kara
2017-07-24 10:23                     ` Jan Kara
2017-07-24 12:06                     ` Pankaj Gupta
2017-07-24 12:06                       ` [Qemu-devel] " Pankaj Gupta
2017-07-24 12:06                       ` Pankaj Gupta
2017-07-24 12:37                       ` Jan Kara
2017-07-24 12:37                         ` [Qemu-devel] " Jan Kara
2017-07-24 12:37                         ` Jan Kara
2017-07-24 15:10                         ` Dan Williams
2017-07-24 15:10                           ` [Qemu-devel] " Dan Williams
2017-07-24 15:10                           ` Dan Williams
2017-07-24 15:48                           ` Jan Kara
2017-07-24 15:48                             ` [Qemu-devel] " Jan Kara
2017-07-24 15:48                             ` Jan Kara
2017-07-24 16:19                             ` Dan Williams
2017-07-24 16:19                               ` [Qemu-devel] " Dan Williams
2017-07-24 16:19                               ` Dan Williams
2017-07-25 14:27                         ` Pankaj Gupta
2017-07-25 14:27                           ` [Qemu-devel] " Pankaj Gupta
2017-07-25 14:27                           ` Pankaj Gupta
2017-07-25 14:46                           ` Dan Williams
2017-07-25 14:46                             ` [Qemu-devel] " Dan Williams
2017-07-25 14:46                             ` Dan Williams
2017-07-25 20:59                             ` Rik van Riel
2017-07-25 20:59                               ` [Qemu-devel] " Rik van Riel
2017-07-26 13:47                               ` Pankaj Gupta [this message]
2017-07-26 13:47                                 ` Pankaj Gupta
2017-07-26 13:47                                 ` Pankaj Gupta
2017-07-26 21:27                                 ` Rik van Riel
2017-07-26 21:27                                   ` [Qemu-devel] " Rik van Riel
2017-07-26 21:40                                   ` Dan Williams
2017-07-26 21:40                                     ` [Qemu-devel] " Dan Williams
2017-07-26 21:40                                     ` Dan Williams
2017-07-26 23:46                                     ` Rik van Riel
2017-07-26 23:46                                       ` [Qemu-devel] " Rik van Riel
2017-07-26 23:46                                       ` Rik van Riel
2017-07-27  0:54                                       ` Dan Williams
2017-07-27  0:54                                         ` [Qemu-devel] " Dan Williams
2017-07-27  0:54                                         ` Dan Williams
2017-10-31  7:13                                         ` Xiao Guangrong
2017-10-31  7:13                                           ` [Qemu-devel] " Xiao Guangrong
2017-10-31  7:13                                           ` Xiao Guangrong
2017-10-31 14:20                                           ` Dan Williams
2017-10-31 14:20                                             ` [Qemu-devel] " Dan Williams
2017-10-31 14:20                                             ` Dan Williams
2017-11-01  3:43                                             ` Xiao Guangrong
2017-11-01  3:43                                               ` [Qemu-devel] " Xiao Guangrong
2017-11-01  3:43                                               ` Xiao Guangrong
2017-11-01  4:25                                               ` Dan Williams
2017-11-01  4:25                                                 ` [Qemu-devel] " Dan Williams
2017-11-01  4:25                                                 ` Dan Williams
2017-11-01  6:46                                                 ` Xiao Guangrong
2017-11-01  6:46                                                   ` [Qemu-devel] " Xiao Guangrong
2017-11-01  6:46                                                   ` Xiao Guangrong
2017-11-01 15:20                                                   ` Dan Williams
2017-11-01 15:20                                                     ` [Qemu-devel] " Dan Williams
2017-11-01 15:20                                                     ` Dan Williams
2017-11-02  8:50                                                     ` Xiao Guangrong
2017-11-02  8:50                                                       ` [Qemu-devel] " Xiao Guangrong
2017-11-02  8:50                                                       ` Xiao Guangrong
2017-11-02 16:30                                                       ` Dan Williams
2017-11-02 16:30                                                         ` [Qemu-devel] " Dan Williams
2017-11-02 16:30                                                         ` Dan Williams
2017-11-03  6:21                                                         ` Xiao Guangrong
2017-11-03  6:21                                                           ` [Qemu-devel] " Xiao Guangrong
2017-11-03  6:21                                                           ` Xiao Guangrong
2017-11-21 18:19                                                           ` Rik van Riel
2017-11-21 18:19                                                             ` [Qemu-devel] " Rik van Riel
2017-11-21 18:26                                                             ` Dan Williams
2017-11-21 18:26                                                               ` [Qemu-devel] " Dan Williams
2017-11-21 18:26                                                               ` Dan Williams
2017-11-21 18:35                                                               ` Rik van Riel
2017-11-21 18:35                                                                 ` [Qemu-devel] " Rik van Riel
2017-11-23  4:05                                                             ` Xiao Guangrong
2017-11-23  4:05                                                               ` [Qemu-devel] " Xiao Guangrong
2017-11-23  4:05                                                               ` Xiao Guangrong
2017-11-23 16:14                                                               ` Dan Williams
2017-11-23 16:14                                                                 ` [Qemu-devel] " Dan Williams
2017-11-23 16:14                                                                 ` Dan Williams
2017-11-23 16:28                                                                 ` Paolo Bonzini
2017-11-23 16:28                                                                   ` [Qemu-devel] " Paolo Bonzini
2017-11-23 16:28                                                                   ` Paolo Bonzini
2017-11-24 12:40                                                                   ` Pankaj Gupta
2017-11-24 12:40                                                                     ` [Qemu-devel] " Pankaj Gupta
2017-11-24 12:40                                                                     ` Pankaj Gupta
2017-11-24 12:44                                                                     ` Paolo Bonzini
2017-11-24 12:44                                                                       ` [Qemu-devel] " Paolo Bonzini
2017-11-24 12:44                                                                       ` Paolo Bonzini
2017-11-24 13:02                                                                       ` [Qemu-devel] " Pankaj Gupta
2017-11-24 13:02                                                                         ` Pankaj Gupta
2017-11-24 13:20                                                                         ` Paolo Bonzini
2017-11-24 13:20                                                                           ` Paolo Bonzini
2017-11-28 18:03                                                                     ` Dan Williams
2017-11-28 18:03                                                                       ` [Qemu-devel] " Dan Williams
2017-11-28 18:03                                                                       ` Dan Williams
2018-01-13  6:23                                                                       ` Pankaj Gupta
2018-01-13  6:23                                                                         ` [Qemu-devel] " Pankaj Gupta
2018-01-13  6:23                                                                         ` Pankaj Gupta
2018-01-17 16:17                                                                         ` Dan Williams
2018-01-17 16:17                                                                           ` [Qemu-devel] " Dan Williams
2018-01-17 16:17                                                                           ` Dan Williams
2018-01-17 17:31                                                                           ` Pankaj Gupta
2018-01-17 17:31                                                                             ` [Qemu-devel] " Pankaj Gupta
2018-01-17 17:31                                                                             ` Pankaj Gupta
2018-01-18 16:53                                                                     ` David Hildenbrand
2018-01-18 16:53                                                                       ` [Qemu-devel] " David Hildenbrand
2018-01-18 16:53                                                                       ` David Hildenbrand
2018-01-18 17:38                                                                       ` Dan Williams
2018-01-18 17:38                                                                         ` [Qemu-devel] " Dan Williams
2018-01-18 17:38                                                                         ` Dan Williams
2018-01-18 17:48                                                                         ` David Hildenbrand
2018-01-18 17:48                                                                           ` [Qemu-devel] " David Hildenbrand
2018-01-18 17:48                                                                           ` David Hildenbrand
2018-01-18 18:45                                                                           ` Dan Williams
2018-01-18 18:45                                                                             ` [Qemu-devel] " Dan Williams
2018-01-18 18:45                                                                             ` Dan Williams
2018-01-18 18:54                                                                           ` Pankaj Gupta
2018-01-18 18:54                                                                             ` [Qemu-devel] " Pankaj Gupta
2018-01-18 18:54                                                                             ` Pankaj Gupta
2018-01-18 18:59                                                                             ` Dan Williams
2018-01-18 18:59                                                                               ` [Qemu-devel] " Dan Williams
2018-01-18 18:59                                                                               ` Dan Williams
2018-01-18 19:36                                                                               ` Pankaj Gupta
2018-01-18 19:36                                                                                 ` [Qemu-devel] " Pankaj Gupta
2018-01-18 19:36                                                                                 ` Pankaj Gupta
2018-01-18 19:48                                                                                 ` Dan Williams
2018-01-18 19:48                                                                                   ` [Qemu-devel] " Dan Williams
2018-01-18 19:48                                                                                   ` Dan Williams
2018-01-18 19:51                                                                               ` David Hildenbrand
2018-01-18 19:51                                                                                 ` [Qemu-devel] " David Hildenbrand
2018-01-18 19:51                                                                                 ` David Hildenbrand
2018-01-18 20:11                                                                                 ` Dan Williams
2018-01-18 20:11                                                                                   ` [Qemu-devel] " Dan Williams
2018-01-18 20:11                                                                                   ` Dan Williams
2017-11-06  7:57                                                         ` [Qemu-devel] " Pankaj Gupta
2017-11-06  7:57                                                           ` Pankaj Gupta
2017-11-06 16:57                                                           ` Dan Williams
2017-11-06 16:57                                                             ` Dan Williams
2017-11-07 11:21                                                             ` Pankaj Gupta
2017-11-07 11:21                                                               ` Pankaj Gupta
2017-11-07 11:21                                                               ` Pankaj Gupta

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1063764405.34607875.1501076841865.JavaMail.zimbra@redhat.com \
    --to=pagupta@redhat.com \
    --cc=jack@suse.cz \
    --cc=kvm@vger.kernel.org \
    --cc=kwolf@redhat.com \
    --cc=linux-nvdimm@ml01.01.org \
    --cc=nilal@redhat.com \
    --cc=pbonzini@redhat.com \
    --cc=qemu-devel@nongnu.org \
    --cc=riel@redhat.com \
    --cc=ross.zwisler@intel.com \
    --cc=stefanha@gmail.com \
    --cc=stefanha@redhat.com \
    --cc=xiaoguangrong.eric@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.