All of lore.kernel.org
 help / color / mirror / Atom feed
From: Wei Wang <wei.w.wang@intel.com>
To: Peter Xu <peterx@redhat.com>
Cc: qemu-devel@nongnu.org, virtio-dev@lists.oasis-open.org,
	mst@redhat.com, quintela@redhat.com, dgilbert@redhat.com,
	pbonzini@redhat.com, liliang.opensource@gmail.com,
	nilal@redhat.com, riel@redhat.com
Subject: Re: [Qemu-devel] [PATCH v10 6/7] migration/ram.c: add a function to disable the bulk stage
Date: Mon, 03 Dec 2018 16:20:15 +0800	[thread overview]
Message-ID: <5C04E73F.9040202@intel.com> (raw)
In-Reply-To: <20181203053118.GD27620@xz-x1>

On 12/03/2018 01:31 PM, Peter Xu wrote:
> On Mon, Dec 03, 2018 at 10:18:30AM +0800, Wei Wang wrote:
>> This patch adds a function to enable a precopy notifier callback outside
>> the migration subsystem to disable the bulk stage flag. This is needed by
>> the free page optimization offered by virtio-balloon.
>>
>> Signed-off-by: Wei Wang <wei.w.wang@intel.com>
>> CC: Dr. David Alan Gilbert <dgilbert@redhat.com>
>> CC: Juan Quintela <quintela@redhat.com>
>> CC: Michael S. Tsirkin <mst@redhat.com>
>> CC: Peter Xu <peterx@redhat.com>
>> ---
>>   include/migration/misc.h | 1 +
>>   migration/ram.c          | 9 +++++++++
>>   2 files changed, 10 insertions(+)
>>
>> diff --git a/include/migration/misc.h b/include/migration/misc.h
>> index 15f8d00..47e7ff5 100644
>> --- a/include/migration/misc.h
>> +++ b/include/migration/misc.h
>> @@ -37,6 +37,7 @@ void precopy_infrastructure_init(void);
>>   void precopy_add_notifier(NotifierWithReturn *n);
>>   void precopy_remove_notifier(NotifierWithReturn *n);
>>   int precopy_notify(PrecopyNotifyReason reason, Error **errp);
>> +void precopy_disable_bulk_stage(void);
>>   
>>   void ram_mig_init(void);
>>   void qemu_guest_free_page_hint(void *addr, size_t len);
>> diff --git a/migration/ram.c b/migration/ram.c
>> index b90a3f2..739dc97 100644
>> --- a/migration/ram.c
>> +++ b/migration/ram.c
>> @@ -354,6 +354,15 @@ int precopy_notify(PrecopyNotifyReason reason, Error **errp)
>>       return notifier_with_return_list_notify(&precopy_notifier_list, &pnd);
>>   }
>>   
>> +void precopy_disable_bulk_stage(void)
>> +{
>> +    if (!ram_state) {
>> +        return;
>> +    }
>> +
>> +    ram_state->ram_bulk_stage = false;
>> +}
>> +
> This one is a bit tricky.  E.g., I think it'll at least affect XBZRLE
> and compression somehow.  Since we will have the on-off switch for
> balloon free page hinting so the user can at least decide what
> features to use, with that I don't see much issue with it so far. But
> I'd also like to see how other people see this change.
>

Yes. I think it would be better that this optimization could co-exist 
with the
compression feature.

How about adding a new flag "ram_state->free_page_optimization_enabled"?

We will then need a change in migration_bitmap_find_dirty:
  - if (rs->ram_bulk_stage && start > 0) {
+ if (!rs->free_page_optimization_enabled && rs->ram_bulk_stage && start 
 > 0) {
         next = start + 1;
     } else {
         next = find_next_bit(bitmap, size, start);
     }

Best,
Wei

WARNING: multiple messages have this Message-ID (diff)
From: Wei Wang <wei.w.wang@intel.com>
To: Peter Xu <peterx@redhat.com>
Cc: qemu-devel@nongnu.org, virtio-dev@lists.oasis-open.org,
	mst@redhat.com, quintela@redhat.com, dgilbert@redhat.com,
	pbonzini@redhat.com, liliang.opensource@gmail.com,
	nilal@redhat.com, riel@redhat.com
Subject: [virtio-dev] Re: [PATCH v10 6/7] migration/ram.c: add a function to disable the bulk stage
Date: Mon, 03 Dec 2018 16:20:15 +0800	[thread overview]
Message-ID: <5C04E73F.9040202@intel.com> (raw)
In-Reply-To: <20181203053118.GD27620@xz-x1>

On 12/03/2018 01:31 PM, Peter Xu wrote:
> On Mon, Dec 03, 2018 at 10:18:30AM +0800, Wei Wang wrote:
>> This patch adds a function to enable a precopy notifier callback outside
>> the migration subsystem to disable the bulk stage flag. This is needed by
>> the free page optimization offered by virtio-balloon.
>>
>> Signed-off-by: Wei Wang <wei.w.wang@intel.com>
>> CC: Dr. David Alan Gilbert <dgilbert@redhat.com>
>> CC: Juan Quintela <quintela@redhat.com>
>> CC: Michael S. Tsirkin <mst@redhat.com>
>> CC: Peter Xu <peterx@redhat.com>
>> ---
>>   include/migration/misc.h | 1 +
>>   migration/ram.c          | 9 +++++++++
>>   2 files changed, 10 insertions(+)
>>
>> diff --git a/include/migration/misc.h b/include/migration/misc.h
>> index 15f8d00..47e7ff5 100644
>> --- a/include/migration/misc.h
>> +++ b/include/migration/misc.h
>> @@ -37,6 +37,7 @@ void precopy_infrastructure_init(void);
>>   void precopy_add_notifier(NotifierWithReturn *n);
>>   void precopy_remove_notifier(NotifierWithReturn *n);
>>   int precopy_notify(PrecopyNotifyReason reason, Error **errp);
>> +void precopy_disable_bulk_stage(void);
>>   
>>   void ram_mig_init(void);
>>   void qemu_guest_free_page_hint(void *addr, size_t len);
>> diff --git a/migration/ram.c b/migration/ram.c
>> index b90a3f2..739dc97 100644
>> --- a/migration/ram.c
>> +++ b/migration/ram.c
>> @@ -354,6 +354,15 @@ int precopy_notify(PrecopyNotifyReason reason, Error **errp)
>>       return notifier_with_return_list_notify(&precopy_notifier_list, &pnd);
>>   }
>>   
>> +void precopy_disable_bulk_stage(void)
>> +{
>> +    if (!ram_state) {
>> +        return;
>> +    }
>> +
>> +    ram_state->ram_bulk_stage = false;
>> +}
>> +
> This one is a bit tricky.  E.g., I think it'll at least affect XBZRLE
> and compression somehow.  Since we will have the on-off switch for
> balloon free page hinting so the user can at least decide what
> features to use, with that I don't see much issue with it so far. But
> I'd also like to see how other people see this change.
>

Yes. I think it would be better that this optimization could co-exist 
with the
compression feature.

How about adding a new flag "ram_state->free_page_optimization_enabled"?

We will then need a change in migration_bitmap_find_dirty:
  - if (rs->ram_bulk_stage && start > 0) {
+ if (!rs->free_page_optimization_enabled && rs->ram_bulk_stage && start 
 > 0) {
         next = start + 1;
     } else {
         next = find_next_bit(bitmap, size, start);
     }

Best,
Wei

---------------------------------------------------------------------
To unsubscribe, e-mail: virtio-dev-unsubscribe@lists.oasis-open.org
For additional commands, e-mail: virtio-dev-help@lists.oasis-open.org


  reply	other threads:[~2018-12-03  8:21 UTC|newest]

Thread overview: 28+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-12-03  2:18 [Qemu-devel] [PATCH v10 0/7] virtio-balloon: free page hint support Wei Wang
2018-12-03  2:18 ` [virtio-dev] " Wei Wang
2018-12-03  2:18 ` [Qemu-devel] [PATCH v10 1/7] bitmap: fix bitmap_count_one Wei Wang
2018-12-03  2:18   ` [virtio-dev] " Wei Wang
2018-12-03  2:18 ` [Qemu-devel] [PATCH v10 2/7] bitmap: bitmap_count_one_with_offset Wei Wang
2018-12-03  2:18   ` [virtio-dev] " Wei Wang
2018-12-03  2:18 ` [Qemu-devel] [PATCH v10 3/7] migration: use bitmap_mutex in migration_bitmap_clear_dirty Wei Wang
2018-12-03  2:18   ` [virtio-dev] " Wei Wang
2018-12-03  5:08   ` [Qemu-devel] " Peter Xu
2018-12-03  2:18 ` [Qemu-devel] [PATCH v10 4/7] migration: API to clear bits of guest free pages from the dirty bitmap Wei Wang
2018-12-03  2:18   ` [virtio-dev] " Wei Wang
2018-12-03  5:10   ` [Qemu-devel] " Peter Xu
2018-12-03  8:07     ` Wei Wang
2018-12-03  8:07       ` [virtio-dev] " Wei Wang
2018-12-03  2:18 ` [Qemu-devel] [PATCH v10 5/7] migration/ram.c: add a notifier chain for precopy Wei Wang
2018-12-03  2:18   ` [virtio-dev] " Wei Wang
2018-12-03  5:20   ` [Qemu-devel] " Peter Xu
2018-12-03  8:10     ` Wei Wang
2018-12-03  8:10       ` [virtio-dev] " Wei Wang
2018-12-03  2:18 ` [Qemu-devel] [PATCH v10 6/7] migration/ram.c: add a function to disable the bulk stage Wei Wang
2018-12-03  2:18   ` [virtio-dev] " Wei Wang
2018-12-03  5:31   ` [Qemu-devel] " Peter Xu
2018-12-03  8:20     ` Wei Wang [this message]
2018-12-03  8:20       ` [virtio-dev] " Wei Wang
2018-12-03  8:24       ` [Qemu-devel] " Wei Wang
2018-12-03  8:24         ` Wei Wang
2018-12-03  2:18 ` [Qemu-devel] [PATCH v10 7/7] virtio-balloon: VIRTIO_BALLOON_F_FREE_PAGE_HINT Wei Wang
2018-12-03  2:18   ` [virtio-dev] " Wei Wang

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=5C04E73F.9040202@intel.com \
    --to=wei.w.wang@intel.com \
    --cc=dgilbert@redhat.com \
    --cc=liliang.opensource@gmail.com \
    --cc=mst@redhat.com \
    --cc=nilal@redhat.com \
    --cc=pbonzini@redhat.com \
    --cc=peterx@redhat.com \
    --cc=qemu-devel@nongnu.org \
    --cc=quintela@redhat.com \
    --cc=riel@redhat.com \
    --cc=virtio-dev@lists.oasis-open.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.