Re: [PATCH RESEND v5 0/6] xen/arm: live migration support in arndale board

Re: [PATCH RESEND v5 0/6] xen/arm: live migration support in arndale board

[유재용]

[-- Attachment #1.1: Type: text/html, Size: 9918 bytes --]

[-- Attachment #1.2: 201404071559537_44YDXKW4.gif --]
[-- Type: image/gif, Size: 14036 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: [PATCH RESEND v5 0/6] xen/arm: live migration support in arndale board

[Ian Campbell]

On Mon, 2014-04-07 at 06:59 +0000, 유재용 wrote:
> Currently, I'm working on a different project and the patch upstream
> regarding live migration is taken over to Mr. Junghyun Yoo.
> 
> So, Junghyun Yoo will send the patches within few weeks.

Great, looking forwards to it.

Thanks,
Ian.



_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: [PATCH RESEND v5 0/6] xen/arm: live migration support in arndale board

[Ian Campbell]

On Mon, 2014-04-07 at 10:14 +0100, Ian Campbell wrote:
> On Mon, 2014-04-07 at 06:59 +0000, 유재용 wrote:
> > Currently, I'm working on a different project and the patch upstream
> > regarding live migration is taken over to Mr. Junghyun Yoo.
> > 
> > So, Junghyun Yoo will send the patches within few weeks.
> 
> Great, looking forwards to it.

BTW you should be aware that there is an ongoing effort to define a
cleaner migration protocol, which is intended to be usable for all
architectures.

http://thread.gmane.org/gmane.comp.emulators.xen.devel/195088 is the
first RFC of the code and the spec was posted at
http://article.gmane.org/gmane.comp.emulators.xen.devel/189538
(discussion was mostly on draft A and B which you can find in the
archives).

There is no need for you to switch any of your code to this new scheme
for the next posting, so please don't delay for that reason. Eventually
though we will want to converge both x86 and arm migration onto this new
format.

Cheers,
Ian.


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: [PATCH RESEND v5 0/6] xen/arm: live migration support in arndale board

[Wei Huang]

On 04/10/2014 05:47 AM, Ian Campbell wrote:
> On Mon, 2014-04-07 at 10:14 +0100, Ian Campbell wrote:
>> On Mon, 2014-04-07 at 06:59 +0000, 유재용 wrote:
>>> Currently, I'm working on a different project and the patch upstream
>>> regarding live migration is taken over to Mr. Junghyun Yoo.
>>>
>>> So, Junghyun Yoo will send the patches within few weeks.
>>
>> Great, looking forwards to it.
>
> BTW you should be aware that there is an ongoing effort to define a
> cleaner migration protocol, which is intended to be usable for all
> architectures.
>
> http://thread.gmane.org/gmane.comp.emulators.xen.devel/195088 is the
> first RFC of the code and the spec was posted at
> http://article.gmane.org/gmane.comp.emulators.xen.devel/189538
> (discussion was mostly on draft A and B which you can find in the
> archives).
>
> There is no need for you to switch any of your code to this new scheme
> for the next posting, so please don't delay for that reason. Eventually
> though we will want to converge both x86 and arm migration onto this new
> format.
I just sent my version to the mailing list for reference and discussion. 
I expect there will be several rounds of review before finalization.

-Wei

>
> Cheers,
> Ian.
>
>


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: [PATCH RESEND v5 0/6] xen/arm: live migration support in arndale board

[Stefano Stabellini]

[-- Attachment #1: Type: text/plain, Size: 4656 bytes --]

On Wed, 2 Apr 2014, Wei Huang wrote:
> On 04/01/2014 02:39 PM, Julien Grall wrote:
> > Hello Jaeyong,
> > 
> > I remembered the patch series was in good shape (you may need to rebase it
> > on the latest master branch), do you plan to resend it?
> I don't know about Jaeyong's progress. But I have back ported his patches,
> plus some fixes, to the latest Xen-unstable. Currently save/restore/migration
> for 32-bit guest VMs are working. 64-bit support is also under way and should
> be completed soon.

That's fantastic!


> > It would be awesome to have migration support for ARM for 4.5 (AFAIK the
> > release is planned around august)
> I can submit my version (with original signed-off intact). But given that
> Jaeyong Yoo and his team are the original author, I will wait for his reply. I
> think we should plan to support migration officially in 4.5 release.

If you go ahead and resend his series, keep him as original author (by
using the From: line in the commit message) and of course add your
signed-off-by.


> > 
> > Regards,
> > 
> > On 08/11/13 07:50, Jaeyong Yoo wrote:
> > > Note: Resend the patch series since the last one was white-space
> > > corrupted.
> > > 
> > > Hello!
> > > here goes the v5 patch series. The major changes in this version are the
> > > following:
> > > 
> > >    1) Save and restore the vcpu-related registers in hvm context. (In
> > > patch 1)
> > > 
> > >    2) Rather than using set_memory_map hypercall use GUEST_RAM_BASE macro
> > > as the start
> > >       of physical address of guest RAM and just let the hypervisor know
> > > the
> > >       maximum memory of guest (In patch 2 and 6)
> > > 
> > >    3) Use bitmap for temporary saving the dirty pages rather than linked
> > > list.
> > >       (In patch 5)
> > > 
> > > 
> > > Patch 1 implements hvm save/restore (including vcpu).
> > > 
> > > Patch 2 implements 'get_maximum_gpfn' hypercall
> > > 
> > > Patch 3 implements 'modify_returncode' for switching the return value of
> > > suspend hypercall from domU.
> > > 
> > > Patch 4 implements base functions for VLPT.
> > > 
> > > Patch 5 implements dirty-page tracing by using VLPT.
> > > 
> > > Patch 6 implements the toolstack part for live migration of ARM.
> > > 
> > > NOTE: In this version, I do not use the p2m walker infrastructure for
> > > p2m_change_entry_type_global.
> > > I think I can apply it after Stefano’s patch is commited.
> > > 
> > > Best,
> > > Jaeyong
> > > 
> > > 
> > > Alexey Sokolov (2):
> > >    xen/arm: Implement modify_returncode
> > >    xen/arm: Implement toolstack for xl restore/save and migrate
> > > 
> > > Evgeny Fedotov (2):
> > >    xen/arm: Implement hvm save and restore
> > >    xen/arm: Implement get_maximum_gpfn hypercall for arm
> > > 
> > > Jaeyong Yoo (2):
> > >    xen/arm: Implement virtual-linear page table for guest p2m mapping in
> > >      live migration
> > >    xen/arm: Implement hypercall for dirty page tracing
> > > 
> > >   config/arm32.mk                        |   1 +
> > >   tools/libxc/Makefile                   |   6 +-
> > >   tools/libxc/xc_arm_migrate.c           | 712
> > > +++++++++++++++++++++++++++++++++
> > >   tools/libxc/xc_dom_arm.c               |   4 +-
> > >   tools/libxc/xc_resume.c                |  25 ++
> > >   tools/misc/Makefile                    |   4 +-
> > >   xen/arch/arm/Makefile                  |   1 +
> > >   xen/arch/arm/domain.c                  |  19 +
> > >   xen/arch/arm/domctl.c                  |  98 ++++-
> > >   xen/arch/arm/hvm.c                     | 464 ++++++++++++++++++++-
> > >   xen/arch/arm/mm.c                      | 237 ++++++++++-
> > >   xen/arch/arm/p2m.c                     | 206 ++++++++++
> > >   xen/arch/arm/save.c                    |  66 +++
> > >   xen/arch/arm/traps.c                   |   9 +
> > >   xen/common/Makefile                    |   2 +
> > >   xen/include/asm-arm/arm32/page.h       |  41 +-
> > >   xen/include/asm-arm/config.h           |   5 +
> > >   xen/include/asm-arm/domain.h           |  14 +
> > >   xen/include/asm-arm/hvm/support.h      |  29 ++
> > >   xen/include/asm-arm/mm.h               |  24 ++
> > >   xen/include/asm-arm/p2m.h              |   4 +
> > >   xen/include/asm-arm/processor.h        |   2 +
> > >   xen/include/public/arch-arm/hvm/save.h | 130 ++++++
> > >   23 files changed, 2084 insertions(+), 19 deletions(-)
> > >   create mode 100644 tools/libxc/xc_arm_migrate.c
> > >   create mode 100644 xen/arch/arm/save.c
> > >   create mode 100644 xen/include/asm-arm/hvm/support.h
> > > 
> > 
> 

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: [PATCH RESEND v5 0/6] xen/arm: live migration support in arndale board

[Wei Huang]

On 04/01/2014 02:39 PM, Julien Grall wrote:
> Hello Jaeyong,
>
> I remembered the patch series was in good shape (you may need to 
> rebase it on the latest master branch), do you plan to resend it?
I don't know about Jaeyong's progress. But I have back ported his 
patches, plus some fixes, to the latest Xen-unstable. Currently 
save/restore/migration for 32-bit guest VMs are working. 64-bit support 
is also under way and should be completed soon.
>
> It would be awesome to have migration support for ARM for 4.5 (AFAIK 
> the release is planned around august)
I can submit my version (with original signed-off intact). But given 
that Jaeyong Yoo and his team are the original author, I will wait for 
his reply. I think we should plan to support migration officially in 4.5 
release.
>
> Regards,
>
> On 08/11/13 07:50, Jaeyong Yoo wrote:
>> Note: Resend the patch series since the last one was white-space 
>> corrupted.
>>
>> Hello!
>> here goes the v5 patch series. The major changes in this version are 
>> the following:
>>
>>    1) Save and restore the vcpu-related registers in hvm context. (In 
>> patch 1)
>>
>>    2) Rather than using set_memory_map hypercall use GUEST_RAM_BASE 
>> macro as the start
>>       of physical address of guest RAM and just let the hypervisor 
>> know the
>>       maximum memory of guest (In patch 2 and 6)
>>
>>    3) Use bitmap for temporary saving the dirty pages rather than 
>> linked list.
>>       (In patch 5)
>>
>>
>> Patch 1 implements hvm save/restore (including vcpu).
>>
>> Patch 2 implements 'get_maximum_gpfn' hypercall
>>
>> Patch 3 implements 'modify_returncode' for switching the return value 
>> of suspend hypercall from domU.
>>
>> Patch 4 implements base functions for VLPT.
>>
>> Patch 5 implements dirty-page tracing by using VLPT.
>>
>> Patch 6 implements the toolstack part for live migration of ARM.
>>
>> NOTE: In this version, I do not use the p2m walker infrastructure for 
>> p2m_change_entry_type_global.
>> I think I can apply it after Stefano’s patch is commited.
>>
>> Best,
>> Jaeyong
>>
>>
>> Alexey Sokolov (2):
>>    xen/arm: Implement modify_returncode
>>    xen/arm: Implement toolstack for xl restore/save and migrate
>>
>> Evgeny Fedotov (2):
>>    xen/arm: Implement hvm save and restore
>>    xen/arm: Implement get_maximum_gpfn hypercall for arm
>>
>> Jaeyong Yoo (2):
>>    xen/arm: Implement virtual-linear page table for guest p2m mapping in
>>      live migration
>>    xen/arm: Implement hypercall for dirty page tracing
>>
>>   config/arm32.mk                        |   1 +
>>   tools/libxc/Makefile                   |   6 +-
>>   tools/libxc/xc_arm_migrate.c           | 712 
>> +++++++++++++++++++++++++++++++++
>>   tools/libxc/xc_dom_arm.c               |   4 +-
>>   tools/libxc/xc_resume.c                |  25 ++
>>   tools/misc/Makefile                    |   4 +-
>>   xen/arch/arm/Makefile                  |   1 +
>>   xen/arch/arm/domain.c                  |  19 +
>>   xen/arch/arm/domctl.c                  |  98 ++++-
>>   xen/arch/arm/hvm.c                     | 464 ++++++++++++++++++++-
>>   xen/arch/arm/mm.c                      | 237 ++++++++++-
>>   xen/arch/arm/p2m.c                     | 206 ++++++++++
>>   xen/arch/arm/save.c                    |  66 +++
>>   xen/arch/arm/traps.c                   |   9 +
>>   xen/common/Makefile                    |   2 +
>>   xen/include/asm-arm/arm32/page.h       |  41 +-
>>   xen/include/asm-arm/config.h           |   5 +
>>   xen/include/asm-arm/domain.h           |  14 +
>>   xen/include/asm-arm/hvm/support.h      |  29 ++
>>   xen/include/asm-arm/mm.h               |  24 ++
>>   xen/include/asm-arm/p2m.h              |   4 +
>>   xen/include/asm-arm/processor.h        |   2 +
>>   xen/include/public/arch-arm/hvm/save.h | 130 ++++++
>>   23 files changed, 2084 insertions(+), 19 deletions(-)
>>   create mode 100644 tools/libxc/xc_arm_migrate.c
>>   create mode 100644 xen/arch/arm/save.c
>>   create mode 100644 xen/include/asm-arm/hvm/support.h
>>
>


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: [PATCH RESEND v5 0/6] xen/arm: live migration support in arndale board

[Julien Grall]

Hello Jaeyong,

I remembered the patch series was in good shape (you may need to rebase 
it on the latest master branch), do you plan to resend it?

It would be awesome to have migration support for ARM for 4.5 (AFAIK the 
release is planned around august)

Regards,

On 08/11/13 07:50, Jaeyong Yoo wrote:
> Note: Resend the patch series since the last one was white-space corrupted.
>
> Hello!
> here goes the v5 patch series. The major changes in this version are the following:
>
>    1) Save and restore the vcpu-related registers in hvm context. (In patch 1)
>
>    2) Rather than using set_memory_map hypercall use GUEST_RAM_BASE macro as the start
>       of physical address of guest RAM and just let the hypervisor know the
>       maximum memory of guest (In patch 2 and 6)
>
>    3) Use bitmap for temporary saving the dirty pages rather than linked list.
>       (In patch 5)
>
>
> Patch 1 implements hvm save/restore (including vcpu).
>
> Patch 2 implements 'get_maximum_gpfn' hypercall
>
> Patch 3 implements 'modify_returncode' for switching the return value of suspend hypercall from domU.
>
> Patch 4 implements base functions for VLPT.
>
> Patch 5 implements dirty-page tracing by using VLPT.
>
> Patch 6 implements the toolstack part for live migration of ARM.
>
> NOTE: In this version, I do not use the p2m walker infrastructure for p2m_change_entry_type_global.
> I think I can apply it after Stefano’s patch is commited.
>
> Best,
> Jaeyong
>
>
> Alexey Sokolov (2):
>    xen/arm: Implement modify_returncode
>    xen/arm: Implement toolstack for xl restore/save and migrate
>
> Evgeny Fedotov (2):
>    xen/arm: Implement hvm save and restore
>    xen/arm: Implement get_maximum_gpfn hypercall for arm
>
> Jaeyong Yoo (2):
>    xen/arm: Implement virtual-linear page table for guest p2m mapping in
>      live migration
>    xen/arm: Implement hypercall for dirty page tracing
>
>   config/arm32.mk                        |   1 +
>   tools/libxc/Makefile                   |   6 +-
>   tools/libxc/xc_arm_migrate.c           | 712 +++++++++++++++++++++++++++++++++
>   tools/libxc/xc_dom_arm.c               |   4 +-
>   tools/libxc/xc_resume.c                |  25 ++
>   tools/misc/Makefile                    |   4 +-
>   xen/arch/arm/Makefile                  |   1 +
>   xen/arch/arm/domain.c                  |  19 +
>   xen/arch/arm/domctl.c                  |  98 ++++-
>   xen/arch/arm/hvm.c                     | 464 ++++++++++++++++++++-
>   xen/arch/arm/mm.c                      | 237 ++++++++++-
>   xen/arch/arm/p2m.c                     | 206 ++++++++++
>   xen/arch/arm/save.c                    |  66 +++
>   xen/arch/arm/traps.c                   |   9 +
>   xen/common/Makefile                    |   2 +
>   xen/include/asm-arm/arm32/page.h       |  41 +-
>   xen/include/asm-arm/config.h           |   5 +
>   xen/include/asm-arm/domain.h           |  14 +
>   xen/include/asm-arm/hvm/support.h      |  29 ++
>   xen/include/asm-arm/mm.h               |  24 ++
>   xen/include/asm-arm/p2m.h              |   4 +
>   xen/include/asm-arm/processor.h        |   2 +
>   xen/include/public/arch-arm/hvm/save.h | 130 ++++++
>   23 files changed, 2084 insertions(+), 19 deletions(-)
>   create mode 100644 tools/libxc/xc_arm_migrate.c
>   create mode 100644 xen/arch/arm/save.c
>   create mode 100644 xen/include/asm-arm/hvm/support.h
>

-- 
Julien Grall

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

[PATCH RESEND v5 0/6] xen/arm: live migration support in arndale board

[Jaeyong Yoo]

Note: Resend the patch series since the last one was white-space corrupted.

Hello!
here goes the v5 patch series. The major changes in this version are the following:

  1) Save and restore the vcpu-related registers in hvm context. (In patch 1)

  2) Rather than using set_memory_map hypercall use GUEST_RAM_BASE macro as the start
     of physical address of guest RAM and just let the hypervisor know the
     maximum memory of guest (In patch 2 and 6)

  3) Use bitmap for temporary saving the dirty pages rather than linked list.
     (In patch 5)


Patch 1 implements hvm save/restore (including vcpu).

Patch 2 implements 'get_maximum_gpfn' hypercall

Patch 3 implements 'modify_returncode' for switching the return value of suspend hypercall from domU.

Patch 4 implements base functions for VLPT.

Patch 5 implements dirty-page tracing by using VLPT.

Patch 6 implements the toolstack part for live migration of ARM.

NOTE: In this version, I do not use the p2m walker infrastructure for p2m_change_entry_type_global. 
I think I can apply it after Stefano’s patch is commited. 

Best,
Jaeyong


Alexey Sokolov (2):
  xen/arm: Implement modify_returncode
  xen/arm: Implement toolstack for xl restore/save and migrate

Evgeny Fedotov (2):
  xen/arm: Implement hvm save and restore
  xen/arm: Implement get_maximum_gpfn hypercall for arm

Jaeyong Yoo (2):
  xen/arm: Implement virtual-linear page table for guest p2m mapping in
    live migration
  xen/arm: Implement hypercall for dirty page tracing

 config/arm32.mk                        |   1 +
 tools/libxc/Makefile                   |   6 +-
 tools/libxc/xc_arm_migrate.c           | 712 +++++++++++++++++++++++++++++++++
 tools/libxc/xc_dom_arm.c               |   4 +-
 tools/libxc/xc_resume.c                |  25 ++
 tools/misc/Makefile                    |   4 +-
 xen/arch/arm/Makefile                  |   1 +
 xen/arch/arm/domain.c                  |  19 +
 xen/arch/arm/domctl.c                  |  98 ++++-
 xen/arch/arm/hvm.c                     | 464 ++++++++++++++++++++-
 xen/arch/arm/mm.c                      | 237 ++++++++++-
 xen/arch/arm/p2m.c                     | 206 ++++++++++
 xen/arch/arm/save.c                    |  66 +++
 xen/arch/arm/traps.c                   |   9 +
 xen/common/Makefile                    |   2 +
 xen/include/asm-arm/arm32/page.h       |  41 +-
 xen/include/asm-arm/config.h           |   5 +
 xen/include/asm-arm/domain.h           |  14 +
 xen/include/asm-arm/hvm/support.h      |  29 ++
 xen/include/asm-arm/mm.h               |  24 ++
 xen/include/asm-arm/p2m.h              |   4 +
 xen/include/asm-arm/processor.h        |   2 +
 xen/include/public/arch-arm/hvm/save.h | 130 ++++++
 23 files changed, 2084 insertions(+), 19 deletions(-)
 create mode 100644 tools/libxc/xc_arm_migrate.c
 create mode 100644 xen/arch/arm/save.c
 create mode 100644 xen/include/asm-arm/hvm/support.h

-- 
1.8.1.2


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel