Question about the status of vNUMA in Xen

Question about the status of vNUMA in Xen

[甘清甜]

[-- Attachment #1.1: Type: text/plain, Size: 543 bytes --]

I'm a master student from Huazhong University of Science & technology,
China. I'm now researching on Xen optimization under NUMA. I'm puzzled
that if  vNUMA on HVM is enbaded in Xen or not. If yes, which version of
xen support it?

So far, I have read the Xen NUMA Roadmap page and watched the
video about vNUMA in Xen on Youtube. I have known that some work
has been done for vNUMA in Xen. Since my benchmark result show a
great improvement in Xen-4.5.1 when compared with Xen-4.0.1. I'm
puzzled if vNUMA has contributed to that improvement.

[-- Attachment #1.2: Type: text/html, Size: 707 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: Question about the status of vNUMA in Xen

[Wei Liu]

On Sun, Sep 06, 2015 at 03:03:13PM +0800, 甘清甜 wrote:
> I'm a master student from Huazhong University of Science & technology,
> China. I'm now researching on Xen optimization under NUMA. I'm puzzled
> that if  vNUMA on HVM is enbaded in Xen or not. If yes, which version of
> xen support it?
> 

Upcoming Xen 4.6 supports vNUMA for HVM guest, with certain limitations.

> So far, I have read the Xen NUMA Roadmap page and watched the
> video about vNUMA in Xen on Youtube. I have known that some work
> has been done for vNUMA in Xen. Since my benchmark result show a
> great improvement in Xen-4.5.1 when compared with Xen-4.0.1. I'm
> puzzled if vNUMA has contributed to that improvement.

No. That's mostly due to other improvements.

Wei.

> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Fwd: Question about the status of vNUMA in Xen

[甘清甜]

[-- Attachment #1.1: Type: text/plain, Size: 1514 bytes --]

---------- Forwarded message ---------
From: Wei Liu <wei.liu2@citrix.com>
Date: 2015年9月7日周一 下午6:23
Subject: Re: [Xen-devel] Question about the status of vNUMA in Xen
To: 甘清甜 <qingtiangan@gmail.com>
Cc: <xen-devel@lists.xenproject.org>, <wei.liu2@citrix.com>


On Sun, Sep 06, 2015 at 03:03:13PM +0800, 甘清甜 wrote:
> I'm a master student from Huazhong University of Science & technology,
> China. I'm now researching on Xen optimization under NUMA. I'm puzzled
> that if  vNUMA on HVM is enbaded in Xen or not. If yes, which version of
> xen support it?
>

Upcoming Xen 4.6 supports vNUMA for HVM guest, with certain limitations.

> So far, I have read the Xen NUMA Roadmap page and watched the
> video about vNUMA in Xen on Youtube. I have known that some work
> has been done for vNUMA in Xen. Since my benchmark result show a
> great improvement in Xen-4.5.1 when compared with Xen-4.0.1. I'm
> puzzled if vNUMA has contributed to that improvement.

No. That's mostly due to other improvements.

Wei.

> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel

I’m sorry that I didn’t express clearly in the last mail. What I want to
know is

that how much the NUMA optimizations (including NUMA-aware VM placement,

NUMA-aware scheduling and vNUMA)  contribute to the improvement

between xen-4.5.1 and xen-4.0.1.  Surely it may also due to other changes.
Thanks!

[-- Attachment #1.2: Type: text/html, Size: 2386 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: Fwd: Question about the status of vNUMA in Xen

[Wei Liu]

Please configure your email client properly.

On Tue, Sep 08, 2015 at 01:21:04AM +0000, 甘清甜 wrote:
> ---------- Forwarded message ---------
> From: Wei Liu <wei.liu2@citrix.com>
> Date: 2015年9月7日周一 下午6:23
> Subject: Re: [Xen-devel] Question about the status of vNUMA in Xen
> To: 甘清甜 <qingtiangan@gmail.com>
> Cc: <xen-devel@lists.xenproject.org>, <wei.liu2@citrix.com>
> 
> 
> On Sun, Sep 06, 2015 at 03:03:13PM +0800, 甘清甜 wrote:
> > I'm a master student from Huazhong University of Science & technology,
> > China. I'm now researching on Xen optimization under NUMA. I'm puzzled
> > that if  vNUMA on HVM is enbaded in Xen or not. If yes, which version of
> > xen support it?
> >
> 
> Upcoming Xen 4.6 supports vNUMA for HVM guest, with certain limitations.
> 
> > So far, I have read the Xen NUMA Roadmap page and watched the
> > video about vNUMA in Xen on Youtube. I have known that some work
> > has been done for vNUMA in Xen. Since my benchmark result show a
> > great improvement in Xen-4.5.1 when compared with Xen-4.0.1. I'm
> > puzzled if vNUMA has contributed to that improvement.
> 
> No. That's mostly due to other improvements.
> 
> Wei.
> 
> > _______________________________________________
> > Xen-devel mailing list
> > Xen-devel@lists.xen.org
> > http://lists.xen.org/xen-devel
> 
> I’m sorry that I didn’t express clearly in the last mail. What I want to
> know is
> 
> that how much the NUMA optimizations (including NUMA-aware VM placement,
> 
> NUMA-aware scheduling and vNUMA)  contribute to the improvement
> 

There is wiki page on wiki.xen.org for NUMA-aware scheduling.

http://wiki.xenproject.org/wiki/Xen_4.3_NUMA_Aware_Scheduling

No tests for vNUMA have been done so far. At least not the upstream
version.

Wei.

> between xen-4.5.1 and xen-4.0.1.  Surely it may also due to other changes.
> Thanks!

> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: Fwd: Question about the status of vNUMA in Xen

[Dario Faggioli]

[-- Attachment #1.1: Type: text/plain, Size: 1873 bytes --]

On Tue, 2015-09-08 at 10:50 +0100, Wei Liu wrote:
> On Tue, Sep 08, 2015 at 01:21:04AM +0000, 甘清甜 wrote:

> > > So far, I have read the Xen NUMA Roadmap page and watched the
> > > video about vNUMA in Xen on Youtube. I have known that some work
> > > has been done for vNUMA in Xen. Since my benchmark result show a
> > > great improvement in Xen-4.5.1 when compared with Xen-4.0.1. I'm
> > > puzzled if vNUMA has contributed to that improvement.
> > 
> > No. That's mostly due to other improvements.
> > 
> > Wei.

> > I’m sorry that I didn’t express clearly in the last mail. What I want to
> > know is
> > 
> > that how much the NUMA optimizations (including NUMA-aware VM placement,
> > 
> > NUMA-aware scheduling and vNUMA)  contribute to the improvement
> > 
> 
Going from 4.0 to 4.5, you get automatic placement and NUMA aware
scheduling, not to mention that many other improvements happened in
between those two release, even if they may not look NUMA-related at a
first glance, may well be leading to better performance.

The NUMA roadmap page is slightly outdated, and I commit to update it
ASAP.

Anyway, if you want to isolate the contribution of each single feature,
you can configure things in such a way that you 'temporarily disable'
them. For instance, you can use vcpu pinning di tweak/disable automatic
placement, and check how the numbers change. For tweaking/disabling NUMA
aware scheduling, you should play with hard and soft affinity (i.e.,
some more refined ways of doing pinning, check what `xl vcpu-pin' does
these days).

Regards,
Dario
-- 
<<This happens because I choose it to happen!>> (Raistlin Majere)
-----------------------------------------------------------------
Dario Faggioli, Ph.D, http://about.me/dario.faggioli
Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK)

[-- Attachment #1.2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 181 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel