From mboxrd@z Thu Jan  1 00:00:00 1970
From: Keir Fraser <keir.fraser@eu.citrix.com>
Subject: Re: 32bit-pv-VM 128G memory limited
Date: Tue, 03 Nov 2009 07:48:40 +0000
Message-ID: <C71590D8.190A4%keir.fraser@eu.citrix.com>
References: <26159985.post@talk.nabble.com>
Mime-Version: 1.0
Content-Type: text/plain;
	charset="US-ASCII"
Content-Transfer-Encoding: 7bit
Return-path: <xen-devel-bounces@lists.xensource.com>
In-Reply-To: <26159985.post@talk.nabble.com>
List-Unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>,
	<mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
List-Post: <mailto:xen-devel@lists.xensource.com>
List-Help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-Subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>,
	<mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
Sender: xen-devel-bounces@lists.xensource.com
Errors-To: xen-devel-bounces@lists.xensource.com
To: "James (song wei)" <jsong@novell.com>, "xen-devel@lists.xensource.com" <xen-devel@lists.xensource.com>
List-Id: xen-devel@lists.xenproject.org

Xen's allocation policy is to allocate larger addresses before smaller
addresses (although allocating from closer NUMA node may dominate this). So
memory over 128G should get allocated first, for guests that can use it. If
the NUMA allocation policy is getting in the way, and you want to reserve
say 64G of memory always to be allocated last, irrespective of NUMA policy,
try adding dma_bitsize=36 as a Xen boot parameter.

For 32-bit PV guests, Xen already maintains a maximum-address-size: see
implementation and use of domain_clamp_alloc_bitsize().

 -- Keir

On 03/11/2009 06:14, "James (song wei)" <jsong@novell.com> wrote:

> 
> Keir 
>  could you please say it in more detail?
> 
> Thanks,
> James 
> 
> Keir Fraser-3 wrote:
>> 
>> This should all already happen by default.
>> 
>>  -- Keir
>> 
>> On 02/11/2009 07:49, "James Song" <jsong@novell.com> wrote:
>> 
>>> Hi, 
>>>  
>>>  
>>>     Since 32-bit pv-domUs require memory below the 128G boundary (IIRC)
>>> but
>>> tools don't enforce this.  So we need a "memory pool" for 32bit pv-domUs.
>>> When starting a 32-bit domU, allocate memory from this pool.  If starting
>>> a
>>> 64-bit domUs or 32bit hvm dom (which don't suffer the 128G boundary
>>> limitation), allocate memory from above the boundary first, only
>>> allocating
>>> from the lower pool when needed.
>>>  
>>> Thanks,
>>> James (Song Wei)
>>>  
>> 
>> 
>> _______________________________________________
>> Xen-devel mailing list
>> Xen-devel@lists.xensource.com
>> http://lists.xensource.com/xen-devel
>> 
>>