From mboxrd@z Thu Jan  1 00:00:00 1970
From: Ian Campbell <ian.campbell@citrix.com>
Subject: Re: [PATCH V6 00/10] Support more than 8 vcpus on arm64
 with GICv3
Date: Fri, 5 Jun 2015 16:15:29 +0100
Message-ID: <1433517329.7108.320.camel@citrix.com>
References: <1433163388-16970-1-git-send-email-cbz@baozis.org>
	<1433513313.7108.316.camel@citrix.com> <5571B414.7090105@citrix.com>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Return-path: <xen-devel-bounces@lists.xen.org>
Received: from mail6.bemta14.messagelabs.com ([193.109.254.103])
	by lists.xen.org with esmtp (Exim 4.72)
	(envelope-from <prvs=591267e2d=Ian.Campbell@citrix.com>)
	id 1Z0tLY-0004V8-LN
	for xen-devel@lists.xenproject.org; Fri, 05 Jun 2015 15:15:48 +0000
In-Reply-To: <5571B414.7090105@citrix.com>
List-Unsubscribe: <http://lists.xen.org/cgi-bin/mailman/options/xen-devel>,
	<mailto:xen-devel-request@lists.xen.org?subject=unsubscribe>
List-Post: <mailto:xen-devel@lists.xen.org>
List-Help: <mailto:xen-devel-request@lists.xen.org?subject=help>
List-Subscribe: <http://lists.xen.org/cgi-bin/mailman/listinfo/xen-devel>,
	<mailto:xen-devel-request@lists.xen.org?subject=subscribe>
Sender: xen-devel-bounces@lists.xen.org
Errors-To: xen-devel-bounces@lists.xen.org
To: Julien Grall <julien.grall@citrix.com>
Cc: xen-devel@lists.xenproject.org, Chen Baozi <baozich@gmail.com>, Chen Baozi <cbz@baozis.org>
List-Id: xen-devel@lists.xenproject.org

On Fri, 2015-06-05 at 15:37 +0100, Julien Grall wrote:
> On 05/06/15 15:08, Ian Campbell wrote:
> > On Mon, 2015-06-01 at 20:56 +0800, Chen Baozi wrote:
> >> From: Chen Baozi <baozich@gmail.com>
> >>
> >> Currently the number of vcpus on arm64 with GICv3 is limited up to 8 due
> >> to the fixed size of redistributor mmio region.
> > 
> > Are we talking about only guests here or are hosts impacted too somehow?
> 
> Guest only. The GICv3 driver should already supports 128 CPUs (though
> never tested).
> 
> >>  Increasing the size
> >> makes the number expand to 16 because of AFF0 restriction on GICv3.
> > 
> > Can you give a reference for this please? "AFF0" doesn't appear anywhere
> > in my gic v3 spec, and "4.2.2 Interrupt Routing in GICv3 Systems"
> > implies 256 processors at each affinity level (which is what I
> > expected).
> 
> 5.7.29 ICC_SGI0R_EL1, ICC_SGI1R_EL1 and ICC_ASGI1R_EL1:
> 
> "Note: this restricts distribution of SGIs to the first 16 processors of
> an affinity 1 cluster".

Thanks, they really buried the lead on that one, the section introducing
affinity hierarchy doesn't even hint at this limit!

> 
> Therefore any CPU using AFF0 >= 16 would never receive SGI.
> 
> FWIW, Linux is shouting loud when the AFF0 is too high. Xen does the
> same thing in the GICv3 drivers.
> 
> 
> Regards,
>