From mboxrd@z Thu Jan  1 00:00:00 1970
From: Dario Faggioli <dario.faggioli@citrix.com>
Subject: Re: [for-4.9] Re: HVM guest performance regression
Date: Thu, 8 Jun 2017 23:00:34 +0200
Message-ID: <1496955634.26212.6.camel@citrix.com>
References: <55443407-5d99-0830-e8e0-6c2044c18ec9@suse.com>
 <22824.21930.185651.403388@mariner.uk.xensource.com>
 <2e6d9143-1abe-2f99-155f-f1071245ca41@suse.com>
 <alpine.DEB.2.10.1705261201010.18759@sstabellini-ThinkPad-X260>
 <77637aaf-0c2c-fe90-2e37-3211ea9026e7@suse.com>
 <alpine.DEB.2.10.1706060930460.10022@sstabellini-ThinkPad-X260>
 <5de5e464-ae54-30b4-7a97-0a2dcbf91416@suse.com>
 <alpine.DEB.2.10.1706061202290.15791@sstabellini-ThinkPad-X260>
 <294d36b9-0ebb-647d-ecfa-7a4e2c0ada47@suse.com>
 <alpine.DEB.2.10.1706071109510.26108@sstabellini-ThinkPad-X260>
 <16819156-5a02-1f21-83c5-70507eed7a4b@suse.com>
Mime-Version: 1.0
Content-Type: multipart/mixed; boundary="===============5951949598689501972=="
Return-path: <xen-devel-bounces@lists.xen.org>
Received: from mail6.bemta5.messagelabs.com ([195.245.231.135])
 by lists.xenproject.org with esmtp (Exim 4.84_2)
 (envelope-from <prvs=3259f3d02=dario.faggioli@citrix.com>)
 id 1dJ4Xu-0008IC-2O
 for xen-devel@lists.xenproject.org; Thu, 08 Jun 2017 21:00:46 +0000
In-Reply-To: <16819156-5a02-1f21-83c5-70507eed7a4b@suse.com>
List-Unsubscribe: <https://lists.xen.org/cgi-bin/mailman/options/xen-devel>,
 <mailto:xen-devel-request@lists.xen.org?subject=unsubscribe>
List-Post: <mailto:xen-devel@lists.xen.org>
List-Help: <mailto:xen-devel-request@lists.xen.org?subject=help>
List-Subscribe: <https://lists.xen.org/cgi-bin/mailman/listinfo/xen-devel>,
 <mailto:xen-devel-request@lists.xen.org?subject=subscribe>
Errors-To: xen-devel-bounces@lists.xen.org
Sender: "Xen-devel" <xen-devel-bounces@lists.xen.org>
To: Juergen Gross <jgross@suse.com>, Stefano Stabellini <sstabellini@kernel.org>
Cc: xen-devel <xen-devel@lists.xenproject.org>, Ian Jackson <ian.jackson@eu.citrix.com>, Wei Liu <wei.liu2@citrix.com>
List-Id: xen-devel@lists.xenproject.org

--===============5951949598689501972==
Content-Type: multipart/signed; micalg=pgp-sha256;
	protocol="application/pgp-signature"; boundary="=-szEUrPixVL0tLMwX5ABv"

--=-szEUrPixVL0tLMwX5ABv
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Bringing in Konrad because...

On Thu, 2017-06-08 at 11:37 +0200, Juergen Gross wrote:
> On 07/06/17 20:19, Stefano Stabellini wrote:
> > On Wed, 7 Jun 2017, Juergen Gross wrote:
> > > On 06/06/17 21:08, Stefano Stabellini wrote:
> > > >=20
> > > > 2) PV suspend/resume
> > > > 3) vector callback
> > > > 4) interrupt remapping
> > > >=20
> > > > 2) is not on the hot path.
> > > > I did individual measurements of 3) at some points and it was a
> > > > clear win.
> > >=20
> > > That might depend on the hardware. Could it be newer processors
> > > are
> > > faster here?
> >=20
> > I don't think so: the alternative it's an emulated interrupt. It's
> > slower under all points of view.
>=20
> What about APIC virtualization of modern processors? Are you sure
> e.g.
> timer interrupts aren't handled completely by the processor? I guess
> this might be faster than letting it be handled by the hypervisor and
> then use the callback into the guest.
>=20
... I kind of remember an email exchange we had, not here on the list,
but in private, about some apparently weird scheduling behavior you
were seeing, there at Oracle, on a particular benchmark/customer's
workload.

Not that this is directly related, but I seem to also recall that you
managed to find out that some of the perf difference (between baremetal
and guest) was due to vAPIC being faster than the PV path we were
taking? What I don't recall, though, is whether your guest was PV or
(PV)HVM... Do you remember anything more precisely than this?

It was like one or two years ago... (I'll dig in the archives for the
emails.)

Regards,
Dario
--=20
<<This happens because I choose it to happen!>> (Raistlin Majere)
-----------------------------------------------------------------
Dario Faggioli, Ph.D, http://about.me/dario.faggioli
Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK)
--=-szEUrPixVL0tLMwX5ABv
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: This is a digitally signed message part
Content-Transfer-Encoding: 7bit

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQIcBAABCAAGBQJZObryAAoJEBZCeImluHPuougQAOfMaDOcNEVzQXOUI3LK2LVG
Rt1BL709ufiQqVopYdCu5VVK2oq3UOR/T/CixbZ8rK/rdo5zBaPnRFg6WbB8qGAM
czw03O6ubyJiDsFWsrta2gM4nj4aVca9cJYikOvrB7Fk4XqGXDd3wAUzLVJdQINU
apuMLNouDHD1NGRXhdvrmRHs+HSTpkK7urhgmlQyRqLNiYiEZPH7riVr+Ba37xkQ
dchqsl1b3TmnF5EMC8b7wRa+FuS7OQW3wslY5Zc6HrpLUP8oDFaFi0L3mgl0mFIa
/fRzbkXDxYff6l2XmXAgmKu3mxW/zC6C/HfQar67Kmr2KPvGe1ZOCrWZ6k2rrvop
+UAE2gAio8YDZzlNRVtVM/hOTB24WCCKmm5TSdP/0/ZCWePqm3jDI/fZ0RW5n3Pc
kLjTW8vxbwWDx69V5/9tMiewOCwJHNP6qsJ5cKxAVLbkehaFwxjSb9rmkA329yuL
VYr1ZSkGrVN2h954HWYszZZZ+6ppnlMdRoaVFZmExXWcczK0UnD8Apw6hHYhazet
AsFJ0kmjhc7s2x37hFMGM1xrcS6U94HUJjPT8v9vyjrpcfnOyLOOW5dtrTCyIE2y
VBv/E66VgYEBxoMBhZBouCHK2jA/Qr8BvFCTPScAxyn2qId5Rm7Yu4POlH4tgSid
/eJWsT+JyF2tO2zUCv3l
=L1ko
-----END PGP SIGNATURE-----

--=-szEUrPixVL0tLMwX5ABv--


--===============5951949598689501972==
Content-Type: text/plain; charset="utf-8"
MIME-Version: 1.0
Content-Transfer-Encoding: base64
Content-Disposition: inline

X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KWGVuLWRldmVs
IG1haWxpbmcgbGlzdApYZW4tZGV2ZWxAbGlzdHMueGVuLm9yZwpodHRwczovL2xpc3RzLnhlbi5v
cmcveGVuLWRldmVsCg==

--===============5951949598689501972==--