From: Greg Kurz <groug@kaod.org>
To: "Cédric Le Goater" <clg@kaod.org>
Cc: Gustavo Romero <gromero@linux.ibm.com>,
qemu-ppc@nongnu.org, qemu-devel@nongnu.org,
David Gibson <david@gibson.dropbear.id.au>
Subject: Re: [PATCH v2 4/6] spapr/xive: Enforce load-after-store ordering
Date: Tue, 6 Oct 2020 19:02:22 +0200 [thread overview]
Message-ID: <20201006190222.2db087a6@bahia.lan> (raw)
In-Reply-To: <20201005165147.526426-5-clg@kaod.org>
On Mon, 5 Oct 2020 18:51:45 +0200
Cédric Le Goater <clg@kaod.org> wrote:
> The XIVE_ESB_SET_PQ_10 load operation is used to disable temporarily
> an interrupt source. If StoreEOI is active, a source could be left
> enabled if the load and store operations come out of order.
>
> QEMU makes use of this offset to quiesce the sources before a
> migration. Enforce the load-after-store ordering always when doing so
> without querying the characteristics of the sources on the host. The
> performance penalty will be very small for QEMU.
>
> Signed-off-by: Cédric Le Goater <clg@kaod.org>
> ---
Reviewed-by: Greg Kurz <groug@kaod.org>
> include/hw/ppc/xive.h | 8 ++++++++
> hw/intc/spapr_xive_kvm.c | 12 ++++++++++++
> hw/intc/xive.c | 6 ++++++
> 3 files changed, 26 insertions(+)
>
> diff --git a/include/hw/ppc/xive.h b/include/hw/ppc/xive.h
> index 445eccfe6b73..39cd273f86d5 100644
> --- a/include/hw/ppc/xive.h
> +++ b/include/hw/ppc/xive.h
> @@ -279,6 +279,14 @@ static inline hwaddr xive_source_esb_mgmt(XiveSource *xsrc, int srcno)
> #define XIVE_ESB_SET_PQ_10 0xe00 /* Load */
> #define XIVE_ESB_SET_PQ_11 0xf00 /* Load */
>
> +/*
> + * Load-after-store ordering
> + *
> + * Adding this offset to the load address will enforce
> + * load-after-store ordering. This is required to use with StoreEOI.
> + */
> +#define XIVE_ESB_LD_ST_MO 0x40 /* Load-after-store ordering */
> +
> uint8_t xive_source_esb_get(XiveSource *xsrc, uint32_t srcno);
> uint8_t xive_source_esb_set(XiveSource *xsrc, uint32_t srcno, uint8_t pq);
>
> diff --git a/hw/intc/spapr_xive_kvm.c b/hw/intc/spapr_xive_kvm.c
> index 66bf4c06fe55..d428422a7b72 100644
> --- a/hw/intc/spapr_xive_kvm.c
> +++ b/hw/intc/spapr_xive_kvm.c
> @@ -357,6 +357,18 @@ static uint64_t xive_esb_rw(XiveSource *xsrc, int srcno, uint32_t offset,
>
> static uint8_t xive_esb_read(XiveSource *xsrc, int srcno, uint32_t offset)
> {
> + /*
> + * The XIVE_ESB_SET_PQ_10 load operation is used to disable
> + * temporarily an interrupt source. If StoreEOI is active, a
> + * source could be left enabled if the load and store operations
> + * come out of order.
> + *
> + * Enforce the load-after-store ordering always.
> + */
> + if (offset == XIVE_ESB_SET_PQ_10) {
> + offset |= XIVE_ESB_LD_ST_MO;
> + }
> +
> return xive_esb_rw(xsrc, srcno, offset, 0, 0) & 0x3;
> }
>
> diff --git a/hw/intc/xive.c b/hw/intc/xive.c
> index 489e6256ef70..b710ba2df095 100644
> --- a/hw/intc/xive.c
> +++ b/hw/intc/xive.c
> @@ -998,6 +998,12 @@ static uint64_t xive_source_esb_read(void *opaque, hwaddr addr, unsigned size)
> case XIVE_ESB_SET_PQ_01 ... XIVE_ESB_SET_PQ_01 + 0x0FF:
> case XIVE_ESB_SET_PQ_10 ... XIVE_ESB_SET_PQ_10 + 0x0FF:
> case XIVE_ESB_SET_PQ_11 ... XIVE_ESB_SET_PQ_11 + 0x0FF:
> + if (offset == XIVE_ESB_SET_PQ_10 &&
> + xsrc->esb_flags & XIVE_SRC_STORE_EOI) {
> + qemu_log_mask(LOG_GUEST_ERROR, "XIVE: load-after-store ordering "
> + "not enforced with Store EOI active for IRQ %d\n",
> + srcno);
> + }
> ret = xive_source_esb_set(xsrc, srcno, (offset >> 8) & 0x3);
> break;
> default:
next prev parent reply other threads:[~2020-10-06 17:03 UTC|newest]
Thread overview: 29+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-10-05 16:51 [PATCH v2 0/6] spapr/xive: Activate StoreEOI in P10 compat guests Cédric Le Goater
2020-10-05 16:51 ` [PATCH v2 1/6] spapr/xive: Introduce a StoreEOI capability Cédric Le Goater
2020-10-06 16:42 ` Greg Kurz
2020-10-07 5:59 ` Cédric Le Goater
2020-10-07 7:24 ` Greg Kurz
2020-10-05 16:51 ` [PATCH v2 2/6] spapr/xive: Add a warning when StoreEOI is activated on POWER8 CPUs Cédric Le Goater
2020-10-06 16:52 ` Greg Kurz
2020-10-05 16:51 ` [PATCH v2 3/6] spapr/xive: Add a warning when StoreEOI is activated on POWER9 CPUs Cédric Le Goater
2020-10-06 16:58 ` Greg Kurz
2020-10-06 17:03 ` Cédric Le Goater
2020-10-07 8:56 ` Greg Kurz
2020-10-07 9:21 ` Cédric Le Goater
2020-10-05 16:51 ` [PATCH v2 4/6] spapr/xive: Enforce load-after-store ordering Cédric Le Goater
2020-10-06 17:02 ` Greg Kurz [this message]
2020-10-05 16:51 ` [PATCH v2 5/6] spapr/xive: Activate StoreEOI at the source level Cédric Le Goater
2020-10-06 17:06 ` Greg Kurz
2020-10-06 17:41 ` Cédric Le Goater
2020-10-07 7:26 ` Greg Kurz
2020-10-05 16:51 ` [PATCH v2 6/6] spapr/xive: Introduce a new CAS value for the StoreEOI capability Cédric Le Goater
2020-10-06 17:39 ` Greg Kurz
2020-10-06 17:56 ` Cédric Le Goater
2020-10-07 13:43 ` Greg Kurz
2020-10-07 14:28 ` Cédric Le Goater
2020-10-09 0:23 ` [PATCH v2 0/6] spapr/xive: Activate StoreEOI in P10 compat guests David Gibson
2020-10-09 5:57 ` Cédric Le Goater
2020-10-12 5:38 ` David Gibson
2020-11-02 13:22 ` Cédric Le Goater
2020-11-23 6:44 ` David Gibson
2020-11-23 11:16 ` Cédric Le Goater
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20201006190222.2db087a6@bahia.lan \
--to=groug@kaod.org \
--cc=clg@kaod.org \
--cc=david@gibson.dropbear.id.au \
--cc=gromero@linux.ibm.com \
--cc=qemu-devel@nongnu.org \
--cc=qemu-ppc@nongnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).