From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.6 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id EDA2AC433B4 for ; Mon, 19 Apr 2021 12:47:42 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 68C266100A for ; Mon, 19 Apr 2021 12:47:42 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 68C266100A Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=linaro.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:58618 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lYTJV-0001WW-HK for qemu-devel@archiver.kernel.org; Mon, 19 Apr 2021 08:47:41 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:36330) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lYTGt-00077J-S4 for qemu-devel@nongnu.org; Mon, 19 Apr 2021 08:44:59 -0400 Received: from mail-ej1-x62e.google.com ([2a00:1450:4864:20::62e]:40607) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1lYTGr-0001v9-AW for qemu-devel@nongnu.org; Mon, 19 Apr 2021 08:44:59 -0400 Received: by mail-ej1-x62e.google.com with SMTP id n2so52667206ejy.7 for ; Mon, 19 Apr 2021 05:44:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=r+4YS2jiMHy4nwP29Z7JJT43gL2LSs43y+nHRLRJFYM=; b=quvIMdTyvM/pqM7PWwN9okalcjEr6rJtyKwnTNShZwaJs/vxI0oCszJymQ7mZeXU6y hQ389a9vxrCMoSeRpHqOFWzjctJgcygzOgsZbIGV3idyCV7xxBazLjDoP2gGX/ksUATq ZaYYXi77imuzevWMIhCaLvaHELTyMamgCW2gSo2UXt9iMaDk9IT0tWSOtqxXH0kw4VPA uZTkyu8hT0kVhqBO2le38ZLTBTUmegNPoywyCyBRWssyX0zCn+OqDrfqhvRcmWsW8TL1 7OfY62bER7d5T7bW1ymK5krPlh3db5IeyV7ARbomR7ARhQRDsG87uow9HaxfVO7mOPZl 8J1Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=r+4YS2jiMHy4nwP29Z7JJT43gL2LSs43y+nHRLRJFYM=; b=K8/00VyvvMIfzJezZcmQaDoIWC+wDFPW+t7GsWtQN+Baua5WS3n8aSHRfVwFjxXKHp XpI+Lzul8P82J36LBjut6OFsQ+o9IDgsDafJ9X0dRmjlx+9o8vZrF/yVG8pHlnOsUnjd PLU42vqFovVV2OE8EA9Lnjamr3h4Fj3qkMEVnablRIImMj+Xp0IQb3YbBwIWAfcW6hSd hHG20IMWwQLsCeLTU7rMj/lQmr1nIr1vE6u8VL1ZEMHzEhNRSJJB1jOzMyM29WcW8mW3 FRx/dm39y9ot6wB9d9QDSudYnxfTWSltQEO2srh3VuUWrDr1DFMI3jeVY5rWpIiVU7iv j0Dw== X-Gm-Message-State: AOAM533uvgTpNNeem3djhB1PVOOjxSLz6dGkBSddbh0bjwakmvKwiphR Ew/qb2Jry6hMSXoR53twDdLXLAi0LfKhIWJiX06ICg== X-Google-Smtp-Source: ABdhPJxSGGGQqD/cS2PX3l3vxN/wOJphYRc9rArQYcW6V/8FSU+9afKCYjOF6siNG/Wx5JMAKx+0n5txB9YHvL444bs= X-Received: by 2002:a17:906:6d41:: with SMTP id a1mr14713067ejt.482.1618836295644; Mon, 19 Apr 2021 05:44:55 -0700 (PDT) MIME-Version: 1.0 References: <20210401024152.203896-1-shashi.mallela@linaro.org> <20210401024152.203896-7-shashi.mallela@linaro.org> In-Reply-To: <20210401024152.203896-7-shashi.mallela@linaro.org> From: Peter Maydell Date: Mon, 19 Apr 2021 13:44:04 +0100 Message-ID: Subject: Re: [PATCH v2 6/8] hw/intc: GICv3 redistributor ITS processing To: Shashi Mallela Content-Type: text/plain; charset="UTF-8" Received-SPF: pass client-ip=2a00:1450:4864:20::62e; envelope-from=peter.maydell@linaro.org; helo=mail-ej1-x62e.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Leif Lindholm , QEMU Developers , qemu-arm , Radoslaw Biernacki Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" On Thu, 1 Apr 2021 at 03:41, Shashi Mallela wrote: > > Implemented lpi processing at redistributor to get lpi config info > from lpi configuration table,determine priority,set pending state in > lpi pending table and forward the lpi to cpuif.Added logic to invoke > redistributor lpi processing with translated LPI which set/clear LPI > from ITS device as part of ITS INT,CLEAR,DISCARD command and > GITS_TRANSLATER processing. Nit: commas should all have a space following. > > Signed-off-by: Shashi Mallela > --- > hw/intc/arm_gicv3.c | 6 ++ > hw/intc/arm_gicv3_cpuif.c | 15 +++-- > hw/intc/arm_gicv3_its.c | 9 ++- > hw/intc/arm_gicv3_redist.c | 124 +++++++++++++++++++++++++++++++++++++ > hw/intc/gicv3_internal.h | 9 +++ > 5 files changed, 158 insertions(+), 5 deletions(-) > > diff --git a/hw/intc/arm_gicv3.c b/hw/intc/arm_gicv3.c > index 66eaa97198..618fa1af95 100644 > --- a/hw/intc/arm_gicv3.c > +++ b/hw/intc/arm_gicv3.c > @@ -166,6 +166,12 @@ static void gicv3_redist_update_noirqset(GICv3CPUState *cs) > cs->hppi.grp = gicv3_irq_group(cs->gic, cs, cs->hppi.irq); > } > > + if (cs->gic->lpi_enable) { > + if (gicv3_redist_update_lpi(cs)) { > + seenbetter = true; > + } > + } > + > /* If the best interrupt we just found would preempt whatever > * was the previous best interrupt before this update, then > * we know it's definitely the best one now. > diff --git a/hw/intc/arm_gicv3_cpuif.c b/hw/intc/arm_gicv3_cpuif.c > index 43ef1d7a84..c225b80f66 100644 > --- a/hw/intc/arm_gicv3_cpuif.c > +++ b/hw/intc/arm_gicv3_cpuif.c > @@ -899,9 +899,14 @@ static void icc_activate_irq(GICv3CPUState *cs, int irq) > cs->gicr_ipendr0 = deposit32(cs->gicr_ipendr0, irq, 1, 0); > gicv3_redist_update(cs); > } else { > - gicv3_gicd_active_set(cs->gic, irq); > - gicv3_gicd_pending_clear(cs->gic, irq); > - gicv3_update(cs->gic, irq, 1); > + if (irq >= GICV3_LPI_INTID_START) { > + gicv3_redist_lpi_pending(cs, irq, 0); > + gicv3_redist_update(cs); > + } else { > + gicv3_gicd_active_set(cs->gic, irq); > + gicv3_gicd_pending_clear(cs->gic, irq); > + gicv3_update(cs->gic, irq, 1); > + } > } > } > > @@ -1337,7 +1342,9 @@ static void icc_eoir_write(CPUARMState *env, const ARMCPRegInfo *ri, > * valid interrupt value read from the Interrupt Acknowledge > * register" and so this is UNPREDICTABLE. We choose to ignore it. > */ > - return; > + if (!(cs->gic->lpi_enable && (irq >= GICV3_LPI_INTID_START))) { > + return; > + } This condition is in the wrong place. I think what you are trying to do is modify "what is the set of numbers we consider to be valid IRQ numbers", in which case you want to be changing the outer "if (irq >= cs->gic->num_irq)" condition, not adding an extra one inside it. More importantly, the thing this condition is guarding is that the code below it assumes that IRQ numbers are in range for the GIC's own internal non-LPI interrupts. If you allow numbers >= cs->gic->num_irq through, then you will get array overruns when icc_deactivate_irq() tries to clear its Active bit. > } > > if (icc_highest_active_group(cs) != grp) { > diff --git a/hw/intc/arm_gicv3_its.c b/hw/intc/arm_gicv3_its.c > index 0e3f176809..41e1e8b2a8 100644 > --- a/hw/intc/arm_gicv3_its.c > +++ b/hw/intc/arm_gicv3_its.c > @@ -226,6 +226,7 @@ static MemTxResult process_int(GICv3ITSState *s, uint64_t value, > bool ite_valid = false; > uint64_t cte = 0; > bool cte_valid = false; > + uint64_t rdbase; > uint8_t buff[ITS_ITT_ENTRY_SIZE]; > uint64_t itt_addr; > > @@ -278,12 +279,18 @@ static MemTxResult process_int(GICv3ITSState *s, uint64_t value, > * since with a physical address the target address must be > * 64KB aligned > */ > - > + rdbase = (cte >> 1U) & RDBASE_MASK; What's going on here? Shouldn't this be in a previous patch ? > /* > * Current implementation only supports rdbase == procnum > * Hence rdbase physical address is ignored > */ > } else { > + rdbase = (cte >> 1U) & RDBASE_PROCNUM_MASK; > + if ((cmd == CLEAR) || (cmd == DISCARD)) { > + gicv3_redist_process_lpi(&s->gicv3->cpu[rdbase], pIntid, 0); > + } else { > + gicv3_redist_process_lpi(&s->gicv3->cpu[rdbase], pIntid, 1); > + } > > if (cmd == DISCARD) { > /* remove mapping from interrupt translation table */ > diff --git a/hw/intc/arm_gicv3_redist.c b/hw/intc/arm_gicv3_redist.c > index 325b974e70..71c648a616 100644 > --- a/hw/intc/arm_gicv3_redist.c > +++ b/hw/intc/arm_gicv3_redist.c > @@ -254,6 +254,8 @@ static MemTxResult gicr_writel(GICv3CPUState *cs, hwaddr offset, > if (cs->gicr_typer & GICR_TYPER_PLPIS) { > if (value & GICR_CTLR_ENABLE_LPIS) { > cs->gicr_ctlr |= GICR_CTLR_ENABLE_LPIS; > + /* Check for any pending interr in pending table */ > + gicv3_redist_update(cs); > } else { > cs->gicr_ctlr &= ~GICR_CTLR_ENABLE_LPIS; > } > @@ -548,6 +550,128 @@ MemTxResult gicv3_redist_write(void *opaque, hwaddr offset, uint64_t data, > return r; > } > > +bool gicv3_redist_update_lpi(GICv3CPUState *cs) Could we have a comment explaining what this function does, please ? > +{ > + AddressSpace *as = &cs->gic->sysmem_as; > + uint64_t lpict_baddr, lpipt_baddr; > + uint32_t pendt_size = 0; > + uint8_t lpite; > + uint8_t prio, pend; > + int i; > + bool seenbetter = false; > + > + if ((!cs->gicr_ctlr & GICR_CTLR_ENABLE_LPIS) || !cs->gicr_propbaser || > + !cs->gicr_pendbaser || cs->lpi_outofrange) { > + return seenbetter; > + } > + > + lpict_baddr = FIELD_EX64(cs->gicr_propbaser, GICR_PROPBASER, PHYADDR); > + lpict_baddr <<= R_GICR_PROPBASER_PHYADDR_SHIFT; > + > + lpipt_baddr = FIELD_EX64(cs->gicr_pendbaser, GICR_PENDBASER, PHYADDR); > + lpipt_baddr <<= R_GICR_PENDBASER_PHYADDR_SHIFT; > + > + /* Determine the highest priority pending interrupt among LPIs */ > + pendt_size = (1UL << (FIELD_EX64(cs->gicr_propbaser, GICR_PROPBASER, > + IDBITS) - 1)); This is where you should be handling "actually the table is empty" or "table size is capped at the implementation's maximum size". > + > + for (i = 0; i < pendt_size; i++) { > + address_space_read(as, lpipt_baddr + > + (((GICV3_LPI_INTID_START + i) / 8) * sizeof(pend)), > + MEMTXATTRS_UNSPECIFIED, &pend, sizeof(pend)); > + > + if ((1 << ((GICV3_LPI_INTID_START + i) % 8)) & pend) { > + address_space_read(as, lpict_baddr + (i * sizeof(lpite)), > + MEMTXATTRS_UNSPECIFIED, &lpite, sizeof(lpite)); > + > + prio = ((lpite >> LPI_CTE_PRIORITY_OFFSET) & > + LPI_CTE_PRIORITY_MASK); > + prio &= LPI_PRIORITY_MASK; > + > + if (prio < cs->hppi.prio) { > + cs->hppi.irq = GICV3_LPI_INTID_START + i; > + cs->hppi.prio = prio; > + /* LPIs are always non-secure Grp1 interrupts */ > + cs->hppi.grp = GICV3_G1NS; > + seenbetter = true; > + } > + } > + } Oof. How big is an LPI configuration table, typically? I'm not sure we want to be scanning the entire LPI configuration table in guest memory for every time gicv3_redist_update() is called if we can avoid it. A bit of benchmarking of how much this slows down emulation might be interesting. > + return seenbetter; > +} > + > +void gicv3_redist_lpi_pending(GICv3CPUState *cs, int irq, int level) > +{ > + AddressSpace *as = &cs->gic->sysmem_as; > + uint64_t lpipt_baddr; > + bool ispend = false; > + uint8_t pend; > + > + /* > + * get the bit value corresponding to this irq in the > + * lpi pending table > + */ > + lpipt_baddr = FIELD_EX64(cs->gicr_pendbaser, GICR_PENDBASER, PHYADDR); > + lpipt_baddr <<= R_GICR_PENDBASER_PHYADDR_SHIFT; > + > + address_space_read(as, lpipt_baddr + ((irq / 8) * sizeof(pend)), > + MEMTXATTRS_UNSPECIFIED, &pend, sizeof(pend)); > + ispend = ((pend >> (irq % 8)) & 0x1); > + > + if (ispend) { > + if (!level) { > + /* > + * clear the pending bit and update the lpi pending table > + */ > + pend &= ~(1 << (irq % 8)); > + > + address_space_write(as, lpipt_baddr + ((irq / 8) * sizeof(pend)), > + MEMTXATTRS_UNSPECIFIED, &pend, sizeof(pend)); > + } > + } else { > + if (level) { > + /* > + * if pending bit is not already set for this irq,turn-on the > + * pending bit and update the lpi pending table > + */ > + pend |= (1 << (irq % 8)); > + > + address_space_write(as, lpipt_baddr + ((irq / 8) * sizeof(pend)), > + MEMTXATTRS_UNSPECIFIED, &pend, sizeof(pend)); > + } > + } > +} > > +void gicv3_redist_process_lpi(GICv3CPUState *cs, int irq, int level) > +{ > + AddressSpace *as = &cs->gic->sysmem_as; > + uint64_t lpict_baddr; > + uint8_t lpite; > + > + if ((!cs->gicr_ctlr & GICR_CTLR_ENABLE_LPIS) || !cs->gicr_propbaser || > + !cs->gicr_pendbaser || cs->lpi_outofrange) { > + return; > + } > + > + lpict_baddr = FIELD_EX64(cs->gicr_propbaser, GICR_PROPBASER, PHYADDR); > + lpict_baddr <<= R_GICR_PROPBASER_PHYADDR_SHIFT; > + > + /* get the lpi config table entry corresponding to this irq */ > + address_space_read(as, lpict_baddr + ((irq - GICV3_LPI_INTID_START) * > + sizeof(lpite)), MEMTXATTRS_UNSPECIFIED, > + &lpite, sizeof(lpite)); > + > + /* check if this irq is enabled before proceeding further */ > + if (!(lpite & LPI_CTE_ENABLED)) { > + return; > + } > + > + /* set/clear the pending bit for this irq */ > + gicv3_redist_lpi_pending(cs, irq, level); > + > + gicv3_redist_update(cs); > +} > + > void gicv3_redist_set_irq(GICv3CPUState *cs, int irq, int level) > { > /* Update redistributor state for a change in an external PPI input line */ > diff --git a/hw/intc/gicv3_internal.h b/hw/intc/gicv3_internal.h > index a2718704d4..4c97c22850 100644 > --- a/hw/intc/gicv3_internal.h > +++ b/hw/intc/gicv3_internal.h > @@ -306,6 +306,12 @@ FIELD(GITS_TYPER, CIL, 36, 1) > > #define L1TABLE_ENTRY_SIZE 8 > > +#define LPI_CTE_ENABLE_OFFSET 0 > +#define LPI_CTE_ENABLED VALID_MASK > +#define LPI_CTE_PRIORITY_OFFSET 2 > +#define LPI_CTE_PRIORITY_MASK ((1U << 6) - 1) > +#define LPI_PRIORITY_MASK 0xfc > + > #define GITS_CMDQ_ENTRY_SIZE 32 > #define NUM_BYTES_IN_DW 8 > > @@ -444,6 +450,9 @@ MemTxResult gicv3_redist_write(void *opaque, hwaddr offset, uint64_t data, > unsigned size, MemTxAttrs attrs); > void gicv3_dist_set_irq(GICv3State *s, int irq, int level); > void gicv3_redist_set_irq(GICv3CPUState *cs, int irq, int level); > +void gicv3_redist_process_lpi(GICv3CPUState *cs, int irq, int level); > +void gicv3_redist_lpi_pending(GICv3CPUState *cs, int irq, int level); > +bool gicv3_redist_update_lpi(GICv3CPUState *cs); > void gicv3_redist_send_sgi(GICv3CPUState *cs, int grp, int irq, bool ns); > void gicv3_init_cpuif(GICv3State *s); thanks -- PMM