From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0D1A2C433F5 for ; Wed, 29 Sep 2021 03:57:11 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 4446B613D0 for ; Wed, 29 Sep 2021 03:57:10 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 4446B613D0 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=nongnu.org Received: from localhost ([::1]:45786 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mVQiT-00059k-Bb for qemu-devel@archiver.kernel.org; Tue, 28 Sep 2021 23:57:09 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:39084) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mVQhc-0004NV-2n; Tue, 28 Sep 2021 23:56:16 -0400 Received: from mail-io1-xd2c.google.com ([2607:f8b0:4864:20::d2c]:36671) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mVQhZ-0002C7-GJ; Tue, 28 Sep 2021 23:56:15 -0400 Received: by mail-io1-xd2c.google.com with SMTP id e144so1424577iof.3; Tue, 28 Sep 2021 20:56:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=ZgKwpIYSx0FSaimaQCg5wymASrLd6PZH46sBxCOzPCU=; b=B4/ED6Vk3BBg+9OGDetNCSC9lSz21jQUji/H76oOF1a2dZVZfIUOjbUdDkzj5o7v0V Z7uo7ZPHEGl/TlR1HaYAT5Qp5PgyW/OlrmODlZVMb/YmnWOJhzEdN89wqMRBBaTIn94G Q2hlxnFoETkColbjxE6gtk1wQoCSnt7PabF0zIf4KAm+qsA93RMfYFszmG6J+2/RHcHz sjMykygboKe8Ip10b/xBb3KJWVuNuyX8vI2RostEoUOr1+JfKsEHU0YpBRzfZFU421Jy 6PQBTxj4x5owlLUvmWC+yqeme1mStup6lHJSzSoqfEwvXXU/2qU0Uqh83ettUGYHLmsM CZxQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=ZgKwpIYSx0FSaimaQCg5wymASrLd6PZH46sBxCOzPCU=; b=cG32AzleBUkKZoaRq6nlA4SpW7yHddEiM95ii9YMUejM7z2ZzFIW9Z+Gh1pU6jJtH5 MWKX04hbCSl72/ibHZFcBoynxwqyMOJJIr8/Y4NJn+ji6TK3Rk6jl5yR8joXw63BCr27 97wv9CpSE8fMLDqzpH4IvbVRB5bkOlE7VysWdR8lv9gUNSHq08hNlXO7MHF9vg19cTgt ozE8m6OCJHIh/2l+5eRrfnxeyhTeUb82X8eYIZdAbPs2yAdqTDQbjs2UQ8avg48ua285 csLCOld1O31719CU6+l2rtLoVSt8yYgZFJlt8DN2CePWIl2EdZHy1MgbuooSDRs8PF8s napQ== X-Gm-Message-State: AOAM531vqRjM8Rby8Y0QNcIkXwO5JwPQNi/4fetkVvVy3u7sgKwnBuyw 4AaWR5aPoiLCqH11fQleLxKkZlc/WhkHTLN0JMU= X-Google-Smtp-Source: ABdhPJyMbWLtRITURa/aA5vmsPn0RvCUwUDV5AcyXzO9obEE7FUwLkIESRtjbFFYeiBugSZvarF73JZo60zJH3TOksY= X-Received: by 2002:a02:2124:: with SMTP id e36mr7476861jaa.35.1632887768874; Tue, 28 Sep 2021 20:56:08 -0700 (PDT) MIME-Version: 1.0 References: <20210409074857.166082-1-zhiwei_liu@c-sky.com> <20210409074857.166082-2-zhiwei_liu@c-sky.com> <20304ba9-6f87-f7b9-a24d-15d4b3d3f75a@c-sky.com> <3e7f6ec6-21a0-9a21-8126-68ea8c2fbf15@c-sky.com> In-Reply-To: From: Alistair Francis Date: Wed, 29 Sep 2021 13:55:43 +1000 Message-ID: Subject: Re: [RFC PATCH 01/11] target/riscv: Add CLIC CSR mintstatus To: Frank Chang Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=2607:f8b0:4864:20::d2c; envelope-from=alistair23@gmail.com; helo=mail-io1-xd2c.google.com X-Spam_score_int: -17 X-Spam_score: -1.8 X-Spam_bar: - X-Spam_report: (-1.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: "open list:RISC-V" , "qemu-devel@nongnu.org Developers" , wxy194768@alibaba-inc.com, Alistair Francis , Palmer Dabbelt , ShihPo Hung , LIU Zhiwei Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" On Tue, Sep 28, 2021 at 6:10 PM Frank Chang wrote: > > On Fri, Jul 2, 2021 at 3:17 PM Alistair Francis wr= ote: >> >> On Fri, Jul 2, 2021 at 4:11 PM LIU Zhiwei wrote: >> > >> > >> > On 2021/7/2 =E4=B8=8B=E5=8D=881:38, Alistair Francis wrote: >> > > On Thu, Jul 1, 2021 at 6:45 PM Frank Chang = wrote: >> > >> LIU Zhiwei =E6=96=BC 2021=E5=B9=B44=E6=9C=88= 20=E6=97=A5 =E9=80=B1=E4=BA=8C =E4=B8=8A=E5=8D=888:49=E5=AF=AB=E9=81=93=EF= =BC=9A >> > >>> >> > >>> On 2021/4/20 =E4=B8=8A=E5=8D=887:23, Alistair Francis wrote: >> > >>>> On Fri, Apr 9, 2021 at 5:52 PM LIU Zhiwei = wrote: >> > >>>>> CSR mintstatus holds the active interrupt level for each support= ed >> > >>>>> privilege mode. sintstatus, and user, uintstatus, provide restri= cted >> > >>>>> views of mintstatus. >> > >>>>> >> > >>>>> Signed-off-by: LIU Zhiwei >> > >>>>> --- >> > >>>>> target/riscv/cpu.h | 2 ++ >> > >>>>> target/riscv/cpu_bits.h | 11 +++++++++++ >> > >>>>> target/riscv/csr.c | 26 ++++++++++++++++++++++++++ >> > >>>>> 3 files changed, 39 insertions(+) >> > >>>>> >> > >>>>> diff --git a/target/riscv/cpu.h b/target/riscv/cpu.h >> > >>>>> index 0a33d387ba..1a44ca62c7 100644 >> > >>>>> --- a/target/riscv/cpu.h >> > >>>>> +++ b/target/riscv/cpu.h >> > >>>>> @@ -159,6 +159,7 @@ struct CPURISCVState { >> > >>>>> target_ulong mip; >> > >>>>> >> > >>>>> uint32_t miclaim; >> > >>>>> + uint32_t mintstatus; /* clic-spec */ >> > >>>>> >> > >>>>> target_ulong mie; >> > >>>>> target_ulong mideleg; >> > >>>>> @@ -243,6 +244,7 @@ struct CPURISCVState { >> > >>>>> >> > >>>>> /* Fields from here on are preserved across CPU reset. */ >> > >>>>> QEMUTimer *timer; /* Internal timer */ >> > >>>>> + void *clic; /* clic interrupt controller */ >> > >>>> This should be the CLIC type. >> > >>> OK. >> > >>> >> > >>> Actually there are many versions of CLIC in my branch as different >> > >>> devices. But it is better to use CLIC type for the upstream versio= n. >> > >> >> > >> Hi Alistair and Zhiwei, >> > >> >> > >> Replacing void *clic with RISCVCLICState *clic may create a circula= r loop >> > >> because CPURISCVState is also referenced in riscv_clic.h. >> > >> >> > >> However, I would like to ask what is the best approach to add >> > >> the reference of CLIC device in CPURISCVState struct? >> > >> >> > >> There may be different kinds of CLIC devices. >> > >> AFAK, there was another RFC patchset trying to add void *eclic >> > >> for Nuclei processor into CPURISCVState struct: >> > >> https://patchwork.kernel.org/project/qemu-devel/patch/2021050708165= 4.11056-2-wangjunqiang@iscas.ac.cn/ >> > >> >> > >> Is it okay to add the device reference directly into CPURISCVState = struct like that, >> > >> or we should create some abstraction for these CLIC devices? >> > >> (However, I'm not sure how big the differences are for these CLIC d= evices...) >> > > I would prefer to not have the CLIC in the struct at all. >> > > >> > > Why is the CLIC required from the CPU? >> > >> > In my opinion, the tight coupled interrupt controller, like NVIC in >> > ARM, is much different from other devices. >> > CPU harts need to communicate with it through many ways. >> >> Agreed. >> >> The difference with RISC-V is that we already have multiple tightly >> coupled interrupt controllers. We have the PLIC, CLIC, eCLIC and AIA, >> not to mention possible vendor controllers. Do we really need a CPU >> struct entry for every single one? >> >> I would like to try and keep all of that logic outside of the CPU >> state. It might not be possible (at least without being a mess) in >> which case that's fine, but it's at least worth considering. >> >> > >> > We can store the CLIC instance in the struct CPURISCVState or a global >> > variable. Is that any other way? >> >> We could split the device. So for example the CSRs and other parts >> that relate to the CPU could be in the CPU while the register mappings >> and GPIO lines could be it's own device. >> >> Another option is to use GPIO lines to indicate the status, but for >> anything too complex that will be messy. > > > Hi Alistair, > > I would like to know whether: > "Using GPIO lines to indicate the status of CPU" > is the right approach for future RISC-V CPU/peripherals development? > > As RISC-V ecosystem is open to everyone and there are more and more perip= herals > being designed by different vendors. I think this actually confirms that this is the right direction. If we are going to have a range of different implementations then we want them to all use the same basic framework. In this case that would be GPIO lines. > I think there is a rising requirement to have an approach for CPU to noti= fy > those core tightly-coupled peripherals after certain instruction/action h= as been completed. > (for this case, CLIC would need to choose the next interrupt to be served= after returning from interrupt in mret/sret) > > Is it possible to add something like: > qemu_irq gpio_out[NUM_OF_GPIOS]; > into CPURISCVState struct so that we can connect the GPIO lines > at machine/SoC-level, e.g. sifive_u or sifive_e? Yes, that's entirely possible. The hard part is adding the logic to the CPU to trigger that line. For standard extensions that is something we can do, but adding functionality like that for vendor specific extensions becomes tricky. > > When certain instruction or event is executed/completed by CPU. > It's possible for CPU to notify the peripheral through these GPIO lines, > and the rest of the tasks can be completed solely by the peripheral itsel= f. > We don't have to add the hacky codes to the generic CPU routines. > > This is just the rough scenario I have come up. > There might be some other issues I may not think of. > (For example, how do we determine which GPIO line should be driven by CPU= at a certain point?) Yeah, I agree. Overall I think it's a good concept, and straight forward to implement. The hard part is doing it in a generic way. Alistair > > Any comments are welcome. > > Regards, > Frank Chang > >> >> >> > >> > > I'm guessing we at least need it for CLIC CSR accesses. Could we >> > > handle that in the CPU and avoid needing a reference to the CLIC? >> > CSR access is one case. Other cases are: >> > >> > 1. When process an interrupt and decide ISP address, we need to know >> > current interrupt is vectored or not. >> > >> > 2. When interrupt returned, we need to choose another interrupt to >> > serve, so that it will not miss any interrupt. >> >> Thanks! >> >> Alistair >> >> > >> > Thanks, >> > Zhiwei >> > > >> > > Alistair >> > > >> > >> Thanks, >> > >> Frank Chang >> > >> >> > >>> >> > >>>>> }; >> > >>>>> >> > >>>>> OBJECT_DECLARE_TYPE(RISCVCPU, RISCVCPUClass, >> > >>>>> diff --git a/target/riscv/cpu_bits.h b/target/riscv/cpu_bits.h >> > >>>>> index caf4599207..c4ce6ec3d9 100644 >> > >>>>> --- a/target/riscv/cpu_bits.h >> > >>>>> +++ b/target/riscv/cpu_bits.h >> > >>>>> @@ -165,6 +165,7 @@ >> > >>>>> #define CSR_MCAUSE 0x342 >> > >>>>> #define CSR_MTVAL 0x343 >> > >>>>> #define CSR_MIP 0x344 >> > >>>>> +#define CSR_MINTSTATUS 0x346 /* clic-spec-draft */ >> > >>>>> >> > >>>>> /* Legacy Machine Trap Handling (priv v1.9.1) */ >> > >>>>> #define CSR_MBADADDR 0x343 >> > >>>>> @@ -183,6 +184,7 @@ >> > >>>>> #define CSR_SCAUSE 0x142 >> > >>>>> #define CSR_STVAL 0x143 >> > >>>>> #define CSR_SIP 0x144 >> > >>>>> +#define CSR_SINTSTATUS 0x146 /* clic-spec-draft */ >> > >>>>> >> > >>>>> /* Legacy Supervisor Trap Handling (priv v1.9.1) */ >> > >>>>> #define CSR_SBADADDR 0x143 >> > >>>>> @@ -585,6 +587,15 @@ >> > >>>>> #define SIP_STIP MIP_STIP >> > >>>>> #define SIP_SEIP MIP_SEIP >> > >>>>> >> > >>>>> +/* mintstatus */ >> > >>>>> +#define MINTSTATUS_MIL 0xff000000 /* mil[7:= 0] */ >> > >>>>> +#define MINTSTATUS_SIL 0x0000ff00 /* sil[7:= 0] */ >> > >>>>> +#define MINTSTATUS_UIL 0x000000ff /* uil[7:= 0] */ >> > >>>>> + >> > >>>>> +/* sintstatus */ >> > >>>>> +#define SINTSTATUS_SIL 0x0000ff00 /* sil[7:= 0] */ >> > >>>>> +#define SINTSTATUS_UIL 0x000000ff /* uil[7:= 0] */ >> > >>>> The bit fields in the comments are out of date. >> > >>> I didn't notice it. Fix it in next version. >> > >>> >> > >>> Thanks. >> > >>> >> > >>> Zhiwei >> > >>> >> > >>>> Alistair >> > >>>> >> > >>>>> + >> > >>>>> /* MIE masks */ >> > >>>>> #define MIE_SEIE (1 << IRQ_S_EXT) >> > >>>>> #define MIE_UEIE (1 << IRQ_U_EXT) >> > >>>>> diff --git a/target/riscv/csr.c b/target/riscv/csr.c >> > >>>>> index d2585395bf..320b18ab60 100644 >> > >>>>> --- a/target/riscv/csr.c >> > >>>>> +++ b/target/riscv/csr.c >> > >>>>> @@ -188,6 +188,12 @@ static int pmp(CPURISCVState *env, int csrn= o) >> > >>>>> { >> > >>>>> return -!riscv_feature(env, RISCV_FEATURE_PMP); >> > >>>>> } >> > >>>>> + >> > >>>>> +static int clic(CPURISCVState *env, int csrno) >> > >>>>> +{ >> > >>>>> + return !!env->clic; >> > >>>>> +} >> > >>>>> + >> > >>>>> #endif >> > >>>>> >> > >>>>> /* User Floating-Point CSRs */ >> > >>>>> @@ -734,6 +740,12 @@ static int rmw_mip(CPURISCVState *env, int = csrno, target_ulong *ret_value, >> > >>>>> return 0; >> > >>>>> } >> > >>>>> >> > >>>>> +static int read_mintstatus(CPURISCVState *env, int csrno, targe= t_ulong *val) >> > >>>>> +{ >> > >>>>> + *val =3D env->mintstatus; >> > >>>>> + return 0; >> > >>>>> +} >> > >>>>> + >> > >>>>> /* Supervisor Trap Setup */ >> > >>>>> static int read_sstatus(CPURISCVState *env, int csrno, target= _ulong *val) >> > >>>>> { >> > >>>>> @@ -893,6 +905,13 @@ static int rmw_sip(CPURISCVState *env, int = csrno, target_ulong *ret_value, >> > >>>>> return ret; >> > >>>>> } >> > >>>>> >> > >>>>> +static int read_sintstatus(CPURISCVState *env, int csrno, targe= t_ulong *val) >> > >>>>> +{ >> > >>>>> + target_ulong mask =3D SINTSTATUS_SIL | SINTSTATUS_UIL; >> > >>>>> + *val =3D env->mintstatus & mask; >> > >>>>> + return 0; >> > >>>>> +} >> > >>>>> + >> > >>>>> /* Supervisor Protection and Translation */ >> > >>>>> static int read_satp(CPURISCVState *env, int csrno, target_ul= ong *val) >> > >>>>> { >> > >>>>> @@ -1644,5 +1663,12 @@ riscv_csr_operations csr_ops[CSR_TABLE_SI= ZE] =3D { >> > >>>>> [CSR_MHPMCOUNTER29H] =3D { "mhpmcounter29h", any32, read= _zero }, >> > >>>>> [CSR_MHPMCOUNTER30H] =3D { "mhpmcounter30h", any32, read= _zero }, >> > >>>>> [CSR_MHPMCOUNTER31H] =3D { "mhpmcounter31h", any32, read= _zero }, >> > >>>>> + >> > >>>>> + /* Machine Mode Core Level Interrupt Controller */ >> > >>>>> + [CSR_MINTSTATUS] =3D { "mintstatus", clic, read_mintstatus= }, >> > >>>>> + >> > >>>>> + /* Supervisor Mode Core Level Interrupt Controller */ >> > >>>>> + [CSR_SINTSTATUS] =3D { "sintstatus", clic, read_sintstatus= }, >> > >>>>> + >> > >>>>> #endif /* !CONFIG_USER_ONLY */ >> > >>>>> }; >> > >>>>> -- >> > >>>>> 2.25.1 >> > >>>>> >> > >>>>> From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from list by lists.gnu.org with archive (Exim 4.90_1) id 1mVQhe-0004OO-2t for mharc-qemu-riscv@gnu.org; Tue, 28 Sep 2021 23:56:18 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:39084) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mVQhc-0004NV-2n; Tue, 28 Sep 2021 23:56:16 -0400 Received: from mail-io1-xd2c.google.com ([2607:f8b0:4864:20::d2c]:36671) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mVQhZ-0002C7-GJ; Tue, 28 Sep 2021 23:56:15 -0400 Received: by mail-io1-xd2c.google.com with SMTP id e144so1424577iof.3; Tue, 28 Sep 2021 20:56:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=ZgKwpIYSx0FSaimaQCg5wymASrLd6PZH46sBxCOzPCU=; b=B4/ED6Vk3BBg+9OGDetNCSC9lSz21jQUji/H76oOF1a2dZVZfIUOjbUdDkzj5o7v0V Z7uo7ZPHEGl/TlR1HaYAT5Qp5PgyW/OlrmODlZVMb/YmnWOJhzEdN89wqMRBBaTIn94G Q2hlxnFoETkColbjxE6gtk1wQoCSnt7PabF0zIf4KAm+qsA93RMfYFszmG6J+2/RHcHz sjMykygboKe8Ip10b/xBb3KJWVuNuyX8vI2RostEoUOr1+JfKsEHU0YpBRzfZFU421Jy 6PQBTxj4x5owlLUvmWC+yqeme1mStup6lHJSzSoqfEwvXXU/2qU0Uqh83ettUGYHLmsM CZxQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=ZgKwpIYSx0FSaimaQCg5wymASrLd6PZH46sBxCOzPCU=; b=cG32AzleBUkKZoaRq6nlA4SpW7yHddEiM95ii9YMUejM7z2ZzFIW9Z+Gh1pU6jJtH5 MWKX04hbCSl72/ibHZFcBoynxwqyMOJJIr8/Y4NJn+ji6TK3Rk6jl5yR8joXw63BCr27 97wv9CpSE8fMLDqzpH4IvbVRB5bkOlE7VysWdR8lv9gUNSHq08hNlXO7MHF9vg19cTgt ozE8m6OCJHIh/2l+5eRrfnxeyhTeUb82X8eYIZdAbPs2yAdqTDQbjs2UQ8avg48ua285 csLCOld1O31719CU6+l2rtLoVSt8yYgZFJlt8DN2CePWIl2EdZHy1MgbuooSDRs8PF8s napQ== X-Gm-Message-State: AOAM531vqRjM8Rby8Y0QNcIkXwO5JwPQNi/4fetkVvVy3u7sgKwnBuyw 4AaWR5aPoiLCqH11fQleLxKkZlc/WhkHTLN0JMU= X-Google-Smtp-Source: ABdhPJyMbWLtRITURa/aA5vmsPn0RvCUwUDV5AcyXzO9obEE7FUwLkIESRtjbFFYeiBugSZvarF73JZo60zJH3TOksY= X-Received: by 2002:a02:2124:: with SMTP id e36mr7476861jaa.35.1632887768874; Tue, 28 Sep 2021 20:56:08 -0700 (PDT) MIME-Version: 1.0 References: <20210409074857.166082-1-zhiwei_liu@c-sky.com> <20210409074857.166082-2-zhiwei_liu@c-sky.com> <20304ba9-6f87-f7b9-a24d-15d4b3d3f75a@c-sky.com> <3e7f6ec6-21a0-9a21-8126-68ea8c2fbf15@c-sky.com> In-Reply-To: From: Alistair Francis Date: Wed, 29 Sep 2021 13:55:43 +1000 Message-ID: Subject: Re: [RFC PATCH 01/11] target/riscv: Add CLIC CSR mintstatus To: Frank Chang Cc: LIU Zhiwei , Palmer Dabbelt , Alistair Francis , "open list:RISC-V" , "qemu-devel@nongnu.org Developers" , wxy194768@alibaba-inc.com, ShihPo Hung Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=2607:f8b0:4864:20::d2c; envelope-from=alistair23@gmail.com; helo=mail-io1-xd2c.google.com X-Spam_score_int: -17 X-Spam_score: -1.8 X-Spam_bar: - X-Spam_report: (-1.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-riscv@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Sep 2021 03:56:16 -0000 On Tue, Sep 28, 2021 at 6:10 PM Frank Chang wrote: > > On Fri, Jul 2, 2021 at 3:17 PM Alistair Francis wr= ote: >> >> On Fri, Jul 2, 2021 at 4:11 PM LIU Zhiwei wrote: >> > >> > >> > On 2021/7/2 =E4=B8=8B=E5=8D=881:38, Alistair Francis wrote: >> > > On Thu, Jul 1, 2021 at 6:45 PM Frank Chang = wrote: >> > >> LIU Zhiwei =E6=96=BC 2021=E5=B9=B44=E6=9C=88= 20=E6=97=A5 =E9=80=B1=E4=BA=8C =E4=B8=8A=E5=8D=888:49=E5=AF=AB=E9=81=93=EF= =BC=9A >> > >>> >> > >>> On 2021/4/20 =E4=B8=8A=E5=8D=887:23, Alistair Francis wrote: >> > >>>> On Fri, Apr 9, 2021 at 5:52 PM LIU Zhiwei = wrote: >> > >>>>> CSR mintstatus holds the active interrupt level for each support= ed >> > >>>>> privilege mode. sintstatus, and user, uintstatus, provide restri= cted >> > >>>>> views of mintstatus. >> > >>>>> >> > >>>>> Signed-off-by: LIU Zhiwei >> > >>>>> --- >> > >>>>> target/riscv/cpu.h | 2 ++ >> > >>>>> target/riscv/cpu_bits.h | 11 +++++++++++ >> > >>>>> target/riscv/csr.c | 26 ++++++++++++++++++++++++++ >> > >>>>> 3 files changed, 39 insertions(+) >> > >>>>> >> > >>>>> diff --git a/target/riscv/cpu.h b/target/riscv/cpu.h >> > >>>>> index 0a33d387ba..1a44ca62c7 100644 >> > >>>>> --- a/target/riscv/cpu.h >> > >>>>> +++ b/target/riscv/cpu.h >> > >>>>> @@ -159,6 +159,7 @@ struct CPURISCVState { >> > >>>>> target_ulong mip; >> > >>>>> >> > >>>>> uint32_t miclaim; >> > >>>>> + uint32_t mintstatus; /* clic-spec */ >> > >>>>> >> > >>>>> target_ulong mie; >> > >>>>> target_ulong mideleg; >> > >>>>> @@ -243,6 +244,7 @@ struct CPURISCVState { >> > >>>>> >> > >>>>> /* Fields from here on are preserved across CPU reset. */ >> > >>>>> QEMUTimer *timer; /* Internal timer */ >> > >>>>> + void *clic; /* clic interrupt controller */ >> > >>>> This should be the CLIC type. >> > >>> OK. >> > >>> >> > >>> Actually there are many versions of CLIC in my branch as different >> > >>> devices. But it is better to use CLIC type for the upstream versio= n. >> > >> >> > >> Hi Alistair and Zhiwei, >> > >> >> > >> Replacing void *clic with RISCVCLICState *clic may create a circula= r loop >> > >> because CPURISCVState is also referenced in riscv_clic.h. >> > >> >> > >> However, I would like to ask what is the best approach to add >> > >> the reference of CLIC device in CPURISCVState struct? >> > >> >> > >> There may be different kinds of CLIC devices. >> > >> AFAK, there was another RFC patchset trying to add void *eclic >> > >> for Nuclei processor into CPURISCVState struct: >> > >> https://patchwork.kernel.org/project/qemu-devel/patch/2021050708165= 4.11056-2-wangjunqiang@iscas.ac.cn/ >> > >> >> > >> Is it okay to add the device reference directly into CPURISCVState = struct like that, >> > >> or we should create some abstraction for these CLIC devices? >> > >> (However, I'm not sure how big the differences are for these CLIC d= evices...) >> > > I would prefer to not have the CLIC in the struct at all. >> > > >> > > Why is the CLIC required from the CPU? >> > >> > In my opinion, the tight coupled interrupt controller, like NVIC in >> > ARM, is much different from other devices. >> > CPU harts need to communicate with it through many ways. >> >> Agreed. >> >> The difference with RISC-V is that we already have multiple tightly >> coupled interrupt controllers. We have the PLIC, CLIC, eCLIC and AIA, >> not to mention possible vendor controllers. Do we really need a CPU >> struct entry for every single one? >> >> I would like to try and keep all of that logic outside of the CPU >> state. It might not be possible (at least without being a mess) in >> which case that's fine, but it's at least worth considering. >> >> > >> > We can store the CLIC instance in the struct CPURISCVState or a global >> > variable. Is that any other way? >> >> We could split the device. So for example the CSRs and other parts >> that relate to the CPU could be in the CPU while the register mappings >> and GPIO lines could be it's own device. >> >> Another option is to use GPIO lines to indicate the status, but for >> anything too complex that will be messy. > > > Hi Alistair, > > I would like to know whether: > "Using GPIO lines to indicate the status of CPU" > is the right approach for future RISC-V CPU/peripherals development? > > As RISC-V ecosystem is open to everyone and there are more and more perip= herals > being designed by different vendors. I think this actually confirms that this is the right direction. If we are going to have a range of different implementations then we want them to all use the same basic framework. In this case that would be GPIO lines. > I think there is a rising requirement to have an approach for CPU to noti= fy > those core tightly-coupled peripherals after certain instruction/action h= as been completed. > (for this case, CLIC would need to choose the next interrupt to be served= after returning from interrupt in mret/sret) > > Is it possible to add something like: > qemu_irq gpio_out[NUM_OF_GPIOS]; > into CPURISCVState struct so that we can connect the GPIO lines > at machine/SoC-level, e.g. sifive_u or sifive_e? Yes, that's entirely possible. The hard part is adding the logic to the CPU to trigger that line. For standard extensions that is something we can do, but adding functionality like that for vendor specific extensions becomes tricky. > > When certain instruction or event is executed/completed by CPU. > It's possible for CPU to notify the peripheral through these GPIO lines, > and the rest of the tasks can be completed solely by the peripheral itsel= f. > We don't have to add the hacky codes to the generic CPU routines. > > This is just the rough scenario I have come up. > There might be some other issues I may not think of. > (For example, how do we determine which GPIO line should be driven by CPU= at a certain point?) Yeah, I agree. Overall I think it's a good concept, and straight forward to implement. The hard part is doing it in a generic way. Alistair > > Any comments are welcome. > > Regards, > Frank Chang > >> >> >> > >> > > I'm guessing we at least need it for CLIC CSR accesses. Could we >> > > handle that in the CPU and avoid needing a reference to the CLIC? >> > CSR access is one case. Other cases are: >> > >> > 1. When process an interrupt and decide ISP address, we need to know >> > current interrupt is vectored or not. >> > >> > 2. When interrupt returned, we need to choose another interrupt to >> > serve, so that it will not miss any interrupt. >> >> Thanks! >> >> Alistair >> >> > >> > Thanks, >> > Zhiwei >> > > >> > > Alistair >> > > >> > >> Thanks, >> > >> Frank Chang >> > >> >> > >>> >> > >>>>> }; >> > >>>>> >> > >>>>> OBJECT_DECLARE_TYPE(RISCVCPU, RISCVCPUClass, >> > >>>>> diff --git a/target/riscv/cpu_bits.h b/target/riscv/cpu_bits.h >> > >>>>> index caf4599207..c4ce6ec3d9 100644 >> > >>>>> --- a/target/riscv/cpu_bits.h >> > >>>>> +++ b/target/riscv/cpu_bits.h >> > >>>>> @@ -165,6 +165,7 @@ >> > >>>>> #define CSR_MCAUSE 0x342 >> > >>>>> #define CSR_MTVAL 0x343 >> > >>>>> #define CSR_MIP 0x344 >> > >>>>> +#define CSR_MINTSTATUS 0x346 /* clic-spec-draft */ >> > >>>>> >> > >>>>> /* Legacy Machine Trap Handling (priv v1.9.1) */ >> > >>>>> #define CSR_MBADADDR 0x343 >> > >>>>> @@ -183,6 +184,7 @@ >> > >>>>> #define CSR_SCAUSE 0x142 >> > >>>>> #define CSR_STVAL 0x143 >> > >>>>> #define CSR_SIP 0x144 >> > >>>>> +#define CSR_SINTSTATUS 0x146 /* clic-spec-draft */ >> > >>>>> >> > >>>>> /* Legacy Supervisor Trap Handling (priv v1.9.1) */ >> > >>>>> #define CSR_SBADADDR 0x143 >> > >>>>> @@ -585,6 +587,15 @@ >> > >>>>> #define SIP_STIP MIP_STIP >> > >>>>> #define SIP_SEIP MIP_SEIP >> > >>>>> >> > >>>>> +/* mintstatus */ >> > >>>>> +#define MINTSTATUS_MIL 0xff000000 /* mil[7:= 0] */ >> > >>>>> +#define MINTSTATUS_SIL 0x0000ff00 /* sil[7:= 0] */ >> > >>>>> +#define MINTSTATUS_UIL 0x000000ff /* uil[7:= 0] */ >> > >>>>> + >> > >>>>> +/* sintstatus */ >> > >>>>> +#define SINTSTATUS_SIL 0x0000ff00 /* sil[7:= 0] */ >> > >>>>> +#define SINTSTATUS_UIL 0x000000ff /* uil[7:= 0] */ >> > >>>> The bit fields in the comments are out of date. >> > >>> I didn't notice it. Fix it in next version. >> > >>> >> > >>> Thanks. >> > >>> >> > >>> Zhiwei >> > >>> >> > >>>> Alistair >> > >>>> >> > >>>>> + >> > >>>>> /* MIE masks */ >> > >>>>> #define MIE_SEIE (1 << IRQ_S_EXT) >> > >>>>> #define MIE_UEIE (1 << IRQ_U_EXT) >> > >>>>> diff --git a/target/riscv/csr.c b/target/riscv/csr.c >> > >>>>> index d2585395bf..320b18ab60 100644 >> > >>>>> --- a/target/riscv/csr.c >> > >>>>> +++ b/target/riscv/csr.c >> > >>>>> @@ -188,6 +188,12 @@ static int pmp(CPURISCVState *env, int csrn= o) >> > >>>>> { >> > >>>>> return -!riscv_feature(env, RISCV_FEATURE_PMP); >> > >>>>> } >> > >>>>> + >> > >>>>> +static int clic(CPURISCVState *env, int csrno) >> > >>>>> +{ >> > >>>>> + return !!env->clic; >> > >>>>> +} >> > >>>>> + >> > >>>>> #endif >> > >>>>> >> > >>>>> /* User Floating-Point CSRs */ >> > >>>>> @@ -734,6 +740,12 @@ static int rmw_mip(CPURISCVState *env, int = csrno, target_ulong *ret_value, >> > >>>>> return 0; >> > >>>>> } >> > >>>>> >> > >>>>> +static int read_mintstatus(CPURISCVState *env, int csrno, targe= t_ulong *val) >> > >>>>> +{ >> > >>>>> + *val =3D env->mintstatus; >> > >>>>> + return 0; >> > >>>>> +} >> > >>>>> + >> > >>>>> /* Supervisor Trap Setup */ >> > >>>>> static int read_sstatus(CPURISCVState *env, int csrno, target= _ulong *val) >> > >>>>> { >> > >>>>> @@ -893,6 +905,13 @@ static int rmw_sip(CPURISCVState *env, int = csrno, target_ulong *ret_value, >> > >>>>> return ret; >> > >>>>> } >> > >>>>> >> > >>>>> +static int read_sintstatus(CPURISCVState *env, int csrno, targe= t_ulong *val) >> > >>>>> +{ >> > >>>>> + target_ulong mask =3D SINTSTATUS_SIL | SINTSTATUS_UIL; >> > >>>>> + *val =3D env->mintstatus & mask; >> > >>>>> + return 0; >> > >>>>> +} >> > >>>>> + >> > >>>>> /* Supervisor Protection and Translation */ >> > >>>>> static int read_satp(CPURISCVState *env, int csrno, target_ul= ong *val) >> > >>>>> { >> > >>>>> @@ -1644,5 +1663,12 @@ riscv_csr_operations csr_ops[CSR_TABLE_SI= ZE] =3D { >> > >>>>> [CSR_MHPMCOUNTER29H] =3D { "mhpmcounter29h", any32, read= _zero }, >> > >>>>> [CSR_MHPMCOUNTER30H] =3D { "mhpmcounter30h", any32, read= _zero }, >> > >>>>> [CSR_MHPMCOUNTER31H] =3D { "mhpmcounter31h", any32, read= _zero }, >> > >>>>> + >> > >>>>> + /* Machine Mode Core Level Interrupt Controller */ >> > >>>>> + [CSR_MINTSTATUS] =3D { "mintstatus", clic, read_mintstatus= }, >> > >>>>> + >> > >>>>> + /* Supervisor Mode Core Level Interrupt Controller */ >> > >>>>> + [CSR_SINTSTATUS] =3D { "sintstatus", clic, read_sintstatus= }, >> > >>>>> + >> > >>>>> #endif /* !CONFIG_USER_ONLY */ >> > >>>>> }; >> > >>>>> -- >> > >>>>> 2.25.1 >> > >>>>> >> > >>>>>