From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.5 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 21E57C4338F for ; Tue, 3 Aug 2021 02:13:53 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id E007E6101D for ; Tue, 3 Aug 2021 02:13:52 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org E007E6101D Authentication-Results: mail.kernel.org; dmarc=fail (p=reject dis=none) header.from=microsoft.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:In-Reply-To:References: Message-ID:Date:Subject:CC:To:From:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=iHgoIWqon/nEKNxPGv+SzytATEcHYEcN9FJ+wzgaysU=; b=bUnOUb4AbyIWzJ QXtSFFl2B7NgMqgLGz/t67wKj8ytd/7UMyLv6KEBjdImwcjUjU/P4gi7h/sQjzkg1YQ1nv3BSnwFV pjdJMTxMDzlHFXX/mkXvQotPBa1U2RvttY8nrIqOFax8nNWYGR+sXom38N13L224FJcGV2K8pfsGF I1OrzQubn96jld783pikMEy0myPBIfTssWk0RTIAU4PsaGL8ETlXJQhDr2yVADP4lol/GePSG8Gic FEgPPjuJA2yHi9i+350I7TOZ5Yclv0880kpAeUUfJWUkH3bjW6eoFC/kSZGzbolm23OKQLPMVtOTi njbrUCFGB5CxrZYAtr5g==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1mAjtu-000lte-9J; Tue, 03 Aug 2021 02:11:26 +0000 Received: from mail-bn8nam12on2138.outbound.protection.outlook.com ([40.107.237.138] helo=NAM12-BN8-obe.outbound.protection.outlook.com) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1mAjtp-000ltK-KY for linux-arm-kernel@lists.infradead.org; Tue, 03 Aug 2021 02:11:23 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=B1sSnGiH3MSV8KifYcU1ok8v7uDqEPj1NBypUDODY9/wU5GWaBRyjnvi/6o3Cimf0W5JuI0jjNqkjuMrv/MnObn0kaVgzHueqcdkBPeKvR5aERbXXJPQu3R5fJWlnY1Mbzr4vbgsundEcLOjA7PX6q1uoFQnSHX5AW3eJre8J/06DTTrxFSF7R98eLRlkoI+k50vqVIcpKYCYGx5QgSUaURmgb4MUBDwr+TmclUD6akVcAeYTw3lN3FHyJXls/jFa9PZ0x9DZ9Z5MUiSb5fOZ8K29m+FF4P+B8ca1tIfWM+tu9BEfdDR8oEkJEh8SHBcWrDM5lDnFP7CGJkZQEbYKg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1EygcjhMvY9gbZwrTumpc6vLwb3bngi8k9tAu9QBhqk=; b=HTXl8JzD8S4CNGqzYa3h+JvLnCku/Oa0POLiP1X+A0LaLJ5kLO12W2QSljgALayZ3ZVXngnZRgCF/Y6U8aH5OgvU2UQ3uQ7IXey0fRY4rbMM72VWstkvq0RHbkd8Il9am/OBSJz8V7au59gHHLalxbww7EnCfQ8vptzIPC1QJjwzzJCDFPO2Ep/ciw6N5DF/1zdZidUz900PgPEZHJNeho++dycwVjQJIAoVZRgcAK5TzRKWCvAckZ3nlJ3syMj4jlXNWrV9noT+6RdZwuAkKjWLLROOA8VXEo4NqtB7ecS2QnIKCubIj7G1/b6j4awpBv5ALBRdQ/56xzrjb1Dswg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=microsoft.com; dmarc=pass action=none header.from=microsoft.com; dkim=pass header.d=microsoft.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1EygcjhMvY9gbZwrTumpc6vLwb3bngi8k9tAu9QBhqk=; b=eii+zYoibTou4GbkJWf2zkqrVMXaVC9BZt8SR/lV0Bv4uZl3mnMsrOW+ezw8vqlzAPsIullXDFALsg3ksTzbiz+ERs8+KIeBxwTc6CjtzTgFJQ02R0VZw43K0FjLehnCrT5M2F3HseMgyjbogVP8YpLc7Fh3hhCgPzQKIGVfvnM= Received: from MW4PR21MB2002.namprd21.prod.outlook.com (2603:10b6:303:68::18) by MW4PR21MB2059.namprd21.prod.outlook.com (2603:10b6:303:11e::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4394.11; Tue, 3 Aug 2021 02:11:14 +0000 Received: from MW4PR21MB2002.namprd21.prod.outlook.com ([fe80::601a:d59b:f64e:5433]) by MW4PR21MB2002.namprd21.prod.outlook.com ([fe80::601a:d59b:f64e:5433%7]) with mapi id 15.20.4415.002; Tue, 3 Aug 2021 02:11:13 +0000 From: Sunil Muthuswamy To: Marc Zyngier CC: Thomas Gleixner , "linux-kernel@vger.kernel.org" , "linux-arm-kernel@lists.infradead.org" , "catalin.marinas@arm.com" , "will@kernel.org" , Michael Kelley , Boqun Feng , KY Srinivasan , Arnd Bergmann Subject: RE: [EXTERNAL] Re: [RFC 1/1] irqchip/gic-v3-its: Add irq domain and chip for Direct LPI without ITS Thread-Topic: [EXTERNAL] Re: [RFC 1/1] irqchip/gic-v3-its: Add irq domain and chip for Direct LPI without ITS Thread-Index: Add0L2f934gE0okbTBC5z2WK9cOcFQCFdR6AAvoodNAA8PnXAACGZfqQ Date: Tue, 3 Aug 2021 02:11:13 +0000 Message-ID: References: <87a6mt2jke.wl-maz@kernel.org> <87tuka24kj.wl-maz@kernel.org> In-Reply-To: <87tuka24kj.wl-maz@kernel.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=microsoft.com; x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 982f5a16-7bd3-492e-3bc5-08d95623f848 x-ms-traffictypediagnostic: MW4PR21MB2059: x-ms-exchange-transport-forked: True x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:8273; x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: m/TiifTAD0Dvi4gBNtjOUglamMd6gNbK6GBMLxkPXVhXH8xvSFcQdRXwTqIlUlcZayZwa2pWB0yAvkafb2h6IoT54eQ0JmeP5JQ+m1fuyfC1tkUafDClQMF96goyZJEP225Hu603qYOE+DWwIi/yIbDsmmL1cVJxPO7/JEFG6jHQcwQ9+sWAjU+9FI5YUx5sJlBd1JXZZY9FY4xsRXP9TTemAQKVcbac/TSwTDBf4SFV4TpdAP5Indqhry2TZWSVoRhv8qrT9IPsKjJ5cgM16aJugIIKgmqEUIgAtbVeJT+1UL26D2KktvwUN9dchA90RjWnjKQyg4v+/CVASFq+gqgbaGr0ejJP/THaAljQ0iWSDKNP+ZKiuI3WYyDS2szle5jtb3n0gkFmGM4MHx+BtqvW136EKNEu3tTSIBGOUUwGIW7LHTHXl3t15QDFsvKgGBs1lO/NIBQsxRybz5KUYhrKO6wcl0ERd0VLE9csDvnOhqvvKBoc6jqsiLcMnB6Z2ZlgMYoTCOC0Yze9oRFQ7+bnp2IMdE853XPMBI0qZveRRqMWaXMxynlvgMKPrhTtbEj18y6XEBTSNc5+JUbPoNkwR0KY15fvEz4cHgP/n7mJJ2H5U4PTLm8kAwbZtSwah2r79jD0LZHqcrGRexS/5BRkplIVfTH6i4Q6G9njZtGG/XGQm1l0BUuHt1o6TJQJu20794sw1u6ptt7lufxW6w== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:MW4PR21MB2002.namprd21.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(86362001)(38100700002)(8676002)(122000001)(52536014)(186003)(66476007)(66556008)(66946007)(8936002)(64756008)(10290500003)(38070700005)(2906002)(76116006)(5660300002)(66446008)(508600001)(33656002)(4326008)(6506007)(71200400001)(53546011)(82950400001)(82960400001)(7696005)(54906003)(83380400001)(316002)(8990500004)(9686003)(55016002)(6916009); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?GmLXTB3oP83mW73mfkx84B9b2wgCd+88iiGuLCPRJ0D1LLaDXmLMd1jmxbM7?= =?us-ascii?Q?5O1NOYBq0CiE6Yii+llkZxCd2Bs9AWH2D4/Mipn05g7/8VJ+K03DFfg8njpK?= =?us-ascii?Q?R1jKCGyRlk3zziOIFqDGtAJXtMTayrlGKcAUBkVbj06Uj6PEs0eSOoUBwAQF?= =?us-ascii?Q?oabHkMz5sN+f8p54Hr7+QgKETSu1TkVJAQ0wXsxFvt1EfbSmIZ9KJLc8p+06?= =?us-ascii?Q?QELBzkbP9s1dWB1xOKsysGpEZUwqgMtbd87r4F8x+3N5NQKloGJF5s6Pvtn2?= =?us-ascii?Q?kkNiIk7fLpPZVxP0o4SGIcppSAy4OdIRhD/KA0j8WZiAHqodTdY+yFAGGqFp?= =?us-ascii?Q?hj1hDjE/4EAju/tnvaKGj6+fm/qS3inm5362J3oK0bcHb27ZCDslUftkGBSu?= =?us-ascii?Q?4n/Ib5Khp2+0ee2DtSw8y7JFPUdywYoIXavsDClOF37DZe5tkOmlEACj+8Hr?= =?us-ascii?Q?NLIh0hbgwWsstRTN6RNDwac2RXLaY3qK+/Y7TGE+eUtrYmoP1fyXWc5Khom2?= =?us-ascii?Q?MQlrqt0KON3pZD6VW58aaIrZc8OORQ9h70FhUG2HdPBGPkluXQh+ewDHZ5wF?= =?us-ascii?Q?Aag/DiBs8DPIQh8Lcw9jzZ8f0mq5cWWw6OkeXn+zWYt9APQXu7dDlaqJReYu?= =?us-ascii?Q?xuOzm6CEGeimbCQcYHkDx9ZYSzZ7/9idxY1zaa3PUwdXvIVUhkfQsQ1daCrb?= =?us-ascii?Q?skPrdDlAoD397opWU8bIviRT9HFnUO0OYnH+Z8BaPo5FvYeo+2Pe/2fhzzSq?= =?us-ascii?Q?lQ4G+6JnjWJ4rlDaKWjqmSncxTxD+RDpnpSwaeoBtw2VhsFNX5bHGDjZ2Xf7?= =?us-ascii?Q?37HGZq+noOdm2OMwBhc5fOMPhnMGwzi8Ps5xedVYdtWT1hYJadyR5cOFdnQv?= =?us-ascii?Q?x8YJZDYaMwHfzwQaHcY7+MfY8cK5R2/vDr/nlQqFq/xK3QnHfEWCQz3/t7NP?= =?us-ascii?Q?KYq9DlitNOEz4k3Nz6cGg3sucOPoeZ0WXd13/uk3Q/7qAEZJvtqwCZuP6mpt?= =?us-ascii?Q?SxPz82got0ezFqoOioB8NnUvNikXz5X1yEdS99SojpRjkfONvK6w+uR0lwNd?= =?us-ascii?Q?5zmjONtuX3fP5SaOiFwEffSw/m5d3mTiqRHKGGqlRar5vZIQiLrpaOhp+RKA?= =?us-ascii?Q?HnTblJYPaGl3bzihTiahccBhsqjpx4FqsrLwdGYo8iwL87OK+kSDGbo2enxD?= =?us-ascii?Q?PCcU6+WmQiQTr3JZD+Sgc5NAchxQY5CgJm6k+uilB/KGCMHueu6fcsLfiJJZ?= =?us-ascii?Q?ClyxgzgCcCRMHHW9ViaqTbUHqQSL7x8NIBCTaQzOFs2OJdU45baNL9R2ureR?= =?us-ascii?Q?hlppsoR8iHNyDlrIDemDRnhoVjf+aMLh/cmsD6svUrAnBjZ9Y6pMC6xbH+Zt?= =?us-ascii?Q?qrvNtbJ9N0kp+82J/yFvBk2I6NWb?= MIME-Version: 1.0 X-OriginatorOrg: microsoft.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: MW4PR21MB2002.namprd21.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 982f5a16-7bd3-492e-3bc5-08d95623f848 X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Aug 2021 02:11:13.7519 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 1X18Obb1G4acn/sp0nR3pO5nzwNBvU3sXZ4NThrXoNIIdyW00Id+baKdhId/Emk3zsf63+g+8mrxhuqWUbSW1f1HOqIHWbSq/+r/ItcJa4s= X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR21MB2059 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210802_191121_794128_D8A3EF2C X-CRM114-Status: GOOD ( 28.14 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Saturday, July 31, 2021 2:52 AM, Marc Zyngier wrote: > > [...] > > > > I also want to understand *how* you are going to plumb this into both > > > ACPI and DT, given that neither understand how to link a PCI endpoint > > > to a set of RDs. > > > > > > M. > > > > One way to do this for NUMA-aware systems would be to use the NUMA > > related information that is available with PCI endpoints or root complex, to > > pick a Redistributor/CPU that is in the NUMA node, as specified by the PCI > > endpoint/root complex. In DT PCI devices can specify this using > > 'numa-node-id' and in ACPI using the '_PXM (Proximity)'. For systems that > > are not NUMA-aware, we can go with *any* Redistributor/CPU. > > This makes zero sense. From the point of view of a device, all the RDs > should be reachable, and firmware has no say in it. Dealing with > interrupt affinity is the responsibility of the endpoint driver, and > NUMA affinity is only a performance optimisation. > > > Is there any additional information we would be able to gather from ACPI > > or DT that's not there currently, that would be useful here? > > You will need some firmware information describing that a given set of > devices must use the RDs for their MSIs. Just like we currently > describe it in IORT for the ITS. You cannot /assume/ things. At the > moment, there is nothing at all, because no-one (including Microsoft) > thought it would be a good idea not to have an ITS, which is also why > ACPI doesn't describe MBIs as a potential MSI provider. > I am a little bit confused by your above comment. Maybe you can help me understand the ask. You indicate that from the point of the view of the device, all the RDs should be reachable. But, then if we define a mapping between PCI endpoint and RD in the firmware, we would be doing exactly the opposite. i.e. restricting the RDs that are reachable by the device. Can you please clarify? Is your concern that the device should be able to only DMA to a subset of GIC Redistributor, for the MSIs? If so, in the IORT, there is "memory address size limit" for both device and root complex nodes. In the implementation, we can enforce that the GICR is within that range. And, if a device deviates further than that (ex: by having accessibility gaps within the GICR range), then that is out of scope for support. - Sunil _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel