From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7794EC433EF for ; Wed, 24 Nov 2021 06:33:25 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S235274AbhKXGgc (ORCPT ); Wed, 24 Nov 2021 01:36:32 -0500 Received: from verein.lst.de ([213.95.11.211]:35794 "EHLO verein.lst.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S235213AbhKXGg3 (ORCPT ); Wed, 24 Nov 2021 01:36:29 -0500 Received: by verein.lst.de (Postfix, from userid 2407) id 0BBE968AFE; Wed, 24 Nov 2021 07:33:17 +0100 (CET) Date: Wed, 24 Nov 2021 07:33:16 +0100 From: Christoph Hellwig To: Dan Williams Cc: Bjorn Helgaas , Ben Widawsky , linux-cxl@vger.kernel.org, Linux PCI , Alison Schofield , Ira Weiny , Jonathan Cameron , Vishal Verma , Christoph Hellwig , Greg Kroah-Hartman , "Rafael J. Wysocki" Subject: Re: [PATCH 20/23] cxl/port: Introduce a port driver Message-ID: <20211124063316.GA6792@lst.de> References: <20211123235557.GA2247853@bhelgaas> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.17 (2007-11-01) Precedence: bulk List-ID: X-Mailing-List: linux-cxl@vger.kernel.org On Tue, Nov 23, 2021 at 04:40:06PM -0800, Dan Williams wrote: > Let me ask a clarifying question coming from the other direction that > resulted in the creation of the auxiliary bus architecture. Some > background. RDMA is a protocol that may run on top of Ethernet. No, RDMA is a concept. Linux supports 2 and a half RDMA protocols that run over ethernet (RoCE v1 and v2 and iWarp). > Consider the case where you have multiple generations of Ethernet > adapter devices, but they all support common RDMA functionality. You > only have the one PCI device to attach a unique Ethernet driver. What > is an idiomatic way to deploy a module that automatically loads and > attaches to the exported common functionality across adapters that > otherwise have a unique native driver for the hardware device? The whole aux bus drama is mostly because the intel design for these is really fucked up. All the sane HCAs do not use this model. All this attchment crap really should not be there. > Another example, the Native PCIe Enclosure Management (NPEM) > specification defines a handful of registers that can appear anywhere > in the PCIe hierarchy. How can you write a common driver that is > generically applicable to any given NPEM instance? Another totally messed up spec. But then pretty much everything coming from the PCIe SIG in terms of interface tends to be really, really broken lately.