nvdimm.lists.linux.dev archive mirror
 help / color / mirror / Atom feed
From: Ben Widawsky <ben.widawsky@intel.com>
To: Dan Williams <dan.j.williams@intel.com>
Cc: linux-cxl@vger.kernel.org,
	Andy Shevchenko <andriy.shevchenko@linux.intel.com>,
	nvdimm@lists.linux.dev, Jonathan.Cameron@huawei.com,
	vishal.l.verma@intel.com, alison.schofield@intel.com,
	ira.weiny@intel.com
Subject: Re: [PATCH 00/23] cxl_test: Enable CXL Topology and UAPI regression tests
Date: Tue, 10 Aug 2021 15:10:23 -0700	[thread overview]
Message-ID: <20210810221023.h65s3i3ephzt7m2w@intel.com> (raw)
In-Reply-To: <162854806653.1980150.3354618413963083778.stgit@dwillia2-desk3.amr.corp.intel.com>

On 21-08-09 15:27:47, Dan Williams wrote:
> As mentioned in patch 20 in this series the response of upstream QEMU
> community to CXL device emulation has been underwhelming to date. Even
> if that picked up it still results in a situation where new driver
> features and new test capabilities for those features are split across
> multiple repositories.
> 
> The "nfit_test" approach of mocking up platform resources via an
> external test module continues to yield positive results catching
> regressions early and often. Repeat that success with a "cxl_test"
> module to inject custom crafted topologies and command responses into
> the CXL subsystem's sysfs and ioctl UAPIs.
> 
> The first target for cxl_test to verify is the integration of CXL with
> LIBNVDIMM and the new support for the CXL namespace label + region-label
> format. The first 11 patches introduce support for the new label format.
> 
> The next 9 patches rework the CXL PCI driver and to move more common
> infrastructure into the core for the unit test environment to reuse. The
> largest change here is disconnecting the mailbox command processing
> infrastructure from the PCI specific transport. The unit test
> environment replaces the PCI transport with a custom backend with mocked
> responses to command requests.
> 
> Patch 20 introduces just enough mocked functionality for the cxl_acpi
> driver to load against cxl_test resources. Patch 21 fixes the first bug
> discovered by this framework, namely that HDM decoder target list maps
> were not being filled out.
> 
> Finally patches 22 and 23 introduce a cxl_test representation of memory
> expander devices. In this initial implementation these memory expander
> targets implement just enough command support to pass the basic driver
> init sequence and enable label command passthrough to LIBNVDIMM.
> 
> The topology of cxl_test includes:
> - (4) platform fixed memory windows. One each of a x1-volatile,
>   x4-volatile, x1-persistent, and x4-persistent.
> - (4) Host bridges each with (2) root ports
> - (8) CXL memory expanders, one for each root port
> - Each memory expander device supports the GET_SUPPORTED_LOGS, GET_LOG,
>   IDENTIFY, GET_LSA, and SET_LSA commands.
> 
> Going forward the expectation is that where possible new UAPI visible
> subsystem functionality comes with cxl_test emulation of the same.
> 
> The build process for cxl_test is:
> 
>     make M=tools/testing/cxl
>     make M=tools/testing/cxl modules_install
> 
> The implementation methodology of the test module is the same as
> nfit_test where the bulk of the emulation comes from replacing symbols
> that cxl_acpi and the cxl_core import with mocked implementation of
> those symbols. See the "--wrap=" lines in tools/testing/cxl/Kbuild. Some
> symbols need to be replaced, but are local to the modules like
> match_add_root_ports(). In those cases the local symbol is marked __weak
> with a strong implementation coming from tools/testing/cxl/. The goal
> being to be minimally invasive to production code paths.

I went through everything except the very last patch, which I'll try to get to
tomorrow when my brain is working a bit better. It looks fine to me overall. I'd
like if we could remove code duplication in the mock driver, but perhaps that's
the nature of the beast here.

> 
> ---
> 
> Dan Williams (23):
>       libnvdimm/labels: Introduce getters for namespace label fields
>       libnvdimm/labels: Add isetcookie validation helper
>       libnvdimm/labels: Introduce label setter helpers
>       libnvdimm/labels: Add a checksum calculation helper
>       libnvdimm/labels: Add blk isetcookie set / validation helpers
>       libnvdimm/labels: Add blk special cases for nlabel and position helpers
>       libnvdimm/labels: Add type-guid helpers
>       libnvdimm/labels: Add claim class helpers
>       libnvdimm/labels: Add address-abstraction uuid definitions
>       libnvdimm/labels: Add uuid helpers
>       libnvdimm/labels: Introduce CXL labels
>       cxl/pci: Make 'struct cxl_mem' device type generic
>       cxl/mbox: Introduce the mbox_send operation
>       cxl/mbox: Move mailbox and other non-PCI specific infrastructure to the core
>       cxl/pci: Use module_pci_driver
>       cxl/mbox: Convert 'enabled_cmds' to DECLARE_BITMAP
>       cxl/mbox: Add exclusive kernel command support
>       cxl/pmem: Translate NVDIMM label commands to CXL label commands
>       cxl/pmem: Add support for multiple nvdimm-bridge objects
>       tools/testing/cxl: Introduce a mocked-up CXL port hierarchy
>       cxl/bus: Populate the target list at decoder create
>       cxl/mbox: Move command definitions to common location
>       tools/testing/cxl: Introduce a mock memory device + driver
> 
> 
>  Documentation/driver-api/cxl/memory-devices.rst |    3 
>  drivers/cxl/acpi.c                              |   65 +
>  drivers/cxl/core/Makefile                       |    1 
>  drivers/cxl/core/bus.c                          |   69 +-
>  drivers/cxl/core/core.h                         |    8 
>  drivers/cxl/core/mbox.c                         |  796 +++++++++++++++++
>  drivers/cxl/core/memdev.c                       |   84 ++
>  drivers/cxl/core/pmem.c                         |   32 +
>  drivers/cxl/cxl.h                               |   35 -
>  drivers/cxl/cxlmem.h                            |  186 ++++
>  drivers/cxl/pci.c                               | 1053 +----------------------
>  drivers/cxl/pmem.c                              |  162 +++-
>  drivers/nvdimm/btt.c                            |   11 
>  drivers/nvdimm/btt.h                            |    4 
>  drivers/nvdimm/btt_devs.c                       |   12 
>  drivers/nvdimm/core.c                           |   40 -
>  drivers/nvdimm/label.c                          |  354 +++++---
>  drivers/nvdimm/label.h                          |   96 +-
>  drivers/nvdimm/namespace_devs.c                 |  194 ++--
>  drivers/nvdimm/nd-core.h                        |    5 
>  drivers/nvdimm/nd.h                             |  263 ++++++
>  drivers/nvdimm/pfn_devs.c                       |    2 
>  include/linux/nd.h                              |    4 
>  tools/testing/cxl/Kbuild                        |   29 +
>  tools/testing/cxl/mock_acpi.c                   |  105 ++
>  tools/testing/cxl/mock_pmem.c                   |   24 +
>  tools/testing/cxl/test/Kbuild                   |   10 
>  tools/testing/cxl/test/cxl.c                    |  587 +++++++++++++
>  tools/testing/cxl/test/mem.c                    |  255 ++++++
>  tools/testing/cxl/test/mock.c                   |  155 +++
>  tools/testing/cxl/test/mock.h                   |   27 +
>  31 files changed, 3234 insertions(+), 1437 deletions(-)
>  create mode 100644 drivers/cxl/core/mbox.c
>  create mode 100644 tools/testing/cxl/Kbuild
>  create mode 100644 tools/testing/cxl/mock_acpi.c
>  create mode 100644 tools/testing/cxl/mock_pmem.c
>  create mode 100644 tools/testing/cxl/test/Kbuild
>  create mode 100644 tools/testing/cxl/test/cxl.c
>  create mode 100644 tools/testing/cxl/test/mem.c
>  create mode 100644 tools/testing/cxl/test/mock.c
>  create mode 100644 tools/testing/cxl/test/mock.h
> 
> base-commit: 427832674f6e2413c21ca2271ec945a720608ff2
> 
> (cxl.git#pending as of August 9th, 2021)

  parent reply	other threads:[~2021-08-10 22:10 UTC|newest]

Thread overview: 61+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-08-09 22:27 Dan Williams
2021-08-09 22:27 ` [PATCH 01/23] libnvdimm/labels: Introduce getters for namespace label fields Dan Williams
2021-08-10 20:48   ` Ben Widawsky
2021-08-10 21:58     ` Dan Williams
2021-08-11 18:44   ` Jonathan Cameron
2021-08-09 22:27 ` [PATCH 02/23] libnvdimm/labels: Add isetcookie validation helper Dan Williams
2021-08-11 18:44   ` Jonathan Cameron
2021-08-09 22:28 ` [PATCH 03/23] libnvdimm/labels: Introduce label setter helpers Dan Williams
2021-08-11 17:27   ` Jonathan Cameron
2021-08-11 17:42     ` Dan Williams
2021-08-09 22:28 ` [PATCH 04/23] libnvdimm/labels: Add a checksum calculation helper Dan Williams
2021-08-11 18:44   ` Jonathan Cameron
2021-08-09 22:28 ` [PATCH 05/23] libnvdimm/labels: Add blk isetcookie set / validation helpers Dan Williams
2021-08-11 18:45   ` Jonathan Cameron
2021-08-09 22:28 ` [PATCH 06/23] libnvdimm/labels: Add blk special cases for nlabel and position helpers Dan Williams
2021-08-11 18:45   ` Jonathan Cameron
2021-08-09 22:28 ` [PATCH 07/23] libnvdimm/labels: Add type-guid helpers Dan Williams
2021-08-11 18:46   ` Jonathan Cameron
2021-08-09 22:28 ` [PATCH 08/23] libnvdimm/labels: Add claim class helpers Dan Williams
2021-08-11 18:46   ` Jonathan Cameron
2021-08-09 22:28 ` [PATCH 09/23] libnvdimm/labels: Add address-abstraction uuid definitions Dan Williams
2021-08-11 18:49   ` Jonathan Cameron
2021-08-11 22:47     ` Dan Williams
2021-08-09 22:28 ` [PATCH 10/23] libnvdimm/labels: Add uuid helpers Dan Williams
2021-08-11  8:05   ` Andy Shevchenko
2021-08-11 16:59     ` Andy Shevchenko
2021-08-11 17:11       ` Dan Williams
2021-08-11 19:18         ` Andy Shevchenko
2021-08-11 19:26           ` Dan Williams
2021-08-12 22:34           ` Dan Williams
2021-08-13 10:14             ` Andy Shevchenko
2021-08-14  7:35               ` Christoph Hellwig
2021-08-11 18:13   ` Jonathan Cameron
2021-08-12 21:17     ` Dan Williams
2021-08-09 22:28 ` [PATCH 11/23] libnvdimm/labels: Introduce CXL labels Dan Williams
2021-08-11 18:41   ` Jonathan Cameron
2021-08-11 23:01     ` Dan Williams
2021-08-09 22:28 ` [PATCH 12/23] cxl/pci: Make 'struct cxl_mem' device type generic Dan Williams
2021-08-09 22:28 ` [PATCH 13/23] cxl/mbox: Introduce the mbox_send operation Dan Williams
2021-08-09 22:29 ` [PATCH 14/23] cxl/mbox: Move mailbox and other non-PCI specific infrastructure to the core Dan Williams
2021-08-11  6:11   ` [PATCH v2 " Dan Williams
2021-08-09 22:29 ` [PATCH 15/23] cxl/pci: Use module_pci_driver Dan Williams
2021-08-09 22:29 ` [PATCH 16/23] cxl/mbox: Convert 'enabled_cmds' to DECLARE_BITMAP Dan Williams
2021-08-09 22:29 ` [PATCH 17/23] cxl/mbox: Add exclusive kernel command support Dan Williams
2021-08-10 21:34   ` Ben Widawsky
2021-08-10 21:52     ` Dan Williams
2021-08-10 22:06       ` Ben Widawsky
2021-08-11  1:22         ` Dan Williams
2021-08-11  2:14           ` Dan Williams
2021-08-09 22:29 ` [PATCH 18/23] cxl/pmem: Translate NVDIMM label commands to CXL label commands Dan Williams
2021-08-09 22:29 ` [PATCH 19/23] cxl/pmem: Add support for multiple nvdimm-bridge objects Dan Williams
2021-08-09 22:29 ` [PATCH 20/23] tools/testing/cxl: Introduce a mocked-up CXL port hierarchy Dan Williams
2021-08-10 21:57   ` Ben Widawsky
2021-08-10 22:40     ` Dan Williams
2021-08-11 15:18       ` Ben Widawsky
     [not found]       ` <xp0k4.l2r85dw1p7do@intel.com>
2021-08-11 21:03         ` Dan Williams
2021-08-09 22:29 ` [PATCH 21/23] cxl/bus: Populate the target list at decoder create Dan Williams
2021-08-09 22:29 ` [PATCH 22/23] cxl/mbox: Move command definitions to common location Dan Williams
2021-08-09 22:29 ` [PATCH 23/23] tools/testing/cxl: Introduce a mock memory device + driver Dan Williams
2021-08-10 22:10 ` Ben Widawsky [this message]
2021-08-10 22:58   ` [PATCH 00/23] cxl_test: Enable CXL Topology and UAPI regression tests Dan Williams

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20210810221023.h65s3i3ephzt7m2w@intel.com \
    --to=ben.widawsky@intel.com \
    --cc=Jonathan.Cameron@huawei.com \
    --cc=alison.schofield@intel.com \
    --cc=andriy.shevchenko@linux.intel.com \
    --cc=dan.j.williams@intel.com \
    --cc=ira.weiny@intel.com \
    --cc=linux-cxl@vger.kernel.org \
    --cc=nvdimm@lists.linux.dev \
    --cc=vishal.l.verma@intel.com \
    --subject='Re: [PATCH 00/23] cxl_test: Enable CXL Topology and UAPI regression tests' \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).