All of lore.kernel.org
 help / color / mirror / Atom feed
From: Haren Myneni <haren@linux.ibm.com>
To: herbert@gondor.apana.org.au, mpe@ellerman.id.au,
	linux-crypto@vger.kernel.org, linuxppc-dev@lists.ozlabs.org,
	hch@infradead.org, npiggin@gmail.com, mikey@neuling.org
Cc: sukadev@linux.vnet.ibm.com, hbabu@us.ibm.com
Subject: [PATCH 00/10] crypto/nx: Enable GZIP engine and provide userpace API
Date: Sun, 15 Dec 2019 04:50:39 -0800	[thread overview]
Message-ID: <1576414240.16318.4066.camel@hbabu-laptop> (raw)


Power9 processor supports Virtual Accelerator Switchboard (VAS) which
allows kernel and userspace to send compression requests to Nest
Accelerator (NX) directly. The NX unit comprises of 2 842 compression
engines and 1 GZIP engine. Linux kernel already has 842 compression
support on kernel. This patch series adds GZIP compression support
from user space. The GZIP Compression engine implements the ZLIB and
GZIP compression algorithms. No plans of adding NX-GZIP compression
support in kernel right now.

Applications can send requests to NX directly with COPY/PASTE
instructions. But kernel has to establish channel / window on NX-GZIP
device for the userspace. So userspace access to the GZIP engine is
provided through /dev/crypto/nx-gzip device with several several
operations.

An application must open the this device to obtain a file descriptor (fd).
Using the fd, application should issue the VAS_TX_WIN_OPEN ioctl to
establish a connection to the engine. Once window is opened, should use
mmap() system call to map the hardware address of engine's request queue
into the application's virtual address space. Then user space forms the
request as co-processor Request Block (CRB) and paste this CRB on the
mapped HW address using COPY/PASTE instructions. Application can poll
on status flags (part of CRB) with timeout for request completion.

For VAS_TX_WIN_OPEN ioctl, if user space passes vas_id = -1 (struct
vas_tx_win_open_attr), kernel determins the VAS instance on the
corresponding chip based on the CPU on which the process is executing.
Otherwise, the specified VAS instance is used if application passes the
proper VAS instance (vas_id listed in /proc/device-tree/vas@*/ibm,vas_id).

Process can open multiple windows with different FDs or can send several
requests to NX on the same window at the same time.

A userspace library libnxz is available:
        https://github.com/abalib/power-gzip

Applications that use inflate/deflate calls can link with libNXz and use
NX GZIP compression without any modification.

Tested the available 842 compression on power8 and power9 system to make
sure no regression and tested GZIP compression on power9 with tests
available in the above link.

Thanks to Bulent Abali for nxz library and tests development.

Haren Myneni (10):
  powerpc/vas: Define vas_win_paste_addr()
  powerpc/vas: Initialize window attributes for GZIP coprocessor type
  powerpc/vas: Define VAS_TX_WIN_OPEN ioctl API
  crypto/nx: Initialize coproc entry with kzalloc
  crypto/nx: Organize powernv 842 code to add new GZIP compression type
  crypto/NX: Make code generic to add new GZIP compression type
  crypto/nx: Enable and setup GZIP compresstion type
  crypto/NX: Add NX GZIP user space API
  powerpc/vas: Remove 'pid' in vas_tx_win_attr struct
  Documentation/powerpc: VAS API

 Documentation/ioctl/ioctl-number.rst        |   1 +
 Documentation/powerpc/index.rst             |   1 +
 Documentation/powerpc/vas-api.rst           | 246 +++++++++++++++
 arch/powerpc/include/asm/vas.h              |   6 +-
 arch/powerpc/include/uapi/asm/vas-api.h     |  22 ++
 arch/powerpc/platforms/powernv/vas-window.c |  27 +-
 drivers/crypto/nx/Makefile                  |   2 +-
 drivers/crypto/nx/nx-842-powernv.c          | 412 +-----------------------
 drivers/crypto/nx/nx-842-powernv.h          |  31 ++
 drivers/crypto/nx/nx-commom-powernv.c       | 474 ++++++++++++++++++++++++++++
 drivers/crypto/nx/nx-gzip-powernv.c         | 282 +++++++++++++++++
 11 files changed, 1094 insertions(+), 410 deletions(-)
 create mode 100644 Documentation/powerpc/vas-api.rst
 create mode 100644 arch/powerpc/include/uapi/asm/vas-api.h
 create mode 100644 drivers/crypto/nx/nx-842-powernv.h
 create mode 100644 drivers/crypto/nx/nx-commom-powernv.c
 create mode 100644 drivers/crypto/nx/nx-gzip-powernv.c

-- 
1.8.3.1




WARNING: multiple messages have this Message-ID (diff)
From: Haren Myneni <haren@linux.ibm.com>
To: herbert@gondor.apana.org.au, mpe@ellerman.id.au,
	linux-crypto@vger.kernel.org, linuxppc-dev@lists.ozlabs.org,
	hch@infradead.org, npiggin@gmail.com, mikey@neuling.org
Cc: sukadev@linux.vnet.ibm.com
Subject: [PATCH 00/10] crypto/nx: Enable GZIP engine and provide userpace API
Date: Sun, 15 Dec 2019 04:50:39 -0800	[thread overview]
Message-ID: <1576414240.16318.4066.camel@hbabu-laptop> (raw)


Power9 processor supports Virtual Accelerator Switchboard (VAS) which
allows kernel and userspace to send compression requests to Nest
Accelerator (NX) directly. The NX unit comprises of 2 842 compression
engines and 1 GZIP engine. Linux kernel already has 842 compression
support on kernel. This patch series adds GZIP compression support
from user space. The GZIP Compression engine implements the ZLIB and
GZIP compression algorithms. No plans of adding NX-GZIP compression
support in kernel right now.

Applications can send requests to NX directly with COPY/PASTE
instructions. But kernel has to establish channel / window on NX-GZIP
device for the userspace. So userspace access to the GZIP engine is
provided through /dev/crypto/nx-gzip device with several several
operations.

An application must open the this device to obtain a file descriptor (fd).
Using the fd, application should issue the VAS_TX_WIN_OPEN ioctl to
establish a connection to the engine. Once window is opened, should use
mmap() system call to map the hardware address of engine's request queue
into the application's virtual address space. Then user space forms the
request as co-processor Request Block (CRB) and paste this CRB on the
mapped HW address using COPY/PASTE instructions. Application can poll
on status flags (part of CRB) with timeout for request completion.

For VAS_TX_WIN_OPEN ioctl, if user space passes vas_id = -1 (struct
vas_tx_win_open_attr), kernel determins the VAS instance on the
corresponding chip based on the CPU on which the process is executing.
Otherwise, the specified VAS instance is used if application passes the
proper VAS instance (vas_id listed in /proc/device-tree/vas@*/ibm,vas_id).

Process can open multiple windows with different FDs or can send several
requests to NX on the same window at the same time.

A userspace library libnxz is available:
        https://github.com/abalib/power-gzip

Applications that use inflate/deflate calls can link with libNXz and use
NX GZIP compression without any modification.

Tested the available 842 compression on power8 and power9 system to make
sure no regression and tested GZIP compression on power9 with tests
available in the above link.

Thanks to Bulent Abali for nxz library and tests development.

Haren Myneni (10):
  powerpc/vas: Define vas_win_paste_addr()
  powerpc/vas: Initialize window attributes for GZIP coprocessor type
  powerpc/vas: Define VAS_TX_WIN_OPEN ioctl API
  crypto/nx: Initialize coproc entry with kzalloc
  crypto/nx: Organize powernv 842 code to add new GZIP compression type
  crypto/NX: Make code generic to add new GZIP compression type
  crypto/nx: Enable and setup GZIP compresstion type
  crypto/NX: Add NX GZIP user space API
  powerpc/vas: Remove 'pid' in vas_tx_win_attr struct
  Documentation/powerpc: VAS API

 Documentation/ioctl/ioctl-number.rst        |   1 +
 Documentation/powerpc/index.rst             |   1 +
 Documentation/powerpc/vas-api.rst           | 246 +++++++++++++++
 arch/powerpc/include/asm/vas.h              |   6 +-
 arch/powerpc/include/uapi/asm/vas-api.h     |  22 ++
 arch/powerpc/platforms/powernv/vas-window.c |  27 +-
 drivers/crypto/nx/Makefile                  |   2 +-
 drivers/crypto/nx/nx-842-powernv.c          | 412 +-----------------------
 drivers/crypto/nx/nx-842-powernv.h          |  31 ++
 drivers/crypto/nx/nx-commom-powernv.c       | 474 ++++++++++++++++++++++++++++
 drivers/crypto/nx/nx-gzip-powernv.c         | 282 +++++++++++++++++
 11 files changed, 1094 insertions(+), 410 deletions(-)
 create mode 100644 Documentation/powerpc/vas-api.rst
 create mode 100644 arch/powerpc/include/uapi/asm/vas-api.h
 create mode 100644 drivers/crypto/nx/nx-842-powernv.h
 create mode 100644 drivers/crypto/nx/nx-commom-powernv.c
 create mode 100644 drivers/crypto/nx/nx-gzip-powernv.c

-- 
1.8.3.1




             reply	other threads:[~2019-12-15 12:53 UTC|newest]

Thread overview: 28+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-12-15 12:50 Haren Myneni [this message]
2019-12-15 12:50 ` [PATCH 00/10] crypto/nx: Enable GZIP engine and provide userpace API Haren Myneni
2019-12-15 12:59 ` [PATCH 01/10] powerpc/vas: Define vas_win_paste_addr() Haren Myneni
2019-12-15 12:59   ` Haren Myneni
2019-12-15 13:00 ` [PATCH 02/10] powerpc/vas: Initialize window attributes for GZIP compression Haren Myneni
2019-12-15 13:00   ` Haren Myneni
2019-12-15 13:01 ` [PATCH 03/10] powerpc/vas: Define VAS_TX_WIN_OPEN ioctl API Haren Myneni
2019-12-15 13:01   ` Haren Myneni
2019-12-15 13:02 ` [PATCH 04/10] crypto/nx: Initialize coproc entry with kzalloc Haren Myneni
2019-12-15 13:02   ` Haren Myneni
2019-12-15 13:02 ` [PATCH 05/10] crypto/nx: Organize powernv 842 code to add new GZIP compression type Haren Myneni
2019-12-15 13:02   ` Haren Myneni
2019-12-15 13:03 ` [PATCH 06/10] crypto/NX: Make code generic to add new GZIP compression Haren Myneni
2019-12-15 13:03   ` Haren Myneni
2019-12-15 13:03 ` [PATCH 07/10] crypto/nx: Enable and setup GZIP compresstion type Haren Myneni
2019-12-15 13:03   ` Haren Myneni
2019-12-15 13:05 ` [PATCH 08/10] crypto/NX: Add NX GZIP user space API Haren Myneni
2019-12-15 13:05   ` Haren Myneni
2019-12-17  9:33   ` Herbert Xu
2019-12-17  9:33     ` Herbert Xu
2019-12-19  8:49     ` Haren Myneni
2019-12-19  8:49       ` Haren Myneni
2019-12-20  7:41       ` Herbert Xu
2019-12-20  7:41         ` Herbert Xu
2019-12-15 13:05 ` [PATCH 09/10] powerpc/vas: Remove 'pid' in vas_tx_win_attr struct Haren Myneni
2019-12-15 13:05   ` Haren Myneni
2019-12-15 13:06 ` [PATCH 10/10] Documentation/powerpc: VAS API Haren Myneni
2019-12-15 13:06   ` Haren Myneni

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1576414240.16318.4066.camel@hbabu-laptop \
    --to=haren@linux.ibm.com \
    --cc=hbabu@us.ibm.com \
    --cc=hch@infradead.org \
    --cc=herbert@gondor.apana.org.au \
    --cc=linux-crypto@vger.kernel.org \
    --cc=linuxppc-dev@lists.ozlabs.org \
    --cc=mikey@neuling.org \
    --cc=mpe@ellerman.id.au \
    --cc=npiggin@gmail.com \
    --cc=sukadev@linux.vnet.ibm.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.