All of lore.kernel.org
 help / color / mirror / Atom feed
* [PATCH v20 00/46] sg: add v4 interface
@ 2021-09-15 22:32 Douglas Gilbert
  2021-09-15 22:32 ` [PATCH v20 01/46] sg: move functions around Douglas Gilbert
                   ` (45 more replies)
  0 siblings, 46 replies; 48+ messages in thread
From: Douglas Gilbert @ 2021-09-15 22:32 UTC (permalink / raw)
  To: linux-scsi; +Cc: martin.petersen, jejb, hare, Damien.LeMoal

This patchset is the first stage of a two stage rewrite of the scsi
generic (sg) driver. The main goal of the first stage is to introduce
the sg v4 interface that uses 'struct sg_io_v4' as well as keeping and
modernizing the sg v3 interface (based on 'struct sg_io_hdr'). The
async interface formerly requiring the use of write() and read()
system calls now have ioctl(SG_IOSUBMIT) and ioctl(SG_IORECEIVE)
replacements. The sg v4 interface is not new, it has been used by
the bsg driver since it was introduced to the kernel around 15
years ago.

For documentation see either url:
    https://sg.danny.cz/sg/sg_v40.html
    https://doug-gilbert.github.io/sg_v40.html

This driver has been tested with utilities found at:
    https://github.com/doug-gilbert/sg3_utils
specifically sgh_dd found under the testing directory. The new
statistics gathering facility can be tested with either sgstat
or 'tapestat -g' using the author's clone of the sysstat package:
    https://github.com/doug-gilbert/sysstat

This patchset is against Martin Petersen's 5.16/scsi-queue branch.


Changes since v19 (sent to linux-scsi list on 20210523)
  - add statistics gathering similar to that found in st driver.
    The tapestat utility in the sysstat package can be used to
    display those statistics; similar arrangement for the sg
    driver. Make changes suggested by Damien Le Moal.
  - rebase on 5.16/scsi-queue branch [lk 5.15.0-rc1]
    - gendisk dependency removed
    - various other Christoph Hellwig cleanups

Changes since v18 (sent to linux-scsi list on 20210407)
  - a request queue's QUEUE_FLAG_POLL flag can be cleared via
    sysfs, overriding the ability to use blk_poll() even when the
    associated LLD allows it. Check that flag and, only when it
    is set and the sg user gives SGV4_FLAG_HIPRI, set REQ_HIPRI
    on a request.
  - simplify the functions supporting ioctl(SG_SET_RESERVED_SIZE)
  - replace blk_rq_append_bio() calls with the simpler
    blk_rq_bio_prep() calls
    [see lk: a4fe2d3afe3ce77edeadb567c0d0a8d102c6b159]
  - rebase on 5.14/scsi-queue branch [lk 5.13.0-rc1]
    - unchecked_isa_dma removed
    - BIO_MAX_PAGES renamed to BIO_MAX_VECS

Changes since v17 (sent to linux-scsi list on 20210407)
  - make clearer distinction between user pollable (i.e. async)
    requests and (user) non-pollable requests (e.g. those injected
    with ioctl(SG_IO), IOWs sync requests)
  - fix crash is sg_start_req() when blk_get_request() yields an
    error (e.g. -EAGAIN when low on resources)
  - sg_finish_scsi_blk_rq(): remove now_zero variable as suggested
    by Hannes R.
  - change deprecation warning url reference from http to https

Changes since v16 (sent to linux-scsi list on 20210208)
  - sg_start_req() fix double free on error path [KASAN]
  - sg_rq_map_kern() fix uninitialized variable [coverity]
  - sg_add_sfp() fix use after free [coverity]
  - sg_remove_sfp_usercontext(): remove pointless NULL check [coverity]
  - fix misuse of WARN_ONCE in sg_rq_end_io_usercontext() [D. Carpenter]
  - remove unused error checks: tracking blk_put_request() calls and
    multiple SG_XA_RQ_FREE calls
  - hipri: as blk_poll() can return > 0 for requests other than the one
    that is being checked for, need to re-check that request is ready
  - rebased on MKP's 5.13/scsi-queue

Changes since v15 (sent to linux-scsi list on 20210125)
  - tweak state machine which sets INFLIGHT state _before_
    blk_execute_rq_nowait() is called. Add a bit flag that indicates
    the logic flow has returned from that call. This guards against
    blk_poll() being called before the block layer has really
    launched the request.
  - fix bug clearing SG_FFD_HIPRI_SEEN bit as
    atomic_dec_and_test() returns true when the post-decrement value
    is zero, the opposite of what a C conditional does.

Changes since v14 and earlier
 - see: the v18 patchset sent to linux-scsi on 20210427


Douglas Gilbert (46):
  sg: move functions around
  sg: remove typedefs, type+formatting cleanup
  sg: sg_log and is_enabled
  sg: rework sg_poll(), minor changes
  sg: bitops in sg_device
  sg: make open count an atomic
  sg: move header to uapi section
  sg: speed sg_poll and sg_get_num_waiting
  sg: sg_allow_if_err_recovery and renames
  sg: improve naming
  sg: change rwlock to spinlock
  sg: ioctl handling
  sg: split sg_read
  sg: sg_common_write add structure for arguments
  sg: rework sg_vma_fault
  sg: rework sg_mmap
  sg: replace sg_allow_access
  sg: rework scatter gather handling
  sg: introduce request state machine
  sg: sg_find_srp_by_id
  sg: sg_fill_request_element
  sg: printk change %p to %pK
  sg: xarray for fds in device
  sg: xarray for reqs in fd
  sg: replace rq array with xarray
  sg: sense buffer rework
  sg: add sg v4 interface support
  sg: rework debug info
  sg: add 8 byte SCSI LUN to sg_scsi_id
  sg: expand sg_comm_wr_t
  sg: add sg_iosubmit_v3 and sg_ioreceive_v3 ioctls
  sg: add some __must_hold macros
  sg: move procfs objects to avoid forward decls
  sg: protect multiple receivers
  sg: first debugfs support
  sg: rework mmap support
  sg: defang allow_dio
  sg: warn v3 write system call users
  sg: add mmap_sz tracking
  sg: remove rcv_done request state
  sg: track lowest inactive and await indexes
  sg: remove unit attention check for device changed
  sg: no_dxfer: move to/from kernel buffers
  sg: add blk_poll support
  sg: add statistics similar to st
  sg: bump version to 4.0.12

 drivers/scsi/sg.c      | 5533 ++++++++++++++++++++++++++++------------
 include/scsi/sg.h      |  306 +--
 include/uapi/scsi/sg.h |  409 +++
 3 files changed, 4288 insertions(+), 1960 deletions(-)
 create mode 100644 include/uapi/scsi/sg.h

-- 
2.25.1


^ permalink raw reply	[flat|nested] 48+ messages in thread

end of thread, other threads:[~2021-09-28  3:02 UTC | newest]

Thread overview: 48+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-09-15 22:32 [PATCH v20 00/46] sg: add v4 interface Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 01/46] sg: move functions around Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 02/46] sg: remove typedefs, type+formatting cleanup Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 03/46] sg: sg_log and is_enabled Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 04/46] sg: rework sg_poll(), minor changes Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 05/46] sg: bitops in sg_device Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 06/46] sg: make open count an atomic Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 07/46] sg: move header to uapi section Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 08/46] sg: speed sg_poll and sg_get_num_waiting Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 09/46] sg: sg_allow_if_err_recovery and renames Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 10/46] sg: improve naming Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 11/46] sg: change rwlock to spinlock Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 12/46] sg: ioctl handling Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 13/46] sg: split sg_read Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 14/46] sg: sg_common_write add structure for arguments Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 15/46] sg: rework sg_vma_fault Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 16/46] sg: rework sg_mmap Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 17/46] sg: replace sg_allow_access Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 18/46] sg: rework scatter gather handling Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 19/46] sg: introduce request state machine Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 20/46] sg: sg_find_srp_by_id Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 21/46] sg: sg_fill_request_element Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 22/46] sg: printk change %p to %pK Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 23/46] sg: xarray for fds in device Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 24/46] sg: xarray for reqs in fd Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 25/46] sg: replace rq array with xarray Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 26/46] sg: sense buffer rework Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 27/46] sg: add sg v4 interface support Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 28/46] sg: rework debug info Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 29/46] sg: add 8 byte SCSI LUN to sg_scsi_id Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 30/46] sg: expand sg_comm_wr_t Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 31/46] sg: add sg_iosubmit_v3 and sg_ioreceive_v3 ioctls Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 32/46] sg: add some __must_hold macros Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 33/46] sg: move procfs objects to avoid forward decls Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 34/46] sg: protect multiple receivers Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 35/46] sg: first debugfs support Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 36/46] sg: rework mmap support Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 37/46] sg: defang allow_dio Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 38/46] sg: warn v3 write system call users Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 39/46] sg: add mmap_sz tracking Douglas Gilbert
2021-09-15 22:32 ` [PATCH v20 40/46] sg: remove rcv_done request state Douglas Gilbert
2021-09-15 22:33 ` [PATCH v20 41/46] sg: track lowest inactive and await indexes Douglas Gilbert
2021-09-15 22:33 ` [PATCH v20 42/46] sg: remove unit attention check for device changed Douglas Gilbert
2021-09-15 22:33 ` [PATCH v20 43/46] sg: no_dxfer: move to/from kernel buffers Douglas Gilbert
2021-09-15 22:33 ` [PATCH v20 44/46] sg: add blk_poll support Douglas Gilbert
2021-09-15 22:33 ` [PATCH v20 45/46] sg: add statistics similar to st Douglas Gilbert
2021-09-28  3:02   ` Damien Le Moal
2021-09-15 22:33 ` [PATCH v20 46/46] sg: bump version to 4.0.12 Douglas Gilbert

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.