[GIT PULL] io_uring updates for 5.15-rc1

[Jens Axboe <axboe@kernel.dk>]

Hi Linus,

io_uring updates for the 5.15 release:

- Cancelation cleanups (Hao, Pavel)

- io-wq accounting cleanup (Hao)

- io_uring submit locking fix (Hao)

- io_uring link handling fixes (Hao)

- Fixed file improvements (wangyangbo, Pavel)

- Allow updates of linked timeouts like regular timeouts (Pavel)

- IOPOLL fix (Pavel)

- Remove batched file get optimization (Pavel)

- Improve reference handling (Pavel)

- IRQ task_work batching (Pavel)

- Allow pure fixed file, and add support for open/accept (Pavel)

- GFP_ATOMIC RT kernel fix

- Multiple CQ ring waiter improvement

- Funnel IRQ completions through task_work

- Add support for limiting async workers explicitly

- Add different clocksource support for timeouts

- io-wq wakeup race fix

- Lots of cleanups and improvement (Pavel et al)

Please pull!


The following changes since commit e22ce8eb631bdc47a4a4ea7ecf4e4ba499db4f93:

  Linux 5.14-rc7 (2021-08-22 14:24:56 -0700)

are available in the Git repository at:

  git://git.kernel.dk/linux-block.git tags/for-5.15/io_uring-2021-08-30

for you to fetch changes up to 87df7fb922d18e96992aa5e824aa34b2065fef59:

  io-wq: fix wakeup race when adding new work (2021-08-30 07:45:47 -0600)

----------------------------------------------------------------
for-5.15/io_uring-2021-08-30

----------------------------------------------------------------
Hao Xu (8):
      io_uring: extract io_uring_files_cancel() in io_uring_task_cancel()
      io_uring: remove files pointer in cancellation functions
      io_uring: code clean for completion_lock in io_arm_poll_handler()
      io-wq: move nr_running and worker_refs out of wqe->lock protection
      io_uring: fix lack of protection for compl_nr
      io_uring: don't free request to slab
      io_uring: remove redundant req_set_fail()
      io_uring: fix failed linkchain code logic

Jens Axboe (14):
      io-wq: remove GFP_ATOMIC allocation off schedule out path
      io_uring: be smarter about waking multiple CQ ring waiters
      io_uring: run timeouts from task_work
      io_uring: run linked timeouts from task_work
      io_uring: run regular file completions from task_work
      io_uring: remove IRQ aspect of io_ring_ctx completion lock
      io_uring: correct __must_hold annotation
      io_uring: add comments on why PF_EXITING checking is safe
      io_uring: add clarifying comment for io_cqring_ev_posted()
      io-wq: provide a way to limit max number of workers
      io_uring: support CLOCK_BOOTTIME/REALTIME for timeouts
      io-wq: check max_worker limits if a worker transitions bound state
      io-wq: wqe and worker locks no longer need to be IRQ safe
      io-wq: fix wakeup race when adding new work

Pavel Begunkov (64):
      io_uring: use kvmalloc for fixed files
      io_uring: inline fixed part of io_file_get()
      io_uring: rename io_file_supports_async()
      io_uring: avoid touching inode in rw prep
      io_uring: clean io-wq callbacks
      io_uring: remove unnecessary PF_EXITING check
      io-wq: improve wq_list_add_tail()
      io_uring: refactor io_alloc_req
      io_uring: don't halt iopoll too early
      io_uring: add more locking annotations for submit
      io_uring: optimise io_cqring_wait() hot path
      io_uring: extract a helper for ctx quiesce
      io_uring: move io_put_task() definition
      io_uring: move io_rsrc_node_alloc() definition
      io_uring: inline io_free_req_deferred
      io_uring: deduplicate open iopoll check
      io_uring: improve ctx hang handling
      io_uring: kill unused IO_IOPOLL_BATCH
      io_uring: drop exec checks from io_req_task_submit
      io_uring: optimise putting task struct
      io_uring: move io_fallback_req_func()
      io_uring: cache __io_free_req()'d requests
      io_uring: remove redundant args from cache_free
      io_uring: use inflight_entry instead of compl.list
      io_uring: inline struct io_comp_state
      io_uring: remove extra argument for overflow flush
      io_uring: inline io_poll_remove_waitqs
      io_uring: clean up tctx_task_work()
      io_uring: remove file batch-get optimisation
      io_uring: move req_ref_get() and friends
      io_uring: remove req_ref_sub_and_test()
      io_uring: remove submission references
      io_uring: skip request refcounting
      io_uring: optimise hot path of ltimeout prep
      io_uring: optimise iowq refcounting
      io_uring: don't inflight-track linked timeouts
      io_uring: optimise initial ltimeout refcounting
      io_uring: kill not necessary resubmit switch
      io_uring: deduplicate cancellation code
      io_uring: kill REQ_F_LTIMEOUT_ACTIVE
      io_uring: simplify io_prep_linked_timeout
      io_uring: cancel not-armed linked touts separately
      io_uring: optimise io_prep_linked_timeout()
      io_uring: better encapsulate buffer select for rw
      io_uring: reuse io_req_complete_post()
      io_uring: improve same wq polling
      io_uring: fix io_timeout_remove locking
      io_uring: extend task put optimisations
      io_uring: limit fixed table size by RLIMIT_NOFILE
      io_uring: place fixed tables under memcg limits
      io_uring: add ->splice_fd_in checks
      io_uring: flush completions for fallbacks
      io_uring: batch task work locking
      io_uring: IRQ rw completion batching
      io_uring: fix io_try_cancel_userdata race for iowq
      net: add accept helper not installing fd
      io_uring: openat directly into fixed fd table
      io_uring: hand code io_accept() fd installing
      io_uring: accept directly into fixed file table
      io_uring: add task-refs-get helper
      io_uring: clarify io_req_task_cancel() locking
      io_uring: add build check for buf_index overflows
      io_uring: keep ltimeouts in a list
      io_uring: allow updating linked timeouts

wangyangbo (1):
      io_uring: Add register support for non-4k PAGE_SIZE

 fs/io-wq.c                    |  208 +++--
 fs/io-wq.h                    |    3 +-
 fs/io_uring.c                 | 1767 ++++++++++++++++++++++++-----------------
 include/linux/io_uring.h      |   11 +-
 include/linux/socket.h        |    3 +
 include/uapi/linux/io_uring.h |   18 +-
 kernel/exit.c                 |    2 +-
 net/socket.c                  |   71 +-
 8 files changed, 1227 insertions(+), 856 deletions(-)

-- 
Jens Axboe