From: Roman Pen <roman.penyaev@profitbricks.com> To: linux-block@vger.kernel.org, linux-rdma@vger.kernel.org Cc: Jens Axboe <axboe@kernel.dk>, Christoph Hellwig <hch@infradead.org>, Sagi Grimberg <sagi@grimberg.me>, Bart Van Assche <bart.vanassche@sandisk.com>, Or Gerlitz <ogerlitz@mellanox.com>, Roman Pen <roman.penyaev@profitbricks.com>, Danil Kipnis <danil.kipnis@profitbricks.com>, Jack Wang <jinpu.wang@profitbricks.com> Subject: [PATCH 00/24] InfiniBand Transport (IBTRS) and Network Block Device (IBNBD) Date: Fri, 2 Feb 2018 15:08:40 +0100 [thread overview] Message-ID: <20180202140904.2017-1-roman.penyaev@profitbricks.com> (raw) This series introduces IBNBD/IBTRS modules. IBTRS (InfiniBand Transport) is a reliable high speed transport library which allows for establishing connection between client and server machines via RDMA. It is optimized to transfer (read/write) IO blocks in the sense that it follows the BIO semantics of providing the possibility to either write data from a scatter-gather list to the remote side or to request ("read") data transfer from the remote side into a given set of buffers. IBTRS is multipath capable and provides I/O fail-over and load-balancing functionality. IBNBD (InfiniBand Network Block Device) is a pair of kernel modules (client and server) that allow for remote access of a block device on the server over IBTRS protocol. After being mapped, the remote block devices can be accessed on the client side as local block devices. Internally IBNBD uses IBTRS as an RDMA transport library. Why? - IBNBD/IBTRS is developed in order to map thin provisioned volumes, thus internal protocol is simple and consists of several request types only without awareness of underlaying hardware devices. - IBTRS was developed as an independent RDMA transport library, which supports fail-over and load-balancing policies using multipath, thus it can be used for any other IO needs rather than only for block device. - IBNBD/IBTRS is faster than NVME over RDMA. Old comparison results: https://www.spinics.net/lists/linux-rdma/msg48799.html (I retested on latest 4.14 kernel - there is no any significant difference, thus I post the old link). Key features of IBTRS transport library and IBNBD block device: o High throughput and low latency due to: - Only two RDMA messages per IO. - IMM InfiniBand messages on responses to reduce round trip latency. - Simplified memory management: memory allocation happens once on server side when IBTRS session is established. o IO fail-over and load-balancing by using multipath. o Simple configuration of IBNBD: - Server side is completely passive: volumes do not need to be explicitly exported. - Only IB port GID and device path needed on client side to map a block device. - A device is remapped automatically i.e. after storage reboot. This series is a second try, first variant was published [1] and presented on Vault in 2017 [2]. Since the first version the following was changed: - Load-balancing and IO fail-over using multipath features were added. - Major parts of the code were rewritten, simplified and overall code size was reduced by a quarter. Commits for kernel can be found here: https://github.com/profitbricks/ibnbd/commits/linux-4.15-rc8 The out-of-tree modules are here: https://github.com/profitbricks/ibnbd/ [1] https://lwn.net/Articles/718181/ [2] http://events.linuxfoundation.org/sites/events/files/slides/IBNBD-Vault-2017.pdf Roman Pen (24): ibtrs: public interface header to establish RDMA connections ibtrs: private headers with IBTRS protocol structs and helpers ibtrs: core: lib functions shared between client and server modules ibtrs: client: private header with client structs and functions ibtrs: client: main functionality ibtrs: client: statistics functions ibtrs: client: sysfs interface functions ibtrs: server: private header with server structs and functions ibtrs: server: main functionality ibtrs: server: statistics functions ibtrs: server: sysfs interface functions ibtrs: include client and server modules into kernel compilation ibtrs: a bit of documentation ibnbd: private headers with IBNBD protocol structs and helpers ibnbd: client: private header with client structs and functions ibnbd: client: main functionality ibnbd: client: sysfs interface functions ibnbd: server: private header with server structs and functions ibnbd: server: main functionality ibnbd: server: functionality for IO submission to file or block dev ibnbd: server: sysfs interface functions ibnbd: include client and server modules into kernel compilation ibnbd: a bit of documentation MAINTAINERS: Add maintainer for IBNBD/IBTRS modules MAINTAINERS | 14 + drivers/block/Kconfig | 2 + drivers/block/Makefile | 1 + drivers/block/ibnbd/Kconfig | 22 + drivers/block/ibnbd/Makefile | 13 + drivers/block/ibnbd/README | 272 ++ drivers/block/ibnbd/ibnbd-clt-sysfs.c | 723 +++++ drivers/block/ibnbd/ibnbd-clt.c | 1959 +++++++++++++ drivers/block/ibnbd/ibnbd-clt.h | 193 ++ drivers/block/ibnbd/ibnbd-log.h | 71 + drivers/block/ibnbd/ibnbd-proto.h | 360 +++ drivers/block/ibnbd/ibnbd-srv-dev.c | 410 +++ drivers/block/ibnbd/ibnbd-srv-dev.h | 149 + drivers/block/ibnbd/ibnbd-srv-sysfs.c | 264 ++ drivers/block/ibnbd/ibnbd-srv.c | 901 ++++++ drivers/block/ibnbd/ibnbd-srv.h | 100 + drivers/infiniband/Kconfig | 1 + drivers/infiniband/ulp/Makefile | 1 + drivers/infiniband/ulp/ibtrs/Kconfig | 20 + drivers/infiniband/ulp/ibtrs/Makefile | 15 + drivers/infiniband/ulp/ibtrs/README | 238 ++ drivers/infiniband/ulp/ibtrs/ibtrs-clt-stats.c | 455 +++ drivers/infiniband/ulp/ibtrs/ibtrs-clt-sysfs.c | 519 ++++ drivers/infiniband/ulp/ibtrs/ibtrs-clt.c | 3496 ++++++++++++++++++++++++ drivers/infiniband/ulp/ibtrs/ibtrs-clt.h | 338 +++ drivers/infiniband/ulp/ibtrs/ibtrs-log.h | 94 + drivers/infiniband/ulp/ibtrs/ibtrs-pri.h | 494 ++++ drivers/infiniband/ulp/ibtrs/ibtrs-srv-stats.c | 110 + drivers/infiniband/ulp/ibtrs/ibtrs-srv-sysfs.c | 278 ++ drivers/infiniband/ulp/ibtrs/ibtrs-srv.c | 1811 ++++++++++++ drivers/infiniband/ulp/ibtrs/ibtrs-srv.h | 169 ++ drivers/infiniband/ulp/ibtrs/ibtrs.c | 582 ++++ drivers/infiniband/ulp/ibtrs/ibtrs.h | 331 +++ 33 files changed, 14406 insertions(+) create mode 100644 drivers/block/ibnbd/Kconfig create mode 100644 drivers/block/ibnbd/Makefile create mode 100644 drivers/block/ibnbd/README create mode 100644 drivers/block/ibnbd/ibnbd-clt-sysfs.c create mode 100644 drivers/block/ibnbd/ibnbd-clt.c create mode 100644 drivers/block/ibnbd/ibnbd-clt.h create mode 100644 drivers/block/ibnbd/ibnbd-log.h create mode 100644 drivers/block/ibnbd/ibnbd-proto.h create mode 100644 drivers/block/ibnbd/ibnbd-srv-dev.c create mode 100644 drivers/block/ibnbd/ibnbd-srv-dev.h create mode 100644 drivers/block/ibnbd/ibnbd-srv-sysfs.c create mode 100644 drivers/block/ibnbd/ibnbd-srv.c create mode 100644 drivers/block/ibnbd/ibnbd-srv.h create mode 100644 drivers/infiniband/ulp/ibtrs/Kconfig create mode 100644 drivers/infiniband/ulp/ibtrs/Makefile create mode 100644 drivers/infiniband/ulp/ibtrs/README create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-clt-stats.c create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-clt-sysfs.c create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-clt.c create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-clt.h create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-log.h create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-pri.h create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-srv-stats.c create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-srv-sysfs.c create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-srv.c create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-srv.h create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs.c create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs.h Signed-off-by: Roman Pen <roman.penyaev@profitbricks.com> Cc: Danil Kipnis <danil.kipnis@profitbricks.com> Cc: Jack Wang <jinpu.wang@profitbricks.com> -- 2.13.1
WARNING: multiple messages have this Message-ID (diff)
From: Roman Pen <roman.penyaev-EIkl63zCoXaH+58JC4qpiA@public.gmane.org> To: linux-block-u79uwXL29TY76Z2rM5mHXA@public.gmane.org, linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org Cc: Jens Axboe <axboe-tSWWG44O7X1aa/9Udqfwiw@public.gmane.org>, Christoph Hellwig <hch-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>, Sagi Grimberg <sagi-NQWnxTmZq1alnMjI0IkVqw@public.gmane.org>, Bart Van Assche <bart.vanassche-XdAiOPVOjttBDgjK7y7TUQ@public.gmane.org>, Or Gerlitz <ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>, Roman Pen <roman.penyaev-EIkl63zCoXaH+58JC4qpiA@public.gmane.org>, Danil Kipnis <danil.kipnis-EIkl63zCoXaH+58JC4qpiA@public.gmane.org>, Jack Wang <jinpu.wang-EIkl63zCoXaH+58JC4qpiA@public.gmane.org> Subject: [PATCH 00/24] InfiniBand Transport (IBTRS) and Network Block Device (IBNBD) Date: Fri, 2 Feb 2018 15:08:40 +0100 [thread overview] Message-ID: <20180202140904.2017-1-roman.penyaev@profitbricks.com> (raw) This series introduces IBNBD/IBTRS modules. IBTRS (InfiniBand Transport) is a reliable high speed transport library which allows for establishing connection between client and server machines via RDMA. It is optimized to transfer (read/write) IO blocks in the sense that it follows the BIO semantics of providing the possibility to either write data from a scatter-gather list to the remote side or to request ("read") data transfer from the remote side into a given set of buffers. IBTRS is multipath capable and provides I/O fail-over and load-balancing functionality. IBNBD (InfiniBand Network Block Device) is a pair of kernel modules (client and server) that allow for remote access of a block device on the server over IBTRS protocol. After being mapped, the remote block devices can be accessed on the client side as local block devices. Internally IBNBD uses IBTRS as an RDMA transport library. Why? - IBNBD/IBTRS is developed in order to map thin provisioned volumes, thus internal protocol is simple and consists of several request types only without awareness of underlaying hardware devices. - IBTRS was developed as an independent RDMA transport library, which supports fail-over and load-balancing policies using multipath, thus it can be used for any other IO needs rather than only for block device. - IBNBD/IBTRS is faster than NVME over RDMA. Old comparison results: https://www.spinics.net/lists/linux-rdma/msg48799.html (I retested on latest 4.14 kernel - there is no any significant difference, thus I post the old link). Key features of IBTRS transport library and IBNBD block device: o High throughput and low latency due to: - Only two RDMA messages per IO. - IMM InfiniBand messages on responses to reduce round trip latency. - Simplified memory management: memory allocation happens once on server side when IBTRS session is established. o IO fail-over and load-balancing by using multipath. o Simple configuration of IBNBD: - Server side is completely passive: volumes do not need to be explicitly exported. - Only IB port GID and device path needed on client side to map a block device. - A device is remapped automatically i.e. after storage reboot. This series is a second try, first variant was published [1] and presented on Vault in 2017 [2]. Since the first version the following was changed: - Load-balancing and IO fail-over using multipath features were added. - Major parts of the code were rewritten, simplified and overall code size was reduced by a quarter. Commits for kernel can be found here: https://github.com/profitbricks/ibnbd/commits/linux-4.15-rc8 The out-of-tree modules are here: https://github.com/profitbricks/ibnbd/ [1] https://lwn.net/Articles/718181/ [2] http://events.linuxfoundation.org/sites/events/files/slides/IBNBD-Vault-2017.pdf Roman Pen (24): ibtrs: public interface header to establish RDMA connections ibtrs: private headers with IBTRS protocol structs and helpers ibtrs: core: lib functions shared between client and server modules ibtrs: client: private header with client structs and functions ibtrs: client: main functionality ibtrs: client: statistics functions ibtrs: client: sysfs interface functions ibtrs: server: private header with server structs and functions ibtrs: server: main functionality ibtrs: server: statistics functions ibtrs: server: sysfs interface functions ibtrs: include client and server modules into kernel compilation ibtrs: a bit of documentation ibnbd: private headers with IBNBD protocol structs and helpers ibnbd: client: private header with client structs and functions ibnbd: client: main functionality ibnbd: client: sysfs interface functions ibnbd: server: private header with server structs and functions ibnbd: server: main functionality ibnbd: server: functionality for IO submission to file or block dev ibnbd: server: sysfs interface functions ibnbd: include client and server modules into kernel compilation ibnbd: a bit of documentation MAINTAINERS: Add maintainer for IBNBD/IBTRS modules MAINTAINERS | 14 + drivers/block/Kconfig | 2 + drivers/block/Makefile | 1 + drivers/block/ibnbd/Kconfig | 22 + drivers/block/ibnbd/Makefile | 13 + drivers/block/ibnbd/README | 272 ++ drivers/block/ibnbd/ibnbd-clt-sysfs.c | 723 +++++ drivers/block/ibnbd/ibnbd-clt.c | 1959 +++++++++++++ drivers/block/ibnbd/ibnbd-clt.h | 193 ++ drivers/block/ibnbd/ibnbd-log.h | 71 + drivers/block/ibnbd/ibnbd-proto.h | 360 +++ drivers/block/ibnbd/ibnbd-srv-dev.c | 410 +++ drivers/block/ibnbd/ibnbd-srv-dev.h | 149 + drivers/block/ibnbd/ibnbd-srv-sysfs.c | 264 ++ drivers/block/ibnbd/ibnbd-srv.c | 901 ++++++ drivers/block/ibnbd/ibnbd-srv.h | 100 + drivers/infiniband/Kconfig | 1 + drivers/infiniband/ulp/Makefile | 1 + drivers/infiniband/ulp/ibtrs/Kconfig | 20 + drivers/infiniband/ulp/ibtrs/Makefile | 15 + drivers/infiniband/ulp/ibtrs/README | 238 ++ drivers/infiniband/ulp/ibtrs/ibtrs-clt-stats.c | 455 +++ drivers/infiniband/ulp/ibtrs/ibtrs-clt-sysfs.c | 519 ++++ drivers/infiniband/ulp/ibtrs/ibtrs-clt.c | 3496 ++++++++++++++++++++++++ drivers/infiniband/ulp/ibtrs/ibtrs-clt.h | 338 +++ drivers/infiniband/ulp/ibtrs/ibtrs-log.h | 94 + drivers/infiniband/ulp/ibtrs/ibtrs-pri.h | 494 ++++ drivers/infiniband/ulp/ibtrs/ibtrs-srv-stats.c | 110 + drivers/infiniband/ulp/ibtrs/ibtrs-srv-sysfs.c | 278 ++ drivers/infiniband/ulp/ibtrs/ibtrs-srv.c | 1811 ++++++++++++ drivers/infiniband/ulp/ibtrs/ibtrs-srv.h | 169 ++ drivers/infiniband/ulp/ibtrs/ibtrs.c | 582 ++++ drivers/infiniband/ulp/ibtrs/ibtrs.h | 331 +++ 33 files changed, 14406 insertions(+) create mode 100644 drivers/block/ibnbd/Kconfig create mode 100644 drivers/block/ibnbd/Makefile create mode 100644 drivers/block/ibnbd/README create mode 100644 drivers/block/ibnbd/ibnbd-clt-sysfs.c create mode 100644 drivers/block/ibnbd/ibnbd-clt.c create mode 100644 drivers/block/ibnbd/ibnbd-clt.h create mode 100644 drivers/block/ibnbd/ibnbd-log.h create mode 100644 drivers/block/ibnbd/ibnbd-proto.h create mode 100644 drivers/block/ibnbd/ibnbd-srv-dev.c create mode 100644 drivers/block/ibnbd/ibnbd-srv-dev.h create mode 100644 drivers/block/ibnbd/ibnbd-srv-sysfs.c create mode 100644 drivers/block/ibnbd/ibnbd-srv.c create mode 100644 drivers/block/ibnbd/ibnbd-srv.h create mode 100644 drivers/infiniband/ulp/ibtrs/Kconfig create mode 100644 drivers/infiniband/ulp/ibtrs/Makefile create mode 100644 drivers/infiniband/ulp/ibtrs/README create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-clt-stats.c create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-clt-sysfs.c create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-clt.c create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-clt.h create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-log.h create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-pri.h create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-srv-stats.c create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-srv-sysfs.c create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-srv.c create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs-srv.h create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs.c create mode 100644 drivers/infiniband/ulp/ibtrs/ibtrs.h Signed-off-by: Roman Pen <roman.penyaev-EIkl63zCoXaH+58JC4qpiA@public.gmane.org> Cc: Danil Kipnis <danil.kipnis-EIkl63zCoXaH+58JC4qpiA@public.gmane.org> Cc: Jack Wang <jinpu.wang-EIkl63zCoXaH+58JC4qpiA@public.gmane.org> -- 2.13.1 -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org More majordomo info at http://vger.kernel.org/majordomo-info.html
next reply other threads:[~2018-02-02 14:08 UTC|newest] Thread overview: 124+ messages / expand[flat|nested] mbox.gz Atom feed top 2018-02-02 14:08 Roman Pen [this message] 2018-02-02 14:08 ` [PATCH 00/24] InfiniBand Transport (IBTRS) and Network Block Device (IBNBD) Roman Pen 2018-02-02 14:08 ` [PATCH 01/24] ibtrs: public interface header to establish RDMA connections Roman Pen 2018-02-02 14:08 ` Roman Pen 2018-02-02 14:08 ` [PATCH 02/24] ibtrs: private headers with IBTRS protocol structs and helpers Roman Pen 2018-02-02 14:08 ` [PATCH 03/24] ibtrs: core: lib functions shared between client and server modules Roman Pen 2018-02-02 14:08 ` Roman Pen 2018-02-05 10:52 ` Sagi Grimberg 2018-02-06 12:01 ` Roman Penyaev 2018-02-06 16:10 ` Jason Gunthorpe 2018-02-07 10:34 ` Roman Penyaev 2018-02-07 10:34 ` Roman Penyaev 2018-02-02 14:08 ` [PATCH 04/24] ibtrs: client: private header with client structs and functions Roman Pen 2018-02-02 14:08 ` Roman Pen 2018-02-05 10:59 ` Sagi Grimberg 2018-02-05 10:59 ` Sagi Grimberg 2018-02-06 12:23 ` Roman Penyaev 2018-02-02 14:08 ` [PATCH 05/24] ibtrs: client: main functionality Roman Pen 2018-02-02 16:54 ` Bart Van Assche 2018-02-02 16:54 ` Bart Van Assche 2018-02-05 13:27 ` Roman Penyaev 2018-02-05 14:14 ` Sagi Grimberg 2018-02-05 14:14 ` Sagi Grimberg 2018-02-05 17:05 ` Roman Penyaev 2018-02-05 17:05 ` Roman Penyaev 2018-02-05 11:19 ` Sagi Grimberg 2018-02-05 14:19 ` Roman Penyaev 2018-02-05 14:19 ` Roman Penyaev 2018-02-05 16:24 ` Bart Van Assche 2018-02-05 16:24 ` Bart Van Assche 2018-02-02 14:08 ` [PATCH 06/24] ibtrs: client: statistics functions Roman Pen 2018-02-02 14:08 ` [PATCH 07/24] ibtrs: client: sysfs interface functions Roman Pen 2018-02-02 14:08 ` Roman Pen 2018-02-05 11:20 ` Sagi Grimberg 2018-02-05 11:20 ` Sagi Grimberg 2018-02-06 12:28 ` Roman Penyaev 2018-02-02 14:08 ` [PATCH 08/24] ibtrs: server: private header with server structs and functions Roman Pen 2018-02-02 14:08 ` [PATCH 09/24] ibtrs: server: main functionality Roman Pen 2018-02-02 14:08 ` Roman Pen 2018-02-05 11:29 ` Sagi Grimberg 2018-02-05 11:29 ` Sagi Grimberg 2018-02-06 12:46 ` Roman Penyaev 2018-02-02 14:08 ` [PATCH 10/24] ibtrs: server: statistics functions Roman Pen 2018-02-02 14:08 ` [PATCH 11/24] ibtrs: server: sysfs interface functions Roman Pen 2018-02-02 14:08 ` Roman Pen 2018-02-02 14:08 ` [PATCH 12/24] ibtrs: include client and server modules into kernel compilation Roman Pen 2018-02-02 14:08 ` [PATCH 13/24] ibtrs: a bit of documentation Roman Pen 2018-02-02 14:08 ` [PATCH 14/24] ibnbd: private headers with IBNBD protocol structs and helpers Roman Pen 2018-02-02 14:08 ` Roman Pen 2018-02-02 14:08 ` [PATCH 15/24] ibnbd: client: private header with client structs and functions Roman Pen 2018-02-02 14:08 ` Roman Pen 2018-02-02 14:08 ` [PATCH 16/24] ibnbd: client: main functionality Roman Pen 2018-02-02 14:08 ` Roman Pen 2018-02-02 15:11 ` Jens Axboe 2018-02-02 15:11 ` Jens Axboe 2018-02-05 12:54 ` Roman Penyaev 2018-02-02 14:08 ` [PATCH 17/24] ibnbd: client: sysfs interface functions Roman Pen 2018-02-02 14:08 ` Roman Pen 2018-02-02 14:08 ` [PATCH 18/24] ibnbd: server: private header with server structs and functions Roman Pen 2018-02-02 14:08 ` [PATCH 19/24] ibnbd: server: main functionality Roman Pen 2018-02-02 14:09 ` [PATCH 20/24] ibnbd: server: functionality for IO submission to file or block dev Roman Pen 2018-02-02 14:09 ` Roman Pen 2018-02-02 14:09 ` [PATCH 21/24] ibnbd: server: sysfs interface functions Roman Pen 2018-02-02 14:09 ` Roman Pen 2018-02-02 14:09 ` [PATCH 22/24] ibnbd: include client and server modules into kernel compilation Roman Pen 2018-02-02 14:09 ` [PATCH 23/24] ibnbd: a bit of documentation Roman Pen 2018-02-02 14:09 ` Roman Pen 2018-02-02 15:55 ` Bart Van Assche 2018-02-02 15:55 ` Bart Van Assche 2018-02-05 13:03 ` Roman Penyaev 2018-02-05 14:16 ` Sagi Grimberg 2018-02-02 14:09 ` [PATCH 24/24] MAINTAINERS: Add maintainer for IBNBD/IBTRS modules Roman Pen 2018-02-02 16:07 ` [PATCH 00/24] InfiniBand Transport (IBTRS) and Network Block Device (IBNBD) Bart Van Assche 2018-02-02 16:07 ` Bart Van Assche 2018-02-02 16:40 ` Doug Ledford 2018-02-02 16:40 ` Doug Ledford 2018-02-05 8:45 ` Jinpu Wang 2018-02-05 8:45 ` Jinpu Wang 2018-06-04 12:14 ` Danil Kipnis 2018-02-02 17:05 ` Bart Van Assche 2018-02-02 17:05 ` Bart Van Assche 2018-02-05 8:56 ` Jinpu Wang 2018-02-05 11:36 ` Sagi Grimberg 2018-02-05 13:38 ` Danil Kipnis 2018-02-05 13:38 ` Danil Kipnis 2018-02-05 14:17 ` Sagi Grimberg 2018-02-05 16:40 ` Danil Kipnis 2018-02-05 18:38 ` Bart Van Assche 2018-02-06 9:44 ` Danil Kipnis 2018-02-06 9:44 ` Danil Kipnis 2018-02-06 15:35 ` Bart Van Assche 2018-02-06 15:35 ` Bart Van Assche 2018-02-05 16:16 ` Bart Van Assche 2018-02-05 16:16 ` Bart Van Assche 2018-02-05 16:36 ` Jinpu Wang 2018-02-05 16:36 ` Jinpu Wang 2018-02-07 16:35 ` Christopher Lameter 2018-02-07 17:18 ` Roman Penyaev 2018-02-07 17:32 ` Bart Van Assche 2018-02-07 17:32 ` Bart Van Assche 2018-02-08 17:38 ` Danil Kipnis 2018-02-08 17:38 ` Danil Kipnis 2018-02-08 18:09 ` Bart Van Assche 2018-02-08 18:09 ` Bart Van Assche 2018-06-04 12:27 ` Danil Kipnis 2018-02-05 12:16 ` Sagi Grimberg 2018-02-05 12:16 ` Sagi Grimberg 2018-02-05 12:30 ` Sagi Grimberg 2018-02-07 13:06 ` Roman Penyaev 2018-02-07 13:06 ` Roman Penyaev 2018-02-05 16:58 ` Bart Van Assche 2018-02-05 16:58 ` Bart Van Assche 2018-02-05 17:16 ` Roman Penyaev 2018-02-05 17:20 ` Bart Van Assche 2018-02-05 17:20 ` Bart Van Assche 2018-02-06 11:47 ` Roman Penyaev 2018-02-06 13:12 ` Roman Penyaev 2018-02-06 13:12 ` Roman Penyaev 2018-02-06 16:01 ` Bart Van Assche 2018-02-06 16:01 ` Bart Van Assche 2018-02-07 12:57 ` Roman Penyaev 2018-02-07 12:57 ` Roman Penyaev 2018-02-07 16:35 ` Bart Van Assche 2018-02-07 16:35 ` Bart Van Assche
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=20180202140904.2017-1-roman.penyaev@profitbricks.com \ --to=roman.penyaev@profitbricks.com \ --cc=axboe@kernel.dk \ --cc=bart.vanassche@sandisk.com \ --cc=danil.kipnis@profitbricks.com \ --cc=hch@infradead.org \ --cc=jinpu.wang@profitbricks.com \ --cc=linux-block@vger.kernel.org \ --cc=linux-rdma@vger.kernel.org \ --cc=ogerlitz@mellanox.com \ --cc=sagi@grimberg.me \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: linkBe sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.