From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wr0-f196.google.com ([209.85.128.196]:35347 "EHLO mail-wr0-f196.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752252AbdDFIeH (ORCPT ); Thu, 6 Apr 2017 04:34:07 -0400 Subject: Re: [PATCH rfc 0/6] Automatic affinity settings for nvme over rdma To: Max Gurtovoy , linux-rdma@vger.kernel.org, linux-nvme@lists.infradead.org, linux-block@vger.kernel.org References: <1491140492-25703-1-git-send-email-sagi@grimberg.me> <86ed1762-a990-691f-e043-3d7dcac8fe85@mellanox.com> Cc: netdev@vger.kernel.org, Saeed Mahameed , Or Gerlitz , Christoph Hellwig From: Sagi Grimberg Message-ID: <09b4dcb4-d0ab-43b7-5f1c-394ecfcce2f0@grimberg.me> Date: Thu, 6 Apr 2017 11:34:03 +0300 MIME-Version: 1.0 In-Reply-To: <86ed1762-a990-691f-e043-3d7dcac8fe85@mellanox.com> Content-Type: text/plain; charset=windows-1255; format=flowed Sender: linux-block-owner@vger.kernel.org List-Id: linux-block@vger.kernel.org > Hi Sagi, Hey Max, > the patchset looks good and of course we can add support for more > drivers in the future. > have you run some performance testing with the nvmf initiator ? I'm limited by the target machine in terms of IOPs, but the host shows ~10% cpu usage decrease, and latency improves slightly as well which is more apparent depending on which cpu I'm running my IO thread (due to the mismatch in comp_vectors and queue mappings some queues have irq vectors mapped to a core on a different numa node. From mboxrd@z Thu Jan 1 00:00:00 1970 From: Sagi Grimberg Subject: Re: [PATCH rfc 0/6] Automatic affinity settings for nvme over rdma Date: Thu, 6 Apr 2017 11:34:03 +0300 Message-ID: <09b4dcb4-d0ab-43b7-5f1c-394ecfcce2f0@grimberg.me> References: <1491140492-25703-1-git-send-email-sagi@grimberg.me> <86ed1762-a990-691f-e043-3d7dcac8fe85@mellanox.com> Mime-Version: 1.0 Content-Type: text/plain; charset=windows-1255; format=flowed Content-Transfer-Encoding: 7bit Return-path: In-Reply-To: <86ed1762-a990-691f-e043-3d7dcac8fe85-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org> Sender: linux-rdma-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org To: Max Gurtovoy , linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org, linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r@public.gmane.org, linux-block-u79uwXL29TY76Z2rM5mHXA@public.gmane.org Cc: netdev-u79uwXL29TY76Z2rM5mHXA@public.gmane.org, Saeed Mahameed , Or Gerlitz , Christoph Hellwig List-Id: linux-rdma@vger.kernel.org > Hi Sagi, Hey Max, > the patchset looks good and of course we can add support for more > drivers in the future. > have you run some performance testing with the nvmf initiator ? I'm limited by the target machine in terms of IOPs, but the host shows ~10% cpu usage decrease, and latency improves slightly as well which is more apparent depending on which cpu I'm running my IO thread (due to the mismatch in comp_vectors and queue mappings some queues have irq vectors mapped to a core on a different numa node. -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org More majordomo info at http://vger.kernel.org/majordomo-info.html From mboxrd@z Thu Jan 1 00:00:00 1970 From: sagi@grimberg.me (Sagi Grimberg) Date: Thu, 6 Apr 2017 11:34:03 +0300 Subject: [PATCH rfc 0/6] Automatic affinity settings for nvme over rdma In-Reply-To: <86ed1762-a990-691f-e043-3d7dcac8fe85@mellanox.com> References: <1491140492-25703-1-git-send-email-sagi@grimberg.me> <86ed1762-a990-691f-e043-3d7dcac8fe85@mellanox.com> Message-ID: <09b4dcb4-d0ab-43b7-5f1c-394ecfcce2f0@grimberg.me> > Hi Sagi, Hey Max, > the patchset looks good and of course we can add support for more > drivers in the future. > have you run some performance testing with the nvmf initiator ? I'm limited by the target machine in terms of IOPs, but the host shows ~10% cpu usage decrease, and latency improves slightly as well which is more apparent depending on which cpu I'm running my IO thread (due to the mismatch in comp_vectors and queue mappings some queues have irq vectors mapped to a core on a different numa node.