From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754288AbeDTDxA (ORCPT ); Thu, 19 Apr 2018 23:53:00 -0400 Received: from mx3-rdu2.redhat.com ([66.187.233.73]:45728 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1754148AbeDTDw7 (ORCPT ); Thu, 19 Apr 2018 23:52:59 -0400 Subject: Re: [RFC] vhost: introduce mdev based hardware vhost backend To: "Michael S. Tsirkin" Cc: Tiwei Bie , alex.williamson@redhat.com, ddutile@redhat.com, alexander.h.duyck@intel.com, virtio-dev@lists.oasis-open.org, linux-kernel@vger.kernel.org, kvm@vger.kernel.org, virtualization@lists.linux-foundation.org, netdev@vger.kernel.org, dan.daly@intel.com, cunming.liang@intel.com, zhihong.wang@intel.com, jianfeng.tan@intel.com, xiao.w.wang@intel.com References: <20180402152330.4158-1-tiwei.bie@intel.com> <622f4bd7-1249-5545-dc5a-5a92b64f5c26@redhat.com> <20180410045723.rftsb7l4l3ip2ioi@debian> <30a63fff-7599-640a-361f-a27e5783012a@redhat.com> <20180419212911-mutt-send-email-mst@kernel.org> From: Jason Wang Message-ID: <060e2b5f-2e93-c53f-387b-5baaa33e87cd@redhat.com> Date: Fri, 20 Apr 2018 11:52:47 +0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: <20180419212911-mutt-send-email-mst@kernel.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2018年04月20日 02:40, Michael S. Tsirkin wrote: > On Tue, Apr 10, 2018 at 03:25:45PM +0800, Jason Wang wrote: >>>>> One problem is that, different virtio ring compatible devices >>>>> may have different device interfaces. That is to say, we will >>>>> need different drivers in QEMU. It could be troublesome. And >>>>> that's what this patch trying to fix. The idea behind this >>>>> patch is very simple: mdev is a standard way to emulate device >>>>> in kernel. >>>> So you just move the abstraction layer from qemu to kernel, and you still >>>> need different drivers in kernel for different device interfaces of >>>> accelerators. This looks even more complex than leaving it in qemu. As you >>>> said, another idea is to implement userspace vhost backend for accelerators >>>> which seems easier and could co-work with other parts of qemu without >>>> inventing new type of messages. >>> I'm not quite sure. Do you think it's acceptable to >>> add various vendor specific hardware drivers in QEMU? >>> >> I don't object but we need to figure out the advantages of doing it in qemu >> too. >> >> Thanks > To be frank kernel is exactly where device drivers belong. DPDK did > move them to userspace but that's merely a requirement for data path. > *If* you can have them in kernel that is best: > - update kernel and there's no need to rebuild userspace Well, you still need to rebuild userspace since a new vhost backend is required which relies vhost protocol through mdev API. And I believe upgrading userspace package is considered to be more lightweight than upgrading kernel. With mdev, we're likely to repeat the story of vhost API, dealing with features/versions and inventing new API endless for new features. And you will still need to rebuild the userspace. > - apps can be written in any language no need to maintain multiple > libraries or add wrappers This is not a big issue consider It's not a generic network driver but a mdev driver, the only possible user is VM. > - security concerns are much smaller (ok people are trying to > raise the bar with IOMMUs and such, but it's already pretty > good even without) Well, I think not, kernel bugs are much more serious than userspace ones. And I beg the kernel driver itself won't be small. > > The biggest issue is that you let userspace poke at the > device which is also allowed by the IOMMU to poke at > kernel memory (needed for kernel driver to work). I don't quite get. The userspace driver could be built on top of VFIO for sure. So kernel memory were perfectly isolated in this case. > > Yes, maybe if device is not buggy it's all fine, but > it's better if we do not have to trust the device > otherwise the security picture becomes more murky. > > I suggested attaching a PASID to (some) queues - see my old post "using > PASIDs to enable a safe variant of direct ring access". > > Then using IOMMU with VFIO to limit access through queue to corrent > ranges of memory. Well userspace driver could benefit from this too. And we can even go further by using nested IO page tables to share IOVA address space between devices and a VM. Thanks