From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D6A9DC33CB3 for ; Wed, 15 Jan 2020 12:02:17 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id ACE1E22522 for ; Wed, 15 Jan 2020 12:02:17 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1579089737; bh=TO5UFyVXqPIEmhn24jmBqJH1UNBUHjDoh+E/hSQY4uk=; h=Date:From:To:Cc:Subject:References:In-Reply-To:List-ID:From; b=UhaKKiJ7MMwK3kIUidxt7amX9ONXoeNSNkBrG7NsT80WM3AoxYrQAiqml69Q4p5Yq 6ld2HpfDnVbTWQDQOE8g+/4R16UjywM0OkS5fw1RyZrsmOTqy+AlwhhTJRsB1bZEEZ SiEKuT5/PvNVhFRm31whZFU5w0VtxRe7fGepHrCo= Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730170AbgAOMCR (ORCPT ); Wed, 15 Jan 2020 07:02:17 -0500 Received: from mail.kernel.org ([198.145.29.99]:58950 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1729892AbgAOMCQ (ORCPT ); Wed, 15 Jan 2020 07:02:16 -0500 Received: from localhost (83-86-89-107.cable.dynamic.v4.ziggo.nl [83.86.89.107]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id EF4DB2187F; Wed, 15 Jan 2020 12:02:14 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1579089735; bh=TO5UFyVXqPIEmhn24jmBqJH1UNBUHjDoh+E/hSQY4uk=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=z53Oerl7n8zbUE6seRg1o8NOKvzxlsVNnV27zQwafcpsHlv52i1T84HDgX8ywjXou P8VYoeiJS7tXH/X/kxVeLcZ2+rqp8q4/tjZJDA101qoJqQj4JHWiAUW5vpLvBJ5M0H xAf64mzsRC1NtdzsjWQcUsBSCxup6Kp/s4KdX9oo= Date: Wed, 15 Jan 2020 13:02:12 +0100 From: Greg Kroah-Hartman To: zhangfei Cc: Arnd Bergmann , Herbert Xu , jonathan.cameron@huawei.com, dave.jiang@intel.com, grant.likely@arm.com, jean-philippe , Jerome Glisse , ilias.apalodimas@linaro.org, francois.ozog@linaro.org, kenneth-lee-2012@foxmail.com, Wangzhou , "haojian . zhuang" , guodong.xu@linaro.org, linux-accelerators@lists.ozlabs.org, linux-kernel@vger.kernel.org, linux-crypto@vger.kernel.org, iommu@lists.linux-foundation.org, Kenneth Lee , Zaibo Xu Subject: Re: [PATCH v11 2/4] uacce: add uacce driver Message-ID: <20200115120212.GA3270387@kroah.com> References: <1578710919-12141-1-git-send-email-zhangfei.gao@linaro.org> <1578710919-12141-3-git-send-email-zhangfei.gao@linaro.org> <20200111194006.GD435222@kroah.com> <053ccd05-4f11-5be6-47c2-eee5c2f1fdc4@linaro.org> <20200114145934.GA1960403@kroah.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Jan 15, 2020 at 07:18:34PM +0800, zhangfei wrote: > Hi, Greg > > On 2020/1/14 下午10:59, Greg Kroah-Hartman wrote: > > On Mon, Jan 13, 2020 at 11:34:55AM +0800, zhangfei wrote: > > > Hi, Greg > > > > > > Thanks for the review. > > > > > > On 2020/1/12 上午3:40, Greg Kroah-Hartman wrote: > > > > On Sat, Jan 11, 2020 at 10:48:37AM +0800, Zhangfei Gao wrote: > > > > > +static int uacce_fops_open(struct inode *inode, struct file *filep) > > > > > +{ > > > > > + struct uacce_mm *uacce_mm = NULL; > > > > > + struct uacce_device *uacce; > > > > > + struct uacce_queue *q; > > > > > + int ret = 0; > > > > > + > > > > > + uacce = xa_load(&uacce_xa, iminor(inode)); > > > > > + if (!uacce) > > > > > + return -ENODEV; > > > > > + > > > > > + if (!try_module_get(uacce->parent->driver->owner)) > > > > > + return -ENODEV; > > > > Why are you trying to grab the module reference of the parent device? > > > > Why is that needed and what is that going to help with here? > > > > > > > > This shouldn't be needed as the module reference of the owner of the > > > > fileops for this module is incremented, and the "parent" module depends > > > > on this module, so how could it be unloaded without this code being > > > > unloaded? > > > > > > > > Yes, if you build this code into the kernel and the "parent" driver is a > > > > module, then you will not have a reference, but when you remove that > > > > parent driver the device will be removed as it has to be unregistered > > > > before that parent driver can be removed from the system, right? > > > > > > > > Or what am I missing here? > > > The refcount here is preventing rmmod "parent" module after fd is opened, > > > since user driver has mmap kernel memory to user space, like mmio, which may > > > still in-use. > > > > > > With the refcount protection, rmmod "parent" module will fail until > > > application free the fd. > > > log like: rmmod: ERROR: Module hisi_zip is in use > > But if the "parent" module is to be unloaded, it has to unregister the > > "child" device and that will call the destructor in here and then you > > will tear everything down and all should be good. > > > > There's no need to "forbid" a module from being unloaded, even if it is > > being used. Look at all networking drivers, they work that way, right? > Thanks Greg for the kind suggestion. > > I still have one uncertainty. > Does uacce has to block process continue accessing the mmapped area when > remove "parent" module? > Uacce can block device access the physical memory when parent module call > uacce_remove. > But application is still running, and suppose it is not the kernel driver's > responsibility to call unmap. > > I am looking for some examples in kernel, > looks vfio does not block process continue accessing when > vfio_unregister_iommu_driver either. > > In my test, application will keep waiting after rmmod parent, until ctrl+c, > when unmap is called. > During the process, kernel does not report any error. > > Do you have any advice? Is there no way for the kernel to invalidate the memory and tell the process to stop? tty drivers do this for when they are removed from the system. Anyway, this is all very rare, no kernel module is ever unloaded on a real system, that is only for when developers are working on them, so it's probably not that big of an issue, right? thanks, greg k-h