From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.2 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 091CEC47097 for ; Fri, 4 Jun 2021 01:30:51 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id DDCF4613FF for ; Fri, 4 Jun 2021 01:30:50 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230008AbhFDBce (ORCPT ); Thu, 3 Jun 2021 21:32:34 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:20876 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229697AbhFDBcd (ORCPT ); Thu, 3 Jun 2021 21:32:33 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1622770248; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jD0SrrifrVAIWI7R1gZoaTn69EV68xZixLKv5uzjFb0=; b=LMBoFqc44DOArA0RxhZDRCpNYIRKtOjHtRTf9+0oDj5qumjjiYyTznNL0O+1WtmWe3JPUi OQa4ICPKWYN8rQ4UzTXu9woMyBx6ItojTaXMr/GveL/Ngtl6vMY8iTrNiCulIAoTy5N7wL JQuQ5WP1FwCq9DJkS1WfBLTVKpgdSVA= Received: from mail-pj1-f72.google.com (mail-pj1-f72.google.com [209.85.216.72]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-297-YqgCkUpuPYSYgUb2kOBEdw-1; Thu, 03 Jun 2021 21:30:46 -0400 X-MC-Unique: YqgCkUpuPYSYgUb2kOBEdw-1 Received: by mail-pj1-f72.google.com with SMTP id w12-20020a17090a528cb029015d7f990752so6599709pjh.0 for ; Thu, 03 Jun 2021 18:30:46 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=jD0SrrifrVAIWI7R1gZoaTn69EV68xZixLKv5uzjFb0=; b=pIxWGVAPsQvk2tO2kmPSmT8DuNCyVjsAwt5lnS2fpk/8JwVfi9AnnScRpRwzsfUbWb I+huzNyuqf+OesvsAu2QgbE6D9173F3+YkT1J8/Xrk89P9e3xbgHta9wK9WoRqyFUZ3c GOJjmsed9sHpblwp223IJkPIjtZmCc+X6mMmZLEO4sgXtAo4nfxA9WnjbyEk9WRS2ZIG PPdeAjasyBiQwUFdCByrahJQEojRGcZzg8ZAI1DCsPTEhX0j5TgJ2FRCUUbCL/7nYh7c xbcf1xLpyeB9pvbaSKQBFEJ5Anjd9drAYf6bVIjgcodFPzWAGGZonVvAzwAAkTKxJUnx neuw== X-Gm-Message-State: AOAM532Ez+Qq3XXEZiwK+l2y2lsc5AozMH7PpMD27hE1NBow5PLZVRg0 wYUa9EzTG//U4eH6kZlMb9g9q6019MwawZ7y52PHk+LUuwQEIXIwi3Dfmxj154N6HE9XqWbwxC0 9EWK4USHqMUpVlpYZknbtOZ7/ X-Received: by 2002:a63:6e87:: with SMTP id j129mr2331150pgc.45.1622770245926; Thu, 03 Jun 2021 18:30:45 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzPvvTcrHVuEjSyMsuOtnGOtgpMffrms7oNztTWuUcXduMPhSu1xCuPg2j+GGQkXnPef6d2rw== X-Received: by 2002:a63:6e87:: with SMTP id j129mr2331134pgc.45.1622770245745; Thu, 03 Jun 2021 18:30:45 -0700 (PDT) Received: from wangxiaodeMacBook-Air.local ([209.132.188.80]) by smtp.gmail.com with ESMTPSA id d3sm3177937pjk.16.2021.06.03.18.30.38 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 03 Jun 2021 18:30:45 -0700 (PDT) Subject: Re: [RFC] /dev/ioasid uAPI proposal To: Jacob Pan , Shenming Lu Cc: Jason Gunthorpe , Lu Baolu , "Tian, Kevin" , LKML , Joerg Roedel , David Woodhouse , "iommu@lists.linux-foundation.org" , "kvm@vger.kernel.org" , "Alex Williamson (alex.williamson@redhat.com)" , Eric Auger , Jonathan Corbet , "Raj, Ashok" , "Liu, Yi L" , "Wu, Hao" , "Jiang, Dave" , Jean-Philippe Brucker , David Gibson , Kirti Wankhede , Robin Murphy , Zenghui Yu , "wanghaibin.wang@huawei.com" References: <01fe5034-42c8-6923-32f1-e287cc36bccc@linux.intel.com> <20210601173323.GN1002214@nvidia.com> <23a482f9-b88a-da98-3800-f3fd9ea85fbd@huawei.com> <20210603111914.653c4f61@jacob-builder> From: Jason Wang Message-ID: <1175ebd5-9d8e-2000-6d05-baa93e960915@redhat.com> Date: Fri, 4 Jun 2021 09:30:37 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.10.2 MIME-Version: 1.0 In-Reply-To: <20210603111914.653c4f61@jacob-builder> Content-Type: text/plain; charset=gbk; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org ÔÚ 2021/6/4 ÉÏÎç2:19, Jacob Pan дµÀ: > Hi Shenming, > > On Wed, 2 Jun 2021 12:50:26 +0800, Shenming Lu > wrote: > >> On 2021/6/2 1:33, Jason Gunthorpe wrote: >>> On Tue, Jun 01, 2021 at 08:30:35PM +0800, Lu Baolu wrote: >>> >>>> The drivers register per page table fault handlers to /dev/ioasid which >>>> will then register itself to iommu core to listen and route the per- >>>> device I/O page faults. >>> I'm still confused why drivers need fault handlers at all? >> Essentially it is the userspace that needs the fault handlers, >> one case is to deliver the faults to the vIOMMU, and another >> case is to enable IOPF on the GPA address space for on-demand >> paging, it seems that both could be specified in/through the >> IOASID_ALLOC ioctl? >> > I would think IOASID_BIND_PGTABLE is where fault handler should be > registered. There wouldn't be any IO page fault without the binding anyway. > > I also don't understand why device drivers should register the fault > handler, the fault is detected by the pIOMMU and injected to the vIOMMU. So > I think it should be the IOASID itself register the handler. As discussed in another thread. I think the reason is that ATS doesn't forbid the #PF to be reported via a device specific way. Thanks > >> Thanks, >> Shenming >> > > Thanks, > > Jacob > From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.7 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,NICE_REPLY_A, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4341BC47096 for ; Fri, 4 Jun 2021 01:30:53 +0000 (UTC) Received: from smtp4.osuosl.org (smtp4.osuosl.org [140.211.166.137]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id E65E8613FF for ; Fri, 4 Jun 2021 01:30:52 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org E65E8613FF Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=iommu-bounces@lists.linux-foundation.org Received: from localhost (localhost [127.0.0.1]) by smtp4.osuosl.org (Postfix) with ESMTP id 7E7FD40691; Fri, 4 Jun 2021 01:30:52 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp4.osuosl.org ([127.0.0.1]) by localhost (smtp4.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id RCr-1wa95iHZ; Fri, 4 Jun 2021 01:30:51 +0000 (UTC) Received: from lists.linuxfoundation.org (lf-lists.osuosl.org [140.211.9.56]) by smtp4.osuosl.org (Postfix) with ESMTP id 3B4454068F; Fri, 4 Jun 2021 01:30:51 +0000 (UTC) Received: from lf-lists.osuosl.org (localhost [127.0.0.1]) by lists.linuxfoundation.org (Postfix) with ESMTP id 1F65EC000E; Fri, 4 Jun 2021 01:30:51 +0000 (UTC) Received: from smtp3.osuosl.org (smtp3.osuosl.org [IPv6:2605:bc80:3010::136]) by lists.linuxfoundation.org (Postfix) with ESMTP id E84E4C0001 for ; Fri, 4 Jun 2021 01:30:49 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp3.osuosl.org (Postfix) with ESMTP id E2F5B6F931 for ; Fri, 4 Jun 2021 01:30:49 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Authentication-Results: smtp3.osuosl.org (amavisd-new); dkim=pass (1024-bit key) header.d=redhat.com Received: from smtp3.osuosl.org ([127.0.0.1]) by localhost (smtp3.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id mzcAGT-ZOOSX for ; Fri, 4 Jun 2021 01:30:49 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.8.0 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by smtp3.osuosl.org (Postfix) with ESMTPS id 3DADA60689 for ; Fri, 4 Jun 2021 01:30:49 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1622770248; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jD0SrrifrVAIWI7R1gZoaTn69EV68xZixLKv5uzjFb0=; b=LMBoFqc44DOArA0RxhZDRCpNYIRKtOjHtRTf9+0oDj5qumjjiYyTznNL0O+1WtmWe3JPUi OQa4ICPKWYN8rQ4UzTXu9woMyBx6ItojTaXMr/GveL/Ngtl6vMY8iTrNiCulIAoTy5N7wL JQuQ5WP1FwCq9DJkS1WfBLTVKpgdSVA= Received: from mail-pf1-f200.google.com (mail-pf1-f200.google.com [209.85.210.200]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-368-LHpgfRI7PO6R-2TF4uSC2A-1; Thu, 03 Jun 2021 21:30:47 -0400 X-MC-Unique: LHpgfRI7PO6R-2TF4uSC2A-1 Received: by mail-pf1-f200.google.com with SMTP id t20-20020aa793940000b02902e8f588ec26so4425380pfe.17 for ; Thu, 03 Jun 2021 18:30:46 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=jD0SrrifrVAIWI7R1gZoaTn69EV68xZixLKv5uzjFb0=; b=Lkd54KzXKse24afPgE2uY7T9XZqUxH8UnsD1Svn09pLlSoEsYHDbzcs6/THrcKTJsB Ax1QnVaen6Vf4mbviGV/qUnwsS8yPvNN4fK91P4mrRwS/KWM/J4XwVE+tAcjYURyPee7 x4QPL6upccAwRs4waIWTbNXSYjjtM802vs7QHa/welhCSQ/MauATgsyXVcdQ1JuqkJUt iYPVr0uxheuT7w8sdeaLABbyrSPLbnWqIlGYu5qpILNH8UpV/EMh5QQq3QiuL2ehbsrx a31LvRCCnKww6RURMGGIE95HPZW6/LT2w7Z/iZQt7YyxZ1LpBnnBuNrc0iy4Ta8cxSDI aPhg== X-Gm-Message-State: AOAM530UTJOBeIhGAgvSMTLFM5NzYa3xaYpKNe/l8eFRmnUhxYoeZyGJ x5rtxaHVCONYbvVBXmlLz5FoCfS204OsyD3I3yBby8z4lwFYaYF3ZooPy/Zxa9GJrGs9c09pP1B /bP4hsLVFruV1MW2OJFAnZ7a9wIXFQg== X-Received: by 2002:a63:6e87:: with SMTP id j129mr2331160pgc.45.1622770245927; Thu, 03 Jun 2021 18:30:45 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzPvvTcrHVuEjSyMsuOtnGOtgpMffrms7oNztTWuUcXduMPhSu1xCuPg2j+GGQkXnPef6d2rw== X-Received: by 2002:a63:6e87:: with SMTP id j129mr2331134pgc.45.1622770245745; Thu, 03 Jun 2021 18:30:45 -0700 (PDT) Received: from wangxiaodeMacBook-Air.local ([209.132.188.80]) by smtp.gmail.com with ESMTPSA id d3sm3177937pjk.16.2021.06.03.18.30.38 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 03 Jun 2021 18:30:45 -0700 (PDT) Subject: Re: [RFC] /dev/ioasid uAPI proposal To: Jacob Pan , Shenming Lu References: <01fe5034-42c8-6923-32f1-e287cc36bccc@linux.intel.com> <20210601173323.GN1002214@nvidia.com> <23a482f9-b88a-da98-3800-f3fd9ea85fbd@huawei.com> <20210603111914.653c4f61@jacob-builder> From: Jason Wang Message-ID: <1175ebd5-9d8e-2000-6d05-baa93e960915@redhat.com> Date: Fri, 4 Jun 2021 09:30:37 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.10.2 MIME-Version: 1.0 In-Reply-To: <20210603111914.653c4f61@jacob-builder> Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=jasowang@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Language: en-US Cc: Jean-Philippe Brucker , "Tian, Kevin" , "Alex Williamson \(alex.williamson@redhat.com\)" , "Raj, Ashok" , "kvm@vger.kernel.org" , Jonathan Corbet , Robin Murphy , LKML , Kirti Wankhede , "iommu@lists.linux-foundation.org" , David Gibson , Jason Gunthorpe , "wanghaibin.wang@huawei.com" , "Jiang, Dave" , David Woodhouse X-BeenThere: iommu@lists.linux-foundation.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Development issues for Linux IOMMU support List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="gbk"; Format="flowed" Errors-To: iommu-bounces@lists.linux-foundation.org Sender: "iommu" CtTaIDIwMjEvNi80IMnPzucyOjE5LCBKYWNvYiBQYW4g0LS1wDoKPiBIaSBTaGVubWluZywKPgo+ IE9uIFdlZCwgMiBKdW4gMjAyMSAxMjo1MDoyNiArMDgwMCwgU2hlbm1pbmcgTHUgPGx1c2hlbm1p bmdAaHVhd2VpLmNvbT4KPiB3cm90ZToKPgo+PiBPbiAyMDIxLzYvMiAxOjMzLCBKYXNvbiBHdW50 aG9ycGUgd3JvdGU6Cj4+PiBPbiBUdWUsIEp1biAwMSwgMjAyMSBhdCAwODozMDozNVBNICswODAw LCBMdSBCYW9sdSB3cm90ZToKPj4+ICAgIAo+Pj4+IFRoZSBkcml2ZXJzIHJlZ2lzdGVyIHBlciBw YWdlIHRhYmxlIGZhdWx0IGhhbmRsZXJzIHRvIC9kZXYvaW9hc2lkIHdoaWNoCj4+Pj4gd2lsbCB0 aGVuIHJlZ2lzdGVyIGl0c2VsZiB0byBpb21tdSBjb3JlIHRvIGxpc3RlbiBhbmQgcm91dGUgdGhl IHBlci0KPj4+PiBkZXZpY2UgSS9PIHBhZ2UgZmF1bHRzLgo+Pj4gSSdtIHN0aWxsIGNvbmZ1c2Vk IHdoeSBkcml2ZXJzIG5lZWQgZmF1bHQgaGFuZGxlcnMgYXQgYWxsPwo+PiBFc3NlbnRpYWxseSBp dCBpcyB0aGUgdXNlcnNwYWNlIHRoYXQgbmVlZHMgdGhlIGZhdWx0IGhhbmRsZXJzLAo+PiBvbmUg Y2FzZSBpcyB0byBkZWxpdmVyIHRoZSBmYXVsdHMgdG8gdGhlIHZJT01NVSwgYW5kIGFub3RoZXIK Pj4gY2FzZSBpcyB0byBlbmFibGUgSU9QRiBvbiB0aGUgR1BBIGFkZHJlc3Mgc3BhY2UgZm9yIG9u LWRlbWFuZAo+PiBwYWdpbmcsIGl0IHNlZW1zIHRoYXQgYm90aCBjb3VsZCBiZSBzcGVjaWZpZWQg aW4vdGhyb3VnaCB0aGUKPj4gSU9BU0lEX0FMTE9DIGlvY3RsPwo+Pgo+IEkgd291bGQgdGhpbmsg SU9BU0lEX0JJTkRfUEdUQUJMRSBpcyB3aGVyZSBmYXVsdCBoYW5kbGVyIHNob3VsZCBiZQo+IHJl Z2lzdGVyZWQuIFRoZXJlIHdvdWxkbid0IGJlIGFueSBJTyBwYWdlIGZhdWx0IHdpdGhvdXQgdGhl IGJpbmRpbmcgYW55d2F5Lgo+Cj4gSSBhbHNvIGRvbid0IHVuZGVyc3RhbmQgd2h5IGRldmljZSBk cml2ZXJzIHNob3VsZCByZWdpc3RlciB0aGUgZmF1bHQKPiBoYW5kbGVyLCB0aGUgZmF1bHQgaXMg ZGV0ZWN0ZWQgYnkgdGhlIHBJT01NVSBhbmQgaW5qZWN0ZWQgdG8gdGhlIHZJT01NVS4gU28KPiBJ IHRoaW5rIGl0IHNob3VsZCBiZSB0aGUgSU9BU0lEIGl0c2VsZiByZWdpc3RlciB0aGUgaGFuZGxl ci4KCgpBcyBkaXNjdXNzZWQgaW4gYW5vdGhlciB0aHJlYWQuCgpJIHRoaW5rIHRoZSByZWFzb24g aXMgdGhhdCBBVFMgZG9lc24ndCBmb3JiaWQgdGhlICNQRiB0byBiZSByZXBvcnRlZCB2aWEgCmEg ZGV2aWNlIHNwZWNpZmljIHdheS4KClRoYW5rcwoKCj4KPj4gVGhhbmtzLAo+PiBTaGVubWluZwo+ Pgo+Cj4gVGhhbmtzLAo+Cj4gSmFjb2IKPgoKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX18KaW9tbXUgbWFpbGluZyBsaXN0CmlvbW11QGxpc3RzLmxpbnV4LWZv dW5kYXRpb24ub3JnCmh0dHBzOi8vbGlzdHMubGludXhmb3VuZGF0aW9uLm9yZy9tYWlsbWFuL2xp c3RpbmZvL2lvbW11