From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.2 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0289AC4708F for ; Wed, 2 Jun 2021 08:58:34 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id DF170613AE for ; Wed, 2 Jun 2021 08:58:33 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233010AbhFBJAL (ORCPT ); Wed, 2 Jun 2021 05:00:11 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:23966 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232993AbhFBJAG (ORCPT ); Wed, 2 Jun 2021 05:00:06 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1622624303; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HgwV7ft+Ln03MaD+qvV/AkL0B+iArPbUA9ahbhF+wVg=; b=QTSJnx4QZANKC2MFrXYT9euhRrVNbgeSmtWvBezvt4xanvqdTbszjudM7O+/7kwlZwQKhu ZfF8PrfdX554kqW/3QLQEGWVq+PdH4BWVXPGoqJuKJGvIJsqnmT4qzyfvpsZLuX2peDUEZ 4Zr2KHhthRE/SX9KmS85ZL9S/H5qtHo= Received: from mail-pg1-f199.google.com (mail-pg1-f199.google.com [209.85.215.199]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-573-ZEFxMhADMeiaD56m3t1q9g-1; Wed, 02 Jun 2021 04:58:22 -0400 X-MC-Unique: ZEFxMhADMeiaD56m3t1q9g-1 Received: by mail-pg1-f199.google.com with SMTP id s7-20020a6352470000b029021b9013c124so1255286pgl.19 for ; Wed, 02 Jun 2021 01:58:21 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=HgwV7ft+Ln03MaD+qvV/AkL0B+iArPbUA9ahbhF+wVg=; b=ZL28Igirf7Vtwfcd5RjJUmYO+HsvDXpU8tHdeB4j9SMckN64sa0jkL9/klrMvVsxZa 9AdrgaaxJrH1Dsr4XYL5wFFuVGs9OELaXPo1G/DHT8qYGOfzZpAjou8hvsLSSa6zAz8s +qfy/zIso1fpqHXz04ihHhycumqdU/DpYK03K+08fi8U9spOsNVcaaA7sUz+xIiIKjsm qgfNyVH/vH+oxoyTZQre/VwmNvLyRrm8YWe8MGHnuY/B+Ayf9yzYcXYLOdFWvoJtW9sb gkVdoCIy+ydgSvCQuVPf71NltYi6itCxZluvlMRKHeNbYlhAiKRA6CMfKZIjRtKD7oc4 r1+Q== X-Gm-Message-State: AOAM532gL6jlUKJvlWC9MjX68akwRagsV9bGP+lODSphinQdFT12zsfb jEP/TilgyNVhuBnbKv3EZ3VZbWoku568RFFImemyHAxfMNJoBjzvOpFtx42VTGlLsIoWHhEIFkU LpP4fNDYyZDCRc+vYN8gIXe4G X-Received: by 2002:a63:e642:: with SMTP id p2mr31912919pgj.316.1622624301197; Wed, 02 Jun 2021 01:58:21 -0700 (PDT) X-Google-Smtp-Source: ABdhPJw/hC2DUGaHASQJ2eBIgS4POmbF/OU0iTy4EElTI9I8lf554Diw4PoXXYk+RPG+3MuIoH1a7g== X-Received: by 2002:a63:e642:: with SMTP id p2mr31912901pgj.316.1622624301050; Wed, 02 Jun 2021 01:58:21 -0700 (PDT) Received: from wangxiaodeMacBook-Air.local ([209.132.188.80]) by smtp.gmail.com with ESMTPSA id m134sm4163818pfd.148.2021.06.02.01.58.17 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 02 Jun 2021 01:58:20 -0700 (PDT) Subject: Re: [RFC] /dev/ioasid uAPI proposal To: Jason Gunthorpe Cc: "Tian, Kevin" , Lu Baolu , Liu Yi L , "Alex Williamson (alex.williamson@redhat.com)\"\"" , "kvm@vger.kernel.org" , Jonathan Corbet , LKML , "iommu@lists.linux-foundation.org" , David Woodhouse References: <20210531164118.265789ee@yiliu-dev> <78ee2638-1a03-fcc8-50a5-81040f677e69@redhat.com> <20210601113152.6d09e47b@yiliu-dev> <164ee532-17b0-e180-81d3-12d49b82ac9f@redhat.com> <64898584-a482-e6ac-fd71-23549368c508@linux.intel.com> <429d9c2f-3597-eb29-7764-fad3ec9a934f@redhat.com> <05d7f790-870d-5551-1ced-86926a0aa1a6@redhat.com> <20210601172956.GL1002214@nvidia.com> From: Jason Wang Message-ID: Date: Wed, 2 Jun 2021 16:58:13 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.10.2 MIME-Version: 1.0 In-Reply-To: <20210601172956.GL1002214@nvidia.com> Content-Type: text/plain; charset=gbk; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org ÔÚ 2021/6/2 ÉÏÎç1:29, Jason Gunthorpe дµÀ: > On Tue, Jun 01, 2021 at 02:07:05PM +0800, Jason Wang wrote: > >> For the case of 1M, I would like to know what's the use case for a single >> process to handle 1M+ address spaces? > For some scenarios every guest PASID will require a IOASID ID # so > there is a large enough demand that FDs alone are not a good fit. > > Further there are global container wide properties that are hard to > carry over to a multi-FD model, like the attachment of devices to the > container at the startup. So if we implement per fd model. The global "container" properties could be done via the parent fd. E.g attaching the parent to the device at the startup. > >>> So this RFC treats fd as a container of address spaces which is each >>> tagged by an IOASID. >> If the container and address space is 1:1 then the container seems useless. > The examples at the bottom of the document show multiple IOASIDs in > the container for a parent/child type relationship This can also be done per fd? A fd parent can have multiple fd childs. Thanks > > Jason > From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.7 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,NICE_REPLY_A, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id EFBC3C4708F for ; Wed, 2 Jun 2021 08:58:31 +0000 (UTC) Received: from smtp1.osuosl.org (smtp1.osuosl.org [140.211.166.138]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 9F3DE613D6 for ; Wed, 2 Jun 2021 08:58:31 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 9F3DE613D6 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=iommu-bounces@lists.linux-foundation.org Received: from localhost (localhost [127.0.0.1]) by smtp1.osuosl.org (Postfix) with ESMTP id 7A4F1838C0; Wed, 2 Jun 2021 08:58:31 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp1.osuosl.org ([127.0.0.1]) by localhost (smtp1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ysnEx-l8RnuQ; Wed, 2 Jun 2021 08:58:27 +0000 (UTC) Received: from lists.linuxfoundation.org (lf-lists.osuosl.org [140.211.9.56]) by smtp1.osuosl.org (Postfix) with ESMTP id E381E836A7; Wed, 2 Jun 2021 08:58:26 +0000 (UTC) Received: from lf-lists.osuosl.org (localhost [127.0.0.1]) by lists.linuxfoundation.org (Postfix) with ESMTP id C945BC000E; Wed, 2 Jun 2021 08:58:26 +0000 (UTC) Received: from smtp1.osuosl.org (smtp1.osuosl.org [IPv6:2605:bc80:3010::138]) by lists.linuxfoundation.org (Postfix) with ESMTP id 877A4C0001 for ; Wed, 2 Jun 2021 08:58:25 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp1.osuosl.org (Postfix) with ESMTP id 758E5838C0 for ; Wed, 2 Jun 2021 08:58:25 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp1.osuosl.org ([127.0.0.1]) by localhost (smtp1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id cbjLP855LqSx for ; Wed, 2 Jun 2021 08:58:24 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.8.0 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [216.205.24.124]) by smtp1.osuosl.org (Postfix) with ESMTPS id BD30C836A7 for ; Wed, 2 Jun 2021 08:58:24 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1622624303; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HgwV7ft+Ln03MaD+qvV/AkL0B+iArPbUA9ahbhF+wVg=; b=QTSJnx4QZANKC2MFrXYT9euhRrVNbgeSmtWvBezvt4xanvqdTbszjudM7O+/7kwlZwQKhu ZfF8PrfdX554kqW/3QLQEGWVq+PdH4BWVXPGoqJuKJGvIJsqnmT4qzyfvpsZLuX2peDUEZ 4Zr2KHhthRE/SX9KmS85ZL9S/H5qtHo= Received: from mail-pj1-f69.google.com (mail-pj1-f69.google.com [209.85.216.69]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-591-MJ1yBlXlPNu0D5gJssRNzw-1; Wed, 02 Jun 2021 04:58:22 -0400 X-MC-Unique: MJ1yBlXlPNu0D5gJssRNzw-1 Received: by mail-pj1-f69.google.com with SMTP id j8-20020a17090a8408b02901651fe80217so1043227pjn.1 for ; Wed, 02 Jun 2021 01:58:21 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=HgwV7ft+Ln03MaD+qvV/AkL0B+iArPbUA9ahbhF+wVg=; b=Z4M5RwWuHnS06LJnLL47czU2oaxWzIGmnfhyjOezihcSVeGMuA1GURVQwFhcQGtEFm 420WVy/dLQgE2UkmLBNapRV/RQE65P4bik5+hlzCv3kW+97rDseDo4rZglV+79mJcJ+q 8OUVlkpaGPmahokcH3TNxSSOfaOF634mt/gHrPIIja5dy74cN64dZRIAcOfgRA8NGYJw 5swQIzWS1IdLJsshPeld29DDILjLtlempbC7gp+z4Eokx7GIr9S9Y6UkXPsm+1tO+34O 7lTjNxXir774XuJ4a1/GvJd+y1XMURqVXsNTnY/68PHT76qExmm0OhRHmbcsscxORLn/ aceg== X-Gm-Message-State: AOAM532M/arcvpml6BJmWvdK9KNbT+ce2uM5QqbV6+vFb+76+VcISxsz d6TgqSesRQoKUdqOzYrz8NJnSyFCdzoAQQCu7mDCQ7ofUEy2R5fE5X60RyZsmUMfjLPsQgKwslb zfJPQ1kIfp35QzWco+f4+A2/ZVm1DvQ== X-Received: by 2002:a63:e642:: with SMTP id p2mr31912921pgj.316.1622624301197; Wed, 02 Jun 2021 01:58:21 -0700 (PDT) X-Google-Smtp-Source: ABdhPJw/hC2DUGaHASQJ2eBIgS4POmbF/OU0iTy4EElTI9I8lf554Diw4PoXXYk+RPG+3MuIoH1a7g== X-Received: by 2002:a63:e642:: with SMTP id p2mr31912901pgj.316.1622624301050; Wed, 02 Jun 2021 01:58:21 -0700 (PDT) Received: from wangxiaodeMacBook-Air.local ([209.132.188.80]) by smtp.gmail.com with ESMTPSA id m134sm4163818pfd.148.2021.06.02.01.58.17 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 02 Jun 2021 01:58:20 -0700 (PDT) Subject: Re: [RFC] /dev/ioasid uAPI proposal To: Jason Gunthorpe References: <20210531164118.265789ee@yiliu-dev> <78ee2638-1a03-fcc8-50a5-81040f677e69@redhat.com> <20210601113152.6d09e47b@yiliu-dev> <164ee532-17b0-e180-81d3-12d49b82ac9f@redhat.com> <64898584-a482-e6ac-fd71-23549368c508@linux.intel.com> <429d9c2f-3597-eb29-7764-fad3ec9a934f@redhat.com> <05d7f790-870d-5551-1ced-86926a0aa1a6@redhat.com> <20210601172956.GL1002214@nvidia.com> From: Jason Wang Message-ID: Date: Wed, 2 Jun 2021 16:58:13 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.10.2 MIME-Version: 1.0 In-Reply-To: <20210601172956.GL1002214@nvidia.com> Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=jasowang@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Language: en-US Cc: "Tian, Kevin" , "kvm@vger.kernel.org" , Jonathan Corbet , LKML , "iommu@lists.linux-foundation.org" , "Alex Williamson \(alex.williamson@redhat.com\)\"\"" , David Woodhouse X-BeenThere: iommu@lists.linux-foundation.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Development issues for Linux IOMMU support List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="gbk"; Format="flowed" Errors-To: iommu-bounces@lists.linux-foundation.org Sender: "iommu" CtTaIDIwMjEvNi8yIMnPzucxOjI5LCBKYXNvbiBHdW50aG9ycGUg0LS1wDoKPiBPbiBUdWUsIEp1 biAwMSwgMjAyMSBhdCAwMjowNzowNVBNICswODAwLCBKYXNvbiBXYW5nIHdyb3RlOgo+Cj4+IEZv ciB0aGUgY2FzZSBvZiAxTSwgSSB3b3VsZCBsaWtlIHRvIGtub3cgd2hhdCdzIHRoZSB1c2UgY2Fz ZSBmb3IgYSBzaW5nbGUKPj4gcHJvY2VzcyB0byBoYW5kbGUgMU0rIGFkZHJlc3Mgc3BhY2VzPwo+ IEZvciBzb21lIHNjZW5hcmlvcyBldmVyeSBndWVzdCBQQVNJRCB3aWxsIHJlcXVpcmUgYSBJT0FT SUQgSUQgIyBzbwo+IHRoZXJlIGlzIGEgbGFyZ2UgZW5vdWdoIGRlbWFuZCB0aGF0IEZEcyBhbG9u ZSBhcmUgbm90IGEgZ29vZCBmaXQuCj4KPiBGdXJ0aGVyIHRoZXJlIGFyZSBnbG9iYWwgY29udGFp bmVyIHdpZGUgcHJvcGVydGllcyB0aGF0IGFyZSBoYXJkIHRvCj4gY2Fycnkgb3ZlciB0byBhIG11 bHRpLUZEIG1vZGVsLCBsaWtlIHRoZSBhdHRhY2htZW50IG9mIGRldmljZXMgdG8gdGhlCj4gY29u dGFpbmVyIGF0IHRoZSBzdGFydHVwLgoKClNvIGlmIHdlIGltcGxlbWVudCBwZXIgZmQgbW9kZWwu IFRoZSBnbG9iYWwgImNvbnRhaW5lciIgcHJvcGVydGllcyBjb3VsZCAKYmUgZG9uZSB2aWEgdGhl IHBhcmVudCBmZC4gRS5nIGF0dGFjaGluZyB0aGUgcGFyZW50IHRvIHRoZSBkZXZpY2UgYXQgdGhl IApzdGFydHVwLgoKCj4KPj4+IFNvIHRoaXMgUkZDIHRyZWF0cyBmZCBhcyBhIGNvbnRhaW5lciBv ZiBhZGRyZXNzIHNwYWNlcyB3aGljaCBpcyBlYWNoCj4+PiB0YWdnZWQgYnkgYW4gSU9BU0lELgo+ PiBJZiB0aGUgY29udGFpbmVyIGFuZCBhZGRyZXNzIHNwYWNlIGlzIDE6MSB0aGVuIHRoZSBjb250 YWluZXIgc2VlbXMgdXNlbGVzcy4KPiBUaGUgZXhhbXBsZXMgYXQgdGhlIGJvdHRvbSBvZiB0aGUg ZG9jdW1lbnQgc2hvdyBtdWx0aXBsZSBJT0FTSURzIGluCj4gdGhlIGNvbnRhaW5lciBmb3IgYSBw YXJlbnQvY2hpbGQgdHlwZSByZWxhdGlvbnNoaXAKCgpUaGlzIGNhbiBhbHNvIGJlIGRvbmUgcGVy IGZkPyBBIGZkIHBhcmVudCBjYW4gaGF2ZSBtdWx0aXBsZSBmZCBjaGlsZHMuCgpUaGFua3MKCgo+ Cj4gSmFzb24KPgoKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X18KaW9tbXUgbWFpbGluZyBsaXN0CmlvbW11QGxpc3RzLmxpbnV4LWZvdW5kYXRpb24ub3JnCmh0 dHBzOi8vbGlzdHMubGludXhmb3VuZGF0aW9uLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2lvbW11