From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.0 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,MSGID_FROM_MTA_HEADER,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0EA5EC47095 for ; Mon, 7 Jun 2021 14:14:33 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id E6B6560FEA for ; Mon, 7 Jun 2021 14:14:32 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230269AbhFGOQX (ORCPT ); Mon, 7 Jun 2021 10:16:23 -0400 Received: from mail-bn8nam11on2060.outbound.protection.outlook.com ([40.107.236.60]:15713 "EHLO NAM11-BN8-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S230198AbhFGOQT (ORCPT ); Mon, 7 Jun 2021 10:16:19 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=gbjd/s9wcyqUkd67z0Iv82eXz58DZka0c6XrSoLLke3iEjg6BN8vGYnsTm8vzCaBoggfCVV1BLDYu+GpHObIDBvjMWzRKoJAe1Q29/LDGtHOIKsMS3Ep029GBw/otduoB5ITch53mzMHIlcASlfMpIbPqRYh7FcMg+M3H8MYDhO6nAVSHbG1YdWABFD+GTK3ONGv2UxClpYBQwtV6Kh50M8CQ34TqNP2KqiOxXubtcBCF7i1mUT3j+UqJMufAVmU9B0zsfjFIlWI9jYt5Mqd/Gu8qwITiq902jQVjNsTL4fbRtNX1pX0le4Z7LRckl9IO+kVVXXYddJukb7NScVkDw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=PDnJJ0Am3hEXNxkbD56bK9p/aVD/JTaQDz/oN3zByPs=; b=DCh31y56gxetbMgw2ta/y6qCsMDoGkWyAoE8vJHg7aF/18s5qYGOcbwzmegqIMdvDCiRNpVu4QNBumH3lgG/VMkSjRZVu1QXPEZqiukid0pXV/9tpTflcQaCm4VzdkJxwmJ1jjXdPMTTYQdnyrBiyMS+hmL4FoSlN+Zd77LlZLd+2wgiPJZHZY/t+8Qm8aa+1qVY243vswbnZ4JxueJNs+6nnl5KtBvq09ra/yGJGwJ0B5d8/IHzagb1W7cETo/jqHuS4Cu8o65Fd1v9YLk4e78ZE4UMhmYETMYVDI8isEcXkOSt8Cg79FwzFUzRcKzfmUsskIDibCznsIhPGNyEgA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=PDnJJ0Am3hEXNxkbD56bK9p/aVD/JTaQDz/oN3zByPs=; b=cy7hK8wCcfKliQgtQ/F1hAE3pT/4HfAUUUZflkhKJW7a3vDGFCKOyrV+YZPggzkotl4Gxw5cBTGpLey0yO2OioKFarMwKfjbxRLJPSy7JDzBWK7A78FcBLdvqtLFOAK8cnyAFu3y3mb4oqHBgX4Us9eDJvAzouu1uKZXjIzTjnFuxXr0XAP5ASZGm/EqvzzQxLSzwOGzSaS26GlJULp2IUqr7pMUko8YwrVwug26qmj/rOVjTh+ap+G8k+4sxRy0sGue27QDL5sF0Mqk5gU5KnakmSAqLr5FK5AXgaGy3xUteVs8axIBdjMAt3bLbJfZnCsnFLm/hCsCfxVxvKy3NQ== Authentication-Results: redhat.com; dkim=none (message not signed) header.d=none;redhat.com; dmarc=none action=none header.from=nvidia.com; Received: from BL0PR12MB5506.namprd12.prod.outlook.com (2603:10b6:208:1cb::22) by BL1PR12MB5160.namprd12.prod.outlook.com (2603:10b6:208:311::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4195.21; Mon, 7 Jun 2021 14:14:26 +0000 Received: from BL0PR12MB5506.namprd12.prod.outlook.com ([fe80::3d51:a3b9:8611:684e]) by BL0PR12MB5506.namprd12.prod.outlook.com ([fe80::3d51:a3b9:8611:684e%6]) with mapi id 15.20.4195.030; Mon, 7 Jun 2021 14:14:26 +0000 Date: Mon, 7 Jun 2021 11:14:24 -0300 From: Jason Gunthorpe To: Jason Wang Cc: Alex Williamson , "Tian, Kevin" , Jean-Philippe Brucker , "Jiang, Dave" , "Raj, Ashok" , "kvm@vger.kernel.org" , Jonathan Corbet , Robin Murphy , LKML , "iommu@lists.linux-foundation.org" , David Gibson , Kirti Wankhede , David Woodhouse Subject: Re: [RFC] /dev/ioasid uAPI proposal Message-ID: <20210607141424.GF1002214@nvidia.com> References: <20210602120111.5e5bcf93.alex.williamson@redhat.com> <20210602180925.GH1002214@nvidia.com> <20210602130053.615db578.alex.williamson@redhat.com> <20210602195404.GI1002214@nvidia.com> <20210602143734.72fb4fa4.alex.williamson@redhat.com> <6a9426d7-ed55-e006-9c4c-6b7c78142e39@redhat.com> <20210603130927.GZ1002214@nvidia.com> <65614634-1db4-7119-1a90-64ba5c6e9042@redhat.com> <20210604115805.GG1002214@nvidia.com> <895671cc-5ef8-bc1a-734c-e9e2fdf03652@redhat.com> Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <895671cc-5ef8-bc1a-734c-e9e2fdf03652@redhat.com> X-Originating-IP: [206.223.160.26] X-ClientProxiedBy: YT1PR01CA0090.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:2d::29) To BL0PR12MB5506.namprd12.prod.outlook.com (2603:10b6:208:1cb::22) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from mlx.ziepe.ca (206.223.160.26) by YT1PR01CA0090.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:2d::29) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4195.27 via Frontend Transport; Mon, 7 Jun 2021 14:14:26 +0000 Received: from jgg by mlx with local (Exim 4.94) (envelope-from ) id 1lqG1I-003Ijr-NO; Mon, 07 Jun 2021 11:14:24 -0300 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 8c898f8a-061a-4ac8-23e5-08d929be8ea7 X-MS-TrafficTypeDiagnostic: BL1PR12MB5160: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:5236; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: D3XwjBKd7iIrvdoCKsyDwTyaV2gj4ZS58xqarpxcAwIVbNOLSuHVhgNSkjXyyz7NyAiKcgvGrrS6/JeCGrjyEM520rvBO4vttgCGu86x8DVx96Gn0DoWMT85hhqdq/4uk8b5r/RRlDtGgZdQzHIluopnv0tiZX6CGzf8FwkS4vJomQHOmM8boQEvz5aUKTgslEgWVrMKHA+3beMR3ucOYIacecxcMiyGmGvKgmQaR7vyFIaKP+K9xo8t6Xhgi+L+nyVryyuMn3MXc/koIXO8B4O3Ou0ZcUBU7yIIeDxNV8gwZtCoMMz6tRFsuhK1RytJi6FdWmK6/90agLR2MKPR1CayPOfYtlgib3aGOFSHEv4ycFSVQC1EwceFFu0IjKRAxCfll5Z5Ow7Eo6FKcBwSOT/u/O9oWB2WqjeabQ3F+xmMRbsNT5aKPQn5kK8EL27Sj4A55PanQN/MOjHVd1u4hOX6Vk78z0XpqGbZFlVPTNHlaww95OSqJa4bYxU7oU8dB92sIgac8nK9ro2Sy/DR3xHKOOObyhfJ+ZEnKdopI5zNGFnBBzUymZJ4wDIpSF9NBdX+bYpNifpc/eqMgGb6Ynweb15fowkTdk6vyWJgB8Q= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BL0PR12MB5506.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(4636009)(366004)(346002)(39860400002)(376002)(396003)(136003)(36756003)(7416002)(1076003)(8936002)(9786002)(478600001)(9746002)(26005)(8676002)(6916009)(4744005)(2616005)(4326008)(2906002)(186003)(38100700002)(54906003)(66556008)(66476007)(66946007)(5660300002)(86362001)(316002)(426003)(33656002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData: =?us-ascii?Q?7kORgXxwQdQ1kTQtKmN650L5nKjFL5Y8Dr0Ghtcqir40z2CBhKPxLYZ+1AbD?= =?us-ascii?Q?EBpC4CMBVSNNdAL5c9C4xjbkN5TJVM68PnoQJvq6HCces7VTUGIxPQpLQ0vJ?= =?us-ascii?Q?DQAf7M+k5Fhy1olpLtsdWSuYI5rWGd88uZ8Angvc52ZtKdCSqQUtfDRdWNOL?= =?us-ascii?Q?s68NmoXxhhP3FMRrr8/la5wI9qOJdm098/M5PVLSnB1Sh79P4cXFyVlDqzj1?= =?us-ascii?Q?WkxcgcjSBR0rGCnZtVs3d3NR/jxt/49hFxGhHvYEIm6EBlo1MGQM2hJfrl4H?= =?us-ascii?Q?kEHeroBg7BeTyhNfNO4fUJ3vZFWaDSrNICKGkfzBj6k3osqCxwrEO6OnLcN1?= =?us-ascii?Q?9ZT0ishEDjsbmbeqTPmNn9/YoZYGYRw/L9TomDJfNCczzoEvC/3EvVqM33xJ?= =?us-ascii?Q?eR9Dzi86al/MaLUROaRusaGIrEU6tsqShxs+GTeaT6WdZ0g63Y9hDPA/GY6H?= =?us-ascii?Q?1ZRYrn9WgARbJ8nthDQJJ4UUQugEsavkPfK+JG+IMOhwIro34rOtFk/upBCE?= =?us-ascii?Q?m8kPy4BVgJeoGHQComnkRZKKAxogs0hNqXjSMz1HmH/BhCcqNcbLTmomJPCM?= =?us-ascii?Q?MYWDU6iAsK5HvRMdS0YF1FIBKR0a8olfFkee1bg1T9ltYBOHj5jBcjzD2ehV?= =?us-ascii?Q?ioDblCr8NWtVat9tXzmkCAYWvV32dkX8pJwOXNRpeMfpnEdKOhXMXCoN65y5?= =?us-ascii?Q?4xq4xACLollWjV1kx1920BhddfKsw9hCl8LeQWL6g0TIVR8DmMUkhy7D9VAz?= =?us-ascii?Q?A7JZcC1MMa9K/zcKIEmaxF6QWXKPvsSaIGmm9Hj63y4cthjJrmH6IIJZzuvQ?= =?us-ascii?Q?9R7RV+5mDCIDIwLQvYcayRrZom/Fh/LmB3hkFvegkua8DYI8dPHApNWWfZlV?= =?us-ascii?Q?F6g5qqk2AL9T4Enh6H0l1adk8dCy4aVwmmRXa4rKnMO1umspeqTcxWddhK7Z?= =?us-ascii?Q?iYPrEzTdtwR41jmhTJ6fqfKYJ1Pn4X+71jyT6Olauz/e2Tj7/3IbY5w6DEkM?= =?us-ascii?Q?Jwp4ryu2b122MXQDh5cus6MDXW38eD5wXlgpZUzi+KoxR8eiswGnbx5c02XT?= =?us-ascii?Q?0xK86VMDZC6eHjN3QJv/ajIe9wogqfvRhpU4sisTkN9jftG9PvAmbVmDsKE+?= =?us-ascii?Q?R9uUYI7dflQnFG04yN23UV1RoOZyYkLuspDPYv41d6Y/O/XefYkHJ78fL8oz?= =?us-ascii?Q?N73SN8YpxRP9Xpb2BhYoFqF0+BA2xP1VIHNEA1X7TLdu5b0GVTTh0FrGQwtb?= =?us-ascii?Q?HwoMUJ6BRxqFHFOO+XC8fMA+4kIIJg8ShccWTpK/ipYcIoayXYU8wjwXbOqQ?= =?us-ascii?Q?/azEKQQb7WPrR/kL0vGLczNH?= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: 8c898f8a-061a-4ac8-23e5-08d929be8ea7 X-MS-Exchange-CrossTenant-AuthSource: BL0PR12MB5506.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Jun 2021 14:14:26.5659 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: bnmq9lbAc8l9AEiy8w240LeWBumtlg6/aFxrH0navOamjL3KiZi+LxYy+pG5ojNo X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL1PR12MB5160 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Jun 07, 2021 at 11:18:33AM +0800, Jason Wang wrote: > Note that no drivers call these things doesn't meant it was not > supported by the spec. Of course it does. If the spec doesn't define exactly when the driver should call the cache flushes for no-snoop transactions then the protocol doesn't support no-soop. no-snoop is only used in very specific sequences of operations, like certain GPU usages, because regaining coherence on x86 is incredibly expensive. ie I wouldn't ever expect a NIC to use no-snoop because NIC's expect packets to be processed by the CPU. "non-coherent DMA" is some general euphemism that evokes images of embedded platforms that don't have coherent DMA at all and have low cost ways to regain coherence. This is not at all what we are talking about here at all. Jason