From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.0 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 541BEC04AAF for ; Thu, 16 May 2019 17:53:55 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 2E76C20657 for ; Thu, 16 May 2019 17:53:55 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728959AbfEPRxy (ORCPT ); Thu, 16 May 2019 13:53:54 -0400 Received: from foss.arm.com ([217.140.101.70]:53524 "EHLO foss.arm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726441AbfEPRxx (ORCPT ); Thu, 16 May 2019 13:53:53 -0400 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.72.51.249]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 5E15119BF; Thu, 16 May 2019 10:53:53 -0700 (PDT) Received: from [10.1.196.75] (e110467-lin.cambridge.arm.com [10.1.196.75]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 0AE6B3F5AF; Thu, 16 May 2019 10:53:50 -0700 (PDT) Subject: Re: [PATCH v3 6/7] iommu: Introduce IOMMU_RESV_DIRECT_RELAXABLE reserved memory regions To: Auger Eric , eric.auger.pro@gmail.com, joro@8bytes.org, iommu@lists.linux-foundation.org, linux-kernel@vger.kernel.org, dwmw2@infradead.org, lorenzo.pieralisi@arm.com, will.deacon@arm.com, hanjun.guo@linaro.org, sudeep.holla@arm.com Cc: alex.williamson@redhat.com, shameerali.kolothum.thodi@huawei.com References: <20190516100817.12076-1-eric.auger@redhat.com> <20190516100817.12076-7-eric.auger@redhat.com> <57db1955-9d19-7c0b-eca3-37cc0d7d745b@redhat.com> From: Robin Murphy Message-ID: Date: Thu, 16 May 2019 18:53:49 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 In-Reply-To: <57db1955-9d19-7c0b-eca3-37cc0d7d745b@redhat.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 16/05/2019 14:23, Auger Eric wrote: > Hi Robin, > On 5/16/19 2:46 PM, Robin Murphy wrote: >> On 16/05/2019 11:08, Eric Auger wrote: >>> Introduce a new type for reserved region. This corresponds >>> to directly mapped regions which are known to be relaxable >>> in some specific conditions, such as device assignment use >>> case. Well known examples are those used by USB controllers >>> providing PS/2 keyboard emulation for pre-boot BIOS and >>> early BOOT or RMRRs associated to IGD working in legacy mode. >>> >>> Since commit c875d2c1b808 ("iommu/vt-d: Exclude devices using RMRRs >>> from IOMMU API domains") and commit 18436afdc11a ("iommu/vt-d: Allow >>> RMRR on graphics devices too"), those regions are currently >>> considered "safe" with respect to device assignment use case >>> which requires a non direct mapping at IOMMU physical level >>> (RAM GPA -> HPA mapping). >>> >>> Those RMRRs currently exist and sometimes the device is >>> attempting to access it but this has not been considered >>> an issue until now. >>> >>> However at the moment, iommu_get_group_resv_regions() is >>> not able to make any difference between directly mapped >>> regions: those which must be absolutely enforced and those >>> like above ones which are known as relaxable. >>> >>> This is a blocker for reporting severe conflicts between >>> non relaxable RMRRs (like MSI doorbells) and guest GPA space. >>> >>> With this new reserved region type we will be able to use >>> iommu_get_group_resv_regions() to enumerate the IOVA space >>> that is usable through the IOMMU API without introducing >>> regressions with respect to existing device assignment >>> use cases (USB and IGD). >>> >>> Signed-off-by: Eric Auger >>> >>> --- >>> >>> Note: At the moment the sysfs ABI is not changed. However I wonder >>> whether it wouldn't be preferable to report the direct region as >>> "direct_relaxed" there. At the moment, in case the same direct >>> region is used by 2 devices, one USB/GFX and another not belonging >>> to the previous categories, the direct region will be output twice >>> with "direct" type. >> >> Hmm, that sounds a bit off - if we have overlapping regions within the >> same domain, then we need to do some additional pre-processing to adjust >> them anyway, since any part of a relaxable region which overlaps a >> non-relaxable region cannot actually be relaxed, and so really should >> never be described as such. > In iommu_insert_resv_region(), we are overlapping regions of the same > type. So iommu_get_group_resv_regions() should return both the relaxable > region and non relaxable one. I should test this again using a hacked > kernel though. We should still consider relaxable regions as being able to merge back in to regular direct regions to a degree - If a relaxable region falls entirely within a direct one then there's no point exposing it because the direct region *has* to take precedence and be enforced. If there is an incomplete overlap then we could possibly just trust consumers to see it and give the direct region precedence themselves, but since the relaxable region is our own in-kernel invention rather than firmware gospel I think it would be safer to truncate it to just its non-overlapping part. Robin.