From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.8 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 43AC3C07E95 for ; Wed, 7 Jul 2021 12:31:44 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id A43DC61CA8 for ; Wed, 7 Jul 2021 12:31:43 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org A43DC61CA8 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=pengutronix.de Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=dri-devel-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 4C4D36E131; Wed, 7 Jul 2021 12:31:40 +0000 (UTC) Received: from metis.ext.pengutronix.de (metis.ext.pengutronix.de [IPv6:2001:67c:670:201:290:27ff:fe1d:cc33]) by gabe.freedesktop.org (Postfix) with ESMTPS id 824B06E12C for ; Wed, 7 Jul 2021 12:31:38 +0000 (UTC) Received: from gallifrey.ext.pengutronix.de ([2001:67c:670:201:5054:ff:fe8d:eefb] helo=[IPv6:::1]) by metis.ext.pengutronix.de with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1m16iH-000199-2F; Wed, 07 Jul 2021 14:31:37 +0200 Message-ID: Subject: Re: [PATCH 3/7] drm/etnaviv: Don't break exclusive fence ordering From: Lucas Stach To: Daniel Vetter Date: Wed, 07 Jul 2021 14:31:35 +0200 In-Reply-To: References: <20210706101209.3034092-1-daniel.vetter@ffwll.ch> <20210706101209.3034092-4-daniel.vetter@ffwll.ch> <7ae23a2b1a4aec4e57881e0d88a7d046fe17bfda.camel@pengutronix.de> Content-Type: text/plain; charset="UTF-8" User-Agent: Evolution 3.40.1 (3.40.1-1.fc34) MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-SA-Exim-Connect-IP: 2001:67c:670:201:5054:ff:fe8d:eefb X-SA-Exim-Mail-From: l.stach@pengutronix.de X-SA-Exim-Scanned: No (on metis.ext.pengutronix.de); SAEximRunCond expanded to false X-PTX-Original-Recipient: dri-devel@lists.freedesktop.org X-BeenThere: dri-devel@lists.freedesktop.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Direct Rendering Infrastructure - Development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Intel Graphics Development , The etnaviv authors , DRI Development , Russell King , Daniel Vetter Errors-To: dri-devel-bounces@lists.freedesktop.org Sender: "dri-devel" Am Mittwoch, dem 07.07.2021 um 13:37 +0200 schrieb Daniel Vetter: > On Wed, Jul 7, 2021 at 10:54 AM Lucas Stach wrote: > > > > Hi Daniel, > > > > I'm feeling like I miss a ton of context here, so some maybe dumb > > questions/remarks below. > > > > Am Dienstag, dem 06.07.2021 um 12:12 +0200 schrieb Daniel Vetter: > > > There's only one exclusive slot, and we must not break the ordering. > > > > > > A better fix would be to us a dma_fence_chain or _array like e.g. > > > amdgpu now uses, but it probably makes sense to lift this into > > > dma-resv.c code as a proper concept, so that drivers don't have to > > > hack up their own solution each on their own. Hence go with the simple > > > fix for now. > > > > > > Another option is the fence import ioctl from Jason: > > > > > > https://lore.kernel.org/dri-devel/20210610210925.642582-7-jason@jlekstrand.net/ > > > > Sorry, but why is the fence import ioctl a alternative to the fix > > proposed in this patch? > > It's not an alternative to fixing the issue here, it's an alternative > to trying to fix this here without adding more dependencies. Depends a > bit what exactly you want to do, I just linked this for the bigger > picture. > I appreciate the bigger picture, it just makes it harder to follow what is going on in this exact commit when trying to match up the code change with the commit message. I would have expected this link to only be part of the cover letter explaining the series, instead of being part of the commit message. > > > > > > > > > Signed-off-by: Daniel Vetter > > > Cc: Lucas Stach > > > Cc: Russell King > > > Cc: Christian Gmeiner > > > Cc: etnaviv@lists.freedesktop.org > > > --- > > > drivers/gpu/drm/etnaviv/etnaviv_gem_submit.c | 8 +++++--- > > > 1 file changed, 5 insertions(+), 3 deletions(-) > > > > > > diff --git a/drivers/gpu/drm/etnaviv/etnaviv_gem_submit.c b/drivers/gpu/drm/etnaviv/etnaviv_gem_submit.c > > > index 92478a50a580..5c4fed2b7c6a 100644 > > > --- a/drivers/gpu/drm/etnaviv/etnaviv_gem_submit.c > > > +++ b/drivers/gpu/drm/etnaviv/etnaviv_gem_submit.c > > > @@ -178,18 +178,20 @@ static int submit_fence_sync(struct etnaviv_gem_submit *submit) > > > for (i = 0; i < submit->nr_bos; i++) { > > > struct etnaviv_gem_submit_bo *bo = &submit->bos[i]; > > > struct dma_resv *robj = bo->obj->base.resv; > > > + bool write = bo->flags & ETNA_SUBMIT_BO_WRITE; > > > > > > - if (!(bo->flags & ETNA_SUBMIT_BO_WRITE)) { > > > + if (!(write)) { > > > > No parenthesis around the write needed. > > > > > ret = dma_resv_reserve_shared(robj, 1); > > > if (ret) > > > return ret; > > > } > > > > > > - if (submit->flags & ETNA_SUBMIT_NO_IMPLICIT) > > > + /* exclusive fences must be ordered */ > > > > I feel like this comment isn't really helpful. It might tell you all > > you need to know if you just paged in all the context around dma_resv > > and the dependency graph, but it's not more than noise to me right now. > > > > I guess the comment should answer the question against what the > > exclusive fence we are going to add needs to be ordered and why it > > isn't safe to skip implicit sync in that case. > > The full-length comment is the doc patch, which is last in the series. > Essentially the rule is that your not allowed to drop fences on the > floor (which you do if you just set a new write fence and not take any > of the existing fences as dependencies), at least for shared buffers. > But since it's easier to be consistent I think it's best if we do this > just across the board. > > Like the commit message explains, there's a few ways to fix this: > - just treat it as implicit synced > - chain the fences together - that way you don't sync, but also > there's no fence that's being lost. This is what amdgpu does, and also > what the new import ioctl does. > > 2nd option is a lot more involved, and since all the dma-resv stuff is > a bit under discussion, I went with the most minimal thing possible. Thanks for the confirmation, that was as much as I figured from the doc patch as well. So with that in mind I would expect this comment to read something like this: "Adding a new exclusive fence drops all previous fences from the dma_resv. To avoid violating the signalling order we err on the side of over-synchronizing by waiting for the existing fences, even if userspace asked us to ignore them." Regards, Lucas > -Daniel > > > > > Regards, > > Lucas > > > + if (submit->flags & ETNA_SUBMIT_NO_IMPLICIT && !write) > > > continue; > > > > > > ret = drm_sched_job_await_implicit(&submit->sched_job, &bo->obj->base, > > > - bo->flags & ETNA_SUBMIT_BO_WRITE); > > > + write); > > > if (ret) > > > return ret; > > > } > > > > > > From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.8 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3C24CC07E95 for ; Wed, 7 Jul 2021 12:31:41 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id B575261C9A for ; Wed, 7 Jul 2021 12:31:40 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org B575261C9A Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=pengutronix.de Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=intel-gfx-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 4CAB56E134; Wed, 7 Jul 2021 12:31:40 +0000 (UTC) Received: from metis.ext.pengutronix.de (metis.ext.pengutronix.de [IPv6:2001:67c:670:201:290:27ff:fe1d:cc33]) by gabe.freedesktop.org (Postfix) with ESMTPS id 31EDF6E12C for ; Wed, 7 Jul 2021 12:31:39 +0000 (UTC) Received: from gallifrey.ext.pengutronix.de ([2001:67c:670:201:5054:ff:fe8d:eefb] helo=[IPv6:::1]) by metis.ext.pengutronix.de with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1m16iH-000199-2F; Wed, 07 Jul 2021 14:31:37 +0200 Message-ID: From: Lucas Stach To: Daniel Vetter Date: Wed, 07 Jul 2021 14:31:35 +0200 In-Reply-To: References: <20210706101209.3034092-1-daniel.vetter@ffwll.ch> <20210706101209.3034092-4-daniel.vetter@ffwll.ch> <7ae23a2b1a4aec4e57881e0d88a7d046fe17bfda.camel@pengutronix.de> User-Agent: Evolution 3.40.1 (3.40.1-1.fc34) MIME-Version: 1.0 X-SA-Exim-Connect-IP: 2001:67c:670:201:5054:ff:fe8d:eefb X-SA-Exim-Mail-From: l.stach@pengutronix.de X-SA-Exim-Scanned: No (on metis.ext.pengutronix.de); SAEximRunCond expanded to false X-PTX-Original-Recipient: intel-gfx@lists.freedesktop.org Subject: Re: [Intel-gfx] [PATCH 3/7] drm/etnaviv: Don't break exclusive fence ordering X-BeenThere: intel-gfx@lists.freedesktop.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Intel graphics driver community testing & development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Intel Graphics Development , The etnaviv authors , DRI Development , Christian Gmeiner , Russell King , Daniel Vetter Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: intel-gfx-bounces@lists.freedesktop.org Sender: "Intel-gfx" Am Mittwoch, dem 07.07.2021 um 13:37 +0200 schrieb Daniel Vetter: > On Wed, Jul 7, 2021 at 10:54 AM Lucas Stach wrote: > > > > Hi Daniel, > > > > I'm feeling like I miss a ton of context here, so some maybe dumb > > questions/remarks below. > > > > Am Dienstag, dem 06.07.2021 um 12:12 +0200 schrieb Daniel Vetter: > > > There's only one exclusive slot, and we must not break the ordering. > > > > > > A better fix would be to us a dma_fence_chain or _array like e.g. > > > amdgpu now uses, but it probably makes sense to lift this into > > > dma-resv.c code as a proper concept, so that drivers don't have to > > > hack up their own solution each on their own. Hence go with the simple > > > fix for now. > > > > > > Another option is the fence import ioctl from Jason: > > > > > > https://lore.kernel.org/dri-devel/20210610210925.642582-7-jason@jlekstrand.net/ > > > > Sorry, but why is the fence import ioctl a alternative to the fix > > proposed in this patch? > > It's not an alternative to fixing the issue here, it's an alternative > to trying to fix this here without adding more dependencies. Depends a > bit what exactly you want to do, I just linked this for the bigger > picture. > I appreciate the bigger picture, it just makes it harder to follow what is going on in this exact commit when trying to match up the code change with the commit message. I would have expected this link to only be part of the cover letter explaining the series, instead of being part of the commit message. > > > > > > > > > Signed-off-by: Daniel Vetter > > > Cc: Lucas Stach > > > Cc: Russell King > > > Cc: Christian Gmeiner > > > Cc: etnaviv@lists.freedesktop.org > > > --- > > > drivers/gpu/drm/etnaviv/etnaviv_gem_submit.c | 8 +++++--- > > > 1 file changed, 5 insertions(+), 3 deletions(-) > > > > > > diff --git a/drivers/gpu/drm/etnaviv/etnaviv_gem_submit.c b/drivers/gpu/drm/etnaviv/etnaviv_gem_submit.c > > > index 92478a50a580..5c4fed2b7c6a 100644 > > > --- a/drivers/gpu/drm/etnaviv/etnaviv_gem_submit.c > > > +++ b/drivers/gpu/drm/etnaviv/etnaviv_gem_submit.c > > > @@ -178,18 +178,20 @@ static int submit_fence_sync(struct etnaviv_gem_submit *submit) > > > for (i = 0; i < submit->nr_bos; i++) { > > > struct etnaviv_gem_submit_bo *bo = &submit->bos[i]; > > > struct dma_resv *robj = bo->obj->base.resv; > > > + bool write = bo->flags & ETNA_SUBMIT_BO_WRITE; > > > > > > - if (!(bo->flags & ETNA_SUBMIT_BO_WRITE)) { > > > + if (!(write)) { > > > > No parenthesis around the write needed. > > > > > ret = dma_resv_reserve_shared(robj, 1); > > > if (ret) > > > return ret; > > > } > > > > > > - if (submit->flags & ETNA_SUBMIT_NO_IMPLICIT) > > > + /* exclusive fences must be ordered */ > > > > I feel like this comment isn't really helpful. It might tell you all > > you need to know if you just paged in all the context around dma_resv > > and the dependency graph, but it's not more than noise to me right now. > > > > I guess the comment should answer the question against what the > > exclusive fence we are going to add needs to be ordered and why it > > isn't safe to skip implicit sync in that case. > > The full-length comment is the doc patch, which is last in the series. > Essentially the rule is that your not allowed to drop fences on the > floor (which you do if you just set a new write fence and not take any > of the existing fences as dependencies), at least for shared buffers. > But since it's easier to be consistent I think it's best if we do this > just across the board. > > Like the commit message explains, there's a few ways to fix this: > - just treat it as implicit synced > - chain the fences together - that way you don't sync, but also > there's no fence that's being lost. This is what amdgpu does, and also > what the new import ioctl does. > > 2nd option is a lot more involved, and since all the dma-resv stuff is > a bit under discussion, I went with the most minimal thing possible. Thanks for the confirmation, that was as much as I figured from the doc patch as well. So with that in mind I would expect this comment to read something like this: "Adding a new exclusive fence drops all previous fences from the dma_resv. To avoid violating the signalling order we err on the side of over-synchronizing by waiting for the existing fences, even if userspace asked us to ignore them." Regards, Lucas > -Daniel > > > > > Regards, > > Lucas > > > + if (submit->flags & ETNA_SUBMIT_NO_IMPLICIT && !write) > > > continue; > > > > > > ret = drm_sched_job_await_implicit(&submit->sched_job, &bo->obj->base, > > > - bo->flags & ETNA_SUBMIT_BO_WRITE); > > > + write); > > > if (ret) > > > return ret; > > > } > > > > > > _______________________________________________ Intel-gfx mailing list Intel-gfx@lists.freedesktop.org https://lists.freedesktop.org/mailman/listinfo/intel-gfx