From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-10.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9F0F0C49EA2 for ; Thu, 17 Jun 2021 16:54:08 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 860FB6128B for ; Thu, 17 Jun 2021 16:54:08 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231373AbhFQQ4P (ORCPT ); Thu, 17 Jun 2021 12:56:15 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:40578 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231365AbhFQQ4O (ORCPT ); Thu, 17 Jun 2021 12:56:14 -0400 Received: from mail-wm1-x331.google.com (mail-wm1-x331.google.com [IPv6:2a00:1450:4864:20::331]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 28FD7C061760 for ; Thu, 17 Jun 2021 09:54:05 -0700 (PDT) Received: by mail-wm1-x331.google.com with SMTP id c84so3856992wme.5 for ; Thu, 17 Jun 2021 09:54:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ffwll.ch; s=google; h=date:from:to:cc:subject:message-id:mail-followup-to:references :mime-version:content-disposition:content-transfer-encoding :in-reply-to; bh=L3tUpMod/cM1TQUcFl0xQWorXugAaW8fIvbrvXm/gIM=; b=PUKWMqw0RyD/Pj8ZQXGwn6ue+YfAd2FHa4aCUws+z6IeQVyafTSFNGyPFlWnpmJAI7 xu0enBeb23tPl2cbYnOiprCU4x19rhPMyXwjmt+G0DoxlyVwDkjHzxabGG46jpzlQYmD WmAvvT7kBmJKAF2EabwPLRMEfRIBuhaFV811w= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id :mail-followup-to:references:mime-version:content-disposition :content-transfer-encoding:in-reply-to; bh=L3tUpMod/cM1TQUcFl0xQWorXugAaW8fIvbrvXm/gIM=; b=fJrIse0gp+VPPguoZ07TIaHMdlT4uS3cxeutofHJkiHzEgaMPz0lEV9UzjBWYiQZ4e 2NWNA/Cg+OUCxf74c+IZgEGoKJ0PYR0OAdJAcv1i40ZiWNtLiBFzDQb9fM4+x2D7XLD2 VsdBYeJGEd2g/4EAncLCJxrcOeY/zFgcdH2rKxNgxVI0snyWSmhrOw3zba9CYRqaBFjj VY0Qpu0j6fmxbKvPix5EnuakHXF1edyK0ZU/0rb1yzeJ7dDU+XYaM+wScxgrN2U5wx4S ze0aSLlIu/wAu7UnQdUSrKv8ioE/ju42IbO7TFPzN4rUNxYEnry2lK75EX9auLlddxXP /Zzw== X-Gm-Message-State: AOAM530XZA3gY8M60hxXj7uTD4SWGPnBUmSMI0aqA0HwHjB1qKoCG+Zz c3a2fILqGwcH2qMzkC1nnllQrA== X-Google-Smtp-Source: ABdhPJzDGw+4bHJ/b9AeEQK87MFN+NplxmL9bo0enXvZXSQwHWFp6JMnFADvM72LXj7O3qao6Nm25A== X-Received: by 2002:a1c:e915:: with SMTP id q21mr6262558wmc.110.1623948843770; Thu, 17 Jun 2021 09:54:03 -0700 (PDT) Received: from phenom.ffwll.local ([2a02:168:57f4:0:efd0:b9e5:5ae6:c2fa]) by smtp.gmail.com with ESMTPSA id a1sm7909721wra.63.2021.06.17.09.54.02 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 17 Jun 2021 09:54:03 -0700 (PDT) Date: Thu, 17 Jun 2021 18:54:01 +0200 From: Daniel Vetter To: Christian =?iso-8859-1?Q?K=F6nig?= Cc: Dan Carpenter , thomas.hellstrom@linux.intel.com, Huang Rui , David Airlie , Daniel Vetter , dri-devel@lists.freedesktop.org, linux-kernel@vger.kernel.org Subject: Re: [PATCH] drm/ttm: fix error handling in ttm_bo_handle_move_mem() Message-ID: Mail-Followup-To: Christian =?iso-8859-1?Q?K=F6nig?= , Dan Carpenter , thomas.hellstrom@linux.intel.com, Huang Rui , David Airlie , dri-devel@lists.freedesktop.org, linux-kernel@vger.kernel.org References: <03d0b798-d1ab-5b6f-2c27-8140d923d445@gmail.com> <20210616083758.GC1901@kadam> <520a9d1f-8841-8d5e-595d-23783de8333d@gmail.com> <20210616093604.GD1901@kadam> <7354cd94-06bf-ec36-4539-c3570c1775ae@gmail.com> <20210616191951.GE1901@kadam> <6d848546-a94b-9285-7956-7e7282ee524f@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <6d848546-a94b-9285-7956-7e7282ee524f@gmail.com> X-Operating-System: Linux phenom 5.10.0-7-amd64 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Jun 17, 2021 at 09:41:35AM +0200, Christian König wrote: > > > Am 16.06.21 um 21:19 schrieb Dan Carpenter: > > On Wed, Jun 16, 2021 at 01:00:38PM +0200, Christian König wrote: > > > > > > Am 16.06.21 um 11:36 schrieb Dan Carpenter: > > > > On Wed, Jun 16, 2021 at 10:47:14AM +0200, Christian König wrote: > > > > > Am 16.06.21 um 10:37 schrieb Dan Carpenter: > > > > > > On Wed, Jun 16, 2021 at 08:46:33AM +0200, Christian König wrote: > > > > > > > Sending the first message didn't worked, so let's try again. > > > > > > > > > > > > > > Am 16.06.21 um 08:30 schrieb Dan Carpenter: > > > > > > > > There are three bugs here: > > > > > > > > 1) We need to call unpopulate() if ttm_tt_populate() succeeds. > > > > > > > > 2) The "new_man = ttm_manager_type(bdev, bo->mem.mem_type);" assignment > > > > > > > > was wrong and it was really assigning "new_mem = old_mem;". There > > > > > > > > is no need for this assignment anyway as we already have the value > > > > > > > > for "new_mem". > > > > > > > > 3) The (!new_man->use_tt) condition is reversed. > > > > > > > > > > > > > > > > Fixes: ba4e7d973dd0 ("drm: Add the TTM GPU memory manager subsystem.") > > > > > > > > Signed-off-by: Dan Carpenter > > > > > > > > --- > > > > > > > > This is from reading the code and I can't swear that I have understood > > > > > > > > it correctly. My nouveau driver is currently unusable and this patch > > > > > > > > has not helped. But hopefully if I fix enough bugs eventually it will > > > > > > > > start to work. > > > > > > > Well NAK, the code previously looked quite well and you are breaking it now. > > > > > > > > > > > > > > What's the problem with nouveau? > > > > > > > > > > > > > The new Firefox seems to excersize nouveau more than the old one so > > > > > > when I start 10 firefox windows it just hangs the graphics. > > > > > > > > > > > > I've added debug code and it seems like the problem is that > > > > > > nv50_mem_new() is failing. > > > > > Sounds like it is running out of memory to me. > > > > > > > > > > Do you have a dmesg? > > > > > > > > > At first there was a very straight forward use after free bug which I > > > > fixed. > > > > https://lore.kernel.org/nouveau/YMinJwpIei9n1Pn1@mwanda/T/#u > > > > > > > > But now the use after free is gone the only thing in dmesg is: > > > > "[TTM] Buffer eviction failed". And I have some firmware missing. > > > > > > > > [ 205.489763] rfkill: input handler disabled > > > > [ 205.678292] nouveau 0000:01:00.0: Direct firmware load for nouveau/nva8_fuc084 failed with error -2 > > > > [ 205.678300] nouveau 0000:01:00.0: Direct firmware load for nouveau/nva8_fuc084d failed with error -2 > > > > [ 205.678302] nouveau 0000:01:00.0: msvld: unable to load firmware data > > > > [ 205.678304] nouveau 0000:01:00.0: msvld: init failed, -19 > > > > [ 296.150632] [TTM] Buffer eviction failed > > > > [ 417.084265] [TTM] Buffer eviction failed > > > > [ 447.295961] [TTM] Buffer eviction failed > > > > [ 510.800231] [TTM] Buffer eviction failed > > > > [ 556.101384] [TTM] Buffer eviction failed > > > > [ 616.495790] [TTM] Buffer eviction failed > > > > [ 692.014007] [TTM] Buffer eviction failed > > > > > > > > The eviction failed message only shows up a minute after the hang so it > > > > seems more like a symptom than a root cause. > > > Yeah, look at the timing. What happens is that the buffer eviction timed out > > > because the hardware is locked up. > > > > > > No idea what that could be. It might not even be kernel related at all. > > I don't think it's hardware related... Using an old version of firefox > > "fixes" the problem. I downloaded the firmware so that's not the issue. > > Here's the dmesg load info with the new firmware. > > Oh, I was not suggesting a hardware problem. > > The most likely cause is a software issue in userspace, e.g. wrong order of > doing thing, doing things to fast without waiting etc... > > There are tons of things how userspace can crash GPU hardware you can't > prevent in the kernel. Especially sending an endless loop is well known as > Turing's halting problems and not even theoretically solvable. > > I suggest to start digging in userspace instead. I guess nouveau doesn't have reset when the fences time out? That would at least paper over this, plus it makes debugging the bug in mesa3 easier. Also as Christian points out, because halting problem lack of tdr (timeoud and device reset) is actually a security bug itself. -Daniel > > Christian. > > > > > [ 1.412458] AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel > > [ 1.412527] AMD-Vi: AMD IOMMUv2 functionality not available on this system > > [ 1.412710] nouveau 0000:01:00.0: vgaarb: deactivate vga console > > [ 1.417213] Console: switching to colour dummy device 80x25 > > [ 1.417272] nouveau 0000:01:00.0: NVIDIA GT218 (0a8280b1) > > [ 1.531565] nouveau 0000:01:00.0: bios: nvkm_bios_new: version 70.18.6f.00.05 > > [ 1.531916] nouveau 0000:01:00.0: fb: nvkm_ram_ctor: 1024 MiB DDR3 > > [ 2.248212] tsc: Refined TSC clocksource calibration: 3392.144 MHz > > [ 2.248218] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x30e5517d4e4, max_idle_ns: 440795261668 ns > > [ 2.252203] clocksource: Switched to clocksource tsc > > [ 2.848138] nouveau 0000:01:00.0: DRM: VRAM: 1024 MiB > > [ 2.848142] nouveau 0000:01:00.0: DRM: GART: 1048576 MiB > > [ 2.848145] nouveau 0000:01:00.0: DRM: TMDS table version 2.0 > > [ 2.848147] nouveau 0000:01:00.0: DRM: DCB version 4.0 > > [ 2.848149] nouveau 0000:01:00.0: DRM: DCB outp 00: 01000302 00020030 > > [ 2.848151] nouveau 0000:01:00.0: DRM: DCB outp 01: 02000300 00000000 > > [ 2.848154] nouveau 0000:01:00.0: DRM: DCB outp 02: 02011362 00020010 > > [ 2.848155] nouveau 0000:01:00.0: DRM: DCB outp 03: 01022310 00000000 > > [ 2.848157] nouveau 0000:01:00.0: DRM: DCB conn 00: 00001030 > > [ 2.848159] nouveau 0000:01:00.0: DRM: DCB conn 01: 00002161 > > [ 2.848161] nouveau 0000:01:00.0: DRM: DCB conn 02: 00000200 > > [ 2.850214] nouveau 0000:01:00.0: DRM: MM: using COPY for buffer copies > > [ 2.908409] nouveau 0000:01:00.0: DRM: allocated 1600x900 fb: 0x70000, bo 00000000091fb080 > > [ 2.908518] fbcon: nouveaudrmfb (fb0) is primary device > > [ 2.955528] Console: switching to colour frame buffer device 200x56 > > [ 2.957780] nouveau 0000:01:00.0: [drm] fb0: nouveaudrmfb frame buffer device > > [ 2.957926] [drm] Initialized nouveau 1.3.1 20120801 for 0000:01:00.0 on minor 0 > > [ 2.959816] loop: module loaded > > > > regards, > > dan carpenter > -- Daniel Vetter Software Engineer, Intel Corporation http://blog.ffwll.ch