From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.7 required=3.0 tests=BAYES_00,DKIM_ADSP_CUSTOM_MED, DKIM_SIGNED,DKIM_VALID,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 52D43C4361B for ; Sun, 6 Dec 2020 16:48:01 +0000 (UTC) Received: from merlin.infradead.org (merlin.infradead.org [205.233.59.134]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 033BE2312F for ; Sun, 6 Dec 2020 16:48:00 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 033BE2312F Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-nvme-bounces+linux-nvme=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=merlin.20170209; h=Sender:Content-Transfer-Encoding: Content-Type:Cc:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:To:Subject:Message-ID:Date:From:In-Reply-To: References:MIME-Version:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=71UqNFdEYWoAhypS5813w2kN3hzsEtadL3NP7oXcJig=; b=3Du9EOIPI0MlZQfb7FFBmghvQ xicqH/C64t28ZjOBMzKbwpX2Ba4KM8jk9HUd8Or+WO1dmyxttexaUpKAH/QkC5DIOow92G9dFnk7A /dTxG8UdwrYt0yceOPP7/CvzztKl1VrcP8JZ8YCIc2Vj4K6XHoBxesjaBKdSumwWkNlBzGYhZjLUj SSdjD6SGV7MuNMYqQEHIZ/ixAOOjFRxJFvGMYjYEMugMBHKFsF6mPsRiB68KhpfMESO6EShUl0p9o 1t34tPzom2XJ620XZywmBWlJgI9zZNiE6vy6cr3mzqDKK25GHVXSc5eJzwS4G2nf73fqBV7fU4snK ATvbTyLig==; Received: from localhost ([::1] helo=merlin.infradead.org) by merlin.infradead.org with esmtp (Exim 4.92.3 #3 (Red Hat Linux)) id 1klxCT-0004zL-36; Sun, 06 Dec 2020 16:47:53 +0000 Received: from mail-lf1-x12d.google.com ([2a00:1450:4864:20::12d]) by merlin.infradead.org with esmtps (Exim 4.92.3 #3 (Red Hat Linux)) id 1klxCN-0004ye-Q1 for linux-nvme@lists.infradead.org; Sun, 06 Dec 2020 16:47:48 +0000 Received: by mail-lf1-x12d.google.com with SMTP id r24so14557206lfm.8 for ; Sun, 06 Dec 2020 08:47:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=RW0lDqSJK11o5Hdo0ZTtiX38zMds7s0ivaE30jYDc08=; b=fyWAecBmSWqbeKTDqjVW+CVkNXAQmZ410oGJ+xz0B3svfmdqi9ApYJY14RYlLULq1X NQfKYWKNfPcKgC+hJNLBviDdi4gBw6UW0zBYYEzqUyiPbgT5G5L/KO8GooMOlf8fcq8V t75RXhiKmf+bn3sH0AYBYtKLi3q2jhRa/RQpy5AYfan7yvFFFKQqrH8wwvd+Vy6atRaf is1yTY0QYFtQXGVSI7EWg9vnv6exSx3VEEew5PE68sbe+WTEaviOQmbo8QaJLc2eaK7y HuNPjjSrWCxhDwki9gHeW6OEwhG/glGZEokkXpBsTQWHYr1m1cgxf2uOFGFRVK13vvp0 MUng== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=RW0lDqSJK11o5Hdo0ZTtiX38zMds7s0ivaE30jYDc08=; b=L689zOf21zq7bTBtiHmWMWjd518V4VCs3zCiMI+doOt7WY73gwcZElAY3JaEhSuItF 7K8TJzcW0cG1+Sc2G2IR00KZTHOhQ95N+sjPEycbvVJupMqVhU7BnjMY+NPzRzt9aLjw FyknOkkLMqdV3rqBomv/NaqpO6fnzblnRop2dFKMvVrfn0rZVjAdLQOBE2kJfuzLgaux ZzRXyGd3H59ppAJcH7qoL/TLEZsIbdgIds6Z2mDCo0X4d8/lXsmPLt/ywK48UJsKV/ac 4NBTnaGaJpnIxJHm6NivwogB9X83QeJEcIAmQZtsqY6uWSeIr70c1q/X4rBMdT73AO9x eUwQ== X-Gm-Message-State: AOAM5307AA0PXZ2luhZKd0cDeGS03kp4yDU6iCgPWtmou3ytywLuR68c vzppnBEtOhM6sfhLzn57T+qjxbqkU6Uxu9t2ggg= X-Google-Smtp-Source: ABdhPJw9vQiBpQRjhN/8CX+xAjLRplV+JVJIeCtYqBQQJnmgOmlExZLWBZV8I1M5wikJWFGCCY4w8C0bQqI+B6jfbXY= X-Received: by 2002:a19:3c5:: with SMTP id 188mr6378736lfd.202.1607273263606; Sun, 06 Dec 2020 08:47:43 -0800 (PST) MIME-Version: 1.0 References: <20201129035639.GW2532@mail-itl> <20201130164010.GA23494@redsun51.ssa.fujisawa.hgst.com> <20201202000642.GJ201140@mail-itl> <20201204110847.GU201140@mail-itl> <20201204120803.GA20727@lst.de> <20201204122054.GV201140@mail-itl> <20201205082839.ts3ju6yta46cgwjn@Air-de-Roger> In-Reply-To: <20201205082839.ts3ju6yta46cgwjn@Air-de-Roger> From: Jason Andryuk Date: Sun, 6 Dec 2020 11:47:32 -0500 Message-ID: Subject: Re: GPF on 0xdead000000000100 in nvme_map_data - Linux 5.9.9 To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20201206_114747_882525_8D09BA75 X-CRM114-Status: GOOD ( 16.37 ) X-BeenThere: linux-nvme@lists.infradead.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Juergen Gross , Sagi Grimberg , =?UTF-8?Q?Marek_Marczykowski=2DG=C3=B3recki?= , linux-nvme@lists.infradead.org, Jens Axboe , Keith Busch , xen-devel , Christoph Hellwig Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "Linux-nvme" Errors-To: linux-nvme-bounces+linux-nvme=archiver.kernel.org@lists.infradead.org T24gU2F0LCBEZWMgNSwgMjAyMCBhdCAzOjI5IEFNIFJvZ2VyIFBhdSBNb25uw6kgPHJvZ2VyLnBh dUBjaXRyaXguY29tPiB3cm90ZToKPgo+IE9uIEZyaSwgRGVjIDA0LCAyMDIwIGF0IDAxOjIwOjU0 UE0gKzAxMDAsIE1hcmVrIE1hcmN6eWtvd3NraS1Hw7NyZWNraSB3cm90ZToKPiA+IE9uIEZyaSwg RGVjIDA0LCAyMDIwIGF0IDAxOjA4OjAzUE0gKzAxMDAsIENocmlzdG9waCBIZWxsd2lnIHdyb3Rl Ogo+ID4gPiBPbiBGcmksIERlYyAwNCwgMjAyMCBhdCAxMjowODo0N1BNICswMTAwLCBNYXJlayBN YXJjenlrb3dza2ktR8OzcmVja2kgd3JvdGU6Cj4gPiA+ID4gY3VscHJpdDoKPiA+ID4gPgo+ID4g PiA+IGNvbW1pdCA5ZTIzNjljMDZjOGExODE0NzgwMzkyNThhNDU5OGMxZGRkMmNhZGZhCj4gPiA+ ID4gQXV0aG9yOiBSb2dlciBQYXUgTW9ubmUgPHJvZ2VyLnBhdUBjaXRyaXguY29tPgo+ID4gPiA+ IERhdGU6ICAgVHVlIFNlcCAxIDEwOjMzOjI2IDIwMjAgKzAyMDAKPiA+ID4gPgo+ID4gPiA+ICAg ICB4ZW46IGFkZCBoZWxwZXJzIHRvIGFsbG9jYXRlIHVucG9wdWxhdGVkIG1lbW9yeQo+ID4gPiA+ Cj4gPiA+ID4gSSdtIGFkZGluZyByZWxldmFudCBwZW9wbGUgYW5kIHhlbi1kZXZlbCB0byB0aGUg dGhyZWFkLgo+ID4gPiA+IEZvciBjb21wbGV0ZW5lc3MsIGhlcmUgaXMgdGhlIG9yaWdpbmFsIGNy YXNoIG1lc3NhZ2U6Cj4gPiA+Cj4gPiA+IFRoYXQgY29tbWl0IGRlZmluaXRpdmVseSBhZGRzIGEg bmV3IFpPTkVfREVWSUNFIHVzZXIsIHNvIGl0IGRvZXMgbG9vawo+ID4gPiByZWxhdGVkLiAgQnV0 IHlvdSBhcmUgbm90IHJ1bm5pbmcgb24gWGVuLCBhcmUgeW91Pwo+ID4KPiA+IEkgYW0uIEl0IGlz IFhlbiBkb20wLgo+Cj4gSSdtIGFmcmFpZCBJJ20gb24gbGVhdmUgYW5kIHdvbid0IGJlIGFibGUg dG8gbG9vayBpbnRvIHRoaXMgdW50aWwgdGhlCj4gYmVnaW5uaW5nIG9mIEphbnVhcnkuIEkgd291 bGQgZ3Vlc3MgaXQncyBzb21lIGtpbmQgb2YgYmFkCj4gaW50ZXJhY3Rpb24gYmV0d2VlbiBibGti YWNrIGFuZCBOVk1lIGRyaXZlcnMgYm90aCB1c2luZyBaT05FX0RFVklDRT8KPgo+IE1heWJlIHRo ZSBiZXN0IGlzIHRvIHJldmVydCB0aGlzIGNoYW5nZSBhbmQgSSB3aWxsIGxvb2sgaW50byBpdCB3 aGVuCj4gSSBnZXQgYmFjaywgdW5sZXNzIHNvbWVvbmUgaXMgd2lsbGluZyB0byBkZWJ1ZyB0aGlz IGZ1cnRoZXIuCgpMb29raW5nIGF0IGNvbW1pdCA5ZTIzNjljMDZjOGEgYW5kIHhlbi1ibGtiYWNr IHB1dF9mcmVlX3BhZ2VzKCkgLCB0aGV5CmJvdGggdXNlIHBhZ2UtPmxydSB3aGljaCBpcyBwYXJ0 IG9mIHRoZSBhbm9ueW1vdXMgdW5pb24gc2hhcmVkIHdpdGgKKnBnbWFwLiAgVGhhdCBtYXRjaGVz IE1hcmVrJ3Mgc3VzcGljaW9uIHRoYXQgdGhlIFpPTkVfREVWSUNFIG1lbW9yeSBpcwpiZWluZyB1 c2VkIGFzIFpPTkVfTk9STUFMLgoKbWVtbWFwX2luaXRfem9uZV9kZXZpY2UoKSBzYXlzOgoqIFpP TkVfREVWSUNFIHBhZ2VzIHVuaW9uIC0+bHJ1IHdpdGggYSAtPnBnbWFwIGJhY2sgcG9pbnRlcgoq IGFuZCB6b25lX2RldmljZV9kYXRhLiAgSXQgaXMgYSBidWcgaWYgYSBaT05FX0RFVklDRSBwYWdl IGlzCiogZXZlciBmcmVlZCBvciBwbGFjZWQgb24gYSBkcml2ZXItcHJpdmF0ZSBsaXN0LgoKUmVn YXJkcywKSmFzb24KCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fCkxpbnV4LW52bWUgbWFpbGluZyBsaXN0CkxpbnV4LW52bWVAbGlzdHMuaW5mcmFkZWFkLm9y ZwpodHRwOi8vbGlzdHMuaW5mcmFkZWFkLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2xpbnV4LW52bWUK From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.7 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 8D883C433FE for ; Sun, 6 Dec 2020 16:48:06 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 417DC2312F for ; Sun, 6 Dec 2020 16:48:06 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 417DC2312F Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.45705.81119 (Exim 4.92) (envelope-from ) id 1klxCN-0001jE-0x; Sun, 06 Dec 2020 16:47:47 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 45705.81119; Sun, 06 Dec 2020 16:47:46 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1klxCM-0001j7-TE; Sun, 06 Dec 2020 16:47:46 +0000 Received: by outflank-mailman (input) for mailman id 45705; Sun, 06 Dec 2020 16:47:46 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1klxCL-0001j2-TS for xen-devel@lists.xenproject.org; Sun, 06 Dec 2020 16:47:46 +0000 Received: from mail-lf1-x12a.google.com (unknown [2a00:1450:4864:20::12a]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id a62cf928-3956-4ded-9bbf-f5dcc643e8d3; Sun, 06 Dec 2020 16:47:44 +0000 (UTC) Received: by mail-lf1-x12a.google.com with SMTP id a9so14587019lfh.2 for ; Sun, 06 Dec 2020 08:47:44 -0800 (PST) X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" X-Inumbo-ID: a62cf928-3956-4ded-9bbf-f5dcc643e8d3 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=RW0lDqSJK11o5Hdo0ZTtiX38zMds7s0ivaE30jYDc08=; b=fyWAecBmSWqbeKTDqjVW+CVkNXAQmZ410oGJ+xz0B3svfmdqi9ApYJY14RYlLULq1X NQfKYWKNfPcKgC+hJNLBviDdi4gBw6UW0zBYYEzqUyiPbgT5G5L/KO8GooMOlf8fcq8V t75RXhiKmf+bn3sH0AYBYtKLi3q2jhRa/RQpy5AYfan7yvFFFKQqrH8wwvd+Vy6atRaf is1yTY0QYFtQXGVSI7EWg9vnv6exSx3VEEew5PE68sbe+WTEaviOQmbo8QaJLc2eaK7y HuNPjjSrWCxhDwki9gHeW6OEwhG/glGZEokkXpBsTQWHYr1m1cgxf2uOFGFRVK13vvp0 MUng== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=RW0lDqSJK11o5Hdo0ZTtiX38zMds7s0ivaE30jYDc08=; b=oCBAb40Vg6Lso/3nZnkEd7H5YaphMpcf+FZnD6ckqIILQagHXZYQy7kQJlmzz+5CLw HRrmBsSjujznmjPT5ekERYELabykL0V4aBoxQeNVyht5hJSHS5GrT4Cl7UYpBuLXsZ9R rojK621JOOmdK5U4BxqGCHR3LylqLqGMSvWW2nEUH67FDOO7k7WwKKByZk/uu2LYR4nL H583png105YXMZrcXUABStk5r6OGHB8hZBkBYFeLHla/9ii0C0RUM+RaXVth8FweeXoK Zd3Pe57Af/WXkamXcWJEwoblCmo5AwsKasV/cV57RxnOwO1U/FPM3zur+lTWhQcT4FzO j7CQ== X-Gm-Message-State: AOAM531NSt81PWouUv1LuTZoR52Wy1+ld7WOgLQ14eT/B9TOAUAolV5M XwlQTyIyZZsOSt+kWQm1xLIpj55z4Pye6Wyvxkc= X-Google-Smtp-Source: ABdhPJw9vQiBpQRjhN/8CX+xAjLRplV+JVJIeCtYqBQQJnmgOmlExZLWBZV8I1M5wikJWFGCCY4w8C0bQqI+B6jfbXY= X-Received: by 2002:a19:3c5:: with SMTP id 188mr6378736lfd.202.1607273263606; Sun, 06 Dec 2020 08:47:43 -0800 (PST) MIME-Version: 1.0 References: <20201129035639.GW2532@mail-itl> <20201130164010.GA23494@redsun51.ssa.fujisawa.hgst.com> <20201202000642.GJ201140@mail-itl> <20201204110847.GU201140@mail-itl> <20201204120803.GA20727@lst.de> <20201204122054.GV201140@mail-itl> <20201205082839.ts3ju6yta46cgwjn@Air-de-Roger> In-Reply-To: <20201205082839.ts3ju6yta46cgwjn@Air-de-Roger> From: Jason Andryuk Date: Sun, 6 Dec 2020 11:47:32 -0500 Message-ID: Subject: Re: GPF on 0xdead000000000100 in nvme_map_data - Linux 5.9.9 To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Cc: =?UTF-8?Q?Marek_Marczykowski=2DG=C3=B3recki?= , Christoph Hellwig , Juergen Gross , xen-devel , Keith Busch , Jens Axboe , Sagi Grimberg , linux-nvme@lists.infradead.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sat, Dec 5, 2020 at 3:29 AM Roger Pau Monn=C3=A9 = wrote: > > On Fri, Dec 04, 2020 at 01:20:54PM +0100, Marek Marczykowski-G=C3=B3recki= wrote: > > On Fri, Dec 04, 2020 at 01:08:03PM +0100, Christoph Hellwig wrote: > > > On Fri, Dec 04, 2020 at 12:08:47PM +0100, Marek Marczykowski-G=C3=B3r= ecki wrote: > > > > culprit: > > > > > > > > commit 9e2369c06c8a181478039258a4598c1ddd2cadfa > > > > Author: Roger Pau Monne > > > > Date: Tue Sep 1 10:33:26 2020 +0200 > > > > > > > > xen: add helpers to allocate unpopulated memory > > > > > > > > I'm adding relevant people and xen-devel to the thread. > > > > For completeness, here is the original crash message: > > > > > > That commit definitively adds a new ZONE_DEVICE user, so it does look > > > related. But you are not running on Xen, are you? > > > > I am. It is Xen dom0. > > I'm afraid I'm on leave and won't be able to look into this until the > beginning of January. I would guess it's some kind of bad > interaction between blkback and NVMe drivers both using ZONE_DEVICE? > > Maybe the best is to revert this change and I will look into it when > I get back, unless someone is willing to debug this further. Looking at commit 9e2369c06c8a and xen-blkback put_free_pages() , they both use page->lru which is part of the anonymous union shared with *pgmap. That matches Marek's suspicion that the ZONE_DEVICE memory is being used as ZONE_NORMAL. memmap_init_zone_device() says: * ZONE_DEVICE pages union ->lru with a ->pgmap back pointer * and zone_device_data. It is a bug if a ZONE_DEVICE page is * ever freed or placed on a driver-private list. Regards, Jason