From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.3 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2EC95C3526C for ; Sat, 19 Dec 2020 06:10:55 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id E836223B19 for ; Sat, 19 Dec 2020 06:10:54 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726398AbgLSGKp (ORCPT ); Sat, 19 Dec 2020 01:10:45 -0500 Received: from hqnvemgate25.nvidia.com ([216.228.121.64]:7482 "EHLO hqnvemgate25.nvidia.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726369AbgLSGKo (ORCPT ); Sat, 19 Dec 2020 01:10:44 -0500 Received: from hqmail.nvidia.com (Not Verified[216.228.121.13]) by hqnvemgate25.nvidia.com (using TLS: TLSv1.2, AES256-SHA) id ; Fri, 18 Dec 2020 22:10:02 -0800 Received: from [10.2.61.104] (172.20.145.6) by HQMAIL107.nvidia.com (172.20.187.13) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Sat, 19 Dec 2020 06:10:01 +0000 Subject: Re: set_page_dirty vs truncate To: Matthew Wilcox , CC: Dominique Martinet , , Steve French , , Miklos Szeredi , Jeff Dike , Richard Weinberger , , Dave Kleikamp , , Trond Myklebust , Anna Schumaker , , Anton Altaparmakov , , Mike Marshall , Martin Brandenburg , , Hans de Goede References: <20201218160531.GL15600@casper.infradead.org> <20201218220316.GO15600@casper.infradead.org> <20201219051852.GP15600@casper.infradead.org> From: John Hubbard Message-ID: <7a7c3052-74c7-c63b-5fe3-65d692c1c5d1@nvidia.com> Date: Fri, 18 Dec 2020 22:10:01 -0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:84.0) Gecko/20100101 Thunderbird/84.0 MIME-Version: 1.0 In-Reply-To: <20201219051852.GP15600@casper.infradead.org> Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Originating-IP: [172.20.145.6] X-ClientProxiedBy: HQMAIL105.nvidia.com (172.20.187.12) To HQMAIL107.nvidia.com (172.20.187.13) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nvidia.com; s=n1; t=1608358202; bh=YT+YKnInmeemv6e/Fp+/gLXE931wQw0pvJP24SiD55g=; h=Subject:To:CC:References:From:Message-ID:Date:User-Agent: MIME-Version:In-Reply-To:Content-Type:Content-Language: Content-Transfer-Encoding:X-Originating-IP:X-ClientProxiedBy; b=IqDV2bngOTzJ/heB1F6Qspmm1JbzkTQy88O9dFw+Pf27ufqeuc9LQ8mZElUt9hQtj Ah68MFRwp1uCNUjqybWF9EWTRYfx2pNNWmYFz2Kvh5ML3fnzTRJsciuZLagOUSPz65 bmmPasdRMZqsr0ATRiFyqT2ZIeD12CBxMn2dRv8C/oLYNM2pCCxRxQBSvb/SkMMLKd tNLq1N3a3YiMn3e/eWddN6DsA1QFd25JWKXx3beuHd7aKQfFKzM6y3dUqYvKj0FuSy cFeDD8k756mBh2pV3PXdwrEou9373IjgY9ApO4tI1EiLCg727obyz1ZmWQYeIZWg37 tDFFU2R7AMF8A== Precedence: bulk List-ID: X-Mailing-List: linux-cifs@vger.kernel.org On 12/18/20 9:18 PM, Matthew Wilcox wrote: > On Fri, Dec 18, 2020 at 10:03:16PM +0000, Matthew Wilcox wrote: >> On Fri, Dec 18, 2020 at 04:05:31PM +0000, Matthew Wilcox wrote: >>> A number of implementations of ->set_page_dirty check whether the page >>> has been truncated (ie page->mapping has become NULL since entering >>> set_page_dirty()). Several other implementations assume that they can do >>> page->mapping->host to get to the inode. So either some implementations >>> are doing unnecessary checks or others are vulnerable to a NULL pointer >>> dereference if truncate() races with set_page_dirty(). >>> >>> I'm touching ->set_page_dirty() anyway as part of the page folio >>> conversion. I'm thinking about passing in the mapping so there's no >>> need to look at page->mapping. >>> >>> The comments on set_page_dirty() and set_page_dirty_lock() suggests >>> there's no consistency in whether truncation is blocked or not; we're >>> only guaranteed that the inode itself won't go away. But maybe the >>> comments are stale. >> >> The comments are, I believe, not stale. Here's some syzbot >> reports which indicate that ext4 is seeing races between set_page_dirty() >> and truncate(): >> >> https://groups.google.com/g/syzkaller-lts-bugs/c/s9fHu162zhQ/m/Phnf6ucaAwAJ >> >> The reproducer includes calls to ftruncate(), so that would suggest >> that's what's going on. > > Hmmm ... looks like __set_page_dirty_nobuffers() has a similar problem: > > { > lock_page_memcg(page); > if (!TestSetPageDirty(page)) { > struct address_space *mapping = page_mapping(page); > unsigned long flags; > > if (!mapping) { > unlock_page_memcg(page); > return 1; > } > > xa_lock_irqsave(&mapping->i_pages, flags); > BUG_ON(page_mapping(page) != mapping); > > sure, we check that the page wasn't truncated between set_page_dirty() > and the call to TestSetPageDirty(), but we can truncate dirty pages > with no problem. So between the call to TestSetPageDirty() and > the call to xa_lock_irqsave(), the page can be truncated, and the > BUG_ON should fire. > > I haven't been able to find any examples of this, but maybe it's just a very > narrow race. Does anyone recognise this signature? Adding the filesystems > which use __set_page_dirty_nobuffers() directly without extra locking. That sounds like the same *kind* of failure that Jan Kara and I were seeing on live systems[1], that led eventually to the gup-to-pup conversion exercise. That crash happened due to calling set_page_dirty() on pages that had no buffers on them [2]. And that sounds like *exactly* the same thing as calling __set_page_dirty_nobuffers() without extra locking. So I'd expect that it's Just Wrong To Do, for the same reasons as Jan spells out very clearly in [1]. Hope that helps. [1] https://www.spinics.net/lists/linux-mm/msg142700.html [2] which triggered this assertion: #define page_buffers(page) \ ({ \ BUG_ON(!PagePrivate(page)); \ ((struct buffer_head *)page_private(page)); \ }) > > $ git grep set_page_dirty.*=.*__set_page_dirty_nobuffers > fs/9p/vfs_addr.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/cifs/file.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/cifs/file.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/fuse/file.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/hostfs/hostfs_kern.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/jfs/jfs_metapage.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/nfs/file.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/ntfs/aops.c: .set_page_dirty = __set_page_dirty_nobuffers, /* Set the page dirty > fs/orangefs/inode.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/vboxsf/file.c: .set_page_dirty = __set_page_dirty_nobuffers, > ...wow, long list of these. thanks, -- John Hubbard NVIDIA From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from hqnvemgate25.nvidia.com ([216.228.121.64]) by merlin.infradead.org with esmtps (Exim 4.92.3 #3 (Red Hat Linux)) id 1kqVRM-0002b8-U0 for linux-um@lists.infradead.org; Sat, 19 Dec 2020 06:10:06 +0000 Subject: Re: set_page_dirty vs truncate References: <20201218160531.GL15600@casper.infradead.org> <20201218220316.GO15600@casper.infradead.org> <20201219051852.GP15600@casper.infradead.org> From: John Hubbard Message-ID: <7a7c3052-74c7-c63b-5fe3-65d692c1c5d1@nvidia.com> Date: Fri, 18 Dec 2020 22:10:01 -0800 MIME-Version: 1.0 In-Reply-To: <20201219051852.GP15600@casper.infradead.org> Content-Language: en-US List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: "linux-um" Errors-To: linux-um-bounces+geert=linux-m68k.org@lists.infradead.org To: Matthew Wilcox , linux-fsdevel@vger.kernel.org Cc: Martin Brandenburg , linux-cifs@vger.kernel.org, jfs-discussion@lists.sourceforge.net, Miklos Szeredi , Dave Kleikamp , Richard Weinberger , Dominique Martinet , linux-um@lists.infradead.org, linux-nfs@vger.kernel.org, Trond Myklebust , Steve French , linux-ntfs-dev@lists.sourceforge.net, Hans de Goede , devel@lists.orangefs.org, Anna Schumaker , v9fs-developer@lists.sourceforge.net, Jeff Dike , Anton Altaparmakov , Mike Marshall On 12/18/20 9:18 PM, Matthew Wilcox wrote: > On Fri, Dec 18, 2020 at 10:03:16PM +0000, Matthew Wilcox wrote: >> On Fri, Dec 18, 2020 at 04:05:31PM +0000, Matthew Wilcox wrote: >>> A number of implementations of ->set_page_dirty check whether the page >>> has been truncated (ie page->mapping has become NULL since entering >>> set_page_dirty()). Several other implementations assume that they can do >>> page->mapping->host to get to the inode. So either some implementations >>> are doing unnecessary checks or others are vulnerable to a NULL pointer >>> dereference if truncate() races with set_page_dirty(). >>> >>> I'm touching ->set_page_dirty() anyway as part of the page folio >>> conversion. I'm thinking about passing in the mapping so there's no >>> need to look at page->mapping. >>> >>> The comments on set_page_dirty() and set_page_dirty_lock() suggests >>> there's no consistency in whether truncation is blocked or not; we're >>> only guaranteed that the inode itself won't go away. But maybe the >>> comments are stale. >> >> The comments are, I believe, not stale. Here's some syzbot >> reports which indicate that ext4 is seeing races between set_page_dirty() >> and truncate(): >> >> https://groups.google.com/g/syzkaller-lts-bugs/c/s9fHu162zhQ/m/Phnf6ucaAwAJ >> >> The reproducer includes calls to ftruncate(), so that would suggest >> that's what's going on. > > Hmmm ... looks like __set_page_dirty_nobuffers() has a similar problem: > > { > lock_page_memcg(page); > if (!TestSetPageDirty(page)) { > struct address_space *mapping = page_mapping(page); > unsigned long flags; > > if (!mapping) { > unlock_page_memcg(page); > return 1; > } > > xa_lock_irqsave(&mapping->i_pages, flags); > BUG_ON(page_mapping(page) != mapping); > > sure, we check that the page wasn't truncated between set_page_dirty() > and the call to TestSetPageDirty(), but we can truncate dirty pages > with no problem. So between the call to TestSetPageDirty() and > the call to xa_lock_irqsave(), the page can be truncated, and the > BUG_ON should fire. > > I haven't been able to find any examples of this, but maybe it's just a very > narrow race. Does anyone recognise this signature? Adding the filesystems > which use __set_page_dirty_nobuffers() directly without extra locking. That sounds like the same *kind* of failure that Jan Kara and I were seeing on live systems[1], that led eventually to the gup-to-pup conversion exercise. That crash happened due to calling set_page_dirty() on pages that had no buffers on them [2]. And that sounds like *exactly* the same thing as calling __set_page_dirty_nobuffers() without extra locking. So I'd expect that it's Just Wrong To Do, for the same reasons as Jan spells out very clearly in [1]. Hope that helps. [1] https://www.spinics.net/lists/linux-mm/msg142700.html [2] which triggered this assertion: #define page_buffers(page) \ ({ \ BUG_ON(!PagePrivate(page)); \ ((struct buffer_head *)page_private(page)); \ }) > > $ git grep set_page_dirty.*=.*__set_page_dirty_nobuffers > fs/9p/vfs_addr.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/cifs/file.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/cifs/file.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/fuse/file.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/hostfs/hostfs_kern.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/jfs/jfs_metapage.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/nfs/file.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/ntfs/aops.c: .set_page_dirty = __set_page_dirty_nobuffers, /* Set the page dirty > fs/orangefs/inode.c: .set_page_dirty = __set_page_dirty_nobuffers, > fs/vboxsf/file.c: .set_page_dirty = __set_page_dirty_nobuffers, > ...wow, long list of these. thanks, -- John Hubbard NVIDIA _______________________________________________ linux-um mailing list linux-um@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-um