From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.6 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 43694C4338F for ; Sat, 24 Jul 2021 14:04:29 +0000 (UTC) Received: from lists.ozlabs.org (lists.ozlabs.org [112.213.38.117]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 40ADB60E97 for ; Sat, 24 Jul 2021 14:04:27 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 40ADB60E97 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=infradead.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=lists.ozlabs.org Received: from boromir.ozlabs.org (localhost [IPv6:::1]) by lists.ozlabs.org (Postfix) with ESMTP id 4GX7Gd6f3pz30Ds for ; Sun, 25 Jul 2021 00:04:25 +1000 (AEST) Authentication-Results: lists.ozlabs.org; dkim=fail reason="signature verification failed" (2048-bit key; secure) header.d=infradead.org header.i=@infradead.org header.a=rsa-sha256 header.s=casper.20170209 header.b=WIpb+PRS; dkim-atps=neutral Authentication-Results: lists.ozlabs.org; spf=none (no SPF record) smtp.mailfrom=infradead.org (client-ip=2001:8b0:10b:1236::1; helo=casper.infradead.org; envelope-from=willy@infradead.org; receiver=) Authentication-Results: lists.ozlabs.org; dkim=pass (2048-bit key; secure) header.d=infradead.org header.i=@infradead.org header.a=rsa-sha256 header.s=casper.20170209 header.b=WIpb+PRS; dkim-atps=neutral Received: from casper.infradead.org (casper.infradead.org [IPv6:2001:8b0:10b:1236::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.ozlabs.org (Postfix) with ESMTPS id 4GX7GT5vYBz2xZR for ; Sun, 25 Jul 2021 00:04:15 +1000 (AEST) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=casper.20170209; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:To:From:Date:Sender:Reply-To:Cc: Content-Transfer-Encoding:Content-ID:Content-Description; bh=+0vnqmJKm+6zv+bJtJfE9x8n4Meokw7C35dQw9EyAok=; b=WIpb+PRSlE3BXqWYcFEoGrmpTG Hpi0pvtLmGmLaLioslauth8jcLyT/S1dKvt3vVG01R3bB+qmpdP4HYZWXr//7fqfKfH8kaMgEKRmY lIpJ9IXyzIvw4E2Ad09rKYFIKe38v9OpRpsijg6PXISO2/gu4UWii/yRstx/urDEHWjgu9zwbeNpn szvxCyuSEp0JTGg9SLfC7jDbj5KyMw0EWyRGSdCdthljOKj4dvQDDPFLYoB1SxXXMZaQHEfcneR1e fNA5Lh2xMIZ4CCNqV++fvxJMTcdaYRgml7WsCtzzI80CY/HdoHYa8hKLDyHpJL3Qn053A0UgPOZWn Q/JASxbA==; Received: from willy by casper.infradead.org with local (Exim 4.94.2 #2 (Red Hat Linux)) id 1m7IFw-00CJFp-NN; Sat, 24 Jul 2021 14:04:03 +0000 Date: Sat, 24 Jul 2021 15:03:56 +0100 From: Matthew Wilcox To: linux-fsdevel@vger.kernel.org, linux-erofs@lists.ozlabs.org, linux-xfs@vger.kernel.org Subject: Re: [PATCH 2/2] iomap: Support inline data with block size < page size Message-ID: References: <20210724034435.2854295-1-willy@infradead.org> <20210724034435.2854295-3-willy@infradead.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-BeenThere: linux-erofs@lists.ozlabs.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Linux EROFS file system List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: linux-erofs-bounces+linux-erofs=archiver.kernel.org@lists.ozlabs.org Sender: "Linux-erofs" On Sat, Jul 24, 2021 at 12:46:45PM +0800, Gao Xiang wrote: > Hi Matthew, > > On Sat, Jul 24, 2021 at 04:44:35AM +0100, Matthew Wilcox (Oracle) wrote: > > Remove the restriction that inline data must start on a page boundary > > in a file. This allows, for example, the first 2KiB to be stored out > > of line and the trailing 30 bytes to be stored inline. > > > > Signed-off-by: Matthew Wilcox (Oracle) > > --- > > fs/iomap/buffered-io.c | 18 ++++++++---------- > > 1 file changed, 8 insertions(+), 10 deletions(-) > > > > diff --git a/fs/iomap/buffered-io.c b/fs/iomap/buffered-io.c > > index 7bd8e5de996d..d7d6af29af7f 100644 > > --- a/fs/iomap/buffered-io.c > > +++ b/fs/iomap/buffered-io.c > > @@ -209,25 +209,23 @@ static int iomap_read_inline_data(struct inode *inode, struct page *page, > > struct iomap *iomap, loff_t pos) > > { > > size_t size = iomap->length + iomap->offset - pos; > > + size_t poff = offset_in_page(pos); > > void *addr; > > > > if (PageUptodate(page)) > > - return PAGE_SIZE; > > + return PAGE_SIZE - poff; > > > > - /* inline data must start page aligned in the file */ > > - if (WARN_ON_ONCE(offset_in_page(pos))) > > - return -EIO; > > if (WARN_ON_ONCE(!iomap_inline_data_size_valid(iomap))) > > return -EIO; > > - if (WARN_ON_ONCE(page_has_private(page))) > > - return -EIO; > > + if (poff > 0) > > + iomap_page_create(inode, page); > > Thanks for the patch! > > Previously I'd like to skip the leading uptodate blocks and update the > extent it covers that is due to already exist iop. If we get rid of the > offset_in_page(pos) restriction like this, I'm not sure if we (or some > other fs users) could face something like below (due to somewhat buggy > fs users likewise): > > [0 - 4096) plain block > > [4096 - 4608) tail INLINE 1 (e.g. by mistake or just splitted > .iomap_begin() report.) > [4608 - 5120] tail INLINE 2 My assumption is that an INLINE extent is <= block_size. Otherwise the first part of the extent would be not-inline. So this would be a bug in the filesystem; [4096-4608) should not be an inline extent. > with this code iomap_set_range_uptodate() wouldn't behave correctly. > > In addition, currently EROFS cannot test such path (since EROFS is > page-sized block only for now) as Darrick said in the previous reply, > so I think it would be better together with the folio patchset and > targeted for the corresponding merge window, so I can test iomap > supported EROFS with the new folio support together (That also give > me some time to support sub-pagesized uncompressed blocks...) Do you want to test erofs with multi-page folios? That might be even more interesting than block size < page size. > > - addr = kmap_atomic(page); > > + addr = kmap_atomic(page) + poff; > > memcpy(addr, iomap_inline_buf(iomap, pos), size); > > - memset(addr + size, 0, PAGE_SIZE - size); > > + memset(addr + size, 0, PAGE_SIZE - poff - size); > > kunmap_atomic(addr); > > As my limited understanding, this may need to be fixed, since it > doesn't match kmap_atomic(page)... void kunmap_local_indexed(void *vaddr) { unsigned long addr = (unsigned long) vaddr & PAGE_MASK; so it's fine to unmap any address in the page.