From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-15.2 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,UNPARSEABLE_RELAY,USER_AGENT_SANE_1 autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7C928C4338F for ; Wed, 18 Aug 2021 22:29:55 +0000 (UTC) Received: from lists.ozlabs.org (lists.ozlabs.org [112.213.38.117]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 3D15D6108D for ; Wed, 18 Aug 2021 22:29:54 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 3D15D6108D Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=linux.alibaba.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=lists.ozlabs.org Received: from boromir.ozlabs.org (localhost [IPv6:::1]) by lists.ozlabs.org (Postfix) with ESMTP id 4GqjJJ5Yg0z307T for ; Thu, 19 Aug 2021 08:29:52 +1000 (AEST) Authentication-Results: lists.ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=linux.alibaba.com (client-ip=115.124.30.44; helo=out30-44.freemail.mail.aliyun.com; envelope-from=bo.liu@linux.alibaba.com; receiver=) X-Greylist: delayed 70 seconds by postgrey-1.36 at boromir; Thu, 19 Aug 2021 08:29:45 AEST Received: from out30-44.freemail.mail.aliyun.com (out30-44.freemail.mail.aliyun.com [115.124.30.44]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.ozlabs.org (Postfix) with ESMTPS id 4GqjJ92rvDz2yXt for ; Thu, 19 Aug 2021 08:29:44 +1000 (AEST) X-Alimail-AntiSpam: AC=PASS; BC=-1|-1; BR=01201311R181e4; CH=green; DM=||false|; DS=||; FP=0|-1|-1|-1|0|-1|-1|-1; HT=alimailimapcm10staff010182156082; MF=bo.liu@linux.alibaba.com; NM=1; PH=DS; RN=8; SR=0; TI=SMTPD_---0UjqEgEW_1629325768; Received: from rsjd01523.et2sqa(mailfrom:bo.liu@linux.alibaba.com fp:SMTPD_---0UjqEgEW_1629325768) by smtp.aliyun-inc.com(127.0.0.1); Thu, 19 Aug 2021 06:29:28 +0800 Date: Thu, 19 Aug 2021 06:29:28 +0800 From: Liu Bo To: Gao Xiang Subject: Re: [PATCH 2/2] erofs: support reading chunk-based uncompressed files Message-ID: <20210818222928.GB73193@rsjd01523.et2sqa> References: <20210818070713.4437-1-hsiangkao@linux.alibaba.com> <20210818070713.4437-2-hsiangkao@linux.alibaba.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210818070713.4437-2-hsiangkao@linux.alibaba.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-BeenThere: linux-erofs@lists.ozlabs.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Linux EROFS file system List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: bo.liu@linux.alibaba.com Cc: LKML , Peng Tao , Joseph Qi , Eryu Guan , Liu Jiang , linux-erofs@lists.ozlabs.org Errors-To: linux-erofs-bounces+linux-erofs=archiver.kernel.org@lists.ozlabs.org Sender: "Linux-erofs" On Wed, Aug 18, 2021 at 03:07:13PM +0800, Gao Xiang wrote: > Add runtime support for chunk-based uncompressed files > described in the previous patch. > Reviewed-by: Liu Bo thanks, liubo > Signed-off-by: Gao Xiang > --- > fs/erofs/data.c | 90 ++++++++++++++++++++++++++++++++++++++++----- > fs/erofs/inode.c | 18 ++++++++- > fs/erofs/internal.h | 5 +++ > 3 files changed, 102 insertions(+), 11 deletions(-) > > diff --git a/fs/erofs/data.c b/fs/erofs/data.c > index b2a22aabc9bc..78d625709481 100644 > --- a/fs/erofs/data.c > +++ b/fs/erofs/data.c > @@ -2,6 +2,7 @@ > /* > * Copyright (C) 2017-2018 HUAWEI, Inc. > * https://www.huawei.com/ > + * Copyright (C) 2021, Alibaba Cloud > */ > #include "internal.h" > #include > @@ -37,13 +38,6 @@ static int erofs_map_blocks_flatmode(struct inode *inode, > nblocks = DIV_ROUND_UP(inode->i_size, PAGE_SIZE); > lastblk = nblocks - tailendpacking; > > - if (offset >= inode->i_size) { > - /* leave out-of-bound access unmapped */ > - map->m_flags = 0; > - map->m_plen = 0; > - goto out; > - } > - > /* there is no hole in flatmode */ > map->m_flags = EROFS_MAP_MAPPED; > > @@ -78,14 +72,90 @@ static int erofs_map_blocks_flatmode(struct inode *inode, > goto err_out; > } > > -out: > map->m_llen = map->m_plen; > - > err_out: > trace_erofs_map_blocks_flatmode_exit(inode, map, flags, 0); > return err; > } > > +static int erofs_map_blocks(struct inode *inode, > + struct erofs_map_blocks *map, int flags) > +{ > + struct super_block *sb = inode->i_sb; > + struct erofs_inode *vi = EROFS_I(inode); > + struct erofs_inode_chunk_index *idx; > + struct page *page; > + u64 chunknr; > + unsigned int unit; > + erofs_off_t pos; > + int err = 0; > + > + if (map->m_la >= inode->i_size) { > + /* leave out-of-bound access unmapped */ > + map->m_flags = 0; > + map->m_plen = 0; > + goto out; > + } > + > + if (vi->datalayout != EROFS_INODE_CHUNK_BASED) > + return erofs_map_blocks_flatmode(inode, map, flags); > + > + if (vi->chunkformat & EROFS_CHUNK_FORMAT_INDEXES) > + unit = sizeof(*idx); /* chunk index */ > + else > + unit = 4; /* block map */ > + > + chunknr = map->m_la >> vi->chunkbits; > + pos = ALIGN(iloc(EROFS_SB(sb), vi->nid) + vi->inode_isize + > + vi->xattr_isize, unit) + unit * chunknr; > + > + page = erofs_get_meta_page(inode->i_sb, erofs_blknr(pos)); > + if (IS_ERR(page)) > + return PTR_ERR(page); > + > + map->m_la = chunknr << vi->chunkbits; > + map->m_plen = min_t(erofs_off_t, 1UL << vi->chunkbits, > + roundup(inode->i_size - map->m_la, EROFS_BLKSIZ)); > + > + /* handle block map */ > + if (!(vi->chunkformat & EROFS_CHUNK_FORMAT_INDEXES)) { > + __le32 *blkaddr = page_address(page) + erofs_blkoff(pos); > + > + if (le32_to_cpu(*blkaddr) == EROFS_NULL_ADDR) { > + map->m_flags = 0; > + } else { > + map->m_pa = blknr_to_addr(le32_to_cpu(*blkaddr)); > + map->m_flags = EROFS_MAP_MAPPED; > + } > + goto out_unlock; > + } > + /* parse chunk indexes */ > + idx = page_address(page) + erofs_blkoff(pos); > + switch (le32_to_cpu(idx->blkaddr)) { > + case EROFS_NULL_ADDR: > + map->m_flags = 0; > + break; > + default: > + /* only one device is supported for now */ > + if (idx->device_id) { > + erofs_err(sb, "invalid device id %u @ %llu for nid %llu", > + le32_to_cpu(idx->device_id), > + chunknr, vi->nid); > + err = -EFSCORRUPTED; > + goto out_unlock; > + } > + map->m_pa = blknr_to_addr(le32_to_cpu(idx->blkaddr)); > + map->m_flags = EROFS_MAP_MAPPED; > + break; > + } > +out_unlock: > + unlock_page(page); > + put_page(page); > +out: > + map->m_llen = map->m_plen; > + return err; > +} > + > static int erofs_iomap_begin(struct inode *inode, loff_t offset, loff_t length, > unsigned int flags, struct iomap *iomap, struct iomap *srcmap) > { > @@ -95,7 +165,7 @@ static int erofs_iomap_begin(struct inode *inode, loff_t offset, loff_t length, > map.m_la = offset; > map.m_llen = length; > > - ret = erofs_map_blocks_flatmode(inode, &map, EROFS_GET_BLOCKS_RAW); > + ret = erofs_map_blocks(inode, &map, EROFS_GET_BLOCKS_RAW); > if (ret < 0) > return ret; > > diff --git a/fs/erofs/inode.c b/fs/erofs/inode.c > index 92728da1d206..036a6cc97d10 100644 > --- a/fs/erofs/inode.c > +++ b/fs/erofs/inode.c > @@ -2,6 +2,7 @@ > /* > * Copyright (C) 2017-2018 HUAWEI, Inc. > * https://www.huawei.com/ > + * Copyright (C) 2021, Alibaba Cloud > */ > #include "xattr.h" > > @@ -122,7 +123,9 @@ static struct page *erofs_read_inode(struct inode *inode, > /* total blocks for compressed files */ > if (erofs_inode_is_data_compressed(vi->datalayout)) > nblks = le32_to_cpu(die->i_u.compressed_blocks); > - > + else if (vi->datalayout == EROFS_INODE_CHUNK_BASED) > + /* fill chunked inode summary info */ > + vi->chunkformat = __le16_to_cpu(die->i_u.c.format); > kfree(copied); > break; > case EROFS_INODE_LAYOUT_COMPACT: > @@ -160,6 +163,8 @@ static struct page *erofs_read_inode(struct inode *inode, > inode->i_size = le32_to_cpu(dic->i_size); > if (erofs_inode_is_data_compressed(vi->datalayout)) > nblks = le32_to_cpu(dic->i_u.compressed_blocks); > + else if (vi->datalayout == EROFS_INODE_CHUNK_BASED) > + vi->chunkformat = __le16_to_cpu(dic->i_u.c.format); > break; > default: > erofs_err(inode->i_sb, > @@ -169,6 +174,17 @@ static struct page *erofs_read_inode(struct inode *inode, > goto err_out; > } > > + if (vi->datalayout == EROFS_INODE_CHUNK_BASED) { > + if (!(vi->chunkformat & EROFS_CHUNK_FORMAT_ALL)) { > + erofs_err(inode->i_sb, > + "unsupported chunk format %x of nid %llu", > + vi->chunkformat, vi->nid); > + err = -EOPNOTSUPP; > + goto err_out; > + } > + vi->chunkbits = LOG_BLOCK_SIZE + > + (vi->chunkformat & EROFS_CHUNK_FORMAT_BLKBITS_MASK); > + } > inode->i_mtime.tv_sec = inode->i_ctime.tv_sec; > inode->i_atime.tv_sec = inode->i_ctime.tv_sec; > inode->i_mtime.tv_nsec = inode->i_ctime.tv_nsec; > diff --git a/fs/erofs/internal.h b/fs/erofs/internal.h > index 25b094085ca6..0a46e149aadd 100644 > --- a/fs/erofs/internal.h > +++ b/fs/erofs/internal.h > @@ -2,6 +2,7 @@ > /* > * Copyright (C) 2017-2018 HUAWEI, Inc. > * https://www.huawei.com/ > + * Copyright (C) 2021, Alibaba Cloud > */ > #ifndef __EROFS_INTERNAL_H > #define __EROFS_INTERNAL_H > @@ -260,6 +261,10 @@ struct erofs_inode { > > union { > erofs_blk_t raw_blkaddr; > + struct { > + unsigned short chunkformat; > + unsigned char chunkbits; > + }; > #ifdef CONFIG_EROFS_FS_ZIP > struct { > unsigned short z_advise; > -- > 2.24.4