From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2D4F6C433EF for ; Wed, 27 Oct 2021 11:51:48 +0000 (UTC) Received: from lists.ozlabs.org (lists.ozlabs.org [112.213.38.117]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id B6730610A0 for ; Wed, 27 Oct 2021 11:51:47 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org B6730610A0 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=linux.alibaba.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=lists.ozlabs.org Received: from boromir.ozlabs.org (localhost [IPv6:::1]) by lists.ozlabs.org (Postfix) with ESMTP id 4HfRqk39Rgz2yNC for ; Wed, 27 Oct 2021 22:51:46 +1100 (AEDT) Authentication-Results: lists.ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=linux.alibaba.com (client-ip=47.88.44.36; helo=out4436.biz.mail.alibaba.com; envelope-from=hsiangkao@linux.alibaba.com; receiver=) Received: from out4436.biz.mail.alibaba.com (out4436.biz.mail.alibaba.com [47.88.44.36]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.ozlabs.org (Postfix) with ESMTPS id 4HfRqZ10ryz2xrC for ; Wed, 27 Oct 2021 22:51:33 +1100 (AEDT) X-Alimail-AntiSpam: AC=PASS; BC=-1|-1; BR=01201311R731e4; CH=green; DM=||false|; DS=||; FP=0|-1|-1|-1|0|-1|-1|-1; HT=e01e01424; MF=hsiangkao@linux.alibaba.com; NM=1; PH=DS; RN=2; SR=0; TI=SMTPD_---0Utt49wT_1635335473; Received: from B-P7TQMD6M-0146.local(mailfrom:hsiangkao@linux.alibaba.com fp:SMTPD_---0Utt49wT_1635335473) by smtp.aliyun-inc.com(127.0.0.1); Wed, 27 Oct 2021 19:51:14 +0800 Date: Wed, 27 Oct 2021 19:51:13 +0800 From: Gao Xiang To: Todor Ivanov Subject: Re: Question about mkfs.erofs and reproducible builds Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: X-BeenThere: linux-erofs@lists.ozlabs.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Linux EROFS file system List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: linux-erofs@lists.ozlabs.org Errors-To: linux-erofs-bounces+linux-erofs=archiver.kernel.org@lists.ozlabs.org Sender: "Linux-erofs" On Wed, Oct 27, 2021 at 02:41:54PM +0300, Todor Ivanov wrote: > Hi, Gao, > > This is how I installed mkfs.erofs on debian10: > > apt-get install pkg-config liblz4-dev gawk > wget > http://ftp.debian.org/debian/pool/main/e/erofs-utils/erofs-utils_1.3.orig.tar.gz > tar xvzpf erofs-utils_1.3.orig.tar.gz > cd erofs-utils-1.3/ > ./autogen.sh > ./configure > make > make install > > Can you tell me where do I clone it from and if build instructions are > different? You could get the latest dev branch from: git://git.kernel.org/pub/scm/linux/kernel/git/xiang/erofs-utils.git -b dev We fixed some reproducable build issues recently, I think it might be related to https://git.kernel.org/pub/scm/linux/kernel/git/xiang/erofs-utils.git/commit/?id=6324fac820c28c6a946f595fa58a0abba0f48eb4 Thanks, Gao Xiang > > Kind regards, > Todor > > On Wed, Oct 27, 2021 at 2:27 PM Gao Xiang > wrote: > > > Hi Todor, > > > > On Wed, Oct 27, 2021 at 02:11:24PM +0300, Todor Ivanov wrote: > > > Hello, > > > > > > We are trying to replace squashfs with erofs and face an issue > > with > > > reproducing the build from one and the same source folder. The source > > > folder is "/etc" actually taken from an offline ubuntu 20.04 image and > > > mounted as read-only. > > > I managed to narrow down the scope and it turns out that the > > issue > > > is when you have a file starting with "." (dot) in this folder. I.e.: > > > > > > etc/.anyfilename > > > > > > If I remove this file the erofs image of "etc" is reproducible (-T and -U > > > are used as well) > > > > > > The issue is somehow related to the other 76 subfolders of etc and this > > > file starting with dot. For example if I create such .anyfilename in usr > > or > > > var, there is no issue. Also if I create this file under > > > etc/xdg/.anyfilename, this is fine as well. > > > I also tried with etc from debian10 and the result is the same. Removing > > > any file that starts with dot directly under etc, makes the erofs build > > > reproducible. > > > Do you have any advice on this? > > > > In principle filenames starting with '.' won't impact anything about > > reproducible builds... > > > > Let me investigate it now... But may I ask which erofs-utils version > > is used? Does it still happen on the latest dev branch? > > > > Thanks, > > Gao Xiang > > > > > > > > Regards, > > > Todor > >