From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.0 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_CR_TRAILER,INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6147CC43460 for ; Mon, 26 Apr 2021 15:07:11 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 2C98E600D1 for ; Mon, 26 Apr 2021 15:07:11 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233825AbhDZPHv (ORCPT ); Mon, 26 Apr 2021 11:07:51 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:23127 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233674AbhDZPHu (ORCPT ); Mon, 26 Apr 2021 11:07:50 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1619449628; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=t7im666vZmx7HZEuHKV4NP8gxPf2CM8wN4SkaGOXh/4=; b=aZ96bpC5ynpbIRw6dy1unDmLrWguoD0L7pNEvSf8sO9VJcKN34BiNwQ+aJccuGYu4Xa3aq /QxKNa1D14uaqmi9f2EyRYjJvEqTGxeEmBwz1ADmidKEmWbhpxe0HHvHudaSrsEC54cVIh 6Oxr/eKFQwblpi8JPnA7/6UN9MCHKjI= Received: from mail-wr1-f72.google.com (mail-wr1-f72.google.com [209.85.221.72]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-97-9UGcwVJ5P12OsHT8F4a7hg-1; Mon, 26 Apr 2021 11:07:06 -0400 X-MC-Unique: 9UGcwVJ5P12OsHT8F4a7hg-1 Received: by mail-wr1-f72.google.com with SMTP id h60-20020adf90420000b029010418c4cd0cso18298861wrh.12 for ; Mon, 26 Apr 2021 08:07:06 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=t7im666vZmx7HZEuHKV4NP8gxPf2CM8wN4SkaGOXh/4=; b=Srw4RUaj3y2nqSTzAOllx8eEB6L0WM+XXilx351DvRCAyJBWOVBErYo0yZw719ks9d Wy7EjQWjx1sDygZxzLfnV53R9K1FB47606Wz7MKxrEBrIfj5hw6Te8tddsB4Ypv8NZba TfQmLTkRasY4tilVZcVYc153L8SgcUM+oZEDu2bMmW3+JKfcqzQeS95NkpYojtYhwh/I 1PMFrdUJ/elR4f9zkI5LrMjOJfpCWYEc5y4lY534xtjT+yfYCt+JSHWuab+CkOOcw394 G+esyNiQRSbuPq4DzDdyyqJlDbdssvVeicXCCRNLIyxAHi6PzSvn7ilaqHQ/OcHkW2Pn 48Zw== X-Gm-Message-State: AOAM530JPsFe/JEOcZKfOSzxdtM7FSsgaJg9LKA+IOwl5lUHSAlnh7Wp PbqnZs6hh0PtpwuvVDLkptN9HUtHZmFTBed4SGhD8b+Goo9wmsmxsXxFTOtj/aW7k54p0xZeL8P JszTYNuyxUNUvVBGL7IN56F1Qc+/nS2GH9w== X-Received: by 2002:a5d:564b:: with SMTP id j11mr24247718wrw.307.1619449624988; Mon, 26 Apr 2021 08:07:04 -0700 (PDT) X-Google-Smtp-Source: ABdhPJz+N/gBycjtARfkMTeOWx9e7ya8AB5ea8ok4XnHa3NW3vTa+iNC0a768otGFhXkyAIBu7hkpRTZ7CuiUH1jPSo= X-Received: by 2002:a5d:564b:: with SMTP id j11mr24247683wrw.307.1619449624738; Mon, 26 Apr 2021 08:07:04 -0700 (PDT) MIME-Version: 1.0 References: <20210422153147.1049666-1-bxue@redhat.com> In-Reply-To: From: Boyang Xue Date: Mon, 26 Apr 2021 23:06:53 +0800 Message-ID: Subject: Re: [PATCH v2] generic/563: tolerate small reads in "write -> read/write" sub-test To: Brian Foster Cc: fstests@vger.kernel.org, Ming Lei , Lukas Czerner Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: fstests@vger.kernel.org Brian, Thanks for the review. You're right. This deviates from the purpose of the test, that, the original purpose of this patch is to ignore the noise, but this is more like monitoring the noise. And another point reminding me is this test is for all file systems, so we can't set it to strict 0 just because it's all passed on ext. I have restored the write tolerance back to 5%, and am sending the v3 patch. Thanks, Boyang On Mon, Apr 26, 2021 at 8:08 PM Brian Foster wrote: > > On Sun, Apr 25, 2021 at 12:53:07PM +0800, Boyang Xue wrote: > > Hi Brian, > > > > Please find my reply below inline. > > > > On Fri, Apr 23, 2021 at 7:07 PM Brian Foster wrote: > > > > > > On Thu, Apr 22, 2021 at 11:31:47PM +0800, bxue@redhat.com wrote: > > > > From: Boyang Xue > > > > > > > > On ext2/ext3, it's expected that several single block metadata reads can occur > > > > when writing to file in the same cgroup (the stack is like below[1]). The > > > > purpose of the "write -> read/write" subtest is to make sure the larger pwrite > > > > is accounted to the correct cgroup, not necessarily enforce that zero bytes are > > > > read in service of the write. This patch fixes the sub-test in order to tolerate > > > > small reads in 1st cgroup. > > > > > > > > [1] Callchain of the read: > > > > > > > > @ext3_read_bio[ > > > > submit_bio+1 > > > > submit_bh_wbc+365 > > > > ext4_read_bh+72 > > > > ext4_get_branch+201 > > > > ext4_ind_map_blocks+382 > > > > ext4_map_blocks+295 > > > > _ext4_get_block+170 > > > > __block_write_begin_int+328 > > > > ext4_write_begin+541 > > > > generic_perform_write+213 > > > > ext4_buffered_write_iter+167 > > > > new_sync_write+345 > > > > vfs_write+438 > > > > __x64_sys_pwrite64+140 > > > > do_syscall_64+51 > > > > entry_SYSCALL_64_after_hwframe+68 > > > > , 5793, 12]: 3 > > > > > > > > Signed-off-by: Boyang Xue > > > > --- > > > > Hi, > > > > > > > > This patch fix the "write -> read/write" sub-test in order to tolerate > > > > small reads in service of the write (like read metadata). > > > > > > > > Change from v1: > > > > (1) More details in commit log, including example call stack > > > > (2) Set the fixed tolerance value to 33792 for accuracy > > > > (3) Update percentage tolerance value to fixed value 0, where doesn't > > > > fail the test > > > > > > > > Tested pass on ext2/ext3/ext4 x 1k/2k/4k blksize. > > > > > > > > Thanks, > > > > Boyang > > > > > > > > tests/generic/563 | 20 +++++++++++++------- > > > > 1 file changed, 13 insertions(+), 7 deletions(-) > > > > > > > > diff --git a/tests/generic/563 b/tests/generic/563 > > > > index b113eacf..44394b4b 100755 > > > > --- a/tests/generic/563 > > > > +++ b/tests/generic/563 > > > > @@ -60,6 +60,8 @@ check_cg() > > > > cgname=$(basename $cgroot) > > > > expectedread=$2 > > > > expectedwrite=$3 > > > > + readtol=$4 > > > > + writetol=$5 > > > > rbytes=0 > > > > wbytes=0 > > > > > > > > @@ -71,8 +73,8 @@ check_cg() > > > > awk -F = '{ print $2 }'` > > > > fi > > > > > > > > - _within_tolerance "read" $rbytes $expectedread 5% -v > > > > - _within_tolerance "write" $wbytes $expectedwrite 5% -v > > > > + _within_tolerance "read" $rbytes $expectedread $readtol -v > > > > + _within_tolerance "write" $wbytes $expectedwrite $writetol -v > > > > } > > > > > > > > # Move current process to another cgroup. > > > > @@ -113,7 +115,7 @@ $XFS_IO_PROG -c "pread 0 $iosize" -c "pwrite 0 $iosize" -c fsync \ > > > > $SCRATCH_MNT/file >> $seqres.full 2>&1 > > > > switch_cg $cgdir > > > > $XFS_IO_PROG -c fsync $SCRATCH_MNT/file > > > > -check_cg $cgdir/$seq-cg $iosize $iosize > > > > +check_cg $cgdir/$seq-cg $iosize $iosize 5% 5% > > > > Here the write tolerance has to be 5% rather than 0, since testing > > with ext2, the write bytes are slightly larger than $iosize (8392704 > > vs 8388608). > > > > Yeah, for any non-zero values the write tolerance should always be 5%. > That's the historical behavior of the test. > > > > > > > > > # Write from one cgroup then read and write from a second. Writes are charged to > > > > # the first group and nothing to the second. > > > > @@ -126,8 +128,12 @@ $XFS_IO_PROG -c "pread 0 $iosize" -c "pwrite 0 $iosize" $SCRATCH_MNT/file \ > > > > >> $seqres.full 2>&1 > > > > switch_cg $cgdir > > > > $XFS_IO_PROG -c fsync $SCRATCH_MNT/file > > > > -check_cg $cgdir/$seq-cg 0 $iosize > > > > -check_cg $cgdir/$seq-cg-2 0 0 > > > > +# Use a fixed value tolerance for the expected value of zero here > > > > +# because filesystems might perform a small number of metadata reads to > > > > +# complete the write. On ext2/3 with 1k block size, the read bytes is > > > > +# as large as 33792. > > > > +check_cg $cgdir/$seq-cg 0 $iosize 33792 0 > > > > > > Shouldn't that last parameter (write tolerance) remain as 5%? > > > > In my test on ext2/3/4 with 1k/2k/4k, the write tolerance here always > > equals $iosize in this sub-test. So make it 0 rather 5%, I hope it > > will gate future behavior change more sensitively. > > > > I think that deviates from the purpose of the test. I don't think we > want to filter this change in behavior down through folks' test > environments just because it happens to be exact in some cases. The > original purpose of the tolerance was to filter out this kind of noise > and test the general effectiveness of the cgroup writeback accounting, > not to capture and document current or future deviations from the exact > I/O sizes being used. > > The problem this patch should fix is that the original test didn't > properly account for potential metadata I/O to support data I/O by > virtue of the 5% tolerance being applied to an iosize of 0. Otherwise, I > don't think it should change the behavior of the test in any way. You > could always create a new fs-specific test if you wanted to test for > precise accounting values for specific filesystem(s). Personally, I > don't think that's really necessary because when such a test fails it > seems more likely to me we'd end up just having to fix the test over > changing things on the kernel side, but that's just my .02. > > Brian > > > > > > > > +check_cg $cgdir/$seq-cg-2 0 0 0 0 > > > > > > > > # Read from one cgroup, read & write from a second. Both reads and writes are > > > > # charged to the first group and nothing to the second. > > > > @@ -140,8 +146,8 @@ $XFS_IO_PROG -c "pread 0 $iosize" -c "pwrite 0 $iosize" $SCRATCH_MNT/file \ > > > > >> $seqres.full 2>&1 > > > > switch_cg $cgdir > > > > $XFS_IO_PROG -c fsync $SCRATCH_MNT/file > > > > -check_cg $cgdir/$seq-cg $iosize $iosize > > > > -check_cg $cgdir/$seq-cg-2 0 0 > > > > +check_cg $cgdir/$seq-cg $iosize $iosize 5% 0 > > > > > > And here too? Otherwise the patch LGTM. > > > > The same reason as above. > > > > If the write tolerance mismatch confuses future readers, I can put a > > comment to explain. Maybe a single comment like this? > > > > ``` > > # Read and write from a single group. > > echo "read/write" > > reset > > switch_cg $cgdir/$seq-cg > > $XFS_IO_PROG -c "pread 0 $iosize" -c "pwrite 0 $iosize" -c fsync \ > > $SCRATCH_MNT/file >> $seqres.full 2>&1 > > switch_cg $cgdir > > $XFS_IO_PROG -c fsync $SCRATCH_MNT/file > > # write bytes is slightly larger than $iosize on ext2 <=== new comment > > check_cg $cgdir/$seq-cg $iosize $iosize 5% 5% > > ``` > > > > Thanks for the review! > > > > -Boyang > > > > > Brian > > > > > > > +check_cg $cgdir/$seq-cg-2 0 0 0 0 > > > > > > > > echo "-io" > $cgdir/cgroup.subtree_control || _fail "subtree control" > > > > > > > > -- > > > > 2.27.0 > > > > > > > > > >