From: "Darrick J. Wong" <darrick.wong@oracle.com> To: hch@infradead.org, david@fromorbit.com, darrick.wong@oracle.com Cc: fstests@vger.kernel.org, xfs@oss.sgi.com, tao.peng@primarydata.com, linux-ext4@vger.kernel.org, Anna.Schumaker@netapp.com, linux-btrfs@vger.kernel.org Subject: [PATCH 10/11] reflink: test what happens when we hit resource limits Date: Wed, 11 Nov 2015 11:27:37 -0800 [thread overview] Message-ID: <20151111192737.15056.44475.stgit@birch.djwong.org> (raw) In-Reply-To: <20151111192628.15056.6451.stgit@birch.djwong.org> Add a few horrible opt-in stress tests to see what happens if we try to reflink the same block billions of times, and what happens if we run out of space while reflinking a file. Signed-off-by: Darrick J. Wong <darrick.wong@oracle.com> --- tests/generic/840 | 99 +++++++++++++++++++++++++++++++++++++++++++++++++ tests/generic/840.out | 0 tests/generic/841 | 81 ++++++++++++++++++++++++++++++++++++++++ tests/generic/841.out | 5 ++ tests/generic/group | 2 + 5 files changed, 187 insertions(+) create mode 100755 tests/generic/840 create mode 100644 tests/generic/840.out create mode 100755 tests/generic/841 create mode 100644 tests/generic/841.out diff --git a/tests/generic/840 b/tests/generic/840 new file mode 100755 index 0000000..137cc3d --- /dev/null +++ b/tests/generic/840 @@ -0,0 +1,99 @@ +#! /bin/bash +# FS QA Test No. 840 +# +# Try to hit the maximum reference count (eek!) +# +# This test runs extremely slowly, so it's not automatically run anywhere. +# +#----------------------------------------------------------------------- +# Copyright (c) 2015, Oracle and/or its affiliates. All Rights Reserved. +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License as +# published by the Free Software Foundation. +# +# This program is distributed in the hope that it would be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write the Free Software Foundation, +# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA +#----------------------------------------------------------------------- + +seq=`basename "$0"` +seqres="$RESULT_DIR/$seq" +echo "QA output created by $seq" + +here=`pwd` +tmp=/tmp/$$ +status=1 # failure is the default! +trap "_cleanup; exit \$status" 0 1 2 3 15 + +_cleanup() +{ + cd / + rm -rf "$tmp".* "$TESTDIR1" +} + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter +. ./common/attr +. ./common/reflink + +# real QA test starts here +_supported_os Linux +_require_scratch_reflink +_require_cp_reflink + +rm -f "$seqres.full" + +echo "Format and mount" +_scratch_mkfs > "$seqres.full" 2>&1 +_scratch_mount >> "$seqres.full" 2>&1 + +TESTDIR="$SCRATCH_MNT/test-$seq" +rm -rf "$TESTDIR" +mkdir "$TESTDIR" + +# Well let's hope the maximum reflink count is (less than (ha!)) 2^32... + +echo "Create a one block file" +BLKSZ="$(stat -f "$TESTDIR" -c '%S')" +_pwrite_byte 0x61 0 $BLKSZ "$TESTDIR/file1" >> "$seqres.full" +_pwrite_byte 0x62 0 $BLKSZ "$TESTDIR/file2" >> "$seqres.full" +_cp_reflink "$TESTDIR/file1" "$TESTDIR/file2" >> "$seqres.full" + +nr=32 +fnr=32 +for i in $(seq 0 $fnr); do + echo " ++ Reflink size $i, $(( (2 ** i) * BLKSZ)) bytes" | tee -a "$seqres.full" + n=$(( (2 ** i) * BLKSZ)) + _reflink_range "$TESTDIR/file1" 0 "$TESTDIR/file1" $n $n >> "$seqres.full" || break +done + +nrf=$((nr - fnr)) +echo "Clone $((2 ** nrf)) files" +seq 0 $((2 ** nrf)) | while read i; do + _cp-reflink "$TESTDIR/file1" "$TESTDIR/file1-$i" +done + +echo "Check scratch fs" +umount "$SCRATCH_MNT" +_check_scratch_fs + +echo "Remove big file and recheck" +_scratch_mount >> "$seqres.full" 2>&1 +umount "$SCRATCH_MNT" +_check_scratch_fs + +echo "Remove all files and recheck" +_scratch_mount >> "$seqres.full" 2>&1 +umount "$SCRATCH_MNT" +_check_scratch_fs + +# success, all done +status=0 +exit diff --git a/tests/generic/840.out b/tests/generic/840.out new file mode 100644 index 0000000..e69de29 diff --git a/tests/generic/841 b/tests/generic/841 new file mode 100755 index 0000000..b89dba4 --- /dev/null +++ b/tests/generic/841 @@ -0,0 +1,81 @@ +#! /bin/bash +# FS QA Test No. 841 +# +# Try to run out of space while cloning? +# +#----------------------------------------------------------------------- +# Copyright (c) 2015, Oracle and/or its affiliates. All Rights Reserved. +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License as +# published by the Free Software Foundation. +# +# This program is distributed in the hope that it would be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write the Free Software Foundation, +# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA +#----------------------------------------------------------------------- + +seq=`basename "$0"` +seqres="$RESULT_DIR/$seq" +echo "QA output created by $seq" + +here=`pwd` +tmp=/tmp/$$ +status=1 # failure is the default! +trap "_cleanup; exit \$status" 0 1 2 3 15 + +_cleanup() +{ + cd / + rm -rf "$tmp".* "$TESTDIR1" +} + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter +. ./common/attr +. ./common/reflink + +# real QA test starts here +_supported_os Linux +_require_scratch_reflink + +rm -f "$seqres.full" + +echo "Format and mount" +_scratch_mkfs > "$seqres.full" 2>&1 +_scratch_mount >> "$seqres.full" 2>&1 + +TESTDIR="$SCRATCH_MNT/test-$seq" +rm -rf "$TESTDIR" +mkdir "$TESTDIR" + +BLKSZ="$(stat -f "$TESTDIR" -c '%S')" +NR_FREE="$(stat -f -c '%f' "$TESTDIR")" +echo "Create a big file" +touch "$TESTDIR/file0" "$TESTDIR/file1" +_pwrite_byte 0x61 0 $((BLKSZ * NR_FREE)) "$TESTDIR/bigfile" >> "$seqres.full" 2>&1 +_scratch_remount +sz="$(stat -c '%s' "$TESTDIR/bigfile")" + +blks="$((sz / BLKSZ))" +echo "Try to reflink" +seq 0 $blks | while read lblk; do + fname="$TESTDIR/file$((lblk % 2))" + out="$(_reflink_range "$TESTDIR/bigfile" $((lblk * BLKSZ)) "$fname" $((lblk * BLKSZ)) $BLKSZ 2>&1)" + echo "$fname: $out" >> "$seqres.full" + echo "$out" | grep -q "No space left on device" && break +done + +echo "Check scratch fs" +umount "$SCRATCH_MNT" +_check_scratch_fs + +# success, all done +status=0 +exit diff --git a/tests/generic/841.out b/tests/generic/841.out new file mode 100644 index 0000000..33c46fd --- /dev/null +++ b/tests/generic/841.out @@ -0,0 +1,5 @@ +QA output created by 841 +Format and mount +Create a big file +Try to reflink +Check scratch fs diff --git a/tests/generic/group b/tests/generic/group index 90f28aa..eef608f 100644 --- a/tests/generic/group +++ b/tests/generic/group @@ -247,4 +247,6 @@ 837 auto quick clone 838 auto quick clone 839 auto quick clone +840 clone_stress +841 clone_stress 846 auto quick clone
WARNING: multiple messages have this Message-ID (diff)
From: "Darrick J. Wong" <darrick.wong@oracle.com> To: hch@infradead.org, david@fromorbit.com, darrick.wong@oracle.com Cc: fstests@vger.kernel.org, xfs@oss.sgi.com, tao.peng@primarydata.com, linux-ext4@vger.kernel.org, Anna.Schumaker@netapp.com, linux-btrfs@vger.kernel.org Subject: [PATCH 10/11] reflink: test what happens when we hit resource limits Date: Wed, 11 Nov 2015 11:27:37 -0800 [thread overview] Message-ID: <20151111192737.15056.44475.stgit@birch.djwong.org> (raw) In-Reply-To: <20151111192628.15056.6451.stgit@birch.djwong.org> Add a few horrible opt-in stress tests to see what happens if we try to reflink the same block billions of times, and what happens if we run out of space while reflinking a file. Signed-off-by: Darrick J. Wong <darrick.wong@oracle.com> --- tests/generic/840 | 99 +++++++++++++++++++++++++++++++++++++++++++++++++ tests/generic/840.out | 0 tests/generic/841 | 81 ++++++++++++++++++++++++++++++++++++++++ tests/generic/841.out | 5 ++ tests/generic/group | 2 + 5 files changed, 187 insertions(+) create mode 100755 tests/generic/840 create mode 100644 tests/generic/840.out create mode 100755 tests/generic/841 create mode 100644 tests/generic/841.out diff --git a/tests/generic/840 b/tests/generic/840 new file mode 100755 index 0000000..137cc3d --- /dev/null +++ b/tests/generic/840 @@ -0,0 +1,99 @@ +#! /bin/bash +# FS QA Test No. 840 +# +# Try to hit the maximum reference count (eek!) +# +# This test runs extremely slowly, so it's not automatically run anywhere. +# +#----------------------------------------------------------------------- +# Copyright (c) 2015, Oracle and/or its affiliates. All Rights Reserved. +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License as +# published by the Free Software Foundation. +# +# This program is distributed in the hope that it would be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write the Free Software Foundation, +# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA +#----------------------------------------------------------------------- + +seq=`basename "$0"` +seqres="$RESULT_DIR/$seq" +echo "QA output created by $seq" + +here=`pwd` +tmp=/tmp/$$ +status=1 # failure is the default! +trap "_cleanup; exit \$status" 0 1 2 3 15 + +_cleanup() +{ + cd / + rm -rf "$tmp".* "$TESTDIR1" +} + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter +. ./common/attr +. ./common/reflink + +# real QA test starts here +_supported_os Linux +_require_scratch_reflink +_require_cp_reflink + +rm -f "$seqres.full" + +echo "Format and mount" +_scratch_mkfs > "$seqres.full" 2>&1 +_scratch_mount >> "$seqres.full" 2>&1 + +TESTDIR="$SCRATCH_MNT/test-$seq" +rm -rf "$TESTDIR" +mkdir "$TESTDIR" + +# Well let's hope the maximum reflink count is (less than (ha!)) 2^32... + +echo "Create a one block file" +BLKSZ="$(stat -f "$TESTDIR" -c '%S')" +_pwrite_byte 0x61 0 $BLKSZ "$TESTDIR/file1" >> "$seqres.full" +_pwrite_byte 0x62 0 $BLKSZ "$TESTDIR/file2" >> "$seqres.full" +_cp_reflink "$TESTDIR/file1" "$TESTDIR/file2" >> "$seqres.full" + +nr=32 +fnr=32 +for i in $(seq 0 $fnr); do + echo " ++ Reflink size $i, $(( (2 ** i) * BLKSZ)) bytes" | tee -a "$seqres.full" + n=$(( (2 ** i) * BLKSZ)) + _reflink_range "$TESTDIR/file1" 0 "$TESTDIR/file1" $n $n >> "$seqres.full" || break +done + +nrf=$((nr - fnr)) +echo "Clone $((2 ** nrf)) files" +seq 0 $((2 ** nrf)) | while read i; do + _cp-reflink "$TESTDIR/file1" "$TESTDIR/file1-$i" +done + +echo "Check scratch fs" +umount "$SCRATCH_MNT" +_check_scratch_fs + +echo "Remove big file and recheck" +_scratch_mount >> "$seqres.full" 2>&1 +umount "$SCRATCH_MNT" +_check_scratch_fs + +echo "Remove all files and recheck" +_scratch_mount >> "$seqres.full" 2>&1 +umount "$SCRATCH_MNT" +_check_scratch_fs + +# success, all done +status=0 +exit diff --git a/tests/generic/840.out b/tests/generic/840.out new file mode 100644 index 0000000..e69de29 diff --git a/tests/generic/841 b/tests/generic/841 new file mode 100755 index 0000000..b89dba4 --- /dev/null +++ b/tests/generic/841 @@ -0,0 +1,81 @@ +#! /bin/bash +# FS QA Test No. 841 +# +# Try to run out of space while cloning? +# +#----------------------------------------------------------------------- +# Copyright (c) 2015, Oracle and/or its affiliates. All Rights Reserved. +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License as +# published by the Free Software Foundation. +# +# This program is distributed in the hope that it would be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write the Free Software Foundation, +# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA +#----------------------------------------------------------------------- + +seq=`basename "$0"` +seqres="$RESULT_DIR/$seq" +echo "QA output created by $seq" + +here=`pwd` +tmp=/tmp/$$ +status=1 # failure is the default! +trap "_cleanup; exit \$status" 0 1 2 3 15 + +_cleanup() +{ + cd / + rm -rf "$tmp".* "$TESTDIR1" +} + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter +. ./common/attr +. ./common/reflink + +# real QA test starts here +_supported_os Linux +_require_scratch_reflink + +rm -f "$seqres.full" + +echo "Format and mount" +_scratch_mkfs > "$seqres.full" 2>&1 +_scratch_mount >> "$seqres.full" 2>&1 + +TESTDIR="$SCRATCH_MNT/test-$seq" +rm -rf "$TESTDIR" +mkdir "$TESTDIR" + +BLKSZ="$(stat -f "$TESTDIR" -c '%S')" +NR_FREE="$(stat -f -c '%f' "$TESTDIR")" +echo "Create a big file" +touch "$TESTDIR/file0" "$TESTDIR/file1" +_pwrite_byte 0x61 0 $((BLKSZ * NR_FREE)) "$TESTDIR/bigfile" >> "$seqres.full" 2>&1 +_scratch_remount +sz="$(stat -c '%s' "$TESTDIR/bigfile")" + +blks="$((sz / BLKSZ))" +echo "Try to reflink" +seq 0 $blks | while read lblk; do + fname="$TESTDIR/file$((lblk % 2))" + out="$(_reflink_range "$TESTDIR/bigfile" $((lblk * BLKSZ)) "$fname" $((lblk * BLKSZ)) $BLKSZ 2>&1)" + echo "$fname: $out" >> "$seqres.full" + echo "$out" | grep -q "No space left on device" && break +done + +echo "Check scratch fs" +umount "$SCRATCH_MNT" +_check_scratch_fs + +# success, all done +status=0 +exit diff --git a/tests/generic/841.out b/tests/generic/841.out new file mode 100644 index 0000000..33c46fd --- /dev/null +++ b/tests/generic/841.out @@ -0,0 +1,5 @@ +QA output created by 841 +Format and mount +Create a big file +Try to reflink +Check scratch fs diff --git a/tests/generic/group b/tests/generic/group index 90f28aa..eef608f 100644 --- a/tests/generic/group +++ b/tests/generic/group @@ -247,4 +247,6 @@ 837 auto quick clone 838 auto quick clone 839 auto quick clone +840 clone_stress +841 clone_stress 846 auto quick clone _______________________________________________ xfs mailing list xfs@oss.sgi.com http://oss.sgi.com/mailman/listinfo/xfs
next prev parent reply other threads:[~2015-11-11 19:28 UTC|newest] Thread overview: 38+ messages / expand[flat|nested] mbox.gz Atom feed top 2015-11-11 19:26 [RFCv3.1 00/11] xfstests: test the nfs/cifs/btrfs/xfs reflink/dedupe ioctls Darrick J. Wong 2015-11-11 19:26 ` Darrick J. Wong 2015-11-11 19:26 ` [PATCH 01/11] btrfs: move btrfs reflink tests to generic Darrick J. Wong 2015-11-11 19:26 ` Darrick J. Wong 2015-11-11 19:26 ` [PATCH 02/11] generic/80[0-2]: support xfs in addition to btrfs Darrick J. Wong 2015-11-11 19:26 ` Darrick J. Wong 2015-11-11 19:26 ` [PATCH 03/11] reflink: basic tests of the reflink and dedupe ioctls Darrick J. Wong 2015-11-11 19:26 ` Darrick J. Wong 2015-11-11 19:26 ` [PATCH 04/11] reflink: test CoW behaviors of reflinked files Darrick J. Wong 2015-11-11 19:26 ` Darrick J. Wong 2015-11-11 19:27 ` [PATCH 05/11] reflink: test the various fallocate modes Darrick J. Wong 2015-11-11 19:27 ` Darrick J. Wong 2015-11-11 19:27 ` [PATCH 06/11] reflink: concurrent operations tests Darrick J. Wong 2015-11-11 19:27 ` Darrick J. Wong 2015-11-11 19:27 ` [PATCH 07/11] reflink: test accuracy of free block counts Darrick J. Wong 2015-11-11 19:27 ` Darrick J. Wong 2015-11-11 19:27 ` [PATCH 08/11] reflink: test error conditions due to bad inputs Darrick J. Wong 2015-11-11 19:27 ` Darrick J. Wong 2015-11-11 19:27 ` [PATCH 09/11] xfs: test xfs-specific reflink pieces Darrick J. Wong 2015-11-11 19:27 ` Darrick J. Wong 2015-11-11 19:27 ` Darrick J. Wong [this message] 2015-11-11 19:27 ` [PATCH 10/11] reflink: test what happens when we hit resource limits Darrick J. Wong 2015-11-11 19:27 ` [PATCH 11/11] reflink: test that CoW writes fail when we're out of space Darrick J. Wong 2015-11-11 19:27 ` Darrick J. Wong 2015-11-12 9:07 ` [RFCv3.1 00/11] xfstests: test the nfs/cifs/btrfs/xfs reflink/dedupe ioctls Christoph Hellwig 2015-11-12 9:07 ` Christoph Hellwig 2015-11-12 12:51 ` Christoph Hellwig 2015-11-12 12:51 ` Christoph Hellwig 2015-11-12 17:34 ` Darrick J. Wong 2015-11-12 17:34 ` Darrick J. Wong 2015-11-12 17:36 ` Christoph Hellwig 2015-11-12 17:36 ` Christoph Hellwig 2015-11-13 9:08 ` Darrick J. Wong 2015-11-13 9:08 ` Darrick J. Wong 2015-11-13 14:12 ` Christoph Hellwig 2015-11-13 14:12 ` Christoph Hellwig 2015-11-13 18:32 ` Darrick J. Wong 2015-11-13 18:32 ` Darrick J. Wong
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=20151111192737.15056.44475.stgit@birch.djwong.org \ --to=darrick.wong@oracle.com \ --cc=Anna.Schumaker@netapp.com \ --cc=david@fromorbit.com \ --cc=fstests@vger.kernel.org \ --cc=hch@infradead.org \ --cc=linux-btrfs@vger.kernel.org \ --cc=linux-ext4@vger.kernel.org \ --cc=tao.peng@primarydata.com \ --cc=xfs@oss.sgi.com \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: linkBe sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.