* [PATCH v3 00/15] xfstests: new btrfs stress test cases
@ 2014-09-18 5:49 Eryu Guan
2014-09-18 5:49 ` [PATCH v3 01/15] btrfs: new test to run btrfs balance and subvolume test simultaneously Eryu Guan
` (16 more replies)
0 siblings, 17 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
This patchset add new stress test cases for btrfs by running two
different btrfs operations simultaneously under fsstress to ensure
btrfs doesn't hang or oops in such situations. btrfs scrub and
btrfs check will be run after each test.
The test matrix is the combination of 6 btrfs operations:
balance
create/mount/umount/delete subvolume
replace device
scrub
defrag
remount with different compress algorithms
Short descriptions:
059: balance-subvolume
060: balance-scrub
061: balance-defrag
062: balance-remount
063: balance-replace
064: subvolume-replace
065: subvolume-scrub
066: subvolume-defrag
067: subvolume-remount
068: replace-scrub
069: replace-defrag
070: replace-remount
071: scrub-defrag
072: scrub-remount
073: defrag-remount
Some issues I've seen:
1. subvolume cannot be mounted with selinux context, so you may see
such logs in dmesg
SELinux: mount invalid. Same superblock, different security settings for (dev dm-8, type btrfs)
I've reported the bug to btrfs list, see
[BUG] cannot mount subvolume with selinux context
http://www.spinics.net/lists/linux-btrfs/msg36779.html
2. btrfs replace operation always returns ENOENT if balance is running
So in 063.full you'll see
ERROR: ioctl(DEV_REPLACE_START) failed on "/mnt/testarea/scratch": No such file or directory, no error
Not sure if it's btrfs bug, at least I think the error code is misleading
3. replace operation hangs the kernel(3.16-rc4+ and 3.17-rc2+) with fsstress running
So case 064/068/069/070 will hang
Changes since v2:
- mount subvolume at $TEST_DIR/$seq.mnt not $tmp.mnt
- don't rm -rf $tmp.* which is dangerous
- remove unnecessary btrfs filesystem sync operation
- update _scratch_pool_mkfs to deal with dup profile
- add more comments for each stress operation
- rename _btrfs_stress_remount to _btrfs_stress_remount_compress (hope it's better...)
- add _btrfs_get_profile_configs to remove duplicated test case array in each case
- use _require_scratch_nocheck and _check_scratch_fs after each loop
Changes since v1:
- put common operations in common/rc as functions and share them across these tests
- append mkfs options to _scratch_mkfs and _scratch_pool_mkfs instead of updating $MKFS_OPTIONS
- rebase on top of master and re-number starting from btrfs/059
Thanks,
Eryu Guan
Eryu Guan (15):
btrfs: new test to run btrfs balance and subvolume test simultaneously
btrfs: new test to run btrfs balance and scrub simultaneously
btrfs: new test to run btrfs balance and defrag operations simultaneously
btrfs: new case to run btrfs balance and remount with different compress algorithms
btrfs: new case to run btrfs balance and device replace operations simultaneously
btrfs: new case to run btrfs subvolume create/delete operations and device replace simultaneously
btrfs: new case to run btrfs subvolume create/delete operations and scrub simultaneously
btrfs: new case to run btrfs subvolume create/delete and defrag operations simultaneously
btrfs: new case to run subvolume create/delete and remount with defferent compress algorithms
btrfs: new case to run device replace and scrub operations simultaneously
btrfs: new case to run device replace and defrag operations simultaneously
btrfs: new case to run device replace and remount with different compress algorithms simultaneously
btrfs: new case to run btrfs scrub and defrag operations simultaneously
btrfs: new case to run btrfs scrub and remount with different compress algorithms simultaneously
btrfs: new case to run defrag and remount with different compress algorithms simultaneously
common/rc | 225 +++++++++++++++++++++++++++++++++++++++++++++++++++-
tests/btrfs/059 | 115 +++++++++++++++++++++++++++
tests/btrfs/059.out | 2 +
tests/btrfs/060 | 114 ++++++++++++++++++++++++++
tests/btrfs/060.out | 2 +
tests/btrfs/061 | 116 +++++++++++++++++++++++++++
tests/btrfs/061.out | 2 +
tests/btrfs/062 | 114 ++++++++++++++++++++++++++
tests/btrfs/062.out | 2 +
tests/btrfs/063 | 122 ++++++++++++++++++++++++++++
tests/btrfs/063.out | 2 +
tests/btrfs/064 | 123 ++++++++++++++++++++++++++++
tests/btrfs/064.out | 2 +
tests/btrfs/065 | 115 +++++++++++++++++++++++++++
tests/btrfs/065.out | 2 +
tests/btrfs/066 | 117 +++++++++++++++++++++++++++
tests/btrfs/066.out | 2 +
tests/btrfs/067 | 116 +++++++++++++++++++++++++++
tests/btrfs/067.out | 2 +
tests/btrfs/068 | 123 ++++++++++++++++++++++++++++
tests/btrfs/068.out | 2 +
tests/btrfs/069 | 125 +++++++++++++++++++++++++++++
tests/btrfs/069.out | 2 +
tests/btrfs/070 | 123 ++++++++++++++++++++++++++++
tests/btrfs/070.out | 2 +
tests/btrfs/071 | 116 +++++++++++++++++++++++++++
tests/btrfs/071.out | 2 +
tests/btrfs/072 | 114 ++++++++++++++++++++++++++
tests/btrfs/072.out | 2 +
tests/btrfs/073 | 116 +++++++++++++++++++++++++++
tests/btrfs/073.out | 2 +
tests/btrfs/group | 15 ++++
32 files changed, 2035 insertions(+), 4 deletions(-)
create mode 100755 tests/btrfs/059
create mode 100644 tests/btrfs/059.out
create mode 100755 tests/btrfs/060
create mode 100644 tests/btrfs/060.out
create mode 100755 tests/btrfs/061
create mode 100644 tests/btrfs/061.out
create mode 100755 tests/btrfs/062
create mode 100644 tests/btrfs/062.out
create mode 100755 tests/btrfs/063
create mode 100644 tests/btrfs/063.out
create mode 100755 tests/btrfs/064
create mode 100644 tests/btrfs/064.out
create mode 100755 tests/btrfs/065
create mode 100644 tests/btrfs/065.out
create mode 100755 tests/btrfs/066
create mode 100644 tests/btrfs/066.out
create mode 100755 tests/btrfs/067
create mode 100644 tests/btrfs/067.out
create mode 100755 tests/btrfs/068
create mode 100644 tests/btrfs/068.out
create mode 100755 tests/btrfs/069
create mode 100644 tests/btrfs/069.out
create mode 100755 tests/btrfs/070
create mode 100644 tests/btrfs/070.out
create mode 100755 tests/btrfs/071
create mode 100644 tests/btrfs/071.out
create mode 100755 tests/btrfs/072
create mode 100644 tests/btrfs/072.out
create mode 100755 tests/btrfs/073
create mode 100644 tests/btrfs/073.out
--
1.8.3.1
^ permalink raw reply [flat|nested] 19+ messages in thread
* [PATCH v3 01/15] btrfs: new test to run btrfs balance and subvolume test simultaneously
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-18 5:49 ` [PATCH v3 02/15] btrfs: new test to run btrfs balance and scrub simultaneously Eryu Guan
` (15 subsequent siblings)
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs balance and subvolume create/mount/umount/delete simultaneously,
with fsstress running in background.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
common/rc | 110 +++++++++++++++++++++++++++++++++++++++++++++++--
tests/btrfs/059 | 115 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/059.out | 2 +
tests/btrfs/group | 1 +
4 files changed, 224 insertions(+), 4 deletions(-)
create mode 100755 tests/btrfs/059
create mode 100644 tests/btrfs/059.out
diff --git a/common/rc b/common/rc
index b8f711a..a0677da 100644
--- a/common/rc
+++ b/common/rc
@@ -582,11 +582,17 @@ _scratch_pool_mkfs()
{
case $FSTYP in
btrfs)
- $MKFS_BTRFS_PROG $MKFS_OPTIONS $* $SCRATCH_DEV_POOL > /dev/null
- ;;
+ # if dup profile is in mkfs options call _scratch_mkfs instead
+ # because dup profile only works with single device
+ if [[ "$*" =~ dup ]]; then
+ _scratch_mkfs $*
+ else
+ $MKFS_BTRFS_PROG $MKFS_OPTIONS $* $SCRATCH_DEV_POOL > /dev/null
+ fi
+ ;;
*)
- echo "_scratch_pool_mkfs is not implemented for $FSTYP" 1>&2
- ;;
+ echo "_scratch_pool_mkfs is not implemented for $FSTYP" 1>&2
+ ;;
esac
}
@@ -2483,6 +2489,102 @@ _get_free_inode()
echo $nr_inode
}
+# get btrfs profile configs being tested
+#
+# A set of pre-set profile configs are exported via _btrfs_profile_configs
+# array. Default configs can be overridden by setting BTRFS_PROFILE_CONFIGS
+# var in the format "metadata_profile:data_profile", multiple configs can be
+# seperated by space, e.g.
+# export BTRFS_PROFILE_CONFIGS="raid0:raid0 raid1:raid1 dup:single"
+_btrfs_get_profile_configs()
+{
+ if [ "$FSTYP" != "btrfs" ]; then
+ return
+ fi
+
+ # no user specified btrfs profile configs, export the default configs
+ if [ -z "$BTRFS_PROFILE_CONFIGS" ]; then
+ # default configs
+ _btrfs_profile_configs=(
+ "-m single -d single"
+ "-m dup -d single"
+ "-m raid0 -d raid0"
+ "-m raid1 -d raid0"
+ "-m raid1 -d raid1"
+ "-m raid10 -d raid10"
+ "-m raid5 -d raid5"
+ "-m raid6 -d raid6"
+ )
+
+ # remove dup/raid5/raid6 profiles if we're doing device replace
+ # dup profile indicates only one device being used (SCRATCH_DEV),
+ # but we don't want to replace SCRATCH_DEV, which will be used in
+ # _scratch_mount/_check_scratch_fs etc.
+ # and raid5/raid6 doesn't support replace yet
+ if [ "$1" == "replace" ]; then
+ _btrfs_profile_configs=(
+ "-m single -d single"
+ "-m raid0 -d raid0"
+ "-m raid1 -d raid0"
+ "-m raid1 -d raid1"
+ "-m raid10 -d raid10"
+ # add these back when raid5/6 is working with replace
+ #"-m raid5 -d raid5"
+ #"-m raid6 -d raid6"
+ )
+ fi
+ export _btrfs_profile_configs
+ return
+ fi
+
+ # parse user specified btrfs profile configs
+ local i=0
+ local cfg=""
+ for cfg in $BTRFS_PROFILE_CONFIGS; do
+ # turn "metadata:data" format to "-m metadata -d data"
+ # and assign it to _btrfs_profile_configs array
+ cfg=`echo "$cfg" | sed -e 's/^/-m /' -e 's/:/ -d /'`
+ _btrfs_profile_configs[$i]="$cfg"
+ let i=i+1
+ done
+
+ if [ "$1" == "replace" ]; then
+ if echo ${_btrfs_profile_configs[*]} | grep -q raid[56]; then
+ _notrun "RAID5/6 doesn't support btrfs device replace yet"
+ fi
+ if echo ${_btrfs_profile_configs[*]} | grep -q dup; then
+ _notrun "Do not set dup profile in btrfs device replace test"
+ fi
+ fi
+ export _btrfs_profile_configs
+}
+
+# stress btrfs by running balance operation in a loop
+_btrfs_stress_balance()
+{
+ local btrfs_mnt=$1
+ while true; do
+ $BTRFS_UTIL_PROG balance start $btrfs_mnt
+ done
+}
+
+# stress btrfs by creating/mounting/umounting/deleting subvolume in a loop
+_btrfs_stress_subvolume()
+{
+ local btrfs_dev=$1
+ local btrfs_mnt=$2
+ local subvol_name=$3
+ local subvol_mnt=$4
+
+ mkdir -p $subvol_mnt
+ while true; do
+ $BTRFS_UTIL_PROG subvolume create $btrfs_mnt/$subvol_name
+ $MOUNT_PROG -o subvol=$subvol_name $btrfs_dev $subvol_mnt
+ $UMOUNT_PROG $subvol_mnt
+ $BTRFS_UTIL_PROG subvolume delete $btrfs_mnt/$subvol_name
+ done
+}
+
init_rc()
{
if [ "$iam" == new ]
diff --git a/tests/btrfs/059 b/tests/btrfs/059
new file mode 100755
index 0000000..5017299
--- /dev/null
+++ b/tests/btrfs/059
@@ -0,0 +1,115 @@
+#! /bin/bash
+# FSQA Test No. btrfs/059
+#
+# Run btrfs balance and subvolume create/mount/umount/delete simultaneously,
+# with fsstress running in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 4
+_btrfs_get_profile_configs
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+ local subvol_mnt=$TEST_DIR/$seq.mnt
+
+ echo "Test $mkfs_opts" >>$seqres.full
+
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed" | tee -a $seqres.full
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start balance worker: " >>$seqres.full
+ _btrfs_stress_balance $SCRATCH_MNT >/dev/null 2>&1 &
+ balance_pid=$!
+ echo "$balance_pid" >>$seqres.full
+
+ echo -n "Start subvolume worker: " >>$seqres.full
+ _btrfs_stress_subvolume $SCRATCH_DEV $SCRATCH_MNT subvol_$$ $subvol_mnt >/dev/null 2>&1 &
+ subvol_pid=$!
+ echo "$subvol_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+
+ kill $balance_pid $subvol_pid
+ wait
+ # wait for the balance operation to finish
+ while ps aux | grep "balance start" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ # in case the subvolume is still mounted
+ $UMOUNT_PROG $subvol_mnt >/dev/null 2>&1
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t"
+done
+
+status=0
+exit
diff --git a/tests/btrfs/059.out b/tests/btrfs/059.out
new file mode 100644
index 0000000..36ebeea
--- /dev/null
+++ b/tests/btrfs/059.out
@@ -0,0 +1,2 @@
+QA output created by 059
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index 3fa9778..c66c42c 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -61,3 +61,4 @@
056 auto quick
057 auto quick
058 auto quick
+059 auto balance subvol
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* [PATCH v3 02/15] btrfs: new test to run btrfs balance and scrub simultaneously
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
2014-09-18 5:49 ` [PATCH v3 01/15] btrfs: new test to run btrfs balance and subvolume test simultaneously Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-18 5:49 ` [PATCH v3 03/15] btrfs: new test to run btrfs balance and defrag operations simultaneously Eryu Guan
` (14 subsequent siblings)
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs balance and scrub operations simultaneously with fsstress
running in background.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
common/rc | 9 +++++
tests/btrfs/060 | 114 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/060.out | 2 +
tests/btrfs/group | 1 +
4 files changed, 126 insertions(+)
create mode 100755 tests/btrfs/060
create mode 100644 tests/btrfs/060.out
diff --git a/common/rc b/common/rc
index a0677da..cc5901f 100644
--- a/common/rc
+++ b/common/rc
@@ -2585,6 +2585,15 @@ _btrfs_stress_subvolume()
done
}
+# stress btrfs by running scrub in a loop
+_btrfs_stress_scrub()
+{
+ local btrfs_mnt=$1
+ while true; do
+ $BTRFS_UTIL_PROG scrub start -B $btrfs_mnt
+ done
+}
+
init_rc()
{
if [ "$iam" == new ]
diff --git a/tests/btrfs/060 b/tests/btrfs/060
new file mode 100755
index 0000000..b270c7b
--- /dev/null
+++ b/tests/btrfs/060
@@ -0,0 +1,114 @@
+#! /bin/bash
+# FSQA Test No. btrfs/060
+#
+# Run btrfs balance and scrub operations simultaneously with fsstress
+# running in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 4
+_btrfs_get_profile_configs
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+
+ echo "Test $mkfs_opts" >>$seqres.full
+
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed"
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start balance worker: " >>$seqres.full
+ _btrfs_stress_balance $SCRATCH_MNT >/dev/null 2>&1 &
+ balance_pid=$!
+ echo "$balance_pid" >>$seqres.full
+
+ echo -n "Start scrub worker: " >>$seqres.full
+ _btrfs_stress_scrub $SCRATCH_MNT >/dev/null 2>&1 &
+ scrub_pid=$!
+ echo "$scrub_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+ kill $balance_pid $scrub_pid
+ wait
+ # wait for the balance and scrub operations to finish
+ while ps aux | grep "balance start" | grep -qv grep; do
+ sleep 1
+ done
+ while ps aux | grep "scrub start" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t"
+done
+
+status=0
+exit
diff --git a/tests/btrfs/060.out b/tests/btrfs/060.out
new file mode 100644
index 0000000..8ffce4d
--- /dev/null
+++ b/tests/btrfs/060.out
@@ -0,0 +1,2 @@
+QA output created by 060
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index c66c42c..1c60c8f 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -62,3 +62,4 @@
057 auto quick
058 auto quick
059 auto balance subvol
+060 auto balance scrub
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* [PATCH v3 03/15] btrfs: new test to run btrfs balance and defrag operations simultaneously
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
2014-09-18 5:49 ` [PATCH v3 01/15] btrfs: new test to run btrfs balance and subvolume test simultaneously Eryu Guan
2014-09-18 5:49 ` [PATCH v3 02/15] btrfs: new test to run btrfs balance and scrub simultaneously Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-18 5:49 ` [PATCH v3 04/15] btrfs: new case to run btrfs balance and remount with different compress algorithms Eryu Guan
` (13 subsequent siblings)
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs balance and defrag operations simultaneously with fsstress
running in background.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
common/rc | 20 +++++++++
tests/btrfs/061 | 116 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/061.out | 2 +
tests/btrfs/group | 1 +
4 files changed, 139 insertions(+)
create mode 100755 tests/btrfs/061
create mode 100644 tests/btrfs/061.out
diff --git a/common/rc b/common/rc
index cc5901f..a333af8 100644
--- a/common/rc
+++ b/common/rc
@@ -2594,6 +2594,26 @@ _btrfs_stress_scrub()
done
}
+# stress btrfs by defragmenting every file/dir in a loop and compress file
+# contents while defragmenting if second argument is not "nocompress"
+_btrfs_stress_defrag()
+{
+ local btrfs_mnt=$1
+ local compress=$2
+
+ while true; do
+ if [ "$compress" == "nocompress" ]; then
+ find $btrfs_mnt \( -type f -o -type d \) -exec \
+ $BTRFS_UTIL_PROG filesystem defrag {} \;
+ else
+ find $btrfs_mnt \( -type f -o -type d \) -exec \
+ $BTRFS_UTIL_PROG filesystem defrag -clzo {} \;
+ find $btrfs_mnt \( -type f -o -type d \) -exec \
+ $BTRFS_UTIL_PROG filesystem defrag -czlib {} \;
+ fi
+ done
+}
+
init_rc()
{
if [ "$iam" == new ]
diff --git a/tests/btrfs/061 b/tests/btrfs/061
new file mode 100755
index 0000000..4aeb366
--- /dev/null
+++ b/tests/btrfs/061
@@ -0,0 +1,116 @@
+#! /bin/bash
+# FSQA Test No. btrfs/061
+#
+# Run btrfs balance and defrag operations simultaneously with fsstress
+# running in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 4
+_btrfs_get_profile_configs
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+ local with_compress=$2
+
+ echo "Test $mkfs_opts with $with_compress" >>$seqres.full
+
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed"
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start balance worker: " >>$seqres.full
+ _btrfs_stress_balance $SCRATCH_MNT >/dev/null 2>&1 &
+ balance_pid=$!
+ echo "$balance_pid" >>$seqres.full
+
+ echo -n "Start defrag worker: " >>$seqres.full
+ _btrfs_stress_defrag $SCRATCH_MNT $with_compress >/dev/null 2>&1 &
+ defrag_pid=$!
+ echo "$defrag_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+ kill $balance_pid $defrag_pid
+ wait
+ # wait for the balance and defrag operations to finish
+ while ps aux | grep "balance start" | grep -qv grep; do
+ sleep 1
+ done
+ while ps aux | grep "btrfs filesystem defrag" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t" nocompress
+ run_test "$t" compress
+done
+
+status=0
+exit
diff --git a/tests/btrfs/061.out b/tests/btrfs/061.out
new file mode 100644
index 0000000..273be9e
--- /dev/null
+++ b/tests/btrfs/061.out
@@ -0,0 +1,2 @@
+QA output created by 061
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index 1c60c8f..85d30b3 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -63,3 +63,4 @@
058 auto quick
059 auto balance subvol
060 auto balance scrub
+061 auto balance defrag compress
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* [PATCH v3 04/15] btrfs: new case to run btrfs balance and remount with different compress algorithms
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
` (2 preceding siblings ...)
2014-09-18 5:49 ` [PATCH v3 03/15] btrfs: new test to run btrfs balance and defrag operations simultaneously Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-18 5:49 ` [PATCH v3 05/15] btrfs: new case to run btrfs balance and device replace operations simultaneously Eryu Guan
` (12 subsequent siblings)
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs balance and remount with different compress algorithms
simultaneously, with fsstress running in background.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
common/rc | 14 +++++++
tests/btrfs/062 | 114 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/062.out | 2 +
tests/btrfs/group | 1 +
4 files changed, 131 insertions(+)
create mode 100755 tests/btrfs/062
create mode 100644 tests/btrfs/062.out
diff --git a/common/rc b/common/rc
index a333af8..571dfad 100644
--- a/common/rc
+++ b/common/rc
@@ -2614,6 +2614,20 @@ _btrfs_stress_defrag()
done
}
+# stress btrfs by remounting it with different compression algorithms in a loop
+# run this with fsstress running at background could exercise the compression
+# code path and ensure no race when switching compression algorithm with constant
+# I/O activity.
+_btrfs_stress_remount_compress()
+{
+ local btrfs_mnt=$1
+ while true; do
+ for algo in no zlib lzo; do
+ $MOUNT_PROG -o remount,compress=$algo $btrfs_mnt
+ done
+ done
+}
+
init_rc()
{
if [ "$iam" == new ]
diff --git a/tests/btrfs/062 b/tests/btrfs/062
new file mode 100755
index 0000000..274da5c
--- /dev/null
+++ b/tests/btrfs/062
@@ -0,0 +1,114 @@
+#! /bin/bash
+# FSQA Test No. btrfs/062
+#
+# Run btrfs balance and remount with different compress algorithms
+# simultaneously, with fsstress running in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 4
+_btrfs_get_profile_configs
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+
+ echo "Test $mkfs_opts" >>$seqres.full
+
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed"
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start balance worker: " >>$seqres.full
+ _btrfs_stress_balance $SCRATCH_MNT >/dev/null 2>&1 &
+ balance_pid=$!
+ echo "$balance_pid" >>$seqres.full
+
+ echo -n "Start remount worker: " >>$seqres.full
+ _btrfs_stress_remount_compress $SCRATCH_MNT >/dev/null 2>&1 &
+ remount_pid=$!
+ echo "$remount_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+ kill $balance_pid $remount_pid
+ wait
+ # wait for the balance and remount loop to finish
+ while ps aux | grep "balance start" | grep -qv grep; do
+ sleep 1
+ done
+ while ps aux | grep "mount.*$SCRATCH_MNT" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t"
+done
+
+status=0
+exit
diff --git a/tests/btrfs/062.out b/tests/btrfs/062.out
new file mode 100644
index 0000000..a1578f4
--- /dev/null
+++ b/tests/btrfs/062.out
@@ -0,0 +1,2 @@
+QA output created by 062
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index 85d30b3..7aa9bf3 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -64,3 +64,4 @@
059 auto balance subvol
060 auto balance scrub
061 auto balance defrag compress
+062 auto balance remount compress
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* [PATCH v3 05/15] btrfs: new case to run btrfs balance and device replace operations simultaneously
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
` (3 preceding siblings ...)
2014-09-18 5:49 ` [PATCH v3 04/15] btrfs: new case to run btrfs balance and remount with different compress algorithms Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-18 5:49 ` [PATCH v3 06/15] btrfs: new case to run btrfs subvolume create/delete operations and device replace simultaneously Eryu Guan
` (11 subsequent siblings)
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs balance and replace operations simultaneously with fsstress
running in background.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
common/rc | 73 +++++++++++++++++++++++++++++++
tests/btrfs/063 | 122 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/063.out | 2 +
tests/btrfs/group | 1 +
4 files changed, 198 insertions(+)
create mode 100755 tests/btrfs/063
create mode 100644 tests/btrfs/063.out
diff --git a/common/rc b/common/rc
index 571dfad..3291823 100644
--- a/common/rc
+++ b/common/rc
@@ -2157,6 +2157,24 @@ _require_scratch_dev_pool()
done
}
+# ensure devices in SCRATCH_DEV_POOL are of the same size
+# must be called after _require_scratch_dev_pool
+_require_scratch_dev_pool_equal_size()
+{
+ local _size
+ local _newsize
+ local _dev
+
+ # SCRATCH_DEV has been set to the first device in SCRATCH_DEV_POOL
+ _size=`_get_device_size $SCRATCH_DEV`
+ for _dev in $SCRATCH_DEV_POOL; do
+ _newsize=`_get_device_size $_dev`
+ if [ $_size -ne $_newsize ]; then
+ _notrun "This test requires devices in SCRATCH_DEV_POOL have the same size"
+ fi
+ done
+}
+
# We will check if the device is deletable
_require_deletable_scratch_dev_pool()
{
@@ -2628,6 +2646,61 @@ _btrfs_stress_remount_compress()
done
}
+# stress btrfs by replacing devices in a loop
+# Note that at least 3 devices are needed in SCRATCH_DEV_POOL and the last
+# device should be free(not used by btrfs)
+_btrfs_stress_replace()
+{
+ local btrfs_mnt=$1
+
+ # The device number in SCRATCH_DEV_POOL should be at least 3,
+ # one is SCRATCH_DEV, one is to be replaced, one is free device
+ # we won't replace SCRATCH_DEV, see below for reason
+ if [ "`echo $SCRATCH_DEV_POOL | wc -w`" -lt 3 ]; then
+ echo "_btrfs_stress_replace requires at least 3 devices in SCRATCH_DEV_POOL"
+ return
+ fi
+
+ # take the last device as the first free_dev
+ local free_dev="`echo $SCRATCH_DEV_POOL | $AWK_PROG '{print $NF}'`"
+
+ # free_dev should be really free
+ if $BTRFS_UTIL_PROG filesystem show | grep -q "$free_dev"; then
+ echo "_btrfs_stress_replace: $free_dev is used by btrfs"
+ return
+ fi
+
+ # dev_pool is device list being currently used by btrfs (excluding SCRATCH_DEV)
+ # and can be replaced. We don't replace SCRATCH_DEV because it will be used in
+ # _scratch_mount and _check_scratch_fs etc.
+ local dev_pool=`echo $SCRATCH_DEV_POOL | sed -e "s# *$SCRATCH_DEV *##" \
+ -e "s# *$free_dev *##"`
+
+ # set the first device in dev_pool as the first src_dev to be replaced
+ local src_dev=`echo $dev_pool | $AWK_PROG '{print $1}'`
+
+ echo "dev_pool=$dev_pool"
+ echo "free_dev=$free_dev, src_dev=$src_dev"
+ while true; do
+ echo "Replacing $src_dev with $free_dev"
+ $BTRFS_UTIL_PROG replace start -fB $src_dev $free_dev $btrfs_mnt
+ if [ $? -ne 0 ]; then
+ # don't update src_dev and free_dev if replace failed
+ continue
+ fi
+ dev_pool="$dev_pool $free_dev"
+ dev_pool=`echo $dev_pool | sed -e "s# *$src_dev *##"`
+ free_dev=$src_dev
+ src_dev=`echo $dev_pool | $AWK_PROG '{print $1}'`
+ done
+}
+
+# return device size in kb
+_get_device_size()
+{
+ grep `_short_dev $1` /proc/partitions | awk '{print $3}'
+}
+
init_rc()
{
if [ "$iam" == new ]
diff --git a/tests/btrfs/063 b/tests/btrfs/063
new file mode 100755
index 0000000..94adc21
--- /dev/null
+++ b/tests/btrfs/063
@@ -0,0 +1,122 @@
+#! /bin/bash
+# FSQA Test No. btrfs/063
+#
+# Run btrfs balance and replace operations simultaneously with fsstress
+# running in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 5
+_require_scratch_dev_pool_equal_size
+_btrfs_get_profile_configs replace
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+ local saved_scratch_dev_pool=$SCRATCH_DEV_POOL
+
+ echo "Test $mkfs_opts" >>$seqres.full
+
+ # remove the last device from the SCRATCH_DEV_POOL list so
+ # _scratch_pool_mkfs won't use all devices in pool
+ local last_dev="`echo $SCRATCH_DEV_POOL | $AWK_PROG '{print $NF}'`"
+ SCRATCH_DEV_POOL=`echo $SCRATCH_DEV_POOL | sed -e "s# *$last_dev *##"`
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed"
+ SCRATCH_DEV_POOL=$saved_scratch_dev_pool
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+ SCRATCH_DEV_POOL=$saved_scratch_dev_pool
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start balance worker: " >>$seqres.full
+ _btrfs_stress_balance $SCRATCH_MNT >/dev/null 2>&1 &
+ balance_pid=$!
+ echo "$balance_pid" >>$seqres.full
+
+ echo -n "Start replace worker: " >>$seqres.full
+ _btrfs_stress_replace $SCRATCH_MNT >>$seqres.full 2>&1 &
+ replace_pid=$!
+ echo "$replace_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+ kill $balance_pid $replace_pid
+ wait
+ # wait for the balance and replace operations to finish
+ while ps aux | grep "balance start" | grep -qv grep; do
+ sleep 1
+ done
+ while ps aux | grep "replace start" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t"
+done
+
+status=0
+exit
diff --git a/tests/btrfs/063.out b/tests/btrfs/063.out
new file mode 100644
index 0000000..de35fc5
--- /dev/null
+++ b/tests/btrfs/063.out
@@ -0,0 +1,2 @@
+QA output created by 063
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index 7aa9bf3..e234bc2 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -65,3 +65,4 @@
060 auto balance scrub
061 auto balance defrag compress
062 auto balance remount compress
+063 auto balance replace
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* [PATCH v3 06/15] btrfs: new case to run btrfs subvolume create/delete operations and device replace simultaneously
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
` (4 preceding siblings ...)
2014-09-18 5:49 ` [PATCH v3 05/15] btrfs: new case to run btrfs balance and device replace operations simultaneously Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-18 5:49 ` [PATCH v3 07/15] btrfs: new case to run btrfs subvolume create/delete operations and scrub simultaneously Eryu Guan
` (10 subsequent siblings)
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs subvolume create/mount/umount/delete and device replace
operation simultaneously, with fsstress running in background.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
tests/btrfs/064 | 123 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/064.out | 2 +
tests/btrfs/group | 1 +
3 files changed, 126 insertions(+)
create mode 100755 tests/btrfs/064
create mode 100644 tests/btrfs/064.out
diff --git a/tests/btrfs/064 b/tests/btrfs/064
new file mode 100755
index 0000000..319e480
--- /dev/null
+++ b/tests/btrfs/064
@@ -0,0 +1,123 @@
+#! /bin/bash
+# FSQA Test No. btrfs/064
+#
+# Run btrfs subvolume create/mount/umount/delete and device replace
+# operation simultaneously, with fsstress running in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 5
+_require_scratch_dev_pool_equal_size
+_btrfs_get_profile_configs replace
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+ local saved_scratch_dev_pool=$SCRATCH_DEV_POOL
+ local subvol_mnt=$TEST_DIR/$seq.mnt
+
+ echo "Test $mkfs_opts" >>$seqres.full
+
+ # remove the last device from the SCRATCH_DEV_POOL list so
+ # _scratch_pool_mkfs won't use all devices in pool
+ local last_dev="`echo $SCRATCH_DEV_POOL | $AWK_PROG '{print $NF}'`"
+ SCRATCH_DEV_POOL=`echo $SCRATCH_DEV_POOL | sed -e "s# *$last_dev *##"`
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed"
+ SCRATCH_DEV_POOL=$saved_scratch_dev_pool
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+ SCRATCH_DEV_POOL=$saved_scratch_dev_pool
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start subvolume worker: " >>$seqres.full
+ _btrfs_stress_subvolume $SCRATCH_DEV $SCRATCH_MNT subvol_$$ $subvol_mnt >/dev/null 2>&1 &
+ subvol_pid=$!
+ echo "$subvol_pid" >>$seqres.full
+
+ echo -n "Start replace worker: " >>$seqres.full
+ _btrfs_stress_replace $SCRATCH_MNT >>$seqres.full 2>&1 &
+ replace_pid=$!
+ echo "$replace_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+
+ kill $subvol_pid $replace_pid
+ wait
+ # wait for the replace operation to finish
+ while ps aux | grep "replace start" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ # in case the subvolume is still mounted
+ $UMOUNT_PROG $subvol_mnt >/dev/null 2>&1
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t"
+done
+
+status=0
+exit
diff --git a/tests/btrfs/064.out b/tests/btrfs/064.out
new file mode 100644
index 0000000..d907654
--- /dev/null
+++ b/tests/btrfs/064.out
@@ -0,0 +1,2 @@
+QA output created by 064
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index e234bc2..a214920 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -66,3 +66,4 @@
061 auto balance defrag compress
062 auto balance remount compress
063 auto balance replace
+064 auto subvol replace
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* [PATCH v3 07/15] btrfs: new case to run btrfs subvolume create/delete operations and scrub simultaneously
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
` (5 preceding siblings ...)
2014-09-18 5:49 ` [PATCH v3 06/15] btrfs: new case to run btrfs subvolume create/delete operations and device replace simultaneously Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-18 5:49 ` [PATCH v3 08/15] btrfs: new case to run btrfs subvolume create/delete and defrag operations simultaneously Eryu Guan
` (9 subsequent siblings)
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs subvolume create/mount/umount/delete and btrfs scrub
operation simultaneously, with fsstress running in background.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
tests/btrfs/065 | 115 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/065.out | 2 +
tests/btrfs/group | 1 +
3 files changed, 118 insertions(+)
create mode 100755 tests/btrfs/065
create mode 100644 tests/btrfs/065.out
diff --git a/tests/btrfs/065 b/tests/btrfs/065
new file mode 100755
index 0000000..14fee63
--- /dev/null
+++ b/tests/btrfs/065
@@ -0,0 +1,115 @@
+#! /bin/bash
+# FSQA Test No. btrfs/065
+#
+# Run btrfs subvolume create/mount/umount/delete and btrfs scrub
+# operation simultaneously, with fsstress running in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 4
+_btrfs_get_profile_configs
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+ local subvol_mnt=$TEST_DIR/$seq.mnt
+
+ echo "Test $mkfs_opts" >>$seqres.full
+
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed"
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start subvolume worker: " >>$seqres.full
+ _btrfs_stress_subvolume $SCRATCH_DEV $SCRATCH_MNT subvol_$$ $subvol_mnt >/dev/null 2>&1 &
+ subvol_pid=$!
+ echo "$subvol_pid" >>$seqres.full
+
+ echo -n "Start scrub worker: " >>$seqres.full
+ _btrfs_stress_scrub $SCRATCH_MNT >/dev/null 2>&1 &
+ scrub_pid=$!
+ echo "$scrub_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+
+ kill $subvol_pid $scrub_pid
+ wait
+ # wait for the scrub operation to finish
+ while ps aux | grep "scrub start" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ # in case the subvolume is still mounted
+ $UMOUNT_PROG $subvol_mnt >/dev/null 2>&1
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t"
+done
+
+status=0
+exit
diff --git a/tests/btrfs/065.out b/tests/btrfs/065.out
new file mode 100644
index 0000000..94476cd
--- /dev/null
+++ b/tests/btrfs/065.out
@@ -0,0 +1,2 @@
+QA output created by 065
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index a214920..4685970 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -67,3 +67,4 @@
062 auto balance remount compress
063 auto balance replace
064 auto subvol replace
+065 auto subvol scrub
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* [PATCH v3 08/15] btrfs: new case to run btrfs subvolume create/delete and defrag operations simultaneously
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
` (6 preceding siblings ...)
2014-09-18 5:49 ` [PATCH v3 07/15] btrfs: new case to run btrfs subvolume create/delete operations and scrub simultaneously Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-18 5:49 ` [PATCH v3 09/15] btrfs: new case to run subvolume create/delete and remount with defferent compress algorithms Eryu Guan
` (8 subsequent siblings)
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs subvolume create/mount/umount/delete and btrfs defrag
operations simultaneously, with fsstress running in backgound.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
tests/btrfs/066 | 117 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/066.out | 2 +
tests/btrfs/group | 1 +
3 files changed, 120 insertions(+)
create mode 100755 tests/btrfs/066
create mode 100644 tests/btrfs/066.out
diff --git a/tests/btrfs/066 b/tests/btrfs/066
new file mode 100755
index 0000000..d8e165d
--- /dev/null
+++ b/tests/btrfs/066
@@ -0,0 +1,117 @@
+#! /bin/bash
+# FSQA Test No. btrfs/066
+#
+# Run btrfs subvolume create/mount/umount/delete and btrfs defrag
+# operation simultaneously, with fsstress running in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 4
+_btrfs_get_profile_configs
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+ local with_compress=$2
+ local subvol_mnt=$TEST_DIR/$seq.mnt
+
+ echo "Test $mkfs_opts with $with_compress" >>$seqres.full
+
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed"
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start subvolume worker: " >>$seqres.full
+ _btrfs_stress_subvolume $SCRATCH_DEV $SCRATCH_MNT subvol_$$ $subvol_mnt >/dev/null 2>&1 &
+ subvol_pid=$!
+ echo "$subvol_pid" >>$seqres.full
+
+ echo -n "Start defrag worker: " >>$seqres.full
+ _btrfs_stress_defrag $SCRATCH_MNT $with_compress >/dev/null 2>&1 &
+ defrag_pid=$!
+ echo "$defrag_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+
+ kill $subvol_pid $defrag_pid
+ wait
+ # wait for btrfs defrag process to exit, otherwise it will block umount
+ while ps aux | grep "btrfs filesystem defrag" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ # in case the subvolume is still mounted
+ $UMOUNT_PROG $subvol_mnt >/dev/null 2>&1
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t" nocompress
+ run_test "$t" compress
+done
+
+status=0
+exit
diff --git a/tests/btrfs/066.out b/tests/btrfs/066.out
new file mode 100644
index 0000000..b60cc24
--- /dev/null
+++ b/tests/btrfs/066.out
@@ -0,0 +1,2 @@
+QA output created by 066
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index 4685970..bbfbb6a 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -68,3 +68,4 @@
063 auto balance replace
064 auto subvol replace
065 auto subvol scrub
+066 auto subvol defrag compress
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* [PATCH v3 09/15] btrfs: new case to run subvolume create/delete and remount with defferent compress algorithms
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
` (7 preceding siblings ...)
2014-09-18 5:49 ` [PATCH v3 08/15] btrfs: new case to run btrfs subvolume create/delete and defrag operations simultaneously Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-18 5:49 ` [PATCH v3 10/15] btrfs: new case to run device replace and scrub operations simultaneously Eryu Guan
` (7 subsequent siblings)
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs subvolume create/mount/umount/delete and remount with
different compress algorithms simultaneously, with fsstress running in
background.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
tests/btrfs/067 | 116 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/067.out | 2 +
tests/btrfs/group | 1 +
3 files changed, 119 insertions(+)
create mode 100755 tests/btrfs/067
create mode 100644 tests/btrfs/067.out
diff --git a/tests/btrfs/067 b/tests/btrfs/067
new file mode 100755
index 0000000..033f3a5
--- /dev/null
+++ b/tests/btrfs/067
@@ -0,0 +1,116 @@
+#! /bin/bash
+# FSQA Test No. btrfs/067
+#
+# Run btrfs subvolume create/mount/umount/delete and remount with
+# different compress algorithms simultaneously, with fsstress running
+# in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 4
+_btrfs_get_profile_configs
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+ local subvol_mnt=$TEST_DIR/$seq.mnt
+
+ echo "Test $mkfs_opts with $with_compress" >>$seqres.full
+
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed"
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start subvolume worker: " >>$seqres.full
+ _btrfs_stress_subvolume $SCRATCH_DEV $SCRATCH_MNT subvol_$$ $subvol_mnt >/dev/null 2>&1 &
+ subvol_pid=$!
+ echo "$subvol_pid" >>$seqres.full
+
+ echo -n "Start remount worker: " >>$seqres.full
+ _btrfs_stress_remount_compress $SCRATCH_MNT >/dev/null 2>&1 &
+ remount_pid=$!
+ echo "$remount_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+
+ kill $subvol_pid $remount_pid
+ wait
+ # wait for the remount loop process to finish
+ while ps aux | grep "mount.*$SCRATCH_MNT" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ # in case the subvolume is still mounted
+ $UMOUNT_PROG $subvol_mnt >/dev/null 2>&1
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t"
+done
+
+status=0
+exit
diff --git a/tests/btrfs/067.out b/tests/btrfs/067.out
new file mode 100644
index 0000000..daa1545
--- /dev/null
+++ b/tests/btrfs/067.out
@@ -0,0 +1,2 @@
+QA output created by 067
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index bbfbb6a..d515ff5 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -69,3 +69,4 @@
064 auto subvol replace
065 auto subvol scrub
066 auto subvol defrag compress
+067 auto subvol remount compress
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* [PATCH v3 10/15] btrfs: new case to run device replace and scrub operations simultaneously
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
` (8 preceding siblings ...)
2014-09-18 5:49 ` [PATCH v3 09/15] btrfs: new case to run subvolume create/delete and remount with defferent compress algorithms Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-18 5:49 ` [PATCH v3 11/15] btrfs: new case to run device replace and defrag " Eryu Guan
` (6 subsequent siblings)
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs replace operations and scrub simultaneously with fsstress
running in background.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
tests/btrfs/068 | 123 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/068.out | 2 +
tests/btrfs/group | 1 +
3 files changed, 126 insertions(+)
create mode 100755 tests/btrfs/068
create mode 100644 tests/btrfs/068.out
diff --git a/tests/btrfs/068 b/tests/btrfs/068
new file mode 100755
index 0000000..220e608
--- /dev/null
+++ b/tests/btrfs/068
@@ -0,0 +1,123 @@
+#! /bin/bash
+# FSQA Test No. btrfs/068
+#
+# Run btrfs replace operations and scrub simultaneously with fsstress
+# running in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 5
+_require_scratch_dev_pool_equal_size
+_btrfs_get_profile_configs replace
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+ local saved_scratch_dev_pool=$SCRATCH_DEV_POOL
+
+ echo "Test $mkfs_opts" >>$seqres.full
+
+ # remove the last device from the SCRATCH_DEV_POOL list so
+ # _scratch_pool_mkfs won't use all devices in pool
+ local last_dev="`echo $SCRATCH_DEV_POOL | $AWK_PROG '{print $NF}'`"
+ SCRATCH_DEV_POOL=`echo $SCRATCH_DEV_POOL | sed -e "s# *$last_dev *##"`
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed"
+ SCRATCH_DEV_POOL=$saved_scratch_dev_pool
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+ SCRATCH_DEV_POOL=$saved_scratch_dev_pool
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start replace worker: " >>$seqres.full
+ _btrfs_stress_replace $SCRATCH_MNT >>$seqres.full 2>&1 &
+ replace_pid=$!
+ echo "$replace_pid" >>$seqres.full
+
+ echo -n "Start scrub worker: " >>$seqres.full
+ _btrfs_stress_scrub $SCRATCH_MNT >/dev/null 2>&1 &
+ scrub_pid=$!
+ echo "$scrub_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+ kill $replace_pid $scrub_pid
+ wait
+
+ # wait for the scrub and replace operations to finish
+ while ps aux | grep "scrub start" | grep -qv grep; do
+ sleep 1
+ done
+ while ps aux | grep "replace start" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t"
+done
+
+status=0
+exit
diff --git a/tests/btrfs/068.out b/tests/btrfs/068.out
new file mode 100644
index 0000000..d10c9bd
--- /dev/null
+++ b/tests/btrfs/068.out
@@ -0,0 +1,2 @@
+QA output created by 068
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index d515ff5..1e83505 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -70,3 +70,4 @@
065 auto subvol scrub
066 auto subvol defrag compress
067 auto subvol remount compress
+068 auto replace scrub
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* [PATCH v3 11/15] btrfs: new case to run device replace and defrag operations simultaneously
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
` (9 preceding siblings ...)
2014-09-18 5:49 ` [PATCH v3 10/15] btrfs: new case to run device replace and scrub operations simultaneously Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-18 5:49 ` [PATCH v3 12/15] btrfs: new case to run device replace and remount with different compress algorithms simultaneously Eryu Guan
` (5 subsequent siblings)
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs replace operations and defrag simultaneously with fsstress
running in background.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
tests/btrfs/069 | 125 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/069.out | 2 +
tests/btrfs/group | 1 +
3 files changed, 128 insertions(+)
create mode 100755 tests/btrfs/069
create mode 100644 tests/btrfs/069.out
diff --git a/tests/btrfs/069 b/tests/btrfs/069
new file mode 100755
index 0000000..882b34b
--- /dev/null
+++ b/tests/btrfs/069
@@ -0,0 +1,125 @@
+#! /bin/bash
+# FSQA Test No. btrfs/069
+#
+# Run btrfs replace operations and defrag simultaneously with fsstress
+# running in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 5
+_require_scratch_dev_pool_equal_size
+_btrfs_get_profile_configs replace
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+ local with_compress=$2
+ local saved_scratch_dev_pool=$SCRATCH_DEV_POOL
+
+ echo "Test $mkfs_opts with $with_compress" >>$seqres.full
+
+ # remove the last device from the SCRATCH_DEV_POOL list so
+ # _scratch_pool_mkfs won't use all devices in pool
+ local last_dev="`echo $SCRATCH_DEV_POOL | $AWK_PROG '{print $NF}'`"
+ SCRATCH_DEV_POOL=`echo $SCRATCH_DEV_POOL | sed -e "s# *$last_dev *##"`
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed"
+ SCRATCH_DEV_POOL=$saved_scratch_dev_pool
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+ SCRATCH_DEV_POOL=$saved_scratch_dev_pool
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start replace worker: " >>$seqres.full
+ _btrfs_stress_replace $SCRATCH_MNT >>$seqres.full 2>&1 &
+ replace_pid=$!
+ echo "$replace_pid" >>$seqres.full
+
+ echo -n "Start defrag worker: " >>$seqres.full
+ _btrfs_stress_defrag $SCRATCH_MNT $with_compress >/dev/null 2>&1 &
+ defrag_pid=$!
+ echo "$defrag_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+ kill $replace_pid $defrag_pid
+ wait
+
+ # wait for the defrag and replace operations to finish
+ while ps aux | grep "btrfs filesystem defrag" | grep -qv grep; do
+ sleep 1
+ done
+ while ps aux | grep "replace start" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t" nocompress
+ run_test "$t" compress
+done
+
+status=0
+exit
diff --git a/tests/btrfs/069.out b/tests/btrfs/069.out
new file mode 100644
index 0000000..532a929
--- /dev/null
+++ b/tests/btrfs/069.out
@@ -0,0 +1,2 @@
+QA output created by 069
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index 1e83505..53f5f4b 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -71,3 +71,4 @@
066 auto subvol defrag compress
067 auto subvol remount compress
068 auto replace scrub
+069 auto replace defrag compress
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* [PATCH v3 12/15] btrfs: new case to run device replace and remount with different compress algorithms simultaneously
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
` (10 preceding siblings ...)
2014-09-18 5:49 ` [PATCH v3 11/15] btrfs: new case to run device replace and defrag " Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-18 5:49 ` [PATCH v3 13/15] btrfs: new case to run btrfs scrub and defrag operations simultaneously Eryu Guan
` (4 subsequent siblings)
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs replace operations and remount with different compress
algorithms simultaneously with fsstress running in background.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
tests/btrfs/070 | 123 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/070.out | 2 +
tests/btrfs/group | 1 +
3 files changed, 126 insertions(+)
create mode 100755 tests/btrfs/070
create mode 100644 tests/btrfs/070.out
diff --git a/tests/btrfs/070 b/tests/btrfs/070
new file mode 100755
index 0000000..4f76455
--- /dev/null
+++ b/tests/btrfs/070
@@ -0,0 +1,123 @@
+#! /bin/bash
+# FSQA Test No. btrfs/070
+#
+# Run btrfs replace operations and remount with different compress
+# algorithms simultaneously with fsstress running in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 5
+_require_scratch_dev_pool_equal_size
+_btrfs_get_profile_configs replace
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+ local saved_scratch_dev_pool=$SCRATCH_DEV_POOL
+
+ echo "Test $mkfs_opts" >>$seqres.full
+
+ # remove the last device from the SCRATCH_DEV_POOL list so
+ # _scratch_pool_mkfs won't use all devices in pool
+ local last_dev="`echo $SCRATCH_DEV_POOL | $AWK_PROG '{print $NF}'`"
+ SCRATCH_DEV_POOL=`echo $SCRATCH_DEV_POOL | sed -e "s# *$last_dev *##"`
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed"
+ SCRATCH_DEV_POOL=$saved_scratch_dev_pool
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+ SCRATCH_DEV_POOL=$saved_scratch_dev_pool
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start replace worker: " >>$seqres.full
+ _btrfs_stress_replace $SCRATCH_MNT >>$seqres.full 2>&1 &
+ replace_pid=$!
+ echo "$replace_pid" >>$seqres.full
+
+ echo -n "Start remount worker: " >>$seqres.full
+ _btrfs_stress_remount_compress $SCRATCH_MNT >/dev/null 2>&1 &
+ remount_pid=$!
+ echo "$remount_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+ kill $replace_pid $remount_pid
+ wait
+
+ # wait for the remount and replace operations to finish
+ while ps aux | grep "btrfs filesystem defrag" | grep -qv grep; do
+ sleep 1
+ done
+ while ps aux | grep "mount.*$SCRATCH_MNT" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t"
+done
+
+status=0
+exit
diff --git a/tests/btrfs/070.out b/tests/btrfs/070.out
new file mode 100644
index 0000000..8940c5d
--- /dev/null
+++ b/tests/btrfs/070.out
@@ -0,0 +1,2 @@
+QA output created by 070
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index 53f5f4b..f68370d 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -72,3 +72,4 @@
067 auto subvol remount compress
068 auto replace scrub
069 auto replace defrag compress
+070 auto replace remount compress
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* [PATCH v3 13/15] btrfs: new case to run btrfs scrub and defrag operations simultaneously
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
` (11 preceding siblings ...)
2014-09-18 5:49 ` [PATCH v3 12/15] btrfs: new case to run device replace and remount with different compress algorithms simultaneously Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-18 5:49 ` [PATCH v3 14/15] btrfs: new case to run btrfs scrub and remount with different compress algorithms simultaneously Eryu Guan
` (3 subsequent siblings)
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs scrub and defrag operations simultaneously with fsstress
running in background.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
tests/btrfs/071 | 116 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/071.out | 2 +
tests/btrfs/group | 1 +
3 files changed, 119 insertions(+)
create mode 100755 tests/btrfs/071
create mode 100644 tests/btrfs/071.out
diff --git a/tests/btrfs/071 b/tests/btrfs/071
new file mode 100755
index 0000000..643b489
--- /dev/null
+++ b/tests/btrfs/071
@@ -0,0 +1,116 @@
+#! /bin/bash
+# FSQA Test No. btrfs/071
+#
+# Run btrfs scrub and defrag operations simultaneously with fsstress
+# running in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 4
+_btrfs_get_profile_configs
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+ local with_compress=$2
+
+ echo "Test $mkfs_opts with $with_compress" >>$seqres.full
+
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed"
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start scrub worker: " >>$seqres.full
+ _btrfs_stress_scrub $SCRATCH_MNT >/dev/null 2>&1 &
+ scrub_pid=$!
+ echo "$scrub_pid" >>$seqres.full
+
+ echo -n "Start defrag worker: " >>$seqres.full
+ _btrfs_stress_defrag $SCRATCH_MNT $with_compress >/dev/null 2>&1 &
+ defrag_pid=$!
+ echo "$defrag_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+ kill $scrub_pid $defrag_pid
+ wait
+ # wait for the scrub and defrag operations to finish
+ while ps aux | grep "scrub start" | grep -qv grep; do
+ sleep 1
+ done
+ while ps aux | grep "btrfs filesystem defrag" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t" nocompress
+ run_test "$t" compress
+done
+
+status=0
+exit
diff --git a/tests/btrfs/071.out b/tests/btrfs/071.out
new file mode 100644
index 0000000..9a9ef40
--- /dev/null
+++ b/tests/btrfs/071.out
@@ -0,0 +1,2 @@
+QA output created by 071
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index f68370d..5377acf 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -73,3 +73,4 @@
068 auto replace scrub
069 auto replace defrag compress
070 auto replace remount compress
+071 auto scrub defrag compress
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* [PATCH v3 14/15] btrfs: new case to run btrfs scrub and remount with different compress algorithms simultaneously
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
` (12 preceding siblings ...)
2014-09-18 5:49 ` [PATCH v3 13/15] btrfs: new case to run btrfs scrub and defrag operations simultaneously Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-18 5:49 ` [PATCH v3 15/15] btrfs: new case to run defrag " Eryu Guan
` (2 subsequent siblings)
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs scrub and remount with different compress algorithms
simultaneously with fsstress running in background.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
tests/btrfs/072 | 114 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/072.out | 2 +
tests/btrfs/group | 1 +
3 files changed, 117 insertions(+)
create mode 100755 tests/btrfs/072
create mode 100644 tests/btrfs/072.out
diff --git a/tests/btrfs/072 b/tests/btrfs/072
new file mode 100755
index 0000000..b185f85
--- /dev/null
+++ b/tests/btrfs/072
@@ -0,0 +1,114 @@
+#! /bin/bash
+# FSQA Test No. btrfs/072
+#
+# Run btrfs scrub and remount with different compress algorithms
+# simultaneously with fsstress running in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 4
+_btrfs_get_profile_configs
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+
+ echo "Test $mkfs_opts" >>$seqres.full
+
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed"
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start scrub worker: " >>$seqres.full
+ _btrfs_stress_scrub $SCRATCH_MNT >/dev/null 2>&1 &
+ scrub_pid=$!
+ echo "$scrub_pid" >>$seqres.full
+
+ echo -n "Start remount worker: " >>$seqres.full
+ _btrfs_stress_remount_compress $SCRATCH_MNT >/dev/null 2>&1 &
+ remount_pid=$!
+ echo "$remount_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+ kill $scrub_pid $remount_pid
+ wait
+ # wait for the scrub and remount operations to finish
+ while ps aux | grep "scrub start" | grep -qv grep; do
+ sleep 1
+ done
+ while ps aux | grep "mount.*$SCRATCH_MNT" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t"
+done
+
+status=0
+exit
diff --git a/tests/btrfs/072.out b/tests/btrfs/072.out
new file mode 100644
index 0000000..590bbc6
--- /dev/null
+++ b/tests/btrfs/072.out
@@ -0,0 +1,2 @@
+QA output created by 072
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index 5377acf..e631d5b 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -74,3 +74,4 @@
069 auto replace defrag compress
070 auto replace remount compress
071 auto scrub defrag compress
+072 auto scrub remount compress
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* [PATCH v3 15/15] btrfs: new case to run defrag and remount with different compress algorithms simultaneously
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
` (13 preceding siblings ...)
2014-09-18 5:49 ` [PATCH v3 14/15] btrfs: new case to run btrfs scrub and remount with different compress algorithms simultaneously Eryu Guan
@ 2014-09-18 5:49 ` Eryu Guan
2014-09-25 5:39 ` [PATCH v3 00/15] xfstests: new btrfs stress test cases Dave Chinner
2014-09-26 3:55 ` Eryu Guan
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-18 5:49 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs, Eryu Guan
Run btrfs defrag operations and remount with different compress
algorithms simultaneously with fsstress running in background.
Signed-off-by: Eryu Guan <eguan@redhat.com>
---
tests/btrfs/073 | 116 ++++++++++++++++++++++++++++++++++++++++++++++++++++
tests/btrfs/073.out | 2 +
tests/btrfs/group | 1 +
3 files changed, 119 insertions(+)
create mode 100755 tests/btrfs/073
create mode 100644 tests/btrfs/073.out
diff --git a/tests/btrfs/073 b/tests/btrfs/073
new file mode 100755
index 0000000..38c8356
--- /dev/null
+++ b/tests/btrfs/073
@@ -0,0 +1,116 @@
+#! /bin/bash
+# FSQA Test No. btrfs/073
+#
+# Run btrfs defrag operations and remount with different compress algorithms
+# simultaneously with fsstress running in background.
+#
+#-----------------------------------------------------------------------
+# Copyright (C) 2014 Red Hat Inc. All rights reserved.
+#
+# This program is free software; you can redistribute it and/or
+# modify it under the terms of the GNU General Public License as
+# published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it would be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write the Free Software Foundation,
+# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
+#
+#-----------------------------------------------------------------------
+#
+
+seq=`basename $0`
+seqres=$RESULT_DIR/$seq
+echo "QA output created by $seq"
+
+here=`pwd`
+tmp=/tmp/$$
+status=1
+trap "_cleanup; exit \$status" 0 1 2 3 15
+
+_cleanup()
+{
+ cd /
+ rm -f $tmp.*
+}
+
+# get standard environment, filters and checks
+. ./common/rc
+. ./common/filter
+
+# real QA test starts here
+_supported_fs btrfs
+_supported_os Linux
+# we check scratch dev after each loop
+_require_scratch_nocheck
+_require_scratch_dev_pool 4
+_btrfs_get_profile_configs
+
+rm -f $seqres.full
+
+run_test()
+{
+ local mkfs_opts=$1
+ local with_compress=$2
+
+ echo "Test $mkfs_opts with $with_compress" >>$seqres.full
+
+ _scratch_pool_mkfs $mkfs_opts >>$seqres.full 2>&1
+ # make sure we created btrfs with desired options
+ if [ $? -ne 0 ]; then
+ echo "mkfs $mkfs_opts failed"
+ return
+ fi
+ _scratch_mount >>$seqres.full 2>&1
+
+ args=`_scale_fsstress_args -p 20 -n 100 $FSSTRESS_AVOID -d $SCRATCH_MNT/stressdir`
+ echo "Run fsstress $args" >>$seqres.full
+ $FSSTRESS_PROG $args >/dev/null 2>&1 &
+ fsstress_pid=$!
+
+ echo -n "Start defrag worker: " >>$seqres.full
+ _btrfs_stress_defrag $SCRATCH_MNT $with_compress >/dev/null 2>&1 &
+ defrag_pid=$!
+ echo "$defrag_pid" >>$seqres.full
+
+ echo -n "Start remount worker: " >>$seqres.full
+ _btrfs_stress_remount_compress $SCRATCH_MNT >/dev/null 2>&1 &
+ remount_pid=$!
+ echo "$remount_pid" >>$seqres.full
+
+ echo "Wait for fsstress to exit and kill all background workers" >>$seqres.full
+ wait $fsstress_pid
+ kill $defrag_pid $remount_pid
+ wait
+ # wait for the defrag and remount operations to finish
+ while ps aux | grep "btrfs filesystem defrag" | grep -qv grep; do
+ sleep 1
+ done
+ while ps aux | grep "mount.*$SCRATCH_MNT" | grep -qv grep; do
+ sleep 1
+ done
+
+ echo "Scrub the filesystem" >>$seqres.full
+ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >>$seqres.full 2>&1
+ if [ $? -ne 0 ]; then
+ echo "Scrub find errors in \"$mkfs_opts\" test" | tee -a $seqres.full
+ fi
+
+ _scratch_unmount
+ # we called _require_scratch_nocheck instead of _require_scratch
+ # do check after test for each profile config
+ _check_scratch_fs
+}
+
+echo "Silence is golden"
+for t in "${_btrfs_profile_configs[@]}"; do
+ run_test "$t" nocompress
+ run_test "$t" compress
+done
+
+status=0
+exit
diff --git a/tests/btrfs/073.out b/tests/btrfs/073.out
new file mode 100644
index 0000000..d107704
--- /dev/null
+++ b/tests/btrfs/073.out
@@ -0,0 +1,2 @@
+QA output created by 073
+Silence is golden
diff --git a/tests/btrfs/group b/tests/btrfs/group
index e631d5b..2e3fb6a 100644
--- a/tests/btrfs/group
+++ b/tests/btrfs/group
@@ -75,3 +75,4 @@
070 auto replace remount compress
071 auto scrub defrag compress
072 auto scrub remount compress
+073 auto defrag remount compress
--
1.8.3.1
^ permalink raw reply related [flat|nested] 19+ messages in thread
* Re: [PATCH v3 00/15] xfstests: new btrfs stress test cases
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
` (14 preceding siblings ...)
2014-09-18 5:49 ` [PATCH v3 15/15] btrfs: new case to run defrag " Eryu Guan
@ 2014-09-25 5:39 ` Dave Chinner
2014-09-26 12:56 ` Josef Bacik
2014-09-26 3:55 ` Eryu Guan
16 siblings, 1 reply; 19+ messages in thread
From: Dave Chinner @ 2014-09-25 5:39 UTC (permalink / raw)
To: Eryu Guan; +Cc: fstests, linux-btrfs
Btrfs developers,
Can someone who knows how this is all supposed to work pass an eye
over this patch series to determine the validity of what is being
tested? Given the number of problems this patchset seems to expose,
it looks pretty important to me to get this into all of your regular
testing. I can't make judgement on whether the tests are valid
things to do to btrfs, so I'm reliant on people with actual btrfs
expertise to vet these patches...
-Dave.
On Thu, Sep 18, 2014 at 01:49:24PM +0800, Eryu Guan wrote:
> This patchset add new stress test cases for btrfs by running two
> different btrfs operations simultaneously under fsstress to ensure
> btrfs doesn't hang or oops in such situations. btrfs scrub and
> btrfs check will be run after each test.
>
> The test matrix is the combination of 6 btrfs operations:
>
> balance
> create/mount/umount/delete subvolume
> replace device
> scrub
> defrag
> remount with different compress algorithms
>
> Short descriptions:
>
> 059: balance-subvolume
> 060: balance-scrub
> 061: balance-defrag
> 062: balance-remount
> 063: balance-replace
> 064: subvolume-replace
> 065: subvolume-scrub
> 066: subvolume-defrag
> 067: subvolume-remount
> 068: replace-scrub
> 069: replace-defrag
> 070: replace-remount
> 071: scrub-defrag
> 072: scrub-remount
> 073: defrag-remount
>
> Some issues I've seen:
>
> 1. subvolume cannot be mounted with selinux context, so you may see
> such logs in dmesg
>
> SELinux: mount invalid. Same superblock, different security settings for (dev dm-8, type btrfs)
>
> I've reported the bug to btrfs list, see
> [BUG] cannot mount subvolume with selinux context
> http://www.spinics.net/lists/linux-btrfs/msg36779.html
>
> 2. btrfs replace operation always returns ENOENT if balance is running
> So in 063.full you'll see
>
> ERROR: ioctl(DEV_REPLACE_START) failed on "/mnt/testarea/scratch": No such file or directory, no error
>
> Not sure if it's btrfs bug, at least I think the error code is misleading
>
> 3. replace operation hangs the kernel(3.16-rc4+ and 3.17-rc2+) with fsstress running
> So case 064/068/069/070 will hang
>
>
> Changes since v2:
> - mount subvolume at $TEST_DIR/$seq.mnt not $tmp.mnt
> - don't rm -rf $tmp.* which is dangerous
> - remove unnecessary btrfs filesystem sync operation
> - update _scratch_pool_mkfs to deal with dup profile
> - add more comments for each stress operation
> - rename _btrfs_stress_remount to _btrfs_stress_remount_compress (hope it's better...)
> - add _btrfs_get_profile_configs to remove duplicated test case array in each case
> - use _require_scratch_nocheck and _check_scratch_fs after each loop
>
> Changes since v1:
> - put common operations in common/rc as functions and share them across these tests
> - append mkfs options to _scratch_mkfs and _scratch_pool_mkfs instead of updating $MKFS_OPTIONS
> - rebase on top of master and re-number starting from btrfs/059
>
> Thanks,
> Eryu Guan
>
> Eryu Guan (15):
> btrfs: new test to run btrfs balance and subvolume test simultaneously
> btrfs: new test to run btrfs balance and scrub simultaneously
> btrfs: new test to run btrfs balance and defrag operations simultaneously
> btrfs: new case to run btrfs balance and remount with different compress algorithms
> btrfs: new case to run btrfs balance and device replace operations simultaneously
> btrfs: new case to run btrfs subvolume create/delete operations and device replace simultaneously
> btrfs: new case to run btrfs subvolume create/delete operations and scrub simultaneously
> btrfs: new case to run btrfs subvolume create/delete and defrag operations simultaneously
> btrfs: new case to run subvolume create/delete and remount with defferent compress algorithms
> btrfs: new case to run device replace and scrub operations simultaneously
> btrfs: new case to run device replace and defrag operations simultaneously
> btrfs: new case to run device replace and remount with different compress algorithms simultaneously
> btrfs: new case to run btrfs scrub and defrag operations simultaneously
> btrfs: new case to run btrfs scrub and remount with different compress algorithms simultaneously
> btrfs: new case to run defrag and remount with different compress algorithms simultaneously
>
> common/rc | 225 +++++++++++++++++++++++++++++++++++++++++++++++++++-
> tests/btrfs/059 | 115 +++++++++++++++++++++++++++
> tests/btrfs/059.out | 2 +
> tests/btrfs/060 | 114 ++++++++++++++++++++++++++
> tests/btrfs/060.out | 2 +
> tests/btrfs/061 | 116 +++++++++++++++++++++++++++
> tests/btrfs/061.out | 2 +
> tests/btrfs/062 | 114 ++++++++++++++++++++++++++
> tests/btrfs/062.out | 2 +
> tests/btrfs/063 | 122 ++++++++++++++++++++++++++++
> tests/btrfs/063.out | 2 +
> tests/btrfs/064 | 123 ++++++++++++++++++++++++++++
> tests/btrfs/064.out | 2 +
> tests/btrfs/065 | 115 +++++++++++++++++++++++++++
> tests/btrfs/065.out | 2 +
> tests/btrfs/066 | 117 +++++++++++++++++++++++++++
> tests/btrfs/066.out | 2 +
> tests/btrfs/067 | 116 +++++++++++++++++++++++++++
> tests/btrfs/067.out | 2 +
> tests/btrfs/068 | 123 ++++++++++++++++++++++++++++
> tests/btrfs/068.out | 2 +
> tests/btrfs/069 | 125 +++++++++++++++++++++++++++++
> tests/btrfs/069.out | 2 +
> tests/btrfs/070 | 123 ++++++++++++++++++++++++++++
> tests/btrfs/070.out | 2 +
> tests/btrfs/071 | 116 +++++++++++++++++++++++++++
> tests/btrfs/071.out | 2 +
> tests/btrfs/072 | 114 ++++++++++++++++++++++++++
> tests/btrfs/072.out | 2 +
> tests/btrfs/073 | 116 +++++++++++++++++++++++++++
> tests/btrfs/073.out | 2 +
> tests/btrfs/group | 15 ++++
> 32 files changed, 2035 insertions(+), 4 deletions(-)
> create mode 100755 tests/btrfs/059
> create mode 100644 tests/btrfs/059.out
> create mode 100755 tests/btrfs/060
> create mode 100644 tests/btrfs/060.out
> create mode 100755 tests/btrfs/061
> create mode 100644 tests/btrfs/061.out
> create mode 100755 tests/btrfs/062
> create mode 100644 tests/btrfs/062.out
> create mode 100755 tests/btrfs/063
> create mode 100644 tests/btrfs/063.out
> create mode 100755 tests/btrfs/064
> create mode 100644 tests/btrfs/064.out
> create mode 100755 tests/btrfs/065
> create mode 100644 tests/btrfs/065.out
> create mode 100755 tests/btrfs/066
> create mode 100644 tests/btrfs/066.out
> create mode 100755 tests/btrfs/067
> create mode 100644 tests/btrfs/067.out
> create mode 100755 tests/btrfs/068
> create mode 100644 tests/btrfs/068.out
> create mode 100755 tests/btrfs/069
> create mode 100644 tests/btrfs/069.out
> create mode 100755 tests/btrfs/070
> create mode 100644 tests/btrfs/070.out
> create mode 100755 tests/btrfs/071
> create mode 100644 tests/btrfs/071.out
> create mode 100755 tests/btrfs/072
> create mode 100644 tests/btrfs/072.out
> create mode 100755 tests/btrfs/073
> create mode 100644 tests/btrfs/073.out
>
> --
> 1.8.3.1
>
> --
> To unsubscribe from this list: send the line "unsubscribe fstests" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
--
Dave Chinner
david@fromorbit.com
^ permalink raw reply [flat|nested] 19+ messages in thread
* Re: [PATCH v3 00/15] xfstests: new btrfs stress test cases
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
` (15 preceding siblings ...)
2014-09-25 5:39 ` [PATCH v3 00/15] xfstests: new btrfs stress test cases Dave Chinner
@ 2014-09-26 3:55 ` Eryu Guan
16 siblings, 0 replies; 19+ messages in thread
From: Eryu Guan @ 2014-09-26 3:55 UTC (permalink / raw)
To: fstests; +Cc: linux-btrfs
On Thu, Sep 18, 2014 at 01:49:24PM +0800, Eryu Guan wrote:
> This patchset add new stress test cases for btrfs by running two
> different btrfs operations simultaneously under fsstress to ensure
> btrfs doesn't hang or oops in such situations. btrfs scrub and
> btrfs check will be run after each test.
>
> The test matrix is the combination of 6 btrfs operations:
>
> balance
> create/mount/umount/delete subvolume
> replace device
> scrub
> defrag
> remount with different compress algorithms
>
> Short descriptions:
>
> 059: balance-subvolume
> 060: balance-scrub
> 061: balance-defrag
> 062: balance-remount
> 063: balance-replace
> 064: subvolume-replace
> 065: subvolume-scrub
> 066: subvolume-defrag
> 067: subvolume-remount
> 068: replace-scrub
> 069: replace-defrag
> 070: replace-remount
> 071: scrub-defrag
> 072: scrub-remount
> 073: defrag-remount
>
> Some issues I've seen:
>
> 1. subvolume cannot be mounted with selinux context, so you may see
> such logs in dmesg
>
> SELinux: mount invalid. Same superblock, different security settings for (dev dm-8, type btrfs)
>
> I've reported the bug to btrfs list, see
> [BUG] cannot mount subvolume with selinux context
> http://www.spinics.net/lists/linux-btrfs/msg36779.html
>
> 2. btrfs replace operation always returns ENOENT if balance is running
> So in 063.full you'll see
>
> ERROR: ioctl(DEV_REPLACE_START) failed on "/mnt/testarea/scratch": No such file or directory, no error
>
> Not sure if it's btrfs bug, at least I think the error code is misleading
>
> 3. replace operation hangs the kernel(3.16-rc4+ and 3.17-rc2+) with fsstress running
> So case 064/068/069/070 will hang
I found some bugs in 070 after applying the patch manually which fixes
the hang. And 070 exposes one more bug (scrub finds correctable and
uncorrectable errors), will state this issue in v4.
Also did minor update in the _btrfs_stress_replace() function. Will
send v4 out soon.
Thanks,
Eryu
>
>
> Changes since v2:
> - mount subvolume at $TEST_DIR/$seq.mnt not $tmp.mnt
> - don't rm -rf $tmp.* which is dangerous
> - remove unnecessary btrfs filesystem sync operation
> - update _scratch_pool_mkfs to deal with dup profile
> - add more comments for each stress operation
> - rename _btrfs_stress_remount to _btrfs_stress_remount_compress (hope it's better...)
> - add _btrfs_get_profile_configs to remove duplicated test case array in each case
> - use _require_scratch_nocheck and _check_scratch_fs after each loop
>
> Changes since v1:
> - put common operations in common/rc as functions and share them across these tests
> - append mkfs options to _scratch_mkfs and _scratch_pool_mkfs instead of updating $MKFS_OPTIONS
> - rebase on top of master and re-number starting from btrfs/059
>
> Thanks,
> Eryu Guan
>
> Eryu Guan (15):
> btrfs: new test to run btrfs balance and subvolume test simultaneously
> btrfs: new test to run btrfs balance and scrub simultaneously
> btrfs: new test to run btrfs balance and defrag operations simultaneously
> btrfs: new case to run btrfs balance and remount with different compress algorithms
> btrfs: new case to run btrfs balance and device replace operations simultaneously
> btrfs: new case to run btrfs subvolume create/delete operations and device replace simultaneously
> btrfs: new case to run btrfs subvolume create/delete operations and scrub simultaneously
> btrfs: new case to run btrfs subvolume create/delete and defrag operations simultaneously
> btrfs: new case to run subvolume create/delete and remount with defferent compress algorithms
> btrfs: new case to run device replace and scrub operations simultaneously
> btrfs: new case to run device replace and defrag operations simultaneously
> btrfs: new case to run device replace and remount with different compress algorithms simultaneously
> btrfs: new case to run btrfs scrub and defrag operations simultaneously
> btrfs: new case to run btrfs scrub and remount with different compress algorithms simultaneously
> btrfs: new case to run defrag and remount with different compress algorithms simultaneously
>
> common/rc | 225 +++++++++++++++++++++++++++++++++++++++++++++++++++-
> tests/btrfs/059 | 115 +++++++++++++++++++++++++++
> tests/btrfs/059.out | 2 +
> tests/btrfs/060 | 114 ++++++++++++++++++++++++++
> tests/btrfs/060.out | 2 +
> tests/btrfs/061 | 116 +++++++++++++++++++++++++++
> tests/btrfs/061.out | 2 +
> tests/btrfs/062 | 114 ++++++++++++++++++++++++++
> tests/btrfs/062.out | 2 +
> tests/btrfs/063 | 122 ++++++++++++++++++++++++++++
> tests/btrfs/063.out | 2 +
> tests/btrfs/064 | 123 ++++++++++++++++++++++++++++
> tests/btrfs/064.out | 2 +
> tests/btrfs/065 | 115 +++++++++++++++++++++++++++
> tests/btrfs/065.out | 2 +
> tests/btrfs/066 | 117 +++++++++++++++++++++++++++
> tests/btrfs/066.out | 2 +
> tests/btrfs/067 | 116 +++++++++++++++++++++++++++
> tests/btrfs/067.out | 2 +
> tests/btrfs/068 | 123 ++++++++++++++++++++++++++++
> tests/btrfs/068.out | 2 +
> tests/btrfs/069 | 125 +++++++++++++++++++++++++++++
> tests/btrfs/069.out | 2 +
> tests/btrfs/070 | 123 ++++++++++++++++++++++++++++
> tests/btrfs/070.out | 2 +
> tests/btrfs/071 | 116 +++++++++++++++++++++++++++
> tests/btrfs/071.out | 2 +
> tests/btrfs/072 | 114 ++++++++++++++++++++++++++
> tests/btrfs/072.out | 2 +
> tests/btrfs/073 | 116 +++++++++++++++++++++++++++
> tests/btrfs/073.out | 2 +
> tests/btrfs/group | 15 ++++
> 32 files changed, 2035 insertions(+), 4 deletions(-)
> create mode 100755 tests/btrfs/059
> create mode 100644 tests/btrfs/059.out
> create mode 100755 tests/btrfs/060
> create mode 100644 tests/btrfs/060.out
> create mode 100755 tests/btrfs/061
> create mode 100644 tests/btrfs/061.out
> create mode 100755 tests/btrfs/062
> create mode 100644 tests/btrfs/062.out
> create mode 100755 tests/btrfs/063
> create mode 100644 tests/btrfs/063.out
> create mode 100755 tests/btrfs/064
> create mode 100644 tests/btrfs/064.out
> create mode 100755 tests/btrfs/065
> create mode 100644 tests/btrfs/065.out
> create mode 100755 tests/btrfs/066
> create mode 100644 tests/btrfs/066.out
> create mode 100755 tests/btrfs/067
> create mode 100644 tests/btrfs/067.out
> create mode 100755 tests/btrfs/068
> create mode 100644 tests/btrfs/068.out
> create mode 100755 tests/btrfs/069
> create mode 100644 tests/btrfs/069.out
> create mode 100755 tests/btrfs/070
> create mode 100644 tests/btrfs/070.out
> create mode 100755 tests/btrfs/071
> create mode 100644 tests/btrfs/071.out
> create mode 100755 tests/btrfs/072
> create mode 100644 tests/btrfs/072.out
> create mode 100755 tests/btrfs/073
> create mode 100644 tests/btrfs/073.out
>
> --
> 1.8.3.1
>
^ permalink raw reply [flat|nested] 19+ messages in thread
* Re: [PATCH v3 00/15] xfstests: new btrfs stress test cases
2014-09-25 5:39 ` [PATCH v3 00/15] xfstests: new btrfs stress test cases Dave Chinner
@ 2014-09-26 12:56 ` Josef Bacik
0 siblings, 0 replies; 19+ messages in thread
From: Josef Bacik @ 2014-09-26 12:56 UTC (permalink / raw)
To: Dave Chinner, Eryu Guan; +Cc: fstests, linux-btrfs
On 09/25/2014 01:39 AM, Dave Chinner wrote:
> Btrfs developers,
>
> Can someone who knows how this is all supposed to work pass an eye
> over this patch series to determine the validity of what is being
> tested? Given the number of problems this patchset seems to expose,
> it looks pretty important to me to get this into all of your regular
> testing. I can't make judgement on whether the tests are valid
> things to do to btrfs, so I'm reliant on people with actual btrfs
> expertise to vet these patches...
>
Yeah sorry Dave I've been meaning to get to this, I'll go through them
all today. Thanks,
Josef
^ permalink raw reply [flat|nested] 19+ messages in thread
end of thread, other threads:[~2014-09-26 12:56 UTC | newest]
Thread overview: 19+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2014-09-18 5:49 [PATCH v3 00/15] xfstests: new btrfs stress test cases Eryu Guan
2014-09-18 5:49 ` [PATCH v3 01/15] btrfs: new test to run btrfs balance and subvolume test simultaneously Eryu Guan
2014-09-18 5:49 ` [PATCH v3 02/15] btrfs: new test to run btrfs balance and scrub simultaneously Eryu Guan
2014-09-18 5:49 ` [PATCH v3 03/15] btrfs: new test to run btrfs balance and defrag operations simultaneously Eryu Guan
2014-09-18 5:49 ` [PATCH v3 04/15] btrfs: new case to run btrfs balance and remount with different compress algorithms Eryu Guan
2014-09-18 5:49 ` [PATCH v3 05/15] btrfs: new case to run btrfs balance and device replace operations simultaneously Eryu Guan
2014-09-18 5:49 ` [PATCH v3 06/15] btrfs: new case to run btrfs subvolume create/delete operations and device replace simultaneously Eryu Guan
2014-09-18 5:49 ` [PATCH v3 07/15] btrfs: new case to run btrfs subvolume create/delete operations and scrub simultaneously Eryu Guan
2014-09-18 5:49 ` [PATCH v3 08/15] btrfs: new case to run btrfs subvolume create/delete and defrag operations simultaneously Eryu Guan
2014-09-18 5:49 ` [PATCH v3 09/15] btrfs: new case to run subvolume create/delete and remount with defferent compress algorithms Eryu Guan
2014-09-18 5:49 ` [PATCH v3 10/15] btrfs: new case to run device replace and scrub operations simultaneously Eryu Guan
2014-09-18 5:49 ` [PATCH v3 11/15] btrfs: new case to run device replace and defrag " Eryu Guan
2014-09-18 5:49 ` [PATCH v3 12/15] btrfs: new case to run device replace and remount with different compress algorithms simultaneously Eryu Guan
2014-09-18 5:49 ` [PATCH v3 13/15] btrfs: new case to run btrfs scrub and defrag operations simultaneously Eryu Guan
2014-09-18 5:49 ` [PATCH v3 14/15] btrfs: new case to run btrfs scrub and remount with different compress algorithms simultaneously Eryu Guan
2014-09-18 5:49 ` [PATCH v3 15/15] btrfs: new case to run defrag " Eryu Guan
2014-09-25 5:39 ` [PATCH v3 00/15] xfstests: new btrfs stress test cases Dave Chinner
2014-09-26 12:56 ` Josef Bacik
2014-09-26 3:55 ` Eryu Guan
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).