All of lore.kernel.org
 help / color / mirror / Atom feed
* xfstest ext4 'utility required' run stop
@ 2013-06-12  5:36 jon ernst
  2013-06-12  6:31 ` Zheng Liu
  2013-06-12 14:47 ` Theodore Ts'o
  0 siblings, 2 replies; 10+ messages in thread
From: jon ernst @ 2013-06-12  5:36 UTC (permalink / raw)
  To: linux-ext4

Hi,

When I try to run xfstest 301 - 304. They all got error message "utility required, run stop, stkip this test" , test 305 is fine.
But it did not tell which utility is required. I do have test patition and scratch partition set up. And I do have e4defrag on my linux.

What could be the reason?please help.

Thanks!

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: xfstest ext4 'utility required' run stop
  2013-06-12  5:36 xfstest ext4 'utility required' run stop jon ernst
@ 2013-06-12  6:31 ` Zheng Liu
  2013-06-12 13:57   ` Lukáš Czerner
  2013-06-12 14:47 ` Theodore Ts'o
  1 sibling, 1 reply; 10+ messages in thread
From: Zheng Liu @ 2013-06-12  6:31 UTC (permalink / raw)
  To: jon ernst; +Cc: linux-ext4

On Wed, Jun 12, 2013 at 01:36:18AM -0400, jon ernst wrote:
> Hi,
> 
> When I try to run xfstest 301 - 304. They all got error message "utility required, run stop, stkip this test" , test 305 is fine.
> But it did not tell which utility is required. I do have test patition and scratch partition set up. And I do have e4defrag on my linux.
> 
> What could be the reason?please help.

Hi Jon,

Could you please check that 'fio' utility has been installed?  You can
get it from this link:
  git clone git://git.kernel.dk/fio.git

Regards,
                                                - Zheng

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: xfstest ext4 'utility required' run stop
  2013-06-12  6:31 ` Zheng Liu
@ 2013-06-12 13:57   ` Lukáš Czerner
  0 siblings, 0 replies; 10+ messages in thread
From: Lukáš Czerner @ 2013-06-12 13:57 UTC (permalink / raw)
  To: Zheng Liu; +Cc: jon ernst, linux-ext4

On Wed, 12 Jun 2013, Zheng Liu wrote:

> Date: Wed, 12 Jun 2013 14:31:32 +0800
> From: Zheng Liu <gnehzuil.liu@gmail.com>
> To: jon ernst <jonernst07@gmx.com>
> Cc: linux-ext4@vger.kernel.org
> Subject: Re: xfstest ext4 'utility required' run stop
> 
> On Wed, Jun 12, 2013 at 01:36:18AM -0400, jon ernst wrote:
> > Hi,
> > 
> > When I try to run xfstest 301 - 304. They all got error message "utility required, run stop, stkip this test" , test 305 is fine.
> > But it did not tell which utility is required. I do have test patition and scratch partition set up. And I do have e4defrag on my linux.
> > 
> > What could be the reason?please help.
> 
> Hi Jon,
> 
> Could you please check that 'fio' utility has been installed?  You can
> get it from this link:
>   git clone git://git.kernel.dk/fio.git
> 
> Regards,
>                                                 - Zheng

Right, you're missing 'fio' utility. And there is a bug in xfstests
because it should tell you that, I will send patch.

Thanks!
-Lukas

> --
> To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: xfstest ext4 'utility required' run stop
  2013-06-12  5:36 xfstest ext4 'utility required' run stop jon ernst
  2013-06-12  6:31 ` Zheng Liu
@ 2013-06-12 14:47 ` Theodore Ts'o
  1 sibling, 0 replies; 10+ messages in thread
From: Theodore Ts'o @ 2013-06-12 14:47 UTC (permalink / raw)
  To: jon ernst; +Cc: linux-ext4

On Wed, Jun 12, 2013 at 01:36:18AM -0400, jon ernst wrote:
> Hi,
> 
> When I try to run xfstest 301 - 304. They all got error message "utility required, run stop, stkip this test" , test 305 is fine.
> But it did not tell which utility is required. I do have test patition and scratch partition set up. And I do have e4defrag on my linux.
> 
> What could be the reason?please help.

For your convenience, you might want to take a look at:

	git://git.kernel.org/pub/scm/fs/ext2/xfstests-bld.git

This will build all of the tools you need for xfstests, in a hermetic
build environment, and create a tarball that has everything you need
to run xfstests.  There are also some convenience scripts which allow
you to easily kick off an xfstests run using qemu.


       	      	       	  	       	     - Ted

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: xfstest ext4 'utility required' run stop
  2013-06-13 13:43 jon ernst
@ 2013-06-13 13:59 ` Theodore Ts'o
  0 siblings, 0 replies; 10+ messages in thread
From: Theodore Ts'o @ 2013-06-13 13:59 UTC (permalink / raw)
  To: jon ernst; +Cc: Zheng Liu, linux-ext4

On Thu, Jun 13, 2013 at 09:43:46AM -0400, jon ernst wrote:
> I built xfstest from latest code. I also built fio from latest code base.
> Thanks for your help!

Dmitry's advice is on-target.  Do you have:

#define CONFIG_LINUX_EXT4_MOVE_EXTENT

defined in fio/config-host.h?

						- Ted

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: xfstest ext4 'utility required' run stop
@ 2013-06-13 13:43 jon ernst
  2013-06-13 13:59 ` Theodore Ts'o
  0 siblings, 1 reply; 10+ messages in thread
From: jon ernst @ 2013-06-13 13:43 UTC (permalink / raw)
  To: Zheng Liu; +Cc: linux-ext4


>  Hi Jon,

> Could you please tell us which xfstest's version are you used? If I
> remember correctly, testcases 301-304 have a bug at some certain
> version. Could you please upgrade your xfstests to the latest version?
> Or as Ted suggested, you could use xfstests-bld.

> Regards,
>  - Zheng

I built xfstest from latest code. I also built fio from latest code base.
Thanks for your help!
--
To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: xfstest ext4 'utility required' run stop
  2013-06-13  5:17 jon ernst
  2013-06-13  7:02 ` Zheng Liu
@ 2013-06-13  7:33 ` Dmitry Monakhov
  1 sibling, 0 replies; 10+ messages in thread
From: Dmitry Monakhov @ 2013-06-13  7:33 UTC (permalink / raw)
  To: jon ernst; +Cc: linux-ext4

On Thu, 13 Jun 2013 01:17:30 -0400, "jon ernst" <jonernst07@gmx.com> wrote:
> Hi All,
> about xfstestI installed fio. But still got error when I run ext4 test 301.
> Could anyone enlight me what;s wrong with my configuration? 
> I have latest ext4 dev branch code with latest xfstest code.
> fio version is 2.1.1
You have compiled fio w/o 'EXT4 move extent' support
which looks strange because it enabled on linux by default
See: 'ext4_me' option in ./configure
BTW: 2.1.1 is broken, Use '4e0a8fa' it is known to work
> 
> this is whole log:
> Thank you! 
> 
> fio: failed parsing ioengine=ioe_e4defrag
> fio: job global dropped
> fio         valid values: sync       Use read/write
>                     : psync      Use pread/pwrite
>                     : vsync      Use readv/writev
>                     : libaio     Linux native asynchronous IO
>                     : posixaio   POSIX asynchronous IO
>                     : mmap       Memory mapped IO
>                     : splice     splice/vmsplice based IO
>                     : netsplice  splice/vmsplice to/from the network
>                     : sg         SCSI generic v3 IO
>                     : null       Testing engine (no data transfer)
>                     : net        Network IO
>                     : syslet-rw  syslet enabled async pread/pwrite IO
>                     : cpuio      CPU cycle burner engine
>                     : binject    binject direct inject block engine
>                     : rdma       RDMA IO engine
>                     : external   Load external engine (append name)
> 
> 
> fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1 
> mke2fs 1.42 (29-Nov-2011)
> Filesystem label=
> OS type: Linux
> Block size=4096 (log=2)
> Fragment size=4096 (log=2)
> Stride=0 blocks, Stripe width=0 blocks
> 629552 inodes, 2518180 blocks
> 125909 blocks (5.00%) reserved for the super user
> First data block=0
> Maximum filesystem blocks=2579496960
> 77 block groups
> 32768 blocks per group, 32768 fragments per group
> 8176 inodes per group
> Superblock backups stored on blocks: 
>  32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
> 
> Allocating group tables:
> 
> # Common e4defrag regression tests
> [global]
> ioengine=ioe_e4defrag
> iodepth=1
> directory=/device8
> filesize=3424725990
> size=999G
> buffered=0
> fadvise_hint=0
> 
> #################################
> # Test1
> # Defragment file while other task does direct io
> 
> # Continious sequential defrag activity
> [defrag-4k]
> ioengine=e4defrag
> iodepth=1
> bs=128k
> donorname=test1.def
> filename=test1
> inplace=0
> rw=write
> numjobs=4
> runtime=30*1
> time_based
> 
> # Verifier
> [aio-dio-verifier]
> ioengine=libaio
> iodepth=128*1
> numjobs=1
> verify=crc32c-intel
> verify_fatal=1
> verify_dump=1
> verify_backlog=1024
> verify_async=1
> verifysort=1
> direct=1
> bs=64k
> rw=randwrite
> filename=test1
> runtime=30*1
> time_based
> # /usr/bin/fio /tmp/5884.fio
> fio: engine libaio not loadable
> fio: failed to load engine libaio
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> ...
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
> failed: '/usr/bin/fio /tmp/5884.fio'
> fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1 
> mke2fs 1.42 (29-Nov-2011)
> Filesystem label=
> OS type: Linux
> Block size=4096 (log=2)
> Fragment size=4096 (log=2)
> Stride=0 blocks, Stripe width=0 blocks
> 629552 inodes, 2518180 blocks
> 125909 blocks (5.00%) reserved for the super user
> First data block=0
> Maximum filesystem blocks=2579496960
> 77 block groups
> 32768 blocks per group, 32768 fragments per group
> 8176 inodes per group
> Superblock backups stored on blocks: 
>  32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
> 
> Allocating group tables: 
> 
> # Common e4defrag regression tests
> [global]
> ioengine=ioe_e4defrag
> iodepth=1
> directory=/device8
> filesize=3424725990
> size=999G
> buffered=0
> fadvise_hint=0
> 
> #################################
> # Test1
> # Defragment file while other task does direct io
> 
> # Continious sequential defrag activity
> [defrag-4k]
> ioengine=e4defrag
> iodepth=1
> bs=128k
> donorname=test1.def
> filename=test1
> inplace=0
> rw=write
> numjobs=4
> runtime=30*1
> time_based
> 
> # Verifier
> [aio-dio-verifier]
> ioengine=libaio
> iodepth=128*1
> numjobs=1
> verify=crc32c-intel
> verify_fatal=1
> verify_dump=1
> verify_backlog=1024
> verify_async=1
> verifysort=1
> direct=1
> bs=64k
> rw=randwrite
> filename=test1
> runtime=30*1
> time_based
> # /usr/bin/fio /tmp/3999.fio
> fio: engine libaio not loadable
> fio: failed to load engine libaio
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> ...
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
> failed: '/usr/bin/fio /tmp/3999.fio'
> fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1 
> mke2fs 1.42 (29-Nov-2011)
> Filesystem label=
> OS type: Linux
> Block size=4096 (log=2)
> Fragment size=4096 (log=2)
> Stride=0 blocks, Stripe width=0 blocks
> 629552 inodes, 2518180 blocks
> 125909 blocks (5.00%) reserved for the super user
> First data block=0
> Maximum filesystem blocks=2579496960
> 77 block groups
> 32768 blocks per group, 32768 fragments per group
> 8176 inodes per group
> Superblock backups stored on blocks: 
>  32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
> 
> Allocating group tables:  
> 
> # Common e4defrag regression tests
> [global]
> ioengine=ioe_e4defrag
> iodepth=1
> directory=/device8
> filesize=3424725990
> size=999G
> buffered=0
> fadvise_hint=0
> 
> #################################
> # Test1
> # Defragment file while other task does direct io
> 
> # Continious sequential defrag activity
> [defrag-4k]
> ioengine=e4defrag
> iodepth=1
> bs=128k
> donorname=test1.def
> filename=test1
> inplace=0
> rw=write
> numjobs=4
> runtime=30*1
> time_based
> 
> # Verifier
> [aio-dio-verifier]
> ioengine=libaio
> iodepth=128*1
> numjobs=1
> verify=crc32c-intel
> verify_fatal=1
> verify_dump=1
> verify_backlog=1024
> verify_async=1
> verifysort=1
> direct=1
> bs=64k
> rw=randwrite
> filename=test1
> runtime=30*1
> time_based
> # /usr/bin/fio /tmp/12231.fio
> fio: engine libaio not loadable
> fio: failed to load engine libaio
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> ...
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
> failed: '/usr/bin/fio /tmp/12231.fio'
> --
> To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: xfstest ext4 'utility required' run stop
  2013-06-13  5:17 jon ernst
@ 2013-06-13  7:02 ` Zheng Liu
  2013-06-13  7:33 ` Dmitry Monakhov
  1 sibling, 0 replies; 10+ messages in thread
From: Zheng Liu @ 2013-06-13  7:02 UTC (permalink / raw)
  To: jon ernst; +Cc: linux-ext4

Hi Jon,

Could you please tell us which xfstest's version are you used?  If I
remember correctly, testcases 301-304 have a bug at some certain
version.  Could you please upgrade your xfstests to the latest version?
Or as Ted suggested, you could use xfstests-bld.

Regards,
                                                - Zheng

On Thu, Jun 13, 2013 at 01:17:30AM -0400, jon ernst wrote:
> Hi All,
> about xfstestI installed fio. But still got error when I run ext4 test 301.
> Could anyone enlight me what;s wrong with my configuration? 
> I have latest ext4 dev branch code with latest xfstest code.
> fio version is 2.1.1
> 
> this is whole log:
> Thank you! 
> 
> fio: failed parsing ioengine=ioe_e4defrag
> fio: job global dropped
> fio         valid values: sync       Use read/write
>                     : psync      Use pread/pwrite
>                     : vsync      Use readv/writev
>                     : libaio     Linux native asynchronous IO
>                     : posixaio   POSIX asynchronous IO
>                     : mmap       Memory mapped IO
>                     : splice     splice/vmsplice based IO
>                     : netsplice  splice/vmsplice to/from the network
>                     : sg         SCSI generic v3 IO
>                     : null       Testing engine (no data transfer)
>                     : net        Network IO
>                     : syslet-rw  syslet enabled async pread/pwrite IO
>                     : cpuio      CPU cycle burner engine
>                     : binject    binject direct inject block engine
>                     : rdma       RDMA IO engine
>                     : external   Load external engine (append name)
> 
> 
> fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1 
> mke2fs 1.42 (29-Nov-2011)
> Filesystem label=
> OS type: Linux
> Block size=4096 (log=2)
> Fragment size=4096 (log=2)
> Stride=0 blocks, Stripe width=0 blocks
> 629552 inodes, 2518180 blocks
> 125909 blocks (5.00%) reserved for the super user
> First data block=0
> Maximum filesystem blocks=2579496960
> 77 block groups
> 32768 blocks per group, 32768 fragments per group
> 8176 inodes per group
> Superblock backups stored on blocks: 
>  32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
> 
> Allocating group tables:
> 
> # Common e4defrag regression tests
> [global]
> ioengine=ioe_e4defrag
> iodepth=1
> directory=/device8
> filesize=3424725990
> size=999G
> buffered=0
> fadvise_hint=0
> 
> #################################
> # Test1
> # Defragment file while other task does direct io
> 
> # Continious sequential defrag activity
> [defrag-4k]
> ioengine=e4defrag
> iodepth=1
> bs=128k
> donorname=test1.def
> filename=test1
> inplace=0
> rw=write
> numjobs=4
> runtime=30*1
> time_based
> 
> # Verifier
> [aio-dio-verifier]
> ioengine=libaio
> iodepth=128*1
> numjobs=1
> verify=crc32c-intel
> verify_fatal=1
> verify_dump=1
> verify_backlog=1024
> verify_async=1
> verifysort=1
> direct=1
> bs=64k
> rw=randwrite
> filename=test1
> runtime=30*1
> time_based
> # /usr/bin/fio /tmp/5884.fio
> fio: engine libaio not loadable
> fio: failed to load engine libaio
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> ...
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
> failed: '/usr/bin/fio /tmp/5884.fio'
> fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1 
> mke2fs 1.42 (29-Nov-2011)
> Filesystem label=
> OS type: Linux
> Block size=4096 (log=2)
> Fragment size=4096 (log=2)
> Stride=0 blocks, Stripe width=0 blocks
> 629552 inodes, 2518180 blocks
> 125909 blocks (5.00%) reserved for the super user
> First data block=0
> Maximum filesystem blocks=2579496960
> 77 block groups
> 32768 blocks per group, 32768 fragments per group
> 8176 inodes per group
> Superblock backups stored on blocks: 
>  32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
> 
> Allocating group tables: 
> 
> # Common e4defrag regression tests
> [global]
> ioengine=ioe_e4defrag
> iodepth=1
> directory=/device8
> filesize=3424725990
> size=999G
> buffered=0
> fadvise_hint=0
> 
> #################################
> # Test1
> # Defragment file while other task does direct io
> 
> # Continious sequential defrag activity
> [defrag-4k]
> ioengine=e4defrag
> iodepth=1
> bs=128k
> donorname=test1.def
> filename=test1
> inplace=0
> rw=write
> numjobs=4
> runtime=30*1
> time_based
> 
> # Verifier
> [aio-dio-verifier]
> ioengine=libaio
> iodepth=128*1
> numjobs=1
> verify=crc32c-intel
> verify_fatal=1
> verify_dump=1
> verify_backlog=1024
> verify_async=1
> verifysort=1
> direct=1
> bs=64k
> rw=randwrite
> filename=test1
> runtime=30*1
> time_based
> # /usr/bin/fio /tmp/3999.fio
> fio: engine libaio not loadable
> fio: failed to load engine libaio
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> ...
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
> failed: '/usr/bin/fio /tmp/3999.fio'
> fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1 
> mke2fs 1.42 (29-Nov-2011)
> Filesystem label=
> OS type: Linux
> Block size=4096 (log=2)
> Fragment size=4096 (log=2)
> Stride=0 blocks, Stripe width=0 blocks
> 629552 inodes, 2518180 blocks
> 125909 blocks (5.00%) reserved for the super user
> First data block=0
> Maximum filesystem blocks=2579496960
> 77 block groups
> 32768 blocks per group, 32768 fragments per group
> 8176 inodes per group
> Superblock backups stored on blocks: 
>  32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
> 
> Allocating group tables:  
> 
> # Common e4defrag regression tests
> [global]
> ioengine=ioe_e4defrag
> iodepth=1
> directory=/device8
> filesize=3424725990
> size=999G
> buffered=0
> fadvise_hint=0
> 
> #################################
> # Test1
> # Defragment file while other task does direct io
> 
> # Continious sequential defrag activity
> [defrag-4k]
> ioengine=e4defrag
> iodepth=1
> bs=128k
> donorname=test1.def
> filename=test1
> inplace=0
> rw=write
> numjobs=4
> runtime=30*1
> time_based
> 
> # Verifier
> [aio-dio-verifier]
> ioengine=libaio
> iodepth=128*1
> numjobs=1
> verify=crc32c-intel
> verify_fatal=1
> verify_dump=1
> verify_backlog=1024
> verify_async=1
> verifysort=1
> direct=1
> bs=64k
> rw=randwrite
> filename=test1
> runtime=30*1
> time_based
> # /usr/bin/fio /tmp/12231.fio
> fio: engine libaio not loadable
> fio: failed to load engine libaio
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> ...
> defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
> fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
> failed: '/usr/bin/fio /tmp/12231.fio'
> --
> To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: xfstest ext4 'utility required' run stop
@ 2013-06-13  5:17 jon ernst
  2013-06-13  7:02 ` Zheng Liu
  2013-06-13  7:33 ` Dmitry Monakhov
  0 siblings, 2 replies; 10+ messages in thread
From: jon ernst @ 2013-06-13  5:17 UTC (permalink / raw)
  Cc: linux-ext4

Hi All,
about xfstestI installed fio. But still got error when I run ext4 test 301.
Could anyone enlight me what;s wrong with my configuration? 
I have latest ext4 dev branch code with latest xfstest code.
fio version is 2.1.1

this is whole log:
Thank you! 

fio: failed parsing ioengine=ioe_e4defrag
fio: job global dropped
fio         valid values: sync       Use read/write
                    : psync      Use pread/pwrite
                    : vsync      Use readv/writev
                    : libaio     Linux native asynchronous IO
                    : posixaio   POSIX asynchronous IO
                    : mmap       Memory mapped IO
                    : splice     splice/vmsplice based IO
                    : netsplice  splice/vmsplice to/from the network
                    : sg         SCSI generic v3 IO
                    : null       Testing engine (no data transfer)
                    : net        Network IO
                    : syslet-rw  syslet enabled async pread/pwrite IO
                    : cpuio      CPU cycle burner engine
                    : binject    binject direct inject block engine
                    : rdma       RDMA IO engine
                    : external   Load external engine (append name)


fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1 
mke2fs 1.42 (29-Nov-2011)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
Stride=0 blocks, Stripe width=0 blocks
629552 inodes, 2518180 blocks
125909 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=2579496960
77 block groups
32768 blocks per group, 32768 fragments per group
8176 inodes per group
Superblock backups stored on blocks: 
 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632

Allocating group tables:

# Common e4defrag regression tests
[global]
ioengine=ioe_e4defrag
iodepth=1
directory=/device8
filesize=3424725990
size=999G
buffered=0
fadvise_hint=0

#################################
# Test1
# Defragment file while other task does direct io

# Continious sequential defrag activity
[defrag-4k]
ioengine=e4defrag
iodepth=1
bs=128k
donorname=test1.def
filename=test1
inplace=0
rw=write
numjobs=4
runtime=30*1
time_based

# Verifier
[aio-dio-verifier]
ioengine=libaio
iodepth=128*1
numjobs=1
verify=crc32c-intel
verify_fatal=1
verify_dump=1
verify_backlog=1024
verify_async=1
verifysort=1
direct=1
bs=64k
rw=randwrite
filename=test1
runtime=30*1
time_based
# /usr/bin/fio /tmp/5884.fio
fio: engine libaio not loadable
fio: failed to load engine libaio
defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
...
defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
failed: '/usr/bin/fio /tmp/5884.fio'
fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1 
mke2fs 1.42 (29-Nov-2011)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
Stride=0 blocks, Stripe width=0 blocks
629552 inodes, 2518180 blocks
125909 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=2579496960
77 block groups
32768 blocks per group, 32768 fragments per group
8176 inodes per group
Superblock backups stored on blocks: 
 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632

Allocating group tables: 

# Common e4defrag regression tests
[global]
ioengine=ioe_e4defrag
iodepth=1
directory=/device8
filesize=3424725990
size=999G
buffered=0
fadvise_hint=0

#################################
# Test1
# Defragment file while other task does direct io

# Continious sequential defrag activity
[defrag-4k]
ioengine=e4defrag
iodepth=1
bs=128k
donorname=test1.def
filename=test1
inplace=0
rw=write
numjobs=4
runtime=30*1
time_based

# Verifier
[aio-dio-verifier]
ioengine=libaio
iodepth=128*1
numjobs=1
verify=crc32c-intel
verify_fatal=1
verify_dump=1
verify_backlog=1024
verify_async=1
verifysort=1
direct=1
bs=64k
rw=randwrite
filename=test1
runtime=30*1
time_based
# /usr/bin/fio /tmp/3999.fio
fio: engine libaio not loadable
fio: failed to load engine libaio
defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
...
defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
failed: '/usr/bin/fio /tmp/3999.fio'
fio --ioengine=ioe_e4defrag --iodepth=1 --directory=/device8 --filesize=3424725990 --size=999G --buffered=0 --fadvise_hint=0 --name=defrag-4k --ioengine=e4defrag --iodepth=1 --bs=128k --donorname=test1.def --inplace=0 --rw=write --numjobs=4 --runtime=30*1 --time_based --filename=test1 --name=aio-dio-verifier --ioengine=libaio --iodepth=128*1 --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=1 --verifysort=1 --direct=1 --bs=64k --rw=randwrite --runtime=30*1 --time_based --filename=test1 
mke2fs 1.42 (29-Nov-2011)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
Stride=0 blocks, Stripe width=0 blocks
629552 inodes, 2518180 blocks
125909 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=2579496960
77 block groups
32768 blocks per group, 32768 fragments per group
8176 inodes per group
Superblock backups stored on blocks: 
 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632

Allocating group tables:  

# Common e4defrag regression tests
[global]
ioengine=ioe_e4defrag
iodepth=1
directory=/device8
filesize=3424725990
size=999G
buffered=0
fadvise_hint=0

#################################
# Test1
# Defragment file while other task does direct io

# Continious sequential defrag activity
[defrag-4k]
ioengine=e4defrag
iodepth=1
bs=128k
donorname=test1.def
filename=test1
inplace=0
rw=write
numjobs=4
runtime=30*1
time_based

# Verifier
[aio-dio-verifier]
ioengine=libaio
iodepth=128*1
numjobs=1
verify=crc32c-intel
verify_fatal=1
verify_dump=1
verify_backlog=1024
verify_async=1
verifysort=1
direct=1
bs=64k
rw=randwrite
filename=test1
runtime=30*1
time_based
# /usr/bin/fio /tmp/12231.fio
fio: engine libaio not loadable
fio: failed to load engine libaio
defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
...
defrag-4k: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=e4defrag, iodepth=1
fio: file:ioengines.c:99, func=dlopen, error=libaio: cannot open shared object file: No such file or directory
failed: '/usr/bin/fio /tmp/12231.fio'
--
To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: xfstest ext4 'utility required' run stop
@ 2013-06-13  3:53 jon ernst
  0 siblings, 0 replies; 10+ messages in thread
From: jon ernst @ 2013-06-13  3:53 UTC (permalink / raw)
  To: Theodore Tso; +Cc: linux-ext4


>For your convenience, you might want to take a look at:

 >git://git.kernel.org/pub/scm/fs/ext2/xfstests-bld.git

>This will build all of the tools you need for xfstests, in a hermetic
>build environment, and create a tarball that has everything you need
>to run xfstests. There are also some convenience scripts which allow
>you to easily kick off an xfstests run using qemu.
Thank you! 
I found a small issue in README of xfstest-bld.
"make tarball" won't work unlesee do "make" once.
"make" pulls several repo's source code.
Then "make tarball" works.



> - Ted

^ permalink raw reply	[flat|nested] 10+ messages in thread

end of thread, other threads:[~2013-06-13 14:00 UTC | newest]

Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2013-06-12  5:36 xfstest ext4 'utility required' run stop jon ernst
2013-06-12  6:31 ` Zheng Liu
2013-06-12 13:57   ` Lukáš Czerner
2013-06-12 14:47 ` Theodore Ts'o
2013-06-13  3:53 jon ernst
2013-06-13  5:17 jon ernst
2013-06-13  7:02 ` Zheng Liu
2013-06-13  7:33 ` Dmitry Monakhov
2013-06-13 13:43 jon ernst
2013-06-13 13:59 ` Theodore Ts'o

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.