Running for a specific number of IOs

Running for a specific number of IOs

[Prabhakaran]

Hi,

Is there a parameter in FIO that can be used to run for a specific
number of IOs? I thought 'number_ios' might to this, but actually it
does fill 1x of the drive usable space and exits.

Thanks,
Prabhu

RE: Running for a specific number of IOs

[Jeff Furlong]

What parameters are you using?  Here is a counterexample from a previous post that shows number_ios running and then the job terminating:

fio --name=test_job --ioengine=libaio --direct=1 --rw=read --iodepth=1 --size=100% --bs=4k --filename=/dev/nvme1n1 --number_ios=8

Regards,
Jeff

-----Original Message-----
From: fio-owner@vger.kernel.org [mailto:fio-owner@vger.kernel.org] On Behalf Of Prabhakaran
Sent: Wednesday, November 22, 2017 2:47 PM
To: fio@vger.kernel.org
Subject: Running for a specific number of IOs

Hi,

Is there a parameter in FIO that can be used to run for a specific number of IOs? I thought 'number_ios' might to this, but actually it does fill 1x of the drive usable space and exits.

Thanks,
Prabhu
--
To unsubscribe from this list: send the line "unsubscribe fio" in the body of a message to majordomo@vger.kernel.org More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Running for a specific number of IOs

[Prabhakaran]

Hi Jeff,

I wanted to generate ~1 billion IOs irrespective of runtime/size. I
think with your example, fio would break, if it reaches 'number_ios',
before it comes to end of first fill. With my example shown below, fio
exits after reaching size=100%, which I have not specified in my job
file.

[global]
ioengine=libaio
clat_percentiles=1
percentile_list=50.0:95.0:99.0:99.5:99.9:99.99:99.999:99.9999:99.99999:99.999999:99.9999999
disable_slat=1
disable_lat=1
disable_clat=1
thread
cpus_allowed=0-7
cpus_allowed_policy=split
direct=1


[4k-4k_100_rd_qd32]
stonewall
bs=4k
ba=4k
iodepth=32
number_ios=10000000000
rw=randread
log_avg_msec=1000
randrepeat=0
norandommap
refill_buffers
write_bw_log=4k-4k_100_rd_qd32
write_iops_log=4k-4k_100_rd_qd32

Thanks,
Prabhu

On 22 November 2017 at 16:06, Jeff Furlong <jeff.furlong@wdc.com> wrote:
> What parameters are you using?  Here is a counterexample from a previous post that shows number_ios running and then the job terminating:
>
> fio --name=test_job --ioengine=libaio --direct=1 --rw=read --iodepth=1 --size=100% --bs=4k --filename=/dev/nvme1n1 --number_ios=8
>
> Regards,
> Jeff
>
> -----Original Message-----
> From: fio-owner@vger.kernel.org [mailto:fio-owner@vger.kernel.org] On Behalf Of Prabhakaran
> Sent: Wednesday, November 22, 2017 2:47 PM
> To: fio@vger.kernel.org
> Subject: Running for a specific number of IOs
>
> Hi,
>
> Is there a parameter in FIO that can be used to run for a specific number of IOs? I thought 'number_ios' might to this, but actually it does fill 1x of the drive usable space and exits.
>
> Thanks,
> Prabhu
> --
> To unsubscribe from this list: send the line "unsubscribe fio" in the body of a message to majordomo@vger.kernel.org More majordomo info at  http://vger.kernel.org/majordomo-info.html



-- 
Thanks,
Prabhakaran

Re: Running for a specific number of IOs

[Sitsofe Wheeler]

Prabhu,

As Jeff mentioned you weren't specific as to exactly what went wrong.
Additionally - did you read all the text for the number_ios option
over on http://fio.readthedocs.io/en/latest/fio_doc.html#cmdoption-arg-number-ios
especially the following: "Note that this does not extend the amount
of I/O that will be done".

On 22 November 2017 at 23:06, Jeff Furlong <jeff.furlong@wdc.com> wrote:
> What parameters are you using?  Here is a counterexample from a previous post that shows number_ios running and then the job terminating:
>
> fio --name=test_job --ioengine=libaio --direct=1 --rw=read --iodepth=1 --size=100% --bs=4k --filename=/dev/nvme1n1 --number_ios=8
>
> Regards,
> Jeff
>
> -----Original Message-----
> From: fio-owner@vger.kernel.org [mailto:fio-owner@vger.kernel.org] On Behalf Of Prabhakaran
> Sent: Wednesday, November 22, 2017 2:47 PM
> To: fio@vger.kernel.org
> Subject: Running for a specific number of IOs
>
> Hi,
>
> Is there a parameter in FIO that can be used to run for a specific number of IOs? I thought 'number_ios' might to this, but actually it does fill 1x of the drive usable space and exits.
>
> Thanks,
> Prabhu

-- 
Sitsofe | http://sucs.org/~sits/

Re: Running for a specific number of IOs

[Sitsofe Wheeler]

Hi,

Try setting a large io_size (e.g. 1p) or a large number of loops
alongside. See http://fio.readthedocs.io/en/latest/fio_doc.html#cmdoption-arg-io-size
and http://fio.readthedocs.io/en/latest/fio_doc.html#cmdoption-arg-loops
for documentation of those options.

On 22 November 2017 at 23:35, Prabhakaran <prabhugce@gmail.com> wrote:
> Hi Jeff,
>
> I wanted to generate ~1 billion IOs irrespective of runtime/size. I
> think with your example, fio would break, if it reaches 'number_ios',
> before it comes to end of first fill. With my example shown below, fio
> exits after reaching size=100%, which I have not specified in my job
> file.

-- 
Sitsofe | http://sucs.org/~sits/

Re: Running for a specific number of IOs

[Prabhakaran]

Hi Sitsofe,

Your idea did work!!

Thanks,
Prabhu

On 22 November 2017 at 16:45, Sitsofe Wheeler <sitsofe@gmail.com> wrote:
> Hi,
>
> Try setting a large io_size (e.g. 1p) or a large number of loops
> alongside. See http://fio.readthedocs.io/en/latest/fio_doc.html#cmdoption-arg-io-size
> and http://fio.readthedocs.io/en/latest/fio_doc.html#cmdoption-arg-loops
> for documentation of those options.
>
> On 22 November 2017 at 23:35, Prabhakaran <prabhugce@gmail.com> wrote:
>> Hi Jeff,
>>
>> I wanted to generate ~1 billion IOs irrespective of runtime/size. I
>> think with your example, fio would break, if it reaches 'number_ios',
>> before it comes to end of first fill. With my example shown below, fio
>> exits after reaching size=100%, which I have not specified in my job
>> file.
>
> --
> Sitsofe | http://sucs.org/~sits/



-- 
Thanks,
Prabhakaran