[SPDK] How to use the fio plugin

[SPDK] How to use the fio plugin

[Henrique Fingler]

[-- Attachment #1: Type: text/plain, Size: 1218 bytes --]

 I'm trying to run some fio benchmarks and it doesn't seem to work for me.
The example in GitHub (
https://github.com/spdk/spdk/tree/master/examples/nvme/fio_plugin) doesn't
work (says "size=" is required) and it's very unclear if there needs to be
any configuration to point to the device.

 It seems that when I run it everything goes straight to the root
filesystem (drive gets saturated with writes, all terminals freeze) or
memory (ungodly throughputs). Here's one input file:

[global]
>
> ioengine=/home/hfingler/mlfs/libfs/lib/spdk/examples/nvme/fio_plugin/fio_plugin
> thread=1
> group_reporting=1
> direct=1
> verify=0
> time_based=1
> ramp_time=0
> runtime=1
>


> [test]
> iodepth=128
> rw=randread
> bs=4k
> numjobs=1
> size=512M
>

 And I get:

Run status group 0 (all jobs):
>    READ: io=10227MB, aggrb=10227MB/s, minb=10227MB/s, maxb=10227MB/s,
> mint=1000msec, maxt=1000msec


 Am I using it correctly? Something seems off. Also, my root filesystem
gets saturated with writes. I can easily notice it using dstat. Is this
normal?

 Could anyone give me a pointer or an example which works? My end goal is
to do some random writes benchmarks.

 Thank you.

[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 1922 bytes --]

Re: [SPDK] How to use the fio plugin

[Cao, Gang]

[-- Attachment #1: Type: text/plain, Size: 2505 bytes --]

By the way, it is always needed to execute the ./<spdk_root_dir>/scripts/setup.sh first.

A readme document can also be found at https://github.com/spdk/spdk/blob/master/examples/nvme/fio_plugin/README.md 

Thanks,
Gang

-----Original Message-----
From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Daniel Verkamp
Sent: Saturday, January 21, 2017 6:25 AM
To: Storage Performance Development Kit <spdk(a)lists.01.org>; spdk(a)ml01.01.org
Subject: Re: [SPDK] How to use the fio plugin

On 01/20/2017 03:11 PM, Henrique Fingler wrote:
> I'm trying to run some fio benchmarks and it doesn't seem to work for 
> me. The example in GitHub
> (https://github.com/spdk/spdk/tree/master/examples/nvme/fio_plugin)
> doesn't work (says "size=" is required) and it's very unclear if there 
> needs to be any configuration to point to the device.
> 
> It seems that when I run it everything goes straight to the root 
> filesystem (drive gets saturated with writes, all terminals freeze) or 
> memory (ungodly throughputs). Here's one input file:
> 
> [global]
> ioengine=/home/hfingler/mlfs/libfs/lib/spdk/examples/nvme/fio_plugin/f
> io_plugin
>
> thread=1
> group_reporting=1
> direct=1
> verify=0
> time_based=1
> ramp_time=0
> runtime=1
> 
> [test]
> iodepth=128
> rw=randread
> bs=4k
> numjobs=1
> size=512M
> 
> 
> And I get:
> 
> Run status group 0 (all jobs): READ: io=10227MB, aggrb=10227MB/s, 
> minb=10227MB/s, maxb=10227MB/s, mint=1000msec, maxt=1000msec
> 
> 
> Am I using it correctly? Something seems off. Also, my root filesystem 
> gets saturated with writes. I can easily notice it using dstat. Is 
> this normal?
> 
> Could anyone give me a pointer or an example which works? My end goal 
> is to do some random writes benchmarks.

Hi,

When using the SPDK NVMe fio_plugin, you need to specify a filename in a special format. See examples/nvme/fio_plugin/README.md for the format.

For example:

  fio yourconf.fio --filename=0000.04.00.0/1

Assuming yourconf.fio is the configuration above, this would run FIO against the NVMe device at PCI domain 0, bus 4, device 0, function 0, NVMe namespace ID 1.

There should not be any I/O activity to your root filesystems - all I/O should bypass the kernel stack entirely if it is being processed by the SPDK FIO plugin.

Thanks,
-- Daniel

_______________________________________________
SPDK mailing list
SPDK(a)lists.01.org
https://lists.01.org/mailman/listinfo/spdk

Re: [SPDK] How to use the fio plugin

[Daniel Verkamp]

[-- Attachment #1: Type: text/plain, Size: 1860 bytes --]

On 01/20/2017 03:11 PM, Henrique Fingler wrote:
> I'm trying to run some fio benchmarks and it doesn't seem to work for
> me. The example in GitHub
> (https://github.com/spdk/spdk/tree/master/examples/nvme/fio_plugin)
> doesn't work (says "size=" is required) and it's very unclear if
> there needs to be any configuration to point to the device.
> 
> It seems that when I run it everything goes straight to the root
> filesystem (drive gets saturated with writes, all terminals freeze)
> or memory (ungodly throughputs). Here's one input file:
> 
> [global] 
> ioengine=/home/hfingler/mlfs/libfs/lib/spdk/examples/nvme/fio_plugin/fio_plugin
>
> thread=1
> group_reporting=1
> direct=1
> verify=0
> time_based=1
> ramp_time=0 
> runtime=1
> 
> [test]
> iodepth=128
> rw=randread
> bs=4k
> numjobs=1
> size=512M
> 
> 
> And I get:
> 
> Run status group 0 (all jobs): READ: io=10227MB, aggrb=10227MB/s,
> minb=10227MB/s, maxb=10227MB/s, mint=1000msec, maxt=1000msec
> 
> 
> Am I using it correctly? Something seems off. Also, my root
> filesystem gets saturated with writes. I can easily notice it using
> dstat. Is this normal?
> 
> Could anyone give me a pointer or an example which works? My end goal
> is to do some random writes benchmarks.

Hi,

When using the SPDK NVMe fio_plugin, you need to specify a filename
in a special format. See examples/nvme/fio_plugin/README.md for the format.

For example:

  fio yourconf.fio --filename=0000.04.00.0/1

Assuming yourconf.fio is the configuration above, this would run FIO
against the NVMe device at PCI domain 0, bus 4, device 0, function 0, NVMe
namespace ID 1.

There should not be any I/O activity to your root filesystems - all I/O
should bypass the kernel stack entirely if it is being processed by the
SPDK FIO plugin.

Thanks,
-- Daniel