* How to Persistent nvme Storage?
@ 2017-12-15 4:08 ` Tony Yang
0 siblings, 0 replies; 14+ messages in thread
From: Tony Yang @ 2017-12-15 4:08 UTC (permalink / raw)
To: linux-nvme, linux-block, linux-nvme-bounces, Christoph Hellwig
Dear All:
I download the new nvme multipath version (git clone
git.infradead.org/nvme.git),I want to know how to use the
multipath, because I want use udev to Persistent Storage,But
when use scsi_id command not found any messages.
What method can nvme achieve multi-path? Can you provide an
example? Thank you
[root@udev]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sdb 8:16 0 1.8T 0 disk
dfa 252:0 0 2.9T 0 disk
=E2=94=9C=E2=94=80dfa5 252:5 0 734.8G 0 part
=E2=94=9C=E2=94=80dfa3 252:3 0 745.1G 0 part
=E2=94=9C=E2=94=80dfa1 252:1 0 9.3G 0 part
=E2=94=9C=E2=94=80dfa4 252:4 0 745.1G 0 part
=E2=94=94=E2=94=80dfa2 252:2 0 745.1G 0 part
nvme1n1 259:10 0 2.9T 0 disk
=E2=94=9C=E2=94=80nvme1n1p5 259:15 0 734.8G 0 part
=E2=94=9C=E2=94=80nvme1n1p3 259:13 0 745.1G 0 part
=E2=94=9C=E2=94=80nvme1n1p1 259:11 0 9.3G 0 part
=E2=94=9C=E2=94=80nvme1n1p4 259:14 0 745.1G 0 part
=E2=94=94=E2=94=80nvme1n1p2 259:12 0 745.1G 0 part
loop0 7:0 0 3.8G 0 loop /mnt/cdrom
sdc 8:32 0 557.9G 0 disk
=E2=94=9C=E2=94=80sdc2 8:34 0 512M 0 part /boot
=E2=94=9C=E2=94=80sdc3 8:35 0 557.3G 0 part
=E2=94=82 =E2=94=9C=E2=94=80rhel-swap 253:1 0 4G 0 lvm [SWAP]
=E2=94=82 =E2=94=94=E2=94=80rhel-root 253:0 0 553.3G 0 lvm /
=E2=94=94=E2=94=80sdc1 8:33 0 100M 0 part /boot/efi
sda 8:0 0 1.8T 0 disk
nvme0n1 259:0 0 1.8T 0 disk
=E2=94=9C=E2=94=80nvme0n1p5 259:5 0 100G 0 part
=E2=94=9C=E2=94=80nvme0n1p3 259:3 0 8G 0 part
=E2=94=9C=E2=94=80nvme0n1p1 259:1 0 8G 0 part
=E2=94=9C=E2=94=80nvme0n1p8 259:8 0 100G 0 part
=E2=94=9C=E2=94=80nvme0n1p6 259:6 0 100G 0 part
=E2=94=9C=E2=94=80nvme0n1p4 259:4 0 1K 0 part
=E2=94=9C=E2=94=80nvme0n1p2 259:2 0 8G 0 part
=E2=94=9C=E2=94=80nvme0n1p9 259:9 0 100G 0 part
=E2=94=94=E2=94=80nvme0n1p7 259:7 0 100G 0 part
[root@udev]# /usr/lib/udev/scsi_id -g -u -d /dev/sdb
3518f2920201113ff
[root@udev]# /usr/lib/udev/scsi_id -g -u -d /dev/dfa
[root@udev]# /usr/lib/udev/scsi_id -g -u -d /dev/dfa5
[root@udev]# /usr/lib/udev/scsi_id -g -u -d /dev/nvme1n1p5
^ permalink raw reply [flat|nested] 14+ messages in thread
* How to Persistent nvme Storage?
@ 2017-12-15 4:08 ` Tony Yang
0 siblings, 0 replies; 14+ messages in thread
From: Tony Yang @ 2017-12-15 4:08 UTC (permalink / raw)
Dear All:
I download the new nvme multipath version (git clone
git.infradead.org/nvme.git),I want to know how to use the
multipath, because I want use udev to Persistent Storage,But
when use scsi_id command not found any messages.
What method can nvme achieve multi-path? Can you provide an
example? Thank you
[root at udev]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sdb 8:16 0 1.8T 0 disk
dfa 252:0 0 2.9T 0 disk
??dfa5 252:5 0 734.8G 0 part
??dfa3 252:3 0 745.1G 0 part
??dfa1 252:1 0 9.3G 0 part
??dfa4 252:4 0 745.1G 0 part
??dfa2 252:2 0 745.1G 0 part
nvme1n1 259:10 0 2.9T 0 disk
??nvme1n1p5 259:15 0 734.8G 0 part
??nvme1n1p3 259:13 0 745.1G 0 part
??nvme1n1p1 259:11 0 9.3G 0 part
??nvme1n1p4 259:14 0 745.1G 0 part
??nvme1n1p2 259:12 0 745.1G 0 part
loop0 7:0 0 3.8G 0 loop /mnt/cdrom
sdc 8:32 0 557.9G 0 disk
??sdc2 8:34 0 512M 0 part /boot
??sdc3 8:35 0 557.3G 0 part
? ??rhel-swap 253:1 0 4G 0 lvm [SWAP]
? ??rhel-root 253:0 0 553.3G 0 lvm /
??sdc1 8:33 0 100M 0 part /boot/efi
sda 8:0 0 1.8T 0 disk
nvme0n1 259:0 0 1.8T 0 disk
??nvme0n1p5 259:5 0 100G 0 part
??nvme0n1p3 259:3 0 8G 0 part
??nvme0n1p1 259:1 0 8G 0 part
??nvme0n1p8 259:8 0 100G 0 part
??nvme0n1p6 259:6 0 100G 0 part
??nvme0n1p4 259:4 0 1K 0 part
??nvme0n1p2 259:2 0 8G 0 part
??nvme0n1p9 259:9 0 100G 0 part
??nvme0n1p7 259:7 0 100G 0 part
[root at udev]# /usr/lib/udev/scsi_id -g -u -d /dev/sdb
3518f2920201113ff
[root at udev]# /usr/lib/udev/scsi_id -g -u -d /dev/dfa
[root at udev]# /usr/lib/udev/scsi_id -g -u -d /dev/dfa5
[root at udev]# /usr/lib/udev/scsi_id -g -u -d /dev/nvme1n1p5
^ permalink raw reply [flat|nested] 14+ messages in thread
* How to Persistent nvme Storage?
2017-12-25 17:27 ` Sagi Grimberg
@ 2017-12-26 9:14 ` Tony Yang
0 siblings, 0 replies; 14+ messages in thread
From: Tony Yang @ 2017-12-26 9:14 UTC (permalink / raw)
Hi,
I follow your prompts to download the latest nvme 4.15, according
to the following steps to configure, but still can not find
CONFIG_NVME_MULTIPATH this option, how to solve?
Create the kernel .config file?
make menuconfig
Select the following modules by clicking on each line and typing the letter "M".
NVM Express block device
NVM Express over Fabrics RDMA host driver
NVMe Target support
NVMe loopback device support
NVMe over Fabrics RDMA target support
Go to:
Device Drivers > Network device support > Ethernet driver support >
Mellanox devices >
And make sure that the following module is enabled.
Mellanox Technologies ConnectX-4 and Connect-IB core driver
and then save .config to check not found CONFIG_NVME_MULTIPATH <<<----
[root at cesdb01 nvme-4.15]# cat .config |grep -i nvme
CONFIG_NVME_CORE=m
CONFIG_BLK_DEV_NVME=m
CONFIG_NVME_FABRICS=m
CONFIG_NVME_RDMA=m
CONFIG_NVME_FC=m
CONFIG_NVME_TARGET=m
CONFIG_NVME_TARGET_LOOP=m
CONFIG_NVME_TARGET_RDMA=m
CONFIG_NVME_TARGET_FC=m
CONFIG_NVME_TARGET_FCLOOP=m
CONFIG_RTC_NVMEM=y
CONFIG_NVMEM=y
[root at cesdb01 nvme-4.15]#
2017-12-26 1:27 GMT+08:00 Sagi Grimberg <sagi at grimberg.me>:
>
>> Thanks
>>
>> I check the .config ,not found CONFIG_NVME_MULTIPATH=y?I added this
>> line to .config file then recompile, but always do not have this
>> option, how to set up this option to open? I use the nvme-4.15
>> version.
>>
>> [root at cesdb01 nvme-4.15]# uname -r
>> 4.13.0-rc7+
>
>
> You need to upgrade the kernel, you can use the latest from the nvme
> tree http://git.infradead.org/nvme.git nvme-4.15
^ permalink raw reply [flat|nested] 14+ messages in thread
* How to Persistent nvme Storage?
2017-12-25 15:02 ` Tony Yang
@ 2017-12-25 17:27 ` Sagi Grimberg
2017-12-26 9:14 ` Tony Yang
0 siblings, 1 reply; 14+ messages in thread
From: Sagi Grimberg @ 2017-12-25 17:27 UTC (permalink / raw)
> Thanks
>
> I check the .config ,not found CONFIG_NVME_MULTIPATH=y?I added this
> line to .config file then recompile, but always do not have this
> option, how to set up this option to open? I use the nvme-4.15
> version.
>
> [root at cesdb01 nvme-4.15]# uname -r
> 4.13.0-rc7+
You need to upgrade the kernel, you can use the latest from the nvme
tree http://git.infradead.org/nvme.git nvme-4.15
^ permalink raw reply [flat|nested] 14+ messages in thread
* How to Persistent nvme Storage?
2017-12-25 10:10 ` Sagi Grimberg
@ 2017-12-25 15:02 ` Tony Yang
2017-12-25 17:27 ` Sagi Grimberg
0 siblings, 1 reply; 14+ messages in thread
From: Tony Yang @ 2017-12-25 15:02 UTC (permalink / raw)
Thanks
I check the .config ,not found CONFIG_NVME_MULTIPATH=y?I added this
line to .config file then recompile, but always do not have this
option, how to set up this option to open? I use the nvme-4.15
version.
[root at cesdb01 nvme-4.15]# uname -r
4.13.0-rc7+
[root at cesdb01 nvme-4.15]# cat .config|grep -i nvme
CONFIG_NVME_CORE=m
CONFIG_BLK_DEV_NVME=m
CONFIG_NVME_FABRICS=m
CONFIG_NVME_RDMA=m
CONFIG_NVME_FC=m
CONFIG_NVME_TARGET=m
CONFIG_NVME_TARGET_LOOP=m
CONFIG_NVME_TARGET_RDMA=m
CONFIG_NVME_TARGET_FC=m
CONFIG_NVME_TARGET_FCLOOP=m
CONFIG_RTC_NVMEM=y
CONFIG_NVMEM=y
[root at cesdb01 nvme-4.15]# nvme list
Node SN Model
Namespace Usage Format FW Rev
---------------- --------------------
---------------------------------------- ---------
-------------------------- ---------------- --------
/dev/nvme3n1 52a5c7ef4e684a27 Linux
10 600.13 GB / 600.13 GB 512 B + 0 B 4.13.0-r
/dev/nvme4n1 20a4165e18d8146f Linux
10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
/dev/nvme5n1 ab72e70de250bce6 Linux
10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
/dev/nvme6n1 67834bc8f68e1be9 Linux
10 2.00 TB / 2.00 TB 512 B + 0 B 4.13.0-r
/dev/nvme7n1 bc3922467a3524a5 Linux
10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
/dev/nvme8n1 1d346731b87eb3d3 Linux
10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
[root at cesdb01 nvme-4.15]# nvme list-subsys
no NVMe subsystem(s) detected.
[root at cesdb01 nvme-4.15]#
2017-12-25 18:10 GMT+08:00 Sagi Grimberg <sagi at grimberg.me>:
> Please check your kernel .config includes CONFIG_NVME_MULTIPATH=y
> and your kernel version.
^ permalink raw reply [flat|nested] 14+ messages in thread
* How to Persistent nvme Storage?
2017-12-25 8:35 ` Tony Yang
@ 2017-12-25 10:10 ` Sagi Grimberg
2017-12-25 15:02 ` Tony Yang
0 siblings, 1 reply; 14+ messages in thread
From: Sagi Grimberg @ 2017-12-25 10:10 UTC (permalink / raw)
Please check your kernel .config includes CONFIG_NVME_MULTIPATH=y
and your kernel version.
^ permalink raw reply [flat|nested] 14+ messages in thread
* How to Persistent nvme Storage?
2017-12-25 8:13 ` Tony Yang
@ 2017-12-25 8:35 ` Tony Yang
2017-12-25 10:10 ` Sagi Grimberg
0 siblings, 1 reply; 14+ messages in thread
From: Tony Yang @ 2017-12-25 8:35 UTC (permalink / raw)
$ git clone git at github.com:linux-nvme/nvme-cli.git
Cloning into 'nvme-cli'...
remote: Counting objects: 4005, done.
remote: Compressing objects: 100% (144/144), done.
rRemote: Total 4005 (delta 203), reused 190 (delta 143), pack-reused 3718eceivin
Receiving objects: 100% (4005/4005), 1.85 MiB | 88.00 KiB/s, done.
Resolving deltas: 100% (2973/2973), done.
Checking connectivity... done.
Checking out files: 100% (306/306), done.
[root at cesdb01 ~]# nvme list-subsys <<<-----No anything
no NVMe subsystem(s) detected.
[root at cesdb01 ~]# nvme list
Node SN Model
Namespace Usage Format FW Rev
---------------- --------------------
---------------------------------------- ---------
-------------------------- ---------------- --------
/dev/nvme0n1 c21dcaeffdf61b87 Linux
10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
/dev/nvme1n1 c21dcaeffdf61b87 Linux
10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
[root at cesdb01 ~]# nvme -version <<-----The lastest version
nvme version 1.4.58.g0b78.dirty
2017-12-25 16:13 GMT+08:00 Tony Yang <yyt168 at gmail.com>:
> Thanks Sagi
>
> I always use the latest nvme-cli
>
> the download address is :https://github.com/linux-nvme/nvme-cli
>
> [root at cesdb01 ~]# nvme -version
> nvme version 1.4
>
>
>
> 2017-12-25 15:49 GMT+08:00 Sagi Grimberg <sagi at grimberg.me>:
>>
>>> [root at cesdb01 ~]# nvme list
>>> Node SN Model
>>> Namespace Usage Format FW Rev
>>> ---------------- --------------------
>>> ---------------------------------------- ---------
>>> -------------------------- ---------------- --------
>>> /dev/nvme0n1 66903eb81cd10252 Linux
>>> 10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
>>> /dev/nvme1n1 66903eb81cd10252 Linux
>>> 10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
>>> /dev/nvme2n1 539f93d6b088e284 Linux
>>> 10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
>>> /dev/nvme3n1 5dd2e0fe188db860 Linux
>>> 10 600.13 GB / 600.13 GB 512 B + 0 B 4.13.0-r
>>> /dev/nvme4n1 38718b8ad7d5e19b Linux
>>> 10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
>>> /dev/nvme5n1 a70df79680a5c834 Linux
>>> 10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
>>> /dev/nvme6n1 f592f9994c0d6469 Linux
>>> 10 2.00 TB / 2.00 TB 512 B + 0 B 4.13.0-r
>>> /dev/nvme7n1 c6e151aae72ee9ec Linux
>>> 10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
>>> /dev/nvme8n1 66113fb757713fcd Linux
>>> 10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
>>> [root at cesdb01 ~]# nvme list-subsys
>>> no NVMe subsystem(s) detected.
>>> [root at cesdb01 ~]#
>>
>>
>> Please make sure you are running with the latest nvme-cli:
>> git at github.com:linux-nvme/nvme-cli.git
^ permalink raw reply [flat|nested] 14+ messages in thread
* How to Persistent nvme Storage?
2017-12-25 7:49 ` Sagi Grimberg
@ 2017-12-25 8:13 ` Tony Yang
2017-12-25 8:35 ` Tony Yang
0 siblings, 1 reply; 14+ messages in thread
From: Tony Yang @ 2017-12-25 8:13 UTC (permalink / raw)
Thanks Sagi
I always use the latest nvme-cli
the download address is :https://github.com/linux-nvme/nvme-cli
[root at cesdb01 ~]# nvme -version
nvme version 1.4
2017-12-25 15:49 GMT+08:00 Sagi Grimberg <sagi at grimberg.me>:
>
>> [root at cesdb01 ~]# nvme list
>> Node SN Model
>> Namespace Usage Format FW Rev
>> ---------------- --------------------
>> ---------------------------------------- ---------
>> -------------------------- ---------------- --------
>> /dev/nvme0n1 66903eb81cd10252 Linux
>> 10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
>> /dev/nvme1n1 66903eb81cd10252 Linux
>> 10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
>> /dev/nvme2n1 539f93d6b088e284 Linux
>> 10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
>> /dev/nvme3n1 5dd2e0fe188db860 Linux
>> 10 600.13 GB / 600.13 GB 512 B + 0 B 4.13.0-r
>> /dev/nvme4n1 38718b8ad7d5e19b Linux
>> 10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
>> /dev/nvme5n1 a70df79680a5c834 Linux
>> 10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
>> /dev/nvme6n1 f592f9994c0d6469 Linux
>> 10 2.00 TB / 2.00 TB 512 B + 0 B 4.13.0-r
>> /dev/nvme7n1 c6e151aae72ee9ec Linux
>> 10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
>> /dev/nvme8n1 66113fb757713fcd Linux
>> 10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
>> [root at cesdb01 ~]# nvme list-subsys
>> no NVMe subsystem(s) detected.
>> [root at cesdb01 ~]#
>
>
> Please make sure you are running with the latest nvme-cli:
> git at github.com:linux-nvme/nvme-cli.git
^ permalink raw reply [flat|nested] 14+ messages in thread
* How to Persistent nvme Storage?
2017-12-25 7:29 ` Tony Yang
@ 2017-12-25 7:49 ` Sagi Grimberg
2017-12-25 8:13 ` Tony Yang
0 siblings, 1 reply; 14+ messages in thread
From: Sagi Grimberg @ 2017-12-25 7:49 UTC (permalink / raw)
> [root at cesdb01 ~]# nvme list
> Node SN Model
> Namespace Usage Format FW Rev
> ---------------- --------------------
> ---------------------------------------- ---------
> -------------------------- ---------------- --------
> /dev/nvme0n1 66903eb81cd10252 Linux
> 10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
> /dev/nvme1n1 66903eb81cd10252 Linux
> 10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
> /dev/nvme2n1 539f93d6b088e284 Linux
> 10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
> /dev/nvme3n1 5dd2e0fe188db860 Linux
> 10 600.13 GB / 600.13 GB 512 B + 0 B 4.13.0-r
> /dev/nvme4n1 38718b8ad7d5e19b Linux
> 10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
> /dev/nvme5n1 a70df79680a5c834 Linux
> 10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
> /dev/nvme6n1 f592f9994c0d6469 Linux
> 10 2.00 TB / 2.00 TB 512 B + 0 B 4.13.0-r
> /dev/nvme7n1 c6e151aae72ee9ec Linux
> 10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
> /dev/nvme8n1 66113fb757713fcd Linux
> 10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
> [root at cesdb01 ~]# nvme list-subsys
> no NVMe subsystem(s) detected.
> [root at cesdb01 ~]#
Please make sure you are running with the latest nvme-cli:
git at github.com:linux-nvme/nvme-cli.git
^ permalink raw reply [flat|nested] 14+ messages in thread
* How to Persistent nvme Storage?
2017-12-25 7:25 ` Sagi Grimberg
@ 2017-12-25 7:29 ` Tony Yang
2017-12-25 7:49 ` Sagi Grimberg
0 siblings, 1 reply; 14+ messages in thread
From: Tony Yang @ 2017-12-25 7:29 UTC (permalink / raw)
[root at cesdb01 ~]# nvme list
Node SN Model
Namespace Usage Format FW Rev
---------------- --------------------
---------------------------------------- ---------
-------------------------- ---------------- --------
/dev/nvme0n1 66903eb81cd10252 Linux
10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
/dev/nvme1n1 66903eb81cd10252 Linux
10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
/dev/nvme2n1 539f93d6b088e284 Linux
10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
/dev/nvme3n1 5dd2e0fe188db860 Linux
10 600.13 GB / 600.13 GB 512 B + 0 B 4.13.0-r
/dev/nvme4n1 38718b8ad7d5e19b Linux
10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
/dev/nvme5n1 a70df79680a5c834 Linux
10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
/dev/nvme6n1 f592f9994c0d6469 Linux
10 2.00 TB / 2.00 TB 512 B + 0 B 4.13.0-r
/dev/nvme7n1 c6e151aae72ee9ec Linux
10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
/dev/nvme8n1 66113fb757713fcd Linux
10 1.92 TB / 1.92 TB 512 B + 0 B 4.13.0-r
[root at cesdb01 ~]# nvme list-subsys
no NVMe subsystem(s) detected.
[root at cesdb01 ~]#
2017-12-25 15:25 GMT+08:00 Sagi Grimberg <sagi at grimberg.me>:
>
>> Thanks .
>>
>> Merry Christmas?I'm sorry to bother you at the festival, but I
>> really need your help, I downloaded the latest nvme-cli version,
>> currently 1.4, I use two ib cards to connect to the same device, but I
>> do not know how to use it Multipathing binds these two nvme
>> devices.Hope to receive your reply?Thanks
>
>
> run: nvme list-subsys
>
> you can see the expected output in the man pages.
^ permalink raw reply [flat|nested] 14+ messages in thread
* How to Persistent nvme Storage?
2017-12-25 6:57 ` Tony Yang
@ 2017-12-25 7:25 ` Sagi Grimberg
2017-12-25 7:29 ` Tony Yang
0 siblings, 1 reply; 14+ messages in thread
From: Sagi Grimberg @ 2017-12-25 7:25 UTC (permalink / raw)
> Thanks .
>
> Merry Christmas?I'm sorry to bother you at the festival, but I
> really need your help, I downloaded the latest nvme-cli version,
> currently 1.4, I use two ib cards to connect to the same device, but I
> do not know how to use it Multipathing binds these two nvme
> devices.Hope to receive your reply?Thanks
run: nvme list-subsys
you can see the expected output in the man pages.
^ permalink raw reply [flat|nested] 14+ messages in thread
* How to Persistent nvme Storage?
2017-12-20 19:04 ` Sagi Grimberg
@ 2017-12-25 6:57 ` Tony Yang
2017-12-25 7:25 ` Sagi Grimberg
0 siblings, 1 reply; 14+ messages in thread
From: Tony Yang @ 2017-12-25 6:57 UTC (permalink / raw)
Thanks .
Merry Christmas?I'm sorry to bother you at the festival, but I
really need your help, I downloaded the latest nvme-cli version,
currently 1.4, I use two ib cards to connect to the same device, but I
do not know how to use it Multipathing binds these two nvme
devices.Hope to receive your reply?Thanks
[root at cesdb01 ~]# dmesg | grep "enabling port"
[ 69.753031] nvmet_rdma: enabling port 1 (10.1.1.21:4420)
[18730.016827] nvmet_rdma: enabling port 2 (10.1.1.121:4420)
[root at cesdb01 ~]# nvme discover -t rdma -a 10.1.1.121 -s 4420
Discovery Log Number of Records 1, Generation counter 5
=====Discovery Log Entry 0======
trtype: rdma
adrfam: ipv4
subtype: nvme subsystem
treq: not specified
portid: 2
trsvcid: 4420
subnqn: CESDB01A
traddr: 10.1.1.121
rdma_prtype: not specified
rdma_qptype: connected
rdma_cms: rdma-cm
rdma_pkey: 0x0000
[root at cesdb01 ~]# nvme connect -t rdma -n CESDB01A -a 10.1.1.21 -s 4420
[root at cesdb01 ~]# nvme connect -t rdma -n CESDB01A -a 10.1.1.121 -s 4420
[root at cesdb01 ~]# nvme list
Node SN Model
Namespace Usage Format FW Rev
---------------- --------------------
---------------------------------------- ---------
-------------------------- ---------------- --------
/dev/nvme0n1 66903eb81cd10252 Linux
10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
/dev/nvme1n1 66903eb81cd10252 Linux
10 3.20 TB / 3.20 TB 512 B + 0 B 4.13.0-r
[root at cesdb01 ~]# nvme -version
nvme version 1.4
2017-12-21 3:04 GMT+08:00 Sagi Grimberg <sagi at grimberg.me>:
> Tony,
>
>> Dear All:
>>
>> I download the new nvme multipath version (git clone from
>> git.infradead.org nvme.git),I want to know how to use the
>> multipath, because I want use udev to Persistent Storage,But
>> when use scsi_id command not found any messages.
>> What method can nvme achieve multi-path? Can you provide an
>> example? Thank you
>
>
> If you opt in CONFIG_NVME_MULTIPATH the nvme device nodes you see
> will actually be multipath devices (no scsi device identification
> needed). Johannes submitted a nvme-cli code to get some more information
> wrt to multipathing.
^ permalink raw reply [flat|nested] 14+ messages in thread
* How to Persistent nvme Storage?
2017-12-16 3:30 Tony Yang
@ 2017-12-20 19:04 ` Sagi Grimberg
2017-12-25 6:57 ` Tony Yang
0 siblings, 1 reply; 14+ messages in thread
From: Sagi Grimberg @ 2017-12-20 19:04 UTC (permalink / raw)
Tony,
> Dear All:
>
> I download the new nvme multipath version (git clone from
> git.infradead.org nvme.git),I want to know how to use the
> multipath, because I want use udev to Persistent Storage,But
> when use scsi_id command not found any messages.
> What method can nvme achieve multi-path? Can you provide an
> example? Thank you
If you opt in CONFIG_NVME_MULTIPATH the nvme device nodes you see
will actually be multipath devices (no scsi device identification
needed). Johannes submitted a nvme-cli code to get some more information
wrt to multipathing.
^ permalink raw reply [flat|nested] 14+ messages in thread
* How to Persistent nvme Storage?
@ 2017-12-16 3:30 Tony Yang
2017-12-20 19:04 ` Sagi Grimberg
0 siblings, 1 reply; 14+ messages in thread
From: Tony Yang @ 2017-12-16 3:30 UTC (permalink / raw)
Dear All:
I download the new nvme multipath version (git clone from
git.infradead.org nvme.git),I want to know how to use the
multipath, because I want use udev to Persistent Storage,But
when use scsi_id command not found any messages.
What method can nvme achieve multi-path? Can you provide an
example? Thank you
[root at udev]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sdb 8:16 0 1.8T 0 disk
dfa 252:0 0 2.9T 0 disk
??dfa5 252:5 0 734.8G 0 part
??dfa3 252:3 0 745.1G 0 part
??dfa1 252:1 0 9.3G 0 part
??dfa4 252:4 0 745.1G 0 part
??dfa2 252:2 0 745.1G 0 part
nvme1n1 259:10 0 2.9T 0 disk
??nvme1n1p5 259:15 0 734.8G 0 part
??nvme1n1p3 259:13 0 745.1G 0 part
??nvme1n1p1 259:11 0 9.3G 0 part
??nvme1n1p4 259:14 0 745.1G 0 part
??nvme1n1p2 259:12 0 745.1G 0 part
loop0 7:0 0 3.8G 0 loop /mnt/cdrom
sdc 8:32 0 557.9G 0 disk
??sdc2 8:34 0 512M 0 part /boot
??sdc3 8:35 0 557.3G 0 part
? ??rhel-swap 253:1 0 4G 0 lvm [SWAP]
? ??rhel-root 253:0 0 553.3G 0 lvm /
??sdc1 8:33 0 100M 0 part /boot/efi
sda 8:0 0 1.8T 0 disk
nvme0n1 259:0 0 1.8T 0 disk
??nvme0n1p5 259:5 0 100G 0 part
??nvme0n1p3 259:3 0 8G 0 part
??nvme0n1p1 259:1 0 8G 0 part
??nvme0n1p8 259:8 0 100G 0 part
??nvme0n1p6 259:6 0 100G 0 part
??nvme0n1p4 259:4 0 1K 0 part
??nvme0n1p2 259:2 0 8G 0 part
??nvme0n1p9 259:9 0 100G 0 part
??nvme0n1p7 259:7 0 100G 0 part
[root at udev]# /usr/lib/udev/scsi_id -g -u -d /dev/sdb
3518f2920201113ff
[root at udev]# /usr/lib/udev/scsi_id -g -u -d /dev/dfa
[root at udev]# /usr/lib/udev/scsi_id -g -u -d /dev/dfa5
[root at udev]# /usr/lib/udev/scsi_id -g -u -d /dev/nvme1n1p5
^ permalink raw reply [flat|nested] 14+ messages in thread
end of thread, other threads:[~2017-12-26 9:14 UTC | newest]
Thread overview: 14+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2017-12-15 4:08 How to Persistent nvme Storage? Tony Yang
2017-12-15 4:08 ` Tony Yang
2017-12-16 3:30 Tony Yang
2017-12-20 19:04 ` Sagi Grimberg
2017-12-25 6:57 ` Tony Yang
2017-12-25 7:25 ` Sagi Grimberg
2017-12-25 7:29 ` Tony Yang
2017-12-25 7:49 ` Sagi Grimberg
2017-12-25 8:13 ` Tony Yang
2017-12-25 8:35 ` Tony Yang
2017-12-25 10:10 ` Sagi Grimberg
2017-12-25 15:02 ` Tony Yang
2017-12-25 17:27 ` Sagi Grimberg
2017-12-26 9:14 ` Tony Yang
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.