Re: [SPDK] vhost target run in another vm

Re: [SPDK] vhost target run in another vm

[Wodkowski, PawelX]

[-- Attachment #1: Type: text/plain, Size: 2924 bytes --]

I think inter VM communication is outside of SPDK vhost area (pls correct me if I'm wrong here). We are providing storage virtio-scsi and virtio-blk devices (the green "Storage I/O" arrow). You can abuse  SPDK vhost to simulate inter-VM communication by sharing the same bdev but currently the SCSI subsystem don't support SCSI RESERVATION so this don't make sense right now. I think using (DPDK) virtio-net to do inter-VM communication is what you want.

Pawel

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Friday, March 9, 2018 2:45 AM
To: spdk <spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm

Hi, Pawel
you can see the architecture of nutanix. http://nutanixbible.com/imagesv2/converged_platform.png
There is a communication between user vm and control vm , that's what I talk.

________________________________
kinzent(a)hotmail.com

From: Wodkowski, PawelX<mailto:pawelx.wodkowski(a)intel.com>
Date: 2018-03-08 23:30
To: Storage Performance Development Kit<mailto:spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm
I'm not sure if I have good understand of what you want to achieve. Can you describe your usecase?
You can use nvmf target to expose resource for multiple vhost targets. Maybe you need SPDK virtio initiator http://www.spdk.io/doc/virtio.html ?

Pawel

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Thursday, March 8, 2018 2:58 PM
To: spdk <spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm

Hi, Paweł

Thanks for reply.
 I think the scenario what you refers is same as the native scenario, that's not what I want. I wonder if  run spdk in a standalone vm or container will be very usefully in a cloud environment.
 If SPDK can not achieve this goal now, how to do? It's there a way to make it?

________________________________
kinzent(a)hotmail.com<mailto:kinzent(a)hotmail.com>

From: Wodkowski, PawelX<mailto:pawelx.wodkowski(a)intel.com>
Date: 2018-03-08 18:06
To: Storage Performance Development Kit<mailto:spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm
If you are talking about SPDK vhost target inter VM communication currently no. You can run SPDK vhost target in nested VM scenario: in VM you start vhost target and then inside the same VM you start nested VM. This scenario is test and working.

Paweł

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Thursday, March 8, 2018 9:20 AM
To: spdk <spdk(a)lists.01.org<mailto:spdk(a)lists.01.org>>
Subject: [SPDK] vhost target run in another vm

Hi, all

I found the vhost target is a great solution. But it needs to run on the host. Can I run the vhost-target in another vm or container? If not, what's the gap?

________________________________
kinzent(a)hotmail.com<mailto:kinzent(a)hotmail.com>

[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 16806 bytes --]

Re: [SPDK] vhost target run in another vm

[Harris, James R]

[-- Attachment #1: Type: text/plain, Size: 4252 bytes --]

Hi Frank,

SPDK cannot run in this mode yet but it’s highly desirable.  We have a couple of folks here at Intel that are digging into this further to scope the effort needed.

-Jim


From: SPDK <spdk-bounces(a)lists.01.org> on behalf of Huang Frank <kinzent(a)hotmail.com>
Reply-To: Storage Performance Development Kit <spdk(a)lists.01.org>
Date: Sunday, March 11, 2018 at 7:05 PM
To: spdk <spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm

Hi, Jim

Thanks.
That's same as what I wanted. The demo is for dpdk, does the vhost of spdk can run in this way too?

________________________________
kinzent(a)hotmail.com

From: Harris, James R<mailto:james.r.harris(a)intel.com>
Date: 2018-03-10 01:24
To: Storage Performance Development Kit<mailto:spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm
Hi Frank,

Do you mean something like is described here?

https://wiki.qemu.org/Features/VirtioVhostUser

-Jim


From: SPDK <spdk-bounces(a)lists.01.org> on behalf of "Wodkowski, PawelX" <pawelx.wodkowski(a)intel.com>
Reply-To: Storage Performance Development Kit <spdk(a)lists.01.org>
Date: Friday, March 9, 2018 at 2:55 AM
To: Storage Performance Development Kit <spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm

I think inter VM communication is outside of SPDK vhost area (pls correct me if I’m wrong here). We are providing storage virtio-scsi and virtio-blk devices (the green “Storage I/O” arrow). You can abuse  SPDK vhost to simulate inter-VM communication by sharing the same bdev but currently the SCSI subsystem don’t support SCSI RESERVATION so this don’t make sense right now. I think using (DPDK) virtio-net to do inter-VM communication is what you want.

Pawel

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Friday, March 9, 2018 2:45 AM
To: spdk <spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm

Hi, Pawel
you can see the architecture of nutanix. http://nutanixbible.com/imagesv2/converged_platform.png
There is a communication between user vm and control vm , that's what I talk.

________________________________
kinzent(a)hotmail.com

From: Wodkowski, PawelX<mailto:pawelx.wodkowski(a)intel.com>
Date: 2018-03-08 23:30
To: Storage Performance Development Kit<mailto:spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm
I'm not sure if I have good understand of what you want to achieve. Can you describe your usecase?
You can use nvmf target to expose resource for multiple vhost targets. Maybe you need SPDK virtio initiator http://www.spdk.io/doc/virtio.html ?

Pawel

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Thursday, March 8, 2018 2:58 PM
To: spdk <spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm

Hi, Paweł

Thanks for reply.
 I think the scenario what you refers is same as the native scenario, that's not what I want. I wonder if  run spdk in a standalone vm or container will be very usefully in a cloud environment.
 If SPDK can not achieve this goal now, how to do? It's there a way to make it?

________________________________
kinzent(a)hotmail.com<mailto:kinzent(a)hotmail.com>

From: Wodkowski, PawelX<mailto:pawelx.wodkowski(a)intel.com>
Date: 2018-03-08 18:06
To: Storage Performance Development Kit<mailto:spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm
If you are talking about SPDK vhost target inter VM communication currently no. You can run SPDK vhost target in nested VM scenario: in VM you start vhost target and then inside the same VM you start nested VM. This scenario is test and working.

Paweł

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Thursday, March 8, 2018 9:20 AM
To: spdk <spdk(a)lists.01.org<mailto:spdk(a)lists.01.org>>
Subject: [SPDK] vhost target run in another vm

Hi, all

I found the vhost target is a great solution. But it needs to run on the host. Can I run the vhost-target in another vm or container? If not, what's the gap?

________________________________
kinzent(a)hotmail.com<mailto:kinzent(a)hotmail.com>

[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 22270 bytes --]

Re: [SPDK] vhost target run in another vm

[Huang Frank]

[-- Attachment #1: Type: text/plain, Size: 3773 bytes --]

Hi, Jim

Thanks.
That's same as what I wanted. The demo is for dpdk, does the vhost of spdk can run in this way too?

________________________________
kinzent(a)hotmail.com

From: Harris, James R<mailto:james.r.harris(a)intel.com>
Date: 2018-03-10 01:24
To: Storage Performance Development Kit<mailto:spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm
Hi Frank,

Do you mean something like is described here?

https://wiki.qemu.org/Features/VirtioVhostUser

-Jim


From: SPDK <spdk-bounces(a)lists.01.org> on behalf of "Wodkowski, PawelX" <pawelx.wodkowski(a)intel.com>
Reply-To: Storage Performance Development Kit <spdk(a)lists.01.org>
Date: Friday, March 9, 2018 at 2:55 AM
To: Storage Performance Development Kit <spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm

I think inter VM communication is outside of SPDK vhost area (pls correct me if I’m wrong here). We are providing storage virtio-scsi and virtio-blk devices (the green “Storage I/O” arrow). You can abuse  SPDK vhost to simulate inter-VM communication by sharing the same bdev but currently the SCSI subsystem don’t support SCSI RESERVATION so this don’t make sense right now. I think using (DPDK) virtio-net to do inter-VM communication is what you want.

Pawel

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Friday, March 9, 2018 2:45 AM
To: spdk <spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm

Hi, Pawel
you can see the architecture of nutanix. http://nutanixbible.com/imagesv2/converged_platform.png
There is a communication between user vm and control vm , that's what I talk.

________________________________
kinzent(a)hotmail.com

From: Wodkowski, PawelX<mailto:pawelx.wodkowski(a)intel.com>
Date: 2018-03-08 23:30
To: Storage Performance Development Kit<mailto:spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm
I'm not sure if I have good understand of what you want to achieve. Can you describe your usecase?
You can use nvmf target to expose resource for multiple vhost targets. Maybe you need SPDK virtio initiator http://www.spdk.io/doc/virtio.html ?

Pawel

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Thursday, March 8, 2018 2:58 PM
To: spdk <spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm

Hi, Paweł

Thanks for reply.
 I think the scenario what you refers is same as the native scenario, that's not what I want. I wonder if  run spdk in a standalone vm or container will be very usefully in a cloud environment.
 If SPDK can not achieve this goal now, how to do? It's there a way to make it?

________________________________
kinzent(a)hotmail.com<mailto:kinzent(a)hotmail.com>

From: Wodkowski, PawelX<mailto:pawelx.wodkowski(a)intel.com>
Date: 2018-03-08 18:06
To: Storage Performance Development Kit<mailto:spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm
If you are talking about SPDK vhost target inter VM communication currently no. You can run SPDK vhost target in nested VM scenario: in VM you start vhost target and then inside the same VM you start nested VM. This scenario is test and working.

Paweł

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Thursday, March 8, 2018 9:20 AM
To: spdk <spdk(a)lists.01.org<mailto:spdk(a)lists.01.org>>
Subject: [SPDK] vhost target run in another vm

Hi, all

I found the vhost target is a great solution. But it needs to run on the host. Can I run the vhost-target in another vm or container? If not, what's the gap?

________________________________
kinzent(a)hotmail.com<mailto:kinzent(a)hotmail.com>

[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 22095 bytes --]

Re: [SPDK] vhost target run in another vm

[Harris, James R]

[-- Attachment #1: Type: text/plain, Size: 3388 bytes --]

Hi Frank,

Do you mean something like is described here?

https://wiki.qemu.org/Features/VirtioVhostUser

-Jim


From: SPDK <spdk-bounces(a)lists.01.org> on behalf of "Wodkowski, PawelX" <pawelx.wodkowski(a)intel.com>
Reply-To: Storage Performance Development Kit <spdk(a)lists.01.org>
Date: Friday, March 9, 2018 at 2:55 AM
To: Storage Performance Development Kit <spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm

I think inter VM communication is outside of SPDK vhost area (pls correct me if I’m wrong here). We are providing storage virtio-scsi and virtio-blk devices (the green “Storage I/O” arrow). You can abuse  SPDK vhost to simulate inter-VM communication by sharing the same bdev but currently the SCSI subsystem don’t support SCSI RESERVATION so this don’t make sense right now. I think using (DPDK) virtio-net to do inter-VM communication is what you want.

Pawel

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Friday, March 9, 2018 2:45 AM
To: spdk <spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm

Hi, Pawel
you can see the architecture of nutanix. http://nutanixbible.com/imagesv2/converged_platform.png
There is a communication between user vm and control vm , that's what I talk.

________________________________
kinzent(a)hotmail.com

From: Wodkowski, PawelX<mailto:pawelx.wodkowski(a)intel.com>
Date: 2018-03-08 23:30
To: Storage Performance Development Kit<mailto:spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm
I'm not sure if I have good understand of what you want to achieve. Can you describe your usecase?
You can use nvmf target to expose resource for multiple vhost targets. Maybe you need SPDK virtio initiator http://www.spdk.io/doc/virtio.html ?

Pawel

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Thursday, March 8, 2018 2:58 PM
To: spdk <spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm

Hi, Paweł

Thanks for reply.
 I think the scenario what you refers is same as the native scenario, that's not what I want. I wonder if  run spdk in a standalone vm or container will be very usefully in a cloud environment.
 If SPDK can not achieve this goal now, how to do? It's there a way to make it?

________________________________
kinzent(a)hotmail.com<mailto:kinzent(a)hotmail.com>

From: Wodkowski, PawelX<mailto:pawelx.wodkowski(a)intel.com>
Date: 2018-03-08 18:06
To: Storage Performance Development Kit<mailto:spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm
If you are talking about SPDK vhost target inter VM communication currently no. You can run SPDK vhost target in nested VM scenario: in VM you start vhost target and then inside the same VM you start nested VM. This scenario is test and working.

Paweł

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Thursday, March 8, 2018 9:20 AM
To: spdk <spdk(a)lists.01.org<mailto:spdk(a)lists.01.org>>
Subject: [SPDK] vhost target run in another vm

Hi, all

I found the vhost target is a great solution. But it needs to run on the host. Can I run the vhost-target in another vm or container? If not, what's the gap?

________________________________
kinzent(a)hotmail.com<mailto:kinzent(a)hotmail.com>

[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 17810 bytes --]

Re: [SPDK] vhost target run in another vm

[Huang Frank]

[-- Attachment #1: Type: text/plain, Size: 2260 bytes --]

Hi, Pawel
you can see the architecture of nutanix. http://nutanixbible.com/imagesv2/converged_platform.png
There is a communication between user vm and control vm , that's what I talk.

________________________________
kinzent(a)hotmail.com

From: Wodkowski, PawelX<mailto:pawelx.wodkowski(a)intel.com>
Date: 2018-03-08 23:30
To: Storage Performance Development Kit<mailto:spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm
I'm not sure if I have good understand of what you want to achieve. Can you describe your usecase?
You can use nvmf target to expose resource for multiple vhost targets. Maybe you need SPDK virtio initiator http://www.spdk.io/doc/virtio.html ?

Pawel

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Thursday, March 8, 2018 2:58 PM
To: spdk <spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm

Hi, Paweł

Thanks for reply.
 I think the scenario what you refers is same as the native scenario, that's not what I want. I wonder if  run spdk in a standalone vm or container will be very usefully in a cloud environment.
 If SPDK can not achieve this goal now, how to do? It's there a way to make it?

________________________________
kinzent(a)hotmail.com<mailto:kinzent(a)hotmail.com>

From: Wodkowski, PawelX<mailto:pawelx.wodkowski(a)intel.com>
Date: 2018-03-08 18:06
To: Storage Performance Development Kit<mailto:spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm
If you are talking about SPDK vhost target inter VM communication currently no. You can run SPDK vhost target in nested VM scenario: in VM you start vhost target and then inside the same VM you start nested VM. This scenario is test and working.

Paweł

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Thursday, March 8, 2018 9:20 AM
To: spdk <spdk(a)lists.01.org<mailto:spdk(a)lists.01.org>>
Subject: [SPDK] vhost target run in another vm

Hi, all

I found the vhost target is a great solution. But it needs to run on the host. Can I run the vhost-target in another vm or container? If not, what's the gap?

________________________________
kinzent(a)hotmail.com<mailto:kinzent(a)hotmail.com>

[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 15156 bytes --]

Re: [SPDK] vhost target run in another vm

[Wodkowski, PawelX]

[-- Attachment #1: Type: text/plain, Size: 1804 bytes --]

I'm not sure if I have good understand of what you want to achieve. Can you describe your usecase?
You can use nvmf target to expose resource for multiple vhost targets. Maybe you need SPDK virtio initiator http://www.spdk.io/doc/virtio.html ?

Pawel

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Thursday, March 8, 2018 2:58 PM
To: spdk <spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm

Hi, Paweł

Thanks for reply.
 I think the scenario what you refers is same as the native scenario, that's not what I want. I wonder if  run spdk in a standalone vm or container will be very usefully in a cloud environment.
 If SPDK can not achieve this goal now, how to do? It's there a way to make it?

________________________________
kinzent(a)hotmail.com<mailto:kinzent(a)hotmail.com>

From: Wodkowski, PawelX<mailto:pawelx.wodkowski(a)intel.com>
Date: 2018-03-08 18:06
To: Storage Performance Development Kit<mailto:spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm
If you are talking about SPDK vhost target inter VM communication currently no. You can run SPDK vhost target in nested VM scenario: in VM you start vhost target and then inside the same VM you start nested VM. This scenario is test and working.

Paweł

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Thursday, March 8, 2018 9:20 AM
To: spdk <spdk(a)lists.01.org<mailto:spdk(a)lists.01.org>>
Subject: [SPDK] vhost target run in another vm

Hi, all

I found the vhost target is a great solution. But it needs to run on the host. Can I run the vhost-target in another vm or container? If not, what's the gap?

________________________________
kinzent(a)hotmail.com<mailto:kinzent(a)hotmail.com>

[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 11006 bytes --]

Re: [SPDK] vhost target run in another vm

[Huang Frank]

[-- Attachment #1: Type: text/plain, Size: 1290 bytes --]

Hi, Paweł

Thanks for reply.
 I think the scenario what you refers is same as the native scenario, that's not what I want. I wonder if  run spdk in a standalone vm or container will be very usefully in a cloud environment.
 If SPDK can not achieve this goal now, how to do? It's there a way to make it?

________________________________
kinzent(a)hotmail.com

From: Wodkowski, PawelX<mailto:pawelx.wodkowski(a)intel.com>
Date: 2018-03-08 18:06
To: Storage Performance Development Kit<mailto:spdk(a)lists.01.org>
Subject: Re: [SPDK] vhost target run in another vm
If you are talking about SPDK vhost target inter VM communication currently no. You can run SPDK vhost target in nested VM scenario: in VM you start vhost target and then inside the same VM you start nested VM. This scenario is test and working.

Paweł

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Thursday, March 8, 2018 9:20 AM
To: spdk <spdk(a)lists.01.org>
Subject: [SPDK] vhost target run in another vm

Hi, all

I found the vhost target is a great solution. But it needs to run on the host. Can I run the vhost-target in another vm or container? If not, what's the gap?

________________________________
kinzent(a)hotmail.com<mailto:kinzent(a)hotmail.com>

[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 6813 bytes --]

Re: [SPDK] vhost target run in another vm

[Wodkowski, PawelX]

[-- Attachment #1: Type: text/plain, Size: 713 bytes --]

If you are talking about SPDK vhost target inter VM communication currently no. You can run SPDK vhost target in nested VM scenario: in VM you start vhost target and then inside the same VM you start nested VM. This scenario is test and working.

Paweł

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Huang Frank
Sent: Thursday, March 8, 2018 9:20 AM
To: spdk <spdk(a)lists.01.org>
Subject: [SPDK] vhost target run in another vm

Hi, all

I found the vhost target is a great solution. But it needs to run on the host. Can I run the vhost-target in another vm or container? If not, what's the gap?

________________________________
kinzent(a)hotmail.com<mailto:kinzent(a)hotmail.com>

[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 4789 bytes --]

[SPDK] vhost target run in another vm

[Huang Frank]

[-- Attachment #1: Type: text/plain, Size: 229 bytes --]

Hi, all

I found the vhost target is a great solution. But it needs to run on the host. Can I run the vhost-target in another vm or container? If not, what's the gap?

________________________________
kinzent(a)hotmail.com

[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 690 bytes --]