spdk.lists.linux.dev archive mirror
 help / color / mirror / Atom feed
* [SPDK] Re: SPDK Controller create failure
@ 2022-10-18 11:04 Zawadzki, Tomasz
  0 siblings, 0 replies; 3+ messages in thread
From: Zawadzki, Tomasz @ 2022-10-18 11:04 UTC (permalink / raw)
  To: spdk

[-- Attachment #1: Type: text/plain, Size: 1636 bytes --]

Hi Niranjan,

The default max number of subsystems is set to 1024, please use nvmf_set_max_subsystems RPC to modify it.

Could you double check if you've encountered the issue after 1024 or 1025 controllers ? If there is an off-by one error somewhere here, please report it to https://github.com/spdk/spdk/issues.

Thanks,
Tomek

> -----Original Message-----
> From: N K Das <nkdas5544(a)gmail.com>
> Sent: Tuesday, October 18, 2022 12:45 PM
> To: spdk(a)lists.01.org
> Subject: [SPDK] SPDK Controller create failure
> 
> Hi,
> I was trying to create  1024 SPDK controller with 1 NS attached to each SPDK
> controller. It creates upto 1023 SPDK controller but fails at 1024. Is there any
> limitation on how many SPDK controller we can create in a single Linux server
> ? I am using Ubuntu 20.04 Linux Server.
> 
> Here is screenshot of error message:
> 
> [2022-10-18 10:22:13.343807] nvmf_rpc.c: 416:rpc_nvmf_create_subsystem:
> *ERROR*: Unable to create subsystem nqn.2016-06.io.spdk:cnode1023
> request:
> {
>   "nqn": "nqn.2016-06.io.spdk:cnode1023",
>   "serial_number": "SPDK0000000001023",
>   "model_number": "SPDK_Controller1023",
>   "allow_any_host": true,
>   "method": "nvmf_create_subsystem",
>   "req_id": 1
> }
> Got JSON-RPC error response
> response:
> {
>   "code": -32603,
>   "message": "Unable to create subsystem nqn.2016-06.io.spdk:cnode1023"
> }
> + exit
> 
> Any help is appreciated.
> 
> Regards,
> Niranjan
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org

^ permalink raw reply	[flat|nested] 3+ messages in thread

* [SPDK] Re: SPDK Controller create failure
@ 2022-10-19 14:19 Harris, James R
  0 siblings, 0 replies; 3+ messages in thread
From: Harris, James R @ 2022-10-19 14:19 UTC (permalink / raw)
  To: spdk

[-- Attachment #1: Type: text/plain, Size: 3374 bytes --]

Hi Niranjan and Tomek,

We use one of the max allowed subsystems for the discovery subsystem.  I think this explains why Niranjan can only create 1023 subsystems instead of 1024.

See nvmf_add_discovery_subsystem() in module/event/subsystems/nvmf/nvmf_tgt.c.

Regards,

-Jim

From: N K Das <nkdas5544(a)gmail.com>
Date: Tuesday, October 18, 2022 at 11:45 PM
To: Storage Performance Development Kit <spdk(a)lists.01.org>
Subject: [SPDK] Re: SPDK Controller create failure
Thanks Tomek ! I started my spdk controller count from 0, so it should
ideally go to 1023 to make it 1024. If i start spdk controller count from
1, it goes to 1023 but ideally it should reach 1024.

[2022-09-29 12:47:12.205208] nvmf_rpc.c: 416:rpc_nvmf_create_subsystem:
*ERROR*: Unable to create subsystem nqn.2016-06.io.spdk:cnode1024

request:

{

  "nqn": "nqn.2016-06.io.spdk:cnode1024",

  "serial_number": "SPDK0000000001024",

  "model_number": "SPDK_Controller1024",

  "allow_any_host": true,

  "method": "nvmf_create_subsystem",

  "req_id": 1

}

Got JSON-RPC error response

response:

{

  "code": -32603,

  "message": "Unable to create subsystem nqn.2016-06.io.spdk:cnode1024"

}

+ exit

On Tue, Oct 18, 2022 at 4:34 PM Zawadzki, Tomasz <tomasz.zawadzki(a)intel.com>
wrote:

> Hi Niranjan,
>
> The default max number of subsystems is set to 1024, please use
> nvmf_set_max_subsystems RPC to modify it.
>
> Could you double check if you've encountered the issue after 1024 or 1025
> controllers ? If there is an off-by one error somewhere here, please report
> it to https://github.com/spdk/spdk/issues.
>
> Thanks,
> Tomek
>
> > -----Original Message-----
> > From: N K Das <nkdas5544(a)gmail.com>
> > Sent: Tuesday, October 18, 2022 12:45 PM
> > To: spdk(a)lists.01.org
> > Subject: [SPDK] SPDK Controller create failure
> >
> > Hi,
> > I was trying to create  1024 SPDK controller with 1 NS attached to each
> SPDK
> > controller. It creates upto 1023 SPDK controller but fails at 1024. Is
> there any
> > limitation on how many SPDK controller we can create in a single Linux
> server
> > ? I am using Ubuntu 20.04 Linux Server.
> >
> > Here is screenshot of error message:
> >
> > [2022-10-18 10:22:13.343807] nvmf_rpc.c: 416:rpc_nvmf_create_subsystem:
> > *ERROR*: Unable to create subsystem nqn.2016-06.io.spdk:cnode1023
> > request:
> > {
> >   "nqn": "nqn.2016-06.io.spdk:cnode1023",
> >   "serial_number": "SPDK0000000001023",
> >   "model_number": "SPDK_Controller1023",
> >   "allow_any_host": true,
> >   "method": "nvmf_create_subsystem",
> >   "req_id": 1
> > }
> > Got JSON-RPC error response
> > response:
> > {
> >   "code": -32603,
> >   "message": "Unable to create subsystem nqn.2016-06.io.spdk:cnode1023"
> > }
> > + exit
> >
> > Any help is appreciated.
> >
> > Regards,
> > Niranjan
> > _______________________________________________
> > SPDK mailing list -- spdk(a)lists.01.org
> > To unsubscribe send an email to spdk-leave(a)lists.01.org
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
>
_______________________________________________
SPDK mailing list -- spdk(a)lists.01.org
To unsubscribe send an email to spdk-leave(a)lists.01.org

^ permalink raw reply	[flat|nested] 3+ messages in thread

* [SPDK] Re: SPDK Controller create failure
@ 2022-10-18 17:51 N K Das
  0 siblings, 0 replies; 3+ messages in thread
From: N K Das @ 2022-10-18 17:51 UTC (permalink / raw)
  To: spdk

[-- Attachment #1: Type: text/plain, Size: 2739 bytes --]

Thanks Tomek ! I started my spdk controller count from 0, so it should
ideally go to 1023 to make it 1024. If i start spdk controller count from
1, it goes to 1023 but ideally it should reach 1024.

[2022-09-29 12:47:12.205208] nvmf_rpc.c: 416:rpc_nvmf_create_subsystem:
*ERROR*: Unable to create subsystem nqn.2016-06.io.spdk:cnode1024

request:

{

  "nqn": "nqn.2016-06.io.spdk:cnode1024",

  "serial_number": "SPDK0000000001024",

  "model_number": "SPDK_Controller1024",

  "allow_any_host": true,

  "method": "nvmf_create_subsystem",

  "req_id": 1

}

Got JSON-RPC error response

response:

{

  "code": -32603,

  "message": "Unable to create subsystem nqn.2016-06.io.spdk:cnode1024"

}

+ exit

On Tue, Oct 18, 2022 at 4:34 PM Zawadzki, Tomasz <tomasz.zawadzki(a)intel.com>
wrote:

> Hi Niranjan,
>
> The default max number of subsystems is set to 1024, please use
> nvmf_set_max_subsystems RPC to modify it.
>
> Could you double check if you've encountered the issue after 1024 or 1025
> controllers ? If there is an off-by one error somewhere here, please report
> it to https://github.com/spdk/spdk/issues.
>
> Thanks,
> Tomek
>
> > -----Original Message-----
> > From: N K Das <nkdas5544(a)gmail.com>
> > Sent: Tuesday, October 18, 2022 12:45 PM
> > To: spdk(a)lists.01.org
> > Subject: [SPDK] SPDK Controller create failure
> >
> > Hi,
> > I was trying to create  1024 SPDK controller with 1 NS attached to each
> SPDK
> > controller. It creates upto 1023 SPDK controller but fails at 1024. Is
> there any
> > limitation on how many SPDK controller we can create in a single Linux
> server
> > ? I am using Ubuntu 20.04 Linux Server.
> >
> > Here is screenshot of error message:
> >
> > [2022-10-18 10:22:13.343807] nvmf_rpc.c: 416:rpc_nvmf_create_subsystem:
> > *ERROR*: Unable to create subsystem nqn.2016-06.io.spdk:cnode1023
> > request:
> > {
> >   "nqn": "nqn.2016-06.io.spdk:cnode1023",
> >   "serial_number": "SPDK0000000001023",
> >   "model_number": "SPDK_Controller1023",
> >   "allow_any_host": true,
> >   "method": "nvmf_create_subsystem",
> >   "req_id": 1
> > }
> > Got JSON-RPC error response
> > response:
> > {
> >   "code": -32603,
> >   "message": "Unable to create subsystem nqn.2016-06.io.spdk:cnode1023"
> > }
> > + exit
> >
> > Any help is appreciated.
> >
> > Regards,
> > Niranjan
> > _______________________________________________
> > SPDK mailing list -- spdk(a)lists.01.org
> > To unsubscribe send an email to spdk-leave(a)lists.01.org
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
>

^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2022-10-19 14:19 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-10-18 11:04 [SPDK] Re: SPDK Controller create failure Zawadzki, Tomasz
2022-10-18 17:51 N K Das
2022-10-19 14:19 Harris, James R

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).