linux-rdma.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* opensm and virt_enabled?
@ 2020-05-25 12:30 David Zarzycki
  2020-05-25 12:41 ` Vladimir Koushnir
  0 siblings, 1 reply; 3+ messages in thread
From: David Zarzycki @ 2020-05-25 12:30 UTC (permalink / raw)
  To: linux-rdma

Hello,

I'm trying to track how to enable "virt_enabled 2" in opensm. Various Mellanox docs refer to this change in opensm behavior in order to support their socket direct cards. That being said, when I search the opensm source and source history, I cannot find any reference this flag ever existing. What am I missing?

For reference, I've connected two ConnectX-6 cards point to point. One of the cards is "socket direct" but the aux card stays "down" despite the link being up (see below).

Thanks for any help,
Dave


CA 'ibp2s0f0'
        CA type: MT4123
        Number of ports: 1
        Firmware version: 20.27.2008
        Hardware version: 0
        Node GUID: 0x0c42a10300609810
        System image GUID: 0x0c42a10300609810
        Port 1:
                State: Active
                Physical state: LinkUp
                Rate: 100
                Base lid: 2
                LMC: 0
                SM lid: 1
                Capability mask: 0x2659e848
                Port GUID: 0x0c42a10300609810
                Link layer: InfiniBand
CA 'ibp3s0f0'
        CA type: MT4123
        Number of ports: 1
        Firmware version: 20.27.2008
        Hardware version: 0
        Node GUID: 0x0c42a10300609814
        System image GUID: 0x0c42a10300609810
        Port 1:
                State: Down
                Physical state: LinkUp
                Rate: 100
                Base lid: 65535
                LMC: 0
                SM lid: 1
                Capability mask: 0x2649e848
                Port GUID: 0x0c42a10300609814
                Link layer: InfiniBand
CA 'ibp2s0f1'
        CA type: MT4123
        Number of ports: 1
        Firmware version: 20.27.2008
        Hardware version: 0
        Node GUID: 0x0c42a10300609811
        System image GUID: 0x0c42a10300609810
        Port 1:
                State: Down
                Physical state: Disabled
                Rate: 10
                Base lid: 65535
                LMC: 0
                SM lid: 0
                Capability mask: 0x2659e848
                Port GUID: 0x0c42a10300609811
                Link layer: InfiniBand
CA 'ibp3s0f1'
        CA type: MT4123
        Number of ports: 1
        Firmware version: 20.27.2008
        Hardware version: 0
        Node GUID: 0x0c42a10300609815
        System image GUID: 0x0c42a10300609810
        Port 1:
                State: Down
                Physical state: Disabled
                Rate: 10
                Base lid: 65535
                LMC: 0
                SM lid: 0
                Capability mask: 0x2649e848
                Port GUID: 0x0c42a10300609815
                Link layer: InfiniBand

^ permalink raw reply	[flat|nested] 3+ messages in thread
* RE: opensm and virt_enabled?
  2020-05-25 12:30 opensm and virt_enabled? David Zarzycki
@ 2020-05-25 12:41 ` Vladimir Koushnir
  2020-05-25 13:08   ` David Zarzycki
  0 siblings, 1 reply; 3+ messages in thread
From: Vladimir Koushnir @ 2020-05-25 12:41 UTC (permalink / raw)
  To: David Zarzycki, linux-rdma

Hello,

"virt_enabled 2" is supported by MLNX subnet manager that is available via UFM/MLNX OFED/MLNX Infiniband switch OS (MLNX OS).

Regards,
Vladimir
-----Original Message-----
From: linux-rdma-owner@vger.kernel.org <linux-rdma-owner@vger.kernel.org> On Behalf Of David Zarzycki
Sent: Monday, May 25, 2020 3:30 PM
To: linux-rdma@vger.kernel.org
Subject: opensm and virt_enabled?

Hello,

I'm trying to track how to enable "virt_enabled 2" in opensm. Various Mellanox docs refer to this change in opensm behavior in order to support their socket direct cards. That being said, when I search the opensm source and source history, I cannot find any reference this flag ever existing. What am I missing?

For reference, I've connected two ConnectX-6 cards point to point. One of the cards is "socket direct" but the aux card stays "down" despite the link being up (see below).

Thanks for any help,
Dave


CA 'ibp2s0f0'
        CA type: MT4123
        Number of ports: 1
        Firmware version: 20.27.2008
        Hardware version: 0
        Node GUID: 0x0c42a10300609810
        System image GUID: 0x0c42a10300609810
        Port 1:
                State: Active
                Physical state: LinkUp
                Rate: 100
                Base lid: 2
                LMC: 0
                SM lid: 1
                Capability mask: 0x2659e848
                Port GUID: 0x0c42a10300609810
                Link layer: InfiniBand
CA 'ibp3s0f0'
        CA type: MT4123
        Number of ports: 1
        Firmware version: 20.27.2008
        Hardware version: 0
        Node GUID: 0x0c42a10300609814
        System image GUID: 0x0c42a10300609810
        Port 1:
                State: Down
                Physical state: LinkUp
                Rate: 100
                Base lid: 65535
                LMC: 0
                SM lid: 1
                Capability mask: 0x2649e848
                Port GUID: 0x0c42a10300609814
                Link layer: InfiniBand
CA 'ibp2s0f1'
        CA type: MT4123
        Number of ports: 1
        Firmware version: 20.27.2008
        Hardware version: 0
        Node GUID: 0x0c42a10300609811
        System image GUID: 0x0c42a10300609810
        Port 1:
                State: Down
                Physical state: Disabled
                Rate: 10
                Base lid: 65535
                LMC: 0
                SM lid: 0
                Capability mask: 0x2659e848
                Port GUID: 0x0c42a10300609811
                Link layer: InfiniBand
CA 'ibp3s0f1'
        CA type: MT4123
        Number of ports: 1
        Firmware version: 20.27.2008
        Hardware version: 0
        Node GUID: 0x0c42a10300609815
        System image GUID: 0x0c42a10300609810
        Port 1:
                State: Down
                Physical state: Disabled
                Rate: 10
                Base lid: 65535
                LMC: 0
                SM lid: 0
                Capability mask: 0x2649e848
                Port GUID: 0x0c42a10300609815
                Link layer: InfiniBand

^ permalink raw reply	[flat|nested] 3+ messages in thread
* Re: opensm and virt_enabled?
  2020-05-25 12:41 ` Vladimir Koushnir
@ 2020-05-25 13:08   ` David Zarzycki
  0 siblings, 0 replies; 3+ messages in thread
From: David Zarzycki @ 2020-05-25 13:08 UTC (permalink / raw)
  To: Vladimir Koushnir, linux-rdma

Hi Vladimir,

Thanks. I found it. Is this opensm closed source? I apparently wrongly assumed that this opensm would be in the source drop of MLNX OFED.

Dave

On Mon, May 25, 2020, at 8:41 AM, Vladimir Koushnir wrote:
> Hello,
> 
> "virt_enabled 2" is supported by MLNX subnet manager that is available 
> via UFM/MLNX OFED/MLNX Infiniband switch OS (MLNX OS).
> 
> Regards,
> Vladimir
> -----Original Message-----
> From: linux-rdma-owner@vger.kernel.org 
> <linux-rdma-owner@vger.kernel.org> On Behalf Of David Zarzycki
> Sent: Monday, May 25, 2020 3:30 PM
> To: linux-rdma@vger.kernel.org
> Subject: opensm and virt_enabled?
> 
> Hello,
> 
> I'm trying to track how to enable "virt_enabled 2" in opensm. Various 
> Mellanox docs refer to this change in opensm behavior in order to 
> support their socket direct cards. That being said, when I search the 
> opensm source and source history, I cannot find any reference this flag 
> ever existing. What am I missing?
> 
> For reference, I've connected two ConnectX-6 cards point to point. One 
> of the cards is "socket direct" but the aux card stays "down" despite 
> the link being up (see below).
> 
> Thanks for any help,
> Dave
> 
> 
> CA 'ibp2s0f0'
>         CA type: MT4123
>         Number of ports: 1
>         Firmware version: 20.27.2008
>         Hardware version: 0
>         Node GUID: 0x0c42a10300609810
>         System image GUID: 0x0c42a10300609810
>         Port 1:
>                 State: Active
>                 Physical state: LinkUp
>                 Rate: 100
>                 Base lid: 2
>                 LMC: 0
>                 SM lid: 1
>                 Capability mask: 0x2659e848
>                 Port GUID: 0x0c42a10300609810
>                 Link layer: InfiniBand
> CA 'ibp3s0f0'
>         CA type: MT4123
>         Number of ports: 1
>         Firmware version: 20.27.2008
>         Hardware version: 0
>         Node GUID: 0x0c42a10300609814
>         System image GUID: 0x0c42a10300609810
>         Port 1:
>                 State: Down
>                 Physical state: LinkUp
>                 Rate: 100
>                 Base lid: 65535
>                 LMC: 0
>                 SM lid: 1
>                 Capability mask: 0x2649e848
>                 Port GUID: 0x0c42a10300609814
>                 Link layer: InfiniBand
> CA 'ibp2s0f1'
>         CA type: MT4123
>         Number of ports: 1
>         Firmware version: 20.27.2008
>         Hardware version: 0
>         Node GUID: 0x0c42a10300609811
>         System image GUID: 0x0c42a10300609810
>         Port 1:
>                 State: Down
>                 Physical state: Disabled
>                 Rate: 10
>                 Base lid: 65535
>                 LMC: 0
>                 SM lid: 0
>                 Capability mask: 0x2659e848
>                 Port GUID: 0x0c42a10300609811
>                 Link layer: InfiniBand
> CA 'ibp3s0f1'
>         CA type: MT4123
>         Number of ports: 1
>         Firmware version: 20.27.2008
>         Hardware version: 0
>         Node GUID: 0x0c42a10300609815
>         System image GUID: 0x0c42a10300609810
>         Port 1:
>                 State: Down
>                 Physical state: Disabled
>                 Rate: 10
>                 Base lid: 65535
>                 LMC: 0
>                 SM lid: 0
>                 Capability mask: 0x2649e848
>                 Port GUID: 0x0c42a10300609815
>                 Link layer: InfiniBand
>

^ permalink raw reply	[flat|nested] 3+ messages in thread
end of thread, other threads:[~2020-05-25 13:09 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-05-25 12:30 opensm and virt_enabled? David Zarzycki
2020-05-25 12:41 ` Vladimir Koushnir
2020-05-25 13:08   ` David Zarzycki

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).