How can I determine which switch the Infiniband subnet manager is running on?

Question

I recently inherited an Infiniband network containing multiple switches, and I know that one of these switches is running the subnet manager. The rest supposedly have that feature turned off, or were never enabled. The trouble is, I have no idea which one it is...

I'd like to replace the switch subnet manager with OpenSM running on a couple of my infrastructure servers. Is there any way, short of logging into each switch individually, to determine which switch is running the SM?

Nope! (Just double checked the hardware, too. :) ) Would be a useful feature, I'll mention it to my Mellanox rep... — ajdecon, Dec 03 '12 at 21:50

score 8 · Answer 1 · answered Dec 20 '12 at 21:44

If your infrastructure servers can run OpenSM, they may also have the OFED stack utilities installed as well. If the commands are available, ibstat will tell you the SM's LID. Then use the LID in smpquery ND -L <LID> to get the node description of the node running the SM.

score 6 · Answer 2 · edited Mar 23 '18 at 02:25

6

If you have an OFED installed in your system and the package infiniband-diags you can use the command sminfo to list running subnet managers in the Infiniband network:

~ # sminfo 
sminfo: sm lid 18 sm guid 0x0000000, activity count 55554951 priority 0 state 3 SMINFO_MASTER

It will list all known subnet managers for that node and the master subnet manager.

edited Mar 23 '18 at 02:25

Brett Holman

140
6

answered Mar 25 '15 at 15:02

Bruno Pereira

309
2
9

score 0 · Answer 3 · answered Dec 04 '12 at 09:27

0

If you reach your manager by IP address, you could look the ARP/MAC tables of your switches to find which IP address corresponds to your switch.

answered Dec 04 '12 at 09:27

fallais

216
2
10

How can I determine which switch the Infiniband subnet manager is running on?

3 Answers3