Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [mellanox]

Mellanox Technologies Ltd. is an Israeli and American multinational supplier of computer networking products using InfiniBand and Ethernet technology

Mellanox Technologies Ltd. is an Israeli and American multinational supplier of computer networking products using InfiniBand and Ethernet technology

34 questions
9
votes
3 answers

QSFP28 - is there something like a crossover cable?

Can not find anything to that ;) Building a Hyperconvergend Cluster as development system. This is for us state of the art. Got 2 machines for a start, with a switch ordered to come in about 4 weeks. Both servers have 2x100gb ethernet cards from…
TomTom
  • 50,857
  • 7
  • 52
  • 134
4
votes
0 answers

How to make systemd monitor processes started using a shell script in the service file?

I have written a service file in Linux that calls a script which starts multiple processes with one as primary and others as secondary. SERVICE FILE: [Unit] Description=TEST…
Vedang
  • 41
  • 2
4
votes
1 answer

How do I enable SR-IOV for Mellanox ConnectX-3 Ubuntu 12.04.3?

I have a Supermicro 2027TR-HTFRF server that I'm using as a xen server. What I'm wanting to do is get SR-IOV operating for the Connectx-3 card so that I can expose Infiniband to virtual machines. Following this recipe I managed to get the I350…
hookenz
  • 14,132
  • 22
  • 86
  • 142
3
votes
1 answer

Is it possible to update Supermicro ConnectX-3 Firmware with newer firmware from Mellanox?

I have a Supermicro server with a X9DRT-HIBFF motherboard installed. It has on-board Infiniband based on the ConnectX-3 chipset from Mellanox. Supermicro supply firmware version 2.10.0700 and unfortunately it doesn't support SR-IOV, it's too old. …
hookenz
  • 14,132
  • 22
  • 86
  • 142
3
votes
0 answers

Why isn't SMB Direct working over RDMA?

In a Windows lab environment, I'm trying to test performance of SMB Direct using Mellanox RDMA adapters with global pause. I wanted to test first with Global Pause for simplicity before switching to PFC. I think I've set up everything correctly,…
Elliott B
  • 200
  • 2
  • 9
2
votes
1 answer

Beegfs-client does not work with mellanox OFED driver

I am trying to configure and test beegfs with RDMA as explained in: https://community.mellanox.com/s/article/howto-configure-and-test-beegfs-with-rdma?t=1570613300675 My test configuration: OS: ubuntu 16.04 on both servers (Kernel version…
Ramon
  • 21
  • 2
2
votes
2 answers

Dual-port RDMA Throughput Issue

I have two nodes connected with dual-port Mellanox Connext-X3 VPI HCAs via an IB switch. The nodes are two socket machines with Hasswell CPUs and 2 16GB DIMMs per each socket (totaling 64GB). Everything seems to work perfectly, except for the…
Mohammad Hedayati
  • 629
  • 1
  • 6
  • 12
2
votes
2 answers

Installing Mellanox ConnectX-2 10gbe PCIe Card on Centos 6

I just installed a Mellanox ConnectX-2 10gbe PCIe x8 Card into my server running CentOS 6.7. On boot, dmesg shows the mlx4_core driver being loaded automatically however I see no eth1 device corresponding to the card. ifconfig -a only shows eth0,…
Crash Override
  • 571
  • 1
  • 8
  • 20
2
votes
4 answers

set the Ca name on unmanaged mellanox switch

How can I set the Hostname/Description of a Mellanox/Infiniband unmanaged switch? I would like a way to abstractly distinguish quickly which switches are which when doing 'ibswitches' or 'ibnetdiscover'. For HCAs that are in Servers, the…
John
  • 23
  • 5
2
votes
0 answers

Infiniband fabric with 3 nodes - newbie

I am trying to connect 3 HP z840 workstations using: Mellanox ConnectX-3 VPI 40 / 56GbE Dual-Port QSFP Adapter MCX354A-FCBT Mellanox SX6005 12-port Non-blocking Unmanaged 56Gb/s Description of machines to be connected: oak-rd0-linux (main node…
theenemy
  • 121
  • 1
1
vote
1 answer

A way to configure DMZ zone on Ethernet Mellanox Switch

Can't find any information is it possible at all and how to configure DMZ zone on Mellanox MSN2100 switch. If I setup ACL disabling traffic from DMZ to LAN, I can't receive response to requests made from LAN to DMZ. Is there any way I can do…
Mike
  • 113
  • 4
1
vote
0 answers

Missing Azure accelerated networking interfaces while VMs initializes

I'm running my application on top of Azure Ubuntu 16.04 VMs (Wrapped as a VHD image). In several cases I have observed missing SRIOV associated VFs interfaces, while VMs were starting. Need to mention that this issue isn't repetitive, but it happen…
ido
  • 11
  • 1
1
vote
1 answer

Infiniband configured and connected but indicator lights unlit on HBAs and no functionality in OS

I have installed two dual-port FDR Infiniband VPI HBAs, one in each of two servers running CentOS 6.9, server1>lspci 03:00.0 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3] server2>lspci 81:00.0 Network controller: Mellanox…
rg6
  • 185
  • 1
  • 11
1
vote
2 answers

In Infiniband can I use the same port for IPoIB traffic as well as RDMA traffic?

Good day, and my disclaimer that I am no IB expert and have not worked on IB directly yet. My question seems a trivial one, yet I could not find anything in google that answers it. Question: In Infiniband can I use the same port for IPoIB traffic…
BeGa
  • 21
  • 6
1
vote
0 answers

Mellanox MT27500 Link to Port 1 is Down

I have Mellanox MT27500 dual port card which is installed on HP SL250s. Ubuntu 14.04.5 with 3.13.0-24-generic kernel is running on the server. Both port1 type and port 2 type are defined as eth. I have connected port 1 and port 2 to switch with same…
Gpost
  • 11
  • 3
1
2 3