Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [mellanox]

Mellanox Technologies Ltd. is an Israeli and American multinational supplier of computer networking products using InfiniBand and Ethernet technology

Mellanox Technologies Ltd. is an Israeli and American multinational supplier of computer networking products using InfiniBand and Ethernet technology

34 questions
1
vote
1 answer

InfiniBand RDMA latency test on Xen's dom0 crashes

The short story: while setting up InfiniBand connection between two servers, I cannot complete the RDMA latency test. It crashes even with breaking the ssh connection. The long story. The first server is the Xen 4.4 with Ubuntu 14.04 as dom0…
Grigory
  • 167
  • 1
  • 2
  • 9
1
vote
0 answers

openstack, bridging, netfilter and dnat

In a recent upgrade (from Openstack Diablo on Ubuntu Lucid to Openstack Essex on Ubuntu Precise), we found that DNS packets were frequently (almost always) dropped on the bridge interface (br100). For our compute-node hosts, that's a Mellanox…
cas
  • 6,653
  • 31
  • 34
1
vote
0 answers

LinuxPTP slave not using master and sync timeout tx announce timeout

And: I'm using G8316 as swtich with ptp transparent enable and Mellanox 354 adapter. Ports using LACP bonding and trunk. First: Server A ptp4l -m -l 7 -i xxxx -i xxxx -S I can capture ServerA boardcast package in ServerB, And ptp counter show…
Alceatraz
  • 111
  • 2
1
vote
1 answer

Infiniband OpenSM N-to-N port routing configuration

I have 10 servers with two CPUs each and one Mellanox 100G Infiniband NIC per CPU. Each NIC is connected to a single Mellanox 36 port 100G IB switch. My RDMA application runs as one process per NUMA node and binds to the local NIC to avoid cross CPU…
Hugo Maxwell
  • 121
  • 4
1
vote
2 answers

Infiniband drivers : OFED or distro included?

I'm setting up a Linux cluster with infiniband network, and I'm quite a newby in infiniband wolrd, any advice is more than welcome ! We are currently using Mellanox OFED drivers, but our infiniband cards are old and not recognized by the latest…
nirnaeth
  • 23
  • 6
0
votes
1 answer

Infiniband P_Keys and the Linux kernel

I'm trying to configure Infiniband partitions between two Debian based Linux hosts running the 4.15 kernel and A Mellanox SX6036 switch. I've setup a "DMZ" partition on the swich using a PKey of 0x0001 and added the Port GUID numbers from the active…
Server Fault
  • 3,454
  • 7
  • 48
  • 88
0
votes
1 answer

Mellanox adapter on GCP instance

I'm trying to install MOFED on an instance (preferably with a GPU) and was wondering if anyone knows if a Mellanox adapter is available at any Google Cloud Platform VM. The VM instances that I've been spinning up come with a Virtio network card that…
afernandezody
  • 1
  • 1
0
votes
1 answer

Connecting Intel X722 SFP+ to Mellanox SX1012 QSFP via 4-split breakout cable using ubuntu

I have two servers running Ubuntu 18.04, each equipped with two SFP+ interfaces, each showing up in lshw like the following. *-network:1 description: Ethernet interface product: Ethernet Connection X722 for 10GbE SFP+ vendor:…
fbindel
  • 1
  • 2
0
votes
1 answer

Can not setup Mellanox connectx-2 in 40g speed

I have Mellanox connectX-2 network card (MT26428) and I installed MLNX_OFED_LINUX-3.4-1.0.0.0-ubuntu16.04-x86_64 driver from Mellanox repository but I'm wondering this equipment setup 20G at maximum although I expected it to setup 40G instead. here…
MDK
  • 101
  • 2
0
votes
1 answer

Managed switch for Mellanox MCX354A-FCBT cards?

I've inherited two Mellanox Infiniband environments. One on a LAN, and the other in a DMZ. Both IB networks have their own SX6005 unmanaged switches and a couple small desktop computers running the subnet manager for the network. As I understand,…
Server Fault
  • 3,454
  • 7
  • 48
  • 88
0
votes
1 answer

Troubles with ibverbs in OpenSUSE Leap 42.2 for Mellanox ConnectX-3 HCA

SOLVED I got troubles setting up infiniband software from OpenSUSE repository. The same card works fine with SLES12 + Mellanox OFED stack. Installing everything containing 'infiniband' from yast I see that HCA is up and diagnostic tools like ibnodes…
catbus
  • 1
  • 1
0
votes
1 answer

VMware infiniband configuration

I have a server which is intended to be a vmware host. This server has two Infiniband Mellanox ConnectX-2 dual-port cards. What I want to do is to make the following setup: The first card should work as a native Ethernet 10G network adapter, talking…
Tigran Baluyan
  • 61
  • 5
0
votes
2 answers

Is ibdump in Mellanox OFED 2 supported in Ubuntu 14.04?

I have Ubuntu 14.04. I have Mellanox Technologies MT27500 Family [ConnectX-3] HCAs. I was able to pass all the tests like ibping and ib_rdma_lat. Now I'm running MPI tests to verify that InfiniBand is working. How can I actually see that there is…
Grigory
  • 167
  • 1
  • 2
  • 9
0
votes
1 answer

Cannot use SDP in Debian Squeezy

I have severe problems running SDP on Debian Squeeze. I'm using two machines with Mellanox adapters each. My /etc/modules looks like this: mlx4_ib # Mellanox ConnectX cards #ib_mthca # some mellanox cards #iw_cxgb3 # Chelsio T3 cards #iw_nes #…
Ulf Klose
  • 387
  • 1
  • 5
  • 18
0
votes
1 answer

Only getting 25Gb/s instead of 100Gb/s from a Mellanox switch running Cumulus Linux

I have a Mellanox 100gb/s switch (running Cumulus Linux 4.1) that I use for connecting multiple servers, each with a Mellanox ConnectX 5 100gb/s card. These servers connect to the switch via a DAC cable. While it is working, I am only able to get…
Jarmund
  • 535
  • 1
  • 6
  • 16
1
2
3