I'm writing because I'm facing an issue that I cannot solve trying to configure a cluster with a master node ( or Frontend node ) as a Virtual machine managing nodes with infiniband network.
I use slurm on this nodes, the frontend node is the slurm controller.
Each compute node got ethernet and infiniband interface , Master node ( or Frontend Node ) got only ethernet interface.
When I launch a job from the frontend VM node, compute nodes network traffic ( between them ) is going through the ethernet interface , I haven't found a way to force the use Infiniband interface .
I found out that launching jobs from a compute node instead of the VM Frontend solves the problem! Is there a way to force the use of IB interface ? What am I missing here ?
any idea is much appreciated.
Best Regards, Simo