I am using a MPI program on limited CPU resources. It involved running an application that requires 20 separate processes on a 12 thread CPU. I run it again and again with different parameters.
Towards the end of the application, most of the 20 processes are already complete, leaving 11 of my 12 threads idle while waiting for the last one to complete. I wish to utilize these idle cores to start the next job in line without waiting for the current one to complete. It would be best if I could already start the next job when one core is already idle.
Torque is set up but I am required to state the resource requirements ahead. I wish to dynamically allocate these CPU cores so that the CPU is always at 100%.