[OpenFOAM] Unable to run SLURM partitioned simulation

[nish-ant]

Thanks Alex for the suggestions.

@ajaust

Spack’s OpenMPI recipe has an schedulers option. There are also quite some other options that might affect the behaviors (e.g. PMI, PMIX). Maybe it would be worth asking your admins about that.

Can you point me to some resources regarding these options? Is it something I need to take care of during preCICE installation?

I’ve been in contact with the HPC team as well. I’ll update if there is any positive development.

@ajaust

When preCICE and OpenFOAM have been compiled with different MPI installation one tends to get “weird” issues. There should also some posts about that issue on the forum.

I will check the forum for more issues like this. However in my build, both preCICE and OpenFOAM use the same MPI recipe as they are installed in the same spack environment.

I was thinking that if anyone wants to replicate the behaviour, the steps to recreate the spack environment that I am using can be found on the top of this comment [OpenFOAM-6 adapter] Error during build: undefined symbols of dependencies - #5 by nish-ant.

@ajaust

Can you avoid the “Host key verification failed” error by starting both executables from one line.

It gives the same Host key verification failed error for runTwo.

@ajaust

For the last case (parallel solver dummies with openmpi/4.0.2/gcc/7.3.0) where the connection between the processes you could try to delete the precice-run/ directory and then restart the solvers.

I made sure that the precice-run/ directory is removed before the next run but the error still persists.

@ajaust

Could you recompile preCICE using the OpenMPI version provided by the system and check whether this solves the problems?

I can try to build a new spack environemt where both preCICE and OpenFOAM are linked to the Open MPI library provided on the cluster. Again, I will update with the findings.