OpenFOAM adapter on Ubuntu 20.04

Claudio · April 26, 2020, 9:27am

Hi,
I was trying to use the OpenFOAM adapter on OF-1912 on Ubuntu 20.04. Afaik OpenFOAM works fine, PReCICE version 2.0.1 compiles and gives no errors in test_base, the adapter compiles, but when I try to run a tutorial I get this error:

Starting time loop

---[preciceAdapter] The preciceAdapter was loaded.
#0  Foam::error::printStack(Foam::Ostream&) at ??:?
#1  Foam::sigSegv::sigHandler(int) at ??:?
#2  ? in /lib/x86_64-linux-gnu/libc.so.6
#3  ? at ??:?
#4  orte_init in /usr/lib/x86_64-linux-gnu/libopen-rte.so.20
#5  ompi_mpi_init in /usr/lib/x86_64-linux-gnu/libmpi.so.20
#6  PMPI_Init_thread in /usr/lib/x86_64-linux-gnu/libmpi.so.20
#7  Foam::UPstream::initNull() at ??:?
#8  Foam::functionObjects::preciceAdapterFunctionObject::preciceAdapterFunctionObject(Foam::word const&, Foam::Time const&, Foam::dictionary const&) at ??:?
#9  Foam::functionObject::adddictionaryConstructorToTable<Foam::functionObjects::preciceAdapterFunctionObject>::New(Foam::word const&, Foam::Time const&, Foam::dictionary const&) at ??:?
#10  Foam::functionObject::New(Foam::word const&, Foam::Time const&, Foam::dictionary const&) at ??:?
#11  Foam::functionObjectList::read() at ??:?
#12  Foam::Time::run() const at ??:?
#13  ? in /opt/claudio/OpenFOAM/OpenFOAM-v1912/platforms/linux64GccDPInt32Opt/bin/pimpleFoam
#14  __libc_start_main in /lib/x86_64-linux-gnu/libc.so.6
#15  ? in /opt/claudio/OpenFOAM/OpenFOAM-v1912/platforms/linux64GccDPInt32Opt/bin/pimpleFoam

I don’t know what is going on. Any help would be appreciated.
Claudio

Makis · April 26, 2020, 12:30pm

I need to try this out, but in the meantime, could you try if removing this line helps?

github.com

precice/openfoam-adapter/blob/master/preciceAdapterFunctionObject.C#L60


    const dictionary& dict
)
:
    fvMeshFunctionObject(name, runTime, dict),
    adapter_(runTime, mesh_)
{
    #if (defined OPENFOAM_PLUS && (OPENFOAM_PLUS >= 1712) ) || (defined OPENFOAM && (OPENFOAM >= 1806))
        // Patch for issue #27: warning "MPI was already finalized" while
        // running in serial. This only affects openfoam.com, while initNull()
        // does not exist in openfoam.org.
        UPstream::initNull();
    #endif


    read(dict);
}




// * * * * * * * * * * * * * * * * Destructor  * * * * * * * * * * * * * * * //


Foam::functionObjects::preciceAdapterFunctionObject::~preciceAdapterFunctionObject()
{

This may give you a warning at finalization in serial cases, which you can ignore.

Claudio · April 26, 2020, 12:56pm

Hi,
I commented the line out and recompiled, but unfortunately the error becomes:

---[preciceAdapter] [DEBUG]   MPI rank: 0
#0  Foam::error::printStack(Foam::Ostream&) at ??:?
#1  Foam::sigSegv::sigHandler(int) at ??:?
#2  ? in /lib/x86_64-linux-gnu/libc.so.6
#3  ? at ??:?
#4  orte_init in /usr/lib/x86_64-linux-gnu/libopen-rte.so.20
#5  ompi_mpi_init in /usr/lib/x86_64-linux-gnu/libmpi.so.20
#6  MPI_Init in /usr/lib/x86_64-linux-gnu/libmpi.so.20
#7  precice::utils::Parallel::initializeMPI(int*, char***) in /usr/local/lib/libprecice.so.2
#8  precice::impl::SolverInterfaceImpl::configure(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) in /usr/local/lib/libprecice.so.2
#9  precice::impl::SolverInterfaceImpl::SolverInterfaceImpl(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, int, void*) in /usr/local/lib/libprecice.so.2
#10  precice::impl::SolverInterfaceImpl::SolverInterfaceImpl(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, int) in /usr/local/lib/libprecice.so.2
#11  precice::SolverInterface::SolverInterface(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, int) in /usr/local/lib/libprecice.so.2
#12  preciceAdapter::Adapter::configure() at ??:?
#13  Foam::functionObjects::preciceAdapterFunctionObject::read(Foam::dictionary const&) at ??:?
#14  Foam::functionObjects::preciceAdapterFunctionObject::preciceAdapterFunctionObject(Foam::word const&, Foam::Time const&, Foam::dictionary const&) at ??:?
#15  Foam::functionObject::adddictionaryConstructorToTable<Foam::functionObjects::preciceAdapterFunctionObject>::New(Foam::word const&, Foam::Time const&, Foam::dictionary const&) at ??:?
#16  Foam::functionObject::New(Foam::word const&, Foam::Time const&, Foam::dictionary const&) at ??:?
#17  Foam::functionObjectList::read() at ??:?
#18  Foam::Time::run() const at ??:?
#19  ? in /opt/claudio/OpenFOAM/OpenFOAM-v1912/platforms/linux64GccDPInt32Opt/bin/pimpleFoam
#20  __libc_start_main in /lib/x86_64-linux-gnu/libc.so.6
#21  ? in /opt/claudio/OpenFOAM/OpenFOAM-v1912/platforms/linux64GccDPInt32Opt/bin/pimpleFoam

Thank you
Claudio

Makis · April 27, 2020, 10:09am

How did you install OpenFOAM and, more importantly, did you use the system MPI or the one provided by OpenFOAM (if you built it from source)? This could be an important aspect.

Disclaimer once again: I have not yet tried running anything OpenFOAM-related on Ubuntu 20.04, so I don’t know if this is a general issue or not, so it is not necessary that you are doing something wrong.

Claudio · April 27, 2020, 10:30am

Hi,
I have built OpenFOAM from source. I think I have done the same steps I made when I compiled it for 18.04. I might be wrong but I think I am using the system MPI, as after setting the environment variables, mpirun points to the system executable.

Makis · April 27, 2020, 8:37pm

@Claudio I just now built OpenFOAM v1912 from source on Ubuntu 20.04, where I already had OpenMPI etc installed from APT. For me, the OpenFOAM-OpenFOAM flow-over-plate tutorial runs fine both in serial and in parallel. Does also this fail for you?

Claudio · April 28, 2020, 6:03am

@Makis It looks like you have my same configuration. But unfortunately the tutorial doesn’t work for me. I can attach the logs, both serial and parallel. It looks like there is some inconsistency in the mpi used, but I’m not sure.
Thank you
Fluid.log (6.4 KB) Fluid_parallel.log (2.5 KB) Solid.log (5.5 KB) Solid_parallel.log (2.5 KB)

Makis · April 28, 2020, 6:28am

So, I summarize the state for your system:

Ubuntu 20.04, preCICE 2.0.1, OpenFOAM 1912, system OpenMPI
OpenFOAM works fine (I assume in serial)
preCICE make test_base succeeds

Does OpenFOAM also work fine in parallel?

Where do you see this inconsistency?

Claudio · April 28, 2020, 7:14am

So, I summarize the state for your system:

Ubuntu 20.04, preCICE 2.0.1, OpenFOAM 1912, system OpenMPI

OpenFOAM works fine (I assume in serial)

preCICE make test_base succeeds

Does OpenFOAM also work fine in parallel?

Yes, make test_base and also testprecice work, both in serial and in parallel. OpenFOAM works in parallel too.
I believe the inconsistency could be in the fact that the error trace prints about ompi_mpi_init in /usr/lib/x86_64-linux-gnu/libmpi.so.20 . Apparently my system has both libmpi.so.20 and libmpi.so.40 and it seems to me that system mpi points to libmpi.so.40.
I don’t exactly know how to fix it.

Makis · April 28, 2020, 8:07am

Indeed, this is important and could be the reason: preCICE and the solver need to be built with the same MPI version, as preCICE is trying to access the communicator of the solver. I cannot really think of how you could have installed OpenMPI 2 on Ubuntu 20.04. Did you somehow upgrade from 18.04 already?

I would try to remove OpenMPI 2 and only keep the latest one. Then, I would rebuild (just relink actually) the solvers.

Claudio · April 28, 2020, 6:34pm

Yes, the problem was indeed a difference between OpenMPI versions. I am not able to understand what happened first, but rebuilding everything with the latest version seems to solve the issue.
Thank you
Claudio

Topic		Replies	Views
Errors while running quickstart with OpenFOAMv1706 and preCICEv2211.0 Official adapters and tutorials openfoam , adapters	6	227	November 7, 2023
Problem with installation of OpenFOAM adapter Official adapters and tutorials openfoam , adapters	3	168	August 4, 2022
Building OpenFOAM adapter failed Official adapters and tutorials openfoam , adapters	5	97	March 3, 2024
OpenFoam adapter failed to compile Non-preCICE openfoam , adapters	8	494	June 28, 2021
Continuing openfoam adapter installation issue Official adapters and tutorials openfoam , centos	6	734	March 10, 2021

OpenFOAM adapter on Ubuntu 20.04

Related Topics