-------------------------------------------------------------------------- A process has executed an operation involving a call to the "fork()" system call to create a child process. Open MPI is currently operating in a condition that could result in memory corruption or other system errors; your job may hang, crash, or produce silent data corruption. The use of fork() (or system() or other calls that create child processes) is strongly discouraged. The process that invoked fork was: Local host: [[19144,1],0] (PID 222499) If you are *absolutely sure* that your application will successfully and correctly survive a call to fork(), you may disable this warning by setting the mpi_warn_on_fork MCA parameter to 0. -------------------------------------------------------------------------- [2] #0 Foam::error::printStack(Foam::Ostream&)[0] #0 Foam::error::printStack(Foam::Ostream&)[1] #0 Foam::error::printStack(Foam::Ostream&)-------------------------------------------------------------------------- A process has executed an operation involving a call to the "fork()" system call to create a child process. Open MPI is currently operating in a condition that could result in memory corruption or other system errors; your job may hang, crash, or produce silent data corruption. The use of fork() (or system() or other calls that create child processes) is strongly discouraged. The process that invoked fork was: Local host: [[19118,1],0] (PID 222521) If you are *absolutely sure* that your application will successfully and correctly survive a call to fork(), you may disable this warning by setting the mpi_warn_on_fork MCA parameter to 0. -------------------------------------------------------------------------- at ??:? [2] #1 Foam::sigFpe::sigHandler(int) at ??:? [0] #1 Foam::sigFpe::sigHandler(int) at ??:? [1] #1 Foam::sigFpe::sigHandler(int) at at ??:? ??:? [1] #2 [2] #2 ?? at ??:? [0] #2 ? in /lib64/libpthread.so.0 [2] #3 ? in /lib64/libpthread.so.0 [1] #3 ? in /lib64/libpthread.so.0 [0] #3 ? in /opt/ohpc/pub/libs/gnu8/openmpi3/trilinos/12.14.1/lib/libteuchoscore.so.12 [2] #4 ? in /opt/ohpc/pub/libs/gnu8/openmpi3/trilinos/12.14.1/lib/libteuchoscore.so.12 [0] #4 ? in /opt/ohpc/pub/libs/gnu8/openmpi3/trilinos/12.14.1/lib/libteuchoscore.so.12 [1] #4 ? in /lib64/ld-linux-x86-64.so.2 [2] #5 ? in /lib64/ld-linux-x86-64.so.2 [0] #5 ? in /lib64/ld-linux-x86-64.so.2 [1] #5 ? in /lib64/ld-linux-x86-64.so.2 [2] #6 ? in /lib64/ld-linux-x86-64.so.2 [1] #6 ? in /lib64/ld-linux-x86-64.so.2 [0] #6 ? in /lib64/ld-linux-x86-64.so.2 [2] #7 ? in /lib64/ld-linux-x86-64.so.2 [1] #7 ? in /lib64/ld-linux-x86-64.so.2 [0] #7 ? in /lib64/ld-linux-x86-64.so.2 [2] #8 ? in /lib64/ld-linux-x86-64.so.2 [1] #8 ? in /lib64/ld-linux-x86-64.so.2 [0] #8 ? in /lib64/libdl.so.2 [1] #9 ? in /lib64/libdl.so.2 [2] #9 ? in /lib64/libdl.so.2 [0] #9 ? in /lib64/ld-linux-x86-64.so.2 [1] #10 ? in /lib64/ld-linux-x86-64.so.2 [2] #10 ? in /lib64/ld-linux-x86-64.so.2 [0] #10 ? in /lib64/libdl.so.2 [0] #11 dlopen in /lib64/libdl.so.2 [1] #11 dlopen in /lib64/libdl.so.2 [2] #11 dlopen in /lib64/libdl.so.2 [0] #12 Foam::dlOpen(Foam::fileName const&, bool) in /lib64/libdl.so.2 [2] #12 Foam::dlOpen(Foam::fileName const&, bool) in /lib64/libdl.so.2 [1] #12 Foam::dlOpen(Foam::fileName const&, bool) at ??:? [0] #13 Foam::dlOpen(Foam::fileName const&, std::__cxx11::basic_string, std::allocator >&) at ??:? [2] #13 Foam::dlOpen(Foam::fileName const&, std::__cxx11::basic_string, std::allocator >&) at ??:? [1] #13 Foam::dlOpen(Foam::fileName const&, std::__cxx11::basic_string, std::allocator >&) at ??:? [0] #14 Foam::dlLibraryTable::openLibrary(Foam::fileName const&, bool) at ??:? [2] #14 Foam::dlLibraryTable::openLibrary(Foam::fileName const&, bool) at ??:? [0] #15 Foam::dlLibraryTable::open(Foam::fileName const&, bool) at ??:? [1] #14 Foam::dlLibraryTable::openLibrary(Foam::fileName const&, bool) at ??:? [2] #15 Foam::dlLibraryTable::open(Foam::fileName const&, bool) at ??:? [0] #16 bool Foam::dlLibraryTable::open (*)(Foam::word const&, Foam::Time const&, Foam::dictionary const&), Foam::word, Foam::Hash >*>(Foam::dictionary const&, Foam::word const&, Foam::HashTable (*)(Foam::word const&, Foam::Time const&, Foam::dictionary const&), Foam::word, Foam::Hash >* const&, bool) at ??:? [1] #15 Foam::dlLibraryTable::open(Foam::fileName const&, bool) at ??:? [2] #16 bool Foam::dlLibraryTable::open (*)(Foam::word const&, Foam::Time const&, Foam::dictionary const&), Foam::word, Foam::Hash >*>(Foam::dictionary const&, Foam::word const&, Foam::HashTable (*)(Foam::word const&, Foam::Time const&, Foam::dictionary const&), Foam::word, Foam::Hash >* const&, bool) at ??:? [0] #17 Foam::functionObject::New(Foam::word const&, Foam::Time const&, Foam::dictionary const&) at ??:? [1] #16 bool Foam::dlLibraryTable::open (*)(Foam::word const&, Foam::Time const&, Foam::dictionary const&), Foam::word, Foam::Hash >*>(Foam::dictionary const&, Foam::word const&, Foam::HashTable (*)(Foam::word const&, Foam::Time const&, Foam::dictionary const&), Foam::word, Foam::Hash >* const&, bool) at ??:? [2] #17 Foam::functionObject::New(Foam::word const&, Foam::Time const&, Foam::dictionary const&) at ??:? [0] #18 Foam::functionObjectList::read() at ??:? [1] #17 Foam::functionObject::New(Foam::word const&, Foam::Time const&, Foam::dictionary const&) at ??:? [2] #18 Foam::functionObjectList::read() at ??:? [0] #19 Foam::Time::run() const at ??:? [1] #18 Foam::functionObjectList::read() at ??:? [2] #19 Foam::Time::run() const at ??:? [0] #20 at ??:? [1] #19 Foam::Time::run() const at ??:? [2] #20 at ??:? [1] #20 ??? at ??:? [2] #21 __libc_start_main at ??:? [0] #21 __libc_start_main at ??:? [1] #21 __libc_start_main in /lib64/libc.so.6 [0] #22 in /lib64/libc.so.6 [2] #22 ? in /lib64/libc.so.6 [1] #22 ?? at ??:? [node001:222521] *** Process received signal *** [node001:222521] Signal: Floating point exception (8) [node001:222521] Signal code: (-6) [node001:222521] Failing at address: 0x3f000036539 at ??:? [node001:222523] *** Process received signal *** [node001:222523] Signal: Floating point exception (8) [node001:222523] Signal code: (-6) [node001:222523] Failing at address: 0x3f00003653b [node001:222523] [ 0] /lib64/libpthread.so.0(+0xf630)[0x7fffefe9f630] [node001:222523] [ 1] /lib64/libpthread.so.0(raise+0x2b)[0x7fffefe9f4fb] [node001:222523] [ 2] /lib64/libpthread.so.0(+0xf630)[0x7fffefe9f630] [node001:222523] [ 3] /opt/ohpc/pub/libs/gnu8/openmpi3/trilinos/12.14.1/lib/libteuchoscore.so.12(+0x23695)[0x7fffb8e9e695] [node001:222523] [ 4] /lib64/ld-linux-x86-64.so.2(+0xf9b3)[0x7ffff7dea9b3] [node001:222523] [ 5] /lib64/ld-linux-x86-64.so.2(+0x1458e)[0x7ffff7def58e] [node001:222523] [ 6] /lib64/ld-linux-x86-64.so.2(+0xf7c4)[0x7ffff7dea7c4] [node001:222523] [ 7] /lib64/ld-linux-x86-64.so.2(+0x13b7b)[0x7ffff7deeb7b] [node001:222523] [ 8] /lib64/libdl.so.2(+0xfab)[0x7ffff0949fab] [node001:222523] [ 9] /lib64/ld-linux-x86-64.so.2(+0xf7c4)[0x7ffff7dea7c4] [node001:222523] [10] /lib64/libdl.so.2(+0x15ad)[0x7ffff094a5ad] [node001:222523] [11] /lib64/libdl.so.2(dlopen+0x31)[0x7ffff094a041] [node001:222523] [12] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam6dlOpenERKNS_8fileNameEb+0x36)[0x7ffff14c5ec6] [node001:222523] [13] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam6dlOpenERKNS_8fileNameERNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0xe)[0x7ffff14c704e] [node001:222523] [14] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam14dlLibraryTable11openLibraryERKNS_8fileNameEb+0x10e)[0x7ffff115debe] [node001:222523] [15] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam14dlLibraryTable4openERKNS_8fileNameEb+0x16)[0x7ffff115f026] [node001:222523] [16] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam14dlLibraryTable4openIPNS_9HashTableIPFNS_7autoPtrINS_14functionObjectEEERKNS_4wordERKNS_4TimeERKNS_10dictionaryEES6_NS_4HashIS6_EEEEEEbSE_S8_RKT_b+0xb0)[0x7ffff116ff90] [node001:222523] [17] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam14functionObject3NewERKNS_4wordERKNS_4TimeERKNS_10dictionaryE+0x15e)[0x7ffff116d35e] [node001:222523] [18] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam18functionObjectList4readEv+0xc19)[0x7ffff1174e39] [node001:222523] [19] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZNK4Foam4Time3runEv+0x2c7)[0x7ffff118ba87] [node001:222523] [20] pimpleFoam[0x42b2d4] [node001:222523] [21] /lib64/libc.so.6(__libc_start_main+0xf5)[0x7fffefae4555] [node001:222523] [22] pimpleFoam[0x4300d8] [node001:222523] *** End of error message *** [node001:222521] [ 0] /lib64/libpthread.so.0(+0xf630)[0x7fffefe9f630] [node001:222521] [ 1] /lib64/libpthread.so.0(raise+0x2b)[0x7fffefe9f4fb] [node001:222521] [ 2] /lib64/libpthread.so.0(+0xf630)[0x7fffefe9f630] [node001:222521] [ 3] /opt/ohpc/pub/libs/gnu8/openmpi3/trilinos/12.14.1/lib/libteuchoscore.so.12(+0x23695)[0x7fffb8e9e695] [node001:222521] [ 4] /lib64/ld-linux-x86-64.so.2(+0xf9b3)[0x7ffff7dea9b3] [node001:222521] [ 5] /lib64/ld-linux-x86-64.so.2(+0x1458e)[0x7ffff7def58e] [node001:222521] [ 6] /lib64/ld-linux-x86-64.so.2(+0xf7c4)[0x7ffff7dea7c4] [node001:222521] [ 7] /lib64/ld-linux-x86-64.so.2(+0x13b7b)[0x7ffff7deeb7b] [node001:222521] [ 8] /lib64/libdl.so.2(+0xfab)[0x7ffff0949fab] [node001:222521] [ 9] /lib64/ld-linux-x86-64.so.2(+0xf7c4)[0x7ffff7dea7c4] [node001:222521] [10] /lib64/libdl.so.2(+0x15ad)[0x7ffff094a5ad] [node001:222521] [11] /lib64/libdl.so.2(dlopen+0x31)[0x7ffff094a041] [node001:222521] [12] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam6dlOpenERKNS_8fileNameEb+0x36)[0x7ffff14c5ec6] [node001:222521] [13] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam6dlOpenERKNS_8fileNameERNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0xe)[0x7ffff14c704e] [node001:222521] [14] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam14dlLibraryTable11openLibraryERKNS_8fileNameEb+0x10e)[0x7ffff115debe] [node001:222521] [15] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam14dlLibraryTable4openERKNS_8fileNameEb+0x16)[0x7ffff115f026] [node001:222521] [16] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam14dlLibraryTable4openIPNS_9HashTableIPFNS_7autoPtrINS_14functionObjectEEERKNS_4wordERKNS_4TimeERKNS_10dictionaryEES6_NS_4HashIS6_EEEEEEbSE_S8_RKT_b+0xb0)[0x7ffff116ff90] [node001:222521] [17] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam14functionObject3NewERKNS_4wordERKNS_4TimeERKNS_10dictionaryE+0x15e)[0x7ffff116d35e] [node001:222521] [18] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam18functionObjectList4readEv+0xc19)[0x7ffff1174e39] [node001:222521] [19] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZNK4Foam4Time3runEv+0x2c7)[0x7ffff118ba87] [node001:222521] [20] pimpleFoam[0x42b2d4] [node001:222521] [21] /lib64/libc.so.6(__libc_start_main+0xf5)[0x7fffefae4555] [node001:222521] [22] pimpleFoam[0x4300d8] [node001:222521] *** End of error message *** at ??:? [node001:222522] *** Process received signal *** [node001:222522] Signal: Floating point exception (8) [node001:222522] Signal code: (-6) [node001:222522] Failing at address: 0x3f00003653a [node001:222522] [ 0] /lib64/libpthread.so.0(+0xf630)[0x7fffefe9f630] [node001:222522] [ 1] /lib64/libpthread.so.0(raise+0x2b)[0x7fffefe9f4fb] [node001:222522] [ 2] /lib64/libpthread.so.0(+0xf630)[0x7fffefe9f630] [node001:222522] [ 3] /opt/ohpc/pub/libs/gnu8/openmpi3/trilinos/12.14.1/lib/libteuchoscore.so.12(+0x23695)[0x7fffb8e9e695] [node001:222522] [ 4] /lib64/ld-linux-x86-64.so.2(+0xf9b3)[0x7ffff7dea9b3] [node001:222522] [ 5] /lib64/ld-linux-x86-64.so.2(+0x1458e)[0x7ffff7def58e] [node001:222522] [ 6] /lib64/ld-linux-x86-64.so.2(+0xf7c4)[0x7ffff7dea7c4] [node001:222522] [ 7] /lib64/ld-linux-x86-64.so.2(+0x13b7b)[0x7ffff7deeb7b] [node001:222522] [ 8] /lib64/libdl.so.2(+0xfab)[0x7ffff0949fab] [node001:222522] [ 9] /lib64/ld-linux-x86-64.so.2(+0xf7c4)[0x7ffff7dea7c4] [node001:222522] [10] /lib64/libdl.so.2(+0x15ad)[0x7ffff094a5ad] [node001:222522] [11] /lib64/libdl.so.2(dlopen+0x31)[0x7ffff094a041] [node001:222522] [12] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam6dlOpenERKNS_8fileNameEb+0x36)[0x7ffff14c5ec6] [node001:222522] [13] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam6dlOpenERKNS_8fileNameERNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0xe)[0x7ffff14c704e] [node001:222522] [14] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam14dlLibraryTable11openLibraryERKNS_8fileNameEb+0x10e)[0x7ffff115debe] [node001:222522] [15] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam14dlLibraryTable4openERKNS_8fileNameEb+0x16)[0x7ffff115f026] [node001:222522] [16] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam14dlLibraryTable4openIPNS_9HashTableIPFNS_7autoPtrINS_14functionObjectEEERKNS_4wordERKNS_4TimeERKNS_10dictionaryEES6_NS_4HashIS6_EEEEEEbSE_S8_RKT_b+0xb0)[0x7ffff116ff90] [node001:222522] [17] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam14functionObject3NewERKNS_4wordERKNS_4TimeERKNS_10dictionaryE+0x15e)[0x7ffff116d35e] [node001:222522] [18] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam18functionObjectList4readEv+0xc19)[0x7ffff1174e39] [node001:222522] [19] /opt/lasie/pub/libs/gnu8/openmpi3/openfoam/OpenFOAM-v2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZNK4Foam4Time3runEv+0x2c7)[0x7ffff118ba87] [node001:222522] [20] pimpleFoam[0x42b2d4] [node001:222522] [21] /lib64/libc.so.6(__libc_start_main+0xf5)[0x7fffefae4555] [node001:222522] [22] pimpleFoam[0x4300d8] [node001:222522] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpirun noticed that process rank 2 with PID 222523 on node node001 exited on signal 8 (Floating point exception). -------------------------------------------------------------------------- [node001:222516] 2 more processes have sent help message help-opal-runtime.txt / opal_init:warn-fork [node001:222516] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages