6.4.2. Open MPI Settings
If preferred, users may build and install their own Open MPI stack to run performance benchmarks.
6.4.2.1. Download Open MPI
Get the latest version from: Open MPI
Extract the archive into /tmp or your preferred build directory.
6.4.2.2. Build and Install
export ompi_install_dir=/desired/path/to/install ./configure --prefix=$ompi_install_dir --with-ofi=/usr --enable-orterun-prefix-by-default LDFLAGS=-Wl,--ena make -j 64 make install
6.4.2.3. Load Open MPI Environment
Ensure that the PATH and LD_LIBRARY_PATH environment variables are set to point to the installed Open MPI version. This allows the system to use the correct mpirun and related binaries and libraries.
6.4.2.4. Run with OPX Support
When using Open MPI with the OPX Provider, specify the following flags:
mpirun -x FI_PROVIDER=opx -mca mtl ofi -mca btl self,vader ...
Note
To run benchmarks with a manually built version of libfabric (instead of the version bundled with the CN5000 software), set the LD_LIBRARY_PATH environment variable to your custom libfabric installation path when invoking mpirun. LD_LIBRARY_PATH should point to the folder where libfabric.so and similar are located.