6.4.3. MVAPICH Settings
Users can download and compile MVAPICH 4.1 from the MVAPICH Downloads site. Note that if MVAPICH detects xpmem installed, it must be explicitly disabled during configuration.
6.4.3.1. Download, Configure, and Compile MVAPICH
cd /tmp wget https://mvapich.cse.ohio-state.edu/download/mvapich/mv2/mvapich-4.1.tar.gz cd mvapich-4.1 ./configure --prefix=/path/to/mvapich-4.1-installed --with-device=ch4:ofi --with-libfabric=/usr/ --with-xpm make -j make install
Process pinning with MVAPICH can be achieved via standard hydra methods. See Using the Hydra Process Manager (GitHub) for detail. There are many ways to explicitly pin processes according to workload requirements (see mpiexec -bind-to -help for details).
Note
To run benchmarks with a manually built version of libfabric (instead of the version bundled with the CN5000 software), set the LD_LIBRARY_PATH environment variable to your custom libfabric installation path when invoking mpirun. LD_LIBRARY_PATH should point to the folder where libfabric.so and similar are located.