The OPX Libfabric Provider (hereafter called the OPX Provider) is written to take full advantage of the libfabric acceleration features while running over existing and future Omni-Path hardware. The OPX Provider delivers excellent latency and message rate performance. Bulk transfer is performed using SDMA to achieve maximum bandwidth at larger message sizes using user configurable thresholds.

Use the FI_LOG_LEVEL=debug and FI_LOG_SUBSYS=core environment variables to print the file location info and OPX Provider library file in use at the beginning of the mpirun output. The output will look similar to: Using opx Provider: Library file location is *.so file location