The OPX Libfabric Provider (hereafter called the OPX Provider) takes full advantage of the libfabric acceleration features while running over existing and future Omni-Path hardware.

The OPX Provider delivers excellent latency characteristics and message rates at small message sizes (under 16K message length). It supports bulk transfer via SDMA, providing added performance for large messages. The OPX Provider implements RDMA support through the expected receive (TID) mechanisms, which is enabled by default. To disable it, set the environment variable: FI_OPX_TID_DISABLE=1.

Use FI_LOG_LEVEL=trace to print the file location info and OPX Provider library file in use. The output will be similar to:

Using opx provider: Library file location is *.so file location