As of OPX Software release 12.0.2, a high bandwidth mode can be enabled by loading the HFI1 driver with the module parameter use_bulksvc=Y. No additional flags are required to use bulk service with Verbs. With bulk service enabled, ib_write_bw and ib_read_bw are able to achieve near line rate.

ib_send_bw still needs to be optimized.