6.6. OPX Tunings for HPC Applications
Certain HPC applications benefit from additional tuning parameters. The following table outlines potential tunings, which may improve application performance.
Application/Workload | Tuning |
|---|---|
BQCD (r685) | Enable BTS (see below) |
CP2K | FI_OPX_SDMA_DISABLE=1 |
127.wrf2-med (Spec MPI2007 medium suite) | FI_OPX_SDMA_DISABLE=1 |
GADGET4 (Cosmology, Galaxy Evolution) | FI_OPX_RELIABILITY_SERVICE_PRE_ACK_RATE=1 |
GROMACS Archer (Large) | Enable BTS (see below) |
GROMACS BenchPEP | FI_OPX_RELIABILITY_SERVICE_PRE_ACK_RATE=1 FI_OPX_RELIABILITY_SERVICE_USEC_MAX=5000 OMP_NUM_THREADS=2 |
GROMACS BenchPEP-h | FI_OPX_SDMA_MIN_PAYLOAD_BYTES=2147483646 FI_OPX_RZV_MIN_PAYLOAD_BYTES=65536 OMP_NUM_THREADS=2 |
HPCG (AMD Zen) | Enable BTS (see below) |
HPL (AMD Zen) | Enable BTS (see below) |
LAMMPS (Rhodo) | Enable BTS (see below) |
To enable BTS, set FI_OPX_HFISVC=1. The hfi1 module must be loaded with the use_bulksvc=Y option.