Skip to main content

Cornelis Technical Documentation

Name

opagetvf — Used for scripting application use of Virtual Fabrics (VFs), such as for mpirun parameters.

Syntax

opagetvf [-h hfi] [-p port] [-e] [-d vfname|-S serviceId|-m mcgid|-i vfIndex|-k pkey|-L sl]

Description

You can query by VF Name, VF Index, Service ID, Multicast Group Identifier (MGID), PKey, or Service Level (SL). Fetches the Virtual Fabric info in a delimited format. Returns exactly one matching VF. When multiple VFs match the query, it prefers non-default VFs in which the calling server is a full member. If multiple choices remain, it returns the one with the lowest VF Index. Uses the same algorithm as the DSAP.

The tool can be used with additional scripts to help set PKey, SL, MTU, and Rate when running MPI jobs. Internally, this tool is based on the opasaquery -o vfinfocsv command. For more information, see .

Options

--help

Produces full help text.

-h hfi

Specifies the SuperNIC to send by. Default is first SuperNIC.

-p port

Specifies the port to send by. Default is first active port.

-e

Outputs MTU and rate as enum values. A value of 0 denotes unspecified.

-d vfname

Queries by VirtualFabric Name.

-S serviceId

Queries by Application ServiceId.

-m gid

Queries by Application Multicast GID.

-i vfindex

Queries by VirtualFabric Index.

-k pkey

Queries by VirtualFabric PKey.

-L SL

Queries by VirtualFabric SL.

Examples

opagetvf -d 'Compute'
opagetvf -h 2 -p 2 -d 'Compute'

Notes - Sample Outputs

The output is of the form: name:index:pkey:sl:mtu:rate:optionflag::mcastSl

Option flag (bitmask) values include:

  • 0x00 Indicates no bits are set. Specifically, no QoS, no Security, and no flow control disabled (which means flow control is enabled).

  • 0x01 Security

  • 0x02 QoS

  • 0x04 Flow Control Disable

# opagetvf -d Default
Default:0:0xffff:0:unlimited:unlimited:0x0::

Virtual Fabric (also called vFabric) - This network architecture partitions a single physical network into logical networks or fabrics. vFabrics permit multiple applications to be run on the same fabric at the same time with limited interference.

Multicast Group Identifier - This ID number maps multicast source, the multicast address, and the VLAN.

Partition Key - This is a unique ID assigned to an InfiniBand or vFabric partition.

Distributed Subnet Administration Provider - This is a component designed to manage records for Virtual Fabrics, specifically those that match SIDs (Subnet IDs) in the DSAP's configuration file, ensuring efficient and accurate subnet management.

Maximum Transmission Unit - This is the size of the largest protocol data unit or data packet that can be sent in a single network layer transaction.

Message Passing Interface - This is a standardized means of exchanging messages between multiple computers running a parallel program across distributed memory

Group Identifier - This is a unique identifier assigned to a group of users on a system, allowing them to access files and directories with common permissions.