Skip to main content

Cornelis Technical Documentation

Name

opagetvf — Used for scripting application use of Virtual Fabrics (VFs), such as for mpirun parameters. This command is one of the Utilities commands.

Syntax

opagetvf [-h hfi] [-p port] [-e] [-d vfname|-S serviceId|-m mcgid|-i vfIndex|-k pkey|-L sl]

Description

You can query by VF Name, VF Index, Service ID, Multicast Group Identifier (MGID), PKey, or Service Level (SL). Fetches the Virtual Fabric info in a delimited format. Returns exactly one matching VF. When multiple VFs match the query, it prefers non-default VFs in which the calling server is a full member. If multiple choices remain, it returns the one with the lowest VF Index. Uses the same algorithm as the DSAP.

The tool can be used with additional scripts to help set PKey, SL, MTU, and Rate when running MPI jobs. Internally, this tool is based on the opasaquery -o vfinfocsv command. For more information, see opasaquery.

Options

--help

Produces full help text.

-h hfi

Specifies the SuperNIC to send by. Default is first SuperNIC.

-p port

Specifies the port to send by. Default is first active port.

-e

Outputs MTU and rate as enum values. A value of 0 denotes unspecified.

-d vfname

Queries by VirtualFabric Name.

-S serviceId

Queries by Application ServiceId.

-m gid

Queries by Application Multicast GID.

-i vfindex

Queries by VirtualFabric Index.

-k pkey

Queries by VirtualFabric PKey.

-L SL

Queries by VirtualFabric SL.

Examples

opagetvf -d 'Compute'
opagetvf -h 2 -p 2 -d 'Compute'

Notes - Sample Outputs

The output is of the form: name:index:pkey:sl:mtu:rate:optionflag::mcastSl

The option flag is a bitmask. A feature is on when its bit is set. Values include:

  • 0x00 Specifies that none of the following features are set.

  • 0x01 Enables the security feature

  • 0x02 Enables the QoS feature

  • 0x04 Enables the Flow Control Disable feature

# opagetvf -d Default
Default:0:0xffff:0:unlimited:unlimited:0x0::

Virtual Fabric (also called vFabric) - This network architecture partitions a single physical network into logical networks or fabrics. vFabrics permit multiple applications to be run on the same fabric at the same time with limited interference.

Multicast Group Identifier - This ID number maps multicast source, the multicast address, and the VLAN.

Partition Key - This is a unique ID assigned to an InfiniBand or vFabric partition.

Distributed Subnet Administration Provider - This is a component designed to manage records for Virtual Fabrics, specifically those that match SIDs (Subnet IDs) in the DSAP's configuration file, ensuring efficient and accurate subnet management.

Maximum Transmission Unit - This is the size of the largest protocol data unit or data packet that can be sent in a single network layer transaction.

Message Passing Interface - This is a standardized means of exchanging messages between multiple computers running a parallel program across distributed memory

Global Identifier - This is a 128-bit fabric address (a 64-bit subnet prefix plus a 64-bit interface identifier) that identifies a port or a multicast group, written as subnet:interface.