Interface GPUOptions.Experimental.VirtualDevicesOrBuilder

All Superinterfaces:
MessageLiteOrBuilder, MessageOrBuilder
All Known Implementing Classes:
GPUOptions.Experimental.VirtualDevices, GPUOptions.Experimental.VirtualDevices.Builder
Enclosing class:
GPUOptions.Experimental
public static interface GPUOptions.Experimental.VirtualDevicesOrBuilder extends MessageOrBuilder

  • Method Details

    • getMemoryLimitMbList

      List<Float> getMemoryLimitMbList()
      Per "virtual" device memory limit, in MB. The number of elements in
the list is the number of virtual devices to create on the
corresponding visible GPU (see "virtual_devices" below).
If empty and `num_virtual_devices_per_gpu` is not set, it will create
single virtual device taking all available memory from the device.
For the concept of "visible" and "virtual" GPU, see the comments for
"visible_device_list" above for more information.
      repeated float memory_limit_mb = 1;
      Returns:
      A list containing the memoryLimitMb.

    • getMemoryLimitMbCount

      int getMemoryLimitMbCount()
      Per "virtual" device memory limit, in MB. The number of elements in
the list is the number of virtual devices to create on the
corresponding visible GPU (see "virtual_devices" below).
If empty and `num_virtual_devices_per_gpu` is not set, it will create
single virtual device taking all available memory from the device.
For the concept of "visible" and "virtual" GPU, see the comments for
"visible_device_list" above for more information.
      repeated float memory_limit_mb = 1;
      Returns:
      The count of memoryLimitMb.

    • getMemoryLimitMb

      float getMemoryLimitMb(int index)
      Per "virtual" device memory limit, in MB. The number of elements in
the list is the number of virtual devices to create on the
corresponding visible GPU (see "virtual_devices" below).
If empty and `num_virtual_devices_per_gpu` is not set, it will create
single virtual device taking all available memory from the device.
For the concept of "visible" and "virtual" GPU, see the comments for
"visible_device_list" above for more information.
      repeated float memory_limit_mb = 1;
      Parameters:
      index - The index of the element to return.
      Returns:
      The memoryLimitMb at the given index.

    • getPriorityList

      List<Integer> getPriorityList()
      Priority values to use with the virtual devices. Use the cuda function
cudaDeviceGetStreamPriorityRange to query for valid range of values for
priority.
On a P4000 GPU with cuda 10.1, the priority range reported was 0 for
least priority and -1 for greatest priority.
If this field is not specified, then the virtual devices will be
created with the default. If this field has values set, then the size
of this must match with the above memory_limit_mb.
      repeated int32 priority = 2;
      Returns:
      A list containing the priority.

    • getPriorityCount

      int getPriorityCount()
      Priority values to use with the virtual devices. Use the cuda function
cudaDeviceGetStreamPriorityRange to query for valid range of values for
priority.
On a P4000 GPU with cuda 10.1, the priority range reported was 0 for
least priority and -1 for greatest priority.
If this field is not specified, then the virtual devices will be
created with the default. If this field has values set, then the size
of this must match with the above memory_limit_mb.
      repeated int32 priority = 2;
      Returns:
      The count of priority.

    • getPriority

      int getPriority(int index)
      Priority values to use with the virtual devices. Use the cuda function
cudaDeviceGetStreamPriorityRange to query for valid range of values for
priority.
On a P4000 GPU with cuda 10.1, the priority range reported was 0 for
least priority and -1 for greatest priority.
If this field is not specified, then the virtual devices will be
created with the default. If this field has values set, then the size
of this must match with the above memory_limit_mb.
      repeated int32 priority = 2;
      Parameters:
      index - The index of the element to return.
      Returns:
      The priority at the given index.

    • getDeviceOrdinalList

      List<Integer> getDeviceOrdinalList()
      Virtual Device ordinal number determines the device ID of the device.
A Virtual device with a lower ordinal number always receives the a
smaller device id. The phyiscal device id and location in the
virtual device list is used to break ties.
      repeated int32 device_ordinal = 3;
      Returns:
      A list containing the deviceOrdinal.

    • getDeviceOrdinalCount

      int getDeviceOrdinalCount()
      Virtual Device ordinal number determines the device ID of the device.
A Virtual device with a lower ordinal number always receives the a
smaller device id. The phyiscal device id and location in the
virtual device list is used to break ties.
      repeated int32 device_ordinal = 3;
      Returns:
      The count of deviceOrdinal.

    • getDeviceOrdinal

      int getDeviceOrdinal(int index)
      Virtual Device ordinal number determines the device ID of the device.
A Virtual device with a lower ordinal number always receives the a
smaller device id. The phyiscal device id and location in the
virtual device list is used to break ties.
      repeated int32 device_ordinal = 3;
      Parameters:
      index - The index of the element to return.
      Returns:
      The deviceOrdinal at the given index.