flytekit.extras.accelerators.MultiInstanceGPUAccelerator

class flytekit.extras.accelerators.MultiInstanceGPUAccelerator[source]

Base class for all multi-instance GPU accelerator types. It is recommended to use one of the pre-defined constants below, as name has to match the name of the device configured on the cluster. For example, to specify a 10GB partition of an A100 GPU, use A100.partition_2g_10gb.

Methods

classmethod partitioned(partition_size)[source]
Parameters:

partition_size (str)

Return type:

MIG

to_flyte_idl()[source]
Return type:

GPUAccelerator

Attributes

unpartitioned
device: ClassVar[str]