flytekit.extras.accelerators.MultiInstanceGPUAccelerator

class flytekit.extras.accelerators.MultiInstanceGPUAccelerator

Base class for all multi-instance GPU accelerator types. It is recommended to use one of the pre-defined constants below, as name has to match the name of the device configured on the cluster. For example, to specify a 10GB partition of an A100 GPU, use A100.partition_2g_10gb.

Methods

classmethod partitioned(partition_size)

Parameters:

partition_size (str)

Return type:

MIG

to_flyte_idl()

Return type:

GPUAccelerator

Attributes

unpartitioned

device: ClassVar[str]