flytekit.extras.accelerators.A100¶

flytekit.extras.accelerators.A100 = <flytekit.extras.accelerators._A100 object>¶

Use this constant to specify that the task should run on an entire NVIDIA A100 GPU. Fractional partitions are also available.

Use pre-defined partitions (as instance attributes). For example, to specify a 10GB partition, use A100.partition_2g_10gb. All partitions are nested in the class as follows:

class flytekit.extras.accelerators._A100[source]¶

Class that represents an NVIDIA A100 GPU. It is possible to specify a partition of an A100 GPU by using the provided partitions on the class. For example, to specify a 10GB partition, use A100.partition_2g_10gb. Refer to Partitioned GPUs

partition_1g_5gb = <flytekit.extras.accelerators._A100_Base object>¶: 5GB partition of an A100 GPU.

partition_2g_10gb = <flytekit.extras.accelerators._A100_Base object>¶: 10GB partition of an A100 GPU - 2x5GB slices with 2/7th of the SM.

partition_3g_20gb = <flytekit.extras.accelerators._A100_Base object>¶: 20GB partition of an A100 GPU - 4x5GB slices, with 3/7th fraction of SM (Streaming multiprocessor).

partition_4g_20gb = <flytekit.extras.accelerators._A100_Base object>¶: 20GB partition of an A100 GPU - 4x5GB slices, with 4/7th fraction of SM.

partition_7g_40gb = <flytekit.extras.accelerators._A100_Base object>¶: 40GB partition of an A100 GPU - 8x5GB slices, with 7/7th fraction of SM.