flytekit.extras.accelerators.A100_80GB¶

flytekit.extras.accelerators.A100_80GB = <flytekit.extras.accelerators._A100_80GB object>¶

use this constant to specify that the task should run on an entire NVIDIA A100 80GB GPU. Fractional partitions are also available.

Use pre-defined partitions (as instance attributes). For example, to specify a 10GB partition, use A100.partition_2g_10gb. All available partitions are listed below:

class flytekit.extras.accelerators._A100_80GB[source]¶

Partitions of an NVIDIA A100 80GB GPU.

partition_1g_10gb = <flytekit.extras.accelerators._A100_80GB_Base object>¶: 10GB partition of an A100 80GB GPU - 2x5GB slices with 1/7th of the SM.

partition_2g_20gb = <flytekit.extras.accelerators._A100_80GB_Base object>¶: 2GB partition of an A100 80GB GPU - 4x5GB slices with 2/7th of the SM.

partition_3g_40gb = <flytekit.extras.accelerators._A100_80GB_Base object>¶: 3GB partition of an A100 80GB GPU - 8x5GB slices with 3/7th of the SM.

partition_4g_40gb = <flytekit.extras.accelerators._A100_80GB_Base object>¶: 4GB partition of an A100 80GB GPU - 8x5GB slices with 4/7th of the SM.

partition_7g_80gb = <flytekit.extras.accelerators._A100_80GB_Base object>¶: 7GB partition of an A100 80GB GPU - 16x5GB slices with 7/7th of the SM.