Type System

Flyte is a data-aware DAG scheduling system. The Graph itself is derived automatically from the flow of data and this closely resembles how a functional programming language passes data between methods.

Data awareness is powered by Flyte’s own type system, which closely maps most programming languages. These types are what power Flyte’s magic of:

• Data lineage

• Memoization

• Auto parallelization

• Simplifying access to data

• Auto generated CLI and Launch UI

It also opens up possibilities of future optimizations.

Flyte and Python Types

Flyte and Python Types

Using Schemas

Using Schemas

Structured Dataset

Structured Dataset

Typed Columns in a Schema

Typed Columns in a Schema

PyTorch Types

PyTorch Types

Using Custom Python Objects

Using Custom Python Objects

Using Enum types

Using Enum types

Using Flyte Pickle

Using Flyte Pickle