Data Types and IO

Flyte is a data-aware DAG scheduling system. The graph itself is derived automatically from the flow of data and this closely resembles how a functional programming language passes data between methods.

Data awareness is powered by Flyte’s own type system, which closely maps most programming languages. These types are what power Flyte’s magic of:

• Data lineage

• Memoization

• Auto parallelization

• Simplifying access to data

• Auto generated CLI and Launch UI

Flyte and Python Types

Using Schemas

Structured Dataset

Typed Columns in a Schema

PyTorch Types

Using Custom Python Objects

Using Enum types

Using Flyte Pickle