Type System#

Flyte is a data-aware DAG scheduling system. The Graph itself is derived automatically from the flow of data and this closely resembles how a functional programming language passes data between methods.

Data awareness is powered by Flyte’s own type system, which closely maps most programming languages. These types are what power Flyte’s magic of:

  • Data lineage

  • Memoization

  • Auto parallelization

  • Simplifying access to data

  • Auto generated CLI and Launch UI

It also opens up possibilities of future optimizations.

Flyte and Python Types

Flyte and Python Types

Flyte and Python Types
Using Schemas

Using Schemas

Using Schemas
Structured Dataset

Structured Dataset

Structured Dataset
Typed Columns in a Schema

Typed Columns in a Schema

Typed Columns in a Schema
PyTorch Types

PyTorch Types

PyTorch Types
Using Custom Python Objects

Using Custom Python Objects

Using Custom Python Objects
Using Enum types

Using Enum types

Using Enum types
Using Flyte Pickle

Using Flyte Pickle

Using Flyte Pickle

Gallery generated by Sphinx-Gallery