Welcome to Flyte!#

The highly scalable and flexible workflow orchestrator that unifies data, ML and analytics.

Linux Foundation GitHub Repo stars Flyte Release GitHub Test Status GitHub Sandbox Status Completed Milestones Flytekit Downloads Flyte Slack License

Flyte is an open-source, Kubernetes-native workflow orchestrator implemented in Go. It enables highly concurrent, scalable and reproducible workflows for data processing, machine learning and analytics.

Created at Lyft in collaboration with Spotify, Freenome, and many others, Flyte provides first-class support for Python, Java, and Scala. Data Scientists and ML Engineers in the industry use Flyte to create:

  • Data pipelines for processing petabyte-scale data.

  • Analytics workflows for business and finance use cases.

  • Machine learning pipelines for logistics, image processing, and cancer diagnostics.

Learn Flyte#

The following guides will take you through Flyte, whether you want to write workflows, deploy the Flyte platform to your K8s cluster, or extend and contribute its architecture and design. You can also access the docs pages by tag.

🔤 Introduction to Flyte

Get your first workflow running, learn about the Flyte development lifecycle and core use cases.

📖 User Guide

A comprehensive view of Flyte’s functionality for data and ML practitioners.

📚 Tutorials

End-to-end examples of Flyte for data/feature engineering, machine learning, bioinformatics, and more.

🔌 Integrations

Leverage a rich ecosystem of third-party tools and libraries to make your Flyte workflows even more effective.

🚀 Deployment Guide

Guides for platform engineers to deploy and maintain a Flyte cluster on your own infrastructure.

🧠 Concepts

Dive deep into all of Flyte’s concepts, from tasks and workflows to the underlying Flyte scheduler.

API Reference#

Below are the API reference to the different components of Flyte:

Flytekit

Flyte’s official Python SDK.

FlyteCTL

Flyte’s command-line interface for interacting with a Flyte cluster.

FlyteIDL

Flyte’s core specification language.

Get Help#

Have questions or need support? The best way to reach us is through Slack:

🗓️ Resources

Find resources for office hours, newsletter, and slack.

🤔 Ask the Community

Ask anything related to Flyte and get a response within a few hours.

👋 Introduce yourself

Tell us about yourself. We’d love to know about you and what brings you to Flyte.

💭 Share ideas

Share any suggestions or feedback you have on how to make Flyte better.

🛠 Get help with deploment

If you need any help with Flyte deployment, hit us up.