Extend Flyte and Available Extenstions

How to extend Flyte

Flyte as platform was designed with extensibility as a core primitive. Flyte is essentially an integration framework and hence extensibility is possible through-out the system. The following sections will guide you through writing your own extensions - either private or public (contribute back to the community).

• When & How to Extend Flyte
• Extend flytekit (python)
• Implement Backend Extensions (advanced)

Available Extensions

Following is a list of maintained plugins for Flyte and guides on how to install / use them.

• Run Spark on your Kubernetes Cluster
• K8s Pods
• Query SQLite3 databases -> DataFrames
• Use Pandera to Enforce Type safety in DataFrames
• Use Papermill notebooks as tasks
• BYOC Hive
• AWS Plugins
• Kubeflow Plugins