Hide navigation sidebar

Hide table of contents sidebar

📢 This is the old documentation for Flyte. Please visit the new documentation here.

Getting Started

Toggle site navigation sidebar

Toggle table of contents sidebar

Getting Started
User Guide
Tutorials
Concepts
Deployment
API Reference
Community

Getting Started

Introduction to Flyte
Quickstart guide
Getting started with workflow development
Flyte fundamentals
Core use cases

User Guide

📖 User Guide
🌳 Environment Setup
🔤 Basics
⌨️ Data Types and IO
🔮 Advanced Composition
🧩 Customizing Dependencies
🏡 Development Lifecycle
⚗️ Testing
🚢 Productionizing
🏗 Extending
📝 Contributing

Tutorials

Tutorials
Model Training
Toggle child pages in navigation
- Diabetes Classification
  Toggle child pages in navigation
  - Train and Validate a Diabetes Classification XGBoost Model
- House Price Regression
  Toggle child pages in navigation
  - Predicting House Price in a Region Using XGBoost
  - Predicting House Price in Multiple Regions Using XGBoost and Dynamic Workflows
- MNIST Classification With PyTorch and W&B
  Toggle child pages in navigation
  - Single Node, Single GPU Training
  - Single Node, Multi GPU Training
- NLP Processing
  Toggle child pages in navigation
  - Word Embeddings and Topic Modelling with Gensim
- Forecasting Rossman Store Sales with Horovod and Spark
  Toggle child pages in navigation
  - Data-Parallel Distributed Training Using Horovod on Spark
Feature Engineering
Toggle child pages in navigation
- EDA, Feature Engineering, and Modeling With Papermill
  Toggle child pages in navigation
- Feast Integration
  Toggle child pages in navigation
Bioinformatics
Toggle child pages in navigation
- Nucleotide Sequence Querying with BLASTX
  Toggle child pages in navigation
  - BLASTX Example
Flytelab
Toggle child pages in navigation
- Weather Forecasting

Integrations

Integrations
Airflow agent
Toggle child pages in navigation
- Airflow agent example usage
Airflow Provider
Toggle child pages in navigation
- FlyteOperator Example
AWS Athena
Toggle child pages in navigation
- Athena Query
AWS Batch
Toggle child pages in navigation
- AWS Batch
BigQuery agent
Toggle child pages in navigation
- BigQuery agent example usage
ChatGPT agent
Toggle child pages in navigation
- ChatGPT agent example usage
Dask
Toggle child pages in navigation
- Running a Dask Task
Databricks agent
Toggle child pages in navigation
- Running Spark on Databricks
DBT
Toggle child pages in navigation
- dbt example
Dolt
Toggle child pages in navigation
- Quickstart
- Dolt Branches
DuckDB
Toggle child pages in navigation
- DuckDB Example
FlyteInteractive
Toggle child pages in navigation
- FlyteInteractive Vscode Decorator
- FlyteInteractive Jupyter Decorator
Great Expectations
Toggle child pages in navigation
- Task Example
- Type Example
Hive
Toggle child pages in navigation
- Hive Tasks
Kubernetes Pods
Toggle child pages in navigation
- Pod Example
MLFlow
Toggle child pages in navigation
- MLflow Example
Memory Machine Cloud agent
Toggle child pages in navigation
- Memory Machine Cloud agent example usage
Modin
Toggle child pages in navigation
- KNN Classifier
MPI
Toggle child pages in navigation
- Running Distributed Training Using Horovod and MPI
ONNX
Toggle child pages in navigation
Papermill
Toggle child pages in navigation
- Jupyter Notebook Tasks
- Simple Papermill Notebook
Pandera
Toggle child pages in navigation
- Basic Schema Example
- Validating and Testing Machine Learning Pipelines
PyTorch Distributed
Toggle child pages in navigation
- Run PyTorch Distributed
Ray
Toggle child pages in navigation
- Running Ray Tasks
AWS SageMaker Inference Agent
Toggle child pages in navigation
- Deploy and serve an XGBoost model on AWS SageMaker using FastAPI
Sensor
Toggle child pages in navigation
- File Sensor
Snowflake agent
Toggle child pages in navigation
- Querying data in Snowflake
Spark
Toggle child pages in navigation
- Running a Spark Task
- Converting a Spark DataFrame to a Pandas DataFrame
SQL
Toggle child pages in navigation
- Sqlite3
- SQLAlchemy
TensorFlow Distributed
Toggle child pages in navigation
- Run Distributed TensorFlow Training
WhyLogs
Toggle child pages in navigation
- whylogs Example

Deprecated integrations

Deprecated integrations
BigQuery plugin
Toggle child pages in navigation
- BigQuery example query
Databricks plugin
Toggle child pages in navigation
- Running Spark on Databricks
Memory Machine Cloud plugin
Toggle child pages in navigation
- Memory Machine Cloud
Snowflake plugin
Toggle child pages in navigation
- Querying data in Snowflake

Tags

Example Tags
Toggle child pages in navigation

Flytesnacks

Toggle table of contents sidebar

Example Tags#

Querying data in Snowflake

Copyright © 2023, Flyte

Made with Sphinx and @pradyunsg's Furo | Show Source