Contents Menu Expand Light mode Dark mode Auto light/dark mode
Logo
Flyte
Getting Started
User Guide
Tutorials
Integrations
Deployment
API Reference
Concepts
Community
flyte.org
Logo
Flyte
  • Getting Started
  • User Guide
  • Tutorials
  • Concepts
  • Deployment
  • API Reference
  • Community

Getting Started

  • Introduction to Flyte
  • Flyte Fundamentals
    • Tasks, Workflows and LaunchPlans
    • Creating a Flyte Project
    • Registering Workflows
    • Running and Scheduling Workflows
    • Visualizing Artifacts
    • Optimizing Tasks
    • Extending Flyte
  • Core Use Cases
    • Data Engineering
    • Machine Learning
    • Analytics

User Guide

  • User Guide
  • Environment Setup
  • Basics
    • Hello World
    • Tasks
    • Workflows
    • Imperative Workflows
    • Add Docstrings to Workflows
    • Launch Plans
    • Flyte Decks
    • Caching
    • Run Bash Scripts Using ShellTask
    • Reference Task
    • Working With Files
    • Working With Folders
    • Named Outputs
    • Decorating Tasks
    • Decorating Workflows
    • Cache Serializing
  • Control Flow
    • Conditions
    • Chain Flyte Entities
    • SubWorkflows
    • Dynamic Workflows
      • Blog Post
    • Map Tasks
      • Blog Post
    • Intratask Checkpoints
    • Implementing Merge Sort
  • Type System
    • Flyte and Python Types
    • Using Schemas
    • Structured Dataset
    • Typed Columns in a Schema
    • PyTorch Types
    • Using Custom Python Objects
    • Using Enum types
    • Using Flyte Pickle
  • Testing
    • Mock Tasks for Testing
  • Containerization
    • Using Raw Containers
    • Multiple Container Images in a Single Workflow
    • Using Secrets in a Task
    • Using Spot/Preemptible Instances
    • Adding Workflow Labels and Annotations
  • Remote Access
    • Creating a New Project
    • Running a Task
    • Running a Workflow
    • Running a Launchplan
    • Inspecting Workflow and Task Executions
    • Debugging Workflow and Task Executions
  • Production Config
    • Deploying Workflows - Registration
    • Customizing Task Resources
    • Notifications
    • Configuring Logging Links in UI
    • Configuring Flyte to Access GPUs
  • Scheduling Workflows
    • Scheduling Workflows Example
  • Extending Flyte
    • Writing Custom Flyte Types
    • Pre-built Container Task Plugin
    • User Container Task Plugin
    • Writing Backend Extensions
    • Container Interface
  • Building Large Apps
    • Setup a Project
    • Deploy to the Cloud
    • Iterate and Re-deploy
  • Example Contribution Guide

Tutorials

  • Tutorials
  • Model Training
    • Diabetes Classification
      • Train and Validate a Diabetes Classification XGBoost Model
    • House Price Regression
      • Predicting House Price in a Region Using XGBoost
      • Predicting House Price in Multiple Regions Using XGBoost and Dynamic Workflows
    • MNIST Classification With PyTorch and W&B
      • Single Node, Single GPU Training
      • Single Node, Multi GPU Training
    • NLP Processing
      • Word Embeddings and Topic Modelling with Gensim
    • Forecasting Rossman Store Sales with Horovod and Spark
      • Blog Post
      • Data-Parallel Distributed Training Using Horovod on Spark
  • Feature Engineering
    • EDA, Feature Engineering, and Modeling With Papermill
      • Flyte Pipeline in One Jupyter Notebook
      • EDA and Feature Engineering in Jupyter Notebook and Modeling in a Flyte Task
      • Supermarket Regression 2 Notebook
      • Supermarket Regression Notebook
      • EDA and Feature Engineering in One Jupyter Notebook and Modeling in the Other
      • Supermarket Regression 1 Notebook
    • Feast Integration
      • Blog Post
      • Feature Engineering Tasks
      • Flyte Pipeline with Feast
      • How to Trigger the Feast Workflow using FlyteRemote
  • Bioinformatics
    • Nucleotide Sequence Querying with BLASTX
      • BLASTX Example
  • Flytelab
    • Weather Forecasting
      • Github Repo
      • Blog Post

Integrations

  • Integrations
  • SQL
    • Sqlite3
    • SQLAlchemy
  • Great Expectations
    • Blog Post
    • Task Example
    • Type Example
  • Papermill
    • Jupyter Notebook Tasks
  • Pandera
    • Basic Schema Example
    • Validating and Testing Machine Learning Pipelines
  • Modin
    • KNN Classifier
  • Dolt
    • Blog Post
    • Quickstart
    • Dolt Branches
  • whylogs
    • whylogs Example
  • ONNX
    • PyTorch Example
    • TensorFlow Example
    • ScikitLearn Example
  • Kubernetes Pods
    • Pod Example
  • Kubernetes Dask Jobs
    • Writing a Dask Task
  • Kubernetes Spark Jobs
    • Writing a PySpark Task
    • Converting a Spark DataFrame to a Pandas DataFrame
  • Kubeflow Pytorch
    • Distributed Pytorch
  • Kubeflow TensorFlow
    • Distributed TensorFlow Training
  • MPI Operator
    • MPIJob Example
  • KubeRay
    • Blog Post
    • Ray Tasks
  • AWS Sagemaker Training
    • Built-in Sagemaker Algorithms
    • Custom Sagemaker Algorithms
  • AWS Sagemaker Pytorch
    • Distributed Pytorch on Sagemaker
  • AWS Athena
    • Athena Query
  • AWS Batch
    • AWS Batch
  • Hive
    • Hive Tasks
  • Snowflake
    • Snowflake Query
  • BigQuery
    • BigQuery Query
  • Airflow Provider
    • Blog Post
    • FlyteOperator Example
  v: latest
Versions
latest
stable
Downloads
On Read the Docs
Project Home
Builds
Flytesnacks
Back to top
Edit this page

Tag: Data#

With this tag

  • EDA, Feature Engineering, and Modeling With Papermill
  • Feast Integration
  • House Price Regression
  • Working With Files
  • Working With Folders
  • Structured Dataset
  • Typed Columns in a Schema
  • AWS Athena
  • AWS Batch
  • Hive
  • Snowflake
  • Dolt
  • Great Expectations
  • Pandera
  • SQL
  • whylogs
  • BigQuery
  • Kubernetes Dask Jobs
  • Kubernetes Spark Jobs
Copyright © 2022, Flyte
Made with Sphinx and @pradyunsg's Furo | Show Source