MMCloud Agent

MemVerge Memory Machine Cloud (MMCloud) empowers users to continuously optimize cloud resources during runtime, safely execute stateful tasks on spot instances, and monitor resource usage in real time. These capabilities make it an excellent fit for long-running batch workloads.

This guide provides an overview of how to set up MMCloud in your Flyte deployment.

Set up MMCloud

To run a Flyte workflow with Memory Machine Cloud, you will need to deploy Memory Machine Cloud. Check out the MMCloud User Guide to get started!

By the end of this step, you should have deployed an MMCloud OpCenter.

Spin up a cluster

Flyte binaryFlyte core

You can spin up a demo cluster using the following command:

flytectl demo start

Or install Flyte using the flyte-binary helm chart.

Note

Add the Flyte chart repo to Helm if you’re installing via the Helm charts.

helm repo add flyteorg https://flyteorg.github.io/flyte

Specify agent configuration

Enable the MMCloud agent by adding the following config to the relevant YAML file(s):

tasks:
  task-plugins:
    enabled-plugins:
      - agent-service
    default-for-task-types:
      - mmcloud_task: agent-service

plugins:
  agent-service:
    agents:
      mmcloud-agent:
        endpoint: <AGENT_ENDPOINT>
        insecure: true
    supportedTaskTypes:
    - mmcloud_task
    agentForTaskTypes:
    - mmcloud_task: mmcloud-agent

Substitute <AGENT_ENDPOINT> with the endpoint of your MMCloud agent.

Upgrade the deployment

Flyte binaryFlyte core

Demo clusterHelm chart

kubectl rollout restart deployment flyte-sandbox -n flyte

Wait for the upgrade to complete. You can check the status of the deployment pods by running the following command:

kubectl get pods -n flyte

For MMCloud agent on the Flyte cluster, see MMCloud agent.