Memory Machine Cloud agent#
MemVerge Memory Machine Cloud (MMCloud)—available on AWS, GCP, and AliCloud—empowers users to continuously optimize cloud resources during runtime, safely execute stateful tasks on spot instances, and monitor resource usage in real time. These capabilities make it an excellent fit for long-running batch workloads. Flyte can be integrated with MMCloud, allowing you to execute Flyte tasks using MMCloud.
Installation#
To install the agent, run the following command:
pip install flytekitplugins-mmcloud
To get started with Memory Machine Cloud, see the Memory Machine Cloud user guide.
Example usage#
For a usage example, see Memory Machine Cloud agent example usage.
Local testing#
To test the MMCloud agent locally, create a class for the agent task that inherits from AsyncAgentExecutorMixin. This mixin can handle asynchronous tasks and allows flytekit to mimic FlytePropeller’s behavior in calling the agent. For more information, see “Testing agents locally”.
Note
In some cases, you will need to store credentials in your local environment when testing locally.
Flyte deployment configuration#
Note
If you are using a managed deployment of Flyte, you will need to contact your deployment administrator to configure agents in your deployment.
To enable the Memory Machine Cloud agent in your Flyte deployment, see the MMCloud agent setup guide.