flytekitplugins.inference.Ollama

class flytekitplugins.inference.Ollama(*, model, image='ollama/ollama', port=11434, cpu=1, gpu=1, mem='15Gi', download_inputs_mem='500Mi', download_inputs_cpu=2)

Methods

Parameters:

• model (Model)

• image (str)

• port (int)

• cpu (int)

• gpu (int)

• mem (str)

• download_inputs_mem (str)

• download_inputs_cpu (int)

setup_ollama_pod_template()

Attributes

base_url

pod_template