Flyte Admin Configuration

Section: auth

httpAuthorizationHeader (string)

Default Value:

flyte-authorization

grpcAuthorizationHeader (string)

Default Value:

flyte-authorization

disableForHttp (bool)

Disables auth enforcement on HTTP Endpoints.

Default Value:

"false"

disableForGrpc (bool)

Disables auth enforcement on Grpc Endpoints.

Default Value:

"false"

authorizedUris ([]config.URL)

Optional: Defines the set of URIs that clients are allowed to visit the service on. If set, the system will attempt to match the incoming host to the first authorized URIs and use that (including the scheme) when generating metadata endpoints and when validating audience and issuer claims. If not provided, the urls will be deduced based on the request url and the ‘secure’ setting.

Default Value:

[]

userAuth (config.UserAuthConfig)

Defines Auth options for users.

Default Value:

cookieBlockKeySecretName: cookie_block_key
cookieHashKeySecretName: cookie_hash_key
openId:
  baseUrl: ""
  clientId: ""
  clientSecretFile: ""
  clientSecretName: oidc_client_secret
  scopes: []
redirectUrl: /console

appAuth (config.OAuth2Options)

Defines Auth options for apps. UserAuth must be enabled for AppAuth to work.

Default Value:

authServerType: Self
externalAuthServer:
  allowedAudience: []
  baseUrl: ""
  metadataUrl: ""
selfAuthServer:
  accessTokenLifespan: 30m0s
  authorizationCodeLifespan: 5m0s
  claimSymmetricEncryptionKeySecretName: claim_symmetric_key
  issuer: ""
  oldTokenSigningRSAKeySecretName: token_rsa_key_old.pem
  refreshTokenLifespan: 1h0m0s
  staticClients:
    flyte-cli:
      audience: null
      grant_types:
      - refresh_token
      - authorization_code
      id: flyte-cli
      public: true
      redirect_uris:
      - http://localhost:53593/callback
      - http://localhost:12345/callback
      response_types:
      - code
      - token
      scopes:
      - all
      - offline
      - access_token
    flytectl:
      audience: null
      grant_types:
      - refresh_token
      - authorization_code
      id: flytectl
      public: true
      redirect_uris:
      - http://localhost:53593/callback
      - http://localhost:12345/callback
      response_types:
      - code
      - token
      scopes:
      - all
      - offline
      - access_token
    flytepropeller:
      audience: null
      client_secret: JDJhJDA2JHB4czFBa0c4MUt2cmhwbWwxUWlMU09RYVRrOWVlUHJVLzdZYWI5eTA3aDN4MFRnbGJhb1Q2
      grant_types:
      - refresh_token
      - client_credentials
      id: flytepropeller
      public: false
      redirect_uris:
      - http://localhost:3846/callback
      response_types:
      - token
      scopes:
      - all
      - offline
      - access_token
  tokenSigningRSAKeySecretName: token_rsa_key.pem
thirdPartyConfig:
  flyteClient:
    clientId: flytectl
    redirectUri: http://localhost:53593/callback
    scopes: []

config.OAuth2Options

authServerType (int)

Default Value:

Self

selfAuthServer (config.AuthorizationServer)

Authorization Server config to run as a service. Use this when using an IdP that does not offer a custom OAuth2 Authorization Server.

Default Value:

accessTokenLifespan: 30m0s
authorizationCodeLifespan: 5m0s
claimSymmetricEncryptionKeySecretName: claim_symmetric_key
issuer: ""
oldTokenSigningRSAKeySecretName: token_rsa_key_old.pem
refreshTokenLifespan: 1h0m0s
staticClients:
  flyte-cli:
    audience: null
    grant_types:
    - refresh_token
    - authorization_code
    id: flyte-cli
    public: true
    redirect_uris:
    - http://localhost:53593/callback
    - http://localhost:12345/callback
    response_types:
    - code
    - token
    scopes:
    - all
    - offline
    - access_token
  flytectl:
    audience: null
    grant_types:
    - refresh_token
    - authorization_code
    id: flytectl
    public: true
    redirect_uris:
    - http://localhost:53593/callback
    - http://localhost:12345/callback
    response_types:
    - code
    - token
    scopes:
    - all
    - offline
    - access_token
  flytepropeller:
    audience: null
    client_secret: JDJhJDA2JHB4czFBa0c4MUt2cmhwbWwxUWlMU09RYVRrOWVlUHJVLzdZYWI5eTA3aDN4MFRnbGJhb1Q2
    grant_types:
    - refresh_token
    - client_credentials
    id: flytepropeller
    public: false
    redirect_uris:
    - http://localhost:3846/callback
    response_types:
    - token
    scopes:
    - all
    - offline
    - access_token
tokenSigningRSAKeySecretName: token_rsa_key.pem

externalAuthServer (config.ExternalAuthorizationServer)

External Authorization Server config.

Default Value:

allowedAudience: []
baseUrl: ""
metadataUrl: ""

thirdPartyConfig (config.ThirdPartyConfigOptions)

Defines settings to instruct flyte cli tools (and optionally others) on what config to use to setup their client.

Default Value:

flyteClient:
  clientId: flytectl
  redirectUri: http://localhost:53593/callback
  scopes: []

config.AuthorizationServer

issuer (string)

Defines the issuer to use when issuing and validating tokens. The default value is https://<requestUri.HostAndPort>/

Default Value:

""

accessTokenLifespan (config.Duration)

Defines the lifespan of issued access tokens.

Default Value:

30m0s

refreshTokenLifespan (config.Duration)

Defines the lifespan of issued access tokens.

Default Value:

1h0m0s

authorizationCodeLifespan (config.Duration)

Defines the lifespan of issued access tokens.

Default Value:

5m0s

claimSymmetricEncryptionKeySecretName (string)

OPTIONAL: Secret name to use to encrypt claims in authcode token.

Default Value:

claim_symmetric_key

tokenSigningRSAKeySecretName (string)

OPTIONAL: Secret name to use to retrieve RSA Signing Key.

Default Value:

token_rsa_key.pem

oldTokenSigningRSAKeySecretName (string)

OPTIONAL: Secret name to use to retrieve Old RSA Signing Key. This can be useful during key rotation to continue to accept older tokens.

Default Value:

token_rsa_key_old.pem

staticClients (map[string]*fosite.DefaultClient)

Default Value:

flyte-cli:
  audience: null
  grant_types:
  - refresh_token
  - authorization_code
  id: flyte-cli
  public: true
  redirect_uris:
  - http://localhost:53593/callback
  - http://localhost:12345/callback
  response_types:
  - code
  - token
  scopes:
  - all
  - offline
  - access_token
flytectl:
  audience: null
  grant_types:
  - refresh_token
  - authorization_code
  id: flytectl
  public: true
  redirect_uris:
  - http://localhost:53593/callback
  - http://localhost:12345/callback
  response_types:
  - code
  - token
  scopes:
  - all
  - offline
  - access_token
flytepropeller:
  audience: null
  client_secret: JDJhJDA2JHB4czFBa0c4MUt2cmhwbWwxUWlMU09RYVRrOWVlUHJVLzdZYWI5eTA3aDN4MFRnbGJhb1Q2
  grant_types:
  - refresh_token
  - client_credentials
  id: flytepropeller
  public: false
  redirect_uris:
  - http://localhost:3846/callback
  response_types:
  - token
  scopes:
  - all
  - offline
  - access_token

config.Duration

Duration (int64)

Default Value:

30m0s

config.ExternalAuthorizationServer

baseUrl (config.URL)

This should be the base url of the authorization server that you are trying to hit. With Okta for instance, it will look something like https://company.okta.com/oauth2/abcdef123456789/

Default Value:

""

allowedAudience ([]string)

Optional: A list of allowed audiences. If not provided, the audience is expected to be the public Uri of the service.

Default Value:

[]

metadataUrl (config.URL)

Optional: If the server doesn’t support /.well-known/oauth-authorization-server, you can set a custom metadata url here.’

Default Value:

""

config.URL

URL (url.URL)

Default Value:

ForceQuery: false
Fragment: ""
Host: ""
Opaque: ""
Path: ""
RawFragment: ""
RawPath: ""
RawQuery: ""
Scheme: ""
User: null

url.URL

Scheme (string)

Default Value:

""

Opaque (string)

Default Value:

""

User (url.Userinfo)

Default Value:

null

Host (string)

Default Value:

""

Path (string)

Default Value:

""

RawPath (string)

Default Value:

""

ForceQuery (bool)

Default Value:

"false"

RawQuery (string)

Default Value:

""

Fragment (string)

Default Value:

""

RawFragment (string)

Default Value:

""

config.ThirdPartyConfigOptions

flyteClient (config.FlyteClientConfig)

Default Value:

clientId: flytectl
redirectUri: http://localhost:53593/callback
scopes: []

config.FlyteClientConfig

clientId (string)

public identifier for the app which handles authorization for a Flyte deployment

Default Value:

flytectl

redirectUri (string)

This is the callback uri registered with the app which handles authorization for a Flyte deployment

Default Value:

http://localhost:53593/callback

scopes ([]string)

Recommended scopes for the client to request.

Default Value:

[]

config.UserAuthConfig

redirectUrl (config.URL)

Default Value:

/console

openId (config.OpenIDOptions)

OpenID Configuration for User Auth

Default Value:

baseUrl: ""
clientId: ""
clientSecretFile: ""
clientSecretName: oidc_client_secret
scopes: []

cookieHashKeySecretName (string)

OPTIONAL: Secret name to use for cookie hash key.

Default Value:

cookie_hash_key

cookieBlockKeySecretName (string)

OPTIONAL: Secret name to use for cookie block key.

Default Value:

cookie_block_key

config.OpenIDOptions

clientId (string)

Default Value:

""

clientSecretName (string)

Default Value:

oidc_client_secret

clientSecretFile (string)

Default Value:

""

baseUrl (config.URL)

Default Value:

""

scopes ([]string)

Default Value:

[]

Section: cluster_resources

templatePath (string)

Default Value:

""

templateData (map[string]interfaces.DataSource)

Default Value:

{}

refreshInterval (config.Duration)

Default Value:

1m0s

customData (map[string]map[string]interfaces.DataSource)

Default Value:

{}

Section: clusters

clusterConfigs ([]interfaces.ClusterConfig)

Default Value:

null

labelClusterMap (map[string][]interfaces.ClusterEntity)

Default Value:

null

Section: database

host (string)

Default Value:

postgres

port (int)

Default Value:

"5432"

dbname (string)

Default Value:

postgres

username (string)

Default Value:

postgres

password (string)

Default Value:

""

passwordPath (string)

Default Value:

""

options (string)

Default Value:

sslmode=disable

debug (bool)

Default Value:

"false"

Section: domains

id (string)

Default Value:

development

name (string)

Default Value:

development

Section: externalevents

enable (bool)

Default Value:

"false"

type (string)

Default Value:

local

aws (interfaces.AWSConfig)

Default Value:

region: ""

gcp (interfaces.GCPConfig)

Default Value:

projectId: ""

eventsPublisher (interfaces.EventsPublisherConfig)

Default Value:

eventTypes: null
topicName: ""

reconnectAttempts (int)

Default Value:

"0"

reconnectDelaySeconds (int)

Default Value:

"0"

interfaces.AWSConfig

region (string)

Default Value:

""

interfaces.EventsPublisherConfig

topicName (string)

Default Value:

""

eventTypes ([]string)

Default Value:

null

interfaces.GCPConfig

projectId (string)

Default Value:

""

Section: flyteadmin

roleNameKey (string)

Default Value:

""

metricsScope (string)

Default Value:

'flyte:'

profilerPort (int)

Default Value:

"10254"

metadataStoragePrefix ([]string)

Default Value:

- metadata
- admin

eventVersion (int)

Default Value:

"2"

asyncEventsBufferSize (int)

Default Value:

"100"

maxParallelism (int32)

Default Value:

"25"

Section: logger

show-source (bool)

Includes source code location in logs.

Default Value:

"false"

mute (bool)

Mutes all logs regardless of severity. Intended for benchmarks/tests only.

Default Value:

"false"

level (int)

Sets the minimum logging level.

Default Value:

"4"

formatter (logger.FormatterConfig)

Sets logging format.

Default Value:

type: json

logger.FormatterConfig

type (string)

Sets logging format type.

Default Value:

json

Section: namespace_mapping

mapping (string)

Default Value:

""

template (string)

Default Value:

'{{ project }}-{{ domain }}'

templateData (map[string]interfaces.DataSource)

Default Value:

null

Section: notifications

type (string)

Default Value:

local

region (string)

Default Value:

""

aws (interfaces.AWSConfig)

Default Value:

region: ""

gcp (interfaces.GCPConfig)

Default Value:

projectId: ""

publisher (interfaces.NotificationsPublisherConfig)

Default Value:

topicName: ""

processor (interfaces.NotificationsProcessorConfig)

Default Value:

accountId: ""
queueName: ""

emailer (interfaces.NotificationsEmailerConfig)

Default Value:

body: ""
emailServerConfig:
  apiKeyEnvVar: ""
  apiKeyFilePath: ""
  serviceName: ""
sender: ""
subject: ""

reconnectAttempts (int)

Default Value:

"0"

reconnectDelaySeconds (int)

Default Value:

"0"

interfaces.NotificationsEmailerConfig

emailServerConfig (interfaces.EmailServerConfig)

Default Value:

apiKeyEnvVar: ""
apiKeyFilePath: ""
serviceName: ""

subject (string)

Default Value:

""

sender (string)

Default Value:

""

body (string)

Default Value:

""

interfaces.EmailServerConfig

serviceName (string)

Default Value:

""

apiKeyEnvVar (string)

Default Value:

""

apiKeyFilePath (string)

Default Value:

""

interfaces.NotificationsProcessorConfig

queueName (string)

Default Value:

""

accountId (string)

Default Value:

""

interfaces.NotificationsPublisherConfig

topicName (string)

Default Value:

""

Section: plugins

enabled-plugins ([]string)

List of enabled plugins, default value is to enable all plugins.

Default Value:

- '*'

catalogcache (catalog.Config)

Default Value:

reader:
  maxItems: 1000
  maxRetries: 3
  workers: 10
writer:
  maxItems: 1000
  maxRetries: 3
  workers: 10

k8s (config.K8sPluginConfig)

Default Value:

co-pilot:
  cpu: 500m
  default-input-path: /var/flyte/inputs
  default-output-path: /var/flyte/outputs
  image: cr.flyte.org/flyteorg/flytecopilot:v0.0.9
  input-vol-name: flyte-inputs
  memory: 128Mi
  name: flyte-copilot-
  output-vol-name: flyte-outputs
  start-timeout: 1m0s
  storage: ""
create-container-error-grace-period: 3m0s
default-annotations:
  cluster-autoscaler.kubernetes.io/safe-to-evict: "false"
default-cpus: "1"
default-env-vars: null
default-env-vars-from-env: null
default-labels: null
default-memory: 1Gi
default-node-selector: null
default-tolerations: null
delete-resource-on-finalize: false
gpu-resource-name: nvidia.com/gpu
inject-finalizer: false
interruptible-node-selector: null
interruptible-node-selector-requirement: null
interruptible-tolerations: null
non-interruptible-node-selector-requirement: null
resource-tolerations: null
scheduler-name: ""

catalog.Config

reader (workqueue.Config)

Catalog reader workqueue config. Make sure the index cache must be big enough to accommodate the biggest array task allowed to run on the system.

Default Value:

maxItems: 1000
maxRetries: 3
workers: 10

writer (workqueue.Config)

Catalog writer workqueue config. Make sure the index cache must be big enough to accommodate the biggest array task allowed to run on the system.

Default Value:

maxItems: 1000
maxRetries: 3
workers: 10

workqueue.Config

workers (int)

Number of concurrent workers to start processing the queue.

Default Value:

"10"

maxRetries (int)

Maximum number of retries per item.

Default Value:

"3"

maxItems (int)

Maximum number of entries to keep in the index.

Default Value:

"1000"

config.K8sPluginConfig

inject-finalizer (bool)

Instructs the plugin to inject a finalizer on startTask and remove it on task termination.

Default Value:

"false"

default-annotations (map[string]string)

Default Value:

cluster-autoscaler.kubernetes.io/safe-to-evict: "false"

default-labels (map[string]string)

Default Value:

null

default-env-vars (map[string]string)

Default Value:

null

default-env-vars-from-env (map[string]string)

Default Value:

null

default-cpus (resource.Quantity)

Defines a default value for cpu for containers if not specified.

Default Value:

"1"

default-memory (resource.Quantity)

Defines a default value for memory for containers if not specified.

Default Value:

1Gi

default-tolerations ([]v1.Toleration)

Default Value:

null

default-node-selector (map[string]string)

Default Value:

null

default-affinity (v1.Affinity)

Default Value:

null

scheduler-name (string)

Defines scheduler name.

Default Value:

""

interruptible-tolerations ([]v1.Toleration)

Default Value:

null

interruptible-node-selector (map[string]string)

Default Value:

null

interruptible-node-selector-requirement (v1.NodeSelectorRequirement)

Default Value:

null

non-interruptible-node-selector-requirement (v1.NodeSelectorRequirement)

Default Value:

null

resource-tolerations (map[v1.ResourceName][]v1.Toleration)

Default Value:

null

co-pilot (config.FlyteCoPilotConfig)

Co-Pilot Configuration

Default Value:

cpu: 500m
default-input-path: /var/flyte/inputs
default-output-path: /var/flyte/outputs
image: cr.flyte.org/flyteorg/flytecopilot:v0.0.9
input-vol-name: flyte-inputs
memory: 128Mi
name: flyte-copilot-
output-vol-name: flyte-outputs
start-timeout: 1m0s
storage: ""

delete-resource-on-finalize (bool)

Instructs the system to delete the resource on finalize. This ensures that no resources are kept around (potentially consuming cluster resources). This, however, will cause k8s log links to expire as soon as the resource is finalized.

Default Value:

"false"

create-container-error-grace-period (config.Duration)

Default Value:

3m0s

gpu-resource-name (string)

The name of the GPU resource to use when the task resource requests GPUs.

Default Value:

nvidia.com/gpu

config.FlyteCoPilotConfig

name (string)

Flyte co-pilot sidecar container name prefix. (additional bits will be added after this)

Default Value:

flyte-copilot-

image (string)

Flyte co-pilot Docker Image FQN

Default Value:

cr.flyte.org/flyteorg/flytecopilot:v0.0.9

default-input-path (string)

Default path where the volume should be mounted

Default Value:

/var/flyte/inputs

default-output-path (string)

Default path where the volume should be mounted

Default Value:

/var/flyte/outputs

input-vol-name (string)

Name of the data volume that is created for storing inputs

Default Value:

flyte-inputs

output-vol-name (string)

Name of the data volume that is created for storing outputs

Default Value:

flyte-outputs

start-timeout (config.Duration)

Default Value:

1m0s

cpu (string)

Used to set cpu for co-pilot containers

Default Value:

500m

memory (string)

Used to set memory for co-pilot containers

Default Value:

128Mi

storage (string)

Default storage limit for individual inputs / outputs

Default Value:

""

resource.Quantity

i (resource.int64Amount)

Default Value:

{}

d (resource.infDecAmount)

Default Value:

<nil>

s (string)

Default Value:

"1"

Format (string)

Default Value:

DecimalSI

resource.infDecAmount

Dec (inf.Dec)

Default Value:

null

resource.int64Amount

value (int64)

Default Value:

"1"

scale (int32)

Default Value:

"0"

Section: qualityofservice

tierExecutionValues (map[string]interfaces.QualityOfServiceSpec)

Default Value:

{}

defaultTiers (map[string]string)

Default Value:

{}

Section: queues

executionQueues (interfaces.ExecutionQueues)

Default Value:

[]

workflowConfigs (interfaces.WorkflowConfigs)

Default Value:

[]

Section: registration

maxWorkflowNodes (int)

Default Value:

"100"

maxLabelEntries (int)

Default Value:

"0"

maxAnnotationEntries (int)

Default Value:

"0"

workflowSizeLimit (string)

Default Value:

""

Section: remotedata

scheme (string)

Default Value:

none

region (string)

Default Value:

""

signedUrls (interfaces.SignedURL)

Default Value:

durationMinutes: 0
enabled: false
signingPrincipal: ""

maxSizeInBytes (int64)

Default Value:

"2097152"

inlineEventDataPolicy (int)

Specifies how inline execution event data should be saved in the backend

Default Value:

"0"

interfaces.SignedURL

enabled (bool)

Whether signed urls should even be returned with GetExecutionData, GetNodeExecutionData and GetTaskExecutionData response objects.

Default Value:

"false"

durationMinutes (int)

Default Value:

"0"

signingPrincipal (string)

Default Value:

""

Section: scheduler

profilerPort (config.Port)

Default Value:

10253

eventScheduler (interfaces.EventSchedulerConfig)

Default Value:

aws: null
local: {}
region: ""
scheduleNamePrefix: ""
scheduleRole: ""
scheme: local
targetName: ""

workflowExecutor (interfaces.WorkflowExecutorConfig)

Default Value:

accountId: ""
aws: null
local:
  adminRateLimit:
    burst: 10
    tps: 100
region: ""
scheduleQueueName: ""
scheme: local

reconnectAttempts (int)

Default Value:

"0"

reconnectDelaySeconds (int)

Default Value:

"0"

backoff (wait.Backoff)

Default Value:

Cap: 0
Duration: 1000000000
Factor: 2
Jitter: 0.1
Steps: 30

config.Port

port (int)

Default Value:

"10253"

interfaces.EventSchedulerConfig

scheme (string)

Default Value:

local

region (string)

Default Value:

""

scheduleRole (string)

Default Value:

""

targetName (string)

Default Value:

""

scheduleNamePrefix (string)

Default Value:

""

aws (interfaces.AWSSchedulerConfig)

Default Value:

null

local (interfaces.FlyteSchedulerConfig)

Default Value:

{}

interfaces.FlyteSchedulerConfig

interfaces.WorkflowExecutorConfig

scheme (string)

Default Value:

local

region (string)

Default Value:

""

scheduleQueueName (string)

Default Value:

""

accountId (string)

Default Value:

""

aws (interfaces.AWSWorkflowExecutorConfig)

Default Value:

null

local (interfaces.FlyteWorkflowExecutorConfig)

Default Value:

adminRateLimit:
  burst: 10
  tps: 100

interfaces.FlyteWorkflowExecutorConfig

adminRateLimit (interfaces.AdminRateLimit)

Default Value:

burst: 10
tps: 100

interfaces.AdminRateLimit

tps (float64)

Default Value:

"100"

burst (int)

Default Value:

"10"

wait.Backoff

Duration (int64)

Default Value:

1s

Factor (float64)

Default Value:

"2"

Jitter (float64)

Default Value:

"0.1"

Steps (int)

Default Value:

"30"

Cap (int64)

Default Value:

0s

Section: secrets

secrets-prefix (string)

Prefix where to look for secrets file

Default Value:

/etc/secrets

env-prefix (string)

Prefix for environment variables

Default Value:

FLYTE_SECRET_

Section: server

httpPort (int)

On which http port to serve admin

Default Value:

"0"

grpcPort (int)

On which grpc port to serve admin

Default Value:

"0"

grpcServerReflection (bool)

Enable GRPC Server Reflection

Default Value:

"false"

kube-config (string)

Path to kubernetes client config file.

Default Value:

""

master (string)

The address of the Kubernetes API server.

Default Value:

""

security (config.ServerSecurityOptions)

Default Value:

allowCors: false
allowedHeaders: []
allowedOrigins: []
auditAccess: false
secure: false
ssl:
  certificateFile: ""
  keyFile: ""
useAuth: false

thirdPartyConfig (config.ThirdPartyConfigOptions)

Deprecated please use auth.appAuth.thirdPartyConfig instead.

Default Value:

flyteClient:
  clientId: ""
  redirectUri: ""
  scopes: []

config.ServerSecurityOptions

secure (bool)

Default Value:

"false"

ssl (config.SslOptions)

Default Value:

certificateFile: ""
keyFile: ""

useAuth (bool)

Default Value:

"false"

auditAccess (bool)

Default Value:

"false"

allowCors (bool)

Default Value:

"false"

allowedOrigins ([]string)

Default Value:

[]

allowedHeaders ([]string)

Default Value:

[]

config.SslOptions

certificateFile (string)

Default Value:

""

keyFile (string)

Default Value:

""

Section: storage

type (string)

Sets the type of storage to configure [s3/minio/local/mem/stow].

Default Value:

s3

connection (storage.ConnectionConfig)

Default Value:

access-key: ""
auth-type: iam
disable-ssl: false
endpoint: ""
region: us-east-1
secret-key: ""

stow (storage.StowConfig)

Storage config for stow backend.

Default Value:

{}

container (string)

Initial container (in s3 a bucket) to create -if it doesn’t exist-.’

Default Value:

""

enable-multicontainer (bool)

If this is true, then the container argument is overlooked and redundant. This config will automatically open new connections to new containers/buckets as they are encountered

Default Value:

"false"

cache (storage.CachingConfig)

Default Value:

max_size_mbs: 0
target_gc_percent: 0

limits (storage.LimitsConfig)

Sets limits for stores.

Default Value:

maxDownloadMBs: 2

defaultHttpClient (storage.HTTPClientConfig)

Sets the default http client config.

Default Value:

headers: null
timeout: 0s

storage.CachingConfig

max_size_mbs (int)

Maximum size of the cache where the Blob store data is cached in-memory. If not specified or set to 0, cache is not used

Default Value:

"0"

target_gc_percent (int)

Sets the garbage collection target percentage.

Default Value:

"0"

storage.ConnectionConfig

endpoint (config.URL)

URL for storage client to connect to.

Default Value:

""

auth-type (string)

Auth Type to use [iam,accesskey].

Default Value:

iam

access-key (string)

Access key to use. Only required when authtype is set to accesskey.

Default Value:

""

secret-key (string)

Secret to use when accesskey is set.

Default Value:

""

region (string)

Region to connect to.

Default Value:

us-east-1

disable-ssl (bool)

Disables SSL connection. Should only be used for development.

Default Value:

"false"

storage.HTTPClientConfig

headers (map[string][]string)

Default Value:

null

timeout (config.Duration)

Sets time out on the http client.

Default Value:

0s

storage.LimitsConfig

maxDownloadMBs (int64)

Maximum allowed download size (in MBs) per call.

Default Value:

"2"

storage.StowConfig

kind (string)

Kind of Stow backend to use. Refer to github/graymeta/stow

Default Value:

""

config (map[string]string)

Configuration for stow backend. Refer to github/graymeta/stow

Default Value:

{}

Section: task_resources

defaults (interfaces.TaskResourceSet)

Default Value:

cpu: "2"
ephemeralStorage: "0"
gpu: "0"
memory: 200Mi
storage: "0"

limits (interfaces.TaskResourceSet)

Default Value:

cpu: "2"
ephemeralStorage: "0"
gpu: "1"
memory: 1Gi
storage: "0"

interfaces.TaskResourceSet

cpu (resource.Quantity)

Default Value:

"2"

gpu (resource.Quantity)

Default Value:

"0"

memory (resource.Quantity)

Default Value:

200Mi

storage (resource.Quantity)

Default Value:

"0"

ephemeralStorage (resource.Quantity)

Default Value:

"0"