flytekit.core.data_persistence.DataPersistence#
- class flytekit.core.data_persistence.DataPersistence(name, default_prefix=None, **kwargs)[source]#
Base abstract type for all DataPersistence operations. This can be extended using the flytekitplugins architecture
Methods
- abstract construct_path(add_protocol, add_prefix, *paths)[source]#
if add_protocol is true then <protocol> is prefixed else Constructs a path in the format <base><delim>*args delim is dependent on the storage medium. each of the args is joined with the delim
- abstract get(from_path, to_path, recursive=False)[source]#
Retrieves data from from_path and writes to the given to_path (to_path is locally accessible)
- abstract put(from_path, to_path, recursive=False)[source]#
Stores data from from_path and writes to the given to_path (from_path is locally accessible)
Attributes
- default_prefix#
- name#