Flytekit StructuredDataset#

StructuredDataset([dataframe, uri, metadata])

This is the user facing StructuredDataset class.

StructuredDatasetEncoder(python_type, protocol)

Extend this abstract class, implement the encode function, and register your concrete class with the StructuredDatasetTransformerEngine class in order for the core flytekit type engine to handle dataframe libraries.

StructuredDatasetDecoder(python_type, protocol)

Extend this abstract class, implement the decode function, and register your concrete class with the StructuredDatasetTransformerEngine class in order for the core flytekit type engine to handle dataframe libraries.

StructuredDatasetTransformerEngine()

Think of this transformer as a higher-level meta transformer that is used for all the dataframe types.