flytekitplugins.spark.SparkDataFrameSchemaWriter#

class flytekitplugins.spark.SparkDataFrameSchemaWriter(to_path, cols, fmt)[source]#

Implements how SparkDataFrame should be written to using open method of FlyteSchema

Methods

write(*dfs, **kwargs)[source]#
Parameters

dfs (pyspark.sql.dataframe.DataFrame) –

Attributes

column_names#
to_path#