Spark API reference#
This package contains things that are useful when extending Flytekit.
|
Optionally creates a new spark session and returns it. |
|
Use this to configure a SparkContext for a your task. |
|
Implements how SparkDataFrame should be read using the |
|
Implements how SparkDataFrame should be written to using |
Transforms Spark DataFrame's to and from a Schema (typed/untyped) |