GeneralMLWriter

class pyspark.ml.util.GeneralMLWriter[source]

Utility class that can save ML instances in different formats.

New in version 2.4.0.

Methods

Attributes

Methods Documentation

format(source)[source]

Specifies the format of ML export (e.g. “pmml”, “internal”, or the fully qualified class name for export).

overwrite()

Overwrites if the output path already exists.

save(path)

Save the ML instance to the input path.

saveImpl(path)

save() handles overwriting and then calls this method. Subclasses should override this method to implement the actual saving of the instance.

session(sparkSession)

Sets the Spark Session to use for saving/loading.

Attributes Documentation

sc

Returns the underlying SparkContext.

sparkSession

Returns the user-specified Spark Session or the default.