DefaultParamsWriter

class pyspark.ml.util.DefaultParamsWriter(instance)[source]

Specialization of MLWriter for Params types

Class for writing Estimators and Transformers whose parameters are JSON-serializable.

New in version 2.3.0.

Methods

Attributes

Methods Documentation

overwrite()

Overwrites if the output path already exists.

save(path)

Save the ML instance to the input path.

saveImpl(path)[source]

save() handles overwriting and then calls this method. Subclasses should override this method to implement the actual saving of the instance.

static saveMetadata(instance, path, sc, extraMetadata=None, paramMap=None)[source]

Saves metadata + Params to: path + “/metadata”

  • class

  • timestamp

  • sparkVersion

  • uid

  • paramMap

  • defaultParamMap (since 2.4.0)

  • (optionally, extra metadata)

Parameters
  • extraMetadata – Extra metadata to be saved at same level as uid, paramMap, etc.

  • paramMap – If given, this is saved in the “paramMap” field.

session(sparkSession)

Sets the Spark Session to use for saving/loading.

Attributes Documentation

sc

Returns the underlying SparkContext.

sparkSession

Returns the user-specified Spark Session or the default.