pyspark.RDDBarrier

class pyspark.RDDBarrier(rdd)[source]

Note

Experimental

Wraps an RDD in a barrier stage, which forces Spark to launch tasks of this stage together. RDDBarrier instances are created by RDD.barrier().

New in version 2.4.0.

__init__(rdd)[source]

Initialize self. See help(type(self)) for accurate signature.

Methods