public class LocalFlow extends BaseFlow<java.util.Properties>
Flow
.
LocalFlow must be created through a LocalFlowConnector
instance.
If classpath paths are provided on the FlowDef
, the context classloader used to internally urn the current
Flow will be swapped out with an URLClassLoader pointing to each element.LocalFlowConnector
BaseFlow.FlowHolder
flowStats, shutdownHook, sinks, sources, stop, stopJobsOnExit, thread
CASCADING_FLOW_ID
Constructor and Description |
---|
LocalFlow(PlatformInfo platformInfo,
java.util.Map<java.lang.Object,java.lang.Object> properties,
java.util.Properties config,
FlowDef flowDef) |
Modifier and Type | Method and Description |
---|---|
protected java.lang.Thread |
createFlowThread(java.lang.String threadName) |
java.util.Properties |
getConfig()
Method getConfig returns the internal configuration object.
|
java.util.Map<java.lang.Object,java.lang.Object> |
getConfigAsProperties()
Method getConfiAsProperties converts the internal configuration object into a
Map of
key value pairs. |
java.util.Properties |
getConfigCopy()
Method getConfigCopy returns a copy of the internal configuration object.
|
FlowProcess<java.util.Properties> |
getFlowProcess() |
protected int |
getMaxNumParallelSteps() |
java.lang.String |
getProperty(java.lang.String key) |
protected void |
initConfig(java.util.Map<java.lang.Object,java.lang.Object> properties,
java.util.Properties parentConfig)
This method creates a new internal Config with the parentConfig as defaults using the properties to override
the defaults.
|
protected void |
internalClean(boolean stop) |
protected void |
internalShutdown() |
protected void |
internalStart() |
protected java.util.Properties |
newConfig(java.util.Properties defaultConfig) |
protected void |
setConfigProperty(java.util.Properties properties,
java.lang.Object key,
java.lang.Object value) |
boolean |
stepsAreLocal()
Method jobsAreLocal returns true if all jobs are executed in-process as a single map and reduce task.
|
addListener, addStepListener, areSinksStale, areSourcesNewer, cleanup, complete, createConfig, deleteCheckpointsIfNotUpdate, deleteCheckpointsIfReplace, deleteSinks, deleteSinksIfNotUpdate, deleteSinksIfReplace, deleteTrapsIfNotUpdate, deleteTrapsIfReplace, fireOnCompleted, fireOnStarting, fireOnStopping, fireOnThrowable, getCascadeID, getCascadingServices, getCheckpointNames, getCheckpoints, getCheckpointsCollection, getClassPath, getFieldsFor, getFlowSession, getFlowSkipStrategy, getFlowStats, getFlowSteps, getFlowStepStrategy, getHolder, getID, getName, getPlatformInfo, getRunID, getSink, getSink, getSinkModified, getSinkNames, getSinks, getSinksCollection, getSource, getSourceNames, getSources, getSourcesCollection, getSpawnStrategy, getStats, getSubmitPriority, getTags, getTrapNames, getTraps, getTrapsCollection, handleExecutorShutdown, hasListeners, hasStepListeners, initFromProperties, initialize, initializeNewJobsMap, initSteps, internalStopAllJobs, isSkipFlow, isStopJobsOnExit, logInfo, openSink, openSink, openSource, openSource, openTapForRead, openTapForWrite, openTrap, openTrap, prepare, presentSinkFields, presentSourceFields, registerShutdownHook, removeListener, removeStepListener, resourceExists, retrieveSinkFields, retrieveSourceFields, setCascade, setCheckpoints, setFlowSkipStrategy, setFlowStepGraph, setFlowStepStrategy, setName, setSinks, setSources, setSpawnStrategy, setSubmitPriority, setTraps, start, stop, toString, updateSchemes, writeDOT, writeStepsDOT
public LocalFlow(PlatformInfo platformInfo, java.util.Map<java.lang.Object,java.lang.Object> properties, java.util.Properties config, FlowDef flowDef)
protected void initConfig(java.util.Map<java.lang.Object,java.lang.Object> properties, java.util.Properties parentConfig)
BaseFlow
initConfig
in class BaseFlow<java.util.Properties>
properties
- of type MapparentConfig
- of type Configprotected void setConfigProperty(java.util.Properties properties, java.lang.Object key, java.lang.Object value)
setConfigProperty
in class BaseFlow<java.util.Properties>
protected java.util.Properties newConfig(java.util.Properties defaultConfig)
public java.util.Properties getConfig()
Flow
FlowConnector
for setting
default properties visible to children. Or see FlowStepStrategy
for setting properties on
individual steps before they are executed.public java.util.Properties getConfigCopy()
Flow
public java.util.Map<java.lang.Object,java.lang.Object> getConfigAsProperties()
Flow
Map
of
key value pairs.public java.lang.String getProperty(java.lang.String key)
public FlowProcess<java.util.Properties> getFlowProcess()
protected void internalStart()
internalStart
in class BaseFlow<java.util.Properties>
protected java.lang.Thread createFlowThread(java.lang.String threadName)
createFlowThread
in class BaseFlow<java.util.Properties>
protected void internalClean(boolean stop)
internalClean
in class BaseFlow<java.util.Properties>
public boolean stepsAreLocal()
Flow
protected int getMaxNumParallelSteps()
getMaxNumParallelSteps
in class BaseFlow<java.util.Properties>
protected void internalShutdown()
internalShutdown
in class BaseFlow<java.util.Properties>