public class Lfs extends Hfs
Tap
class that provides access to the Local File System via Hadoop.
Note that using a Lfs Tap
instance in a Flow
will force a portion of not the whole Flow to be executed
in "local" mode forcing the Flow to execute in the current JVM. Mixing with Dfs
and other Tap
types is possible, providing a means to implement complex file/data management functions.
Use Hfs
if you need a Tap instance that inherits the default FileSystem
used by Hadoop.stringPath, TEMPORARY_DIRECTORY
Constructor and Description |
---|
Lfs(Fields fields,
java.lang.String stringPath)
Deprecated.
|
Lfs(Fields fields,
java.lang.String stringPath,
SinkMode sinkMode)
Deprecated.
|
Lfs(Scheme scheme,
java.lang.String stringPath)
Constructor Lfs creates a new Lfs instance.
|
Lfs(Scheme scheme,
java.lang.String stringPath,
boolean replace)
Deprecated.
|
Lfs(Scheme scheme,
java.lang.String stringPath,
SinkMode sinkMode)
Constructor Lfs creates a new Lfs instance.
|
Modifier and Type | Method and Description |
---|---|
protected org.apache.hadoop.fs.FileSystem |
getFileSystem(org.apache.hadoop.mapred.JobConf conf) |
protected void |
setStringPath(java.lang.String stringPath) |
applySourceConfInitIdentifiers, createResource, deleteChildResource, deleteResource, getBlockSize, getChildIdentifiers, getChildIdentifiers, getCombinedInputSafeMode, getDefaultFileSystem, getDefaultFileSystemURIScheme, getFullIdentifier, getIdentifier, getLocalModeScheme, getModifiedTime, getPath, getReplication, getSize, getTemporaryDirectory, getTempPath, getURIScheme, getUseCombinedInput, isDirectory, makeTemporaryPathDirString, makeURIScheme, openForRead, openForWrite, resourceExists, setTemporaryDirectory, setUriScheme, sinkConfInit, sourceConfInit, sourceConfInitAddInputPath, sourceConfInitComplete, verifyNoDuplicates
commitResource, createResource, deleteResource, equals, flowConfInit, getConfigDef, getFullIdentifier, getModifiedTime, getScheme, getSinkFields, getSinkMode, getSourceFields, getStepConfigDef, getTrace, hasConfigDef, hashCode, hasStepConfigDef, id, isEquivalentTo, isKeep, isReplace, isSink, isSource, isTemporary, isUpdate, openForRead, openForWrite, outgoingScopeFor, presentSinkFields, presentSourceFields, resolveIncomingOperationArgumentFields, resolveIncomingOperationPassThroughFields, resourceExists, retrieveSinkFields, retrieveSourceFields, rollbackResource, setScheme, taps, toString
@ConstructorProperties(value={"fields","stringPath"}) @Deprecated public Lfs(Fields fields, java.lang.String stringPath)
fields
- of type FieldsstringPath
- of type String@ConstructorProperties(value={"scheme","stringPath"}) public Lfs(Scheme scheme, java.lang.String stringPath)
scheme
- of type SchemestringPath
- of type String@ConstructorProperties(value={"scheme","stringPath","replace"}) @Deprecated public Lfs(Scheme scheme, java.lang.String stringPath, boolean replace)
scheme
- of type SchemestringPath
- of type Stringreplace
- of type boolean@ConstructorProperties(value={"fields","stringPath","sinkMode"}) @Deprecated public Lfs(Fields fields, java.lang.String stringPath, SinkMode sinkMode)
fields
- of type FieldsstringPath
- of type StringsinkMode
- of type SinkModeprotected void setStringPath(java.lang.String stringPath)
setStringPath
in class Hfs
protected org.apache.hadoop.fs.FileSystem getFileSystem(org.apache.hadoop.mapred.JobConf conf)
getFileSystem
in class Hfs