Description:

Creates Hadoop Sequence Files from incoming flow files

Additional Details...

Tags:

hadoop, sequence file, create, sequencefile

Properties:

In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values.

NameDefault ValueAllowable ValuesDescription
Hadoop Configuration ResourcesA file or comma separated list of files which contains the Hadoop file system configuration. Without this, Hadoop will search the classpath for a 'core-site.xml' and 'hdfs-site.xml' file or will revert to a default configuration.
Kerberos PrincipalKerberos principal to authenticate as. Requires nifi.kerberos.krb5.file to be set in your nifi.properties
Kerberos KeytabKerberos keytab associated with the principal. Requires nifi.kerberos.krb5.file to be set in your nifi.properties
Kerberos Relogin Period4 hoursPeriod of time which should pass before attempting a kerberos relogin
compression type
  • NONE
  • DEFAULT
  • BZIP
  • GZIP
  • LZ4
  • SNAPPY
  • AUTOMATIC
Type of compression to use when creating Sequence File

Relationships:

NameDescription
failureIncoming files that failed to generate a Sequence File are sent to this relationship
successGenerated Sequence Files are sent to this relationship

Reads Attributes:

None specified.

Writes Attributes:

None specified.

See Also:

PutHDFS