@aws-cdk_aws-glue-alpha.ScalaJobExecutableProps

interface ScalaJobExecutableProps ๐Ÿ”น

LanguageType name
.NETAmazon.CDK.AWS.Glue.Alpha.ScalaJobExecutableProps
Gogithub.com/aws/aws-cdk-go/awscdkgluealpha/v2#ScalaJobExecutableProps
Javasoftware.amazon.awscdk.services.glue.alpha.ScalaJobExecutableProps
Pythonaws_cdk.aws_glue_alpha.ScalaJobExecutableProps
TypeScript (source)@aws-cdk/aws-glue-alpha ยป ScalaJobExecutableProps

Props for creating a Scala Spark (ETL or Streaming) job executable.

Example

declare const bucket: s3.Bucket;
new glue.Job(this, 'ScalaSparkEtlJob', {
  executable: glue.JobExecutable.scalaEtl({
    glueVersion: glue.GlueVersion.V4_0,
    script: glue.Code.fromBucket(bucket, 'src/com/example/HelloWorld.scala'),
    className: 'com.example.HelloWorld',
    extraJars: [glue.Code.fromBucket(bucket, 'jars/HelloWorld.jar')],
  }),
  workerType: glue.WorkerType.G_8X,
  description: 'an example Scala ETL job',
});

Properties

NameTypeDescription
className๐Ÿ”นstringThe fully qualified Scala class name that serves as the entry point for the job.
glueVersion๐Ÿ”นGlueVersionGlue version.
script๐Ÿ”นCodeThe script that executes a job.
extraFiles?๐Ÿ”นCode[]Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.
extraJars?๐Ÿ”นCode[]Additional Java .jar files that AWS Glue adds to the Java classpath before executing your script. Only individual files are supported, directories are not supported.
extraJarsFirst?๐Ÿ”นbooleanSetting this value to true prioritizes the customer's extra JAR files in the classpath.
runtime?๐Ÿ”นRuntimeRuntime.

className๐Ÿ”น

Type: string

The fully qualified Scala class name that serves as the entry point for the job.

See also: [ --class in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html]( --class in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html)


glueVersion๐Ÿ”น

Type: GlueVersion

Glue version.

See also: https://docs.aws.amazon.com/glue/latest/dg/release-notes.html


script๐Ÿ”น

Type: Code

The script that executes a job.


extraFiles?๐Ÿ”น

Type: Code[] (optional, default: [] - no extra files are copied to the working directory)

Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.

Only individual files are supported, directories are not supported.

See also: [ --extra-files in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html]( --extra-files in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html)


extraJars?๐Ÿ”น

Type: Code[] (optional, default: [] - no extra jars are added to the classpath)

Additional Java .jar files that AWS Glue adds to the Java classpath before executing your script. Only individual files are supported, directories are not supported.

See also: [ --extra-jars in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html]( --extra-jars in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html)


extraJarsFirst?๐Ÿ”น

Type: boolean (optional, default: false - priority is not given to user-provided jars)

Setting this value to true prioritizes the customer's extra JAR files in the classpath.

See also: [ --user-jars-first in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html]( --user-jars-first in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html)


runtime?๐Ÿ”น

Type: Runtime (optional)

Runtime.

It is required for Ray jobs.