@aws-cdk_aws-glue-alpha.JobExecutable

class JobExecutable ๐Ÿ”น

LanguageType name
.NETAmazon.CDK.AWS.Glue.Alpha.JobExecutable
Gogithub.com/aws/aws-cdk-go/awscdkgluealpha/v2#JobExecutable
Javasoftware.amazon.awscdk.services.glue.alpha.JobExecutable
Pythonaws_cdk.aws_glue_alpha.JobExecutable
TypeScript (source)@aws-cdk/aws-glue-alpha ยป JobExecutable

The executable properties related to the Glue job's GlueVersion, JobType and code.

Example

declare const bucket: s3.Bucket;
new glue.Job(this, 'ScalaSparkEtlJob', {
  executable: glue.JobExecutable.scalaEtl({
    glueVersion: glue.GlueVersion.V4_0,
    script: glue.Code.fromBucket(bucket, 'src/com/example/HelloWorld.scala'),
    className: 'com.example.HelloWorld',
    extraJars: [glue.Code.fromBucket(bucket, 'jars/HelloWorld.jar')],
  }),
  workerType: glue.WorkerType.G_8X,
  description: 'an example Scala ETL job',
});

Methods

NameDescription
bind()๐Ÿ”นCalled during Job initialization to get JobExecutableConfig.
static of(config)๐Ÿ”นCreate a custom JobExecutable.
static pythonEtl(props)๐Ÿ”นCreate Python executable props for Apache Spark ETL job.
static pythonRay(props)๐Ÿ”นCreate Python executable props for Ray jobs.
static pythonShell(props)๐Ÿ”นCreate Python executable props for python shell jobs.
static pythonStreaming(props)๐Ÿ”นCreate Python executable props for Apache Spark Streaming job.
static scalaEtl(props)๐Ÿ”นCreate Scala executable props for Apache Spark ETL job.
static scalaStreaming(props)๐Ÿ”นCreate Scala executable props for Apache Spark Streaming job.

bind()๐Ÿ”น

public bind(): JobExecutableConfig

Returns

  • JobExecutableConfig

Called during Job initialization to get JobExecutableConfig.


static of(config)๐Ÿ”น

public static of(config: JobExecutableConfig): JobExecutable

Parameters

  • config JobExecutableConfig โ€” custom job executable configuration.

Returns

  • JobExecutable

Create a custom JobExecutable.


static pythonEtl(props)๐Ÿ”น

public static pythonEtl(props: PythonSparkJobExecutableProps): JobExecutable

Parameters

  • props PythonSparkJobExecutableProps โ€” Python Apache Spark Job props.

Returns

  • JobExecutable

Create Python executable props for Apache Spark ETL job.


static pythonRay(props)๐Ÿ”น

public static pythonRay(props: PythonRayExecutableProps): JobExecutable

Parameters

  • props PythonRayExecutableProps โ€” Ray Job props.

Returns

  • JobExecutable

Create Python executable props for Ray jobs.


static pythonShell(props)๐Ÿ”น

public static pythonShell(props: PythonShellExecutableProps): JobExecutable

Parameters

  • props PythonShellExecutableProps โ€” Python Shell Job props.

Returns

  • JobExecutable

Create Python executable props for python shell jobs.


static pythonStreaming(props)๐Ÿ”น

public static pythonStreaming(props: PythonSparkJobExecutableProps): JobExecutable

Parameters

  • props PythonSparkJobExecutableProps โ€” Python Apache Spark Job props.

Returns

  • JobExecutable

Create Python executable props for Apache Spark Streaming job.


static scalaEtl(props)๐Ÿ”น

public static scalaEtl(props: ScalaJobExecutableProps): JobExecutable

Parameters

  • props ScalaJobExecutableProps โ€” Scala Apache Spark Job props.

Returns

  • JobExecutable

Create Scala executable props for Apache Spark ETL job.


static scalaStreaming(props)๐Ÿ”น

public static scalaStreaming(props: ScalaJobExecutableProps): JobExecutable

Parameters

  • props ScalaJobExecutableProps โ€” Scala Apache Spark Job props.

Returns

  • JobExecutable

Create Scala executable props for Apache Spark Streaming job.