@aws-cdk_aws-glue-alpha.GlueVersion

class GlueVersion ๐Ÿ”น

LanguageType name
.NETAmazon.CDK.AWS.Glue.Alpha.GlueVersion
Gogithub.com/aws/aws-cdk-go/awscdkgluealpha/v2#GlueVersion
Javasoftware.amazon.awscdk.services.glue.alpha.GlueVersion
Pythonaws_cdk.aws_glue_alpha.GlueVersion
TypeScript (source)@aws-cdk/aws-glue-alpha ยป GlueVersion

AWS Glue version determines the versions of Apache Spark and Python that are available to the job.

See also: [https://docs.aws.amazon.com/glue/latest/dg/add-job.html.

If you need to use a GlueVersion that doesn't exist as a static member, you can instantiate a GlueVersion object, e.g: GlueVersion.of('1.5').](https://docs.aws.amazon.com/glue/latest/dg/add-job.html.

If you need to use a GlueVersion that doesn't exist as a static member, you can instantiate a GlueVersion object, e.g: GlueVersion.of('1.5').)

Example

declare const bucket: s3.Bucket;
new glue.Job(this, 'ScalaSparkEtlJob', {
  executable: glue.JobExecutable.scalaEtl({
    glueVersion: glue.GlueVersion.V4_0,
    script: glue.Code.fromBucket(bucket, 'src/com/example/HelloWorld.scala'),
    className: 'com.example.HelloWorld',
    extraJars: [glue.Code.fromBucket(bucket, 'jars/HelloWorld.jar')],
  }),
  workerType: glue.WorkerType.G_8X,
  description: 'an example Scala ETL job',
});

Properties

NameTypeDescription
name๐Ÿ”นstringThe name of this GlueVersion, as expected by Job resource.
static V0_9๐Ÿ”นGlueVersionGlue version using Spark 2.2.1 and Python 2.7.
static V1_0๐Ÿ”นGlueVersionGlue version using Spark 2.4.3, Python 2.7 and Python 3.6.
static V2_0๐Ÿ”นGlueVersionGlue version using Spark 2.4.3 and Python 3.7.
static V3_0๐Ÿ”นGlueVersionGlue version using Spark 3.1.1 and Python 3.7.
static V4_0๐Ÿ”นGlueVersionGlue version using Spark 3.3.0 and Python 3.10.

name๐Ÿ”น

Type: string

The name of this GlueVersion, as expected by Job resource.


static V0_9๐Ÿ”น

Type: GlueVersion

Glue version using Spark 2.2.1 and Python 2.7.


static V1_0๐Ÿ”น

Type: GlueVersion

Glue version using Spark 2.4.3, Python 2.7 and Python 3.6.


static V2_0๐Ÿ”น

Type: GlueVersion

Glue version using Spark 2.4.3 and Python 3.7.


static V3_0๐Ÿ”น

Type: GlueVersion

Glue version using Spark 3.1.1 and Python 3.7.


static V4_0๐Ÿ”น

Type: GlueVersion

Glue version using Spark 3.3.0 and Python 3.10.

Methods

NameDescription
static of(version)๐Ÿ”นCustom Glue version.

static of(version)๐Ÿ”น

public static of(version: string): GlueVersion

Parameters

  • version string โ€” custom version.

Returns

  • GlueVersion

Custom Glue version.