@aws-cdk_aws-glue-alpha.WorkerType

class WorkerType ๐Ÿ”น

LanguageType name
.NETAmazon.CDK.AWS.Glue.Alpha.WorkerType
Gogithub.com/aws/aws-cdk-go/awscdkgluealpha/v2#WorkerType
Javasoftware.amazon.awscdk.services.glue.alpha.WorkerType
Pythonaws_cdk.aws_glue_alpha.WorkerType
TypeScript (source)@aws-cdk/aws-glue-alpha ยป WorkerType

The type of predefined worker that is allocated when a job runs.

If you need to use a WorkerType that doesn't exist as a static member, you can instantiate a WorkerType object, e.g: WorkerType.of('other type').

Example

declare const bucket: s3.Bucket;
new glue.Job(this, 'ScalaSparkEtlJob', {
  executable: glue.JobExecutable.scalaEtl({
    glueVersion: glue.GlueVersion.V4_0,
    script: glue.Code.fromBucket(bucket, 'src/com/example/HelloWorld.scala'),
    className: 'com.example.HelloWorld',
    extraJars: [glue.Code.fromBucket(bucket, 'jars/HelloWorld.jar')],
  }),
  workerType: glue.WorkerType.G_8X,
  description: 'an example Scala ETL job',
});

Properties

NameTypeDescription
name๐Ÿ”นstringThe name of this WorkerType, as expected by Job resource.
static G_025X๐Ÿ”นWorkerTypeEach worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. Suitable for low volume streaming jobs.
static G_1X๐Ÿ”นWorkerTypeEach worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker.
static G_2X๐Ÿ”นWorkerTypeEach worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker.
static G_4X๐Ÿ”นWorkerTypeEach worker maps to 4 DPU (16 vCPU, 64 GB of memory, 256 GB disk), and provides 1 executor per worker.
static G_8X๐Ÿ”นWorkerTypeEach worker maps to 8 DPU (32 vCPU, 128 GB of memory, 512 GB disk), and provides 1 executor per worker.
static STANDARD๐Ÿ”นWorkerTypeEach worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
static Z_2X๐Ÿ”นWorkerTypeEach worker maps to 2 high-memory DPU [M-DPU] (8 vCPU, 64 GB of memory, 128 GB disk).

name๐Ÿ”น

Type: string

The name of this WorkerType, as expected by Job resource.


static G_025X๐Ÿ”น

Type: WorkerType

Each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. Suitable for low volume streaming jobs.


static G_1X๐Ÿ”น

Type: WorkerType

Each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker.

Suitable for memory-intensive jobs.


static G_2X๐Ÿ”น

Type: WorkerType

Each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker.

Suitable for memory-intensive jobs.


static G_4X๐Ÿ”น

Type: WorkerType

Each worker maps to 4 DPU (16 vCPU, 64 GB of memory, 256 GB disk), and provides 1 executor per worker.

We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for AWS Glue version 3.0 or later jobs.


static G_8X๐Ÿ”น

Type: WorkerType

Each worker maps to 8 DPU (32 vCPU, 128 GB of memory, 512 GB disk), and provides 1 executor per worker.

We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for AWS Glue version 3.0 or later jobs.


static STANDARD๐Ÿ”น

Type: WorkerType

Each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.


static Z_2X๐Ÿ”น

Type: WorkerType

Each worker maps to 2 high-memory DPU [M-DPU] (8 vCPU, 64 GB of memory, 128 GB disk).

Supported in Ray jobs.

Methods

NameDescription
static of(workerType)๐Ÿ”นCustom worker type.

static of(workerType)๐Ÿ”น

public static of(workerType: string): WorkerType

Parameters

  • workerType string โ€” custom worker type.

Returns

  • WorkerType

Custom worker type.