aws-cdk-lib.aws_stepfunctions_tasks.JobDriver

interface JobDriver

LanguageType name
.NETAmazon.CDK.AWS.StepFunctions.Tasks.JobDriver
Gogithub.com/aws/aws-cdk-go/awscdk/v2/awsstepfunctionstasks#JobDriver
Javasoftware.amazon.awscdk.services.stepfunctions.tasks.JobDriver
Pythonaws_cdk.aws_stepfunctions_tasks.JobDriver
TypeScript (source)aws-cdk-lib » aws_stepfunctions_tasks » JobDriver

Specify the driver that the EMR Containers job runs on.

The job driver is used to provide an input for the job that will be run.

Example

new tasks.EmrContainersStartJobRun(this, 'EMR Containers Start Job Run', {
  virtualCluster: tasks.VirtualClusterInput.fromVirtualClusterId('de92jdei2910fwedz'),
  releaseLabel: tasks.ReleaseLabel.EMR_6_2_0,
  jobName: 'EMR-Containers-Job',
  jobDriver: {
    sparkSubmitJobDriver: {
      entryPoint: sfn.TaskInput.fromText('local:///usr/lib/spark/examples/src/main/python/pi.py'),
    },
  },
  applicationConfig: [{
    classification: tasks.Classification.SPARK_DEFAULTS,
    properties: {
      'spark.executor.instances': '1',
      'spark.executor.memory': '512M',
    },
  }],
});

Properties

NameTypeDescription
sparkSubmitJobDriverSparkSubmitJobDriverThe job driver parameters specified for spark submit.

sparkSubmitJobDriver

Type: SparkSubmitJobDriver

The job driver parameters specified for spark submit.

See also: https://docs.aws.amazon.com/emr-on-eks/latest/APIReference/API_SparkSubmitJobDriver.html