aws-cdk-lib.aws_stepfunctions_tasks.S3DataSource

interface S3DataSource

LanguageType name
.NETAmazon.CDK.AWS.StepFunctions.Tasks.S3DataSource
Gogithub.com/aws/aws-cdk-go/awscdk/v2/awsstepfunctionstasks#S3DataSource
Javasoftware.amazon.awscdk.services.stepfunctions.tasks.S3DataSource
Pythonaws_cdk.aws_stepfunctions_tasks.S3DataSource
TypeScript (source)aws-cdk-lib » aws_stepfunctions_tasks » S3DataSource

S3 location of the channel data.

See also: https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_S3DataSource.html

Example

new tasks.SageMakerCreateTrainingJob(this, 'TrainSagemaker', {
  trainingJobName: sfn.JsonPath.stringAt('$.JobName'),
  algorithmSpecification: {
    algorithmName: 'BlazingText',
    trainingInputMode: tasks.InputMode.FILE,
  },
  inputDataConfig: [{
    channelName: 'train',
    dataSource: {
      s3DataSource: {
        s3DataType: tasks.S3DataType.S3_PREFIX,
        s3Location: tasks.S3Location.fromJsonExpression('$.S3Bucket'),
      },
    },
  }],
  outputDataConfig: {
    s3OutputLocation: tasks.S3Location.fromBucket(s3.Bucket.fromBucketName(this, 'Bucket', 'mybucket'), 'myoutputpath'),
  },
  resourceConfig: {
    instanceCount: 1,
    instanceType: new ec2.InstanceType(sfn.JsonPath.stringAt('$.InstanceType')),
    volumeSize: Size.gibibytes(50),
  }, // optional: default is 1 instance of EC2 `M4.XLarge` with `10GB` volume
  stoppingCondition: {
    maxRuntime: Duration.hours(2),
  }, // optional: default is 1 hour
});

Properties

NameTypeDescription
s3LocationS3LocationS3 Uri.
attributeNames?string[]List of one or more attribute names to use that are found in a specified augmented manifest file.
s3DataDistributionType?S3DataDistributionTypeS3 Data Distribution Type.
s3DataType?S3DataTypeS3 Data Type.

s3Location

Type: S3Location

S3 Uri.


attributeNames?

Type: string[] (optional, default: No attribute names)

List of one or more attribute names to use that are found in a specified augmented manifest file.


s3DataDistributionType?

Type: S3DataDistributionType (optional, default: None)

S3 Data Distribution Type.


s3DataType?

Type: S3DataType (optional, default: S3_PREFIX)

S3 Data Type.