aws-cdk-lib.aws_sagemaker.CfnModelPackage.S3DataSourceProperty

interface S3DataSourceProperty

LanguageType name
.NETAmazon.CDK.AWS.Sagemaker.CfnModelPackage.S3DataSourceProperty
Gogithub.com/aws/aws-cdk-go/awscdk/v2/awssagemaker#CfnModelPackage_S3DataSourceProperty
Javasoftware.amazon.awscdk.services.sagemaker.CfnModelPackage.S3DataSourceProperty
Pythonaws_cdk.aws_sagemaker.CfnModelPackage.S3DataSourceProperty
TypeScript aws-cdk-lib » aws_sagemaker » CfnModelPackage » S3DataSourceProperty

Describes the S3 data source.

Your input bucket must be in the same AWS region as your training job.

Example

// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const s3DataSourceProperty: sagemaker.CfnModelPackage.S3DataSourceProperty = {
  s3DataType: 's3DataType',
  s3Uri: 's3Uri',
};

Properties

NameTypeDescription
s3DataTypestringIf you choose S3Prefix , S3Uri identifies a key name prefix.
s3UristringDepending on the value specified for the S3DataType , identifies either a key name prefix or a manifest.

s3DataType

Type: string

If you choose S3Prefix , S3Uri identifies a key name prefix.

SageMaker uses all objects that match the specified key name prefix for model training.

If you choose ManifestFile , S3Uri identifies an object that is a manifest file containing a list of object keys that you want SageMaker to use for model training.

If you choose AugmentedManifestFile , S3Uri identifies an object that is an augmented manifest file in JSON lines format. This file contains the data you want to use for model training. AugmentedManifestFile can only be used if the Channel's input mode is Pipe .


s3Uri

Type: string

Depending on the value specified for the S3DataType , identifies either a key name prefix or a manifest.

For example:

  • A key name prefix might look like this: s3://bucketname/exampleprefix
  • A manifest might look like this: s3://bucketname/example.manifest

A manifest is an S3 object which is a JSON file consisting of an array of elements. The first element is a prefix which is followed by one or more suffixes. SageMaker appends the suffix elements to the prefix to get a full set of S3Uri . Note that the prefix must be a valid non-empty S3Uri that precludes users from specifying a manifest whose individual S3Uri is sourced from different S3 buckets.

The following code example shows a valid manifest format:

[ {"prefix": "s3://customer_bucket/some/prefix/"},

"relative/path/to/custdata-1",

"relative/path/custdata-2",

...

"relative/path/custdata-N"

]

This JSON is equivalent to the following S3Uri list:

s3://customer_bucket/some/prefix/relative/path/to/custdata-1

s3://customer_bucket/some/prefix/relative/path/custdata-2

...

s3://customer_bucket/some/prefix/relative/path/custdata-N

The complete set of S3Uri in this manifest is the input data for the channel for this data source. The object that each S3Uri points to must be readable by the IAM role that SageMaker uses to perform tasks on your behalf.

Your input bucket must be located in same AWS region as your training job.