An OpenSearch Ingestion Service Data Prepper pipeline running Data Prepper.
resource "awscc_osis_pipeline" "example_pipeline" {
pipeline_name = "example-pipeline"
min_units = 1
max_units = 4
pipeline_configuration_body = file("example-pipeline.yaml")
}
resource "awscc_logs_log_group" "log_group" {
log_group_name = "/aws/vendedlogs/OpenSearchIngestion/example-pipeline/audit-logs"
}
resource "awscc_osis_pipeline" "example_pipeline" {
pipeline_name = "example-pipeline"
min_units = 1
max_units = 4
pipeline_configuration_body = file("example-pipeline.yaml")
log_publishing_options = {
is_logging_enabled = true
cloudwatch_log_destination = {
log_group = awscc_logs_log_group.log_group.log_group_name
}
}
}
max_units
(Number) The maximum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).min_units
(Number) The minimum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).pipeline_configuration_body
(String) The Data Prepper pipeline configuration.pipeline_name
(String) Name of the OpenSearch Ingestion Service pipeline to create. Pipeline names are unique across the pipelines owned by an account within an AWS Region.buffer_options
(Attributes) Key-value pairs to configure buffering. (see below for nested schema)encryption_at_rest_options
(Attributes) Key-value pairs to configure encryption at rest. (see below for nested schema)log_publishing_options
(Attributes) Key-value pairs to configure log publishing. (see below for nested schema)tags
(Attributes Set) An array of key-value pairs to apply to this resource. (see below for nested schema)vpc_options
(Attributes) Container for the values required to configure VPC access for the pipeline. If you don't specify these values, OpenSearch Ingestion Service creates the pipeline with a public endpoint. (see below for nested schema)id
(String) Uniquely identifies the resource.ingest_endpoint_urls
(List of String) A list of endpoints that can be used for ingesting data into a pipelinepipeline_arn
(String) The Amazon Resource Name (ARN) of the pipeline.vpc_endpoints
(Attributes List) The VPC interface endpoints that have access to the pipeline. (see below for nested schema)buffer_options
Required:
persistent_buffer_enabled
(Boolean) Whether persistent buffering should be enabled.encryption_at_rest_options
Required:
kms_key_arn
(String) The KMS key to use for encrypting data. By default an AWS owned key is usedlog_publishing_options
Optional:
cloudwatch_log_destination
(Attributes) The destination for OpenSearch Ingestion Service logs sent to Amazon CloudWatch. (see below for nested schema)is_logging_enabled
(Boolean) Whether logs should be published.log_publishing_options.cloudwatch_log_destination
Required:
log_group
(String)tags
Required:
key
(String) The key name of the tag. You can specify a value that is 1 to 128 Unicode characters in length and cannot be prefixed with aws:. You can use any of the following characters: the set of Unicode letters, digits, whitespace, _, ., /, =, +, and -.value
(String) The value for the tag. You can specify a value that is 0 to 256 Unicode characters in length and cannot be prefixed with aws:. You can use any of the following characters: the set of Unicode letters, digits, whitespace, _, ., /, =, +, and -.vpc_options
Required:
subnet_ids
(List of String) A list of subnet IDs associated with the VPC endpoint.Optional:
security_group_ids
(List of String) A list of security groups associated with the VPC endpoint.vpc_endpoints
Read-Only:
vpc_endpoint_id
(String) The unique identifier of the endpoint.vpc_id
(String) The ID for your VPC. AWS Privatelink generates this value when you create a VPC.vpc_options
(Attributes) Container for the values required to configure VPC access for the pipeline. If you don't specify these values, OpenSearch Ingestion Service creates the pipeline with a public endpoint. (see below for nested schema)vpc_endpoints.vpc_options
Read-Only:
security_group_ids
(List of String) A list of security groups associated with the VPC endpoint.subnet_ids
(List of String) A list of subnet IDs associated with the VPC endpoint.Import is supported using the following syntax:
$ terraform import awscc_osis_pipeline.example <resource ID>