Manages an Azure Blob Dataset inside an Azure Data Factory.
resource "azurerm_resource_group" "example" {
name = "example-resources"
location = "West Europe"
}
data "azurerm_storage_account" "example" {
name = "storageaccountname"
resource_group_name = azurerm_resource_group.example.name
}
resource "azurerm_data_factory" "example" {
name = "example"
location = azurerm_resource_group.example.location
resource_group_name = azurerm_resource_group.example.name
}
resource "azurerm_data_factory_linked_service_azure_blob_storage" "example" {
name = "example"
data_factory_id = azurerm_data_factory.example.id
connection_string = data.azurerm_storage_account.example.primary_connection_string
}
resource "azurerm_data_factory_dataset_azure_blob" "example" {
name = "example"
data_factory_id = azurerm_data_factory.example.id
linked_service_name = azurerm_data_factory_linked_service_azure_blob_storage.example.name
path = "foo"
filename = "bar.png"
}
The following supported arguments are common across all Azure Data Factory Datasets:
name
- (Required) Specifies the name of the Data Factory Dataset. Changing this forces a new resource to be created. Must be globally unique. See the Microsoft documentation for all restrictions.
data_factory_id
- (Required) The Data Factory ID in which to associate the Linked Service with. Changing this forces a new resource.
linked_service_name
- (Required) The Data Factory Linked Service name in which to associate the Dataset with.
folder
- (Optional) The folder that this Dataset is in. If not specified, the Dataset will appear at the root level.
schema_column
- (Optional) A schema_column
block as defined below.
description
- (Optional) The description for the Data Factory Dataset.
annotations
- (Optional) List of tags that can be used for describing the Data Factory Dataset.
parameters
- (Optional) A map of parameters to associate with the Data Factory Dataset.
additional_properties
- (Optional) A map of additional properties to associate with the Data Factory Dataset.
The following supported arguments are specific to Azure Blob Dataset:
path
- (Optional) The path of the Azure Blob.
filename
- (Optional) The filename of the Azure Blob.
dynamic_path_enabled
- (Optional) Is the path
using dynamic expression, function or system variables? Defaults to false
.
dynamic_filename_enabled
- (Optional) Is the filename
using dynamic expression, function or system variables? Defaults to false
.
A schema_column
block supports the following:
name
- (Required) The name of the column.
type
- (Optional) Type of the column. Valid values are Byte
, Byte[]
, Boolean
, Date
, DateTime
,DateTimeOffset
, Decimal
, Double
, Guid
, Int16
, Int32
, Int64
, Single
, String
, TimeSpan
. Please note these values are case sensitive.
description
- (Optional) The description of the column.
In addition to the Arguments listed above - the following Attributes are exported:
id
- The ID of the Data Factory Dataset.The timeouts
block allows you to specify timeouts for certain actions:
create
- (Defaults to 30 minutes) Used when creating the Data Factory Dataset.update
- (Defaults to 30 minutes) Used when updating the Data Factory Dataset.read
- (Defaults to 5 minutes) Used when retrieving the Data Factory Dataset.delete
- (Defaults to 30 minutes) Used when deleting the Data Factory Dataset.Data Factory Datasets can be imported using the resource id
, e.g.
terraform import azurerm_data_factory_dataset_azure_blob.example /subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/example/providers/Microsoft.DataFactory/factories/example/datasets/example