Azure blob ETL Streaming Source

An Azure Blob Stream channel reads different formats of streaming data (json, csv, orc, parquet) from container and emit data into different containers.

Configuring an Azure Blob Data Source #

To add an Azure Blob Data Source into your pipeline, drag the Data Source to the canvas and right click on it to configure.

Under the Schema Type tab, you can Upload Data File and Fetch From Source.

Connection Name Select the connection name from the available list of connections, from where you would like to read the data.

Container Container name in Azure Blob.

Path End path with * in case of directory. For example:- outdir/*

Expecting any specific format in directory Path:- outdir/*.csv

Add Configuration To add additional custom properties in key-value pairs.