Azure Blob Batch Data Source
An Azure Blob Batch channel reads different formats of data in batch (json, csv, orc, parquet) from container. It can omit data into any emitter.
Configuring an Azure Blob Data Source
To add an Azure Blob Data Source into your pipeline, drag the Data Source to the canvas and right click on it to configure.
Under the Schema Type tab, you can Upload Data File and Fetch From Source.
| Field | Description |
|---|---|
| Connection Name | Select the connection name from the available list of connections, from where you would like to read the data. |
| Container | Container name in Azure Blob. |
| Path | End path with * in case of directory. For example:- outdir.*. For Absolute path:- outdir/filename |
| Add Configuration | To add additional custom properties in key-value pairs. |
Configure Pre-Action in Source →
If you have any feedback on Gathr documentation, please email us!