ADLS Streaming ETL Source

ADLS Streaming data source reads the objects from the ADLS Container.

Schema Type

See the topic Provide Schema for ETL Source → to know how schema details can be provided for data sources.

After providing schema type details, the next step is to configure the data source.


Data Source Configuration

Configure the data source parameters that are explained below.

Connection Name

Connections are the service identifiers. A connection name can be selected from the list if you have created and saved connection details for ADLS earlier. Or create one as explained in the topic - ADLS Connection →


Container

ADLS container name from which the data should be read.


ADLS Directory Path

Provide directory path for ADLS file system.


File Filter

Provide a file pattern example: *csv/*json to retrieve the available files.


Recursive File Lookup

Check the option to retrieve the files from current/sub-folder(s).


Add Configuration: To add additional custom ADLS properties in a key-value pair.


Detect Schema

Check the populated schema details. For more details, see Schema Preview →


Notes

Optionally, enter notes in the Notes → tab and save the configuration.

Top