Delta SQL Batch ETL Source

Delta SQL Channel supports JDBC database. To add a Delta SQL source into your ETL application, select the source from components panel on the canvas and click to configure it.

Schema Type #

See the topic Provide Schema for ETL Source → to know how schema details can be provided for data sources.

After providing schema type details, the next step is to configure the data source.

Data Source Configuration #

Configure the data source parameters that are explained below.

Connection Name #

Connections are the service identifiers. A connection name can be selected from the list if you have created and saved connection details for JDBC earlier. Or create one as explained in the topic - JDBC Connection →

Source Storage Type #

JDBC source storage type is supported.

Query #

Provide delta compatible SQL query to be executed in the component.

Design Time Query #

Provide a JDBC compatible SQL query to be executed in the component with a set limit in records count for design time.

You can provide a simple query with table name like select \* from tablename.

• “As of” clause is not supported during design time but can be used in query field for run time.

Add Configuration: To add additional custom ADLS properties in a key-value pair.

Detect Schema #

Check the populated schema details. For more details, see Schema Preview →

Incremental Read #

Optionally, you can enable incremental read. For more details, see ADLS Incremental Configuration →.

Pre Action #

To understand how to provide SQL queries or Stored Procedures that will be executed during pipeline run, see Pre-Actions →.

Notes #

Optionally, enter notes in the Notes → tab and save the configuration.