Azure SQL Incremental Configuration

Enable Incremental Read

In Azure SQL data source, the option for incremental read can be enabled or disabled. Enable to read the desired data incrementally from the specified column as per the input start date. Disable to read the data within a specific range by providing the start date and an end date.

Column: The timestamp field should be selected on which the condition to fetch data will be applied as per the incremental read type.

Offset: Mention a value of the reference column, Only the records whose value of the reference column is greater than this value will be read.

Read Control Type: Control how you want to read the data from the source with one of the below options:

None: Read the data without specifying any limit. Provide a record from the selected Column, and the data will be read starting from the provided value.

Limit by Count: Specify the number of records you want to read in a single request.

Limit by Value: Read the data till the specified limit. Provide a record from the selected Column, and the data will be read till the provided value.