Custom JDBC Incremental Configuration

Enable Incremental Read: Option to enable or disable incremental read support.

This is useful if the need is only to read the objects that have been updated in the source, since the last execution of the application for the given configuration.

Provide the details for enabling incremental read as described below:

Column: Select a column on which incremental read will work. Displays the list of columns that has integer, long, date, timestamp, decimal type of values. It is recommended that this column should have sequential, unique and sorted (in increasing order) values.

Offset: Mention a value of the reference column, Only the records with value in the reference column greater than the specified value will be read.

Read Control Type: Provides 3 options to control data to be fetched - None, Limit By Count and Maximum Value.

None - All the records with value of reference column greater than offset will be read.

Limit By Count - Mentioned no of records will be read with value of reference column greater than offset will be read.

Maximum Value - All the records with value of reference column greater than offset and less than Column Value field will be read.

👉

For None and Limit by Count it is recommend that table should have data in sequential and sorted (increasing) order.

No. of Records: Here, you can specify the number of records that you want to read in a single request. This field will appear when read control type is set to limit by count.

Column Value: Here, you can specify the value for configured column till the point where you want to read the data. This field will appear when read control type is set to limit by value.

If you have any feedback on Gathr documentation, please email us!