HDFS Incremental Configuration

Enable Incremental Read: You can choose to enable incremental read.

This is useful if the need is only to read the objects that have been updated in the source, since the last execution of the application for the given configuration.

Provide the details for enabling incremental read as described below:

Offset: Specifies last modified time of file - all the files whose last modified time is greater than this value will be read.