Kinesis Data Source

Kinesis Data Source allows you to fetch data from Amazon Kinesis stream.

Configuring Kinesis Data Source

Under the Schema Type tab, select Upload Data File.

FieldDescription
Connection Name

Connections are the Service identifiers.

Select the connection name from the available list of connections, from where you would like to read the data.

Override Credentials

Unchecked by default, check mark the checkbox to override credentials for user specific actions.

Provide AWS KeyID and Secret Access Key.

Stream NameName of the Kinesis stream.
EndPointEnd point is a URL that is the entry point of Kinesis services.
RegionName of the region. For example, us-west-2
Initial Position

In the absence of Kinesis checkpoint, this is the workers initial starting position in the stream.

- The values are either the beginning of stream per Kinesis limit of 24 hours or the tip of the stream.

- TRIM_HORIZON: To read data from beginning of stream, use the command TRIM_HORIZON.

- LATESOpenness To read latest or most recent records, use the command LATEST.

Connection RetriesThe number of retries for component connection. Possible values are -1, 0 or any positive number. If the value were -1 then there would be infinite retries for infinite connection.
Delay between Connection RetriesRetry delay interval for component connection. (In milliseconds.)
Maximum Delay Between Connection RetriesMaximum cool-off period between two retries.
ADD CONFIGURATIONUser can add further configurations by providing values after clicking the ADD CONFIGURATION option.

Environment Params

Click on the Add Notes tab. Enter the notes in the space provided.

Click Done to save the configuration.

Top