Kinesis Emitter
Kinesis emitter emits data to Amazon Kinesis stream. Supported data type formats of the output are Json and Delimited.
Kinesis Emitter Configuration
To add a Kinesis emitter to your pipeline, drag the emitter onto the canvas, connect it to a Data Source or a Processor, and right-click on it to configure it.
| Field | Description |
|---|---|
| Connection Name | Select a Kinesis connection for connecting to Kinesis. |
| Stream Name | Name of the Kinesis Stream. |
| Shard Count | Number of shards required to create the stream, in case stream is not present. |
| Region | Name of the region. For example, us-west-2 |
| Partition Key | Used by Amazon Kinesis to distribute data across shards. |
| Output Format | Datatype format of the output. |
| Output Fields | Fields in the message that needs to be a part of the output data. |
| Checkpoint Directory | Location where the checkpoint data is stored. |
| Output Mode | Mode to be used while writing the data to Streaming sink. Select the output mode from the given three options: Append: Output Mode in which only the new rows in the streaming data will be written to the sink. Complete Mode: Output Mode in which all the rows in the streaming data will be written to the sink every time there are some updates. Update Mode: Output Mode in which only the rows that were updated in the streaming data will be written to the sink every time there are some updates. |
| Enable Trigger | Trigger defines how frequently a streaming query should be executed. |
| Processing Time | It will appear only when Enable Trigger checkbox is selected. Processing Time is the trigger time interval in minutes or seconds. |
| ADD CONFIGURATION | Enables to configure additional properties. |
Click on the Next button.
Enter the notes in the space provided.
Click Save for saving the configuration details.
If you have any feedback on Gathr documentation, please email us!