SQS Data Source
This component is supported in Gathr on-premise. SQS Channel allows you to read data from different SQS queues. The Queue types supported are Standard and FIFO. Along with providing maximum throughput you can achieve scalability using the buffered requests independently.
Configuring SQS Data Source
To add a SQS Data Source into your pipeline, drag the Data Source to the canvas and right-click on it to configure.
Under the Schema tab, you can select the Max No. of Rows and Sampling Method as Top-N or Random Sample.
| Field | Description |
|---|---|
| Connection Name | Connection Name for creating connection. |
| Queue Type | Select type of the queue: Standard or FIFO. |
| Queue Name | Name of the queue where data will be published. |
| Visibility Timeout | The length of the time (in seconds) that a message received from a queue will be invisible to other receiving components. |
| Message Retention Period (in seconds) | The amount of time Amazon SQS will retainna message in if it does not get deleted. |
| Maximum Message Size (in bytes) | Maximum message size (in bytes) accepted by Amazon SQS. |
| Receive Message Wait Time (in seconds) | The maximum amount of time that a long polling receive call will wait for a message to become available before returning an empty house. |
| Delivery Delay (in seconds) | The amount of time to delay the first delivery of all messages added to this queue. |
If you have any feedback on Gathr documentation, please email us!