PubSub ETL Target

The Pub/Sub emitter stores data to an existing Topic in Google Pub/Sub. Data format supported are JSON and DELIMITED.

Target Configuration #

Connection Name: Connections are the service identifiers. A connection name can be selected from the list if you have created and saved connection details for Pub/Sub earlier. Or create one as explained in the topic - PubSub Connection →

Topic Name: A topic is a category or feed name to which messages will be published.

Retry Timeout: It defines how long the logic should keep trying the remote call until it gives up completely. The higher the total timeout, the more retries can be attempted. The value should be entered in seconds.

Output Format: Data type format of the output.

Delimiter: Message field separator to be selected if output format is selected as delimited.

Output Fields: Fields in the message that needs to be a part of the output data.

Add Custom Message Attributes: Add key value pair to add any custom message attributes.

Post Action #

To understand how to provide SQL queries or Stored Procedures that will be executed during pipeline run, see Post-Actions →

Notes #

Optionally, enter notes in the Notes → tab and save the configuration.