PubSub ETL Source

Through the Google Pub/Sub Data Source, you can read the objects from the Pub/Sub Topics.

Schema Type #

See the topic Provide Schema for ETL Source → to know how schema details can be provided for data sources.

After providing schema type details, the next step is to configure the data source.

Data Source Configuration #

Connection Name: Connections are the service identifiers. A connection name can be selected from the list if you have created and saved connection details for Pub/Sub earlier. Or create one as explained in the topic - PubSub Connection →

Topic Name: The topic name where data will be published.

Auto-create Subscription Name: Select the checkbox to auto-create the subscription name.

Subscription Name: Enter a subscription name of your choice if you are not opting to auto-create the subscription name.

Max Size: Number of messages to be received in one request.

Detect Schema #

Check the populated schema details. For more details, see Schema Preview →

Notes #

Optionally, enter notes in the Notes → tab and save the configuration.