Eventbridge ETL Target

Target Configuration #

Configure the target parameters that are explained below.

Connection Name #

Connections are the service identifiers. A connection name can be selected from the list if you have created and saved connection details for Eventbridge earlier. Or create one as explained in the topic - Eventbridge Connection →

EventBridge Fields #

Option to specify Source #

Use ‘Constant Value’ to assign constant String or ‘Select Field’ to assign value from a field.

Option to specify Detail Type #

Use ‘Constant Value’ to assign constant String or ‘Select Field’ to assign value from a field.

Specify Event Bus #

Specify the event bus where you want to publish data. Use ‘Constant Value’ to assign constant String or ‘Select Field’ to assign value from a field.

Specify Resource #

Use ‘Constant Value’ to assign a constant String or Use ‘Select Field’ to assign value from a field.

Specify Time #

Use ‘None’ to leave it blank or Use ‘Current Time’ to assign a current GMT time or Use ‘Select Field’ to assign value from a field.

Detail #

Fields in the message that needs to be a part of the output data.

Convert Detail fields to JSON #

Select String fields in the message that needs to be parsed as JSON objects.

Throttle Control #

Maximum Parallel Events #

The maximum number of events that can be published by the application in parallel.

Maximum entries in a PutEvent Request #

Maximum number of events that can be published in a single PutEvent request.

Write Modes (for streaming applications only) #

Output Mode #

The output mode specifies how to write the data. In case of streaming source, the available options are:

• Append

• Complete

Enable Trigger #

Check this option to define how frequently a streaming query should be executed. Upon checking this option, provide Trigger Type as explained below.

Trigger Type #

Select one of the options available from the drop-down:

• One-Time Micro-Batch

• Fixed Interval Micro-Batches

Processing Time #

Specifies the time interval that governs the trigger policy.

Retry on failure #

Enable Retry Mechanism #

Check the option to retry the job after any interruption while writing data. The job will resume from the point where it was interrupted.

Retry Count #

Specify the number of times to retry jobs in case of any interruption.

Retry Delay #

Specify the retry delay in milliseconds. This is the time that application should wait before retrying.

Stop on Failure #

Once checked, application will fail after completing retries (if any). If unchecked, application will continue to publish further events in input dataset.

Add Configuration: To add additional custom ADLS properties in a key-value pair.

Post Action #

To understand how to provide SQL queries or Stored Procedures that will be executed during pipeline run, see Post-Actions →

Notes #

Optionally, enter notes in the Notes → tab and save the configuration.