Create a Template
You can create a workflow that has multiple executions of the same flow with different configurations.
You can convert any configuration property as a placeholder in each operator. This will allow you to provide different configurations for different executions. Once all operators are configured and the flow is defined, you will able to provide different values for each placeholder either by entering data in data grid or by uploading a csv file.
You will have following options:
You can convert any configuration property as a placeholder by clicking on it. Once clicked, its color will change and ‘$$’ will be append as prefix. Value that user provided for this configuration will considered as placeholder key.
If at least any one of the property is selected as placeholder in any of the operator, workflow will be converted into a template workflow and data grid option will be enable to provide configurations.
On the top right corner of the pipeline canvas, a grid icon is placed. This is the template icon. Once you click on it, it opens the template window beneath the pipeline.
In the Data grid, all placeholder keys are listed as header and you can provide their values for each execution. Each row will consider as one execution. A column with ‘unique_id’ is appended by default to identify each execution.
The Template window configuration properties are explained below:
Add New Row: To add a new row, select the + icon. This icon will allow you to create a new entry.
Remove Selected Rows: To remove the selected rows, select the checkbox in from of each row and select Remove.
Clone Selected Rows: To clone the selected rows, select the checkbox in from of each row and click on the Clone icon.
Upload: With Upload option you will able to upload the configurations file that has multiple rows for each placeholder properties.
Download: With download option, you will able to download a csv file contains the all the data which has been provided (along with placeholders as headers).
Maximize: To maximize the template window.
Close: To close the template window.
Notes:
It is not allowed to convert any configuration property, in Pipeline, Control and Workflow node as a placeholder.
Make sure the placeholder name and property names are not similar, they should be different. For example, if your property is Connection_ID, make sure the placeholder name is not Connection_ID too.
Provide python list to use variable name (string) & value in Assignment Operator as placeholder.
If you have any feedback on Gathr documentation, please email us!