BigQuery Emitter
The configuration of Big Query Emitter is mentioned below:
| Field | Description |
|---|---|
| Save as Dataset | Select checkbox to save schema as dataset. Mention the dataset name. |
| Connection Name | Mention the connection name for creating connection. |
| Override Credentials | Check this option to override credentials for user specific actions. Upload the GCS service account key. |
| Message Name | Select the name for the message configuration which will act as metadata for actual data. |
| BigQuery Dataset Name | Select the existing dataset name in BigQuery. |
| Big Query Table Name | Select the existing table name of specified BigQuery dataset. |
| TimeStamp Column | Enter value for timestamp column that is used for tracking load time in BigQuery streaming pipeline. |
| Save Mode | Select save mode: Append, Overwrite or Ignore. It specifies how to handle existing data, if present. |
| GCS Bucket | Provide the intermediate GCS location for BigQuery table. |
The user can add further configurations by clicking at the ADD CONFIGURATION button.
Schema Results:
Under this section, the user can view the data that he is getting and which column he wants to save it to. The user can view: Table Column Name, Mapping Value, Database Datatype, Mode and Ignore All checkbox.
The user can download or upload Mapping.
If you have any feedback on Gathr documentation, please email us!