GCS (Batch and Streaming) Data Source
Gathr provides batch and streaming GCS (Google Cloud Storage) channels.
The configuration for GCS data source is specified below:
| Field | Description |
|---|---|
| Connection Name | Select GCP connection name for establishing connection. |
| Bucket Name | Provide path of the file for Google storage bucket name. |
| Path | Provide value for the end path with * in case of directory. For e.g. outdir.* |
Note:
The user can add configuration by clicking at the ADD CONFIGURATION button.
Next, in the Detect Schema window, the user can set the schema as dataset by clicking on the Save As Dataset checkbox.
The Incremental Read option will be in GCS batch data source and not in the GCS Streaming channel.
Configure Pre-Action in Source →
If you have any feedback on Gathr documentation, please email us!