Streaming Delta Data Source
On Delta Lake Channel, you should be able to read data from delta lake table on S3, HDFS or DBFS.
Configuring a Streaming Delta Data Source.
| Field | Description |
|---|---|
| Source | Mention the source name. |
| Connection Name | Select the connection name from the available list of connections, from where you would like to read the data. |
| Override Credentials | Check-mark the checkbox. Provide the username through which the Hadoop service is running. |
| HDFS File Path | Provide file path of the HDFS file system. |
| S3 Protocol | S3 protocol to be used. |
| Bucket Name | Mention Bucket Name. |
| Path | Sub-directories of the bucket name mentioned above to which the data is to be written on. |
| Add configuration | To add additional custom properties in key-value pairs. |
If you have any feedback on Gathr documentation, please email us!