Manage IBM Spectrum Conductor
Gathr uses IBM Spectrum Conductor, a spark engine utilized to run ETL jobs. It also provides high-performance cluster management capabilities to efficiently manage and keep your Spark clusters running reliably throughout their lifecycle. The First step in Gathr -IBM Conductor integration is to register an already created IBM Spectrum Conductor’s Cluster in Gathr.
Click REGISTER CLUSTER button. Provide the below fields for creating a new cluster.
| Field | Description |
|---|---|
| Cluster Name | Provide a unique name to register an already available IBM Conductor cluster. |
| Cluster Tags | Provide tags for easy identification of the registering cluster. |
| Base Rest Url | Provide a valid base REST URL, that will be used to fetch cluster instances and job details in Gathr. e.g. <HTTP_PROTOCOL://HOST:IBM_RESTPORT//platform/rest |
| Distributed Jar Path | This distributed Jar path will be utilized by gathr pipelines to upload the pipeline artifacts such as gathr uber jar, custom code jar and other data files that are part of gathr. |
Under the Credentials tab, the below options are provided:
| Field | Description |
|---|---|
| IBM Credential Type | Select security configuration from the drop down list of available options. Select None if security configuration is not required. |
| User Name | Provide the EGO username. |
| Password | Provide the EGO password. |
Click Register button.
You can ADD CONFIGURATION under the Additional Configuration tab.
Once the IBM Spectrum Conductor cluster is registered, the registered cluster will be listed on the Clusters listing page.
The cluster can be unmapped by clicking at the Deregister button under Actions tab.
You can also edit and update the datails of the registered cluster by clicking at the Edit option available under Actions tab.
You will be navigated to the Instance Group list of the registered cluster upon clicking the View Instance option under Actions tab.
If you have any feedback on Gathr documentation, please email us!