Working with Spark Connect
These methods allow you to work remotely with a Cloud Spark cluster via the Spark Connect client.
Pass paths to jar files, Maven packages, and alternative repositories to the Cloud Spark cluster via Spark Connect.
Required token role: Administrator. Learn more about token roles.
Argument | Type | Description |
|---|---|---|
(required) |
| The Cloud Spark cluster ID. The list of Cloud Spark clusters and their IDs can be obtained using the get_clusters method |
(optional) |
| A list of paths to jar files or the value |
(optional) |
| A list of paths to Maven packages or the value |
(optional) |
| A list of paths to alternative repositories or the value |
An object of the K8sSparkConnectSettings class, which contains information about the Spark server settings.