VK Cloud logo

Working with Spark Connect

These methods allow you to work remotely with a Cloud Spark cluster via the Spark Connect client.

add_spark_connect_jars

Pass paths to jar files, Maven packages, and alternative repositories to the Cloud Spark cluster via Spark Connect.

Required token role: Administrator. Learn more about token roles.

Method arguments

Argument

Type

Description

cluster_id

(required)

str

The Cloud Spark cluster ID.

The list of Cloud Spark clusters and their IDs can be obtained using the get_clusters method

jars

(optional)

list[str]

A list of paths to jar files or the value None. Default value: None

packages

(optional)

list[str]

A list of paths to Maven packages or the value None. Default value: None

repositories

(optional)

list[str]

A list of paths to alternative repositories or the value None. Default value: None

Return value

An object of the K8sSparkConnectSettings class, which contains information about the Spark server settings.

Method signature and usage example

Was this article helpful?