Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
I am creating cluster using rest api call but every-time it is creating all purpose cluster. Is there a way to create job cluster and run notebook using python code?
job_cluster_key
string
[ 1 .. 100 ] characters
^[\w\-\_]+$
If job_cluster_key, this task is executed reusing the cluster specified in job.settings.job_clusters.
