cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Is there any way to create Databricks jobCluster through Databricks connect

mofa1995
New Contributor III

Is there any way to create Databricks jobCluster through Databricks connect We are using All purposed cluster so far, to reduce Databricks cost we are planning to go ahead with jobCluster but unfortunately, I couldn't find a way to create jobCluster through Databricks connect. Or is there any alternate way to by-pass the Databricks connect and create job cluster through IDE PyCharm

 
1 REPLY 1

Kaniz_Fatma
Community Manager
Community Manager

Hi @mofa1995 , Databricks Connect does not provide functionality to create job clusters directly.

However, you can create a job cluster by using the Databricks Jobs REST API or the Databricks CLI.You need to set up the Databricks CLI to call the Jobs REST API 2.0 or 2.1.

You can do this by running the command databricks jobs configure --version=2.0 or databricks jobs configure --version=2.1. This adds the setting jobs-api-version = 2.0 or jobs-api-version = 2.1 to the file ~/.databrickscfg on Unix, Linux, or macOS, or %USERPROFILE%\.databrickscfg on Windows. All jobs CLI (and job runs CLI) subcommands will call the Jobs REST API 2.0 or 2.1 by default.

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!