cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

How can i run a single task in job from Rest API

200842
New Contributor

How can I run a single task in a job that has many tasks?
I can do it in the UI, but I canโ€™t find a way to do it using the REST API. Does anyone know how to accomplish this?

1 ACCEPTED SOLUTION

Accepted Solutions

Ayushi_Suthar
Databricks Employee
Databricks Employee

Hi @200842 , Greetings! 

It is currently not possible to run a single task or a group of tasks from a job without running the entire job from the API. 

Leave a like if this helps, followups are appreciated.
Kudos,

Ayushi

View solution in original post

2 REPLIES 2

Ayushi_Suthar
Databricks Employee
Databricks Employee

Hi @200842 , Greetings! 

It is currently not possible to run a single task or a group of tasks from a job without running the entire job from the API. 

Leave a like if this helps, followups are appreciated.
Kudos,

Ayushi

themattmorris
New Contributor III

It looks like this may be a possibility now? I haven't actually tried it, but I noticed a parameter named "only" has been added to the Databricks SDK for when running a job.

 

Here is the commit that made the change: [Release] Release v0.38.0 (#826) ยท databricks/databricks-sdk-py@d516d1e

And here is the line on the main branch as of right now: databricks-sdk-py/databricks/sdk/service/jobs.py at f2472bf98160bd4556efbb575b68c5375b2e902e ยท datab...

The Databricks API docs doesn't display this parameter, but it seems this is a feature that is either coming or already works. It may be worth trying out.

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local communityโ€”sign up today to get started!

Sign Up Now