4 weeks ago
I need to obtain a list of my Databricks workflows with their job IDs in a notebook Databricks
4 weeks ago
@VabethRamirez - Please find the below code snippet. Kindly modify according to your needs.
import requests, json
# Set the Databricks API URL. <eg. dbi.databricks.cloud.com>
api_url = 'https://<URL>/api/2.1'
# Set the Databricks token
token = '<API token>'
# Get a list of all jobs
jobs_endpoint = f"{api_url}/jobs/list"
headers = {
'Authorization': f"Bearer {token}",
'Content-Type': 'application/json'
}
response = requests.get(jobs_endpoint, headers=headers)
if response.status_code == 200:
# Extract the list of jobs
jobs = response.json()['jobs']
# Print the job names and IDs
for job in jobs:
print(f"Job ID: {job['job_id']}, Job Name: {job['settings']['name']}")
else:
print(f"Failed to retrieve jobs. Status Code: {response.status_code}")
4 weeks ago
Can you check if this post answers you question: https://community.databricks.com/t5/community-discussions/reading-workflow-items/td-p/61277
4 weeks ago
@VabethRamirez - Please find the below code snippet. Kindly modify according to your needs.
import requests, json
# Set the Databricks API URL. <eg. dbi.databricks.cloud.com>
api_url = 'https://<URL>/api/2.1'
# Set the Databricks token
token = '<API token>'
# Get a list of all jobs
jobs_endpoint = f"{api_url}/jobs/list"
headers = {
'Authorization': f"Bearer {token}",
'Content-Type': 'application/json'
}
response = requests.get(jobs_endpoint, headers=headers)
if response.status_code == 200:
# Extract the list of jobs
jobs = response.json()['jobs']
# Print the job names and IDs
for job in jobs:
print(f"Job ID: {job['job_id']}, Job Name: {job['settings']['name']}")
else:
print(f"Failed to retrieve jobs. Status Code: {response.status_code}")
4 weeks ago
4 weeks ago
Thank you for sharing!
2 weeks ago
Hi @VabethRamirez ,
Also, instead of using directly the API, you can use databricks Python sdk :
%pip install databricks-sdk --upgrade
dbutils.library.restartPython()
from databricks.sdk import WorkspaceClient
w = WorkspaceClient()
job_list = w.jobs.list(expand_tasks=False)
Additional examples : https://github.com/databricks/databricks-sdk-py/tree/main/examples
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.