topic Re: How can I make Databricks API calls from notebook? in Data Engineering

How can I make Databricks API calls from notebook?

User16752245312 — Thu, 10 Jun 2021 17:04:02 GMT

Access to Databricks APIs require the user to authenticate. This usually means creating a PAT (Personal Access Token) token. Conveniently, a token is readily available to you when you are using a Databricks notebook.

databricksURL = dbutils.notebook.entry_point.getDbutils().notebook().getContext().apiUrl().getOrElse(None)
myToken = dbutils.notebook.entry_point.getDbutils().notebook().getContext().apiToken().getOrElse(None)

Thus you don't need to generate and manage a token yourself.

import requests
 
header = {'Authorization': 'Bearer {}'.format(myToken)}
endpoint = '/api/2.0/jobs/runs/list'
payload = """{"limit": "5", "offset": "0"}"""
 
resp = requests.get(
  databricksURL + endpoint,
  data=payload,
  headers=header
)

Re: How can I make Databricks API calls from notebook?

519320 — Tue, 22 Aug 2023 01:43:21 GMT

hmmm.... no resolution yet?

Re: How can I make Databricks API calls from notebook?

StephanieAlba — Wed, 03 Jul 2024 14:10:34 GMT

This was a question and answer in one

Re: How can I make Databricks API calls from notebook?

Panda — Fri, 18 Oct 2024 10:32:25 GMT

@User16752245312 You can use Databricks Secret Scope to manage sensitive data such as personal access tokens (PATs) securely. Storing your token in a secret scope ensures you don’t hard-code credentials in your notebook, making it more secure.
For more details how to use Databricks REST API