cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Changes in Databricks rest api

Databrixer
New Contributor II

Hi all, 
Just wanted to ask if there is an announcement regarding changes on Databricks REST API?  
Because I had weird experiences in using the REST API. 
Specifically for Query History API 

Last Aug 29, 2024. 
I created a script to pull get request in the endpoint. I saw a key in the response named: 

'query_source': {'driver_info': {'driver_name': '', 'version_number': '2.0', etc..'},

I can get all the response but not with that specific key. (use case is to determine where it is used ex:NB, Genie space, etc.) 
I checked the query params, but there is nothing related to query_source. I even also enabled metrics, still no luck. 

But then with my playful mind, I added this on my parameters: 
"include_query_source": 'true', - which is not part of the documentation - and you guess it, it worked. 


Now as I am writing this, the 'query_source' is now missing in the response sample in the documentation. But still works. 
It is better if we have and announcement regarding the changes of the endpoints because this might cause issues in the future when we decide to create a workflow for this kind of use case. 

2 REPLIES 2

szymon_dybczak
Contributor III

Yeah, totally agree with you. It should be documented/mentioned somewhere. Or maybe the API should be versioned, so if they introduce a new version, it won't break existing workflows.
Anyway, thanks for sharing!

Agree. They have announcements on other endpoints in the documentation but it is better to have a dedicated page for the list of versions. 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group