cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Global search programatically

jrosend
New Contributor III

Hi!

At the workspace header, there is a search box that allow us to look for a text in all notebooks in the workspace. 

Is there a way via CLI or API to call the global search https://<workspace-domain>/graphql/SearchGql so the result can be analysed automaticaly with a script? I couldn`t find a way in the documentation.

Right now I'm having to download all notebooks (API) to execute the search locally. The download itself takes too long (several hours) for there are thousands of notebooks across multiple workspaces. Even if i multithread, there's a limit of 30 requests per second. I also have to account for unsupported file formats and path size limitations.

So it would be best to use Databicks indexing to make this faster.

The request itself uses cookies to get the session ID and authenticate (I think) and I don't know how to reproduce it, say, in postman.

Is there a way to use a user token instead?

Thanks!

2 REPLIES 2

Tharun-Kumar
Databricks Employee
Databricks Employee

@jrosend 

We do not have an API for searching workspace objects as of now. We already have an internal ticket for this request but we don't have an ETA for preview yet.

-werners-
Esteemed Contributor III

if you checked in the notebooks into a git repo, the search in the git repo (or API) might save you.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group