Databricks API - Create Connection
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-08-2024 03:02 AM
Hi,
Is it possible to use the Databricks API to create a connection to a different Azure Databricks workspace?
Thanks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-08-2024 03:14 AM
No. You can use either Unity Catalog, Databricks Connect, Delta Sharing or DBFS mounts to access data in another databricks workspace (with its own cloud storage)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-08-2024 03:28 AM
It is possible to create a connection and create a foreign catalog which uses this connection, through the Databricks UI . For some reason, the Databricks API doesn't seem to be able to handle creating the connection to a different Databricks workspace.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-08-2024 03:43 AM - edited 07-08-2024 03:45 AM
Ah you mean a connection inside Unity Catalog, that wasn't really clear from the starting post.
I've done all of this with Terraform, so there must be an API available for it. Here it is: https://docs.databricks.com/api/azure/workspace/connections/create.
For creating a Databricks to Databricks connection, you'll have to either set Unity Catalog permissions or remove the catalog isolation in the workspaces.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-08-2024 03:55 AM
My apologies for not being cleared in the first post.
Terraform can handle it. The API is probably behind and can't handle the connection to Databricks yet. The best solution would probably be to just move to Unity Catalog...
Thanks for your quick reply

