cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Docs/Info for metastore, artifact blob storage endpoints etc for Azure Databricks

GuyPerson
New Contributor

Hi! This is probably a very newbie type of question and my google skills seems to be lacking but is there any in depth documentation/explanations of the metastore, artifact blob storage, system tables storage, log blob storage and event hubs services which endpoints you need to reach from your Azure Databricks workspace? The fqdn's for the different services are well documented here: IP addresses and domains for Azure Databricks services and assets - Azure Databricks | Microsoft Lea.... But I have some trouble of grasping of what most of them actually do and where they're located and who has access to the services (customer? databricks?). Can someone here point me in the right direction for any documentation?

I understand that artifact blob storage is neccessary to reach in order for the workspace to pull runtimes from a databricks managed storage to the workspace clusters but the other ones are a bit of a mystery.

Is it for example neccessary to reach the hive metastore fqdn (consolidated-australiacentral-prod-metastore.mysql.database.azure.com) when you use Unity Catalog?

And from what I think I can understand, the system tables storage, log blob storage and event hubs services are all located at and managed by Azure Databricks and not at the customers tenant/subscription. What information is sent there?

Sorry for a lot of probably very simple and stupid questions but for some reasons I can't seem to find any documentation about it.

 

0 REPLIES 0

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group