Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-18-2024 03:47 AM
Hi,
You can check below:
System Tables Storage
- Purpose: System tables storage is used to store system-level metadata and configuration data for the Azure Databricks workspace.
- Data Stored: This includes metadata related to the Unity Catalog, cluster configurations, job metadata, and other system-level information necessary for the workspace's operation and management.
Metastore
- Purpose: The metastore is used to store metadata about the data stored in your Azure Databricks workspace.
- Data Stored: Metadata such as table definitions, schema information, and other structural data.
Artifact Blob Storage
- Purpose: This storage is necessary for the workspace to pull runtimes from Databricks-managed storage to the workspace clusters.
- Data Stored: Artifacts such as libraries, JAR files, and other runtime dependencies.
Log Blob Storage
- Purpose: Used for storing logs generated by the Databricks workspace.
- Data Stored: Logs related to cluster operations, job executions, and other workspace activities.
Event Hubs
- Purpose: Used for streaming data and event processing.
- Data Stored: Event data and streaming logs.
> These services are essential for the operation and management of the Azure Databricks workspace. The data stored in these services is primarily related to the management and operation of the workspace and does not include the customer's actual data.
> The details of the addresses for these are provided here https://learn.microsoft.com/en-us/azure/databricks/resources/ip-domain-region#metastore-etc