- 6854 Views
- 6 replies
- 4 kudos
Migration of Unity Catalog files with Databricks migration tool
Hi there,I'm currently migrating Databricks (metastores, workspaces, etc.) from Azure to AWS using the Databricks migration tool. During the migration process and after digging in the code, I've come to the conclusion that the tool only supports a mi...
- 6854 Views
- 6 replies
- 4 kudos
- 4 kudos
@Nino Weingart​ :Q1: You are correct that the Databricks migration tool only supports migration of the built-in Hive metastore and not custom metastores in Unity Catalog. If you want to migrate custom metastores, you would need to extend the code and...
- 4 kudos
- 3505 Views
- 4 replies
- 3 kudos
What is best practice for organising simple desktop-style analytics workflows in Databricks?
Apologies in advance for the soft question, but I'm genuinely struggling with this.We're a small data science unit just setting up in Databricks. While we do run some intensive ETL and analytics jobs, a non-trivial part of the team's BAU is explorato...
- 3505 Views
- 4 replies
- 3 kudos
- 3 kudos
Hi @Jason Millburn​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answer...
- 3 kudos
- 16335 Views
- 6 replies
- 6 kudos
Resolved! DBFS mounts no longer recommended?
Checking the docs I noticed this statement under Azure storage access page:[https://learn.microsoft.com/en-us/azure/databricks/external-data/azure-storage]Deprecated patterns for storing and accessing data from Azure DatabricksThe following are depre...
- 16335 Views
- 6 replies
- 6 kudos
- 6 kudos
You don't need to mount to dbfs. The security issue with mounting is that as soon as you've mounted using a credential, everyone with access to the workspace now has access to the data at that mounted location.The recommended way that isn't mounting ...
- 6 kudos