- 957 Views
- 2 replies
- 0 kudos
Move metastore to another azure subscription
Hi, We need to migrate our metastore with Unity Catalog to a new Azure subscription while remaining in the same Azure region. Currently, we have two workspaces attached to a single Unity Catalog. I’m looking for the best approach to move the metastor...
- 957 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @alesventus,There are few points to be considered before migrating from One metastore to another. We need to see how the catalogs, schemas and tables are created as of now.If you have created everything has managed like managed catalog, schema and...
- 0 kudos
- 2331 Views
- 7 replies
- 2 kudos
Resolved! Reporting serverless costs to azure costs
So, we've just recently applied serverless budget polices to some of our vector searches and apps. At the moment they're all going to azure under one general tag that we created.However, we needed more definition. So i added the serverless budget pol...
- 2331 Views
- 7 replies
- 2 kudos
- 2 kudos
OK, so raised it with MS, they raised it with Databricks, turns out it's behaving as expected. Serverless billing isn't enabled on vector searches or apps. However, there is a plan to add them to the billing process. This piece of work is planned to ...
- 2 kudos
- 609 Views
- 2 replies
- 0 kudos
Share notebooks with a AD-user assigned via group
Hi everybody,I try to share a notebook with a user that was assigned to the workspace via a AD-Group (using the new automatic sync). But I only see users directly assigned to the workspace. My expectation would be that I see all users that are within...
- 609 Views
- 2 replies
- 0 kudos
- 0 kudos
Here are some helpful tips/tricks, and general guidance. Sharing notebooks with users who are members of Active Directory (AD) groups can sometimes be challenging due to the way Azure Databricks handles user permissions. Here are some important poi...
- 0 kudos
- 2841 Views
- 1 replies
- 0 kudos
Workspace creation is getting failed constanly
We are trying to create a workspace with custome VPC. But the creation is getting failed constantly.The error doesn't have any description which makes the troubleshoting hard.Does anyboday had similar issue like this before and has a solution? Thanks...
- 2841 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi Nisha, If you are still having the issue, I recommend opening a Support ticket with the workspace ID and any error details so that we can investigate. Regards Kamal
- 0 kudos
- 918 Views
- 4 replies
- 3 kudos
Resolved! Connecting Azure databricks with firewall enabled Azure storage account
Hi I am trying to connect from Azure Databrick workspace to Azure gen2 storage account securely. The storage account is set up with these options1. Enabled from selected virtual networks and IP addresses- we whitelisted few ips 2. Added Microsoft.Dat...
- 918 Views
- 4 replies
- 3 kudos
- 3 kudos
Thanks Szymon, Yes, I have the exact set up as the above and the access connectors are added to the allowed resource instances list and they have contributor role on the storage account. With the above set up, are you able to read/write to the storag...
- 3 kudos
- 852 Views
- 1 replies
- 1 kudos
Resolved! Databricks Apps - X-Forwarded-Access-Token not available
Hi all,I've recently been getting started with Databricks Apps, and have been trying to use on-behalf-of access. However, it seems that the X-Forwarded-Access-Token is not coming through in my app headers. I have lots of other X-Forwarded ones such a...
- 852 Views
- 1 replies
- 1 kudos
- 1 kudos
For anybody who comes across this post with the same issue, this issue is caused by enabling the on-behalf-of preview after deploying an App. The solution is to fully stop the App and then start it again after the preview has been enabled. Redeployin...
- 1 kudos
- 310 Views
- 0 replies
- 0 kudos
Establish Cross cloud connectivity between Azure Databricks and AWS s3
Hello.We have the cross cloud configuration set as below:AWS - VPC, Transit Gateways, AWS Direct ConnectOn Premise Data centerAzure - Vnet, Transit Vnet , Express Route.We are trying to create a Databricks storage credential as below. The AWS IAM obj...
- 310 Views
- 0 replies
- 0 kudos
- 921 Views
- 2 replies
- 0 kudos
Error with file events in external location (via pub/sub)
Hi everyone!I am new here and in Databricks world.I was trying to enable a trigger event on file uploading in GCP bucket in order to start a job following this tutorial: https://docs.databricks.com/gcp/en/connect/unity-catalog/cloud-storage/manage-ex...
- 921 Views
- 2 replies
- 0 kudos
- 0 kudos
Hey @hmnilp did you contact databricks, may be there is a feature to be enabled.
- 0 kudos
- 451 Views
- 0 replies
- 1 kudos
Databricks Usage Dashboard - Tagging Networking Costs
Problem OverviewOur team has successfully integrated Azure Databricks Usage Dashboards to monitor platform-related costs. This addition has delivered valuable insights into our spending patterns. However, we've encountered a tagging issue that's prov...
- 451 Views
- 0 replies
- 1 kudos
- 21994 Views
- 26 replies
- 26 kudos
Resolved! Unable to login to Azure Databricks Account Console
I have a personal Azure pay-as-you-go subscription in which I have the 'Global Administrator' role. I am also the databricks account administrator.Until two weeks ago, I was able to access the databricks account console without any issues, but I am f...
- 21994 Views
- 26 replies
- 26 kudos
- 26 kudos
Hi @RameshRetnasamy thanks for your solution.I was able to login to Databricks Account Console but was unable to set the metastore path.Something got broke along the way.It would definitely be beneficial if we could have the same email address for ou...
- 26 kudos
- 5639 Views
- 8 replies
- 1 kudos
Resolved! Creating Azure Databricks Workspace Without NAT Gateway
Hello,Recently, when I create a new Databricks workspace on Azure, it automatically create a NAT Gateway which incurs additional cost !When creating the workspace, I don't choose secure cluster connectivity, so I'm expecting not to have a NAT Gateway...
- 5639 Views
- 8 replies
- 1 kudos
- 1 kudos
Make sure to disable the following option when creating your workspace, as it has recently become enabled by default.Deploy Azure Databricks workspace with Secure Cluster Connectivity (No Public IP)
- 1 kudos
- 817 Views
- 2 replies
- 1 kudos
Resolved! How do I access Hive Metastore via API?
Hi,Is there any Databricks REST API to directly access Hive Metastore tables (like list of tables, schemas, columns) without using Unity Catalog or SQL Warehouse?I’m specifically looking to fetch metadata from hive_metastore.Thanks.
- 817 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Ninad-Mulik ,As far as I know, there’s no Databricks REST API to directly access Hive Metastore metadata without using Unity Catalog or SQL Warehouses. The legacy Hive Metastore only supports SQL-based queries. REST APIs for metadata access are o...
- 1 kudos
- 798 Views
- 1 replies
- 1 kudos
Resolved! Guidance on Managing Databricks Apps Whitelisting
Hi,Our workspace users currently have permissions to create Databricks apps, and we’ve observed a rise in associated costs. To address this, we’re developing an administrative notebook to:Check whether an app is whitelisted/approved from the admins.A...
- 798 Views
- 1 replies
- 1 kudos
- 1 kudos
Here are some helpful tips that you might find useful: Summary of Best Practices and Recommendations for App Whitelisting and Automated App Removal in Databricks 1. Overview and Whitelisting Strategy To control costs and maintain governance over Da...
- 1 kudos
- 2517 Views
- 1 replies
- 0 kudos
Delete Azure Databricks Workspace resource but reference remains in Account Console
As the title says. I have deleted both the Azure Databricks Workspace resource and the resource group it was located in. However, I can still see the workspace in the account console. Also, it appears in the response from GET https://accounts.azureda...
- 2517 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi Kim3, same problem here, did you find a solution for this?Thanks!
- 0 kudos
- 899 Views
- 4 replies
- 0 kudos
Not able to connect to GCP Secret Manager except when using "No isolation shared" Cluster
Hey everyone,We’re trying to access secrets stored in GCP Secret Manager using its Python package from Databricks on GCP. However, we can only reach the Secret Manager when using "No Isolation Shared" clusters, which is not an option for us. Currentl...
- 899 Views
- 4 replies
- 0 kudos
- 0 kudos
@yumnus did you ever resolved this error when cluster Is not "No isolation shared" ?
- 0 kudos
