- 4870 Views
- 3 replies
- 0 kudos
Azure Databricks with metastore, cannot create managed table
We have set up Azure Databricks with Unity Catalog (metastore) in an ADLS Gen2 storage account.Used Managed Identity (Databricks Access Connector) for connection from workspace(s) to ADLS Gen2ADLS Gen2 storage account has Storage Blob Data Owner and ...
- 4870 Views
- 3 replies
- 0 kudos
- 0 kudos
@m997al Were you able to resolve this issue? I have same issue as you described. I am able to upload into Volumes but not able to create managed tables in ADLS metastore storage account..
- 0 kudos
- 3663 Views
- 2 replies
- 0 kudos
Resolved! System tables in Azure with private link
Hi,Is there any restriction on what is able to be enabled with System tables when using Azure Databricks with a private link connection? And is there a way around the restriction (that is secure)?In a public network I am able to enable the following...
- 3663 Views
- 2 replies
- 0 kudos
- 0 kudos
Turns out it was an issue with Microsoft somewhere, they've now fixed it and all the system schemas have been enabled that I can enable"schemas":[{"schema":"operational_data","state":"UNAVAILABLE"},{"schema":"access","state":"ENABLE_COMPLETED"},{"sch...
- 0 kudos
- 6966 Views
- 3 replies
- 1 kudos
Unable to access all schemas in system catalog
https://docs.databricks.com/en/administration-guide/system-tables/index.htmlBased on this documentation, there should be a bunch of schemas in the system catalog and when trying to list them all, I can only see the INFORMATION_SCHEMA in the system ca...
- 6966 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi Team, If you have any particular solution for this, then please share as I am also unable to access any system tables I enabled in 2023 August now!!
- 1 kudos
- 1653 Views
- 1 replies
- 0 kudos
Dashboard update through API
Hi,I would like to create / update dashboard definition based on the json file. How can one do it? I tried the following:databricks api post /api/2.0/preview/sql/dashboards/$dashboard_id --json @file.jsonBut it does not update the widgetsdatabricks a...
- 1653 Views
- 1 replies
- 0 kudos
- 2685 Views
- 1 replies
- 0 kudos
Approval required when connecting Tableau Desktop to Azure Databricks
My users want to connect Tableau Desktop to Azure Databricks. I have tested this myself as Administrator of the databricks workspace and it works fine. One of my users can connect to Azure databricks fine and run notebooks. However when he connects T...
- 2685 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, Could you please send the whole screenshot? Is it asking to login to azure and asking Azure's approval or Databricks?
- 0 kudos
- 7331 Views
- 4 replies
- 3 kudos
Spark jobs not starting for saving
I am having issues with a new workspace that has been created and having trouble diagnosing what the issue is.It seems to be related to compute resources, spark and storage.I am an admin and able to create compute resources. Using SQL warehouses I ca...
- 7331 Views
- 4 replies
- 3 kudos
- 3 kudos
ok looks like it might be this for us....You must have a separate pair of host/container subnets for each workspace that you deploy. It is unsupported to share subnets across workspaces or to deploy other Azure resources on the subnets that are used ...
- 3 kudos
- 4286 Views
- 2 replies
- 1 kudos
Not able to edit the user group entitlement
I am workspace admin , but when editing the entitlement (allow unrestricted cluster creation) of user group, it is not happening, it gives a prompt to confirm the remove, but evening after confirming it does not get removes. after clicking remove , i...
- 4286 Views
- 2 replies
- 1 kudos
- 1678 Views
- 0 replies
- 0 kudos
"Forgot my password" does not send mail to users in my organization.
Hi, we are using databricks in my organization. SSO logins stopped working for us about a week ago. As a workaround, we asked our users to use the admin login page, and use their organization passwords. This didn't work because the passwords were inc...
- 1678 Views
- 0 replies
- 0 kudos
- 2436 Views
- 0 replies
- 0 kudos
HIPAA compliance "pay-as-you-go" option
Hi does Databricks offer HIPAA compliance with the "pay-as-you-go" option? I know that Snowflake has the ability to do that, what about Databricks?
- 2436 Views
- 0 replies
- 0 kudos
- 9399 Views
- 2 replies
- 1 kudos
Resolved! Unity Catalog - Lakehouse Federation: Permission to read data from foreign catalogs
I have seup connection "SQL-SV-conn" to SQL Server and based on that connection I have created foreign catalog "FC-SQL-SV".I have granted All permission on CATALOG to developers:Use CatalogUse SchemaSelectBut they can not query table (e.g. by running...
- 9399 Views
- 2 replies
- 1 kudos
- 1 kudos
OK, I have found out the answer in below docummentation:https://learn.microsoft.com/en-us/azure/databricks/query-federation/#limitationsSingle-user access mode is only available for users that own the connection.So when I use e.g. Job Cluster that ru...
- 1 kudos
- 4016 Views
- 0 replies
- 1 kudos
Workspace Model Registry with Unity Catalog
if the "default catalog for the workspace" is to Unity Catalog, how can we access a model from the workspace model registry?I have already tried mlflow.set_tracking_uri("databricks") but still try to find catalog in UC.
- 4016 Views
- 0 replies
- 1 kudos
- 2961 Views
- 0 replies
- 0 kudos
Specify cidr when using aws quick start template
Hello,I want to create a new databricks workspace using aws quick start template. However, I want to specify a cidr address that is specified by our network administration. Is it possible to do that. From what I read, the quick start template does no...
- 2961 Views
- 0 replies
- 0 kudos
- 6466 Views
- 1 replies
- 1 kudos
Resolved! Security and vulnerability for Azure databricks clusters in Data Plane
Microsoft defender is not supported for azure databricks clusters. Can someone point me to a document which describe how the security vulnerabilities are reported and fixed for azure databricks clusters in data plane.
- 6466 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi Aria,can you check this link?Basically Databricks checks for vulnerabilities and does pentesting etc."Databricks will use commercially reasonable efforts to address critical vulnerabilities within 14 days, high severity within 30 days, and medium ...
- 1 kudos
- 3922 Views
- 1 replies
- 0 kudos
Automatic UC enablement with existing Unity Catalog
Hello,The environment I'm working in has an existing account and unity catalog in our primary region. These have been primarily PoC, and have existed for a year or so.Now we're building out our IaC and getting ready to move towards production. In new...
- 3922 Views
- 1 replies
- 0 kudos
- 3324 Views
- 1 replies
- 0 kudos
Connect to Salesforce
Curious if there's a Databricks connector for Salesforce on AWS?
- 3324 Views
- 1 replies
- 0 kudos
- 0 kudos
There is no "databricks" connector like the on you have in Unity Fedarating e.g. for Snowflake.You can use partner ecosystem e.g. Fivetran https://www.fivetran.com/connectors/salesforceto integrate Salesforce data to your Lakehouse. You also have spa...
- 0 kudos
