cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

pawelzak
by New Contributor III
  • 1348 Views
  • 1 replies
  • 0 kudos

Dashboard update through API

Hi,I would like to create / update dashboard definition based on the json file. How can one do it? I tried the following:databricks api post /api/2.0/preview/sql/dashboards/$dashboard_id --json @file.jsonBut it does not update the widgetsdatabricks a...

  • 1348 Views
  • 1 replies
  • 0 kudos
bric-a-brac
by New Contributor
  • 2352 Views
  • 1 replies
  • 0 kudos

Approval required when connecting Tableau Desktop to Azure Databricks

My users want to connect Tableau Desktop to Azure Databricks. I have tested this myself as Administrator of the databricks workspace and it works fine. One of my users can connect to Azure databricks fine and run notebooks. However when he connects T...

image-20240105-123145.png
  • 2352 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Hi, Could you please send the whole screenshot? Is it asking to login to azure and asking Azure's approval or Databricks? 

  • 0 kudos
OwenDB
by New Contributor III
  • 6660 Views
  • 4 replies
  • 3 kudos

Spark jobs not starting for saving

I am having issues with a new workspace that has been created and having trouble diagnosing what the issue is.It seems to be related to compute resources, spark and storage.I am an admin and able to create compute resources. Using SQL warehouses I ca...

  • 6660 Views
  • 4 replies
  • 3 kudos
Latest Reply
OwenDB
New Contributor III
  • 3 kudos

ok looks like it might be this for us....You must have a separate pair of host/container subnets for each workspace that you deploy. It is unsupported to share subnets across workspaces or to deploy other Azure resources on the subnets that are used ...

  • 3 kudos
3 More Replies
Kroy
by Contributor
  • 3720 Views
  • 2 replies
  • 1 kudos

Not able to edit the user group entitlement

I am workspace admin , but when editing the entitlement (allow unrestricted cluster creation) of user group, it is not happening, it gives a prompt to confirm the remove, but evening after confirming it does not get removes. after clicking remove , i...

Kroy_0-1704885328747.png Kroy_1-1704885377008.png
  • 3720 Views
  • 2 replies
  • 1 kudos
Latest Reply
Avvar2022
Contributor
  • 1 kudos

is your workspace untiy catalog enabled?

  • 1 kudos
1 More Replies
Wojciech_BUK
by Valued Contributor III
  • 7936 Views
  • 2 replies
  • 1 kudos

Resolved! Unity Catalog - Lakehouse Federation: Permission to read data from foreign catalogs

I have seup connection "SQL-SV-conn" to SQL Server and based on that connection I have created foreign catalog "FC-SQL-SV".I have granted All permission on CATALOG to developers:Use CatalogUse SchemaSelectBut they can not query table (e.g. by running...

Administration & Architecture
Foreign Catalog
Lakehouse Federation
Unity Catalog
  • 7936 Views
  • 2 replies
  • 1 kudos
Latest Reply
Wojciech_BUK
Valued Contributor III
  • 1 kudos

OK, I have found out the answer in below docummentation:https://learn.microsoft.com/en-us/azure/databricks/query-federation/#limitationsSingle-user access mode is only available for users that own the connection.So when I use e.g. Job Cluster that ru...

  • 1 kudos
1 More Replies
sachinw
by New Contributor II
  • 3693 Views
  • 0 replies
  • 1 kudos

Workspace Model Registry with Unity Catalog

if the "default catalog for the workspace" is to Unity Catalog, how can we access a model from the workspace model registry?I have already tried  mlflow.set_tracking_uri("databricks") but still try to find catalog in UC.  

  • 3693 Views
  • 0 replies
  • 1 kudos
Aria
by New Contributor III
  • 4316 Views
  • 1 replies
  • 1 kudos

Resolved! Security and vulnerability for Azure databricks clusters in Data Plane

Microsoft defender is not supported for azure databricks clusters. Can someone point me to a document which describe how the security vulnerabilities are reported and fixed for azure databricks clusters in data plane.

Administration & Architecture
security vulnerability patch dataplane
  • 4316 Views
  • 1 replies
  • 1 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 1 kudos

Hi Aria,can you check this link?Basically Databricks checks for vulnerabilities and does pentesting etc."Databricks will use commercially reasonable efforts to address critical vulnerabilities within 14 days, high severity within 30 days, and medium ...

  • 1 kudos
leelee3000
by Databricks Employee
  • 2980 Views
  • 1 replies
  • 0 kudos

Connect to Salesforce

Curious if there's a Databricks connector for Salesforce on AWS? 

  • 2980 Views
  • 1 replies
  • 0 kudos
Latest Reply
Wojciech_BUK
Valued Contributor III
  • 0 kudos

There is no "databricks" connector like the on you have in Unity Fedarating e.g. for Snowflake.You can use partner ecosystem e.g. Fivetran https://www.fivetran.com/connectors/salesforceto integrate Salesforce data to your Lakehouse. You also have spa...

  • 0 kudos
riturralde-p
by New Contributor II
  • 3906 Views
  • 1 replies
  • 1 kudos

How to allocate costs per SQL query?

By using System Tables (systen.billing.usage) I'm able to identity DBU usage per query, but I'm not able to identify who ran each query because is not part of the table. I'm also aware of query history where all the queries and who ran them is listed...

  • 3906 Views
  • 1 replies
  • 1 kudos
Latest Reply
riturralde-p
New Contributor II
  • 1 kudos

thanks @Retired_mod for the reply, however query_id is not part of the system.billing.usage table, so no way to join them by IDs. What my Databricks account team suggested me is to join them by timestamps since both tables contain a column like that....

  • 1 kudos
lgepp11
by New Contributor III
  • 4952 Views
  • 2 replies
  • 0 kudos

NPIP tunnel setup failure during launch

In AWS with this current error when spinning up the SQL warehouse or personal compute.Backend private link is enabled.Error: NPIP tunnel setup failure during launch. Please try again later and contact Databricks if the problem persists. Instance boot...

  • 4952 Views
  • 2 replies
  • 0 kudos
Latest Reply
User16539034020
Databricks Employee
  • 0 kudos

Hello,  Thanks for contacting Databricks Support.  Based on the error message: NPIP_TUNNEL_SETUP_FAILURE. It indicates that bootstrap failed due to network connectivity issues between the data plane and control plane.  Seems like you have already dow...

  • 0 kudos
1 More Replies