cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
deanb-everc
by • New Contributor
  • 1240 Views
  • 1 replies
  • 0 kudos

"Forgot my password" does not send mail to users in my organization.

Hi, we are using databricks in my organization. SSO logins stopped working for us about a week ago. As a workaround, we asked our users to use the admin login page, and use their organization passwords. This didn't work because the passwords were inc...

Administration & Architecture
Reply
  • 1240 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @deanb-everc, Please raise a support ticket.

  • 0 kudos
leelee3000
by • New Contributor III
  • 1760 Views
  • 2 replies
  • 0 kudos

HIPAA compliance "pay-as-you-go" option

Hi does Databricks offer HIPAA compliance with the "pay-as-you-go" option? I know that Snowflake has the ability to do that, what about Databricks?

Administration & Architecture
Reply
  • 1760 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?This...

  • 0 kudos
1 More Replies
arkadiuszr
by • New Contributor III
  • 3781 Views
  • 4 replies
  • 1 kudos

Resolved! Unable to access Live Ganglia UI

I’m having a trouble accessing Ganglia UI on a job run cluster. The job run is executed by a service principal and I would like to enable the Ganglia UI view to an user/admin group in Databricks. The error I get is: HTTP ERROR 403 PERMISSION_DENIED: ...

Administration & Architecture
Reply
  • 3781 Views
  • 4 replies
  • 1 kudos
View Replies
Latest Reply
shan_chandra
Esteemed Contributor
  • 1 kudos

Hi @arkadiuszr  -  can you please try the following steps and let us know? To resolve this error, first you want to add your service principal to the workspace: Go to admin console as a workspace adminSelect “service principal tab”Click “Add service ...

  • 1 kudos
3 More Replies
Aria
by • New Contributor III
  • 2804 Views
  • 2 replies
  • 1 kudos

Resolved! Security and vulnerability for Azure databricks clusters in Data Plane

Microsoft defender is not supported for azure databricks clusters. Can someone point me to a document which describe how the security vulnerabilities are reported and fixed for azure databricks clusters in data plane.

Administration & Architecture
security vulnerability patch dataplane
Reply
  • 2804 Views
  • 2 replies
  • 1 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 1 kudos

Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?This...

  • 1 kudos
1 More Replies
srisuffolk1
by • New Contributor
  • 2249 Views
  • 2 replies
  • 0 kudos

Specify cidr when using aws quick start template

Hello,I want to create a new databricks workspace using aws quick start template. However, I want to specify a cidr address that is specified by our network administration. Is it possible to do that. From what I read, the quick start template does no...

Administration & Architecture
Reply
  • 2249 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?This...

  • 0 kudos
1 More Replies
Redford
by • New Contributor
  • 3603 Views
  • 2 replies
  • 0 kudos

Can I configure Notebook Result Downloads with Databricks CLI , API or Terraform provider ?

I'm Databricks Admin and I'm looking for a solution to automate some Security Workspace settings.Those are:Notebook result downloadSQL result downloadNotebook table clipboard featuresI can't find these options in the Databricks terraform provider, Da...

Administration & Architecture
Reply
  • 3603 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
nkraj
New Contributor III
  • 0 kudos

Hi @Redford, With the Databricks API, you have the capability to toggle the following features: Enable/Disable Features Notebook result download (key name: enableResultsDownloading)Notebook table clipboard features (key name: enableNotebo...

  • 0 kudos
1 More Replies
Kroy
by • Contributor
  • 2299 Views
  • 2 replies
  • 1 kudos

Not able to edit the user group entitlement

I am workspace admin , but when editing the entitlement (allow unrestricted cluster creation) of user group, it is not happening, it gives a prompt to confirm the remove, but evening after confirming it does not get removes. after clicking remove , i...

Kroy_0-1704885328747.png Kroy_1-1704885377008.png
Administration & Architecture
Reply
  • 2299 Views
  • 2 replies
  • 1 kudos
View Replies
Latest Reply
Avvar2022
Contributor
  • 1 kudos

is your workspace untiy catalog enabled?

  • 1 kudos
1 More Replies
Wojciech_BUK
by • Valued Contributor III
  • 4875 Views
  • 4 replies
  • 0 kudos

Unity Catalog - Lakehouse Federation: Permission to read data from foreign catalogs

I have seup connection "SQL-SV-conn" to SQL Server and based on that connection I have created foreign catalog "FC-SQL-SV".I have granted All permission on CATALOG to developers:Use CatalogUse SchemaSelectBut they can not query table (e.g. by running...

Administration & Architecture
Foreign Catalog
Lakehouse Federation
Unity Catalog
Reply
  • 4875 Views
  • 4 replies
  • 0 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

I want to express my gratitude for your effort in selecting the most suitable solution. It's great to hear that your query has been successfully resolved. Thank you for your contribution. 

  • 0 kudos
3 More Replies
sachinw
by • New Contributor II
  • 1999 Views
  • 1 replies
  • 1 kudos

Resolved! Workspace Model Registry with Unity Catalog

if the "default catalog for the workspace" is to Unity Catalog, how can we access a model from the workspace model registry?I have already tried  mlflow.set_tracking_uri("databricks") but still try to find catalog in UC.  

Administration & Architecture
Reply
  • 1999 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 1 kudos

Hi @sachinw, If your workspace is enabled for Unity Catalog, the default behaviour of the MLflow Python client is to create models in the Unity Catalog. However, if you want to access a model from the Workspace Model Registry, you need to explicitly ...

  • 1 kudos
scott1
by • New Contributor II
  • 2441 Views
  • 2 replies
  • 0 kudos

Automatic UC enablement with existing Unity Catalog

Hello,The environment I'm working in has an existing account and unity catalog in our primary region. These have been primarily PoC, and have existed for a year or so.Now we're building out our IaC and getting ready to move towards production. In new...

Administration & Architecture
Reply
  • 2441 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @scott1, it is possible to replicate the automatic enablement behaviour in your existing region, but you will need to have an account admin role in that region.   Account admins can enable workspaces for Unity Catalog by assigning them to a Unity ...

  • 0 kudos
1 More Replies
leelee3000
by • New Contributor III
  • 2003 Views
  • 1 replies
  • 0 kudos

Connect to Salesforce

Curious if there's a Databricks connector for Salesforce on AWS? 

Administration & Architecture
Reply
  • 2003 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Wojciech_BUK
Valued Contributor III
  • 0 kudos

There is no "databricks" connector like the on you have in Unity Fedarating e.g. for Snowflake.You can use partner ecosystem e.g. Fivetran https://www.fivetran.com/connectors/salesforceto integrate Salesforce data to your Lakehouse. You also have spa...

  • 0 kudos
riturralde-p
by • New Contributor II
  • 2588 Views
  • 2 replies
  • 1 kudos

How to allocate costs per SQL query?

By using System Tables (systen.billing.usage) I'm able to identity DBU usage per query, but I'm not able to identify who ran each query because is not part of the table. I'm also aware of query history where all the queries and who ran them is listed...

Administration & Architecture
Reply
  • 2588 Views
  • 2 replies
  • 1 kudos
View Replies
Latest Reply
riturralde-p
New Contributor II
  • 1 kudos

thanks @Kaniz_Fatma for the reply, however query_id is not part of the system.billing.usage table, so no way to join them by IDs. What my Databricks account team suggested me is to join them by timestamps since both tables contain a column like that....

  • 1 kudos
1 More Replies
lgepp11
by • New Contributor II
  • 3965 Views
  • 2 replies
  • 0 kudos

NPIP tunnel setup failure during launch

In AWS with this current error when spinning up the SQL warehouse or personal compute.Backend private link is enabled.Error: NPIP tunnel setup failure during launch. Please try again later and contact Databricks if the problem persists. Instance boot...

Administration & Architecture
Reply
  • 3965 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
User16539034020
Contributor II
  • 0 kudos

Hello,  Thanks for contacting Databricks Support.  Based on the error message: NPIP_TUNNEL_SETUP_FAILURE. It indicates that bootstrap failed due to network connectivity issues between the data plane and control plane.  Seems like you have already dow...

  • 0 kudos
1 More Replies
alexlod
by • New Contributor III
  • 3525 Views
  • 4 replies
  • 1 kudos

How to monitor a python wheel job with Prometheus?

Hi Community,We have a Databricks job with a single Python wheel task that runs our streaming pyspark job. The job runs on a single-node compute cluster and consumes from Kafka.Our monitoring stack is Prometheus + Grafana.I want the job's metrics to ...

Administration & Architecture
Reply
  • 3525 Views
  • 4 replies
  • 1 kudos
View Replies
Latest Reply
amelia1
New Contributor II
  • 1 kudos

Hi I'm trying to use the metrics registry object inside an UDF function, but I can't because it's not serializable due to Lock. Our goal is to be able to count the number of messages parsed, and the number of messages we can't parsed (due to exceptio...

  • 1 kudos
3 More Replies
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels