cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Lakehouse Architecture


Forum Posts

faaiqsaheed12
by New Contributor II
  • 3990 Views
  • 10 replies
  • 4 kudos

Resolved! Unable to view Manage Account Option in Databricks UI

Hi All, I want to remove Unity Catalog from Admin Console so that I need to navigate to manage account option but the option is not available in my Databricks workspace. Please help me to sort this issue by removing Unity Catalog.

  • 3990 Views
  • 10 replies
  • 4 kudos
Latest Reply
shivagarg
New Contributor II
  • 4 kudos

Thanks for putting this up.  I have faced the same issue , Glad I came here.

  • 4 kudos
9 More Replies
jeremy98
by New Contributor III
  • 119 Views
  • 1 replies
  • 0 kudos

renaming resource group on azure is it possible?

Hello community,I deployed one month ago a resource group with a particular name, where inside there are two databricks workspaces deployed. Is it possible to rename the resource group without any problem? Or do I need to move the existed dbws to a n...

  • 119 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Contributor III
  • 0 kudos

Hi @jeremy98 ,Unfortunately, you cannot rename resource group. You need to create new resource group and recreate all required resources.

  • 0 kudos
Christian_j
by New Contributor
  • 148 Views
  • 1 replies
  • 0 kudos

Cannot create a workspace on GCP

Hi,I have been using Databricks for a couple of months and been spinning up workspaces with Terraform. The other day we decided to end our POC and move on to a MVP. This meant cleaning up all workspaces and GCP. after the cleanup was done I wanted to...

  • 148 Views
  • 1 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

This could be related to quota limits, permissions, or other configuration issues. Ensuring that the necessary permissions are set and that the quota limits are correctly configured might help resolve the issue.  

  • 0 kudos
Matty
by New Contributor II
  • 383 Views
  • 2 replies
  • 0 kudos

Azure basic public IP SKU retirement

With Azure notifying that retirement of the basic public IP SKU in 2025 I'd like to understand how compute cluster workers can be moved over from basic to standard SKU? We've used Terraform to deploy our Databricks environment but I'd like to underst...

  • 383 Views
  • 2 replies
  • 0 kudos
Latest Reply
sonia598lewis
New Contributor II
  • 0 kudos

@Matty wrote:With Azure notifying that retirement of the basic public IP SKU in 2025 I'd like to understand how compute cluster workers can be moved over from basic to standard SKU? We've used Terraform to deploy our Databricks environment but I'd li...

  • 0 kudos
1 More Replies
Mario_D
by New Contributor III
  • 138 Views
  • 1 replies
  • 0 kudos

Resolved! System tables on workspace level

I could be mistaken, but it seem like the systems table contain data of all workspaces, even workspaces that you don't have access to. According to "least principle privilege" idea, I do not think that's a good idea.If forementioned is correct, has s...

  • 138 Views
  • 1 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

As per documentation it is confirmed that system tables include data from all workspaces in your account, but they can only be accessed by a workspace with Unity Catalog, you can restrict which admins has access to this system tables.It is not possib...

  • 0 kudos
Learnit
by New Contributor II
  • 3227 Views
  • 1 replies
  • 0 kudos

Managing databricks workspace permissions

I need assistance with writing API/Python code to manage a Databricks workspace permissions database(unity catalog). The task involves obtaining a list of workspace details from the account console, which includes various details like Workspace name,...

  • 3227 Views
  • 1 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

Here's a start.   https://docs.databricks.com/api/workspace/workspacebindings/updatebindings As far as coding, I use CURL.  See attachment as to the syntax.  Note the example in the attachment is for Workspace notebooks, as opposed to Workspace envir...

  • 0 kudos
xzero-trustx
by New Contributor
  • 161 Views
  • 1 replies
  • 0 kudos

Get hardware metrics like CPU usage, memory usage and send it to Azure Monitor

Hello guys,I would like to get hardware metrics like server load distribution, CPU utilization, memory utilization and send it to Azure Monitor. Is there any way to do this? Can you help me with this doubt?Thanks.

  • 161 Views
  • 1 replies
  • 0 kudos
Latest Reply
michelle653burk
New Contributor III
  • 0 kudos

@xzero-trustx wrote:Hello guys,I would like to get hardware metrics like server load distribution, CPU utilization, memory utilization and send it to Azure Monitor. Is there any way to do this? Can you help me with this doubt?Thanks.Hello!Yes, you ca...

  • 0 kudos
axelboursin
by New Contributor II
  • 219 Views
  • 1 replies
  • 0 kudos

Databricks and AWS CodeArtifact

Hello, I saw multiple topics about it, but I need explanations and a solution.In my context, we have developers that are developing Python projects, like X.In Databricks, we have a cluster with a library of the main project A that is dependent of X.p...

  • 219 Views
  • 1 replies
  • 0 kudos
Latest Reply
axelboursin
New Contributor II
  • 0 kudos

I saw that solution may be in the init script but it's not really essy to work with.I mean, there's no log generated from the bash script, so this is not an easy way to solve my problem, maybe you have some advices about it?

  • 0 kudos
_paskal_1
by New Contributor
  • 173 Views
  • 1 replies
  • 1 kudos

Issue running notebook from another notebook in Job cluster

Hi,I have situation where I can run my notebook without any issue when I use a 'normal' cluster. However, when I run the exact same notebook in a job cluster it fails.It fails at the point where it runs the cell:`%run ../utils/some_other_notebook`And...

  • 173 Views
  • 1 replies
  • 1 kudos
Latest Reply
_paskal_
New Contributor III
  • 1 kudos

Not sure what went wrong but after pulling the sources (notebooks) again from GIT it now works both for my 'normal' cluster and the 'job' cluster.Case closed for me...

  • 1 kudos
swapnild-tomtom
by New Contributor II
  • 244 Views
  • 2 replies
  • 5 kudos
  • 244 Views
  • 2 replies
  • 5 kudos
Latest Reply
JissMathew
New Contributor III
  • 5 kudos

Hi,Yes, Databricks Asset Bundles (DABs) can be used with a Standard Tier Databricks workspace. The use of DABs is not directly tied to the workspace pricing tier but rather to the configuration of your workspace and integration with CI/CD pipelines.

  • 5 kudos
1 More Replies
SeBaFlu
by New Contributor
  • 150 Views
  • 2 replies
  • 1 kudos

Meta data for cloned table

Hi, guys!How I can find out whether a table is cloned right now - hopefully by querying some meta data (information_schema or the like)?Thanks! Sebastian

  • 150 Views
  • 2 replies
  • 1 kudos
Latest Reply
JissMathew
New Contributor III
  • 1 kudos

Hi @SeBaFlu ,To determine whether a table in Databricks is a clone (created using Delta Lake's CREATE TABLE CLONE), you can use Delta Lake's metadata and DESCRIBE HISTORY command.

  • 1 kudos
1 More Replies
ambigus9
by New Contributor III
  • 326 Views
  • 7 replies
  • 3 kudos

PrivateLink Validation Error - When trying to access to Workspace

We have a workspace that had been deployed on AWS customer architecture using Terraform privatelink: https://registry.terraform.io/providers/databricks/databricks/latest/docs/guides/aws-private-link-workspaceThe fact is when we disable the Public Acc...

ambigus9_0-1732035784493.png ambigus9_1-1732035847145.png ambigus9_2-1732037994364.png ambigus9_3-1732038098998.png
  • 326 Views
  • 7 replies
  • 3 kudos
Latest Reply
Walter_C
Databricks Employee
  • 3 kudos

Can you share your workspace id so I can do a validation?  

  • 3 kudos
6 More Replies
WWoman
by Contributor
  • 388 Views
  • 2 replies
  • 0 kudos

Resolved! Download Dashboard as PDF

I see several reference in Databricks documentation to export a Dashboard as a PDF, yet I have no options for format when I download it, it creates a json file. Is there a way to download a Dashboard as a PDF?

  • 388 Views
  • 2 replies
  • 0 kudos
Latest Reply
WWoman
Contributor
  • 0 kudos

Actually you can download a Dashboard to a PDF if it is a legacy dashboard. It does not appear as an option for an AI/BI dashboard.

  • 0 kudos
1 More Replies
rew_data
by New Contributor II
  • 417 Views
  • 4 replies
  • 0 kudos

Resolved! Databricks apps, data plane configuration not supported

Unable to create app, get 'This workspace has a data plane configuration that is not yet supported' message.   Is there something specific I should look for configuration wise to correct the issue?   Azure hosted. Virtual network.

  • 417 Views
  • 4 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hello @rew_data, You might want to check if you region is available to use Databricks Apps, please refer to: https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/ The error message "This workspace has a data plane configuratio...

  • 0 kudos
3 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels