cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

jeremy98
by Honored Contributor
  • 910 Views
  • 1 replies
  • 0 kudos

renaming resource group on azure is it possible?

Hello community,I deployed one month ago a resource group with a particular name, where inside there are two databricks workspaces deployed. Is it possible to rename the resource group without any problem? Or do I need to move the existed dbws to a n...

  • 910 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @jeremy98 ,Unfortunately, you cannot rename resource group. You need to create new resource group and recreate all required resources.

  • 0 kudos
Mario_D
by New Contributor III
  • 1075 Views
  • 1 replies
  • 0 kudos

Resolved! System tables on workspace level

I could be mistaken, but it seem like the systems table contain data of all workspaces, even workspaces that you don't have access to. According to "least principle privilege" idea, I do not think that's a good idea.If forementioned is correct, has s...

  • 1075 Views
  • 1 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

As per documentation it is confirmed that system tables include data from all workspaces in your account, but they can only be accessed by a workspace with Unity Catalog, you can restrict which admins has access to this system tables.It is not possib...

  • 0 kudos
Learnit
by New Contributor II
  • 7658 Views
  • 1 replies
  • 0 kudos

Managing databricks workspace permissions

I need assistance with writing API/Python code to manage a Databricks workspace permissions database(unity catalog). The task involves obtaining a list of workspace details from the account console, which includes various details like Workspace name,...

  • 7658 Views
  • 1 replies
  • 0 kudos
Latest Reply
mark_ott
Databricks Employee
  • 0 kudos

Here's a start.   https://docs.databricks.com/api/workspace/workspacebindings/updatebindings As far as coding, I use CURL.  See attachment as to the syntax.  Note the example in the attachment is for Workspace notebooks, as opposed to Workspace envir...

  • 0 kudos
xzero-trustx
by New Contributor
  • 841 Views
  • 1 replies
  • 0 kudos

Get hardware metrics like CPU usage, memory usage and send it to Azure Monitor

Hello guys,I would like to get hardware metrics like server load distribution, CPU utilization, memory utilization and send it to Azure Monitor. Is there any way to do this? Can you help me with this doubt?Thanks.

  • 841 Views
  • 1 replies
  • 0 kudos
Latest Reply
michelle653burk
New Contributor III
  • 0 kudos

@xzero-trustx wrote:Hello guys,I would like to get hardware metrics like server load distribution, CPU utilization, memory utilization and send it to Azure Monitor. Is there any way to do this? Can you help me with this doubt?Thanks.Hello!Yes, you ca...

  • 0 kudos
_paskal_1
by New Contributor
  • 847 Views
  • 1 replies
  • 1 kudos

Issue running notebook from another notebook in Job cluster

Hi,I have situation where I can run my notebook without any issue when I use a 'normal' cluster. However, when I run the exact same notebook in a job cluster it fails.It fails at the point where it runs the cell:`%run ../utils/some_other_notebook`And...

  • 847 Views
  • 1 replies
  • 1 kudos
Latest Reply
_paskal_
New Contributor III
  • 1 kudos

Not sure what went wrong but after pulling the sources (notebooks) again from GIT it now works both for my 'normal' cluster and the 'job' cluster.Case closed for me...

  • 1 kudos
swapnild-tomtom
by New Contributor II
  • 1173 Views
  • 2 replies
  • 5 kudos
  • 1173 Views
  • 2 replies
  • 5 kudos
Latest Reply
JissMathew
Valued Contributor
  • 5 kudos

Hi,Yes, Databricks Asset Bundles (DABs) can be used with a Standard Tier Databricks workspace. The use of DABs is not directly tied to the workspace pricing tier but rather to the configuration of your workspace and integration with CI/CD pipelines.

  • 5 kudos
1 More Replies
SeBaFlu
by New Contributor
  • 744 Views
  • 2 replies
  • 1 kudos

Meta data for cloned table

Hi, guys!How I can find out whether a table is cloned right now - hopefully by querying some meta data (information_schema or the like)?Thanks! Sebastian

  • 744 Views
  • 2 replies
  • 1 kudos
Latest Reply
JissMathew
Valued Contributor
  • 1 kudos

Hi @SeBaFlu ,To determine whether a table in Databricks is a clone (created using Delta Lake's CREATE TABLE CLONE), you can use Delta Lake's metadata and DESCRIBE HISTORY command.

  • 1 kudos
1 More Replies
WWoman
by Contributor
  • 3378 Views
  • 2 replies
  • 0 kudos

Resolved! Download Dashboard as PDF

I see several reference in Databricks documentation to export a Dashboard as a PDF, yet I have no options for format when I download it, it creates a json file. Is there a way to download a Dashboard as a PDF?

  • 3378 Views
  • 2 replies
  • 0 kudos
Latest Reply
WWoman
Contributor
  • 0 kudos

Actually you can download a Dashboard to a PDF if it is a legacy dashboard. It does not appear as an option for an AI/BI dashboard.

  • 0 kudos
1 More Replies
rew_data
by New Contributor II
  • 1619 Views
  • 4 replies
  • 0 kudos

Resolved! Databricks apps, data plane configuration not supported

Unable to create app, get 'This workspace has a data plane configuration that is not yet supported' message.   Is there something specific I should look for configuration wise to correct the issue?   Azure hosted. Virtual network.

  • 1619 Views
  • 4 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hello @rew_data, You might want to check if you region is available to use Databricks Apps, please refer to: https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/ The error message "This workspace has a data plane configuratio...

  • 0 kudos
3 More Replies
gyorgyjelinek
by New Contributor II
  • 621 Views
  • 1 replies
  • 1 kudos

REST API List dashboard schedules - 501 NOT IMPLEMENTED

When I try to retrieve the dashboard scheduling info based on REST API List dashboard schedules I receive the following `501 NOT IMPLEMENTED` response:{ "error_code": "NOT_IMPLEMENTED", "message": "This API is not yet supported." }But e.g the...

  • 621 Views
  • 1 replies
  • 1 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 1 kudos

Hello @gyorgyjelinek, I just tried testing on my end and got the same failure as yours: python3 list_dashboardID.py Error 501: {"error_code":"NOT_IMPLEMENTED","message":"This API is not yet supported."} This endpoint might not be fully supported yet ...

  • 1 kudos
iskidet01
by New Contributor II
  • 1562 Views
  • 1 replies
  • 0 kudos

Resolved! Challenge isolating databricks workspace with single unity catalog metstore for multiple workspaces

Hello Community,I am currently managing multiple workspaces for various projects and facing challenges in achieving data asset isolation between these workspaces. My goal is to ensure that data sharing happens exclusively through Delta Sharing.The cu...

  • 1562 Views
  • 1 replies
  • 0 kudos
Latest Reply
Stefan-Koch
Valued Contributor II
  • 0 kudos

Hi iskidet01You can use use workspace-catalog bindings. https://learn.microsoft.com/en-us/azure/databricks/catalogs/#workspace-catalog-binding. When you create a catalog, you can assign it to specific workspace, instead of "All workspaces have access...

  • 0 kudos
jonxu
by New Contributor III
  • 1074 Views
  • 3 replies
  • 0 kudos

PAT needed but not allowed in "Advanced Data Engineering - 6.5L Deploy pipeline with the CLI Lab"

It is stated in the lab notebook that:Run the setupRun the setup script for this lesson by running the cell below. This will ensure that:The Databricks CLI is installedAuthentication is configuredA pipeline is createdHowever, when I tried to run the ...

  • 1074 Views
  • 3 replies
  • 0 kudos
Latest Reply
jonxu
New Contributor III
  • 0 kudos

... and if I start with step 5, using workspace-level authorisation, I ended up with "localhost refused to connect." in the generated link.

  • 0 kudos
2 More Replies
martkev
by New Contributor III
  • 916 Views
  • 1 replies
  • 0 kudos

Will Lakehouse Federation between Databricks and Snowflake support Azure Entra ID?

The Lakehouse Federation between Databricks and Snowflake looks promising, but the lack of support for Azure Entra ID as an identity provider (IdP) is a big limitation for enterprises standardized on it.Managing separate OAuth flows or using Snowflak...

  • 916 Views
  • 1 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hello @martkev, Currently, Azure Databricks does not support using Azure Entra ID (formerly Azure Active Directory) directly as an identity provider (IdP) for federated queries on Snowflake. The only supported OAuth integration for Snowflake is Snowf...

  • 0 kudos
seckinaktas
by New Contributor II
  • 2898 Views
  • 2 replies
  • 2 kudos

Resolved! system schemas permission

Hi,I'm an account admin on Databricks and  when I try to set select permission for system schemasI take "PERMISSION_DENIED: User is not an owner of Schema 'system.compute'." When I try to set permission for system catalog,I take "Requires ownership o...

  • 2898 Views
  • 2 replies
  • 2 kudos
Latest Reply
seckinaktas
New Contributor II
  • 2 kudos

Thank you so much

  • 2 kudos
1 More Replies
AlbertWang
by Valued Contributor
  • 2708 Views
  • 3 replies
  • 2 kudos

Networking configuration of Azure Databricks managed storage account

Hi all,I created an Azure Databricks Workspace, and the workspace creates an Azure Databricks managed storage account.The networking configuration of the storage account is "Enabled from all networks".Shall I change it to "Enabled from selected virtu...

  • 2708 Views
  • 3 replies
  • 2 kudos
Latest Reply
Walter_C
Databricks Employee
  • 2 kudos

You dont need view on the subnets itself.In regards the Disabling key access you could use any of the other authentication methods listed here: https://learn.microsoft.com/en-us/azure/databricks/connect/storage/azure-storage#connect-to-azure-data-lak...

  • 2 kudos
2 More Replies