cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Olex
by New Contributor II
  • 2987 Views
  • 5 replies
  • 1 kudos

Unable to login accounts.azuredatabricks.net and create admin account

Hello everyoneI'm trying to setup my admin account in Databricks Admin Console and am following these steps:https://learn.microsoft.com/en-us/azure/databricks/administration-guide/#--what-are-account-adminsHowever, when I access accounts.azuredatabri...

  • 2987 Views
  • 5 replies
  • 1 kudos
Latest Reply
Olex
New Contributor II
  • 1 kudos

Hi everyoneI asked that question a year and somehow it'd been solved.Not sure however if it's related to generic email providers, but I have multiple registered accounts, gmail and corporate one. For databricks accademy, I'm using gmail account, whic...

  • 1 kudos
4 More Replies
shubhdhanuka
by New Contributor
  • 802 Views
  • 1 replies
  • 0 kudos

Account Access token

Can you please help me with how to authenticate account level rest apis?curl --request GET https://accounts.cloud.databricks.com/api/2.0/accounts/{account_id}/usageI use Permanent Access Token to authenticate workspace APIs but it's not working for w...

  • 802 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @shubhdhanuka ,To get access to account API you cannot use personal access token. Instead, you must use the Microsoft Entra ID tokens of Azure Databricks account admins. Azure Databricks account admins can be users or service principals.Below you ...

  • 0 kudos
jenshumrich
by Contributor
  • 1878 Views
  • 3 replies
  • 2 kudos

Databricks UI error

I receive this respone when trying to download a csv file: adb-737684297741988.8.azuredatabricks.net/ajax-api/2.0/workspace/export?path=/Repos/jhu_admin%40siemensgamesa.com/sgre-dfp-lifestrategy-python/cpo/output/Rattlesnake Flats/Rdata/AssetCheck_Ra...

jenshumrich_0-1723198951857.png
  • 1878 Views
  • 3 replies
  • 2 kudos
Latest Reply
jenshumrich
Contributor
  • 2 kudos

@szymon_dybczak I am using the GUI (see the screenshot in the original post): File marked -> Three dots -> Export

  • 2 kudos
2 More Replies
dprutean
by New Contributor III
  • 1616 Views
  • 1 replies
  • 0 kudos

JDBC Error with OpenJDK 21

Connecting to Azure Databricks using latest JDBC driver and OpenJDK 21 I got this error. I already set:--add-opens=java.base/java.nio=ALL-UNNAMED-Dio.netty.tryReflectionSetAccessible=true java.sql.SQLException: [Databricks][JDBCDriver](500618) Error ...

  • 1616 Views
  • 1 replies
  • 0 kudos
Latest Reply
151640
New Contributor III
  • 0 kudos

Version 02.06.38.1068Using SQLSquirrel with ibm-semeru-certified-17-jdk (17.0.11+9)With JRE options --add-opens=jdk.unsupported/sun.misc=ALL-UNNAMED failsShould be  --add-opens=java.base/java.nio=ALL-UNNAMEDcaused by: java.lang.reflect.InaccessibleOb...

  • 0 kudos
renancy
by New Contributor III
  • 353 Views
  • 0 replies
  • 0 kudos

Using Databricks CLI for generating Notebooks not supported or not implemented

Hi I'm a Data engineer and recently developed a Notebook analytics template for general purposes that I would like to be the standard on my company. Continuing, I created another notebook with a text widget that uses the user input to map the folder ...

  • 353 Views
  • 0 replies
  • 0 kudos
data_bricklayer
by New Contributor III
  • 512 Views
  • 1 replies
  • 1 kudos

[Metastore] can't assign to workspace in cross Azure Account envirronment

Hi all,hope you are doing well. We have a metastore in tenant A, and workspaces in tenant B. Tenant B has Contributor Role to tenant A, to access the metastore. For some reasons, we can not assign the metastore from tenant A to the workspace in tenan...

  • 512 Views
  • 1 replies
  • 1 kudos
fonini
by New Contributor III
  • 1014 Views
  • 3 replies
  • 4 kudos

dbutils secrets break matplotlib in recent Databricks runtimes

Using a Databricks cluster running Databricks Runtime version 15.4 LTS Beta, and with no init-scripts, the following code works fine:import numpy as npimport pandas as pddf = pd.DataFrame(np.random.randn(2000, 10))df.plot(subplots=True, figsize=(10, ...

Administration & Architecture
Bug
dbutils
matplotlib
  • 1014 Views
  • 3 replies
  • 4 kudos
Latest Reply
fonini
New Contributor III
  • 4 kudos

OK, I understand the error now:This specific secret is a small alphanumeric string. The probability of it being part of the base64 of a big PNG is quite large.Is there any workaround for this? I know I can't turn off the redaction of secrets. Can I d...

  • 4 kudos
2 More Replies
heathwinning
by New Contributor II
  • 1020 Views
  • 1 replies
  • 0 kudos

Obtain access of Azure metastore storage account to configure Lifecycle management

I recently set up an Azure Databricks workspace with an automatically created metastore and metastore-level root storage within the metastore blob storage account. All the catalogs, schemas, and tables/volumes have been created without a specified or...

  • 1020 Views
  • 1 replies
  • 0 kudos
prateekgoyal
by New Contributor II
  • 1287 Views
  • 1 replies
  • 0 kudos

Databricks connection pool(ing) using python

I have a python application which I need to connect with databricks (Databricks SQL Connector). The process for that is quite simple -1. connect with dbr2. execute your query3. get the result4. close the connectionExample from - https://docs.databric...

  • 1287 Views
  • 1 replies
  • 0 kudos
Latest Reply
prateekgoyal
New Contributor II
  • 0 kudos

Hi @Retired_mod, thanks for your reply. I have 2 follow-up questions for you - When you say "consider managing connection lifetimes by closing and recreating them periodically" - the problem I face with this is when my API request comes in and I crea...

  • 0 kudos
antonuzzo96
by New Contributor III
  • 2898 Views
  • 5 replies
  • 4 kudos

Resolved! UCX- installation error -

I'm getting the following error when trying to install UCX on  a specific workspace.I have already installed ucx from my machine on other workspace and works, now on this workspace i'm getting this error  ERROR [d.l.blueprint.parallel][installing_das...

  • 2898 Views
  • 5 replies
  • 4 kudos
Latest Reply
Cor
New Contributor III
  • 4 kudos

Issue was resolved in lsql v0.7.4, a ucx dependency: https://github.com/databrickslabs/lsql/releases/tag/v0.7.41. Upgrade the Databricks cli: https://github.com/databricks/cli/releases/2. Upgrade ucx: `databricks labs install ucx`

  • 4 kudos
4 More Replies
StephanieAlba
by Databricks Employee
  • 1671 Views
  • 5 replies
  • 2 kudos

Promoting assets from Dev workspace to Prod

What is the best way to promote Databricks objects from one workspace to another? For example, DABs are great for code and models. However, SQL alerts do not seem to fall into DABs. The API allows for retrieving queries and creating them via API in t...

  • 1671 Views
  • 5 replies
  • 2 kudos
Latest Reply
NandiniN
Databricks Employee
  • 2 kudos

https://docs.databricks.com/api/workspace/queries https://docs.databricks.com/en/sql/dbsql-api-latest.html#changes-to-the-alerts-api The API path is now api/2.0/sql/alerts, replacing the legacy path of /api/2.0/preview/sql/alerts. https://docs.databr...

  • 2 kudos
4 More Replies
millie_dbrx_use
by New Contributor
  • 694 Views
  • 1 replies
  • 1 kudos

System Tables

Hi,I've recently enabled the billing schema in system tables, but still not able to view it in catalog. I am both an account admin and workspace admin, as well as an owner of the workspace in Azure. A colleague (who used to be Azure AD admin but no l...

  • 694 Views
  • 1 replies
  • 1 kudos
ag2all
by New Contributor
  • 830 Views
  • 1 replies
  • 1 kudos

Databricks + Apache Iceberg = advantageous or wasted effort due to duplicate functionality ?

Trying to design a Lakehouse. Spark is at the base layer. Now wondering if adding Apache Iceberg sitting below Spark will be of help, or, not ? Preferring Iceberg for its auto indexing, ACID query facilities over big hetergenous datasets. Wonder if i...

  • 830 Views
  • 1 replies
  • 1 kudos
Latest Reply
holly
Databricks Employee
  • 1 kudos

Hello, if you're planning on building your own open source stack of spark+iceberg, it can be a good choice.  If you're on Databricks, however, you're going to miss out a *lot* on delta features that are baked into the platform. Specifically compute +...

  • 1 kudos
data_bricklayer
by New Contributor III
  • 2597 Views
  • 4 replies
  • 3 kudos

Resolved! [VNET injection] Container and container subnet

Hi,I was researching everywhere and could not find the answer. I understand that when workspace is created, it has 2 subnets, host and container. The VM, which runs the Databricks container, is in host subnet, which logically means the container is a...

  • 2597 Views
  • 4 replies
  • 3 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 3 kudos

Hi @data_bricklayer ,Public Subnet (host): The public subnet is typically used for resources that need to communicate with the internet or other Azure services. In Azure Databricks, this subnet is used for driver nodes of the clusters that require ou...

  • 3 kudos
3 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels