- 956 Views
- 2 replies
- 1 kudos
Azure Databricks SCIM provisioning configured, working...but what happens when user is deleted?
Hi - I have Azure Databricks with Unity Catalog, and the SCIM Connector provisioning up and working.Due to a misunderstanding on my part, I deleted some individual users (using the Databricks admin console) thinking that I was deleting individual acc...
- 956 Views
- 2 replies
- 1 kudos
- 1 kudos
This was resolved...but why it was resolved remains a mystery. We simply re-provisioned by turning off and then on the SCIM provisioning in the Azure portal for the Databricks SCIM connector (which is supposed to cause a full re-provisioning, but di...
- 1 kudos
- 480 Views
- 1 replies
- 0 kudos
Terraform databricks new feature
I recently saw a new feature in databricks that allows to set an upper limit of run time for jobs, so it fails when the limit is breached. See image below:Are we able to terraform code this new feature?
- 480 Views
- 1 replies
- 0 kudos
- 0 kudos
Isn't that just timeout_seconds?That UI element looks like it corresponds to that property in the REST API (https://docs.databricks.com/api/azure/workspace/jobs/create#timeout_seconds), and that same top-level argument in Terraform, https://registry....
- 0 kudos
- 2618 Views
- 5 replies
- 1 kudos
Unable to login accounts.azuredatabricks.net and create admin account
Hello everyoneI'm trying to setup my admin account in Databricks Admin Console and am following these steps:https://learn.microsoft.com/en-us/azure/databricks/administration-guide/#--what-are-account-adminsHowever, when I access accounts.azuredatabri...
- 2618 Views
- 5 replies
- 1 kudos
- 1 kudos
Hi everyoneI asked that question a year and somehow it'd been solved.Not sure however if it's related to generic email providers, but I have multiple registered accounts, gmail and corporate one. For databricks accademy, I'm using gmail account, whic...
- 1 kudos
- 591 Views
- 1 replies
- 0 kudos
Account Access token
Can you please help me with how to authenticate account level rest apis?curl --request GET https://accounts.cloud.databricks.com/api/2.0/accounts/{account_id}/usageI use Permanent Access Token to authenticate workspace APIs but it's not working for w...
- 591 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @shubhdhanuka ,To get access to account API you cannot use personal access token. Instead, you must use the Microsoft Entra ID tokens of Azure Databricks account admins. Azure Databricks account admins can be users or service principals.Below you ...
- 0 kudos
- 1380 Views
- 3 replies
- 2 kudos
Databricks UI error
I receive this respone when trying to download a csv file: adb-737684297741988.8.azuredatabricks.net/ajax-api/2.0/workspace/export?path=/Repos/jhu_admin%40siemensgamesa.com/sgre-dfp-lifestrategy-python/cpo/output/Rattlesnake Flats/Rdata/AssetCheck_Ra...
- 1380 Views
- 3 replies
- 2 kudos
- 2 kudos
@szymon_dybczak I am using the GUI (see the screenshot in the original post): File marked -> Three dots -> Export
- 2 kudos
- 1317 Views
- 1 replies
- 0 kudos
JDBC Error with OpenJDK 21
Connecting to Azure Databricks using latest JDBC driver and OpenJDK 21 I got this error. I already set:--add-opens=java.base/java.nio=ALL-UNNAMED-Dio.netty.tryReflectionSetAccessible=true java.sql.SQLException: [Databricks][JDBCDriver](500618) Error ...
- 1317 Views
- 1 replies
- 0 kudos
- 0 kudos
Version 02.06.38.1068Using SQLSquirrel with ibm-semeru-certified-17-jdk (17.0.11+9)With JRE options --add-opens=jdk.unsupported/sun.misc=ALL-UNNAMED failsShould be --add-opens=java.base/java.nio=ALL-UNNAMEDcaused by: java.lang.reflect.InaccessibleOb...
- 0 kudos
- 294 Views
- 0 replies
- 0 kudos
Using Databricks CLI for generating Notebooks not supported or not implemented
Hi I'm a Data engineer and recently developed a Notebook analytics template for general purposes that I would like to be the standard on my company. Continuing, I created another notebook with a text widget that uses the user input to map the folder ...
- 294 Views
- 0 replies
- 0 kudos
- 480 Views
- 1 replies
- 7 kudos
Databricks Unity Catalog Bug - Reset of Network Connectivity Configuration not possible
The following use case is strange regarding the Network Connectivity Configuration (NCC):I create a Workspace (the NCC is empty)I create a NCCI attach the NCC to the WorkspaceI want to remove the NCC from the Workspace -> not possibleTherefore, I can...
- 480 Views
- 1 replies
- 7 kudos
- 7 kudos
We faced the very same issue in our Tenant.
- 7 kudos
- 427 Views
- 1 replies
- 1 kudos
[Metastore] can't assign to workspace in cross Azure Account envirronment
Hi all,hope you are doing well. We have a metastore in tenant A, and workspaces in tenant B. Tenant B has Contributor Role to tenant A, to access the metastore. For some reasons, we can not assign the metastore from tenant A to the workspace in tenan...
- 427 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi all,hope you are doing well. We have a metastore in tenant A, and workspaces in tenant B. Tenant B has Contributor Role to tenant A, to access the metastore. For some reasons, we can not assign the metastore from tenant A to the workspace in tenan...
- 1 kudos
- 843 Views
- 3 replies
- 4 kudos
dbutils secrets break matplotlib in recent Databricks runtimes
Using a Databricks cluster running Databricks Runtime version 15.4 LTS Beta, and with no init-scripts, the following code works fine:import numpy as npimport pandas as pddf = pd.DataFrame(np.random.randn(2000, 10))df.plot(subplots=True, figsize=(10, ...
- 843 Views
- 3 replies
- 4 kudos
- 4 kudos
OK, I understand the error now:This specific secret is a small alphanumeric string. The probability of it being part of the base64 of a big PNG is quite large.Is there any workaround for this? I know I can't turn off the redaction of secrets. Can I d...
- 4 kudos
- 874 Views
- 1 replies
- 0 kudos
Obtain access of Azure metastore storage account to configure Lifecycle management
I recently set up an Azure Databricks workspace with an automatically created metastore and metastore-level root storage within the metastore blob storage account. All the catalogs, schemas, and tables/volumes have been created without a specified or...
- 874 Views
- 1 replies
- 0 kudos
- 0 kudos
I recently set up an Azure Databricks workspace with an automatically created metastore and metastore-level root storage within the metastore blob storage account. All the catalogs, schemas, and tables/volumes have been created without a specified or...
- 0 kudos
- 1005 Views
- 1 replies
- 0 kudos
Databricks connection pool(ing) using python
I have a python application which I need to connect with databricks (Databricks SQL Connector). The process for that is quite simple -1. connect with dbr2. execute your query3. get the result4. close the connectionExample from - https://docs.databric...
- 1005 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Retired_mod, thanks for your reply. I have 2 follow-up questions for you - When you say "consider managing connection lifetimes by closing and recreating them periodically" - the problem I face with this is when my API request comes in and I crea...
- 0 kudos
- 2544 Views
- 5 replies
- 4 kudos
Resolved! UCX- installation error -
I'm getting the following error when trying to install UCX on a specific workspace.I have already installed ucx from my machine on other workspace and works, now on this workspace i'm getting this error ERROR [d.l.blueprint.parallel][installing_das...
- 2544 Views
- 5 replies
- 4 kudos
- 4 kudos
Issue was resolved in lsql v0.7.4, a ucx dependency: https://github.com/databrickslabs/lsql/releases/tag/v0.7.41. Upgrade the Databricks cli: https://github.com/databricks/cli/releases/2. Upgrade ucx: `databricks labs install ucx`
- 4 kudos
- 1511 Views
- 5 replies
- 2 kudos
Promoting assets from Dev workspace to Prod
What is the best way to promote Databricks objects from one workspace to another? For example, DABs are great for code and models. However, SQL alerts do not seem to fall into DABs. The API allows for retrieving queries and creating them via API in t...
- 1511 Views
- 5 replies
- 2 kudos
- 2 kudos
https://docs.databricks.com/api/workspace/queries https://docs.databricks.com/en/sql/dbsql-api-latest.html#changes-to-the-alerts-api The API path is now api/2.0/sql/alerts, replacing the legacy path of /api/2.0/preview/sql/alerts. https://docs.databr...
- 2 kudos
- 631 Views
- 1 replies
- 1 kudos
System Tables
Hi,I've recently enabled the billing schema in system tables, but still not able to view it in catalog. I am both an account admin and workspace admin, as well as an owner of the workspace in Azure. A colleague (who used to be Azure AD admin but no l...
- 631 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi,I've recently enabled the billing schema in system tables, but still not able to view it in catalog. I am both an account admin and workspace admin, as well as an owner of the workspace in Azure. A colleague (who used to be Azure AD admin but no l...
- 1 kudos
