- 207 Views
- 2 replies
- 0 kudos
DAB Deployment to a (external) volume on UC
Hi everyone,We are currently migrating to Unity Catalog and also our CD pipeline from DBX to Assets Bundle.Reading the documentation beforehand, I was totally sure that Databricks would support deploying jobs directly to (external) volumes as it woul...
- 207 Views
- 2 replies
- 0 kudos
- 0 kudos
The path in the databricks.yml is with 2 slashes.. This is what I used root_path: s3://test-${var.sdlc_env}-us-east-1/dabs-artifacts/projects/.bundle/${bundle.name}/${bundle.target}Yet still I got the error Error: Path (s3:/test-dev-us-east-1/dabs-ar...
- 0 kudos
- 105 Views
- 0 replies
- 0 kudos
How to monitor serverless compute usage in real time
Hello, I'm using Databricks Connect to connect a dash app to my Databricks account. My use case is similar to this example: https://github.com/databricks-demos/dbconnect-examples/tree/main/python/PlotlyI've been able to get everything configured and ...
- 105 Views
- 0 replies
- 0 kudos
- 5630 Views
- 5 replies
- 1 kudos
Resolved! AWS Secrets Manager access
HiWe're in the process of moving over from Databricks in Azure to AWS.I am trying to establish a method of accessing secrets from AWS Secrets Manager (we were using Azure KeyVault) and understand this can be done with boto as suggested from AWS.We ha...
- 5630 Views
- 5 replies
- 1 kudos
- 1 kudos
Hi @AClarkson, I understand that you are trying to access AWS Secrets Manager from a shared cluster and are facing issues due to the constraints mentioned in the documentation . Since the instance metadata service (IMDS) is not accessible from the sh...
- 1 kudos
- 149 Views
- 1 replies
- 0 kudos
Databricks Terraform Module for reading the current clusters times out
Hi, we are managing our Databricks Workspaces entirely using terraform. As of today, the module to read the current clusters fails with a timeout. We use this:data "databricks_clusters" "this" { }This has worked flawlessly before. However, now we are...
- 149 Views
- 1 replies
- 0 kudos
- 0 kudos
Correction of my previous post: The error occurs when bumping the provider version to 1.50.0. It works fine on 1.49.0
- 0 kudos
- 96 Views
- 0 replies
- 0 kudos
Would it be great if the job workflow supports running docker-based tasks
The current workflow function in Databricks gives a series of options such as DLT, Dbt, python scripts, python files, JAR, etc. It would be good to add a docker file to that and simplify the development process a lot, especially on the unit and integ...
- 96 Views
- 0 replies
- 0 kudos
- 170 Views
- 0 replies
- 0 kudos
Programmatically setting tags for securables
Unity Catalog securable objects can be tagged with key value pairs: https://learn.microsoft.com/en-us/azure/databricks/database-objects/tagsIs it possible tag objects via REST API calls?I initially thought any Unity Catalog resource in the Databricks...
- 170 Views
- 0 replies
- 0 kudos
- 261 Views
- 2 replies
- 0 kudos
Terraform databricks new feature
I recently saw a new feature in databricks that allows to set an upper limit of run time for jobs, so it fails when the limit is breached. See image below:Are we able to terraform code this new feature?
- 261 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Rjdudley, Thanks for reaching out! Please review the response and let us know which best addresses your question. Your feedback is valuable to us and the community. If the response resolves your issue, kindly mark it as the accepted solution. T...
- 0 kudos
- 266 Views
- 0 replies
- 0 kudos
client.openSession() : TypeError: Cannot read properties of undefined (reading '0')
I am using the Databricks SQL Driver for Node.js to create an endpoint that queries a Databricks database following the guide here Databricks SQL Driver for Node.js | Databricks on AWS . This code was working previously but now I am getting a TypeErr...
- 266 Views
- 0 replies
- 0 kudos
- 281 Views
- 2 replies
- 1 kudos
Azure Databricks SCIM provisioning configured, working...but what happens when user is deleted?
Hi - I have Azure Databricks with Unity Catalog, and the SCIM Connector provisioning up and working.Due to a misunderstanding on my part, I deleted some individual users (using the Databricks admin console) thinking that I was deleting individual acc...
- 281 Views
- 2 replies
- 1 kudos
- 1 kudos
This was resolved...but why it was resolved remains a mystery. We simply re-provisioned by turning off and then on the SCIM provisioning in the Azure portal for the Databricks SCIM connector (which is supposed to cause a full re-provisioning, but di...
- 1 kudos
- 220 Views
- 0 replies
- 0 kudos
How to assign user group for email notification in databricks Alerts
How can I assign a azure databricks user group to an alert for notification?Current scenario is whenever we need to add a user for alert email notification we are manually adding that user email address to each we setup (more than 100) which is very ...
- 220 Views
- 0 replies
- 0 kudos
- 1796 Views
- 5 replies
- 1 kudos
Unable to login accounts.azuredatabricks.net and create admin account
Hello everyoneI'm trying to setup my admin account in Databricks Admin Console and am following these steps:https://learn.microsoft.com/en-us/azure/databricks/administration-guide/#--what-are-account-adminsHowever, when I access accounts.azuredatabri...
- 1796 Views
- 5 replies
- 1 kudos
- 1 kudos
Hi everyoneI asked that question a year and somehow it'd been solved.Not sure however if it's related to generic email providers, but I have multiple registered accounts, gmail and corporate one. For databricks accademy, I'm using gmail account, whic...
- 1 kudos
- 188 Views
- 1 replies
- 0 kudos
Account Access token
Can you please help me with how to authenticate account level rest apis?curl --request GET https://accounts.cloud.databricks.com/api/2.0/accounts/{account_id}/usageI use Permanent Access Token to authenticate workspace APIs but it's not working for w...
- 188 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @shubhdhanuka ,To get access to account API you cannot use personal access token. Instead, you must use the Microsoft Entra ID tokens of Azure Databricks account admins. Azure Databricks account admins can be users or service principals.Below you ...
- 0 kudos
- 586 Views
- 3 replies
- 2 kudos
Databricks UI error
I receive this respone when trying to download a csv file: adb-737684297741988.8.azuredatabricks.net/ajax-api/2.0/workspace/export?path=/Repos/jhu_admin%40siemensgamesa.com/sgre-dfp-lifestrategy-python/cpo/output/Rattlesnake Flats/Rdata/AssetCheck_Ra...
- 586 Views
- 3 replies
- 2 kudos
- 2 kudos
@szymon_dybczak I am using the GUI (see the screenshot in the original post): File marked -> Three dots -> Export
- 2 kudos
- 119 Views
- 0 replies
- 0 kudos
- 119 Views
- 0 replies
- 0 kudos
- 218 Views
- 2 replies
- 0 kudos
JDBC Error with OpenJDK 21
Connecting to Azure Databricks using latest JDBC driver and OpenJDK 21 I got this error. I already set:--add-opens=java.base/java.nio=ALL-UNNAMED-Dio.netty.tryReflectionSetAccessible=true java.sql.SQLException: [Databricks][JDBCDriver](500618) Error ...
- 218 Views
- 2 replies
- 0 kudos
- 0 kudos
Version 02.06.38.1068Using SQLSquirrel with ibm-semeru-certified-17-jdk (17.0.11+9)With JRE options --add-opens=jdk.unsupported/sun.misc=ALL-UNNAMED failsShould be --add-opens=java.base/java.nio=ALL-UNNAMEDcaused by: java.lang.reflect.InaccessibleOb...
- 0 kudos
