- 1768 Views
- 1 replies
- 0 kudos
Config sso and user provioning on databricks via terraform or api
Hi All,I am looking for a way to automate SSO configuration and user provisioning on Databricks. I see that this is feasible via the Databricks console, as documented SSO in your Databricks account console | Databricks on AWS. However, I am not sure ...
- 1768 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi I am also looking to configure SSO in databricks using REST API. Were you able to figure out a way to do that?Thanks
- 0 kudos
- 740 Views
- 1 replies
- 0 kudos
Google SSO Login after renew Google SSO Cert
Hey there,SSO for Databricks was enabled and worked for us. After renewing the Google SSO Cert, it´s not possible to renew the cert also in DataBricks... can you help me?
- 740 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @mickl089, Thank you for sharing your concern with us! To expedite your request, please list your concerns on our ticketing portal. Our support staff would be able to act faster on the resolution (our standard resolution time is 24-48 hours).
- 0 kudos
- 3910 Views
- 4 replies
- 5 kudos
Resolved! Databricks Community Edition -- Service Status Page
Databricks Community Edition Service Status Page is not available. Or if available the link is well hidden. This feature will be beneficial to all users of Databricks Community Edition.
- 3910 Views
- 4 replies
- 5 kudos
- 5 kudos
Hi @clentin and @szymon_dybczak, Between 22:00 UTC on August 14, 2024, and 14:43 UTC on August 19, 2024, you may have been a user of Databricks' Community Edition who experienced errors citing "Your session has expired, please authenticate again" wit...
- 5 kudos
- 6164 Views
- 3 replies
- 1 kudos
Resolved! Shared cluster
Hello Community,At my company, we use Databricks extensively for workflow development. We operate on a shared cluster that multiple users access concurrently, and we utilize a shared workspace, where one folder is accessible to a designated group. Ea...
- 6164 Views
- 3 replies
- 1 kudos
- 1 kudos
No Shiva, it don't work like that,one notebook one session simple, collaborative notebook means one development notebook with multiple user ,but multiple session wont work like that .
- 1 kudos
- 1538 Views
- 1 replies
- 0 kudos
DAB Deployment to a (external) volume on UC
Hi everyone,We are currently migrating to Unity Catalog and also our CD pipeline from DBX to Assets Bundle.Reading the documentation beforehand, I was totally sure that Databricks would support deploying jobs directly to (external) volumes as it woul...
- 1538 Views
- 1 replies
- 0 kudos
- 0 kudos
The path in the databricks.yml is with 2 slashes.. This is what I used root_path: s3://test-${var.sdlc_env}-us-east-1/dabs-artifacts/projects/.bundle/${bundle.name}/${bundle.target}Yet still I got the error Error: Path (s3:/test-dev-us-east-1/dabs-ar...
- 0 kudos
- 11514 Views
- 3 replies
- 0 kudos
AWS Secrets Manager access
HiWe're in the process of moving over from Databricks in Azure to AWS.I am trying to establish a method of accessing secrets from AWS Secrets Manager (we were using Azure KeyVault) and understand this can be done with boto as suggested from AWS.We ha...
- 11514 Views
- 3 replies
- 0 kudos
- 0 kudos
I should add I'm running this on a shared cluster and therefore suspect the following constraints are impeding me:Taken from: https://docs.databricks.com/en/clusters/configure.htmlCannot connect to the instance metadata service (IMDS), other EC2 ins...
- 0 kudos
- 1160 Views
- 1 replies
- 0 kudos
Databricks Terraform Module for reading the current clusters times out
Hi, we are managing our Databricks Workspaces entirely using terraform. As of today, the module to read the current clusters fails with a timeout. We use this:data "databricks_clusters" "this" { }This has worked flawlessly before. However, now we are...
- 1160 Views
- 1 replies
- 0 kudos
- 0 kudos
Correction of my previous post: The error occurs when bumping the provider version to 1.50.0. It works fine on 1.49.0
- 0 kudos
- 1311 Views
- 2 replies
- 0 kudos
Terraform databricks new feature
I recently saw a new feature in databricks that allows to set an upper limit of run time for jobs, so it fails when the limit is breached. See image below:Are we able to terraform code this new feature?
- 1311 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Rjdudley, Thanks for reaching out! Please review the response and let us know which best addresses your question. Your feedback is valuable to us and the community. If the response resolves your issue, kindly mark it as the accepted solution. T...
- 0 kudos
- 4149 Views
- 2 replies
- 1 kudos
Azure Databricks SCIM provisioning configured, working...but what happens when user is deleted?
Hi - I have Azure Databricks with Unity Catalog, and the SCIM Connector provisioning up and working.Due to a misunderstanding on my part, I deleted some individual users (using the Databricks admin console) thinking that I was deleting individual acc...
- 4149 Views
- 2 replies
- 1 kudos
- 1 kudos
This was resolved...but why it was resolved remains a mystery. We simply re-provisioned by turning off and then on the SCIM provisioning in the Azure portal for the Databricks SCIM connector (which is supposed to cause a full re-provisioning, but di...
- 1 kudos
- 6272 Views
- 5 replies
- 1 kudos
Unable to login accounts.azuredatabricks.net and create admin account
Hello everyoneI'm trying to setup my admin account in Databricks Admin Console and am following these steps:https://learn.microsoft.com/en-us/azure/databricks/administration-guide/#--what-are-account-adminsHowever, when I access accounts.azuredatabri...
- 6272 Views
- 5 replies
- 1 kudos
- 1 kudos
Hi everyoneI asked that question a year and somehow it'd been solved.Not sure however if it's related to generic email providers, but I have multiple registered accounts, gmail and corporate one. For databricks accademy, I'm using gmail account, whic...
- 1 kudos
- 1994 Views
- 1 replies
- 0 kudos
Account Access token
Can you please help me with how to authenticate account level rest apis?curl --request GET https://accounts.cloud.databricks.com/api/2.0/accounts/{account_id}/usageI use Permanent Access Token to authenticate workspace APIs but it's not working for w...
- 1994 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @shubhdhanuka ,To get access to account API you cannot use personal access token. Instead, you must use the Microsoft Entra ID tokens of Azure Databricks account admins. Azure Databricks account admins can be users or service principals.Below you ...
- 0 kudos
- 3632 Views
- 3 replies
- 2 kudos
Databricks UI error
I receive this respone when trying to download a csv file: adb-737684297741988.8.azuredatabricks.net/ajax-api/2.0/workspace/export?path=/Repos/jhu_admin%40siemensgamesa.com/sgre-dfp-lifestrategy-python/cpo/output/Rattlesnake Flats/Rdata/AssetCheck_Ra...
- 3632 Views
- 3 replies
- 2 kudos
- 2 kudos
@szymon_dybczak I am using the GUI (see the screenshot in the original post): File marked -> Three dots -> Export
- 2 kudos
- 2655 Views
- 1 replies
- 0 kudos
JDBC Error with OpenJDK 21
Connecting to Azure Databricks using latest JDBC driver and OpenJDK 21 I got this error. I already set:--add-opens=java.base/java.nio=ALL-UNNAMED-Dio.netty.tryReflectionSetAccessible=true java.sql.SQLException: [Databricks][JDBCDriver](500618) Error ...
- 2655 Views
- 1 replies
- 0 kudos
- 0 kudos
Version 02.06.38.1068Using SQLSquirrel with ibm-semeru-certified-17-jdk (17.0.11+9)With JRE options --add-opens=jdk.unsupported/sun.misc=ALL-UNNAMED failsShould be --add-opens=java.base/java.nio=ALL-UNNAMEDcaused by: java.lang.reflect.InaccessibleOb...
- 0 kudos
- 1180 Views
- 2 replies
- 1 kudos
[Metastore] can't assign to workspace in cross Azure Account envirronment
Hi all,hope you are doing well. We have a metastore in tenant A, and workspaces in tenant B. Tenant B has Contributor Role to tenant A, to access the metastore. For some reasons, we can not assign the metastore from tenant A to the workspace in tenan...
- 1180 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @data_bricklayer, To address this, ensure the Contributor Role in tenant B has the right permissions for tenant A's metastore. Verify that the workspace in tenant B is properly registered and visible in tenant A and that both are in the same regio...
- 1 kudos
- 1889 Views
- 3 replies
- 4 kudos
dbutils secrets break matplotlib in recent Databricks runtimes
Using a Databricks cluster running Databricks Runtime version 15.4 LTS Beta, and with no init-scripts, the following code works fine:import numpy as npimport pandas as pddf = pd.DataFrame(np.random.randn(2000, 10))df.plot(subplots=True, figsize=(10, ...
- 1889 Views
- 3 replies
- 4 kudos
- 4 kudos
OK, I understand the error now:This specific secret is a small alphanumeric string. The probability of it being part of the base64 of a big PNG is quite large.Is there any workaround for this? I know I can't turn off the redaction of secrets. Can I d...
- 4 kudos
