cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

know-how
by New Contributor III
  • 4886 Views
  • 6 replies
  • 4 kudos

What is the Databricks equivalent of a stored procedure that works with Power BI?

Is there a way to query Databricks using Power BI, via a stored procedure or similar? In my use case the query will have multiple parameters, that the user will provide values for at runtime. I don't think Databricks notebooks can be consumed directl...

  • 4886 Views
  • 6 replies
  • 4 kudos
Latest Reply
db_20240821
New Contributor II
  • 4 kudos

Hi @BrahmareddySorry ... But Stored procedures are much more than just views. This is a big loss for DATABRICKS users. Can they not implement something  ? SOON ? 

  • 4 kudos
5 More Replies
Rajatkumar002
by Databricks Partner
  • 3071 Views
  • 3 replies
  • 1 kudos

session expired Error

Within two minutes of logging into Databricks Community Edition, I am receiving the following error message: "Session expired." The session has ended; please log in again." I've attempted to log in again, but the message "Authenticate the session is ...

  • 3071 Views
  • 3 replies
  • 1 kudos
Latest Reply
Retired_mod
Esteemed Contributor III
  • 1 kudos

Hi @Rajatkumar002, Please review the response and let us know if it answers your question. Your feedback is valuable to us and the community. If the response resolves your issue, kindly mark it as the accepted solution. This will help close the threa...

  • 1 kudos
2 More Replies
Olfa_Kamli
by New Contributor III
  • 1959 Views
  • 1 replies
  • 0 kudos

Config sso and user provioning on databricks via terraform or api

Hi All,I am looking for a way to automate SSO configuration and user provisioning on Databricks. I see that this is feasible via the Databricks console, as documented SSO in your Databricks account console | Databricks on AWS. However, I am not sure ...

  • 1959 Views
  • 1 replies
  • 0 kudos
Latest Reply
suranamudit
New Contributor II
  • 0 kudos

Hi I am also looking to configure SSO in databricks using REST API. Were you able to figure out a way to do that?Thanks

  • 0 kudos
mickl089
by New Contributor
  • 881 Views
  • 1 replies
  • 0 kudos

Google SSO Login after renew Google SSO Cert

Hey there,SSO for Databricks was enabled and worked for us. After renewing the Google SSO Cert, it´s not possible to renew the cert also in DataBricks... can you help me?

  • 881 Views
  • 1 replies
  • 0 kudos
Latest Reply
Retired_mod
Esteemed Contributor III
  • 0 kudos

Hi @mickl089, Thank you for sharing your concern with us!   To expedite your request, please list your concerns on our ticketing portal. Our support staff would be able to act faster on the resolution (our standard resolution time is 24-48 hours).  

  • 0 kudos
clentin
by Contributor
  • 4953 Views
  • 4 replies
  • 5 kudos

Resolved! Databricks Community Edition -- Service Status Page

Databricks Community Edition Service Status Page is not available. Or if available the link is well hidden. This feature will be beneficial to all users of Databricks Community Edition. 

  • 4953 Views
  • 4 replies
  • 5 kudos
Latest Reply
Retired_mod
Esteemed Contributor III
  • 5 kudos

Hi @clentin and @szymon_dybczak, Between 22:00 UTC on August 14, 2024, and 14:43 UTC on August 19, 2024, you may have been a user of Databricks' Community Edition who experienced errors citing "Your session has expired, please authenticate again" wit...

  • 5 kudos
3 More Replies
shiva1212
by New Contributor II
  • 6660 Views
  • 3 replies
  • 1 kudos

Resolved! Shared cluster

Hello Community,At my company, we use Databricks extensively for workflow development. We operate on a shared cluster that multiple users access concurrently, and we utilize a shared workspace, where one folder is accessible to a designated group. Ea...

  • 6660 Views
  • 3 replies
  • 1 kudos
Latest Reply
Aviral-Bhardwaj
Esteemed Contributor III
  • 1 kudos

No Shiva, it don't work like that,one notebook one session simple, collaborative notebook means one development notebook with multiple user ,but multiple session wont work like that .

  • 1 kudos
2 More Replies
breaka
by New Contributor III
  • 1909 Views
  • 1 replies
  • 0 kudos

DAB Deployment to a (external) volume on UC

Hi everyone,We are currently migrating to Unity Catalog and also our CD pipeline from DBX to Assets Bundle.Reading the documentation beforehand, I was totally sure that Databricks would support deploying jobs directly to (external) volumes as it woul...

  • 1909 Views
  • 1 replies
  • 0 kudos
Latest Reply
prith
New Contributor III
  • 0 kudos

The path in the databricks.yml is with 2 slashes.. This is what I used root_path: s3://test-${var.sdlc_env}-us-east-1/dabs-artifacts/projects/.bundle/${bundle.name}/${bundle.target}Yet still I got the error Error: Path (s3:/test-dev-us-east-1/dabs-ar...

  • 0 kudos
AClarkson
by New Contributor II
  • 12795 Views
  • 3 replies
  • 0 kudos

AWS Secrets Manager access

HiWe're in the process of moving over from Databricks in Azure to AWS.I am trying to establish a method of accessing secrets from AWS Secrets Manager (we were using Azure KeyVault) and understand this can be done with boto as suggested from AWS.We ha...

  • 12795 Views
  • 3 replies
  • 0 kudos
Latest Reply
AClarkson
New Contributor II
  • 0 kudos

I should add I'm running this on a shared cluster and therefore suspect the following constraints are impeding me:Taken from:  https://docs.databricks.com/en/clusters/configure.htmlCannot connect to the instance metadata service (IMDS), other EC2 ins...

  • 0 kudos
2 More Replies
Mathias_Peters
by Contributor II
  • 1404 Views
  • 1 replies
  • 0 kudos

Databricks Terraform Module for reading the current clusters times out

Hi, we are managing our Databricks Workspaces entirely using terraform. As of today, the module to read the current clusters fails with a timeout. We use this:data "databricks_clusters" "this" { }This has worked flawlessly before. However, now we are...

Mathias_Peters_0-1723728679046.png
  • 1404 Views
  • 1 replies
  • 0 kudos
Latest Reply
Mathias_Peters
Contributor II
  • 0 kudos

Correction of my previous post: The error occurs when bumping the provider version to 1.50.0. It works fine on 1.49.0

  • 0 kudos
MichaelO
by New Contributor III
  • 1599 Views
  • 2 replies
  • 0 kudos

Terraform databricks new feature

I recently saw a new feature in databricks that allows to set an upper limit of run time for jobs, so it fails when the limit is breached. See image below:Are we able to terraform code this new feature?

MichaelO_0-1723549982471.png
  • 1599 Views
  • 2 replies
  • 0 kudos
Latest Reply
Retired_mod
Esteemed Contributor III
  • 0 kudos

Hi @Rjdudley, Thanks for reaching out! Please review the response and let us know which best addresses your question. Your feedback is valuable to us and the community.   If the response resolves your issue, kindly mark it as the accepted solution. T...

  • 0 kudos
1 More Replies
m997al
by Contributor III
  • 5129 Views
  • 2 replies
  • 1 kudos

Azure Databricks SCIM provisioning configured, working...but what happens when user is deleted?

Hi - I have Azure Databricks with Unity Catalog, and the SCIM Connector provisioning up and working.Due to a misunderstanding on my part, I deleted some individual users (using the Databricks admin console) thinking that I was deleting individual acc...

  • 5129 Views
  • 2 replies
  • 1 kudos
Latest Reply
m997al
Contributor III
  • 1 kudos

This was resolved...but why it was resolved remains a mystery.  We simply re-provisioned by turning off and then on the SCIM provisioning in the Azure portal for the Databricks SCIM connector (which is supposed to cause a full re-provisioning, but di...

  • 1 kudos
1 More Replies
Olex
by New Contributor II
  • 7562 Views
  • 5 replies
  • 1 kudos

Unable to login accounts.azuredatabricks.net and create admin account

Hello everyoneI'm trying to setup my admin account in Databricks Admin Console and am following these steps:https://learn.microsoft.com/en-us/azure/databricks/administration-guide/#--what-are-account-adminsHowever, when I access accounts.azuredatabri...

  • 7562 Views
  • 5 replies
  • 1 kudos
Latest Reply
Olex
New Contributor II
  • 1 kudos

Hi everyoneI asked that question a year and somehow it'd been solved.Not sure however if it's related to generic email providers, but I have multiple registered accounts, gmail and corporate one. For databricks accademy, I'm using gmail account, whic...

  • 1 kudos
4 More Replies
shubhdhanuka
by New Contributor
  • 2883 Views
  • 1 replies
  • 0 kudos

Account Access token

Can you please help me with how to authenticate account level rest apis?curl --request GET https://accounts.cloud.databricks.com/api/2.0/accounts/{account_id}/usageI use Permanent Access Token to authenticate workspace APIs but it's not working for w...

  • 2883 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @shubhdhanuka ,To get access to account API you cannot use personal access token. Instead, you must use the Microsoft Entra ID tokens of Azure Databricks account admins. Azure Databricks account admins can be users or service principals.Below you ...

  • 0 kudos
jenshumrich
by Contributor
  • 4045 Views
  • 3 replies
  • 2 kudos

Databricks UI error

I receive this respone when trying to download a csv file: adb-737684297741988.8.azuredatabricks.net/ajax-api/2.0/workspace/export?path=/Repos/jhu_admin%40siemensgamesa.com/sgre-dfp-lifestrategy-python/cpo/output/Rattlesnake Flats/Rdata/AssetCheck_Ra...

jenshumrich_0-1723198951857.png
  • 4045 Views
  • 3 replies
  • 2 kudos
Latest Reply
jenshumrich
Contributor
  • 2 kudos

@szymon_dybczak I am using the GUI (see the screenshot in the original post): File marked -> Three dots -> Export

  • 2 kudos
2 More Replies
dprutean
by New Contributor III
  • 3303 Views
  • 1 replies
  • 0 kudos

JDBC Error with OpenJDK 21

Connecting to Azure Databricks using latest JDBC driver and OpenJDK 21 I got this error. I already set:--add-opens=java.base/java.nio=ALL-UNNAMED-Dio.netty.tryReflectionSetAccessible=true java.sql.SQLException: [Databricks][JDBCDriver](500618) Error ...

  • 3303 Views
  • 1 replies
  • 0 kudos
Latest Reply
151640
Databricks Partner
  • 0 kudos

Version 02.06.38.1068Using SQLSquirrel with ibm-semeru-certified-17-jdk (17.0.11+9)With JRE options --add-opens=jdk.unsupported/sun.misc=ALL-UNNAMED failsShould be  --add-opens=java.base/java.nio=ALL-UNNAMEDcaused by: java.lang.reflect.InaccessibleOb...

  • 0 kudos