cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

know-how
by New Contributor III
  • 3441 Views
  • 6 replies
  • 4 kudos

What is the Databricks equivalent of a stored procedure that works with Power BI?

Is there a way to query Databricks using Power BI, via a stored procedure or similar? In my use case the query will have multiple parameters, that the user will provide values for at runtime. I don't think Databricks notebooks can be consumed directl...

  • 3441 Views
  • 6 replies
  • 4 kudos
Latest Reply
db_20240821
New Contributor II
  • 4 kudos

Hi @BrahmareddySorry ... But Stored procedures are much more than just views. This is a big loss for DATABRICKS users. Can they not implement something  ? SOON ? 

  • 4 kudos
5 More Replies
Rajatkumar002
by New Contributor
  • 1945 Views
  • 3 replies
  • 1 kudos

session expired Error

Within two minutes of logging into Databricks Community Edition, I am receiving the following error message: "Session expired." The session has ended; please log in again." I've attempted to log in again, but the message "Authenticate the session is ...

  • 1945 Views
  • 3 replies
  • 1 kudos
Latest Reply
Retired_mod
Esteemed Contributor III
  • 1 kudos

Hi @Rajatkumar002, Please review the response and let us know if it answers your question. Your feedback is valuable to us and the community. If the response resolves your issue, kindly mark it as the accepted solution. This will help close the threa...

  • 1 kudos
2 More Replies
Olfa_Kamli
by New Contributor III
  • 1373 Views
  • 1 replies
  • 0 kudos

Config sso and user provioning on databricks via terraform or api

Hi All,I am looking for a way to automate SSO configuration and user provisioning on Databricks. I see that this is feasible via the Databricks console, as documented SSO in your Databricks account console | Databricks on AWS. However, I am not sure ...

  • 1373 Views
  • 1 replies
  • 0 kudos
Latest Reply
suranamudit
New Contributor II
  • 0 kudos

Hi I am also looking to configure SSO in databricks using REST API. Were you able to figure out a way to do that?Thanks

  • 0 kudos
mickl089
by New Contributor
  • 606 Views
  • 1 replies
  • 0 kudos

Google SSO Login after renew Google SSO Cert

Hey there,SSO for Databricks was enabled and worked for us. After renewing the Google SSO Cert, it´s not possible to renew the cert also in DataBricks... can you help me?

  • 606 Views
  • 1 replies
  • 0 kudos
Latest Reply
Retired_mod
Esteemed Contributor III
  • 0 kudos

Hi @mickl089, Thank you for sharing your concern with us!   To expedite your request, please list your concerns on our ticketing portal. Our support staff would be able to act faster on the resolution (our standard resolution time is 24-48 hours).  

  • 0 kudos
EdsonDEV
by New Contributor
  • 2565 Views
  • 0 replies
  • 0 kudos

Error on github association

Hello,I'm having an error when trying to link a GitHub account to store some scripts. Looks like my profile keeps on eternal loading too. Does anyone know how I can fix that?

  • 2565 Views
  • 0 replies
  • 0 kudos
clentin
by Contributor
  • 2854 Views
  • 4 replies
  • 5 kudos

Resolved! Databricks Community Edition -- Service Status Page

Databricks Community Edition Service Status Page is not available. Or if available the link is well hidden. This feature will be beneficial to all users of Databricks Community Edition. 

  • 2854 Views
  • 4 replies
  • 5 kudos
Latest Reply
Retired_mod
Esteemed Contributor III
  • 5 kudos

Hi @clentin and @szymon_dybczak, Between 22:00 UTC on August 14, 2024, and 14:43 UTC on August 19, 2024, you may have been a user of Databricks' Community Edition who experienced errors citing "Your session has expired, please authenticate again" wit...

  • 5 kudos
3 More Replies
yvishal519
by Contributor
  • 2335 Views
  • 2 replies
  • 2 kudos

Resolved! Restricting Catalog and External Location Visibility Across Databricks Workspaces

Hi Databricks Community,I need some guidance regarding catalogs and external locations across multiple environments. Here's my situation:I've set up a resource group (dev-rg) and created a Databricks workspace where I successfully created catalogs (b...

  • 2335 Views
  • 2 replies
  • 2 kudos
Latest Reply
Retired_mod
Esteemed Contributor III
  • 2 kudos

Hi @yvishal519, Thanks for reaching out! Please review the response and let us know if it answers your question. Your feedback is valuable to us and the community. If the response resolves your issue, kindly mark it as the accepted solution. This wil...

  • 2 kudos
1 More Replies
shiva1212
by New Contributor II
  • 5671 Views
  • 3 replies
  • 1 kudos

Resolved! Shared cluster

Hello Community,At my company, we use Databricks extensively for workflow development. We operate on a shared cluster that multiple users access concurrently, and we utilize a shared workspace, where one folder is accessible to a designated group. Ea...

  • 5671 Views
  • 3 replies
  • 1 kudos
Latest Reply
Aviral-Bhardwaj
Esteemed Contributor III
  • 1 kudos

No Shiva, it don't work like that,one notebook one session simple, collaborative notebook means one development notebook with multiple user ,but multiple session wont work like that .

  • 1 kudos
2 More Replies
breaka
by New Contributor III
  • 1250 Views
  • 1 replies
  • 0 kudos

DAB Deployment to a (external) volume on UC

Hi everyone,We are currently migrating to Unity Catalog and also our CD pipeline from DBX to Assets Bundle.Reading the documentation beforehand, I was totally sure that Databricks would support deploying jobs directly to (external) volumes as it woul...

  • 1250 Views
  • 1 replies
  • 0 kudos
Latest Reply
prith
New Contributor III
  • 0 kudos

The path in the databricks.yml is with 2 slashes.. This is what I used root_path: s3://test-${var.sdlc_env}-us-east-1/dabs-artifacts/projects/.bundle/${bundle.name}/${bundle.target}Yet still I got the error Error: Path (s3:/test-dev-us-east-1/dabs-ar...

  • 0 kudos
Carson
by New Contributor II
  • 2998 Views
  • 0 replies
  • 1 kudos

How to monitor serverless compute usage in real time

Hello, I'm using Databricks Connect to connect a dash app to my Databricks account. My use case is similar to this example: https://github.com/databricks-demos/dbconnect-examples/tree/main/python/PlotlyI've been able to get everything configured and ...

  • 2998 Views
  • 0 replies
  • 1 kudos
AClarkson
by New Contributor II
  • 10200 Views
  • 3 replies
  • 0 kudos

AWS Secrets Manager access

HiWe're in the process of moving over from Databricks in Azure to AWS.I am trying to establish a method of accessing secrets from AWS Secrets Manager (we were using Azure KeyVault) and understand this can be done with boto as suggested from AWS.We ha...

  • 10200 Views
  • 3 replies
  • 0 kudos
Latest Reply
AClarkson
New Contributor II
  • 0 kudos

I should add I'm running this on a shared cluster and therefore suspect the following constraints are impeding me:Taken from:  https://docs.databricks.com/en/clusters/configure.htmlCannot connect to the instance metadata service (IMDS), other EC2 ins...

  • 0 kudos
2 More Replies
Mathias_Peters
by Contributor II
  • 808 Views
  • 1 replies
  • 0 kudos

Databricks Terraform Module for reading the current clusters times out

Hi, we are managing our Databricks Workspaces entirely using terraform. As of today, the module to read the current clusters fails with a timeout. We use this:data "databricks_clusters" "this" { }This has worked flawlessly before. However, now we are...

Mathias_Peters_0-1723728679046.png
  • 808 Views
  • 1 replies
  • 0 kudos
Latest Reply
Mathias_Peters
Contributor II
  • 0 kudos

Correction of my previous post: The error occurs when bumping the provider version to 1.50.0. It works fine on 1.49.0

  • 0 kudos
mo_moattar
by New Contributor III
  • 2752 Views
  • 0 replies
  • 0 kudos

Would it be great if the job workflow supports running docker-based tasks

The current workflow function in Databricks gives a series of options such as DLT, Dbt, python scripts, python files, JAR, etc. It would be good to add a docker file to that and simplify the development process a lot, especially on the unit and integ...

  • 2752 Views
  • 0 replies
  • 0 kudos
camilo_s
by Contributor
  • 3005 Views
  • 0 replies
  • 0 kudos

Programmatically setting tags for securables

Unity Catalog securable objects can be tagged with key value pairs: https://learn.microsoft.com/en-us/azure/databricks/database-objects/tagsIs it possible tag objects via REST API calls?I initially thought any Unity Catalog resource in the Databricks...

  • 3005 Views
  • 0 replies
  • 0 kudos