cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

HariSelvarajan
by Databricks Employee
  • 1164 Views
  • 3 replies
  • 2 kudos

Privileged Identity Management for Databricks with Microsoft Entra ID

Privileged Identity Management (PIM) can be used to secure access to critical Databricks roles with Just-in-Time (JIT) access. This approach helps organizations enforce time-bound permissions, approval workflows, and centralized auditing for sensitiv...

  • 1164 Views
  • 3 replies
  • 2 kudos
Latest Reply
sugidwan
New Contributor II
  • 2 kudos

Thanks for sharing this, it is helpful. However, onboarding the AAD group as an account admin under the Databricks account is not straightforward and is also not clearly explained in the blog.

  • 2 kudos
2 More Replies
AnkurMittal008
by New Contributor III
  • 2658 Views
  • 1 replies
  • 0 kudos

Databricks App : Limitations

I have some questions regarding Databricks App.1) Can we use Framework other than mentioned in documentation( Streamlit,Flask,Dash,Gradio,Shiny).2) Can we allocate compute more than 2 vCPU and 6GB memory to any App.3) Any other programming language o...

  • 2658 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ismael-K
Databricks Employee
  • 0 kudos

1.) You can use most Python-based application frameworks, including some beyond those mentioned above.(Reference here) 2.) Currently, app capacity is limited to 2 vCPUs and 6 GB of RAM. However, future updates may introduce options for scaling out an...

  • 0 kudos
KBN
by New Contributor II
  • 12766 Views
  • 2 replies
  • 2 kudos

Authentication for Databricks Apps

Databricks Apps allows us to define dependencies & an entrypoint to execute a Python application like Gradio, Streamlit, etc. It seems I can also run a FastAPI application and access via an authenticated browser which is potentially a very powerful c...

  • 12766 Views
  • 2 replies
  • 2 kudos
Latest Reply
apinara
New Contributor II
  • 2 kudos

Hello, Thank you for your questions and answers regarding this topic. Is it available this feature right now? Or still not supported? Thank you in advance

  • 2 kudos
1 More Replies
mohsen-dbx
by New Contributor II
  • 1329 Views
  • 2 replies
  • 1 kudos

Databricks Network Policies

Hi Databricks community. I have 2 questions that I'd appreciate if you can shed some lights on:Is the new Network Policies in Databricks account, only applicable to serverless compute or are these workspace-wide policies which apply to all other comp...

mohsendbx_0-1740670036975.png
  • 1329 Views
  • 2 replies
  • 1 kudos
Latest Reply
Rjdudley
Honored Contributor
  • 1 kudos

I am not support, just a regular customer like you, but here is what I know:1. Yes, serverless egress only applies to serverless.  There is another upcoming change you'll need to make for your classic compute, announced by Microsoft at Default outbou...

  • 1 kudos
1 More Replies
dawnCoder
by New Contributor III
  • 1585 Views
  • 3 replies
  • 1 kudos

Vocareum Lab issue

Hi,I have taken a Lab Subscription from databricks academy. It worked fine for me for 1 day. As I try to login today, it is not starting up. I really appreciate any help in this regard. I have things as planned to do on the lab and when it is not sta...

  • 1585 Views
  • 3 replies
  • 1 kudos
Latest Reply
Deepa710
New Contributor III
  • 1 kudos

Hi, was this resolved? can I know the solution please? Also, is there any restriction on the number of days or so to use this lab? I am getting 'Session ended' message even after I login again.RegardsDeepa

  • 1 kudos
2 More Replies
refah_1
by New Contributor
  • 804 Views
  • 0 replies
  • 0 kudos

von Google Cloud Storage

Hi everyone,I'm new to Databricks and am trying to connect my Google Cloud Storage bucket to my Databricks workspace. I have a 43GB CSV file stored in a GCP bucket that I want to work with. Here’s what I've done so far:Bucket Setup:I created a GCP bu...

  • 804 Views
  • 0 replies
  • 0 kudos
patrykp
by New Contributor II
  • 442 Views
  • 2 replies
  • 0 kudos

AWS Secrets Manager access

HiI am trying to establish a method of accessing secrets from AWS Secrets Manager and understand this can be done with boto as suggested from AWS.We have created all of the relevant IAM roles, instance profiles etc.  Accessing S3 with this method is ...

  • 442 Views
  • 2 replies
  • 0 kudos
Latest Reply
patrykp
New Contributor II
  • 0 kudos

Hi @Alberto_Umana,Yes, the Role has the SecretsManagerReadWrite policy.Also within my furthet investigation I tried running it via Personal Cluster and it worked!Basically, 3 scenarios:- Shared Cluster with applied InstanceProfile - Secrets failing- ...

  • 0 kudos
1 More Replies
Dnirmania
by Contributor
  • 266 Views
  • 1 replies
  • 0 kudos

Communication between multiple region workspaces & metastore

Hi EveryoneWe currently have a workspace and metastore in the EastUS region, and we’re planning to set up another workspace and metastore in the Canada region. Additionally, we need to be able to access data from the Canada region within the US regio...

  • 266 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika_
Databricks Employee
  • 0 kudos

Hello @Dnirmania! Delta Sharing is ideal for read-only, cross-platform data access without duplication. Direct metastore connections offer low-latency access between Databricks workspaces under a unified governance model. Additionally, you may explor...

  • 0 kudos
saiV06
by New Contributor III
  • 1052 Views
  • 0 replies
  • 0 kudos

Lakehouse Federation - Unable to connect to Snowflake using "PEM Private Key"

Hi,I'm currently using Lakehouse Federation feature on databricks to run queries against Snowflake datawarehouse. Today I'm using a service credential to establish the connection (user id & pwd), but I have to change it to use private key. I tried us...

  • 1052 Views
  • 0 replies
  • 0 kudos
Ludo
by New Contributor III
  • 1378 Views
  • 2 replies
  • 1 kudos

Issue with Databricks Alerts formatting sent to Microsoft Teams

Hello all,As of Thursday 20th 2025, we started to have our alert notifications being sent via Microsoft Teams with no formatting (raw HTML).We use a custom template with QUERY_RESULT_TABLE  and a few html tags.Looks like databricks alerts deprecated ...

  • 1378 Views
  • 2 replies
  • 1 kudos
Latest Reply
Ludo
New Contributor III
  • 1 kudos

Sorry for you.No solution yet, pending databricks to provide one. (hopefully)

  • 1 kudos
1 More Replies
nishaath
by New Contributor
  • 1019 Views
  • 0 replies
  • 0 kudos

Workspace creation is getting failed constanly

We are trying to create a workspace with custome VPC. But the creation is getting failed constantly.The error doesn't have any description which makes the troubleshoting hard.Does anyboday had similar issue like this before and has a solution? Thanks...

nishaath_1-1740998508239.png
  • 1019 Views
  • 0 replies
  • 0 kudos
Michael_Appiah
by Contributor
  • 1073 Views
  • 0 replies
  • 0 kudos

Enforcing Tags on SQL Warehouses

Is there a way to enforce tags on SQL Warehouses? Regular cluster policies do not apply to SQL Warehouses and budget policies do not cover SQL Warehouses either, which I find quite surprising given the fact that budget policies are documented as "Att...

  • 1073 Views
  • 0 replies
  • 0 kudos
ScottDunk
by New Contributor
  • 288 Views
  • 1 replies
  • 0 kudos

Query not returning result - no internet connection

Hi,New to DBricks. We have set up our new environment and imported some data to tables.  However when we run a query against the table using a newly created warehouse we can see the query runs fine but throw the error: failed communicating with serve...

  • 288 Views
  • 1 replies
  • 0 kudos
Latest Reply
emillion25
New Contributor III
  • 0 kudos

It sounds like there might be a network configuration issue or a client-side problem preventing your query results from appearing in the session, even though they're executing successfully on the server. Here are a few things you could check:Network ...

  • 0 kudos
neointab
by New Contributor
  • 1073 Views
  • 2 replies
  • 1 kudos

Restrict a Workspace User from Creating/Managing Databricks Jobs

Hello Databricks team,I currently have a workspace user, and I want to disable their ability to create or manage Databricks jobs entirely. Specifically, I would like to prevent the user from accessing the "Create Job" option in the Databricks UI or v...

  • 1073 Views
  • 2 replies
  • 1 kudos
Latest Reply
JameDavi_51481
Contributor
  • 1 kudos

Are there any updates on any of these internal feature requests? It's a pretty big failure in the permissions model that we can't prevent users from scheduling arbitrary workloads on compute they are able to access.

  • 1 kudos
1 More Replies
saiV06
by New Contributor III
  • 1100 Views
  • 0 replies
  • 0 kudos

Lakehouse Federation - Unable to connect to Snowflake using "PEM Private Key"

Hi,I'm currently using Lakehouse Federation feature on databricks to run queries against Snowflake datawarehouse. Today I'm using a service credential to establish the connection (user id & pwd), but I have to change it to use private key. I tried us...

Administration & Architecture
FederatedQuery
LakehouseFederation
SnowflakeConnection
  • 1100 Views
  • 0 replies
  • 0 kudos