cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Aaron_Wong
by New Contributor II
  • 2493 Views
  • 8 replies
  • 0 kudos

How do I simply disable someone's user account

I'm trying to do something seemingly very simple - disable someone's user account. I don't even want to delete the user, just disable it for the time being. How do I go about doing that? 

  • 2493 Views
  • 8 replies
  • 0 kudos
Latest Reply
maaz1
New Contributor II
  • 0 kudos

 In Databricks, go to the Admin Console.Navigate to the Service Principals section.Create a Service Role (make sure it has necessary permissions (Admin Access).Generate OAuth TokenFollow the instructions in the Databricks documentation to generate ap...

  • 0 kudos
7 More Replies
harripy
by New Contributor III
  • 2291 Views
  • 2 replies
  • 0 kudos

Proper way to collect Statement ID from JDBC Connection

Hi, We are executing DML calls on Databricks SQL Warehouse programmatically, with Java and Python.There can be thousands of executions running on daily level, so in case of an error occurs, it would be very beneficial to spot the Statement ID of the ...

  • 2291 Views
  • 2 replies
  • 0 kudos
Latest Reply
oprime
New Contributor II
  • 0 kudos

Found a way to extract it for below dbx-java library.-> databricks-jdbc library version : `2.6.32` private static String extractQueryIdFromDbxStatement(Hive42PreparedStatement statement) { byte[] guid = ((HiveJDBCNativeQueryExecutor) state...

  • 0 kudos
1 More Replies
bhanu_dp
by New Contributor III
  • 2389 Views
  • 0 replies
  • 0 kudos

How to know Legacy Metastore connection to SQL DB (used to store metadata)

I am logged into a workspace and trying to check the schemas in legacy hive_metastore using a serverless compute, I can see the schemas listed.However, when I am creating all-purpose cluster and trying to check the schemas in legacy hive_metastore. I...

Administration & Architecture
configuration
Hive
metastore
  • 2389 Views
  • 0 replies
  • 0 kudos
AnkurMittal008
by New Contributor III
  • 1116 Views
  • 1 replies
  • 0 kudos

Secret Creation for Service Principal using API

There is API available to create a secret for Service Principal./api/2.0/accounts/{account_id}/servicePrincipals/{service_principal_id}/credentials/secretsCan anyone please help what has to be passed as authentication for this API ? This is looking a...

  • 1116 Views
  • 1 replies
  • 0 kudos
Latest Reply
Stefan-Koch
Valued Contributor II
  • 0 kudos

hi @AnkurMittal008 In general, I do not recommend using tokens anymore. Instead, if you want to log in via databricks cli, you can use this command:databricks auth login --host https://accounts.azuredatabricks.net/ --account-id <YOUR_ACCOUNT_ID>This ...

  • 0 kudos
jeet414
by New Contributor
  • 622 Views
  • 1 replies
  • 0 kudos

Reading delta table from ADLS gen2 using ABFS driver

Scenario - I have an ADLS g2 account and trying to read a delta table using ABFS driver. I am using Databricks Serverless compute. There are no firewalls in place as I am working with sample data. There's network line of sight between Databricks serv...

  • 622 Views
  • 1 replies
  • 0 kudos
Latest Reply
Nivethan_Venkat
Contributor III
  • 0 kudos

Hi @jeet414,You can always read Delta table from ADLS storage in Databricks mount points: https://learn.microsoft.com/en-us/azure/databricks/dbfs/mountsThis is just experimental, please give it a try.Best Regards,Nivethan V

  • 0 kudos
PaulJones
by New Contributor
  • 381 Views
  • 1 replies
  • 0 kudos

Querying view gives spurious error

When trying to query a view, my_view, we sometimes see a spurious error. This seems to occur after the table underlying the view has been updated. The error persists for a while and then it seems to fix itself. Error running query: [42501] [Simba][Ha...

  • 381 Views
  • 1 replies
  • 0 kudos
Latest Reply
mnorland
Valued Contributor
  • 0 kudos

Are there DDL updates of the view going on?

  • 0 kudos
karthiknuvepro
by New Contributor II
  • 1002 Views
  • 3 replies
  • 0 kudos

Databricks Workspace Access and Permissions

Hi Team,The GCP Databricks URL https://accounts.gcp.databricks.com/ for GCP Databricks is linked to the GCP Billing Account.We have two clients with separate GCP Organizations:client1.example.comclient2.example.comBoth GCP Organizations share the sam...

  • 1002 Views
  • 3 replies
  • 0 kudos
Latest Reply
mnorland
Valued Contributor
  • 0 kudos

@karthiknuvepro The Databricks Account should be handled by a third-party Cloud Administration team.  The workspace admins can work with them to set up the necessary cloud resources to support their catalogs and user adds/remove from their selected a...

  • 0 kudos
2 More Replies
KBN
by New Contributor II
  • 13239 Views
  • 2 replies
  • 2 kudos

Authentication for Databricks Apps

Databricks Apps allows us to define dependencies & an entrypoint to execute a Python application like Gradio, Streamlit, etc. It seems I can also run a FastAPI application and access via an authenticated browser which is potentially a very powerful c...

  • 13239 Views
  • 2 replies
  • 2 kudos
Latest Reply
apinara
New Contributor II
  • 2 kudos

Hello, Thank you for your questions and answers regarding this topic. Is it available this feature right now? Or still not supported? Thank you in advance

  • 2 kudos
1 More Replies
mohsen-dbx
by New Contributor II
  • 3097 Views
  • 2 replies
  • 1 kudos

Databricks Network Policies

Hi Databricks community. I have 2 questions that I'd appreciate if you can shed some lights on:Is the new Network Policies in Databricks account, only applicable to serverless compute or are these workspace-wide policies which apply to all other comp...

mohsendbx_0-1740670036975.png
  • 3097 Views
  • 2 replies
  • 1 kudos
Latest Reply
Rjdudley
Honored Contributor
  • 1 kudos

I am not support, just a regular customer like you, but here is what I know:1. Yes, serverless egress only applies to serverless.  There is another upcoming change you'll need to make for your classic compute, announced by Microsoft at Default outbou...

  • 1 kudos
1 More Replies
dawnCoder
by New Contributor III
  • 1984 Views
  • 3 replies
  • 1 kudos

Vocareum Lab issue

Hi,I have taken a Lab Subscription from databricks academy. It worked fine for me for 1 day. As I try to login today, it is not starting up. I really appreciate any help in this regard. I have things as planned to do on the lab and when it is not sta...

  • 1984 Views
  • 3 replies
  • 1 kudos
Latest Reply
Deepa710
New Contributor III
  • 1 kudos

Hi, was this resolved? can I know the solution please? Also, is there any restriction on the number of days or so to use this lab? I am getting 'Session ended' message even after I login again.RegardsDeepa

  • 1 kudos
2 More Replies
refah_1
by New Contributor
  • 2411 Views
  • 0 replies
  • 0 kudos

von Google Cloud Storage

Hi everyone,I'm new to Databricks and am trying to connect my Google Cloud Storage bucket to my Databricks workspace. I have a 43GB CSV file stored in a GCP bucket that I want to work with. Here’s what I've done so far:Bucket Setup:I created a GCP bu...

  • 2411 Views
  • 0 replies
  • 0 kudos
patrykp
by New Contributor II
  • 655 Views
  • 2 replies
  • 0 kudos

AWS Secrets Manager access

HiI am trying to establish a method of accessing secrets from AWS Secrets Manager and understand this can be done with boto as suggested from AWS.We have created all of the relevant IAM roles, instance profiles etc.  Accessing S3 with this method is ...

  • 655 Views
  • 2 replies
  • 0 kudos
Latest Reply
patrykp
New Contributor II
  • 0 kudos

Hi @Alberto_Umana,Yes, the Role has the SecretsManagerReadWrite policy.Also within my furthet investigation I tried running it via Personal Cluster and it worked!Basically, 3 scenarios:- Shared Cluster with applied InstanceProfile - Secrets failing- ...

  • 0 kudos
1 More Replies
Dnirmania
by Contributor
  • 524 Views
  • 1 replies
  • 0 kudos

Communication between multiple region workspaces & metastore

Hi EveryoneWe currently have a workspace and metastore in the EastUS region, and we’re planning to set up another workspace and metastore in the Canada region. Additionally, we need to be able to access data from the Canada region within the US regio...

  • 524 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika_
Databricks Employee
  • 0 kudos

Hello @Dnirmania! Delta Sharing is ideal for read-only, cross-platform data access without duplication. Direct metastore connections offer low-latency access between Databricks workspaces under a unified governance model. Additionally, you may explor...

  • 0 kudos
saiV06
by New Contributor III
  • 2582 Views
  • 0 replies
  • 0 kudos

Lakehouse Federation - Unable to connect to Snowflake using "PEM Private Key"

Hi,I'm currently using Lakehouse Federation feature on databricks to run queries against Snowflake datawarehouse. Today I'm using a service credential to establish the connection (user id & pwd), but I have to change it to use private key. I tried us...

  • 2582 Views
  • 0 replies
  • 0 kudos