cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

paritoshsh
by New Contributor II
  • 1312 Views
  • 0 replies
  • 1 kudos

PAT Tokens access restrictions

Hi,We have a Databricks workspace on which we have disabled PAT's for now. Moving ahead we want the developers to use Personal Access Tokens but only for development purpose.As I know the current option to enable PAT's give access to the whole REST A...

  • 1312 Views
  • 0 replies
  • 1 kudos
555308
by New Contributor
  • 1967 Views
  • 1 replies
  • 1 kudos

Cluster failed to start

I am getting this error in my Partner Databricks Account and I had tried several methods to start the cluster. As i don't have access to console.aws.amazon.com/ec2. I was not able to check the details/logs in the ec2 instance. I am getting the follow...

  • 1967 Views
  • 1 replies
  • 1 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 1 kudos

Here is a similar topic:https://community.databricks.com/t5/machine-learning/problem-with-spinning-up-a-cluster-on-a-new-workspace/m-p/29996To actually fix/analyse the issue, you need access to the EC2 console unfortunately.  I assume someone in the ...

  • 1 kudos
SanderJvanDijk
by New Contributor
  • 1365 Views
  • 0 replies
  • 0 kudos

Ubuntu 18.4 EOL

Hi,last July 18th we were informed by Databricks that Ubuntu version 20.04 (operating system: Ubuntu 20.04.4 LTS) was going to be the only certified and supported Ubuntu version for the 10.4 runtime cluster we use. We have been experiencing some issu...

  • 1365 Views
  • 0 replies
  • 0 kudos
diego_poggioli
by Contributor
  • 9689 Views
  • 5 replies
  • 2 kudos

Resolved! Unable to list service principal in Job details RUN AS

I added the service principal in Admin Settings > Service Principal and then enabled all the Configurations "allow cluster creation", "databricks SQL access" and "workspace access". In the Permission settings I have enabled "Service principal: Manage...

  • 9689 Views
  • 5 replies
  • 2 kudos
Latest Reply
BilalAslamDbrx
Databricks Employee
  • 2 kudos

For future readers - don't forget to add your email (e.g. me@foo.com) in the Service Principals permissions tab. This way, you will be able to see the newly-created service principal in the dropdown menu.

  • 2 kudos
4 More Replies
jaganadhg
by New Contributor
  • 1911 Views
  • 0 replies
  • 0 kudos

Clean up Databricks confidential computing resources

Hello All,I created a Databricks Premium Workspace for a Confidential Computing PoC. After creating a VM from Databricks UI, it came to notice that there is a new RG with managed identity, NAT Gateway, Public IP, security group, and a VNET (/16). I w...

Administration & Architecture
Confidential Compute
  • 1911 Views
  • 0 replies
  • 0 kudos
PetePP
by New Contributor II
  • 2566 Views
  • 2 replies
  • 0 kudos

Extreme RocksDB memory usage

During migration to production workload, I switched some queries to use RocksDB. I am concerned with its memory usage though. Here is sample output from my streaming query:   "stateOperators" : [ { "operatorName" : "dedupeWithinWatermark", "...

  • 2566 Views
  • 2 replies
  • 0 kudos
Latest Reply
PetePP
New Contributor II
  • 0 kudos

Thank you for the input. Is there any particular reason why deduplication watermark makes it store everything and not just the key needed for deduplication? The 1st record has to be written to the table anyway, and its content is irrelevant as it jus...

  • 0 kudos
1 More Replies
Bagger
by New Contributor II
  • 3094 Views
  • 0 replies
  • 0 kudos

Monitoring job metrics

Hi,We need to monitor Databricks jobs and we have made a setup where are able to get the prometheus metrics, however, we are lagging an overview of which metrics refer to what.Namely, we need to monitor the following:failed jobs : is a job failedtabl...

Administration & Architecture
jobs
metrics
prometheus
  • 3094 Views
  • 0 replies
  • 0 kudos
nihar_ghude
by New Contributor II
  • 7583 Views
  • 2 replies
  • 0 kudos

How to change Workspace Owner?

Our Databricks workspace was created by a personal account. Now the person has left the organization. We would like to change the owner to a Service account(preferably, else to an Admin account).Questions:Is it possible to change the owner of the wor...

Administration & Architecture
admin
change owner
workspace owner
  • 7583 Views
  • 2 replies
  • 0 kudos
Latest Reply
Atanu
Databricks Employee
  • 0 kudos

Are you in aws or Azure.When you say workspace admin, that could be many. So, you can have multiple workspace admin.  

  • 0 kudos
1 More Replies
NadithK
by Contributor
  • 7702 Views
  • 2 replies
  • 1 kudos

Using a custom Hostname in Databricks CLI instead of per-workspace URL

Hi,At our organization, we have added front end privatelink connection to a Databricks workspace in Azure, and public access to the workspace is disabled. I am able to access the workspace UI with the private IP (in the browser), and able to call the...

  • 7702 Views
  • 2 replies
  • 1 kudos
Latest Reply
NadithK
Contributor
  • 1 kudos

Hi @Retired_mod ,Thank you for the support.Really appreciate it.Thanks

  • 1 kudos
1 More Replies
re
by New Contributor II
  • 1800 Views
  • 0 replies
  • 0 kudos

terraform/databricks setting default_catalog_name

While configuring databricks, we've set the "default_catalog_name", which sets the default schema when users connect via an ODBC connection. While the naming isn't consistent, this does have one desired effect, that is, when users connect, it default...

  • 1800 Views
  • 0 replies
  • 0 kudos