cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

jonathanvdr
by New Contributor II
  • 493 Views
  • 3 replies
  • 1 kudos

Resolved! Unity catalog resolution of Entra Groups: PRINCIPAL_DOES_NOT_EXIST

Problem statement: Unity catalog PRINCIPAL_DOES_NOT_EXIST when granting an entra group created via SDK, but works after manual UI assignment)Hi all,I'm running into a Unity Catalog identity resolution issue and I am trying to understand if this is ex...

  • 493 Views
  • 3 replies
  • 1 kudos
Latest Reply
jonathanvdr
New Contributor II
  • 1 kudos

Hi @saurabh18cs,I am not an account admin. I am a workspace admin though

  • 1 kudos
2 More Replies
Harish_Kumar_M
by New Contributor
  • 710 Views
  • 4 replies
  • 2 kudos

Resolved! Databricks One - Enable on Workspace

Hi,We see that Databricks One is enabled on one of the workspaces but could see this on all the workspaces. How do we enable Databricks One on rest of the workspaces. What are the workspace settings that we need to activate in order to enable it?

  • 710 Views
  • 4 replies
  • 2 kudos
Latest Reply
nayan_wylde
Esteemed Contributor II
  • 2 kudos

@youssefmrini Databricks One is Ga now it seems. The toggle switch was available when it was in Preview.

  • 2 kudos
3 More Replies
axelboursin
by New Contributor II
  • 5939 Views
  • 3 replies
  • 3 kudos

Databricks and AWS CodeArtifact

Hello, I saw multiple topics about it, but I need explanations and a solution.In my context, we have developers that are developing Python projects, like X.In Databricks, we have a cluster with a library of the main project A that is dependent of X.p...

  • 5939 Views
  • 3 replies
  • 3 kudos
Latest Reply
theclipse
New Contributor II
  • 3 kudos

Hi @stbjelcevic,actually we are still facing a mystery.We created an init_script in order to generate a codeartifact token and change pip conf. Here isthe content:pip install awscliexport AWS_CODEARTIFACT_TOKEN=$(aws codeartifact get-authorization-to...

  • 3 kudos
2 More Replies
MiriamHundemer
by New Contributor III
  • 459 Views
  • 1 replies
  • 2 kudos

Resolved! SQL queries unable to finish with databricks sql pro warehose

During a recent workspace migration/recreation of workspaces we stumbled upon the problem, that it was no longer possible to execute sql queries (or get sample data from tables) using our sql warehouse or the shared compute cluster.A sql query like S...

  • 459 Views
  • 1 replies
  • 2 kudos
Latest Reply
youssefmrini
Databricks Employee
  • 2 kudos

1. Infrastructure as Code (IaC) - The "Golden Standard" If you aren't already, moving your workspace deployment to Terraform is the best way to solve this. Terraform maintains a "state" file. When you run terraform destroy, it doesn't just delete the...

  • 2 kudos
Akpel27
by New Contributor
  • 333 Views
  • 1 replies
  • 1 kudos

Resolved! Not able to access Databricks AI assistant or create thread

The user can be able to see the databricks AI assistant but not able to access. However, he can access the assistant in different environments but not in one environment let's say QA. It is not the configuration, Network, or access issue. Not able to...

Akpel27_0-1770753580757.png
  • 333 Views
  • 1 replies
  • 1 kudos
Latest Reply
joelramirezai
Databricks Employee
  • 1 kudos

Hello @Akpel27 , Have you tried removing cookies and cache from the web browser?. Could you try to check the error using the inspect tool ?    In the next section, you might find an error message:    

  • 1 kudos
roysnc
by Databricks Partner
  • 335 Views
  • 1 replies
  • 0 kudos

Resolved! Cannot login to azure databricks account console

Hi, I use my Azure account to create the Azure Databricks service. I have two questions. 1. I do not have the option to go azure databricks account console under the workspace tab,2. I get error when I login to https://accounts.azuredatabricks.net/So...

roysnc_0-1770825643650.png roysnc_1-1770825706364.png
  • 335 Views
  • 1 replies
  • 0 kudos
Latest Reply
joelramirezai
Databricks Employee
  • 0 kudos

Hi @Roysync,It looks like you’re not the Account Admin for your Databricks setup. When a workspace is created for the first time, the Databricks Account Admin role is automatically assigned to the Global Entra ID Admin.You’ll need to sign in using th...

  • 0 kudos
eric-c
by New Contributor II
  • 1398 Views
  • 2 replies
  • 1 kudos

Alert ACL's not available

The list of available ACL's for alerts suggests there's a way to set "can run" and "can manage" permissions but neither the REST API nor the Databricks CLI show options for setting permissions. Is there a way to set acl's on alerts? If so, how?Alert ...

  • 1398 Views
  • 2 replies
  • 1 kudos
Latest Reply
eric-c
New Contributor II
  • 1 kudos

Thanks @Walter_C  Looks like that api is deprecated now. Here's the latest one: Set workspace object permissions | Workspace API | REST API reference | Databricks on AWS

  • 1 kudos
1 More Replies
rpl
by Contributor
  • 6101 Views
  • 15 replies
  • 2 kudos

Resolved! Which API to use to list groups in which a given user is a member

Is there an API that can be used to list groups in which a given user is a member? Specifically, I’d be interested in account (not workspace) groups.It seems there used to be a workspace-level list-parents API referred to in the answers to this quest...

  • 6101 Views
  • 15 replies
  • 2 kudos
Latest Reply
noorbasha534
Valued Contributor II
  • 2 kudos

there will be 2 system tables soon - users, groups. Probably, that makes life easy. I have already requested the Databricks RAS meant for my customer to enabled these for our control plane

  • 2 kudos
14 More Replies
arun_prakash
by New Contributor
  • 1694 Views
  • 4 replies
  • 0 kudos

Databricks Apps not working in postman

I have a question regarding Databricks Apps. I have deployed my databricks Apps, and its working on my laptop, but when I try to open the same url in my mobile its redirecting to databricks signin page, and also its not working through postman as wel...

  • 1694 Views
  • 4 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

Is this issue specifically with the Databricks Apps am I right? Are you getting and erro message?

  • 0 kudos
3 More Replies
lion_king_84
by New Contributor III
  • 608 Views
  • 2 replies
  • 0 kudos

Resolved! Azure Databricks - Exporting data frame to external volume

Hello,I am reading a Delta table and exporting it to an external volume. The Unity Catalog external volume points to an Azure Data Lake Storage container.When I run the code below, I encounter the error message shown below. (When I export the data to...

  • 608 Views
  • 2 replies
  • 0 kudos
Latest Reply
saurabh18cs
Honored Contributor III
  • 0 kudos

Hi @lion_king_84 are we missing write volume permissions on this schema in UC?

  • 0 kudos
1 More Replies
Thabang
by Databricks Partner
  • 1111 Views
  • 3 replies
  • 2 kudos

Resolved! Databricks Networking

Currently our workspace has almost reached its maximum IP capacity, and we would like to create additional compute resources to handle memory intensive tasks. In doing some research we have been running into some conflicting answers, so I wanted to a...

  • 1111 Views
  • 3 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

Greeting @Thabang , I did some digging and there are potential mitigation paths, but they’re fairly involved and not something you’d want to tackle solo. The guidance consistently points to engaging Support—you’ll definitely need their help to do thi...

  • 2 kudos
2 More Replies
johnb1
by Contributor
  • 8086 Views
  • 12 replies
  • 4 kudos

Resolved! Deploy Workflow only to specific target (Databricks Asset Bundles)

I am using Databricks Asset Bundles to deploy Databricks workflows to all of my target environments (dev, staging, prod). However, I have one specific workflow that is supposed to be deployed only to the dev target environment.How can I implement tha...

  • 8086 Views
  • 12 replies
  • 4 kudos
Latest Reply
Pat
Esteemed Contributor
  • 4 kudos

I know it's a bit old, but if someone is looking into a solution, then I was able to resolve the issue where I need to deploy some jobs only into the DEV target:https://github.com/databricks/bundle-examples/tree/main/knowledge_base/target_includes.Us...

  • 4 kudos
11 More Replies
Harish_Kumar_M
by New Contributor
  • 480 Views
  • 1 replies
  • 2 kudos

Resolved! Databricks Asset Bundles Issue

Hi All,We are trying to update an existing job with some additional configurations. We are trying to deploy the new changes to the job using the DABs process. We have mentioned the job_id and job_name variables and defined them as well.Pipeline state...

  • 480 Views
  • 1 replies
  • 2 kudos
Latest Reply
Pat
Esteemed Contributor
  • 2 kudos

Hi @Harish_Kumar_M ,Databricks Asset Bundles (DABs) require binding to existing workspace resources like manually created jobs before updates will reflect during deployment. https://docs.azure.cn/en-us/databricks/dev-tools/bundles/migrate-resourcesYo...

  • 2 kudos
pppp
by New Contributor II
  • 654 Views
  • 2 replies
  • 3 kudos

Resolved! timeout for sessions made with sdk

How do I determine the rules for when a session will timeout? From testing it seems to be related to inactivity. I am using JavaScript SDK and I want to test my logic for creating a new session when the current one times out based on this issue: http...

  • 654 Views
  • 2 replies
  • 3 kudos
Latest Reply
pppp
New Contributor II
  • 3 kudos

seems to be timing out after 15 min of inactivity

  • 3 kudos
1 More Replies