- 1850 Views
- 1 replies
- 1 kudos
Resolved! Timeout settings for Postgresql external catalog connection?
Is there any way to configure timeouts for external catalog connections? We are getting some timeouts with complex queries accessing a pgsql database through the catalog. We tried configuring the connection and we got this error │ Error: cannot upda...
- 1850 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @ErikApption, there is no direct support for a connectTimeout option in the connection settings through Unity Catalog as of now. You might need to explore these alternative timeout configurations or consider adjusting your database handling to ...
- 1 kudos
- 2374 Views
- 3 replies
- 0 kudos
Cannot create a workspace on GCP
Hi,I have been using Databricks for a couple of months and been spinning up workspaces with Terraform. The other day we decided to end our POC and move on to a MVP. This meant cleaning up all workspaces and GCP. after the cleanup was done I wanted to...
- 2374 Views
- 3 replies
- 0 kudos
- 3185 Views
- 2 replies
- 0 kudos
Can we create an external location from a different tenant in Azure
We are looking to add an external location which points to a storage account in another Azure tenant. Is this possible? Could you point to any documentation around this.Currently, when we try to add a new credential providing a DBX access connector a...
- 3185 Views
- 2 replies
- 0 kudos
- 0 kudos
Thanks for the response @Alberto_Umana .Looks like the IDs are all provided correctly. Here is the config -Tenant A Tenant BDatabricks is hosted here ...
- 0 kudos
- 940 Views
- 0 replies
- 0 kudos
UCX Account Admin authentication error in Azure Databricks
Hi Team,I am using Azure Databricks to implement UCX. The UCX installation is completed properly. But facing issues when I am executing commands with account admin role. I am account admin in Azure Databricks (https://accounts.azuredatabricks.net/). ...
- 940 Views
- 0 replies
- 0 kudos
- 2239 Views
- 1 replies
- 0 kudos
creating Workspace in AWS with Quickstart is giving error
Hello, While creating workspace in AWS using Quickstart, I get below error. I used both admin Account and root account to create this but both gave the same issue. Any help is appreciated. The resource CopyZipsFunction is in a CREATE_FAILED stateT...
- 2239 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @eondatatech, Ensure that both the admin and the root account you are using to create the workspace have the necessary IAM permissions to create and manage Lambda functions. Specifically, check if the CreateFunction and PassRole permissions are...
- 0 kudos
- 2965 Views
- 3 replies
- 1 kudos
Databricks on GCP with GKE | Cluster stuck in starting status | GKE allocation ressource failing
Hi Databricks Community,I’m currently facing several challenges with my Databricks clusters running on Google Kubernetes Engine (GKE). I hope someone here might have insights or suggestions to resolve the issues.Problem Overview:I am experiencing fre...
- 2965 Views
- 3 replies
- 1 kudos
- 1 kudos
I am having similar issues. first time I am using the `databricks_cluster` resource, my terraform apply does not gracefully complete, and I see numerous errors about:1. Can’t scale up a node pool because of a failing scheduling predicateThe autoscale...
- 1 kudos
- 3941 Views
- 1 replies
- 0 kudos
Resolved! ALTER TABLE ... ALTER COLUMN .... SYNC IDENTITY not working anymore ?
Hello,I recently noticed that the ALTER TABLE ALTER COLUMN SYNC IDENTITY command is no longer functioning as expected.I have an IDENTITY column on my table:D_Category_SID BIGINT GENERATED BY DEFAULT AS IDENTITY (START WITH 1 INCREMENT BY 1)Previously...
- 3941 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @MDV, Thanks for your question. According to the recent updates, the SYNC IDENTITY command is now more restrictive and follows stronger invariants. Specifically, it no longer allows the high watermark to be reduced to ensure that there is no ri...
- 0 kudos
- 1778 Views
- 3 replies
- 0 kudos
Is there a way to switch default cluster associated with a workflow job
Hi, I have a workflow job that is connected to a default cluster (see blow)I know I can swap the cluster. However, sometimes the cluster is not active but when I start the workflow job, I will wait for the cluster to beome activated. It will take som...
- 1778 Views
- 3 replies
- 0 kudos
- 0 kudos
I suppose you can call the databricks api to run those workflows?Or is that a no go?
- 0 kudos
- 1361 Views
- 3 replies
- 0 kudos
Does Databricks support configuring more than 1 Microsoft Entra ID in 1 Databricks account for SSO?
Can I configure more than 1 Microsoft Entra ID for a Databricks account for SSO? For example, I have 2 Microsoft Entra IDs: AD1 and AD2, and I want to configure them into 1 Databricks account, so I can share the data or workspaces to the users in th...
- 1361 Views
- 3 replies
- 0 kudos
- 0 kudos
No, an account is specific to the EntraID tenant and region, so you can only integrate SCIM with one tenant. You'd have to make the users in AD2 guests in AD1 and then manage all the users in AD1. We have a similar setup. Clunky but works.
- 0 kudos
- 1965 Views
- 1 replies
- 2 kudos
Resolved! Running job within job fails
Hello,I have a job with a task of type "Run Job". Everything is deployed using asset bundles and the deployment works fine, however when running the job, the Job step fails with error "PERMISSION DENIED : User unknown does not have Manage Run or Owne...
- 1965 Views
- 1 replies
- 2 kudos
- 2 kudos
the permissions of a main job are not copied to nested jobs, so the executing user needs the proper permissions for the main job and the nested job.This can be defined in the permissions seciont of the job (not the task).I for one am waiting for a ce...
- 2 kudos
- 1823 Views
- 3 replies
- 0 kudos
Databricks Asset bundles
Hi Team,In our company we are planning to migrate our workflows with Databricks Asset bundles, is it mandatory to install Databricks CLI tool for getting started with DAB ? Any one who integrated with Github with CICD pipeline please let me know the ...
- 1823 Views
- 3 replies
- 0 kudos
- 0 kudos
I forgot the CI/CD part:that is not that hard. Basically in DAB you define the type of environment you are using.If you use 'development', DAB assumes you are in actual development mode (feature branch). so there you can connect git and put the fil...
- 0 kudos
- 1135 Views
- 1 replies
- 0 kudos
De facto Standard for Databricks on AWS
Hello,I am working on creating an architecture diagram for Databricks on AWS.I would like to adopt the de facto standard used by enterprises. Based on my research, I have identified the following components:Network: Customer-managed VPC,Secure Cluste...
- 1135 Views
- 1 replies
- 0 kudos
- 0 kudos
I would not call it a 'standard' but a possible architecture. The great thing about the cloud is you can complete the puzzle in many ways and make it as complex or as easy as possible.Also I would not consider Fivetran to be standard in companies. ...
- 0 kudos
- 2567 Views
- 6 replies
- 0 kudos
permissions tab is missing from policy UI
Hi Team.When I try to create a new policy the permissions tab is missing.I am an account admin.Any ideas why?Many thanks.Dave.
- 2567 Views
- 6 replies
- 0 kudos
- 0 kudos
@bigger_dave If you are trying to create a compute policy, permissions tab should be available during configuration. If you wanted to grant to an existing policy, then permissions tab is available once you choose edit the policy. If you are looking f...
- 0 kudos
- 3704 Views
- 6 replies
- 0 kudos
Resolved! Updating Workspace Cluster
Hello,My organization is experiencing difficulties updating our Google Kubernetes Engine (GKE) cluster.We've reviewed the official GKE documentation for automated cluster updates, but it appears to primarily focus on AWS integrations. We haven't foun...
- 3704 Views
- 6 replies
- 0 kudos
- 9671 Views
- 5 replies
- 2 kudos
Resolved! How to enable Genie?
Hi All,Based on the article below to enable Genie one needs to:1. Enable Azure AI services-powered featuresThat is done:2. Enable Genie must be enabled from the Previews pageI do not see Genie among Previews:I am using Azure Databricks. Any idea how ...
- 9671 Views
- 5 replies
- 2 kudos
- 2 kudos
I can access to preview on account level but can't see Genie in Previews
- 2 kudos
