- 4259 Views
- 0 replies
- 0 kudos
- 4259 Views
- 0 replies
- 0 kudos
Forum Posts
- 1908 Views
- 0 replies
- 0 kudos
- 1908 Views
- 0 replies
- 0 kudos
- 898 Views
- 0 replies
- 0 kudos
Data categories for databases
Is there a way to automate data categorisation with OpenAI API?
- 898 Views
- 0 replies
- 0 kudos
- 8518 Views
- 6 replies
- 1 kudos
Resolved! Unable to create table with primary key
Hi Team,Getting below error while creating a table with primary key,"Table constraints are only supported in Unity Catalog."Table script : CREATE TABLE persons(first_name STRING NOT NULL, last_name STRING NOT NULL, nickname STRING,CONSTRAINT persons_...
- 8518 Views
- 6 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi, this needs further investigation, could you please raise a support case with Databricks?
- 1 kudos
- 5174 Views
- 0 replies
- 0 kudos
Permissions on Delta Live Table (DLT) pipelines
I have a large collection - and growing daily - of DLT pipelines and I need to grant access to non-admin users. Do I need to assign permissions on each individual DLT pipeline or is there a better approach?
- 5174 Views
- 0 replies
- 0 kudos
- 1103 Views
- 1 replies
- 0 kudos
How do I regulate notebook cache
I am experiencing error of over caching in databricks notebook. If i display different dfs one of the dfs get cache which after the result of others afterwards. Please how can I avoid the cache memory while using the notebook?
- 1103 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
I don't exactly understand what your issue is. Can you elaborate more?
- 0 kudos
- 1623 Views
- 1 replies
- 0 kudos
Problem starting cluster
I try to start cluster that i used to start it 7 times before and it gave me this error Cloud provider is undergoing a transient resource throttling. This is retryable. 1 out of 2 pods scheduled. Failed to launch cluster in kubernetes in 1800 seconds...
- 1623 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi, This error "GCE out of resources" typically means that Google compute engine is out of resources as in out of nodes (can be a quota issue or can be node issues in that particular region in GCP). Could you please raise a google support case on thi...
- 0 kudos
- 1108 Views
- 1 replies
- 0 kudos
Fail start cluster
I try to start cluster that i used to start it 7 times before and it gave me this error Cloud provider is undergoing a transient resource throttling. This is retryable. 1 out of 2 pods scheduled. Failed to launch cluster in kubernetes in 1800 seconds...
- 1108 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi, This error "GCE out of resources" typically means that Google compute engine is out of resources as in out of nodes (can be a quota issue or can be node issues in that particular region in GCP). Could you please raise a google support case on thi...
- 0 kudos
- 6328 Views
- 3 replies
- 1 kudos
inegstion time clustering
Hello, in rerence to https://www.databricks.com/blog/2022/11/18/introducing-ingestion-time-clustering-dbr-112.htmlI have a silly question how to use it. So let's assume that I have a few TB of not partitioned data. So, if I would like to query on dat...
- 6328 Views
- 3 replies
- 1 kudos
- 5491 Views
- 0 replies
- 0 kudos
Databricks Terraform Cluster Issue.
Error: default auth: cannot configure default credentials. Config: token=***. Env: DATABRICKS_TOKENon cluster.tf line 27, in data “databricks_spark_version” “latest_lts”:27: data “databricks_spark_version” “latest_lts” {
- 5491 Views
- 0 replies
- 0 kudos
- 2667 Views
- 1 replies
- 1 kudos
Resolved! Run tasks conditionally "Always" condition missing?
Does the new feature 'Run If' that allows you to run tasks conditionally lack the 'ALWAYS' option? In order to execute the task both when there is OK and error from the dependencies
- 2667 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
You can choose the All Done option to run the task in both the scenarios
- 1 kudos
- 6777 Views
- 2 replies
- 3 kudos
How to send alert when cluster is running for too long
Hello,Our team recently experienced an issue where a teammate started a new workflow job then went on vacation. This job ended up running continuously without failing for 4.5 days. The usage of the cluster did not seem out of place during the workday...
- 6777 Views
- 2 replies
- 3 kudos
Latest Reply
- 3 kudos
@Retired_mod,I ended up creating a job leveraging the Databricks Python SDK to check cluster and active job run times. The script will raise an error and notify the team if the cluster hasn't terminated or restarted in the past 24 hours or if a job h...
- 3 kudos
- 1382 Views
- 0 replies
- 0 kudos
Unable to connect to databricks compute server on making first request to the server
Hello all, I am facing an issue while making the first request to the Databricks compute server It will be taking so much time, and in response 504 Gateway timeout error is throwing Could anyone please suggest what is the best possibility we can do?
- 1382 Views
- 0 replies
- 0 kudos
- 1016 Views
- 0 replies
- 0 kudos
DBX Sync Command --unmatched-behaviour=unspecified-delete-unmatched not working
We are using dbx command to sync the objects from the local to Databricks workspace, we are using the below command to sync the data,dbx sync workspace --unmatched-behaviour=unspecified-delete-unmatched -s /tmp -d /tmpWe have deleted some files loca...
- 1016 Views
- 0 replies
- 0 kudos
- 690 Views
- 0 replies
- 0 kudos
Analyze data metodoly
Hello,I have an ETL process that ingests data into bronze tables, transforms the data, and then ingests it into silver tables before finally populating the gold tables. This workflow is executed every 5 minutes. When I want to analyze the data or app...
- 690 Views
- 0 replies
- 0 kudos
