- 668 Views
- 0 replies
- 0 kudos
Data categories for databases
Is there a way to automate data categorisation with OpenAI API?
- 668 Views
- 0 replies
- 0 kudos
Forum Posts
- 4899 Views
- 0 replies
- 0 kudos
Permissions on Delta Live Table (DLT) pipelines
I have a large collection - and growing daily - of DLT pipelines and I need to grant access to non-admin users. Do I need to assign permissions on each individual DLT pipeline or is there a better approach?
- 4899 Views
- 0 replies
- 0 kudos
- 726 Views
- 1 replies
- 0 kudos
How do I regulate notebook cache
I am experiencing error of over caching in databricks notebook. If i display different dfs one of the dfs get cache which after the result of others afterwards. Please how can I avoid the cache memory while using the notebook?
- 726 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
I don't exactly understand what your issue is. Can you elaborate more?
- 0 kudos
- 4110 Views
- 3 replies
- 1 kudos
inegstion time clustering
Hello, in rerence to https://www.databricks.com/blog/2022/11/18/introducing-ingestion-time-clustering-dbr-112.htmlI have a silly question how to use it. So let's assume that I have a few TB of not partitioned data. So, if I would like to query on dat...
- 4110 Views
- 3 replies
- 1 kudos
Latest Reply
" src="" />
- 1 kudos
Hello, in rerence to https://www.databricks.com/blog/2022/11/18/introducing-ingestion-time-clustering-dbr-112.htmlI have a silly question how to use it. So let's assume that I have a few TB of not partitioned data. So, if I would like to query on dat...
- 1 kudos
- 5169 Views
- 0 replies
- 0 kudos
Databricks Terraform Cluster Issue.
Error: default auth: cannot configure default credentials. Config: token=***. Env: DATABRICKS_TOKENon cluster.tf line 27, in data “databricks_spark_version” “latest_lts”:27: data “databricks_spark_version” “latest_lts” {
- 5169 Views
- 0 replies
- 0 kudos
- 5045 Views
- 2 replies
- 3 kudos
How to send alert when cluster is running for too long
Hello,Our team recently experienced an issue where a teammate started a new workflow job then went on vacation. This job ended up running continuously without failing for 4.5 days. The usage of the cluster did not seem out of place during the workday...
- 5045 Views
- 2 replies
- 3 kudos
Latest Reply
- 3 kudos
@Retired_mod,I ended up creating a job leveraging the Databricks Python SDK to check cluster and active job run times. The script will raise an error and notify the team if the cluster hasn't terminated or restarted in the past 24 hours or if a job h...
- 3 kudos
- 905 Views
- 0 replies
- 0 kudos
Unable to connect to databricks compute server on making first request to the server
Hello all, I am facing an issue while making the first request to the Databricks compute server It will be taking so much time, and in response 504 Gateway timeout error is throwing Could anyone please suggest what is the best possibility we can do?
- 905 Views
- 0 replies
- 0 kudos
- 664 Views
- 0 replies
- 0 kudos
DBX Sync Command --unmatched-behaviour=unspecified-delete-unmatched not working
We are using dbx command to sync the objects from the local to Databricks workspace, we are using the below command to sync the data,dbx sync workspace --unmatched-behaviour=unspecified-delete-unmatched -s /tmp -d /tmpWe have deleted some files loca...
- 664 Views
- 0 replies
- 0 kudos
- 658 Views
- 0 replies
- 0 kudos
Unable to login using company email - help migrate account please
Hi, originally I accidentally made a customer academy account with my company that is a databricks partner. Then I made an account using my personal email and listed my company email as the partner email for the partner academy account. that account ...
- 658 Views
- 0 replies
- 0 kudos
- 1829 Views
- 0 replies
- 0 kudos
Databricks community edition and cloud platform
I have been using databricks in work for a few years now and absolutely love it.I have been wanting to use it at home but I dont have a ton of money to spend.Any community members can advise a good cloud option to run databricks on that's relatively ...
- 1829 Views
- 0 replies
- 0 kudos
- 3607 Views
- 0 replies
- 0 kudos
how to resolve "Error pushing changes" Remote ref update was rejected issue
how to resolve "Error pushing changes" Remote ref update was rejected issue even after having all edit access on remote ado repo
- 3607 Views
- 0 replies
- 0 kudos
- 5596 Views
- 6 replies
- 7 kudos
Resolved! Cannot use docker container with runtime 13.1 and above
Hi,In our setup we use custom docker images on our job clusters. The setup of these images is in line with the docker images found on the databricks github page. The custom image works fine on runtimes, including 13.0. When using anything higher that...
- 5596 Views
- 6 replies
- 7 kudos
Latest Reply
- 7 kudos
Interestingly enough I can use the exact same docker image on 13.3LTS Beta with no issues.
- 7 kudos
- 1143 Views
- 0 replies
- 0 kudos
The Voucher code provided to me by my organization is not working. Please help ASAP.
Hello,I have been recently given a voucher code by my organization to register for the Databricks Data Engineer Associate (Version 3) exam. However, when I tried to apply the code, the page kept showing "Candidate is not associated with the promotion...
- 1143 Views
- 0 replies
- 0 kudos
- 1196 Views
- 0 replies
- 0 kudos
My exam has suspended , Need help Urgently (21/08/2023)
Hello Team,I encountered Pathetic experience while attempting my 1st DataBricks certification. Abruptly, Proctor asked me to show my desk, after showing he/she asked multiple times.. wasted my time and then suspended my exam.I want to file a complain...
- 1196 Views
- 0 replies
- 0 kudos
- 8461 Views
- 8 replies
- 4 kudos
InternalError, error message: The output of the notebook is too large.
Hello guys. I am having the following annoying issue with DataBricks job executed from ADF. I have stopped all the logs, deleted all the print statements and display. And I am still getting this error. I don't understand what might cause it. I am att...
- 8461 Views
- 8 replies
- 4 kudos
Latest Reply
- 4 kudos
Apologies for the late reply. I will try to upload the logs,cause it's been some time.Interesting is how I solve it. I put all the code in a single cell and It is running since then without issues. Although it was just few cells with python code. I e...
- 4 kudos
