Hello, Good afternoon great people. I was following the step-by-step instructions to enable or disable Databricks Assistant in my Databricks Community Edition to enable the AI assistance. However, I...
May be I am new to Databricks that's why I have confusion. Suppose I have worker memory of 64gb in Databricks job max 12 nodes... and my job is failing due to Executor Lost due to 137 (OOM if found...
Getting following error while saving a dataframe partitioned by two columns. Job aborted due to stage failure: Task 5774 in stage 33.0 failed 4 times, most recent failure: Lost task 5774.3 in stage ...
I’ve been trying to develop a solution for our team to be able to have Git integration between Databricks and Azure DevOps. However, the “query” file type/workspace item on Databricks can’t be commit...
Hi, I am realtively new on databricks, although I am conscious about lazy evaluation, transformations and actions and peristence. I have a json file (complex-nested) with about 1,73 MiB. whe...
I'm creating dashboard with multiple visualizations from a notebook. Whenever I add a new visualization, the default position in dashboard is top left which mess up all the format I did for previous...
Hello, I am running a job that depends on the information provided in column storage_sub_directory in system.information_schema.tables .... and it worked until 1-2 weeks ago. Now I discovered in th...
The `Library` option in cluster config allows installation of language-specific libraries - e.g., PyPi for Python, CRAN for R. Some of these libraries - e.g., `sf` - require system libraries - e.g.,...