Databricks

Megan05 · 06-29-2022

I am trying to write data from databricks to an S3 bucket but when I submit the code, it runs and runs and does not make any progress. I am not getting any errors and the logs don't seem to recognize I've submitted anything. The cluster also looks un...

Megan05 · 06-22-2022

I am working on writing a large amount of data from Databricks to an external SQL server using a JDB connection. I keep getting timeout errors/connection lost but digging deeper it appears to be a memory problem. I am wondering what cluster configura...

Megan05 · 09-05-2022

Try adding row() as an additional variable in your query that you can use as the x-axis. Your code could look something like: row() over( rk_cons.energy_kwh_m2_imputed DESC).

Megan05 · 06-29-2022

Hi Vivian,This only happens with this command. I have tried attaching different clusters/restarting. The logs also say it is healthy.

Megan05 · 06-24-2022

I was getting an SSL when trying to set up secrets using the Databricks CLI. To fix the CLI SSL error I went to %USERPROFILE%\.databrickscfg (~/.databrickscfg on Unix, Linux, or macOS) from the file explorer on my local machine and added the insecure...

Megan05 · 06-22-2022

Have you tried installing the module through the cluster settings? Navigate to libraries in your cluster's settings and install from there. You should then be able to import into your notebook when attached to that cluster.Note that the cluster runti...

Megan05 · 06-22-2022

Thanks for your response, Hubert! That seemed to work to fix the timeout issue.

Databricks

User Stats

User Activity

Trying to write to S3 bucket but executed code not showing any progress

Out of Memory/Connection Lost When Writing to External SQL Server from Databricks Using JDBC Connection

Re: Order By disabled in sql dashboard

Re: Trying to write to S3 bucket but executed code not showing any progress

Re: SSL Error While Setting up databricks cli or installing library

Re: Unable to import tkinter in notebook

Re: Out of Memory/Connection Lost When Writing to External SQL Server from Databricks Using JDBC Connection