Databricks

JustinMills · 01-22-2018

No other output is available, not even output from cells that did run successfully. Also, I'm unable to connect to spark ui or view the logs. It makes an attempt to load each of them, but after some time an error message appears saying it's unable ...

JustinMills · 01-25-2018

I don't have proof of this, but I suspect this is just a memory issue where spark either hangs (presumably stuck in GC), or is killed by the OS. I watched the logs as the job progressed and noticed that the GC cycle was happening more frequently as ...

JustinMills · 01-24-2018

Seems like maybe there's something with how this job fails that circumvents Databrick's ability to restore the logs or UI. I remember in the past something like this happening, and it was related to a job outputting UTF8 characters. I think Databric...

JustinMills · 01-24-2018

I'm not sure if this is related, but I ran this job yesterday and the exact spot where it failed when run weekly this time never completed. It typically takes about 2 hours, but I noticed it still running at 14h. I canceled the job before I took a l...

Databricks

User Stats

User Activity

Job fails with "The spark driver has stopped unexpectedly and is restarting. Your notebook will be automatically reattached."

Re: Job fails with "The spark driver has stopped unexpectedly and is restarting. Your notebook will be automatically reattached."

Re: Job fails with "The spark driver has stopped unexpectedly and is restarting. Your notebook will be automatically reattached."

Re: Job fails with "The spark driver has stopped unexpectedly and is restarting. Your notebook will be automatically reattached."