cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

During execution of a cell "RuntimeException: The python kernel is unresponsive."

Valon98
New Contributor III

Hi all, I am running a preprocessing to create my trainset and test set. Does anyone know why during the execution my cell gives the error "RuntimeException: The python kernel is unresponsive." ? How can I solve it?

1 ACCEPTED SOLUTION

Accepted Solutions

Prabakar
Databricks Employee
Databricks Employee

@Valerio Goretti​ we need to look at the thread dumps to understand this issue. if the repl thread running the command is blocked by the partial result fetcher thread and If this is consistent with several threads dump snapshots, it suggests that the command is streaming a lot of stuff to the result buffer, so that the partial result fetcher can take more time than normal to send them to the tree store and frontend.

View solution in original post

8 REPLIES 8

Anonymous
Not applicable

@Valerio Goretti​ , It's hard to know exactly why that would occur. One thing that works for me when I get strange errors is refreshing the browser. Sometimes the HTML doesn't render correctly. When that doesn't work, I try to disconnect and reattach my cluster. Once every few months, I need to restart my cluster and that always fixes things.

Valon98
New Contributor III

@Joseph Kambourakis​ Thank you for your reply. I use Databricks Community Edition so I restart the cluster every time it expires. I tried updating my browser but it keeps giving me the same problem...

Valon98
New Contributor III

Hi @Kaniz Fatma​ , unfortunately my problem persists.

Prabakar
Databricks Employee
Databricks Employee

@Valerio Goretti​ we need to look at the thread dumps to understand this issue. if the repl thread running the command is blocked by the partial result fetcher thread and If this is consistent with several threads dump snapshots, it suggests that the command is streaming a lot of stuff to the result buffer, so that the partial result fetcher can take more time than normal to send them to the tree store and frontend.

Valon98
New Contributor III

@Prabakar Ammeappin​ Thank you!

Anonymous
Not applicable

Hey there @Valerio Goretti​ 

Hope all is well!

Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

Valon98
New Contributor III

Hi! I just now read @Prabakar Ammeappin​ 's reply. But that was the problem.

Hello,

I am facing same issue. What did you do to fix the problem you had. Was there any configuration change that was needed? Thank you

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group