01-12-2022 01:46 PM
I have a customer who is experiencing hanging queries and was wondering if there are any best practices for managing a hanging query.
For example, they have seen a query hang as the cluster itself was hanging for the 90 minutes before the timeout triggered. Is there a better way to diagnose and retry this?
01-14-2022 06:46 AM
Exactly, when it is job maybe stream is better. When SQL maybe loading in chunks. Timeout is also useful - in fact is working in your case so it can be shorten.
01-12-2022 04:45 PM
Hi Nicole,
Piper here. Welcome back! As usual, we'll give the community a while to respond before we come back around. Thank you for your patience.
01-14-2022 02:22 AM
@Nicole Wong I'd like more details.
More details please 🙂
01-14-2022 06:46 AM
Exactly, when it is job maybe stream is better. When SQL maybe loading in chunks. Timeout is also useful - in fact is working in your case so it can be shorten.
01-26-2022 08:30 AM
@Nicole Wong - Checking in. If Hubert's answer helped, would you let us know? If not, would you be happy to give bilal more information?
05-13-2022 05:28 AM
Hey there @Nicole Wong
Hope everything is going great.
Just wanted to see if you were able to find an answer to your question and would you like to share the solution with us? It would be really helpful for the other members too.
We'd love to hear from you.
Cheers!
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group