Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-03-2025 09:07 PM - edited 06-03-2025 09:11 PM
Hi @Louis_Frolio ,
I am using serverless compute for running a hash validation script across a large number of tables. While serverless is supposed to automatically adjust resources based on workload scaling up during peak and scaling down during idle periods I am noticing that the driver gets detached automatically, especially when processing large tables.
1. What is the reason the driver detaches automatically in serverless compute, especially when processing large tables?
2. What is the solution or best practice to prevent this issue and ensure stable processing?