I have a streaming aggregation query with highly variable micro-batch processing times. Seeing a lot of GC pauses in the logs . Any pointers on how to debug ?

sajith_appukutt
Databricks Employee
Databricks Employee

‎06-09-2021 01:20 AM

Though the data volume is relatively even, the  streaming aggregation query is showing highly variable micro-batch processing times

0 Kudos