ETL job execution failure in serverless compute

furqanraza
New Contributor II

Hi,

We facing an issue when executing the ELT pipeline on serverless compute. In the ETL pipeline, for some users, a task gets stuck every time we run the job. However, a similar ETL pipeline works fine for other users. Furthermore, there are canceled queries in the query history, but it shows that these are still being processed.

Have you faced a similar issue in Databricks with serverless compute?