Set time out or Auto termination for long running query
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-19-2024 09:37 PM
Hi ,
We want to set auto termination for long running queries in data bricks adhoc cluster.
I attempted below two approaches in my notebook. Despite my understanding that queries should automatically terminate after one hour, with both the approaches queries exceeded this timeout limit and kept running
Approache 1:
SET spark.databricks.queryWatchdog.enabled=true;
SET spark.databricks.queryWatchdog.timeout=3600;
Approache 2:
SET STATEMENT_TIMEOUT = 3600;
Please suggest what wrong am i doing here?
