Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
How can I block the use of statement_timeout at the session level in Databricks? I want the global parameter to be enforced even if a SET statement_timeout has been executed in Databricks notebooks."
To set a workspace-level timeout, go to the workspace admin settings, click Compute, then click Manage next to SQL warehouses. In the SQL Configuration Parameters setting, add a configuration parameter where the timeout value is in seconds.
I did this, but when a user uses the set statement_timeout command in their own Databricks notebook, the query exceeds the time determined by the global parameter
To revalidate this, are you using Serverless SQL Warehouse or Serverless Compute which are different? Can you share an screenshot of the compute being used to make sure we are aligned?
