Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
How can I block the use of statement_timeout at the session level in Databricks? I want the global parameter to be enforced even if a SET statement_timeout has been executed in Databricks notebooks."
To set a workspace-level timeout, go to the workspace admin settings, click Compute, then click Manage next to SQL warehouses. In the SQL Configuration Parameters setting, add a configuration parameter where the timeout value is in seconds.
I did this, but when a user uses the set statement_timeout command in their own Databricks notebook, the query exceeds the time determined by the global parameter
To revalidate this, are you using Serverless SQL Warehouse or Serverless Compute which are different? Can you share an screenshot of the compute being used to make sure we are aligned?
Yes, this global config only applies to Serverless SQL Warehouses, but wont apply if you use serverless compute for notebooks
Connect with Databricks Users in Your Area
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
