topic Re: How disable disk cache in SQL Warehouse (Azure Databricks)? in Data Engineering

How disable disk cache in SQL Warehouse (Azure Databricks)?

jlgr — Thu, 23 Feb 2023 07:57:44 GMT

Hi! I want to disable disk cache for SQL Warehouse in Azure Databricks, but it seems that is not possible. Is it correct?

You can't use this configuration for SQL Warehouse (https://learn.microsoft.com/en-US/azure/databricks/optimizations/disk-cache#--enable-or-disable-the-disk-cache), and if you use parameter USED_CACHE_RESULT=false (https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/parameters/use_cached_result) only is disable Spark cache, not for disk cache.

Could someone confirm it?

Thanks!!

Re: How disable disk cache in SQL Warehouse (Azure Databricks)?

jlgr — Fri, 24 Feb 2023 12:22:11 GMT

Thanks @Kaniz Fatma! But this options is not available in Databricks SQL (SQL Warehouse). My question is about Databricks SQL.

Is there any options to disable disk cache in Databricks SQL?

Re: How disable disk cache in SQL Warehouse (Azure Databricks)?

Anonymous — Mon, 24 Apr 2023 10:18:27 GMT

Hi @jlgr jlgr

Hope everything is going great.

Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we can help you.

Cheers!