cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Databricks Predictive optimization

AnkurMittal008
New Contributor III

If we want to enable Databricks Predictive Optimization, then is it also mandatory to enable serverless Job/Notebook Compute in our account. We already have Serverless SQL warehouse available in our workspaces.

4 REPLIES 4

MuthuLakshmi
Databricks Employee
Databricks Employee

@AnkurMittal008 

There is no specific requirement to have Serverless to enable Predictive Optimization. 
You must fulfill the following requirements to enable predictive optimization:

AnkurMittal008
New Contributor III

Thanks for your answer, One more question on this, I think in case to use predictive optimization we should first enable this at account level ? If this is the case then by doing this each of the catalogue/schema/table in Account will start using predictive optimization? should we first disable this for list of catalogues where we do not want this to be used using "ALTER CATALOG [catalog_name] DISABLE PREDICTIVE OPTIMIZATION;"" before enabling at Account level ? 

SparkJun
Databricks Employee
Databricks Employee

htd350
New Contributor II

The documentation states this:

Predictive optimization identifies tables that would benefit from ANALYZEOPTIMIZE, and VACUUM operations and queues them to run using serverless compute for jobs.

If I don't have serverless workloads enabled how does predictive optimization optimizes the tables?

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now