cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Enabling serverless type for SQL warehouse running on Google Cloud Platform

96286
Contributor

I am in the process of connecting Looker to one of my Databricks databases. To reduce startup time on my SQL warehouse cluster I would like to change the type from "Pro" to "Serverless". I cannot find a way to do that and "Serverless" is not an option for me. 

Is Serverless not available when running databricks on GCP? I can't find much information in the docs... Thanks. 

3 REPLIES 3

glawry
New Contributor II

Are Ephemeral Clusters still a feature that is offered? I do not see any docs on them, and I don't see them as an option in the SQL Warehouse Create UI.  

Kayla
Valued Contributor

Echoing glawry - I'd be fascinated to know if this "Ephemeral clusters" are a thing.

Well currently I believe ephemeral clusters are offered on Google Cloud (GCP) Dataproc (tin boxes). Dataproc is mainly for running Spark and Hadoop jobs on GCP (you can add other artefacts to Dataproc as well like Flink etc) . Dataproc is optimized for launching ephemeral clusters quickly for short-lived jobs. So serverless is not on offer on GCP. However, you can utilize autoscaling clusters to adjust size based on workload. On GCP, BigQuery is serverless. 

Mich Talebzadeh | Technologist | Data | Generative AI | Financial Fraud
London
United Kingdom

view my Linkedin profile



https://en.everybodywiki.com/Mich_Talebzadeh



Disclaimer: The information provided is correct to the best of my knowledge but of course cannot be guaranteed . It is essential to note that, as with any advice, quote "one test result is worth one-thousand expert opinions (Werner Von Braun)".

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group