Enabling serverless type for SQL warehouse running on Google Cloud Platform
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-25-2023 07:39 AM
I am in the process of connecting Looker to one of my Databricks databases. To reduce startup time on my SQL warehouse cluster I would like to change the type from "Pro" to "Serverless". I cannot find a way to do that and "Serverless" is not an option for me.
Is Serverless not available when running databricks on GCP? I can't find much information in the docs... Thanks.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-04-2024 07:54 AM
Are Ephemeral Clusters still a feature that is offered? I do not see any docs on them, and I don't see them as an option in the SQL Warehouse Create UI.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-15-2024 11:10 AM
Echoing glawry - I'd be fascinated to know if this "Ephemeral clusters" are a thing.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-15-2024 03:31 PM
Well currently I believe ephemeral clusters are offered on Google Cloud (GCP) Dataproc (tin boxes). Dataproc is mainly for running Spark and Hadoop jobs on GCP (you can add other artefacts to Dataproc as well like Flink etc) . Dataproc is optimized for launching ephemeral clusters quickly for short-lived jobs. So serverless is not on offer on GCP. However, you can utilize autoscaling clusters to adjust size based on workload. On GCP, BigQuery is serverless.
London
United Kingdom
view my Linkedin profile
https://en.everybodywiki.com/Mich_Talebzadeh
Disclaimer: The information provided is correct to the best of my knowledge but of course cannot be guaranteed . It is essential to note that, as with any advice, quote "one test result is worth one-thousand expert opinions (Werner Von Braun)".

