In the rapidly evolving landscape of data engineering and analytics, speed, scalability, and simplicity are invaluable. Serverless compute addresses these needs by eliminating the complexity of managing infrastructure, allowing you to focus on building impactful data-driven solutions. We’re thrilled to announce serverless compute for notebooks, Workflows, and DLT pipelines is now generally available on Google Cloud. Thus, any user can benefit from distributed compute across all major cloud platforms without having to manage complex infrastructure.
What is Databricks Serverless Compute?
Databricks serverless compute is a scalable and secure execution layer that simplifies running notebooks, Workflows, and Delta Live Tables (DLT) pipelines by eliminating the need to set up, optimize, and manage clusters. With serverless compute, resources are provisioned automatically, so you can:
- Reduce operational overhead: No need to manually configure or manage clusters.
- Optimize performance or costs: Only pay for compute when it’s assigned to a workload. Serverless currently optimizes for performance. Soon, you will also be able to select a cost-optimized mode, which automatically optimizes infrastructure to reduce cost.
- Improve productivity: Scale workloads effortlessly while focusing on solving business problems.
For detailed guidance on taking advantage of serverless compute, explore our best practices for serverless compute.
Continue to read here.
