Celebrate Data and AI Summit with us at the Virtual Learning Festival! Mark your calendars: June 11 - July 2, 2025! In honor of our Annual Data and AI Summit, we’re offering an exciting opportunity to upskill in data engineering, data analysis, m...
- 39215 Views
- 72 replies
- 27 kudos
05-15-2025
We're excited to announce the launch of the Greece User Group—a dedicated space for data enthusiasts, engineers, scientists, and professionals from across Greece to connect, collaborate, and grow together! What is a User Group? User Groups are region...
- 17 Views
- 0 replies
- 0 kudos
4 hours ago
What a buzzing Day 1 at the Databricks Community Booth near the Expo Hall! We were thrilled to welcome 500+ visitors who dropped by to say hi, explore, and get involved! Here's what went down: Attendees joined fun community activities and walked awa...
- 620 Views
- 2 replies
- 4 kudos
Wednesday
The energy just keeps building, and Day 2 was no exception. We welcomed 600+ attendees to the Databricks Community Booth near the Expo Hall — bringing curiosity, insights, and enthusiasm for all things data. Here’s what made Day 2 memorable: The mor...
- 326 Views
- 0 replies
- 3 kudos
Thursday
Community Activity
- 32 Views
- 2 replies
- 1 kudos
Transfer Account Ownership
I have the same issue as this previous user, who had their question resolved before an actionable solution was provided: https://community.databricks.com/t5/data-engineering/how-to-transfer-ownership-of-a-databricks-cloud-standard-account/td-p/34737I...
- 32 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
You are going to have a very difficult time with the transfer as it can only be done on the backside by Databricks. Your only real option would be to have your customer create their own account and migrate the workspace assets over outside of having...
- 1 kudos
- 8 Views
- 0 replies
- 0 kudos
"Aws Invalid Kms Key State" when trying to start new cluster on AWS
Hey,We just established new environment based on AWS. Our first step was to create Cluster but while doing so, we have encountered an error. We tried different policies, configurations and instance types. All resulted in:Aws Invalid Kms Key State: Th...
- 8 Views
- 0 replies
- 0 kudos
- 40 Views
- 3 replies
- 0 kudos
how to specify the runtime version for serverless job
Hello,if I understood correctly.... using a serverless cluster comes always with the latest runtime version, by default.Now I need to stick to e.g. runtime version 15.4 for a certain job, which gets deployed via asset bundles. How do I specify/config...
- 40 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
HI @GeKo, Serverless versions behave a bit differently than classic runtime versions. With serverless you no longer have control over which cluster runtime is used as it's continuously updated, you do however have control over which API to target and...
- 0 kudos
- 1095 Views
- 6 replies
- 1 kudos
Redshift Stored Procedure Migration to Databricks
Hi,I want to migrate Redshift SQL Stored Procedures to databricks.As databricks doesn't support the concept of SQL Stored Procedures. How can I do so?
- 1095 Views
- 6 replies
- 1 kudos
Latest Reply
- 1 kudos
Lake Bridge might be a solution.https://www.databricks.com/solutions/migration/lakebridge
- 1 kudos
- 9 Views
- 0 replies
- 0 kudos
DLT Performance Issue
I've been seeing patterns in DLT process time in all my pipelines, as in attached screenshot. Each data point is an "update" that's set to "continuous". The process time keeps increasing until a point and drops back to what it's desired to be. This w...
- 9 Views
- 0 replies
- 0 kudos
- 5 Views
- 0 replies
- 0 kudos
Moving average calculation in Databricks AI/BI dashboard
So, I can't figure out how to do moving average as custom calculation in Databricks dashboard. I'm applying many different filters and the denominator of the metric has to change dynamically based on the chosen filters. So, in this case using `Custom...
- 5 Views
- 0 replies
- 0 kudos
- 4 Views
- 0 replies
- 0 kudos
Which is your favorite topics in the keynotes in DAIS 2025
My favorite parts were :LakebaseLakeflow DesignerAgent Bricks#Databricks
- 4 Views
- 0 replies
- 0 kudos
- 5 Views
- 0 replies
- 0 kudos
Which is your favorite topics in the keynotes in DAIS 2025
My favorite parts were :LakebaseLakeflow DesignerAgent Bricks
- 5 Views
- 0 replies
- 0 kudos
- 27 Views
- 1 replies
- 0 kudos
Deletion Vectors on Partioned Tables
Are Deletion Vectors supported for partitioned delta tables in Databricks?
- 27 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @pooja_bhumandla , Yes, deletion vectors are supported for partitioned delta tables in Databricks. It comes as part of storage optimization that allows to delete, update, merge operations to mark existing rows as removed or changed without rewrit...
- 0 kudos
- 2791 Views
- 3 replies
- 6 kudos
DMV Member Introductions | Say Hello! 😃
DMV Community Member IntroductionsIf you’d like to find other members to connect with, or would like others to be able to connect / find you — then you’re in the right place.This forum is for DMV Databricks Community Members to introduce themselves.F...
- 2791 Views
- 3 replies
- 6 kudos
Latest Reply
- 6 kudos
@PXL Sounds good. We are planning for a meetup soon. @Anton_Lagergren
- 6 kudos
- 13957 Views
- 2 replies
- 3 kudos
Getting Started with Databricks SQL Serverless on Azure
Getting Started with Databricks SQL Serverless on Azure This is an Azure admin guide for existing Databricks SQL customers interested in SQL Serverless features. This guide covers the following topics: What is Serverless ArchitectureSecurity on Serv...
- 13957 Views
- 2 replies
- 3 kudos
Latest Reply
- 3 kudos
@DatabricksGuide We have implemented serverless warehouses in databricks. But we still have some pro clusters. I want to have a comparison of cost between serverless and pro. While serverless cost is easily available in system tables but I am not abl...
- 3 kudos
- 36 Views
- 1 replies
- 1 kudos
Resolved! DataFrame.localCheckpoint() and cluster autoscaling at odds with each other
I have a notebook where at the beginning I load several dataframes and cache them using localCheckpoint(). I run this notebook using an all-purpose cluster with autoscaling enabled, with a mininum of 1 worker and maximum 2.The cluster often autoscale...
- 36 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @rcostanza You're facing a common issue with autoscaling clusters and cached data locality.There are several approaches to address this:Preventing Downscaling During Execution1. Disable Autoscaling Temporarily- You can disable autoscaling programm...
- 1 kudos
- 456 Views
- 1 replies
- 0 kudos
assets bundle
Hello Guys,I am working on assets bundle. So i want to make it generic for all team like ( analytics, data engineering), Someone could you share a best practice for this purpose ? Cordially,
- 456 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @seefoods Creating a generic asset bundle that works across different teams requires careful design around modularity, configurability, and clear interfaces.Here are key best practices:1. Structure and OrganizationModular Architecture: Design your...
- 0 kudos
- 17 Views
- 0 replies
- 0 kudos
Welcome to the Greece User Group!
We're excited to announce the launch of the Greece User Group—a dedicated space for data enthusiasts, engineers, scientists, and professionals from across Greece to connect, collaborate, and grow together! What is a User Group? User Groups are region...
- 17 Views
- 0 replies
- 0 kudos
- 110 Views
- 4 replies
- 1 kudos
Delivery Specialization: UC Upgrade Lab Not Submitting
I have submitted Lab notebooks in Vocareum environment successfully after passing all required check points . Still after submission the grades are not evaluating section Section 3 - Table and View Migration and Section 4 - Workload Upgrade. Please h...
- 110 Views
- 4 replies
- 1 kudos
Latest Reply
- 1 kudos
Hello @kuldip05! Could you please raise a support ticket with the Databricks Support Team? They’ll be able to review the grading status and assist you accordingly
- 1 kudos
Announcements
Latest from our Blog
Beginner's Guide to Implementing Zero Trust Security for Databricks on Azure
Data security has always been one of the top priorities of organizations, but is often one of the final conversations that happens when considering an environment or evaluating a new platform. In t...
Unlocking Real-Time Intelligence for AI Agents with You.com and Databricks
This blog post was originally co-authored by You.com Co-Founder and CTO Bryan McCann and Databricks Sr. Solutions Architect Jai Behl. As Artificial Intelligence (AI) agents tackle increasingly sophist...
A Practical Guide to Serverless Migrations
Many customers have been eager to adopt serverless compute on Databricks, attracted by the promise of eliminating infrastructure management, gaining elastic scalability, and simplifying the user exper...
Enterprise-Grade MCP on Databricks: A Practical Walkthrough
If you’ve been curious about MCP—the latest buzzword in the AI tooling space—you might already know it was developed by Anthropic and open-sourced in late 2024. Maybe you’ve seen it described as “the ...
