Ready to level up your skills before the biggest data and AI event of the year? From May 27 through June 3, we are cutting prices in half. Expert-led training courses are just $212.50 each! Register for Data + AI Summit today and pick from 20+ hands...
- 727 Views
- 2 replies
- 2 kudos
a week ago
Grow Your Skills and Earn Rewards! Mark your calendar: June 15 – July 6, 2026 Join us for a three-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whethe...
- 29089 Views
- 50 replies
- 39 kudos
3 weeks ago
We’re getting ready to pilot the Databricks Detective Series ahead of its launch at Data + AI Summit 2026, and we’re looking for Community members to help test it. Databricks Detective Series is a free, gamified, hands-on experience where you become...
- 1414 Views
- 8 replies
- 8 kudos
3 weeks ago
Join Our Business Impact Accelerator Sessions! We are thrilled to invite you to the Business Impact Accelerator, a specialized single-session program designed specifically for business professionals, executives, and non-technical teams. If yo...
- 190 Views
- 0 replies
- 2 kudos
yesterday
Already registered for Data + AI Summit 2026? Join us on Monday, June 15 for the Databricks Apps & Agents for Good Hackathon 2026, hosted in partnership with OpenAI. Secure your spot and apply by Sunday May, 31 Note: Marking RSVP on this Community ...
- 1097 Views
- 1 replies
- 1 kudos
3 weeks ago
DAIS 2026 · Speaker Spotlight A conversationwith Julien Debard On the Energy & Utilities Industry Forum — and what it looks like to solve real operational problems in the field with data and AI. The Session Energy & Utilities Industry Forum...
- 119 Views
- 0 replies
- 0 kudos
yesterday
RFM segmentation helps retail brands use first-party data to better understand their customers based on Recency, Frequency and Monetary value. The Recency, Frequency and Monetary (RFM) Segmentation Solution Accelerator shows how organizations can cal...
- 255 Views
- 0 replies
- 0 kudos
Tuesday
The Weekly Digest • May 25 – May 31 Community Pulse Your weekly roundup of top threads, fresh articles, and community wins. This Week's Community Stars Recognizing the people who kept the community moving forward -- with a new face in the mix ...
- 406 Views
- 1 replies
- 2 kudos
Wednesday
Community Activity
- 64 Views
- 2 replies
- 1 kudos
Resolved! Accreditation Badge for Analytics Fundamentals not received in email though I scored 50 of 50
#https://www.databricks.com/resources/learn/training/analytics-fundamentals-accreditationFirstname: SrinivasaganLastname: KrishnaswamyCompany: BlitzenXEmail: srinivasagank@gmaul.com Accreditation Badge for Analytics Fundamentals not received in email...
- 64 Views
- 2 replies
- 1 kudos
- 5401 Views
- 2 replies
- 2 kudos
Need Guidance for Databricks-Generative-AI-Engineer-Associate Exam
Hi Everyone,I’m preparing for the Databricks-Generative-AI-Engineer-Associate exam and looking for some guidance from experienced candidates. I want to understand the exam pattern, important topics, and the best ways to practice for success.I’ve been...
- 5401 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
I cleared my Databricks-Generative-AI-Engineer-Associate exam recently, and the updated questions on (Certs Topic) gave me a better idea of what to expect.
- 2 kudos
- 16 Views
- 0 replies
- 0 kudos
Claude Mythos & Databricks LakeWatch
Databricks LakeWatch- Security for the Agentic Era:What is Lakewatch?Lakewatch is a new security product, essentially a comprehensive security camera system for your entire company’s computer systems, powered by AI.Two significant developments occurr...
- 16 Views
- 0 replies
- 0 kudos
- 17 Views
- 0 replies
- 0 kudos
Databricks Genie vs Databricks Genie Code
Databricks Genie vs Databricks Genie Code – What's the Difference?Many people assume Genie and Genie Code are the same, but they are designed for completely different audiences and use cases.GenieWho it’s for: All employees, from Marketing Managers t...
- 17 Views
- 0 replies
- 0 kudos
- 22 Views
- 0 replies
- 0 kudos
Embed a Databricks Genie space in an External Website or Application
You can now embed a Databricks Genie Space directly into an external website or application.What does this mean?Instead of asking your business users to log into Databricks every time they want to query data, you can bring Genie to them right inside ...
- 22 Views
- 0 replies
- 0 kudos
- 594 Views
- 2 replies
- 0 kudos
AI/BI Genie
I was working with genie and started using Research agent, and now I want to make the genie as a sharable Infrastructure as Code where I can manage all the changes through GitHub and so does anyone have any suggestions how to do this in a best optimi...
- 594 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @Gaganmjain_012, I know this is a late reply, but if you are looking for the cleanest way to make a Genie Space shareable and manageable as infrastructure-as-code, the best pattern today is to keep the Genie Space configuration in GitHub and deplo...
- 0 kudos
- 861 Views
- 4 replies
- 2 kudos
AWS DATABRICKS COMPUTE COSTS IN USAGE DASHBOARDS
Good afternoon!I know that the built-in Databricks usage dashboards currently only display DBU (Databricks Unit) usage. Our Databricks workspaces are running on AWS, and the clusters provision EC2 instances automatically.I would like to include the u...
- 861 Views
- 4 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @margarita_shir, If you are still looking for an answer... the right way to bring underlying EC2 cost into your reporting is to use Databricks system tables for the Databricks side of the picture and AWS billing data for the cloud side. The built-...
- 2 kudos
- 170 Views
- 5 replies
- 1 kudos
Declarative pipeline full table refresh generates empty MV.
Hi everyone,- the situation:I have a Declarative pipeline. The pipeline consists several .py files.file1.py: creates a Materialized View: description.file2.py: create 2nd Materialized View by reading a table "transactions" and reading the MV "descri...
- 170 Views
- 5 replies
- 1 kudos
Latest Reply
- 1 kudos
@cdn_yyz_yul I think that reading part is where your problem lies. When reading from same pipeline produced datasets, you shouldn't use 3 level name, instead follow DLT's way.Older pipeline versions, where "target" field was used for target schema de...
- 1 kudos
- 49 Views
- 2 replies
- 0 kudos
Ingest data from snowflake to databricks
Hi Team,I have some confusion regarding the best approach for ingesting data from Snowflake into Databricks using custom SQL queries.While evaluating the available options, I found multiple approaches:Snowflake Spark ConnectorJDBCQuery FederationLake...
- 49 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Thanks for raising this question. I recently evaluated similar options for Snowflake-to-Databricks ingestion and would like to share my perspective.From my understanding, the choice depends on whether your primary focus is performance, ease of manage...
- 0 kudos
- 26 Views
- 0 replies
- 0 kudos
Operating PostgreSQL CDC on AWS RDS with Lakeflow Connect
Over the years, I have helped organizations design and deliver large-scale data platforms, and one recurring lesson has remained constant: CDC failures are rarely caused by technology alone. They are usually the result of unclear ownership, missing o...
- 26 Views
- 0 replies
- 0 kudos
- 53 Views
- 0 replies
- 1 kudos
UI sync back to DABs
If you deploy a bundle from the UI in development mode (source-linked deployment) and edit it in the UI, changes are now propagated to the files. Really useful for jobs and dashboards. For jobs, of course, please always review in GIT as results in so...
- 53 Views
- 0 replies
- 1 kudos
- 76 Views
- 1 replies
- 1 kudos
Resolved! How execute SET spark.sql.sources.partitionOverwriteMode = dynamic; in SQL Stored procedures
Hi,I am able to execute the INSERT OVERWRITE TABLE <tables> PARTITION command , in a notebook cell SET spark.sql.sources.partitionOverwriteMode=dynamic;DECLARE OR REPLACE VARIABLE v_load_date DATE;SET VAR v_load_date = DATE '2026-05-03';INSERT OVERW...
- 76 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Hello @RGSLCA , The short answer is that you can't make SET spark.sql.sources.partitionOverwriteMode=dynamic work from a stored procedure running on a SQL warehouse or serverless. That dynamic partition overwrite path is legacy, and it's SQL-support...
- 1 kudos
- 104 Views
- 1 replies
- 0 kudos
MCPs not working properly
Has anyone facing the same issue?Basically we created a MCP to use OpenMetadata functionalities. It works fine on AI Playground, and it works fine on Databricks Genie (previously, Databricks One). But when I try to add this MCP on Genie Code, it fail...
- 104 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hello @arthurandrade , I looked into this and here is what If found: These are really two separate problems, and the thing that untangles them is realizing that AI Playground, Chat in Genie (what used to sit under Databricks One), and Genie Code are ...
- 0 kudos
- 154 Views
- 1 replies
- 0 kudos
network security perimeter post-setup questions
I've set up the network security perimeter with Terraform using Configure an Azure network security perimeter for Azure resources - Azure Databricks | Microsoft Learn as my guide. All of the resources associated to the NSP, and the Status of each is...
- 154 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Greetings @Rjdudley , I did some digging and here is what I found: Good news on both counts. Neither of these means your NSP setup is broken. On the MissingIdentityConfiguration issue, you can ignore it for what you're doing. It's a generic Azure NS...
- 0 kudos
- 233 Views
- 1 replies
- 0 kudos
Data bricks + Network security perimeter (storage account) Error
Serverless Compute + NCC configration in account console + Private Endpoint (PE) to storage account is working as expected.When Network security perimeter (NSP) is added and storage account (SA), in NSP we have 2 access mode to choose (transition an...
- 233 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hey @MyProfile , I looked into your issue and here is what I found: Short version: your instinct is right. The data read over the private endpoint is fine. What's failing is a storage account level call, the Get User Delegation Key operation that U...
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2266 | |
| 1317 | |
| 1219 | |
| 1194 | |
| 958 |
| User | Count |
|---|---|
| 437 | |
| 286 | |
| 220 | |
| 63 | |
| 51 |
Latest from our Blog
Apache Spark’s Real-Time Mode Use Case Deep Dive: Gaming Sessionization
This article is a companion to this Databricks blog about a gaming sessionization use case, with a GitHub repo — a self-serve example you can import into your Databricks workspace and run end-to-end t...
[CUSTOMER BLOG] Enabling Seamless Inbound Data Sharing at Magnite
Introduction In this post, we’ll explore how Magnite and Databricks collaborated to build: A foundation for secure and automated data publishing: a Python wheel file that customers install to set up t...
Multi-Agent Supervisor for Hybrid Retrieval with Agent Bricks and MLflow
California beekeepers lost 21% of their honey bee colonies in the first quarter of 2024, the worst quarter for the state in at least a decade, according to the United States Department of Agriculture ...
FinOps at Scale: Building a Repeatable Architecture for Cross-Account Cost Visibility in Databricks
In today’s enterprise data landscape, large organizations often operate multiple Databricks workspaces across cloud accounts, regions, and business units. While this flexibility enables autonomy and s...
