Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, November 5! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...
- 628 Views
- 1 replies
- 2 kudos
2 weeks ago
NOVEMBER · THE TOUR IS ON THE MOVE Nine stops. Three regions.One epic November. THIS MONTH'S ROUTE Munich → Atlanta → Amsterdam → London → Toronto → Los Angeles (Anaheim) → New York City → Milan → Tokyo A free, one-day event on how organizations...
- 1430 Views
- 1 replies
- 0 kudos
a week ago
DATA + AI LIVE Time: AMER Nov 11 / 9 AM PT / 12 PM ET APAC Nov 12 / 9:30 AM IST / 12 PM SGT / 1 PM JST-KST / 3 PM AEDT EMEA Nov 17 / 9 AM GMT / 10 AM CET Register for the Workshop Note: Marking RSVP on this Community event does not register you fo...
- 1120 Views
- 0 replies
- 2 kudos
2 weeks ago
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 3759 Views
- 0 replies
- 4 kudos
09-01-2026
Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...
- 819 Views
- 0 replies
- 1 kudos
2 weeks ago
Responsible gaming initiatives are becoming increasingly important as regulation, gameplay experiences and the betting and gaming industry continue to expand. The Responsible Gaming Solution Accelerator, developed in partnership with AWS, shows how t...
- 566 Views
- 1 replies
- 5 kudos
2 weeks ago
Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...
- 761 Views
- 0 replies
- 4 kudos
3 weeks ago
Community Activity
- 3 Views
- 0 replies
- 0 kudos
Building on Lakebase | Episode 3: Branch, Test, and Ship: Release Changes Safely using Branching
Welcome to Building on Lakebase, a four-part series on building transactional apps and AI agents on Lakebase, a fully managed serverless PostgreSQL database built by Databricks. Over the four episodes led by Michelle Deng and Benjamin Nwokeleme, Solu...
- 3 Views
- 0 replies
- 0 kudos
- 17 Views
- 0 replies
- 0 kudos
Models Should Be Config, Not Copies: A Config-Driven MLOps Blueprint on Databricks
Banking · Insurance · Credit Risk · Any Team Running More Than One Model — From Copy-Pasted Pipelines to One Shared Pipeline and One YAML per ModelBy @SrinuB in collaboration with @sridharplv Your first model went to production beautifully. Your fif...
- 17 Views
- 0 replies
- 0 kudos
- 176 Views
- 3 replies
- 0 kudos
Real time Streaming to AI Engine at Databricks
Hi there,Usercase: Fraud Detection Technology : Databricks, Kafka, Microsoft Foundry, Dashboard showing real-time reportsAsk: Please let me know if any reference or technology details to achieve 1-2 milli second (Max) latency using above technology s...
- 176 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @abhietc31, the fraud detection Solution Accelerator scores Kafka transactions in real-time mode and feeds a live Databricks Apps dashboard from Lakebase. For your own pipeline, the Lakebase sink writes real-time mode output to a Lakebase table wi...
- 0 kudos
- 443 Views
- 3 replies
- 0 kudos
Unable to Serve Gemini 3.8 Flash on Azure Databricks – East US
I am working with an Azure Databricks workspace in the East US region and am trying to use the Gemini 3.8 Flash model through Databricks Model Serving.The model is visible in the workspace under the system AI models as:system.ai.databricks-gemini-3-8...
- 443 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @krSindhu, on Azure Databricks, Gemini 3.8 Flash needs both ADI Services, which require eligibility and enablement, and cross-geography routing. Check that the Integration with ADI Services toggle is enabled. Confirm that Enforce data processing...
- 0 kudos
- 24 Views
- 0 replies
- 0 kudos
Exam Suspended before start (Kryterion) - Ticket #01054624
Hi everyone,I'm reaching out here hoping a community moderator or Databricks staff member can help escalate my support ticket.On October 25, 2026, I was scheduled to take the Databricks Certified Data Engineer Associate exam. I paid the 246 USD certi...
- 24 Views
- 0 replies
- 0 kudos
- 54 Views
- 2 replies
- 0 kudos
Best approach for moving Alteryx workflows to Databricks ?
Hey folks, We're planning to migrate our ETL pipelines from Alteryx to Databricks.Many of our workflows use iterative macros and complex joins, so manually rewriting everything into PySpark/Spark SQL will take a while.For those who have made this tra...
- 54 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Great answer from @Harshad_B .Several things to addd: there is No native one-click converter exists for Alteryx-to-Databricks migration, so the you need to follow a structured approach covering tooling, iterative macro translation, target architectur...
- 0 kudos
- 20 Views
- 0 replies
- 0 kudos
How to size your Genie bill (Genie Agent, Genie Code) before the free period ends (31 January 2027)
31 January 2027 is closer than it looks. Until then, every question your people ask Genie One or a Genie Agent is free. From 1 February, it's billed like the rest of Genie: a free monthly allowance per person, then pay-as-you-go. If nobody has worked...
- 20 Views
- 0 replies
- 0 kudos
- 22 Views
- 0 replies
- 0 kudos
Structured Streaming: Choose Watermarks Around Real Arrival Delays
Structured Streaming: Choose Watermarks Around Real Arrival DelaysA practical streaming lesson: measure how late business events arrive before choosing a watermark threshold.Consider a hypothetical retailer using Azure Databricks to calculate sales i...
- 22 Views
- 0 replies
- 0 kudos
- 70 Views
- 0 replies
- 0 kudos
Governed Writes with SQL SECURITY DEFINER for Stored Procedures
SQL Stored Procedures in Databricks now support SQL SECURITY DEFINER, and it is Generally Available on SQL warehouses, Serverless compute and All-Purpose clusters (DBR 19+). A SECURITY DEFINER procedure runs with its owner's privileges, not the calle...
- 70 Views
- 0 replies
- 0 kudos
- 555 Views
- 3 replies
- 2 kudos
Resolved! rich colors affected by recent dark mode update
Hello,I use rich Consoles to print DataFrame modification statistics, and I use dark mode. Up until a few days ago, Databricks handled dark mode by inverting rich's colors. That was fine, I just inverted the colors I wanted before passing them into r...
- 555 Views
- 3 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @mksmith521, Thanks for the careful report, and for measuring the color with a picker. You're right: bright_red inside a class="nodarkmode" wrapper does not come back as FF0000. What you're seeing is a limitation of the CSS filter capabilities ...
- 2 kudos
- 65 Views
- 2 replies
- 0 kudos
How to Connect Databricks to Snowflake & Query Live Data?
Hi everyone,I am looking for a method to connect Databricks to Snowflake so I can query and transform the data directly in a notebook. I specifically want to avoid methods that just perform a one-time copy of the tables into Databricks, as I need the...
- 65 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
@Raj_DB, Databricks has native Lakeflow connector to connect with Snowflake and ingest data. But it is not a recommended solution if your requirement is to only read data and not have it physically ingested in a catalog. If data is read-only then con...
- 0 kudos
- 1602 Views
- 4 replies
- 0 kudos
Resolved! Databricks Cost Estimation Template
Hi Databricks Team, Is there a standard Databricks cost estimation template(xl), sizing calculator, or TCO tool that allows us to provide the following inputs and derive an approximate monthly and annual platform cost:Source systems and their types (...
- 1602 Views
- 4 replies
- 0 kudos
Latest Reply
- 0 kudos
@Phani1 @robert7878 - You can build a AI/BI dashboard pretty easily using Genie, just give what is required and how you want it to be represented.
- 0 kudos
- 437 Views
- 3 replies
- 1 kudos
Mismatch of spark.catalog.tableExists and SHOW TABLES in streams
Consider this minimal example of a streaming workflow:import os from pyspark.sql import functions as F, DataFrame from typing import Literal # Change these if you want to replicate CATALOG, SCHEMA = 'partner_demo_catalog', 'ad_sales_demo' spark.sql...
- 437 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @i4ata Hi how if you try with batch specific session (just curious)def foreach_batch(batch_df, batch_id): spark_session = batch_df.sparkSession if spark_session.catalog.tableExists(table_name): brSaurabh
- 1 kudos
- 80 Views
- 2 replies
- 2 kudos
Resolved! AIM configuration on Databricks (AWS)
Hello,We want to manage our users and groups (not service principals) via AIM on our databricks platform which sits on AWS. This is an existing platform with manually created users and groupsIn the documentation it refers to the externalID of both th...
- 80 Views
- 2 replies
- 2 kudos
- 96 Views
- 1 replies
- 0 kudos
Partner Champion nomination – no Champions or PSA at my company (LATAM)
Hi Databricks team,I'm a Senior Data Engineer at DB, a Databricks partner in Brazil, and I'd like to be nominated for the Partner Champion Program (Solutions Architect track). Our company doesn't have any Partner Champions yet and we're not aligned w...
- 96 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
That’s an impressive set of certifications and hands-on experience. Hopefully someone from the Databricks LATAM partner team can connect you with the right program lead. It would be great to see DB have its first Partner Champion, and your Solutions ...
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1506 | |
| 1255 | |
| 1189 | |
| 961 |
Latest from our Blog
Governed Writes with SQL SECURITY DEFINER for Stored Procedures
SQL Stored Procedures in Databricks now support SQL SECURITY DEFINER, and it is Generally Available on SQL warehouses, Serverless compute and All-Purpose clusters (DBR 19+). A SECURITY DEFINER procedu...
Assume, don't inherit. Putting Databricks RBAC to work.
Access problems in Databricks are rarely about missing permissions. More often they are about people carrying every permission they have ever been given into every session. Someone gets added to a fin...
Geospatial Reasoning with Genie Agents: Competitor Impact in Your Trade Area (Part 1)
As we start building agents that deliver business value, it is inevitable that subsets of the data an agent needs are geospatial in nature. When agents are left to make geospatial decisions on their o...
Serving the Lakebase Data API Through Azure API Management
Why use APIM with Data API? The Data API is one of the underrated features of Lakebase. Traditionally, teams that wanted to share a database over HTTP built a layer of REST services in front of it. Th...
