Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, October 29! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...
- 836 Views
- 1 replies
- 3 kudos
2 weeks ago
Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, November 5! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...
- 326 Views
- 0 replies
- 2 kudos
a week ago
NOVEMBER · THE TOUR IS ON THE MOVE Nine stops. Three regions.One epic November. THIS MONTH'S ROUTE Munich → Atlanta → Amsterdam → London → Toronto → Los Angeles (Anaheim) → New York City → Milan → Tokyo A free, one-day event on how organizations...
- 372 Views
- 1 replies
- 0 kudos
Monday
DATA + AI LIVE Time: AMER Nov 11 / 9 AM PT / 12 PM ET APAC Nov 12 / 9:30 AM IST / 12 PM SGT / 1 PM JST-KST / 3 PM AEDT EMEA Nov 17 / 9 AM GMT / 10 AM CET Register for the Workshop Note: Marking RSVP on this Community event does not register you fo...
- 767 Views
- 0 replies
- 2 kudos
a week ago
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 3273 Views
- 0 replies
- 4 kudos
09-01-2026
Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...
- 259 Views
- 0 replies
- 1 kudos
Friday
Responsible gaming initiatives are becoming increasingly important as regulation, gameplay experiences and the betting and gaming industry continue to expand. The Responsible Gaming Solution Accelerator, developed in partnership with AWS, shows how t...
- 280 Views
- 1 replies
- 4 kudos
a week ago
Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...
- 591 Views
- 0 replies
- 4 kudos
2 weeks ago
Community Activity
- 795 Views
- 4 replies
- 0 kudos
How to extract data from SAP to Databricks?
Hey everyone, I'm working through a project where I need to get data out of SAP S4Hana and into Databricks, and I'd love to pick the brains of anyone who's done this before.A few things I'm trying to figure out:How are you actually pulling the data o...
- 795 Views
- 4 replies
- 0 kudos
Latest Reply
- 0 kudos
@RaulTovar, a big chunk of the questions I have answered in a sibling thread, but to address the missing part:You go with the style you actually need, but most likely you'll end up with batch extraction using a delta mechanism. This can be built into...
- 0 kudos
- 88 Views
- 2 replies
- 0 kudos
Unity Catalog external location access error after metastore attachment
Hi everyone,I am running into a permission issue when trying to query data from an external S3 storage location managed through Unity Catalog.Here are the symptoms:The Setup: Storage credentials and an external location were successfully created, and...
- 88 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
A correct IAM role is necessary but not sufficient. Access to an external location goes through two separate checks, and the wording of the error tells you which one failed. Here's how to find it quickly. Step 0 – Capture the exact error. Run a direc...
- 0 kudos
- 144 Views
- 3 replies
- 0 kudos
Asset Bundles: how to link a bundle-managed Genie space to an AI/BI dashboard across environments (o
Hi all,I'm managing an AI/BI dashboard and a Genie space with Databricks Asset Bundles (CLI v1.20, engine: direct), deployed to three workspaces (dev / test / prod) via Azure DevOps.The problem When I link the Genie space to the dashboard in the UI, ...
- 144 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
This is a current DAB limitation. CLI 1.20 supports Genie spaces with the direct engine, but the documented dashboard resource has no Genie-space binding field. The dashboard JSON file also isn’t a place where bundle resource references are resolved,...
- 0 kudos
- 173 Views
- 2 replies
- 0 kudos
Governed Tag Propagation (Beta) in Unity Catalog - How It Works and What to Consider
Databricks' Governed Tag Propagation (Beta) is an interesting addition to Unity Catalog, helping automatically carry governed tags across downstream tables and views using data lineage.As data moves across medallion layers, this could significantly r...
- 173 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
@DoTA Thanks for highlighting the asynchronous propagation aspect, that's an important consideration, particularly when propagated tags are tied to ABAC policies. It's a useful reminder to account for the propagation delay rather than assuming govern...
- 0 kudos
- 314 Views
- 2 replies
- 1 kudos
Why External Secrets in Unity Catalog Matter
Modern data and AI workloads rarely operate in isolation. Pipelines connect to operational databases. Notebooks call third-party APIs. Agents invoke external tools. Applications use tokens, passwords, certificates, and API keys to reach the systems a...
- 314 Views
- 2 replies
- 1 kudos
- 17 Views
- 0 replies
- 0 kudos
Unity AI Gateway Observability: Models, MCP Tools, and Coding Agents
Databricks Unity AI Gateway provides a unified way to monitor and understand AI activity through its built-in Workspace AI Gateway Usage Analytics dashboard and the underlying system.ai_gateway.usage system table.Some useful capabilities include:Mode...
- 17 Views
- 0 replies
- 0 kudos
- 10490 Views
- 3 replies
- 1 kudos
Data Migration from SAP S/4HANA to Databricks
May someone please help me designing the Migration of SAP S/4 HANA to Databricks. How to design this. what all we need to consider as LLD.1. How Data needs to be extracted and by which tool ? near–real-time replication is required2. Each layer for Da...
- 10490 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
@Pratikmsbsvm I will try to be brief but accurate.1. Getting data out of SAPYou need a properly supported connector/extraction method. You can start researching Fivetran, SNP Glue and alike. What you need to understand is that this can be expensive, ...
- 1 kudos
- 75 Views
- 2 replies
- 3 kudos
Resolved! Issue Reading DLT-Generated Materialized Views on DBR 18.x
We are experiencing an intermittent issue when reading Unity Catalog materialized views from downstream transformation notebooks.EnvironmentAzure DatabricksUnity Catalog enabledMaterialized views and streaming tables are created by a Lakeflow (former...
- 75 Views
- 2 replies
- 3 kudos
Latest Reply
- 3 kudos
Adding a small practical note to Nina's answer, since your policy uses auto:latest-lts.The quickest way to apply the 17.3 LTS workaround without hardcoding a version key is to switch the policy to auto:prev-lts. It maps to the second-latest LTS runti...
- 3 kudos
- 300999 Views
- 3 replies
- 9 kudos
The Ultimate Guide to Chunking Strategies for RAG Applications with Databricks
Over the years, I have collaborated closely with ML engineering leaders across various industries, guiding them on how to make the right chunking strategy decisions for their Retrieval-Augmented Generation (RAG) use cases. One of the biggest challeng...
- 300999 Views
- 3 replies
- 9 kudos
- 178947 Views
- 241 replies
- 45 kudos
Resolved! Databricks Certification Exam Suspended? Our Support Team Can Help
Taking exams is so stressful already, and if your exam gets suspended it is extra stressful. Don't worry! Our support team is awesome and will help you get back on track. The most important step is to file a ticket in our Help Center. Be sure to inc...
- 178947 Views
- 241 replies
- 45 kudos
Latest Reply
- 45 kudos
Hi @Cert-Team and @Cert-TeamOPS,My Databricks Certified Data Engineer Associate exam on 27 October 2026 at 2230H Asia/Calcutta was suspended after I received a warning that I was not looking at the screen. I had prepared for this exam for a long time...
- 45 kudos
- 335 Views
- 1 replies
- 1 kudos
How to make each person see only their specific data (i.e. their own rows in Genie) with RBAC & ABAC
When rolling Genie out to a UK enterprise Finance department, one of the questions was "will a cost-centre owner accidentally see another team's numbers?" In Finance, one leaked row is a bigger problem than a slightly clumsy chart. The good news: yo...
- 335 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Good write up, and the two-persona test is the right way to check this. One thing I'd push back on gently is step 2. It says that if the space runs as its creator, everyone sees the creator's rows. From the Genie docs that isn't how a space used dire...
- 1 kudos
- 115 Views
- 1 replies
- 0 kudos
Pattern: Sharing Databricks output with an AKS app through an external volume and managed identity
Scenario A transaction app runs on AKS. It is the only component with a connection to MongoDB Atlas. Databricks processes the data, and the app has to pick up the results and write them back to Atlas. The requirements are no PATs, no CLI, no Databric...
- 115 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
This is close to what I'd do too. On the open point about reads outside Unity Catalog: I don't think there's a way to get UC to govern them, so I'd lean on the storage side. Private endpoint or firewall on the export account, the reader identity scop...
- 0 kudos
- 118 Views
- 2 replies
- 1 kudos
Question regarding Databricks Apps deployment
Hello Databricks Community,I am currently working on setting up a Databricks App and ran into a few questions.Here are the details of what I am working with:Target Framework: [e.g., Streamlit / Dash]Goal: [Briefly describe what you are trying to achi...
- 118 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
When setting up Databricks Apps, common challenges center on configuration, Unity Catalog (UC) connectivity, and authentication. Ensure your app.yaml correctly specifies the startup command and binds to the container port, and leverage the Databricks...
- 1 kudos
- 88 Views
- 1 replies
- 0 kudos
Not received my Databricks certified Data Engineer Professional certification
Hello Support Team,I successfully completed and passed my Databricks certification exam on 15th October 2026. However, as of 28th October 2026, I have not yet received my certificate, though it is visible in my Webassessor/Credentials portal.It's alr...
- 88 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @soumya_kumari, Congratulations on passing, and thanks for reaching out. Certificates aren't sent as a separate file. You download your certificate and badge yourself from the Databricks Credentials portal. Sign in at https://credentials.databrick...
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1505 | |
| 1255 | |
| 1189 | |
| 961 |
Latest from our Blog
[PARTNER BLOG] Scaling Auto Loader on AWS: Moving to File Notification Mode with Managed File Events
Contents IntroductionUnderstanding the Key ConceptsWhy File Notification with Managed File Events?Key Benefits of Managed File EventsArchitecture OverviewPrerequisitesPhase 1: AWS IAM SetupPhase 2: Da...
End-to-End Cyber Lakehouse Streaming via Zerobus Ingest, Spark Declarative Pipelines, and OCSF
Streaming raw events into a cyber lakehouse and normalizing them to a standard schema is a common pattern for security analytics. This blog walks through an end-to-end architecture that uses Databrick...
AI Functions for Synthetic Test Data: Generate Realistic Datasets in Pure SQL
The views expressed in this post are my own and do not represent those of my employer. Not long ago, generating realistic synthetic data meant building custom pipelines with GANs, Transformers, or RN...
Databricks maintenance and cleanup: Visualize, Clean, and Log with Declarative Automation Bundles
Introduction Managing Databricks environments can quickly become overwhelming as jobs, AI Search indexes, and pipeline artifacts accumulate, making manual cleanup, logging, and compliance difficult. T...
