Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, October 29! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...
- 250 Views
- 0 replies
- 0 kudos
Monday
DATABRICKS Asia-Pacific Learning Festival Free, virtual, hands-on Databricks training 21 & 22 October 2026 Virtual, labs included Free Ready to level up your Databricks skills? The Databricks Asia-Pacific Learning Festival is back, and ...
- 1720 Views
- 1 replies
- 1 kudos
2 weeks ago
FOR DATABRICKS LEARNERS Two free ways to grow yourDatabricks skills Both are free and live in the Databricks Community. Bookmark the one that fits where you are right now - or use both. 01 LEARNING PATHS Your Path to Certification What it is:...
- 1813 Views
- 3 replies
- 6 kudos
3 weeks ago
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 2465 Views
- 0 replies
- 3 kudos
09-01-2026
Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...
- 743 Views
- 0 replies
- 0 kudos
a week ago
Community Champion • September 2026 Meet Venugopal Dabbara Every month, our Community Champion Program recognizes a member who makes the Databricks Community better for everyone, through their knowledge, their willingness to help, and their commitmen...
- 612 Views
- 3 replies
- 6 kudos
2 weeks ago
Genome-wide association studies help identify genetic variations associated with a disease or trait. The Genome-Wide Association Studies Solution Accelerator builds on Glow, an open source project for genomic analysis, to provide a fast, scalable and...
- 130 Views
- 0 replies
- 1 kudos
Tuesday
Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...
- 145 Views
- 0 replies
- 3 kudos
yesterday
Community Activity
- 485 Views
- 10 replies
- 6 kudos
Resolved! Zerobus Ingest with Kafka compliant API and WITHOUT a callback
Is see that kafka for zerobus is still in beta. So maybe something will change. Can someone tell me whether they are aware of an authentication handshake with this API that might AVOID the callback?Here is the python example, which uses a sophistica...
- 485 Views
- 10 replies
- 6 kudos
Latest Reply
- 6 kudos
The Zerobus team is actively working on scoped long-lived token support, which will likely help here by allowing you to avoid refreshing the token. I recommend keeping an eye out for upcoming roadmap announcements.
- 6 kudos
- 39 Views
- 0 replies
- 0 kudos
- 39 Views
- 0 replies
- 0 kudos
- 90 Views
- 3 replies
- 1 kudos
Resolved! Zerobus Variant Data not Processed as Expected (json data destined for Variant column).
Lets say I have a table receiving zerobus data (json) over HTTP/rest.That last VARIANT is "ValueJson".If I want to submit data to it, I would expect to be able to use normal json formatting:[ { "a": "E", "b": 123, "c": "xy...
- 90 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
Agree it feels unnatural, but you can hide it from the remote client with a thin encoding step right before sending, so producers keep working with normal nested JSON.A small helper that encodes only the VARIANT columns:import jsonVARIANT_COLUMNS = {...
- 1 kudos
- 81 Views
- 2 replies
- 1 kudos
Resolved! Zerobus rescue (VARIANT) not working. No Preview Available.
Has anyone tried using the rescue feature for json in zerobus-ingest? It seems like a very significant feature, assuming the schema incoming json is even 1% outside the control of team that may be ingesting on the databricks side. There needs to be ...
- 81 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
The error "unrecognized field name 'whatever'" suggests the rescue column isn't active for that table yet, so Zerobus is still validating strictly against the schema.A few things worth checking:1. Previews exist at two levels. Besides the account con...
- 1 kudos
- 198 Views
- 3 replies
- 0 kudos
Resolved! Service principals created by Genie App builder are not visible in Databricks UI
I created a Chat Assistant application using Databricks Genie App Builder, which automatically created a dedicated service principal for the application.The service principal requires access to the relevant Genie Space and catalog to run successfully...
- 198 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi Bhawana,I'm running into a similar issue except the solution provided does not work - the service principal created by the Genie App Builder doesn't exist in the Account Console. I've tried looking it up by both name and application ID, but I can'...
- 0 kudos
- 34 Views
- 0 replies
- 0 kudos
- 34 Views
- 0 replies
- 0 kudos
- 39 Views
- 0 replies
- 0 kudos
Databricks Apps vs Model Serving: Authentication, Cost, and Performance Compared
Presented by Arthur Dooner
- 39 Views
- 0 replies
- 0 kudos
- 60 Views
- 1 replies
- 0 kudos
External location Manage permission
Hi team, I'm trying to update the owner of an external location and I see the following message:Requires permission MANAGE on external location 'location_name'The owner of the resource, the user that created it doesn't have that permission? How is th...
- 60 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @orlandovallejos, The owner of a Unity Catalog object can do everything with it, including transferring ownership. But Databricks never actually adds MANAGE (or ALL PRIVILEGES) as a grant for the owner. That's why the Permissions tab or SHOW GRA...
- 0 kudos
- 63 Views
- 1 replies
- 0 kudos
Disable auto-scroll on Databricks Genie Code
Hello, I frequently use Genie Code when developing, particularly to ask Genie questions about certain lines or sections of code. The responses are great, but because they are often long, the chat auto-scrolls while text is being generated. Is there a...
- 63 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @humphriesdt, I don't think there's an option to turn off auto-scroll in Genie Code. You can open the Genie Code settings from the More menu in the chat pane header. They let you change the panel view (Docked or Side pane), set the serverless us...
- 0 kudos
- 46 Views
- 0 replies
- 0 kudos
PIM for Groups with Databricks: users appear in group without activating, nothing shows in PIM to ac
Hi everyone,We’re setting up just-in-time read access to a Unity Catalog catalog for a small audit team using Microsoft Entra PIM for Groups, and I’d like to check whether our setup is right.SetupAzure Databricks with account-level SCIM provisioning ...
- 46 Views
- 0 replies
- 0 kudos
- 34 Views
- 0 replies
- 0 kudos
- 34 Views
- 0 replies
- 0 kudos
- 58 Views
- 0 replies
- 0 kudos
About Azure SQL Managed Connector
Hi Community,We are trying to configure a Databricks Lakeflow Connect managed SQL Server connector to ingest data from Azure SQL Database into Databricks.We are using a contained SQL database user that has access only to the specific source database,...
- 58 Views
- 0 replies
- 0 kudos
- 37 Views
- 0 replies
- 0 kudos
- 37 Views
- 0 replies
- 0 kudos
- 46 Views
- 0 replies
- 0 kudos
Jev as Judge for Genie Agents
Can we configure the Jev to be as judge for Genie Agents ? I know we can log traces of Genie Agents into ML Flow on top of it can we bring in Jev and score the outputs generated ?
- 46 Views
- 0 replies
- 0 kudos
- 83 Views
- 2 replies
- 2 kudos
Databricks Connect + AutoDependencies + UDF + Streaming breaks
I have this toy python script:CATALOG = 'mpt_usd_gbl_bronze_dev' # <-- replaceSCHEMA = 'mpt_gbl_tco_fof' # <-- replacesrc=f'{CATALOG}.{SCHEMA}.toy_source'DEST = f'{CATALOG}.{SCHEMA}.toy_dest'from databricks.connect import DatabricksSession, Databrick...
- 83 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
Quick follow-up: I reproduced the hook failure locally with the latest databricks-connect (19.2.0). foreachBatch sends its function as a PythonUDF message, but its command is just the pickled function, not the (func, return_type) tuple the hook expec...
- 2 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1498 | |
| 1255 | |
| 1188 | |
| 961 |
Latest from our Blog
Locate, Measure, Judge: A Pattern for Verifiable Visual AI on Databricks (Part 2)
Part 1 introduced the pattern for verifiable visual AI. Let the model find the evidence, use deterministic code to measure it, apply governed rules to produce a pass, review, or fail verdict, and send...
Locate, Measure, Judge: A Pattern for Verifiable Visual AI on Databricks (Part 1)
AI adoption has moved much faster than measurable business results. McKinsey reports that 88% of organizations now use AI in at least one business function, yet only 39% see a bottom-line effect. A co...
Minimize disruptions for continuous pipelines with Maintenance Windows
Minimize disruptions for continuous pipelines with Maintenance Windows In an agentic world, it is more important than ever to make decisions using the latest available data. To achieve this, data engi...
Introducing session restore for serverless jobs
Serverless jobs make it easy to run production notebook workloads at scale, but until now, the state of a run was gone once it ended. If a pipeline ran for hours and failed on the last step, the varia...
