What's the challenge Build a Databricks App on Free Edition with a Genie Agent at its core. Build a Databricks App, create and configure your own Genie Agent, connect it to your App, and use it to power a meaningful, useful, or unexpected experienc...
- 283 Views
- 0 replies
- 4 kudos
yesterday
Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, August 20, 2026! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data...
- 506 Views
- 0 replies
- 3 kudos
a week ago
VIRTUAL TRAINING Time: AMER Aug 19 – Aug 20, 2026 | 9:00 AM PT / 12:00 PM ET Register for the Workshop Note: Marking RSVP on this Community event does not register you for the workshop. Please use the Register button above to complete your registr...
- 2501 Views
- 1 replies
- 6 kudos
4 weeks ago
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 698 Views
- 0 replies
- 1 kudos
a week ago
Congratulations to all members who have received the new Databricks Partner badge! Your badge recognizes your affiliation with the Databricks Partner ecosystem and helps community members quickly identify trusted partner professionals across discuss...
- 4200 Views
- 41 replies
- 9 kudos
3 weeks ago
New in Community Say hello to the Genie Hub Your questions about Databricks Genie, answered by the people actually building with it. Ask the community anything about Genie… Ask → Genie runs on plain-language conversation - you ask, it answers f...
- 1273 Views
- 1 replies
- 5 kudos
a month ago
Our Community Champion Program has always been about recognizing individuals who consistently show up to support others, share their expertise, and strengthen the Databricks Community. Alongside our customers, we’re equally proud to recognize the inc...
- 610 Views
- 4 replies
- 6 kudos
a week ago
R&D teams work with many forms of life sciences data, making it important to organize that data and uncover connections across it. The R&D Optimization With Knowledge Graphs Solution Accelerator shows how knowledge graphs combine the semantics, scala...
- 191 Views
- 0 replies
- 0 kudos
Thursday
The Weekly Digest • August 10 – 16 Community Pulse Your weekly dose of the best articles, events, and conversations from the community. This Week's Community Stars The members who showed up and made a difference this week : @Sumit_7 @szymon_...
- 124 Views
- 1 replies
- 3 kudos
13 hours ago
Community Activity
- 162 Views
- 3 replies
- 0 kudos
Creating Databricks agent
Hi All,We are trying to create a Databricks agent and were looking for a step by step approach if there is any. We did go through the Author an agent and deploy it on Databricks Apps | Databricks on AWS but weren't very clear on creation of a new age...
- 162 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Thank you , we had looked at this but this doesnt help to create an agent from start to finish. Is there any other exercise or example we can look at?
- 0 kudos
- 124 Views
- 1 replies
- 3 kudos
🌟 Community Pulse: Your Weekly Roundup! August 10 – 16, 2026
The Weekly Digest • August 10 – 16 Community Pulse Your weekly dose of the best articles, events, and conversations from the community. This Week's Community Stars The members who showed up and made a difference this week : @Sumit_7 @szymon_...
- 124 Views
- 1 replies
- 3 kudos
Latest Reply
- 3 kudos
Kudos to all the members and bricksters for their contributions Thanks for sharing/mention @Advika!
- 3 kudos
- 90 Views
- 2 replies
- 0 kudos
Not Able to Remove Courses
Over time, I have enrolled in various courses and learning paths. Some I do not plan on completing and some are now expired and unusable. However, these remain persistent in my "My Courses and Learning Plans" page, making it cluttered and difficult t...
- 90 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hello @Advika ,Thanks for your response. When I try to hide the courses, I don't see the "hide" option. Any ideas?
- 0 kudos
- 45 Views
- 0 replies
- 0 kudos
DATABRICKS.SQL and DATABRICKS.TABLE Functions Debuts in Microsoft Excel
I was genuinely stunned to discover that Excel now supports DATABRICKS.SQL and DATABRICKS.TABLE worksheet functions . For years, analysts and business users have relied on exporting CSVs or building complex connectors to bridge the gap between enterp...
- 45 Views
- 0 replies
- 0 kudos
- 321 Views
- 3 replies
- 0 kudos
Unable to Enable Unity Catalog – Azure Managed Identity Credential Not Found
Hi Databricks Community,I am trying to enable Unity Catalog in my Azure Databricks account. As part of the setup, I created an Azure Databricks Access Connector and assigned its managed identity the required permissions on my ADLS Gen2 storage accoun...
- 321 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @Aparajita_Nag The "could not be found" error indicates Databricks cannot locate the Access Connector resource in Azure. This happens before any ADLS permissions are checked. Because I lack full information on your setup, you can verify the below ...
- 0 kudos
- 129 Views
- 3 replies
- 2 kudos
S3 LIST costs on high commit rate Delta tables: is there a start-after option on Databricks runtime?
Hi All,If you run streaming or continuous pipelines that commit to Delta tables on S3 every few minutes, your _delta_log folders are probably much bigger than your tables. A CDC or MERGE flow commits every cycle whether or not data arrived, and with ...
- 129 Views
- 3 replies
- 2 kudos
Latest Reply
- 2 kudos
@brianjorge178 @cartergray70543 Thanks for your thoughts. I had a long chat with Databricks support team, and here is where have landed so far if it interests you:What we believed. The pipelines committed every few minutes, so each table's transactio...
- 2 kudos
- 443 Views
- 2 replies
- 1 kudos
Resolved! Vulnerabilities for com.databricks:databricks-jdbc:3.4.1 jar
We are reporting two groups of Snyk-identified security vulnerabilities in com.databricks:databricks-jdbc:3.4.1 caused by shaded/embedded dependencies that cannot be remediated by consumers through standard dependency management overrides.Why We Cann...
- 443 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Thank you so much Louis! The above solution to use databricks-jdbc-thin dependency worked. Appreciate your prompt response.
- 1 kudos
- 73 Views
- 1 replies
- 1 kudos
Auto SCD API Tombstone Garbage Collection
Are there any settings that can be used to influence the frequency at which the auto SCD API runs the tombstone garbage collection process in Spark Declarative Pipelines? I've seen a couple community posts that referenced the following: pipelines.a...
- 73 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @de01 ,Short answer: Those two settings (pipelines.applyChanges.tombstoneGCFrequencyInSeconds and pipelines.cdc.tombstoneGCFrequencyInSeconds) are internal/undocumented configurations. They are not part of the public API surface and may have been ...
- 1 kudos
- 49 Views
- 0 replies
- 0 kudos
Solution Accelerator Series | Overall Equipment Effectiveness
Manufacturers collect large volumes of sensor and equipment data, but measuring equipment productivity at the required latency and scale can be difficult with traditional systems. The Overall Equipment Effectiveness (OEE) Solution Accelerator demonst...
- 49 Views
- 0 replies
- 0 kudos
- 81 Views
- 1 replies
- 0 kudos
how to enable column level lineage in databricks
I have bronze layer data which is directly referred in silver. there are one or two columns from bronze layer which are used to build silver column.is there any way I can have column-level lineage shown in databricks like table lineage@DATA @lineage
- 81 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi Prathamesh, Column level lineage is tracked automatically in Databricks if the tables are governed by Unity Catalog. You do not need to configure explicit column tracking or alter the pipeline code, once your bronze-to-silver transformations run o...
- 0 kudos
- 283 Views
- 3 replies
- 0 kudos
NetSuite JDBC Driver 8.10.190.0 - Databricks support
Hi,Currently I'm trying to connect my databricks to Netsuite using Lakeflow connect. At the moment, Netsuite only provides JAR driver version 8.10.190.0. Would Databricks be supporting this version soon? If not yet, can I know when would Databricks b...
- 283 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
That version should work although documentation doesn't list it yet. Can you try out? If it fails I would recommend opening a support case with your workspace ID and the exact error message so the team can verify the allowlist status.
- 0 kudos
- 90 Views
- 0 replies
- 0 kudos
Announcement | Taking AUTO CDC to the Next Level in Databricks
Databricks is expanding AUTO CDC to handle more of the difficult, real-world cases data engineers face, including bitemporal history, partial record updates, and open-source change data capture capabilities in Apache Spark. What’s new Bitemporal hist...
- 90 Views
- 0 replies
- 0 kudos
- 94 Views
- 1 replies
- 0 kudos
Cannot work with workspace
Hello everyone,We’re currently experiencing issues across all our Databricks environments. We’re unable to open any notebooks and are receiving the error shown below.Does anyone have any insights into the issue or know when it is expected to be resol...
- 94 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
it seems that the problem is fixed now
- 0 kudos
- 186 Views
- 3 replies
- 0 kudos
Not Able To Log In - Free Edition
Hi Databricks Team,I am not able to log in to my Databricks free edition account. I tried clearing my cache and logging in from incognito mode but I face the same error (screengrab attached) with Reference ID: d5284105-10d1-4b2f-88df-436ffd3efb72 I w...
- 186 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
The most likely issue is a Databricks-side identity/account association, not your Google/OTP authentication. Databricks documents that user identities are represented by email addresses and can exist at the account/workspace level check here
- 0 kudos
- 253 Views
- 5 replies
- 0 kudos
facing issue in llm models
i have signed up to databricks using aws but when i try to access model i m getting error Error (403): PERMISSION_DENIED: The endpoint is temporarily disabled due to a Databricks-set rate limit of 0.
- 253 Views
- 5 replies
- 0 kudos
Latest Reply
- 0 kudos
Yes. If you have already upgraded from the Free Trial to Enterprise and the error is still exactly Databricks-set rate limit of 0, then changing the QPM/TPM limit in the UI is not going to fix it.I checked the current Databricks documentation and rec...
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2289 | |
| 1358 | |
| 1250 | |
| 1184 | |
| 961 |
Latest from our Blog
Identity Columns Best Practices for Databricks Lakehouse
The surrogate key problem nobody plans for Sooner or later every data warehouse needs surrogate keys. You are building a dimension table and you want a single narrow column your fact tables can join o...
DABs Migration Guide: Terraform to the Direct Deployment Engine
This guide covers the migration procedure and several behaviors worth knowing that this migration surfaced in practice. Background and timeline The deployment backend for DABs is moving from the Terra...
Beyond Prompting: Production-Ready Image Generation and Visual Asset Management on Databricks
Image Generation in the Enterprise For agencies, creative studios, retailers, and media companies, visual assets are core to the business. Better image generation can directly improve output, speed, a...
LLMOps for Data Scientists and AI Builders: A Quickstart on Databricks
Building an LLM-powered prototype is easy. A few lines of code, a hosted model, and you have an agent that classifies tickets, summarizes documents, or answers questions. The hard part comes after: me...
