Ready to level up your skills before the biggest data and AI event of the year? From May 27 through June 3, we are cutting prices in half. Expert-led training courses are just $212.50 each! Register for Data + AI Summit today and pick from 20+ hands...
- 1279 Views
- 3 replies
- 4 kudos
2 weeks ago
Grow Your Skills and Earn Rewards! Mark your calendar: June 15 – July 6, 2026 Join us for a three-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whethe...
- 43715 Views
- 75 replies
- 51 kudos
a month ago
We’re getting ready to pilot the Databricks Detective Series ahead of its launch at Data + AI Summit 2026, and we’re looking for Community members to help test it. Databricks Detective Series is a free, gamified, hands-on experience where you become...
- 1637 Views
- 8 replies
- 8 kudos
a month ago
Join Our Business Impact Accelerator Sessions! We are thrilled to invite you to the Business Impact Accelerator, a specialized single-session program designed specifically for business professionals, executives, and non-technical teams. If yo...
- 548 Views
- 1 replies
- 2 kudos
Friday
Already registered for Data + AI Summit 2026? Join us on Monday, June 15 for the Databricks Apps & Agents for Good Hackathon 2026, hosted in partnership with OpenAI. Secure your spot and apply by Sunday May, 31 Note: Marking RSVP on this Community ...
- 1398 Views
- 1 replies
- 1 kudos
a month ago
DAIS 2026 · Speaker Spotlight A conversationwith Erin Butler On why AI in financial services is a business model shift, not a tooling upgrade, and what context plus control actually unlock. The Session Financial Services Industry Forum Date ...
- 92 Views
- 0 replies
- 0 kudos
11 hours ago
Customer service teams often need to work with large volumes of unstructured data such as call transcripts, chat messages and other text. The Large Language Models (LLMs) for Customer Service Analytics Solution Accelerator shows how NLP, transformers...
- 198 Views
- 0 replies
- 0 kudos
Tuesday
The Weekly Digest • June 1 – June 7 Community Pulse Miss something this week? We've got you covered.. This Week's Community Stars The members who showed up and made a difference this week: @szymon_dybczak @balajij8 @ShamenParis + Top Bricks...
- 403 Views
- 1 replies
- 3 kudos
Tuesday
Community Activity
- 125 Views
- 3 replies
- 1 kudos
Databricks Free Edition Suddenly Not Working - June 9
Hello Community,I am using databricks free edition for doing POC(s) of multiple use case.The databricks free edition page is not opening from the morning and I am unable to login.Is there any outage or some issues that is going on right now?Regards,R...
- 125 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
Same happening to me today. Databricks Free Edition is not working. It does not want to be open, at least now.
- 1 kudos
- 15 Views
- 0 replies
- 0 kudos
Models failing in tutorial
Hello,I am following the "Get started: Build your first machine learning model on Databricks" tutorial, and am getting stuck on "Parallel training using Optuna".When I Search runs to retrieve the best model, the following code fails as there are no m...
- 15 Views
- 0 replies
- 0 kudos
- 39 Views
- 0 replies
- 0 kudos
Petabyte scale with Zerobus ingest: Download the Code and Ingest the Milky Way
We just published a deep-dive engineering post on Zerobus Ingest that covers how it works and the design choices that made it possible. 1 petabyte. 24 hours. 12 GB/s sustained. 12 million rows per second. Single table. Zero pre-configuration. The th...
- 39 Views
- 0 replies
- 0 kudos
- 21 Views
- 0 replies
- 0 kudos
Does combo chart have group by color function ?
Does combo chart have group by color function by specific field (type)? Like Line Chart: the line will perfectly split into multiple lines of different colors, with each line representing a distinct Type.Bar Chart: The original single bar will also ...
- 21 Views
- 0 replies
- 0 kudos
- 13 Views
- 0 replies
- 0 kudos
Are Paid Training Codes Available?
Late to the party here, wondering if there are any codes available to bring down the $425 cost for the Paid Training?
- 13 Views
- 0 replies
- 0 kudos
- 50 Views
- 1 replies
- 0 kudos
Can multiple questions be added to the same sql query in genie space
Hi, Can we add multiple sample questions to one SQL query in the sql queries instructions so Genie learns to handle similar variations?
- 50 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @IM_01, The public guidance points to one natural-language question or title per example SQL query, rather than multiple sample questions attached to a single query. In the Tune Genie Space quality docs, Databricks says that for each example SQL q...
- 0 kudos
- 36 Views
- 0 replies
- 0 kudos
HealthCare Prior Authorizations with Databricks Lakebase Vector Search
Healthcare organizations possess enormous volumes of care, operational and payer related data. Every care interaction generates information across care notes, diagnosis records, medication histories, imaging reports, claims systems and payer policies...
- 36 Views
- 0 replies
- 0 kudos
- 57 Views
- 0 replies
- 1 kudos
CUSTOMER STORY | DEICHMANN SE: Operationalizing customer data for omnichannel marketing
"The lakebase architecture makes it easier to operationalize analytics data and use the same governed data across analytics, data science, and e-commerce marketing." - Kevin Haferkamp, Head of Data Platform & Engineering CoE, IT Data & Anal...
- 57 Views
- 0 replies
- 1 kudos
- 177 Views
- 1 replies
- 4 kudos
5 Minute Features - a new video series
I have spent the past couple of months building up a small hobby YouTube project where I run through Databricks Features in an easy to digest format.I am for a very hands-on and demo heavy approach so you can actually see what is going on, and how th...
- 177 Views
- 1 replies
- 4 kudos
Latest Reply
- 4 kudos
There is a new video live today! We are taking a look at ABAC - check it out below:https://www.youtube.com/watch?v=uNbvZ8YIuRs&t=1s
- 4 kudos
- 72 Views
- 0 replies
- 0 kudos
Unify Your Engineering Data: Jira Ingestion Best Practices
For most engineering teams, Jira is the system of record for project work: issues, sprints, and workflows. And Confluence sits alongside Jira as the knowledge layer, capturing the documentation and decisions that give that work context. Lakeflow Conn...
- 72 Views
- 0 replies
- 0 kudos
- 128 Views
- 5 replies
- 2 kudos
Resolved! Databricks unable to list ADLS folder and files
Hi Databricks Community,I am able to list the container from my databricks workspace but unable to list the folder and files further.If I try to access the same files and folder from the Databricks UI, external location path, I am able to see all fil...
- 128 Views
- 5 replies
- 2 kudos
Latest Reply
- 2 kudos
Following are may be the Causes1. Different authentication methods- The UI's external location uses Unity Catalog credentials- Your dbutils.fs.ls() command uses the compute's Spark configurations- These may be using different credentials with differe...
- 2 kudos
- 43 Views
- 1 replies
- 0 kudos
DESCRIBE HISTORY Performance Issue for Large Scale Tables (22K Tables)
Hi everyone, I’m working with around 22,000 Unity Catalog external Delta tables, and my requirement is to execute DESCRIBE HISTORY table_name LIMIT 1 for each table and append the latest record into a single consolidated table. I’ve already tried mul...
- 43 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi,The reason your performance degrades so badly (4 mins for 2k tables, but 50 mins for 12k) is because of the Spark Driver. When you run spark.sql("DESCRIBE HISTORY...") inside a ThreadPoolExecutor, every single one of those 22,000 queries has to be...
- 0 kudos
- 113 Views
- 0 replies
- 1 kudos
[PARTNER BLOG] Building a Fully Automated Power BI Refresh Pipeline with Databricks
A capability that often goes unnoticed in Databricks Workflows is the Power BI task type. After exploring this feature in detail, it becomes clear that a common challenge faced by many data teams can now be solved more efficiently: Power BI semantic ...
- 113 Views
- 0 replies
- 1 kudos
- 336 Views
- 3 replies
- 0 kudos
foreachPartition
Is there any difference between pyspark.RDD.foreachPartition vs pyspark.sql.DataFrame.foreachPartition under the hood? The PySpark documentation describes pyspark.sql.DataFrame.foreachPartition as "a shorthand for df.rdd.foreachPartition()"If DataFra...
- 336 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Although the PySpark documentation states that DataFrame.foreachPartition() is a shorthand for df.rdd. foreachPartition(), there is an important difference when running on Databricks shared clusters (especially with Unity Catalog and Spark Connect).D...
- 0 kudos
- 779 Views
- 5 replies
- 0 kudos
Databricks Access Issue with UC
Hi All ,We are facing issues while reading Storage account where stream data from data verse in Unity catalog through External table but not every time . It was running fine with hiveAn error occurred while calling o393.sql.: org.apache.spark.SparkEx...
- 779 Views
- 5 replies
- 0 kudos
Latest Reply
- 0 kudos
This issue appears to be related to Azure Storage access through Unity Catalog rather than the data itself, especially since the same workload was working fine with Hive and the failure is intermittent.A few areas worth checking:1. Storage Credential...
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2273 | |
| 1317 | |
| 1223 | |
| 1182 | |
| 958 |
| User | Count |
|---|---|
| 441 | |
| 286 | |
| 220 | |
| 63 | |
| 51 |
Latest from our Blog
Petabyte scale with Zerobus ingest: Download the Code and Ingest the Milky Way
We just published a deep-dive engineering post on Zerobus Ingest that covers how it works and the design choices that made it possible. 1 petabyte. 24 hours. 12 GB/s sustained. 12 million rows per se...
Unify Your Engineering Data: Jira Ingestion Best Practices
For most engineering teams, Jira is the system of record for project work: issues, sprints, and workflows. And Confluence sits alongside Jira as the knowledge layer, capturing the documentation and de...
[PARTNER BLOG] Building a Fully Automated Power BI Refresh Pipeline with Databricks
A capability that often goes unnoticed in Databricks Workflows is the Power BI task type. After exploring this feature in detail, it becomes clear that a common challenge faced by many data teams can ...
Automatic Git Deployments for Databricks Apps from Github
If you've been deploying Databricks Apps from Git, you know the workflow: push your code, open the Deploy dialog, enter a Git reference, and hit Deploy. It works, but requires a series of manual steps...
