Databricks Free Edition is the new home for personal learning and exploration on Databricks. It’s perpetually free and built on modern Databricks - the same Data Intelligence Platform used by professionals. Free Edition lets you learn professional da...
- 542 Views
- 0 replies
- 4 kudos
Monday
June 15–18, 2026 Are you building the future with data and AI? Then this is your moment. The Call for Proposals for Data + AI Summit 2026 is officially open, and we want to hear from builders, practitioners, and innovators across the data and AI com...
- 868 Views
- 2 replies
- 5 kudos
Monday
Your voice matters to us. We are planning the 2026 Data + AI Summit, and we’d love your input on what would make the experience even more valuable for you. Take a few minutes to share your feedback through our quick survey — your insights directly in...
- 425 Views
- 3 replies
- 4 kudos
Monday
How to Register & Prepare If you're interested in advancing your skills with Databricks through a Specialist Session, here's a clear guide on how to register and what free courses you can take to prepare effectively. How to Begin Your Learning Path S...
- 3103 Views
- 2 replies
- 9 kudos
10-02-2025
Governing the Full Data Lifecycle: From Ingestion to Insight with Unity Catalog Date: Saturday, December 13 Time: 12:00 PM – 3:00 PM Location: Bengaluru, Karnataka (Register to see address) Registration: Approval required Register Here! About Thi...
- 908 Views
- 1 replies
- 3 kudos
3 weeks ago
Event Details Date: 19 December 2025Time: 6:00 PM – 7:30 PM ISTFormat: Virtual (Online) Marking RSVP on this page will not register your interest for the event. Please use the button below. Unlimited seats — but registration is recommended to recei...
- 925 Views
- 0 replies
- 6 kudos
2 weeks ago
Our Champion program has always celebrated the customers who go above and beyond to engage, help others, and uplift the Community. Recently, we have seen remarkable participation from Bricksters as well—and their impact deserves recognition too. Begi...
- 1218 Views
- 6 replies
- 13 kudos
a month ago
We’re inching toward year-end, And the Community just dropped another week packed with sharp questions and standout wins.If you missed the action, here’s the pulse of everything that made the feed light up Week’s Power Players Spotlight on t...
- 393 Views
- 4 replies
- 4 kudos
a week ago
Community Activity
- 54 Views
- 0 replies
- 0 kudos
Databricks Advent Calendar 2025 #20
As Unity Catalog becomes an enterprise catalog, bring-your-own lineage is one of my favorite features.
- 54 Views
- 0 replies
- 0 kudos
- 62 Views
- 0 replies
- 0 kudos
how to complete connection to snowflake
Hi all,Simple test creating connection to my snowflake trial account was successful, and..Anyway:dbx > external data > connections > create connection > ... > [Test] successful but still see last 2 steps todo (5 access, 6 metadata) but don't see any ...
- 62 Views
- 0 replies
- 0 kudos
- 127 Views
- 1 replies
- 0 kudos
Queries from Serverless compute referring to older/deleted/vacuumed version of the delta tables.
Hi Team,I have a unity catalog based managed delta table which I am able to successfully query using the regular compute/cluster options.But when I try to query the same table using a Serverless/SQL Warehouse, they are referring to an older version /...
- 127 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @s_agarwal Please find below my findinsg for your query. Serverless uses cached Unity Catalog metadata Your UC metadata points to an old Delta version Regular clusters bypass this cache Fix by refreshing or forcing UC metadata rewrite
- 0 kudos
- 126 Views
- 1 replies
- 0 kudos
spark conf for serveless jobs
Hello Guys, I use serveless on databricks Azure, so i have build a decorator which instanciate a SparkSession. My job use autolaoder / kafka using mode availableNow. Someone Knows which spark conf is required beacause i want to add it ? Thanx import...
- 126 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @seefoods Please find below my findings for your case. You don’t need (and can’t meaningfully add) any Spark conf to enable availableNow on Databricks Serverless. Let me explain clearly, and then show what is safe to do in your decorator. availa...
- 0 kudos
- 11553 Views
- 18 replies
- 16 kudos
Free Certification voucher
looking for free certification voucher
- 11553 Views
- 18 replies
- 16 kudos
Latest Reply
- 16 kudos
Hi, can you please provide me free voucher for azure data bricks fundamental
- 16 kudos
- 43514 Views
- 48 replies
- 5 kudos
Resolved! Data Engineer Associate Certification in 2025 Voucher
Hi Community,I’m planning to take the Data Engineer Associate Certification in 2025 to advance my skills and career. Are there any ongoing promotions or opportunities to get a 50% discount voucher for the exam? It would be incredibly helpful if you c...
- 43514 Views
- 48 replies
- 5 kudos
- 266 Views
- 5 replies
- 0 kudos
Read Array of Arrays of Objects JSON file using Spark
Hi Databricks Community! This is my first post in this forum, so I hope you can forgive me if it's not according to the forum best practices After lots of searching, I decided to share the peculiar issue I'm running into in this community.I try to lo...
- 266 Views
- 5 replies
- 0 kudos
Latest Reply
- 0 kudos
I guess I was a bit over enthusiastic by accepting the answer.When I run the following on the single object array of arrays (as shown in the original post) I get a single row with column "value" and value null. from pyspark.sql import functions as F,...
- 0 kudos
- 111 Views
- 0 replies
- 0 kudos
Removing access to Lakehouse and only allowing Databricks One?
Hello, I am trying to set up a user group for business users in our Azure Databricks that will only be able to query data. It looks like Databricks One is the solution to use. So I followed the documentation and granted the user group Consumer Access...
- 111 Views
- 0 replies
- 0 kudos
- 104 Views
- 0 replies
- 0 kudos
Can I create a serverless budget policy via Python SDK on Azure Databricks?
Hi, I am trying to use the Databricks Python SDK (v0.74.0) to automate the creation of budget policies in our Databricks account. See the Python code below where I am trying to create a serverless budget policy. Note the error.When I click the "Diagn...
- 104 Views
- 0 replies
- 0 kudos
- 107 Views
- 0 replies
- 0 kudos
Databricks Advent Calendar 2025 #19
In 2025, Metrics Views are becoming the standard way to define business logic once and reuse it everywhere. Instead of repeating complex SQL, teams can work with clean, consistent metrics.
- 107 Views
- 0 replies
- 0 kudos
- 168 Views
- 1 replies
- 0 kudos
How do I grant access to find a table in Databricks, without giving access to query the table?
Hi!By default it seems users can only see tables and views in Unity Catalog that they have SELECT permission/privilege on. However, we would like to use Unity Catalog as a data catalog of tables we have. They wouldn't then be able to request access t...
- 168 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
@excavator-matt you can grant BROWSE privilege on your catalog to a broad audience (for example, the “All account users” group). This lets users see object metadata (names, comments, lineage, search results, information_schema, etc.) in Catalog Explo...
- 0 kudos
- 143 Views
- 1 replies
- 0 kudos
scroll bar disappears on widgets in dashboards
Databricks newbie.I've created a dashboard that has several widgets to allow users to select multiple values from a drop-down list. When I first open the widget to select the values, there is a scroll bar on the right side of the box which allows me...
- 143 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hello @RichC! You’re not missing any setting here. This is expected behavior. The scrollbar auto-hides after a couple of seconds, but it’s still active. If you start scrolling again (mouse wheel or trackpad), the scrollbar will reappear.
- 0 kudos
- 4583 Views
- 9 replies
- 0 kudos
Databricks apps - Volumes and Workspace - FileNotFound issues
I have a Databricks App I need to integrate with volumes using local python os functions. I've setup a simple test: def __init__(self, config: ObjectStoreConfig): self.config = config # Ensure our required paths are created ...
- 4583 Views
- 9 replies
- 0 kudos
Latest Reply
- 0 kudos
I would also like to see some responses to this problem.
- 0 kudos
- 210 Views
- 7 replies
- 2 kudos
pkgutils walk_packages stopped working in DBR 17.2
Hi,After moving from Databricks runtime 17.1 to 17.2 suddenly my pkgutils walk_packages doesn't identify any packages within my repository anymore.This is my example code:import pkgutil import os packages = pkgutil.walk_packages([os.getcwd()]) print...
- 210 Views
- 7 replies
- 2 kudos
Latest Reply
- 2 kudos
Hey @Maxrb , Just thinking out loud here, but this might be worth experimenting with. You could try using a Unity Catalog Volume as a lightweight package repository. Volumes can act as a secure, governed home for Python wheels (and JARs), and Databri...
- 2 kudos
- 125 Views
- 1 replies
- 0 kudos
Certificate not received even after 5 days of exam completion
Hi Team,I haven't received the digital credentials even after 5 days of completion the data engineer associate certification successfully.Need help on this.Thank you
- 125 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hello @PavanDasa, Please check your spam just in case it went there. If you do not receive your badge in 48 hours, please file a ticket with our support team. Please also provide them with your email address so that they can look up your account (it ...
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2192 | |
| 1214 | |
| 1055 | |
| 950 | |
| 876 |
Latest from our Blog
[PARTNER BLOG] Beyond ADLS Limits: File Arrival Triggers for File Updates
Beyond ADLS Limitations: Making File Arrival Triggers Work for Existing File Updates Using a Flag File MechanismThe Flag File MechanismThe Root Problem: Triggers Only Work on “Create”, Not “Modify” Ev...
AI Newsletter Series (Part 1): Parsing Enterprise PDFs Into AI-Ready Data
Enterprise Account macro trends, strategy doc, account and project updates often end up in PDF format. Meanwhile, usage metrics and account-level signals—such as active users, DBU consumption, and use...
Fine-Grained Access Control in Delta Sharing: Dynamic Views vs Partition Filtering
The Challenge: Sharing Data While Maintaining Privacy Boundaries Imagine you're a global retail company with customer order data spanning multiple regions—North America, Europe, and Asia Pacific. You ...
Integration Testing for Lakeflow Jobs with Pytest and Databricks Connect
Introduction Databricks Lakeflow enables data teams to design and operate data pipelines at scale, where speed and reliability directly influence the time to market for insights. As pipeline complexit...
