cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 
PSA: Community Edition retires on January 1, 2026. Move to the Free Edition today to keep your work.

Databricks Free Edition is the new home for personal learning and exploration on Databricks. It’s perpetually free and built on modern Databricks - the same Data Intelligence Platform used by professionals. Free Edition lets you learn professional da...

  • 396 Views
  • 0 replies
  • 4 kudos
Monday
🎤 Call for Presentations: Data + AI Summit 2026 is Open!

June 15–18, 2026 Are you building the future with data and AI? Then this is your moment. The Call for Proposals for Data + AI Summit 2026 is officially open, and we want to hear from builders, practitioners, and innovators across the data and AI com...

  • 727 Views
  • 2 replies
  • 4 kudos
Monday
Last Chance: Help Shape the 2026 Data + AI Summit | Win a Full Conference Pass

Your voice matters to us. We are planning the 2026 Data + AI Summit, and we’d love your input on what would make the experience even more valuable for you. Take a few minutes to share your feedback through our quick survey — your insights directly in...

  • 359 Views
  • 3 replies
  • 4 kudos
Monday
Level Up with Databricks Specialist Sessions

How to Register & Prepare If you're interested in advancing your skills with Databricks through a Specialist Session, here's a clear guide on how to register and what free courses you can take to prepare effectively. How to Begin Your Learning Path S...

  • 3060 Views
  • 2 replies
  • 9 kudos
10-02-2025
Lakehouse, Lagers & Legends — Bangalore Meetup | December 13

Governing the Full Data Lifecycle: From Ingestion to Insight with Unity Catalog Date: Saturday, December 13 Time: 12:00 PM – 3:00 PM Location: Bengaluru, Karnataka (Register to see address) Registration: Approval required Register Here! About Thi...

  • 870 Views
  • 1 replies
  • 3 kudos
2 weeks ago
Jaipur Usergroup First Virtual Meetup: AI/BI Genie + Data Science Careers — 19 Dec | 6 PM IST

Event Details Date: 19 December 2025Time: 6:00 PM – 7:30 PM ISTFormat: Virtual (Online) Marking RSVP on this page will not register your interest for the event. Please use the button below. Unlimited seats — but registration is recommended to recei...

  • 885 Views
  • 0 replies
  • 6 kudos
2 weeks ago
Celebrating Our First Brickster Champion: Louis Frolio

Our Champion program has always celebrated the customers who go above and beyond to engage, help others, and uplift the Community. Recently, we have seen remarkable participation from Bricksters as well—and their impact deserves recognition too. Begi...

  • 1176 Views
  • 6 replies
  • 13 kudos
a month ago
🌟 Community Pulse: Your Weekly Roundup! December 05 – 11, 2025

We’re inching toward year-end, And the Community just dropped another week packed with sharp questions and standout wins.If you missed the action, here’s the pulse of everything that made the feed light up   Week’s Power Players      Spotlight on t...

  • 349 Views
  • 4 replies
  • 4 kudos
a week ago

Community Activity

ScottH
by > New Contributor III
  • 3 Views
  • 0 replies
  • 0 kudos

Can I create a serverless budget policy via Python SDK on Azure Databricks?

Hi, I am trying to use the Databricks Python SDK (v0.74.0) to automate the creation of budget policies in our Databricks account. See the Python code below where I am trying to create a serverless budget policy. Note the error.When I click the "Diagn...

ScottH_0-1766168891911.png
  • 3 Views
  • 0 replies
  • 0 kudos
Hubert-Dudek
by Databricks MVP
  • 8 Views
  • 0 replies
  • 0 kudos

Databricks Advent Calendar 2025 #19

In 2025, Metrics Views are becoming the standard way to define business logic once and reuse it everywhere. Instead of repeating complex SQL, teams can work with clean, consistent metrics.

202519.png
  • 8 Views
  • 0 replies
  • 0 kudos
excavator-matt
by > Contributor
  • 95 Views
  • 1 replies
  • 0 kudos

How do I grant access to find a table in Databricks, without giving access to query the table?

Hi!By default it seems users can only see tables and views in Unity Catalog that they have SELECT permission/privilege on. However, we would like to use Unity Catalog as a data catalog of tables we have. They wouldn't then be able to request access t...

Data Governance
permission
privilege
Unity Catalog
  • 95 Views
  • 1 replies
  • 0 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 0 kudos

@excavator-matt you can grant BROWSE privilege on your catalog to a broad audience (for example, the “All account users” group). This lets users see object metadata (names, comments, lineage, search results, information_schema, etc.) in Catalog Explo...

  • 0 kudos
RichC
by > Visitor
  • 22 Views
  • 1 replies
  • 0 kudos

scroll bar disappears on widgets in dashboards

Databricks newbie.I've created a dashboard that has several widgets to allow users to select multiple values from a drop-down list.  When I first open the widget to select the values, there is a scroll bar on the right side of the box which allows me...

  • 22 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Community Manager
  • 0 kudos

Hello @RichC! You’re not missing any setting here. This is expected behavior. The scrollbar auto-hides after a couple of seconds, but it’s still active. If you start scrolling again (mouse wheel or trackpad), the scrollbar will reappear.

  • 0 kudos
lance-gliser
by > New Contributor
  • 4481 Views
  • 9 replies
  • 0 kudos

Databricks apps - Volumes and Workspace - FileNotFound issues

I have a Databricks App I need to integrate with volumes using local python os functions. I've setup a simple test:  def __init__(self, config: ObjectStoreConfig): self.config = config # Ensure our required paths are created ...

  • 4481 Views
  • 9 replies
  • 0 kudos
Latest Reply
SarahA
New Contributor II
  • 0 kudos

I would also like to see some responses to this problem.

  • 0 kudos
8 More Replies
Maxrb
by > New Contributor
  • 118 Views
  • 7 replies
  • 2 kudos

pkgutils walk_packages stopped working in DBR 17.2

Hi,After moving from Databricks runtime 17.1 to 17.2 suddenly my pkgutils walk_packages doesn't identify any packages within my repository anymore.This is my example code:import pkgutil import os packages = pkgutil.walk_packages([os.getcwd()]) print...

  • 118 Views
  • 7 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

Hey @Maxrb , Just thinking out loud here, but this might be worth experimenting with. You could try using a Unity Catalog Volume as a lightweight package repository. Volumes can act as a secure, governed home for Python wheels (and JARs), and Databri...

  • 2 kudos
6 More Replies
PavanDasa
by > Visitor
  • 25 Views
  • 1 replies
  • 0 kudos

Certificate not received even after 5 days of exam completion

Hi Team,I haven't received the digital credentials even after 5 days of completion the data engineer associate certification successfully.Need help on this.Thank you

  • 25 Views
  • 1 replies
  • 0 kudos
Latest Reply
cert-ops
Databricks Employee
  • 0 kudos

Hello @PavanDasa, Please check your spam just in case it went there. If you do not receive your badge in 48 hours, please file a ticket with our support team. Please also provide them with your email address so that they can look up your account (it ...

  • 0 kudos
Joost1024
by > New Contributor
  • 154 Views
  • 4 replies
  • 0 kudos

Read Array of Arrays of Objects JSON file using Spark

Hi Databricks Community! This is my first post in this forum, so I hope you can forgive me if it's not according to the forum best practices After lots of searching, I decided to share the peculiar issue I'm running into in this community.I try to lo...

  • 154 Views
  • 4 replies
  • 0 kudos
Latest Reply
Joost1024
New Contributor
  • 0 kudos

I guess I was a bit over enthusiastic by accepting the answer.When I run the following on the single object array of arrays (as shown in the original post) I get a single row with column "value" and value null. from pyspark.sql import functions as F,...

  • 0 kudos
3 More Replies
jpassaro
by > Visitor
  • 61 Views
  • 1 replies
  • 0 kudos

does databricks respect parallel vacuum setting?

I am trying to run VACUUM on a delta table that i know has millions of obselete files.out of the box, VACUUM runs the deletes in sequence on the driver. that is bad news for me!According to OSS delta docs, the setting spark.databricks.delta.vacuum.pa...

  • 61 Views
  • 1 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Greetings @jpassaro ,  Thanks for laying out the context and the links. Let me clarify what’s actually happening here and how I’d recommend moving forward. Short answer No. On Databricks Runtime, the spark.databricks.delta.vacuum.parallelDelete.enabl...

  • 0 kudos
Kesavan31
by New Contributor II
  • 269 Views
  • 2 replies
  • 4 kudos

[PARTNER BLOG] Beyond ADLS Limits: File Arrival Triggers for File Updates

Beyond ADLS Limitations: Making File Arrival Triggers Work for Existing File Updates Using a Flag File MechanismThe Flag File MechanismThe Root Problem: Triggers Only Work on “Create”, Not “Modify” EventsWhy This Limitation Matters in Real Data Platf...

Architecture_image_front.png csv_to_delta_home_image.jpg CI_CD_Home.png CI_CD_automation.png
  • 269 Views
  • 2 replies
  • 4 kudos
Latest Reply
Kesavan31
New Contributor II
  • 4 kudos

Thank you, @Louis_Frolio   - I really appreciate the thoughtful feedback.The intent was exactly as you described: lean into the platform’s event-driven design and build a deterministic, production-safe pattern around it.The delete and reintroduce ins...

  • 4 kudos
1 More Replies
piotrsofts
by > Contributor
  • 102 Views
  • 4 replies
  • 2 kudos

Accessing Knowledge Base from Databricks One

Is it possible to use Knowledge Assistant from Databricks one ? 

  • 102 Views
  • 4 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

@piotrsofts , if you are happy please accept as a solution so others can be confident in the approach.  Cheers, Louis.

  • 2 kudos
3 More Replies
Anonym40
by > New Contributor II
  • 25 Views
  • 2 replies
  • 1 kudos

Ingesting data from APIs

Hi, I need to ingest some data available at API endpoint. I was thinking of this option - 1. make API call from Notebook and save data to ADLS2. use AutoLoader to load data from ADLS location. But then, i have some doubts - like I can directly write ...

  • 25 Views
  • 2 replies
  • 1 kudos
Latest Reply
Raman_Unifeye
Contributor III
  • 1 kudos

@Anonym40 - its generally a good idea to break the direct API calls to your rest of the data pipeline. By staging the data to ADLS, you are protecting your downstream to upstream processes and getting more restartability/maintenance in your e2e flow....

  • 1 kudos
1 More Replies
simenheg
by > Visitor
  • 60 Views
  • 3 replies
  • 1 kudos

Tracing SQL costs

Hello, Databricks community!In our Account Usage Dashboard, the biggest portion of our costs are labeled simply "SQL".We want to drill deeper to see where the SQL costs are coming from.By querying the `system.usage.billing` table we see that it's mos...

  • 60 Views
  • 3 replies
  • 1 kudos
Latest Reply
Raman_Unifeye
Contributor III
  • 1 kudos

@simenheg - first of all, It’s not an error as Serverls SQL often produces null metadata fields.So you will need to follow below steps for the costUse SQL Warehouse Query Historyjoin billing data with SQL query history - system.billing.usage.usage_da...

  • 1 kudos
2 More Replies
ymmmm
by > New Contributor
  • 77 Views
  • 6 replies
  • 1 kudos

Account reset and loss of access to paid Databricks Academy Labs subscription

Hello,I am facing an issue with my Databricks Academy account.During a normal sign-in using my usual email address, I was asked to re-enter my first and last name, as if my account was being created again. After that, my account appeared to be reset,...

  • 77 Views
  • 6 replies
  • 1 kudos
Latest Reply
ymmmm
New Contributor
  • 1 kudos

Thank you for your support and tour help

  • 1 kudos
5 More Replies
jlancaster86
by > New Contributor
  • 247 Views
  • 3 replies
  • 2 kudos

Can't find zip file for "Get Started with Databricks Free Edition"

Hi, all. I'm getting stuck on the second step of the "Get Started with Databricks Free Edition" course. It's obviously instructing me to download a zip file from a GitHub repository, but there is no link provided for the repository. What am I missing...

  • 247 Views
  • 3 replies
  • 2 kudos
Latest Reply
Advika
Community Manager
  • 2 kudos

Update: The course instructions have now been updated. You can find the required ZIP file in the Repository section at the bottom of the lesson page.Apologies for the inconvenience, @jlancaster86 & @zwilk.

  • 2 kudos
2 More Replies
Welcome to the Databricks Community!

Once you are logged in, you will be ready to post content, ask questions, participate in discussions, earn badges and more.

Spend a few minutes exploring Get Started Resources, Learning Paths, Certifications, and Platform Discussions.

Connect with peers through User Groups and stay updated by subscribing to Events. We are excited to see you engage!

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Top Kudoed Authors
Read Databricks Data Intelligence Platform reviews on G2

Latest from our Blog