cancel
Showing results for 
Search instead for 
Did you mean: 
Community Discussions
Engage in vibrant discussions covering diverse learning topics within the Databricks Community. Explore learning resources, share insights, and collaborate with peers to enhance your skills in data engineering, machine learning, and more.
cancel
Showing results for 
Search instead for 
Did you mean: 

Browse the Community

Certifications

Join dynamic discussions on Databricks certifications within the Community. Exchange insights, tips,...

874 Posts

Training offerings

Explore discussions on Databricks training programs and offerings within the Community. Get insights...

199 Posts

Get Started Discussions

Start your journey with Databricks by joining discussions on getting started guides, tutorials, and ...

2706 Posts

Activity in Community Discussions

saikrishna08
by > Visitor
  • 9 Views
  • 0 replies
  • 0 kudos

Data Engineer Professional Certificate Exam Discount Voucher

HiI am planning to take Databricks Certified Data Engineer Professional Exam. The fee is highly unaffordable for me. I am looking for discount vouchers. Please let me know if there is a way to get discount on the exam.Thank you!RegardsKrishna

  • 9 Views
  • 0 replies
  • 0 kudos
boitumelodikoko
by > Valued Contributor
  • 588 Views
  • 1 replies
  • 3 kudos

Data Engineering Lessons

Getting into the data space can feel overwhelming, with so many tools, terms, and technologies. But after years inExpect failure. Design for it.Jobs will fail. The data will be late. Build systems that can recover gracefully, and continually monitor ...

  • 588 Views
  • 1 replies
  • 3 kudos
Latest Reply
Gecofer
Contributor
  • 3 kudos

Hi @boitumelodikoko A few more principles I always share with people entering the data space:Observability is non-negotiable.If you can’t see what your pipelines are doing, you can’t fix what breaks.Good logging, metrics, and alerts save countless ho...

  • 3 kudos
Poorva21
by > New Contributor
  • 52 Views
  • 1 replies
  • 1 kudos

How realistic is truly end-to-end LLMOps on Databricks?

Databricks is positioning the platform as a full stack for LLM development — from data ingestion → feature/embedding pipelines → fine-tuning (Mosaic AI) → evaluation → deployment (Model Serving) → monitoring (Lakehouse Monitoring).I’m curious about r...

  • 52 Views
  • 1 replies
  • 1 kudos
Latest Reply
Gecofer
Contributor
  • 1 kudos

Hi @Poorva21 In several projects I’ve seen and worked on, Databricks gets you very close to a full end-to-end LLMOps platform, but not completely. It realistically covers most of the lifecycle, but in real production setups you still complement it wi...

  • 1 kudos
Idrisskh
by > New Contributor II
  • 107 Views
  • 2 replies
  • 0 kudos

Gemini video input

Hello,Is it possible to use a video as an input for Google Gemini 2.5 Pro within Databricks?Thank you.

  • 107 Views
  • 2 replies
  • 0 kudos
Latest Reply
Idrisskh
New Contributor II
  • 0 kudos

Do you know when it will be available?

  • 0 kudos
1 More Replies
Hubert-Dudek
by Esteemed Contributor III
  • 21 Views
  • 0 replies
  • 1 kudos

Databricks Advent Calendar 2025 #7

Imagine all a data engineer or analyst needs to do to read from a REST API is use spark.read(), no direct request calls, no manual JSON parsing - just spark .read. That’s the power of a custom Spark Data Source. Soon, we will see a surge of open-sour...

2025_7.png 2025_7.png
  • 21 Views
  • 0 replies
  • 1 kudos
Hubert-Dudek
by Esteemed Contributor III
  • 66 Views
  • 0 replies
  • 1 kudos

Databricks Advent Calendar 2025 #6

DBX is one of the most crucial projects of dblabs this year, and we can expect that more and more great checks from it will be supported natively in databricks. More about dbx on https://databrickslabs.github.io/dqx/

2025_6.png
  • 66 Views
  • 0 replies
  • 1 kudos
n1399
by > New Contributor II
  • 1054 Views
  • 2 replies
  • 0 kudos

On Demand Pool Configuration & Policy definition

I'm using Job cluster and created compute policies for library management and now I'm trying to use pools in databricks. I'm getting error like this : Cluster validation error: Validation failed for azure_attributes.spot_bid_max_price from pool, the ...

  • 1054 Views
  • 2 replies
  • 0 kudos
Latest Reply
Poorva21
New Contributor
  • 0 kudos

This error occurs because instance pools require a concrete spot bid max price value, even if the cluster policy marks it as unlimited. Set an explicit value (e.g., 100) directly in the instance pool configuration, or switch the pool to on-demand nod...

  • 0 kudos
1 More Replies
mrstevegross
by > Contributor III
  • 5044 Views
  • 2 replies
  • 2 kudos

How to resolve "cannot import name 'Iterable' from 'collections'" error?

I'm running a DBR/Spark job using a container. I've set docker_image.url to `docker.io/databricksruntime/standard:13.3-LTS`, as well as the Spark env var `DATABRICKS_RUNTIME_VERSION=13.3`. At runtime, however, I'm encountering this error: ImportError...

  • 5044 Views
  • 2 replies
  • 2 kudos
Latest Reply
Poorva21
New Contributor
  • 2 kudos

Go to Compute → Your Cluster / Job ComputeChange Databricks Runtime to:Databricks Runtime 13.3 LTSRe-run your job with the same container.

  • 2 kudos
1 More Replies
Eswariy
by > New Contributor
  • 61 Views
  • 0 replies
  • 0 kudos

Request to reschedule Databricks Certified Generative AI Engineer Associate

I am writing to request assistance with rescheduling my exam for the Databricks Certified Generative AI Engineer Associate certification. My exam was originally scheduled for Today at 7:30 PM. However, when I attempted to access the exam, the Webasse...

  • 61 Views
  • 0 replies
  • 0 kudos
Marlingomez
by > New Contributor
  • 72 Views
  • 0 replies
  • 0 kudos

Databricks Certified Data Engineer Professional Scenario Question

Hey everyone, I’m currently on my journey to prepare for the Databricks Certified Data Engineer Professional exam and have been exploring multiple resources, including Databricks documentation, hands-on labs, and practice exercises. Midway through my...

  • 72 Views
  • 0 replies
  • 0 kudos
steveKris
by > New Contributor
  • 156 Views
  • 6 replies
  • 4 kudos

Extract all users from Databricks Groups

Hey everyone,we are trying to get an overview of all users that we have in our databricks groups. We have tried to do so with the REST API as well as the SQL-queries (with normal developer accounts as well as workspace administrator accounts). The pr...

  • 156 Views
  • 6 replies
  • 4 kudos
Latest Reply
Poorva21
New Contributor
  • 4 kudos

Use the Databricks SQL system users tableSELECT * FROM system.usersOnly shows fully provisioned users Users pending invitation may not appear.

  • 4 kudos
5 More Replies
Gokkul007
by > New Contributor
  • 127 Views
  • 2 replies
  • 1 kudos

How to create a lakebase table ?

Hi databricks community, I want to create a lakebase table that is synced with the delta table . So whenever the delta table is updated the changes should be available in lakebase table.  Now I want to create a databricks streamlit application and ma...

  • 127 Views
  • 2 replies
  • 1 kudos
Latest Reply
Poorva21
New Contributor
  • 1 kudos

Yes, it’s possible to have a Lakehouse table synced with a Delta table in Unity Catalog. You have a few options:Direct read: Register the Delta table in Unity Catalog and query it directly from your Streamlit app.Delta Live Tables (DLT): Create a DLT...

  • 1 kudos
1 More Replies
Hubert-Dudek
by Esteemed Contributor III
  • 60 Views
  • 1 replies
  • 1 kudos

Databricks Advent Calendar 2025 #5

When something goes wrong, and your pattern is doing MERGEs per day in your jobs, backfill jobs will help you to reload many days in one shot.

2025_5.png
  • 60 Views
  • 1 replies
  • 1 kudos
Latest Reply
Raman_Unifeye
Contributor III
  • 1 kudos

Full link of the actual blog for reference - https://www.databricks.com/blog/announcing-backfill-runs-lakeflow-jobs-higher-quality-downstream-data 

  • 1 kudos
tarunnagar
by > Contributor
  • 66 Views
  • 1 replies
  • 0 kudos

How to Connect Databricks with Web and Mobile Apps

Hi everyone,I’m exploring ways to leverage Databricks for building data-driven web and mobile applications and wanted to get some insights from this community. Databricks is great for processing large datasets, running analytics, and building machine...

  • 66 Views
  • 1 replies
  • 0 kudos
Latest Reply
jameswood32
New Contributor III
  • 0 kudos

To connect Databricks with web or mobile apps, most developers recommend exposing your data or models through a lightweight API layer. Use Databricks SQL Endpoints or MLflow model serving to generate secure REST endpoints your app can call directly. ...

  • 0 kudos
Hubert-Dudek
by Esteemed Contributor III
  • 140 Views
  • 1 replies
  • 4 kudos

Databricks Advent Calendar 2025

With the first day of December comes the first window of our Databricks Advent Calendar. It’s a perfect time to look back at this year’s biggest achievements and surprises — and to dream about the new “presents” the platform may bring us next year. ...

2025_1.png 2025_2.png
  • 140 Views
  • 1 replies
  • 4 kudos
Latest Reply
Advika
Databricks Employee
  • 4 kudos

Fantastic kickoff to the Databricks Advent Calendar 2025 , appreciate you steering the series, @Hubert-Dudek!

  • 4 kudos