cancel
Showing results for 
Search instead for 
Did you mean: 
Community Discussions
Engage in vibrant discussions covering diverse learning topics within the Databricks Community. Explore learning resources, share insights, and collaborate with peers to enhance your skills in data engineering, machine learning, and more.
cancel
Showing results for 
Search instead for 
Did you mean: 

Browse the Community

Certifications

Join dynamic discussions on Databricks certifications within the Community. Exchange insights, tips,...

828 Posts

Training offerings

Explore discussions on Databricks training programs and offerings within the Community. Get insights...

185 Posts

Get Started Discussions

Start your journey with Databricks by joining discussions on getting started guides, tutorials, and ...

2651 Posts

Databricks Free Trial Help

Engage in discussions about the Databricks Free Trial within the Databricks Community. Share insight...

109 Posts

Activity in Community Discussions

YuriS
by > New Contributor II
  • 253 Views
  • 2 replies
  • 1 kudos

Resolved! How to reduce data loss for Delta Lake on Azure when failing from primary to secondary regions?

Let’s say we have big data application where data loss is not an option.Having GZRS (geo-zone-redundant storage) redundancy we would achieve zero data loss if primary region is alive – writer is waiting for acks from two or more Azure availability zo...

  • 253 Views
  • 2 replies
  • 1 kudos
Latest Reply
YuriS
New Contributor II
  • 1 kudos

@mark_ott Mark, thank you for so detailed response.We are currently evaluating two approaches for seamless, lossless failover with full integrity in stateless streaming scenarios.  1) Parse Databricks Offsets files and2) Enable row trackingthat we’ve...

  • 1 kudos
1 More Replies
Rezakorehi
by > New Contributor II
  • 358 Views
  • 6 replies
  • 10 kudos

Unity catalogues - What would you do

If you were creating Unity Catalogs again, what would you do differently based on your past experience?

  • 358 Views
  • 6 replies
  • 10 kudos
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 10 kudos

@szymon_dybczak, I recently heard about a use case where the company is automatically creating a new catalog for every employee... but of course I agree with you. 

  • 10 kudos
5 More Replies
VamsiDatabricks
by > New Contributor
  • 60 Views
  • 2 replies
  • 1 kudos

Delta comparison architecture using flatMapGroupsWithState in Structured Streaming

 I am designing structured streaming job in Azure data bricks(using Scala) which will consume messages from two event hubs, lets call them source and target.I would like your feedback on below flow, whether it is will survive the production load and ...

  • 60 Views
  • 2 replies
  • 1 kudos
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 1 kudos

It is hard to understand what the source is and what the target is. Some charts could be useful. Also, information on how long the state is kept. My solution usually is:- Use declarative lakeflow pipelines if possible (dlt) - if not, consider handlin...

  • 1 kudos
1 More Replies
kasinathanrames
by > New Contributor
  • 4587 Views
  • 8 replies
  • 13 kudos

Free Certification voucher

looking for free certification voucher

  • 4587 Views
  • 8 replies
  • 13 kudos
Latest Reply
ajay0861
New Contributor II
  • 13 kudos

how to get 50% free voucher

  • 13 kudos
7 More Replies
Cert-Team
by Databricks Employee
  • 17618 Views
  • 1 replies
  • 2 kudos

Minimize the risk of your exam getting suspended - Tip #1

The number one cause of exam suspensions is loss of video feed. This is often because your computer is not set up right for taking an online proctored exam. Before launching an exam, make sure the computer you are using meets the technical requiremen...

  • 17618 Views
  • 1 replies
  • 2 kudos
Latest Reply
ava951rob
New Contributor
  • 2 kudos

Hello,That's a great tip! Losing video feed sounds like a major headache. I'll definitely run the Kryterion System Check a few days before my online proctored exam to make sure my setup is good to go.

  • 2 kudos
Mailendiran
by > New Contributor III
  • 248 Views
  • 6 replies
  • 4 kudos

Resolved! Databricks partner Tech Summit FY26 access

I'm trying to access the recordings of Partner Tech Summit FY26 which happened a month back. It says lobby is closed.Is there any other way i can access the recordings. I'm yet to watch the day 2 sessions.

  • 248 Views
  • 6 replies
  • 4 kudos
Latest Reply
Mailendiran
New Contributor III
  • 4 kudos

Hi @saurabh18cs , check link shared by @Advika . Make sure you are logged in using partner account.Link - https://partner-academy.databricks.com/learn/catalog/view/168SS: 

  • 4 kudos
5 More Replies
egor
by > New Contributor
  • 214 Views
  • 4 replies
  • 5 kudos

serialized_dashboard

I have a dashboard.json file, for example: {select * from ${{var.table_name}}}. I have job.yml and section serialized_dashboard there? bcs my job runs parallel with dashboard. Can I use variables in databrics.yml if I define the table_variable variab...

  • 214 Views
  • 4 replies
  • 5 kudos
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 5 kudos

I currently use the parameter inside IDENTIFIER(:schema || 'my_table') and the 'bundle scripts' feature to perform substitutions, but I hope for better support soon.

  • 5 kudos
3 More Replies
guidotognini
by > New Contributor
  • 96 Views
  • 1 replies
  • 0 kudos

Missed the certification exam schedule - Reschedule is required

Hi Team, @data_help @helpdesk I have missed the certification exam schedule. I thought it is 8h15PM instead of 8h15AM. Is there a possibility this can be reschedule to today anytime or tomorrow?Thanks in advance for your comments.Regards,Guido Tognin...

  • 96 Views
  • 1 replies
  • 0 kudos
Latest Reply
cert-ops
Databricks Employee
  • 0 kudos

Hello @guidotognini,Sorry to hear you missed your exam window. Please file a ticket with our support team so they can review the case and determine next steps.Thanks & Regards,@cert-ops

  • 0 kudos
BenBricks
by > New Contributor III
  • 214 Views
  • 4 replies
  • 4 kudos

Resolved! Need help understanding Databricks

Hi,I come from a traditional ETL background and am having trouble understanding some of the cloud hyper scalar features and use cases.I understand Databricks is hosted on a cloud providers. I see the cloud providers have their own tools for ETL, ML/A...

  • 214 Views
  • 4 replies
  • 4 kudos
Latest Reply
BenBricks
New Contributor III
  • 4 kudos

Thanks a lot Gema. For the detailed and meticulous answers.I guess I have to unlearn and relearn everything starting today. 

  • 4 kudos
3 More Replies
pgopi
by > New Contributor
  • 110 Views
  • 1 replies
  • 0 kudos

Need help in how to switch the from PDF slides to videos

Hi Everyone,I’m currently preparing for the Databricks Data Engineer Associate certification. I’m able to view the PDF slides, but I’m not able to access the videos. Could someone please suggest how to switch from the PDF slides to the video lessons?...

  • 110 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Databricks Employee
  • 0 kudos

Hello @pgopi! Databricks Academy is transitioning its self‑paced content from video lessons to PDF slides. If you’d like a more interactive experience with video lectures and live Q&A, I recommend the instructor‑led “Data Engineering with Databricks”...

  • 0 kudos
r_ramsen
by > New Contributor
  • 147 Views
  • 1 replies
  • 0 kudos

Databricks exam got suspended , Need urgent help

Hello Team , I faced few challenges while attempting my certification exam , the exam got paused two times when approximately 11 minutes were left for my exam to get over. I got a pop-up message which contained the message "There's eye movement". The...

  • 147 Views
  • 1 replies
  • 0 kudos
Latest Reply
cert-ops
Databricks Employee
  • 0 kudos

Hello @r_ramsen ,Thank you for filing a ticket with our support team, Support team will respond shortly. Please note that we cannot provide support or handle exam suspensions via community (it is not advised that you post your email address here in c...

  • 0 kudos
Akhil_O
by > New Contributor
  • 130 Views
  • 1 replies
  • 0 kudos

Exam Time Mismatch – Unable to Attend Scheduled Certification

Re: #00757843 I had scheduled my Databricks [Databricks Certified Data Analyst Associate] certification exam for 12 October 2025 at 4:00 PM IST. However, when I checked today, the system showed my exam time as 4:00H IST. Because of this discrepancy, ...

  • 130 Views
  • 1 replies
  • 0 kudos
Latest Reply
cert-ops
Databricks Employee
  • 0 kudos

Hello @Akhil_O,Sorry to hear you missed your exam window. Thank you for filling the ticket with our support team so they can review the case and determine next steps. Please note that we cannot provide support via community.Thanks & Regards, @cert-op...

  • 0 kudos
Manishkumar_79
by > New Contributor
  • 1307 Views
  • 1 replies
  • 1 kudos

Certification

Dear Databricks Team and Community,I am currently preparing for the Databricks Certified Data Engineer Associate exam and kindly request assistance in obtaining a certification voucher.Your support would be invaluable to help me advance my expertise ...

  • 1307 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @Manishkumar_79 ,I have good news for you. Virtual Learning Festival just started - ️ Users who complete at least one self-paced learning pathway within Customer Academy between October 10 and October 31 will receive the following incentives: - 50...

  • 1 kudos
Carlton
by > Contributor II
  • 187 Views
  • 2 replies
  • 1 kudos

Resolved! Are Clusters Available Databricks Free Edition

Hi Community,Can someone let me know if its possible to create compute clusters in Databricks Free Edition. It was available in the old Databricks Community Edition.This is quite important as a lot of my code relies on spark executions.

  • 187 Views
  • 2 replies
  • 1 kudos
Latest Reply
Carlton
Contributor II
  • 1 kudos

Hello Community,Can I get your thoughts on this question please?

  • 1 kudos
1 More Replies
rcostanza
by > New Contributor III
  • 350 Views
  • 5 replies
  • 3 kudos

Resolved! Stateless streaming with aggregations on a DLT/Lakeflow pipeline

In a DLT pipeline I have a bronze table that ingest files using Autoloader, and a derived silver table that, for this example, just stores the number of rows for each file ingested into bronze. The basic code example: import dlt from pyspark.sql impo...

  • 350 Views
  • 5 replies
  • 3 kudos
Latest Reply
mark_ott
Databricks Employee
  • 3 kudos

For scenarios in Databricks where lower latency is needed for Silver tables but continuous streaming pipelines are not feasible, using jobs or notebooks with foreachBatch running in Structured Streaming mode is a common and recommended approach. This...

  • 3 kudos
4 More Replies