cancel
Showing results for 
Search instead for 
Did you mean: 
Community Discussions
Engage in vibrant discussions covering diverse learning topics within the Databricks Community. Explore learning resources, share insights, and collaborate with peers to enhance your skills in data engineering, machine learning, and more.
cancel
Showing results for 
Search instead for 
Did you mean: 

Browse the Community

Certifications

Join dynamic discussions on Databricks certifications within the Community. Exchange insights, tips,...

816 Posts

Training offerings

Explore discussions on Databricks training programs and offerings within the Community. Get insights...

181 Posts

Get Started Discussions

Start your journey with Databricks by joining discussions on getting started guides, tutorials, and ...

2632 Posts

Databricks Free Trial Help

Engage in discussions about the Databricks Free Trial within the Databricks Community. Share insight...

106 Posts

Activity in Community Discussions

tech07
by > Visitor
  • 18 Views
  • 2 replies
  • 1 kudos

My exam got auto-suspneded during Launch - Databricks Certified Generative AI Engineer Associate

Hi Team,My exam got suspended during camera check while Launching the exam on 28th September, 2025. I filled up the form and reached out to the support team. Today, after more than 2 days, I have received email saying that exam was suspended due to n...

  • 18 Views
  • 2 replies
  • 1 kudos
Latest Reply
tech07
Visitor
  • 1 kudos

Yes, I raised the ticket using the above link regarding my exam suspension. The response mentioned that the Respondus software detected malware related to remote access on my device. However, I do not have any such software installed on my MacBook, s...

  • 1 kudos
1 More Replies
fiverrpromotion
by > New Contributor
  • 1110 Views
  • 1 replies
  • 0 kudos

Addressing Memory Constraints in Scaling XGBoost and LGBM: A Comprehensive Approach for High-Volume

Scaling XGBoost and LightGBM models to handle exceptionally large datasets—those comprising billions to tens of billions of rows—presents a formidable computational challenge, particularly when constrained by the limitations of in-memory processing o...

  • 1110 Views
  • 1 replies
  • 0 kudos
Latest Reply
jamesl
Databricks Employee
  • 0 kudos

Hi @fiverrpromotion, As you mention, scaling XGBoost and LightGBM for massive datasets has its challenges, especially when trying to preserve critical training capabilities such as early stopping and handling of sparse features / high-cardinality cat...

  • 0 kudos
masab019
by > New Contributor
  • 40 Views
  • 1 replies
  • 0 kudos

Got No such file or directory error while serving the endpoint

Hello Everyone!I'm using Databricks for my MLOps learning, and I'm following the tutorial, and I got an error while serving the endpoint. I need help in this.Problem Overview:I have created a basic LightGBM model and logged it in the Unity Catalog. T...

  • 40 Views
  • 1 replies
  • 0 kudos
Latest Reply
sevin91580
Visitor
  • 0 kudos

Hello!The error OSError: No such file or directory: '/model/artifacts' usually means your PyFunc model is missing required files during deployment. Make sure you’ve logged the model correctly with all necessary artifacts, and that your custom wrapper...

  • 0 kudos
JavierS
by > New Contributor
  • 1123 Views
  • 1 replies
  • 0 kudos

Problem with ray train and Databricks Notebook (Strange dbutils error)

Hi everyone,I'm running some code to train a multimodal Hugging Face model with SFTTrainer and TorchTrainer to use all GPU workers. When trying to execute trainer.fit() it gives me a dbutils serialization error,even I am not using dbutils directly in...

Get Started Discussions
AIR
Databricks
DeepLearning
Distributed
ray
  • 1123 Views
  • 1 replies
  • 0 kudos
Latest Reply
sarahbhord
Databricks Employee
  • 0 kudos

JavierS -  The dbutils serialization error occurs in your code because dbutils is only available on the Databricks driver node and cannot be pickled or transferred to Spark or Ray worker nodes. This error can appear even if your code doesn't directly...

  • 0 kudos
AKUMAR_DEngg
by > New Contributor II
  • 475 Views
  • 1 replies
  • 1 kudos

Passedd the DBX Associate Engineer Exam. Not yet received certificate

DBX Certification Department, Hello Team,I cleared my certification exam, Databricks Certified Data Engineer Associate on March 01, 2025.  Still have not received the certificate, more than 48hrs now. Can I please get an update on when I should recei...

Certifications
@Data Engineering
  • 475 Views
  • 1 replies
  • 1 kudos
Latest Reply
Advika
Databricks Employee
  • 1 kudos

Hello @AKUMAR_DEngg! Could you please check your spam or junk folder? It is possible the Certification email may have been routed there.Since it has been over 48 hours, we recommend that you submit a ticket with the Databricks Support team.

  • 1 kudos
Cert-Team
by Databricks Employee
  • 75395 Views
  • 201 replies
  • 17 kudos

Suspended Exam? Don't worry! Our support team can help!

Taking exams is so stressful already, and if your exam gets suspended it is extra stressful. Don't worry! Our support team is awesome and will help you get back on track. The most important step is to file a ticket in our Help Center. Be sure to inc...

  • 75395 Views
  • 201 replies
  • 17 kudos
Latest Reply
CA-kroW
New Contributor II
  • 17 kudos

Hi @Cert-Team @cert-ops ,My exam was suspended due to eye movement. I want to clarify that my eye movements were only from reading the questions and answer options. I did not engage in any malpractice.Kindly review my case and allow my exam attempt t...

  • 17 kudos
200 More Replies
Remy
by > New Contributor II
  • 593 Views
  • 2 replies
  • 2 kudos

Questions about the Knowledge Assistant during agentBrick

hello.I'm testing agentBricks right now. As I'm testing, I have a few questions that I'd like to ask.1) Is it possible to input the schema in a format with input and output?2) In the free trial, when I create a vector search index and utilize it as a...

  • 593 Views
  • 2 replies
  • 2 kudos
Latest Reply
Martser
New Contributor II
  • 2 kudos

Did you ever figure this out? Also running intoVector index type DIRECT_ACCESS is not supported for this workspace.

  • 2 kudos
1 More Replies
JaydeepKhatri
by > New Contributor II
  • 485 Views
  • 2 replies
  • 1 kudos

Using merge Schema with spark.read.csv for inconsistent schemas

The Problem:A common data engineering challenge is reading a directory of CSV files where the schemas are inconsistent. For example, some files might have columns in a different order, or be missing certain columns altogether. The standard behavior o...

  • 485 Views
  • 2 replies
  • 1 kudos
Latest Reply
BigRoux
Databricks Employee
  • 1 kudos

  Hey @JaydeepKhatri  here are some helpful points to consider: Is this an officially supported, enhanced feature of the Databricks CSV reader? Based on internal research, this appears to be an undocumented “feature” of Spark running on Databricks. ...

  • 1 kudos
1 More Replies
mohan6
by > New Contributor
  • 1834 Views
  • 1 replies
  • 0 kudos

Exam Suspended

Hi @Cert-Team/support team My Associate Data Engineer exam was scheduled to start at 3:15 PM. After about 30 minutes, I faced multiple interruptions and challenges while attempting my certification.The exam got paused due to a video issue, and It was...

  • 1834 Views
  • 1 replies
  • 0 kudos
Latest Reply
cert-ops
Databricks Employee
  • 0 kudos

Hello @mohan6 ,Thank you for filing a ticket with our support team, Support team will respond shortly. Please note that we cannot provide support or handle exam suspensions via community.Thanks & Regards,@cert-ops

  • 0 kudos
Sanjay_12
by > New Contributor
  • 2340 Views
  • 2 replies
  • 0 kudos

Suspended Exam

Hi Team, my exam is suspended but it was because I got call and it was important, so I had to pick it during taking the exam and there was no one with me since phone was in picture my exam was suspended.My email id -  sanjay.subramanian@mathco.comExa...

  • 2340 Views
  • 2 replies
  • 0 kudos
Latest Reply
Sanjay_12
New Contributor
  • 0 kudos

This is request I have raised for rescheduling my exam - #00747589

  • 0 kudos
1 More Replies
MadelynM
by Databricks Employee
  • 3805 Views
  • 10 replies
  • 0 kudos

Who's hiring? Latest Job Postings from the Databricks Community!

More than 10,000 organizations worldwide — including Block, Comcast, Condé Nast, Rivian, Shell and over 60% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to take control of their data and put it to work with AI. Use this thre...

  • 3805 Views
  • 10 replies
  • 0 kudos
Latest Reply
Ashwini23
New Contributor
  • 0 kudos

Job Title - Engineering Data Analyst LeadCompany name- Wartsila Location - Mumbai Required years of experience- 8 years Link to apply - https://careers.wartsila.com/job-invite/46999/Job description;ResponsibilitiesTransform raw data into meaningful i...

  • 0 kudos
9 More Replies
Phani1
by > Valued Contributor II
  • 3159 Views
  • 5 replies
  • 0 kudos

Talend ETL code to Databricks

Hi Team,What is the best way to transfer Talend ETL code to Databricks and what are the best methods/practices for migrating Talend ETL's to Databricks (notebook, code conversion/migration strategy, workflow's etc)?Regards,Janga

  • 3159 Views
  • 5 replies
  • 0 kudos
Latest Reply
vamsi_simbus
New Contributor II
  • 0 kudos

Hi @Phani1 ,Were you able to complete the migration from Talend to Databricks? If yes, please do let me know the process / tools that you have used for the migration and the challenges that you have encountered. ThanksVamsi.

  • 0 kudos
4 More Replies
anipar
by > New Contributor
  • 172 Views
  • 6 replies
  • 4 kudos

Resolved! Databricks metastore

I have configured a new databricks workspace through my personal azure account. I cannot see the metastore. Since this is my personal account, I am the admin. Can you please guide me on how to enable the metastore. Thank you.

  • 172 Views
  • 6 replies
  • 4 kudos
Latest Reply
Khaja_Zaffer
Contributor
  • 4 kudos

Hello @anipar Good day!!Can you please confirm again if you can see the metastore here?Log in to your Databricks workspace.Click your username in the top bar and select "Manage Account" to open the account console AZURE (https://accounts.azuredatabri...

  • 4 kudos
5 More Replies
shilpashivamall
by > New Contributor
  • 100 Views
  • 1 replies
  • 1 kudos

Databricks Professional Certification for Data Engineer- Resources

Hi Guys,Could you please share tips , free resources with hands on labs. Is Udemy course is better?Thanks a lotRegards

  • 100 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @shilpashivamall ,At the moment, the best source to prepare for this exam is Databricks Academy. Why do I think so? Because starting from September 30th, a new version of the exam will be introduced, and most of the Udemy courses have not yet been...

  • 1 kudos
Gaz
by > New Contributor
  • 117 Views
  • 1 replies
  • 1 kudos

Resolved! Dashboard embed: dashboard id is missing in token claim

We're trying to embed a dashboard following the example at https://learn.microsoft.com/en-us/azure/databricks/dashboards/embedding/external-embed#step-4-use-the-example-app-to-authenticate-and-generate-tokens The embed is displayed but with an error ...

  • 117 Views
  • 1 replies
  • 1 kudos
Latest Reply
Gaz
New Contributor
  • 1 kudos

Nevermind. I accidentally removed the external_viewer_id and external_value parameters. After adding them back it works as expected.

  • 1 kudos