cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
SubhaJ
by • New Contributor III
  • 1193 Views
  • 2 replies
  • 1 kudos

Test Proctoring Issue

Hi Team,I have given the databricks associate engineer v2 test on 18th June. There were some proctoring issues on my test. They kept removing me from the test so they could thoroughly check the room. Even though they were satisfied they removed me fr...

Data Engineering
Reply
  • 1193 Views
  • 2 replies
  • 1 kudos
View Replies
Latest Reply
SubhaJ
New Contributor III
  • 1 kudos

Hi team, hope you are doing well, It's been a week or far I didn't get any response. It'll be a great help if you can look into the issue as a priority.Thanks, Subha  

  • 1 kudos
1 More Replies
ayush1900
by • New Contributor II
  • 1437 Views
  • 1 replies
  • 1 kudos

I have successfully passed the test with 225.5 makrs. But I have'nt recieved any badge from your side as promised. I have been provided with a certificate. Please provide me with the badge. My cetificate ID is E-03DK31

Data Engineering
Reply
  • 1437 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Ayush Raj​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers you...

  • 1 kudos
pedroHmdo
by • New Contributor II
  • 5847 Views
  • 2 replies
  • 3 kudos

Resolved! Why I did not receive the databricks lakehouse fundamentals accreditation badge?

I have passed the test but did not receive the Badge. I also didn't receive any email.Thank you for you attention.

Data Engineering
Reply
  • 5847 Views
  • 2 replies
  • 3 kudos
View Replies
Latest Reply
Anonymous
Not applicable
  • 3 kudos

Hi @Pedro Medeiros​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answer...

  • 3 kudos
1 More Replies
bakiya
by • New Contributor II
  • 3324 Views
  • 8 replies
  • 0 kudos

I have successfully passed the test after completion of the course I haven't received any badge from your side as promised. I have been provided with a certificate which looks *****. Please provide me with the badge. My cetificate ID is ID: E-03DK31

I tried log in to > https://credentials.databricks.com/ with a registered email address and not able to find any Badge there. I need badge for the test i taken and passed, do needful.

Data Engineering
Reply
  • 3324 Views
  • 8 replies
  • 0 kudos
View Replies
Latest Reply
ftmoztl
New Contributor II
  • 0 kudos

Hello!The same situation is valid for me. I couldn't reach my badge from the following link. Could you help me too? @Vidula Khanna​ https://customer-academy.databricks.com/legacy/lms/index.php%3Fr%3DmyActivities/index%26tab%3Dbadges

  • 0 kudos
7 More Replies
Sushma
by • New Contributor
  • 1368 Views
  • 1 replies
  • 0 kudos

Databricks Lakehouse Fundamentals Certificate and Badge not received

I successfully passed the test after completing the course but I haven't received any certification or badge yet.Any Help is much appreciated. @Vidula Khanna​ 

Data Engineering
Reply
  • 1368 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Vartika
Databricks Employee
  • 0 kudos

Hi @Sushma Rani​,Thank you for reaching out! Please submit a ticket to our Training Team here: https://help.databricks.com/s/contact-us?ReqType=training  and our team will get back to you shortly. 

  • 0 kudos
Chris_Konsur
by • New Contributor III
  • 2416 Views
  • 1 replies
  • 0 kudos

Unit test with Nutter

When I run the simple test in a notebook, it works fine, but when I run it from the Azure ADO pipeline, it fails with the error.code;def __init__(self):  NutterFixture.__init__(self)  from runtime.nutterfixture import NutterFixture, tagclass uTestsDa...

Data Engineering
Reply
  • 2416 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Anonymous
Not applicable
  • 0 kudos

@Chris Konsur​ :The error message suggests that there is an issue with the standard output buffer when the Python interpreter is shutting down, which could be related to daemon threads. This error is not specific to Databricks or Azure ADO pipeline, ...

  • 0 kudos
beer
by • New Contributor II
  • 1533 Views
  • 3 replies
  • 0 kudos

Didn't receive my Databricks Spark 3.0 certification

I took the exam yesterday and passed the test. I haven't received any email from Databricks Academy. How long would it take to receive the certification?

Data Engineering
Reply
  • 1533 Views
  • 3 replies
  • 0 kudos
View Replies
Latest Reply
beer
New Contributor II
  • 0 kudos

This is resolved.

  • 0 kudos
2 More Replies
JLMP
by • New Contributor II
  • 1468 Views
  • 2 replies
  • 2 kudos

Badge not received for Databricks Lakehouse Fundamentals Accreditation

I have successfully passed the test. But I have'nt recieved any badge or points, could you help me with this?The e-mail registered in the community is the same as that registered in the databricks academy and in credentials.databricks.com as well.Pdf...

Data Engineering
Reply
  • 1468 Views
  • 2 replies
  • 2 kudos
View Replies
Latest Reply
Aviral-Bhardwaj
Esteemed Contributor III
  • 2 kudos

Please submit a ticket to Databricks Training Team here: https://help.databricks.com/s/contact-us?ReqType=training ,they will reach out you soon, maybe due to holiday they revert late,please be patient

  • 2 kudos
1 More Replies
hare
by • New Contributor III
  • 9566 Views
  • 1 replies
  • 1 kudos

Failed to merge incompatible data types

We are processing the josn file from the storage location on every day and it will get archived once the records are appended into the respective tables.source_location_path: "..../mon=05/day=01/fld1" , "..../mon=05/day=01/fld2" ..... "..../mon=05/d...

Data Engineering
Reply
  • 9566 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
Shalabh007
Honored Contributor
  • 1 kudos

@Hare Krishnan​ the issues highlighted can easily be handled using the .option("mergeSchema", "true") at the time of reading all the files.Sample code:spark.read.option("mergeSchema", "true").json(<file paths>, multiLine=True)The only scenario this w...

  • 1 kudos
tanin
by • Contributor
  • 4395 Views
  • 8 replies
  • 8 kudos

Using .repartition(100000) causes the unit test to be extremely slow (>20 mins). Is there a way to speed it up?

Here's the code:val result = spark .createDataset(List("test")) .rdd .repartition(100000) .map { _ => "test" } .collect() .toList   println(result)I write tests to test for correctness, so I wonde...

Data Engineering
Reply
  • 4395 Views
  • 8 replies
  • 8 kudos
View Replies
Latest Reply
Vidula
Honored Contributor
  • 8 kudos

Hey there @tanin​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...

  • 8 kudos
7 More Replies
Rahul_Samant
by • Contributor
  • 4460 Views
  • 4 replies
  • 1 kudos

Resolved! Spark Sql Connector :

i am trying to read data from azure sql database from databricks. azure sql database is created with private link endpoint.Using DBR 10.4 LTS Cluster and expectation is the connector is pre installed as per documentation.using the below code to fetch...

Data Engineering
Reply
  • 4460 Views
  • 4 replies
  • 1 kudos
View Replies
Latest Reply
artsheiko
Databricks Employee
  • 1 kudos

It seems that .option("databaseName", "test") is redundant here as you need to include the db name in the url.Please verify that you use a connector compatible to your cluster's Spark version : Apache Spark connector: SQL Server & Azure SQL

  • 1 kudos
3 More Replies
Labels