- 3440 Views
- 2 replies
- 2 kudos
Resolved! Request for reattempt voucher. Databricks Certified Data Engineer Associate exam
HiOn Feb 27th ,I attempted the Databricks Certified Data Engineer Associate exam for 1st time , unfortunately I ended up by failing grade. My passing grade was 70%, and I received 64.88%.I am planning to reattempt the exam, Could you kindly give me a...
- 3440 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Sanmati Mahesh Undodi​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from ...
- 2 kudos
- 3052 Views
- 3 replies
- 3 kudos
Resolved! Getting OOM error while loading huge zipped CSV file to the databricks Hive_metasore table
Is any better way to load huge zipped CSV file to hive_metastore table ?????​
- 3052 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi @Ankit Gangwal​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers...
- 3 kudos
- 3364 Views
- 5 replies
- 0 kudos
Data Engineer Associate Certificate and badge not yet received
I have cleared the certification exam on 26th January 2023, but still haven't received the certificate. I had given the exam with a different mail ID but I'm not receiving any emails from Databricks to that mail ID.​Kindly help me resolve the issue.
- 3364 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi @Naeemah Khatib​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 0 kudos
- 6997 Views
- 3 replies
- 1 kudos
How to read a json from BytesIO with PySpark?
I want read a json from IO variable using PySpark.My code using pandas:io = BytesIO()ftp.retrbinary('RETR '+ file_name, io.write)io.seek(0)# With pandasdf = pd.read_json(io)What I tried using PySpark, but don't work: io = BytesIO() ftp.retrbinary('...
- 6997 Views
- 3 replies
- 1 kudos
- 2765 Views
- 2 replies
- 2 kudos
Are there any python API bindings for the Databricks Account API?
All I could find in terms of API bindings for python is https://pypi.org/project/databricks-cli/, and this does not include the Account API and it is also not official. I will just use the OpenAPI spec, but just want to be sure I'm not doing unnece...
- 2765 Views
- 2 replies
- 2 kudos
- 2 kudos
@Iwan Aucamp​ : Yes, there are Python API bindings available for the Databricks Account API.For Databricks Account API with Python, please refer to the Databricks documentation: https://docs.databricks.com/dev-tools/api/latest/accounts.html#python-ap...
- 2 kudos
- 12099 Views
- 3 replies
- 5 kudos
Notebook dropdown widget
I have created a dropdown (say B) in my notebook whose input depend on dropdown( say B). So if select some value in dropdown A, it corresponding value appears in B dropdown & i'm selecting one amongst it. Now if i change the value in dropdown A, then...
- 12099 Views
- 3 replies
- 5 kudos
- 5 kudos
If the previously selected value of B is not meant to be in the list of values for newly selected dropdown A value, then you could set a default value (ie: 'No selection') that the B dropdown should have when first created. In a method to define how ...
- 5 kudos
- 39549 Views
- 7 replies
- 35 kudos
Resolved! pyspark - regexp_extract
hello everyone, I'm creating a regex expression to fetch only the value of a string, but some values ​​are negative. I am not able to create the rule to compose the negative value. can you help me?from pyspark.sql.functions import regexp_extract fro...
- 39549 Views
- 7 replies
- 35 kudos
- 35 kudos
Have you found the answer? If you are a student in college or school searching for free essay examples online, you may want to visit the website https://writinguniverse.com/free-essay-examples/soccer/ here you will find a vast collection of free essa...
- 35 kudos
- 8329 Views
- 2 replies
- 0 kudos
Error when importing .dbc of a complete Workspace
I saved the content of an older Databricks Workspace by clicking on the Dropdown next to Workspace -> Export -> DBC Archive and saved it on my local machine.In a new Databricks Workspace, I now want to import That .DBC archive to restore the previous...
- 8329 Views
- 2 replies
- 0 kudos
- 0 kudos
@Sebastian K​ :It looks like the error you are facing while importing the DBC archive could be due to the version incompatibility between the Databricks instance where you created the DBC archive and the one where you are trying to import it. Can you...
- 0 kudos
- 3318 Views
- 1 replies
- 3 kudos
Resolved! I Input the wrong schedule time for the exams can it be reschedule ?
Helo today ,i think i was scheduled to do an exams at 2.15 PM but unfortunately i made a mistake put the time to 2.15 AM, could it be rescheduled? i already submit a ticket to https://help.databricks.com/s/contact-us?ReqType=training but no reply yet...
- 3318 Views
- 1 replies
- 3 kudos
- 3 kudos
Hello @heron halim,​ If the exam time and date have already passed, we cannot help in the situation; we can only change the time/date of the exam if we are notified a minimum of 30 hours before the exam date/time. Test-takers must ensure they check t...
- 3 kudos
- 7659 Views
- 5 replies
- 6 kudos
how to load structured stream data into delta table whose location is in ADLS Gen2
Hi All,I am working on a streaming data processing. As a intial step i have read the data from azure eventhub using readstream. now i want to writestream this into a delta table. My requirement is, The data should present in external location (adls g...
- 7659 Views
- 5 replies
- 6 kudos
- 6 kudos
There are a couple ways to connect to ADLS Gen2. Please refer to below doc. For instance, if you decide to go by service principal method, you need to add below storage account configurations details to the cluster or notebooks. Same goes for storag...
- 6 kudos
- 5499 Views
- 1 replies
- 4 kudos
Resolved! Deploying global parameters from lower to higher env in ADF
how can we deploy global parameters from dev to higher environments in ADF. Could anyone throw some light on this.I'm using GIT in DEV and deploying it to PROD using Azure CICD pipeline.
- 5499 Views
- 1 replies
- 4 kudos
- 4 kudos
@KVNARK .​ : To deploy global parameters from dev to higher environments in Azure Data Factory (ADF), you can follow these steps:In your DEV environment, create the global parameters in ADF and save them.Commit and push the changes to your Git reposi...
- 4 kudos
- 4098 Views
- 1 replies
- 2 kudos
Resolved! Fastest Azure VM for Databricks Big Data workload
Hi All,It is well known that Azure provides a wide variety of VM for Databricks, some of which provide powerful features such as Photon and Delta Caching. I would like to ask the community which do you think is the fastests cluster for performing Big...
- 4098 Views
- 1 replies
- 2 kudos
- 2 kudos
@Alvaro Moure​ :The performance of a Databricks cluster for big data operations depends on many factors, such as the amount and structure of the data, the nature of the operations being performed, the configuration of the cluster, and the specific re...
- 2 kudos
- 8210 Views
- 0 replies
- 2 kudos
Weekly Release Notes RecapHere’s a quick recap of the latest release notes updates from the past one week. Databricks platform release notesMarch 13 -...
Weekly Release Notes RecapHere’s a quick recap of the latest release notes updates from the past one week.Databricks platform release notesMarch 13 - 17, 2023Execute SQL cells in the notebook in parallelYou can now run SQL cells in Databricks noteboo...
- 8210 Views
- 0 replies
- 2 kudos
- 5274 Views
- 4 replies
- 4 kudos
The possibility of finding the workload dynamically and spin up the cluster based on the workload
Hi Team,Good morning. I would like to understand if there is a possibility to determine the workload automatically through code (data load from a file to a table, determine the file size, kind of a benchmark that we can check), based on which we can ...
- 5274 Views
- 4 replies
- 4 kudos
- 4 kudos
Hi @Arunsundar Muthumanickam​ , When you say workload, I believe you might be handling various volumes of data between Dev and Prod environment. If you are using Databricks cluster and do not have much idea on how the volumes might turn out in differ...
- 4 kudos
- 18677 Views
- 3 replies
- 3 kudos
Resolved! Geting error Caused by: com.databricks.NotebookExecutionException: FAILED
I am trying to run the below notebook through databricks but getting the below error. I have tried to update the notebook timeout and the retry mechanism but still no luck yet. NotebookData("/Users/mynotebook",9900, retry=3) ] res = parallelNot...
- 18677 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi @Dipak Bachhav​, not sure if you have fixed the issue, but here are few things you can check: Is the path "/Users/mynotebook" correct? Maybe you are missing the dot in the beginning.Run the notebook using dbutils.notebook.run("/Users/mynotebook") ...
- 3 kudos
| User | Count |
|---|---|
| 1644 | |
| 793 | |
| 580 | |
| 349 | |
| 287 |
