- 2710 Views
- 2 replies
- 0 kudos
I need to run Sql Update/Delete commands for a AWS RDS system.
I tried 'jdbc' connection to access the data from the RDS. I was able to read the data successfully but I need to do run some update queries. It seems the jdbc won't support update operation. I tried to make connection to my RDS mysql with host, user...
- 2710 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Manikandan Ramachandran​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear fro...
- 0 kudos
- 3964 Views
- 3 replies
- 1 kudos
Didn't received the certificate for Databricks Certified Data Engineer Associate exam
@Vidula Khanna​ @Nadia Elsayed​ Hi,I pass Databricks Certified Data Engineer Associate exam 48 hours ago. But still didn't received the certificate yet. I also created ticket(00312849) 6 hours ago but still no one reach out to me yet regarding this i...
- 3964 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Urvish Patel​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...
- 1 kudos
- 11614 Views
- 1 replies
- 0 kudos
Read CSV file using SQL
Hi, I am trying to reverse engineer to get to the source file for a table. Looking at the query history, I came across SQL string which loads data from file to table, however the code looks little mystery to me. I haven't come across idbfs, Can someb...
- 11614 Views
- 1 replies
- 0 kudos
- 1624 Views
- 2 replies
- 1 kudos
Databricks Certified Associate Developer for Apache Certification
Hi Team, just wanted to know is Databricks planning to sunset Databricks Certified Associate Developer for Apache certification.I guess Databricks already informed the partners about the same so just thought to reconfirm the same.thank you!
- 1624 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Tushar Bomble​ Thank you for reaching out! Please submit a ticket to our Training Team here: https://help.databricks.com/s/contact-us?ReqType=training and our team will get back to you shortly.
- 1 kudos
- 5446 Views
- 2 replies
- 1 kudos
Resolved! ImportError: cannot import name dataclass_transform
Hi,I am using Standard Runtime 11.3 LTS and trying to utilize spacy-> en_core_web_sm but I am getting following error.ImportError: cannot import name dataclass_transformIt was working last week but stopped working recently.Appreciate any help. Regard...
- 5446 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Sanjay Jain​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks...
- 1 kudos
- 3408 Views
- 2 replies
- 2 kudos
Databricks Data Cleanroom
Just needs to understand the data cleanroom. As per the documentation, Databricks Data Cleanroom provides a secure, governed, and privacy-safe environment. Participants can enable fine-grained control access to data with the help of UnityCatalog.Also...
- 3408 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Rajarampandian Arumugam​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear fro...
- 2 kudos
- 11568 Views
- 1 replies
- 1 kudos
Logging when using multiprocessing with joblib
Hi,I'm using joblib for multiprocessing in one of our processes. The logging does work well (except weird py4j errors which I supress) except when it's within multiprocessing. Also how do I supress the other errors that I always receive on DB - perha...
- 11568 Views
- 1 replies
- 1 kudos
- 1 kudos
@Sam G​ :It seems like the issue is related to the py4j library used by Spark, and not specifically related to joblib or multiprocessing. The error message indicates a network error while sending a command between the Python process and the Java Virt...
- 1 kudos
- 8938 Views
- 1 replies
- 1 kudos
How can I optimize Spark performance in Databricks for large-scale data processing
I'm using Databricks for processing large-scale data with Apache Spark, but I'm experiencing performance issues. The processing time is taking longer than expected, and I'm encountering memory and CPU usage limitations. I want to optimize the perform...
- 8938 Views
- 1 replies
- 1 kudos
- 1 kudos
@jhon marton​ :Optimizing Spark performance in Databricks for large-scale data processing can involve a combination of techniques, configurations, and best practices. Below are some recommendations that can help improve the performance of your Spark ...
- 1 kudos
- 4236 Views
- 1 replies
- 1 kudos
Resolved! What is the best way to use credentials for API calls from databricks notebook?
Hello, I have an Databricks account on Azure, and the goal is to compare different image tagging services from Azure, GCP, AWS via corresponding API calls, with Python notebook. I have problems with GCP vision API calls, specifically with credentials...
- 4236 Views
- 1 replies
- 1 kudos
- 1 kudos
Ok, here is a trick: in my case, the file with GCP credentials is stored in notebook workspace storage, which is not visible to os.environ() command. So solution is to read a content of this file, and save it to the cluster storage attached to the no...
- 1 kudos
- 3084 Views
- 1 replies
- 1 kudos
Is it possible to use the databricks-sql-nodejs driver in a create-react-app app?
I'm using the typescript example for the databricks sql driver but I'm getting errors when compiling:
- 3084 Views
- 1 replies
- 1 kudos
- 1 kudos
Hello @asdf fdsa​ ,The NodeJS connector is built for NodeJS environment it will not integrate ReactJSFor cases where a web execution is needed we advise to use SQL Exec APIPlease check documentation here for the same:https://docs.databricks.com/sql/a...
- 1 kudos
- 8350 Views
- 1 replies
- 4 kudos
Automating the re run of job (with several Tasks) // automate the notification of a failed specific tasks after re trying // Error handling on azure data factory pipeline with DataBricks notebook
Hi DataBricks Experts:I'm using Databricks on Azure.... I'd like to understand the following:1) if there is way of automating the re run some specific failed tasks from a job (with several Tasks), for example if I have 4 tasks, and the task 1 and 2 h...
- 8350 Views
- 1 replies
- 4 kudos
- 4 kudos
You can use "retries".In Workflow, select your job, the task, and in the options below, configure retries.If so, you can also see more options at:https://learn.microsoft.com/pt-br/azure/databricks/dev-tools/api/2.0/jobs?source=recommendations
- 4 kudos
- 1838 Views
- 1 replies
- 0 kudos
How to skip "onboarding" wizard?
I have registreded account via AWS marketplace.Also I have deployed workspaces with Terraform.When I log in admin console, It redirects me to https://accounts.cloud.databricks.com/onboardingwhere I need to create workspace manually, but I don't want ...
- 1838 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi Team, Would you mind telling us how you have provisioned? Are you using the same account id which you have used while creation. If so, Could you please try to login through incognito and see if that works?
- 0 kudos
- 3457 Views
- 2 replies
- 1 kudos
Example API call using 'has_more=true'
Can someone please provide an example while loop including has_more=true. I can't get pagination to work for the API endpoint '/jobs/runs/list/'. Thanks
- 3457 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Rachel Cunningham​ Could you please elaborate what you mean by "I can't get pagination to work"? Is "has_more" set to "true" even when there are no more tasks to list? This is do you mean it doesn't list all runs or doesn't list tasks within each...
- 1 kudos
- 1774 Views
- 1 replies
- 1 kudos
www.youtube.com
We made another major release for Security Analysis Tool (SAT) with Unity Catalog and Delta sharing checks, Terraform deployments, and faster analysis if you have many workspaces. If you are on Azure Databricks there are new step-by-step video-based ...
- 1774 Views
- 1 replies
- 1 kudos
- 1 kudos
Thank you for sharing @Arun Pamulapati​!!!
- 1 kudos
- 1440 Views
- 1 replies
- 0 kudos
The current cluster state is pending . please retry your request after 30 seconds
We are trying to make a connection to database instance from datahub/dbeaver and getting error . We can make a connection manually after few tries . We are facing it every time we execute our code to make a connection. We need to resolve this before ...
- 1440 Views
- 1 replies
- 0 kudos
- 0 kudos
could you share more details? for example, go to the driver's logs and extract the logs and share the error stack trace with us please.
- 0 kudos
| User | Count |
|---|---|
| 1629 | |
| 790 | |
| 511 | |
| 349 | |
| 287 |
