- 2812 Views
- 3 replies
- 0 kudos
Resolved! when trying to use %run to a notebook, I'm getting an error.
this error is occurring randomly. sometimes it resolves on its own. not sure what is the cause of the error. The notebook I'm sourcing runs flawlessly. I'm only trying to import dates from this notebook
- 2812 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @viswa p​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ca...
- 0 kudos
- 2139 Views
- 1 replies
- 0 kudos
Can sql result display more than 25 records per page?
Hi! I have a result table with 41 rows. What should I do to make all rows available on the same page?
- 2139 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @wenting_deng wenting_deng​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, pleas...
- 0 kudos
- 4942 Views
- 2 replies
- 2 kudos
Resolved! Lot of write shuffle on optimize + ZORDER, is it normal?
Hi! I'm optimizing several Tb of partitioned data on ZSTD lvl 9.It surprises me the level of shuffle write, it could make sense because of ZORDER but I want to be sure that I'm not missing something, here is some context: Could I be missing something...
- 4942 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Alejandro Martinez​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best an...
- 2 kudos
- 24859 Views
- 2 replies
- 2 kudos
Resolved! Upgrade Python version in cluster
Currently I am using the following cluster. It is using the default python version of 3.9.5 and I would like to update it to 3.10.1.0How to achieve this?
- 24859 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Ayush Modi​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...
- 2 kudos
- 18129 Views
- 4 replies
- 3 kudos
Relationship between Databricks Account and Azure resources
Hello,What is the relationship between Databricks Account (as described in [1]) and Azure resources? Is Databricks Account created per Azure account? Or per Azure tenant? Or maybe per subscription?[1] https://learn.microsoft.com/en-us/azure/databrick...
- 18129 Views
- 4 replies
- 3 kudos
- 3 kudos
Hi @Chris Nawara​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so ...
- 3 kudos
- 9068 Views
- 1 replies
- 0 kudos
Iteration - Pyspark vs Pandas
Hello. Could someone please explain why iteration over a Pyspark dataframe is way slower than over a Pandas dataframe?Pysparkdf_list = df.collect()for index in range(0, len(df_list )):.....Pandasdf_pnd = df.toPandas() for index, row in df_p...
- 9068 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @ELENI GEORGOUSI​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us ...
- 0 kudos
- 3662 Views
- 1 replies
- 0 kudos
Running terraform plan; databricks throws a "Permission_Denied: Missing required permissions [View] on node with ID "1759335429158542"
To give you a little bit of background:We use terraform to deploy a resource group with multiple Azure services Terraform leverages an Azure Service Principal that has Owner rights to the Azure subscriptionThis way, databricks is also deployed. We al...
- 3662 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Gent Reshtani​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers...
- 0 kudos
- 5840 Views
- 10 replies
- 2 kudos
Selfpaced course link for "Apache Spark developer associate "
Please where can i find the the "Apache Spark developer associate " selfpaced course ?Thanks in advance.
- 5840 Views
- 10 replies
- 2 kudos
- 2 kudos
Hi @youssef ansari​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us s...
- 2 kudos
- 3157 Views
- 3 replies
- 1 kudos
Create a Dockerfile from Cluster
Is there a way to create a Dockerfile from Workspace A's cluster configurations and deploy that on a different different cluster in Workspace B?
- 3157 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Kevin Kim​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ...
- 1 kudos
- 1367 Views
- 1 replies
- 0 kudos
- 1367 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Bhupesh Aggarwal​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us...
- 0 kudos
- 1932 Views
- 1 replies
- 1 kudos
How to use SparkNLP library and JohnSnowLabs maven coordinates in cluster which is not connected to internet
Hi,I am trying SparkNLP library for the first time. The cluster I'm using is corporate and cannot be connected to internet. I can only download packages that are provided to us or by using a jar file.I've three questions:What jar files do I need to ...
- 1932 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Samy Syed​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ...
- 1 kudos
- 7272 Views
- 3 replies
- 4 kudos
What is a recommended directory for creating a database with a specified path?
I was going through Data Engineering with Databricks training, and in DE 3.3L - Databases, Tables & Views Lab section, it says "Defining database directories for groups of users can greatly reduce the chances of accidental data exfiltration." I agree...
- 7272 Views
- 3 replies
- 4 kudos
- 4 kudos
Hi @Dilorom A​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ...
- 4 kudos
- 2357 Views
- 3 replies
- 1 kudos
December exam voucher for Databricks Certified Associate Developer for Apache Spark 3.0 exam
Dear @Jose Gonzalez​ Hope you're having great day. This is of HIGH priority for me, I've to schedule exam in December before slots are full.I gave Databricks Certified Associate Developer for Apache Spark 3.0 exam on 30th Nov but missed by one perc...
- 2357 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Smitha Nelapati​ Thank you for reaching out! Please submit a ticket to our Training Team here: https://help.databricks.com/s/contact-us?ReqType=training and our team will get back to you shortly.
- 1 kudos
- 2252 Views
- 2 replies
- 0 kudos
I need to run Sql Update/Delete commands for a AWS RDS system.
I tried 'jdbc' connection to access the data from the RDS. I was able to read the data successfully but I need to do run some update queries. It seems the jdbc won't support update operation. I tried to make connection to my RDS mysql with host, user...
- 2252 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Manikandan Ramachandran​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear fro...
- 0 kudos
- 7586 Views
- 6 replies
- 0 kudos
Log files are not getting deleted automatically after logRetentionDuration internal
Hi team Log files are not getting deleted automatically after logRetentionDuration internal from delta log folder and after analysis , I see checkpoint files are not getting created after 10 commits . Below table properties using spark.sql( f""" ...
- 7586 Views
- 6 replies
- 0 kudos
- 0 kudos
Hi @vinay kumar​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks...
- 0 kudos
| User | Count |
|---|---|
| 1614 | |
| 773 | |
| 349 | |
| 286 | |
| 253 |
