- 4593 Views
- 6 replies
- 0 kudos
I've successfully passed Databricks Data Engineer Associate Certified exam but still have not received the certificate. Could you help on it pleas...
I've successfully passed Databricks Data Engineer Associate Certified exam but still have not received the certificate. Could you help on it please.
- 4593 Views
- 6 replies
- 0 kudos
- 0 kudos
Hi @Venkata Sai Anuroop Samudrala​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to he...
- 0 kudos
- 3061 Views
- 2 replies
- 1 kudos
Configure DLT Pipeline to use existing running cluster
How can I configure a DLT pipeline to use an existing running cluster? I don't see where in the settings to set the pipeline to use an existing cluster. Instead it wants to always standup a new cluster.
- 3061 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Justin Stuparitz​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.T...
- 1 kudos
- 4357 Views
- 3 replies
- 0 kudos
Cluster not following the zone: auto configuration
Hi, I'm trying some new instance types, so to be sure I will get one I set the Availability zone to 'auto'.But this is happening, the image of the error and JSON are attached.So, the cluster is trying three times to upscale and the three times is usi...
- 4357 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Alejandro Martinez​ Hope everything is going great.Does @Sivaprasad C S​ response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to hear from you.Thanks!
- 0 kudos
- 2255 Views
- 2 replies
- 2 kudos
Time Parameter Returns Incorrect Time
For some reason, the parameter keeps showing me my local time in UTC. When converting this parameter from EST, the offset is wrong. In the screenshot, you can see that my local session TZ is set to ETC/UTC (for whatever reason). It looks like the par...
- 2255 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @Zachary Higgins​ Hope everything is going great.Does @Prasad Wagh​ response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to hear from you.Thanks!
- 2 kudos
- 6271 Views
- 6 replies
- 10 kudos
databricks learning Full screen disabled in selfpaced course
databricks learning self paced course Databricks Certified Associate Developer for Apache Spark 3 has below issues 1) Full screen button is disabled, difficult to see small font and stress on eyes.PFA2) courses do not have captions. Sometimes it is d...
- 6271 Views
- 6 replies
- 10 kudos
- 10 kudos
Hi @Smitha Nelapati​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us ...
- 10 kudos
- 6213 Views
- 3 replies
- 0 kudos
bug: add csv data UI: missing leading zero
use add data UI, add csv manually, even set data type as string, the leading zero will be missingexample csvval1,val20012345, abcafter load data, 123,abc is stored in table
- 6213 Views
- 3 replies
- 0 kudos
- 0 kudos
there are no issues using spark.read in notebooksthe issue is specific to using Add Data User interface and adding a csv file manually.
- 0 kudos
- 2548 Views
- 0 replies
- 0 kudos
Connection from on-premise R sparklyr session to Databricks, " invalid method toDF for object 17/org.apache.spark.sql.DataFrameReader fields 0 selected 0"
Hello,I'm working with an on-premise R session and would like to connect to Databricks using sparklyr. RStudio server in this case is not an option.I would like to use jdbc. I tested RJDBC + DBI and can conect locally and perform operations. However,...
- 2548 Views
- 0 replies
- 0 kudos
- 3353 Views
- 2 replies
- 1 kudos
10.4LTS has outdated snowflake spark connector, how to force latest snowflake spark connector
Hi,I am trying to run my code from a scala fatjar on azure-databricks, which connects to snowflake for the data.I usually run my jar on 9.1 LTS.However when I run on 10.4 LTS the performace was 4x degraded and in the log it says WARN SnowflakeConnect...
- 3353 Views
- 2 replies
- 1 kudos
- 1 kudos
I also encountered the similar problem. This is a snippet from my log file:22/12/18 09:36:28 WARN SnowflakeConnectorUtils$: Query pushdown is not supported because you are using Spark 3.2.0 with a connector designed to support Spark 3.1. Either use t...
- 1 kudos
- 5486 Views
- 5 replies
- 7 kudos
Resolved! 14-day free trial console showing blank page
I would like to register for a new 14-day free trial account as my existing one expires. I received the welcome email to validate my email address. I followed the link to set my password and it redirected me to the Databricks console page, but the pa...
- 5486 Views
- 5 replies
- 7 kudos
- 7 kudos
You can just log in to portal.azure.com and create a new databricks workspace, and there is an option 14 days premium free trial. I use that approach every time.
- 7 kudos
- 3672 Views
- 3 replies
- 4 kudos
Resolved! 14 day trial version console showing blank screen after login
I have taken a trial version of Databricks and wanted to configure it with AWS. but after login it was showing as blank screen since 20 hours. can someone help me with this. Note: strictly i have to use AWS with Databricks for configuration.
- 3672 Views
- 3 replies
- 4 kudos
- 2346 Views
- 2 replies
- 2 kudos
Databricks Lakehouse Fundamentals Accreditation V2 Badge/Certificate Date Not Updated
I had appeared for Databricks Lakehouse Fundamentals Accreditation for both V1 and V2. Recently I came to know that when you take V1 test, and you get a badge and certificate - once you take V2 test, it updates that same badge and certificate to the ...
- 2346 Views
- 2 replies
- 2 kudos
- 2969 Views
- 1 replies
- 0 kudos
GET_COLUMNS fails with Unexpected character (\\'t\\' (code 116)): was expecting comma to separate Object entries - how to fix?
I just run `cursor.columns()` via the python client and I'll get back a `org.apache.hive.service.cli.HiveSQLException` as response. There is also a long stack trace, I'll just paste the last bit because it might be illuminating: org.apache.spark.sql....
- 2969 Views
- 1 replies
- 0 kudos
- 0 kudos
this can be package issue or runtime issue, try to change both
- 0 kudos
- 7137 Views
- 2 replies
- 1 kudos
Resolved! Can I use Widgets in a Delta Live Table pipeline
Hello, I'm pretty new to Databricks in general and Delta Live Tables specifically. My problem statement is that I'd like loop through a set of files and run a notebook that loads the data into some Delta Live Tables. Additionally, I'd like to include...
- 7137 Views
- 2 replies
- 1 kudos
- 1 kudos
may be it is possible in the job run file there will be configurations option the user can add there
- 1 kudos
- 4816 Views
- 3 replies
- 3 kudos
- 4816 Views
- 3 replies
- 3 kudos
- 3732 Views
- 2 replies
- 2 kudos
delete and append in delta path
I am deleting data from curated path based on date column and appending staged data on it on each run, using below script. My fear is, just after the delete operation, if any network issue appeared and the job stopped before it appended the staged da...
- 3732 Views
- 2 replies
- 2 kudos
| User | Count |
|---|---|
| 1644 | |
| 791 | |
| 553 | |
| 349 | |
| 287 |
