- 2048 Views
- 3 replies
- 2 kudos
Error while writing dataframe to csv file.
Hi Folks, Need help to resolve an error. I'm getting a below error while writing a dataframe into a csv file and exporting that file.Error:py4j.protocol.Py4JJavaError: An error occurred while calling o53.save.: java.lang.UnsatisfiedLinkError: 'boolea...
- 2048 Views
- 3 replies
- 2 kudos
- 2 kudos
Do I see it correctly that you're actually not using Databricks, but Spark, locally installed, instead? Your issue can have many different causes, like an incompatible Java version. In this case, I can only refer to the official docs.
- 2 kudos
- 1237 Views
- 1 replies
- 0 kudos
Error while running Job sparkSession is null while trying to executeCollectResult
Hi,I have started getting following error while running jobs in databrick. It started failing since last few days. Recently I have migrated to unity catalogue, no other change was made recently. I am running on DBR 13.3 LTS. com.google.common.util.co...
- 1237 Views
- 1 replies
- 0 kudos
- 0 kudos
Although it won't be the root cause of your issue, one thing worth mentioning is that `.trigger(once=True)` is obsolete by now and was replaced by `availableNow=True`
- 0 kudos
- 3271 Views
- 3 replies
- 1 kudos
ADF - Fails to run job in workspace in another subscription
We are trying to run a Databricks job from ADF, but we keep getting the following error:Operation on target Run dbt job failed: {"error_code":"PERMISSION_DENIED","message":"User <adf-mi-prod-id> does not have Manage Run or Owner or Admin permissions...
- 3271 Views
- 3 replies
- 1 kudos
- 1 kudos
I am seeing the error message above whenever job 123 is triggered by ADF, but I can't find any instances of this job running in Databricks.
- 1 kudos
- 2736 Views
- 0 replies
- 0 kudos
DBCE login works, but shows two workspace with the same email
Hi:I'm able to login in DBCE but it shows two workspace(s) with the same email. Please see the attached screenshot.That's strange. What gives ?
- 2736 Views
- 0 replies
- 0 kudos
- 1589 Views
- 1 replies
- 2 kudos
Unable to login to databricks community edition
Hi Team, I was not able to login to Databricks community edition It’s working fine for me yesterday when I used but today while logging in it’s directing to same login page after entering user name and password . Can someone please look into this iss...
- 1589 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi I have the same problem. I used CE for logging MLFlow experiments and now can't login into my account. Can you please look into it @Sujitha @Retired_mod?
- 2 kudos
- 865 Views
- 1 replies
- 0 kudos
Hi I am trying to change datatype of DOB column from stringtype to DateType but getting issue
Hi I am trying to change datatype of DOB column from String type to DateType but getting issue"SparkUpgradeException: [] You may get a different result due to the upgrading to Spark >= 3.0: Caused by: DateTimeParseException: Text '7/8/1972' could not...
- 865 Views
- 1 replies
- 0 kudos
- 0 kudos
It's because the format you're using it wrong. Use `'M/d/yyyy'` instead.
- 0 kudos
- 1209 Views
- 1 replies
- 1 kudos
Error in notebook while execution
Error in callback <bound method UserNamespaceCommandHook.post_run_cell of <dbruntime.DatasetInfo.UserNamespaceCommandHook object at 0x7f5790c07070>> (for post_run_cell)
- 1209 Views
- 1 replies
- 1 kudos
- 1 kudos
https://community.databricks.com/t5/data-engineering/error-in-notebook-execution/m-p/76226#M35165
- 1 kudos
- 2207 Views
- 2 replies
- 1 kudos
Resolved! Cluster Termination Issue
Hi, I am new to ADB and started recently using this community edition. I created a cluster and it is terminating immediately when i use to connect.What I am missing or what i need do? kindly help me.
- 2207 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi Walter_C, thanks for your response. Your assumption is correct. Now I tried to create new Cluster whenever I start practice. Then no issues.
- 1 kudos
- 1076 Views
- 1 replies
- 1 kudos
Winston-Salem/Greensboro, NC User Group
Hi All! I'm looking to start at Databricks Usergroup in the Greensboro/Winston-Salem, NC area. Wanted to gauge interest to find others who would like to join.
- 1076 Views
- 1 replies
- 1 kudos
- 1 kudos
Thank you for setting this up, Brandon!
- 1 kudos
- 4967 Views
- 4 replies
- 0 kudos
Where the "Driver logs" are stored by default, and How much default space to store it.
Recently, when I was using databricks for deep learning I ran into an issue, i.e., after a certain amount of time of execution the cluster would break and restart. The logs are as below:The Event logs displayed "Metastore is down; Driver is up but is...
- 4967 Views
- 4 replies
- 0 kudos
- 0 kudos
Hello Jaron, is it not possible for you to redirect the login to an ABFSS or S3 bucket?
- 0 kudos
- 8309 Views
- 2 replies
- 0 kudos
Callback bound method error
When executing a withColumn (running on DBR 14.3 LST) I get this error:Error in callback <bound method UserNamespaceCommandHook.post_run_cell of <dbruntime.DatasetInfo.UserNamespaceCommandHook object at 0x7feda2b2efb0>> (for post_run_cell):How shoul...
- 8309 Views
- 2 replies
- 0 kudos
- 0 kudos
We have the same issue using a shared cluster running DBR 14.3:Code executed: dfNew = dfTmp.withColumn(HashKeyColumnName, F.sha2(F.concat_ws("||", *ColumnList), 256))Error received: Error in callback <bound method UserNamespaceCommandHook.post_run_ce...
- 0 kudos
- 1421 Views
- 0 replies
- 0 kudos
Pystan3 with databricks runtime 13.3
I am getting a read-only error when running pystan3 build() in a UDF.I think the issue is related to the location that the code is being run from, which is read-only. I am looking to set a custom cache location inside the UDF. Based on this link I a...
- 1421 Views
- 0 replies
- 0 kudos
- 2429 Views
- 1 replies
- 0 kudos
Databricks JDBC driver attempting to pass access token (JWT) from an external IDP (OKTA)
Configured a Databricks workspace for SSO to an IDP (OKTA).Databricks JDBC driver 02.06.38.1068Attempting to connect to Databricks using a URL similar to following where access token is obtained from the IDP (OKTA). Using tool such as SQLSquirrel wit...
- 2429 Views
- 1 replies
- 0 kudos
- 0 kudos
Yes, latest version 02.06.38.1068Would like to know if other persons have successfully passed access tokens from an external IDP via the driver.
- 0 kudos
- 2316 Views
- 0 replies
- 0 kudos
Databricks vs. Competitors: Key Features
Hi everyone,Can anyone share insights on the key features that differentiate Databricks from its competitors? Looking forward to your thoughts!Thanks!
- 2316 Views
- 0 replies
- 0 kudos
- 5186 Views
- 4 replies
- 1 kudos
run datarbicks worflow as service pricipal (managed identity) reads from azure dev ops repo Failed
Hello,we are running a workflow as a service principal, that is a aad managed identity. This does result in the issue: run databricks workflow as service principal the reads from azure dev ops repo Failed to checkout Git repository: PERMISSION_DENIED...
- 5186 Views
- 4 replies
- 1 kudos
- 1 kudos
We managed to solve this problem, however it is not an elegant solution. Databricks should simplify this.The steps that have to be done are listed below. We are using user assigned managed identity (MI), but I assume this should work for Azure Servic...
- 1 kudos
