- 1861 Views
- 1 replies
- 0 kudos
Error while running Job sparkSession is null while trying to executeCollectResult
Hi,I have started getting following error while running jobs in databrick. It started failing since last few days. Recently I have migrated to unity catalogue, no other change was made recently. I am running on DBR 13.3 LTS. com.google.common.util.co...
- 1861 Views
- 1 replies
- 0 kudos
- 0 kudos
Although it won't be the root cause of your issue, one thing worth mentioning is that `.trigger(once=True)` is obsolete by now and was replaced by `availableNow=True`
- 0 kudos
- 4509 Views
- 3 replies
- 1 kudos
ADF - Fails to run job in workspace in another subscription
We are trying to run a Databricks job from ADF, but we keep getting the following error:Operation on target Run dbt job failed: {"error_code":"PERMISSION_DENIED","message":"User <adf-mi-prod-id> does not have Manage Run or Owner or Admin permissions...
- 4509 Views
- 3 replies
- 1 kudos
- 1 kudos
I am seeing the error message above whenever job 123 is triggered by ADF, but I can't find any instances of this job running in Databricks.
- 1 kudos
- 3300 Views
- 0 replies
- 0 kudos
DBCE login works, but shows two workspace with the same email
Hi:I'm able to login in DBCE but it shows two workspace(s) with the same email. Please see the attached screenshot.That's strange. What gives ?
- 3300 Views
- 0 replies
- 0 kudos
- 2216 Views
- 1 replies
- 2 kudos
Unable to login to databricks community edition
Hi Team, I was not able to login to Databricks community edition It’s working fine for me yesterday when I used but today while logging in it’s directing to same login page after entering user name and password . Can someone please look into this iss...
- 2216 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi I have the same problem. I used CE for logging MLFlow experiments and now can't login into my account. Can you please look into it @Sujitha @Retired_mod?
- 2 kudos
- 1445 Views
- 1 replies
- 0 kudos
Hi I am trying to change datatype of DOB column from stringtype to DateType but getting issue
Hi I am trying to change datatype of DOB column from String type to DateType but getting issue"SparkUpgradeException: [] You may get a different result due to the upgrading to Spark >= 3.0: Caused by: DateTimeParseException: Text '7/8/1972' could not...
- 1445 Views
- 1 replies
- 0 kudos
- 0 kudos
It's because the format you're using it wrong. Use `'M/d/yyyy'` instead.
- 0 kudos
- 1639 Views
- 1 replies
- 1 kudos
Error in notebook while execution
Error in callback <bound method UserNamespaceCommandHook.post_run_cell of <dbruntime.DatasetInfo.UserNamespaceCommandHook object at 0x7f5790c07070>> (for post_run_cell)
- 1639 Views
- 1 replies
- 1 kudos
- 1 kudos
https://community.databricks.com/t5/data-engineering/error-in-notebook-execution/m-p/76226#M35165
- 1 kudos
- 3293 Views
- 2 replies
- 1 kudos
Resolved! Cluster Termination Issue
Hi, I am new to ADB and started recently using this community edition. I created a cluster and it is terminating immediately when i use to connect.What I am missing or what i need do? kindly help me.
- 3293 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi Walter_C, thanks for your response. Your assumption is correct. Now I tried to create new Cluster whenever I start practice. Then no issues.
- 1 kudos
- 1564 Views
- 1 replies
- 1 kudos
Winston-Salem/Greensboro, NC User Group
Hi All! I'm looking to start at Databricks Usergroup in the Greensboro/Winston-Salem, NC area. Wanted to gauge interest to find others who would like to join.
- 1564 Views
- 1 replies
- 1 kudos
- 1 kudos
Thank you for setting this up, Brandon!
- 1 kudos
- 8013 Views
- 4 replies
- 0 kudos
Where the "Driver logs" are stored by default, and How much default space to store it.
Recently, when I was using databricks for deep learning I ran into an issue, i.e., after a certain amount of time of execution the cluster would break and restart. The logs are as below:The Event logs displayed "Metastore is down; Driver is up but is...
- 8013 Views
- 4 replies
- 0 kudos
- 0 kudos
Hello Jaron, is it not possible for you to redirect the login to an ABFSS or S3 bucket?
- 0 kudos
- 9078 Views
- 2 replies
- 0 kudos
Callback bound method error
When executing a withColumn (running on DBR 14.3 LST) I get this error:Error in callback <bound method UserNamespaceCommandHook.post_run_cell of <dbruntime.DatasetInfo.UserNamespaceCommandHook object at 0x7feda2b2efb0>> (for post_run_cell):How shoul...
- 9078 Views
- 2 replies
- 0 kudos
- 0 kudos
We have the same issue using a shared cluster running DBR 14.3:Code executed: dfNew = dfTmp.withColumn(HashKeyColumnName, F.sha2(F.concat_ws("||", *ColumnList), 256))Error received: Error in callback <bound method UserNamespaceCommandHook.post_run_ce...
- 0 kudos
- 2068 Views
- 0 replies
- 0 kudos
Pystan3 with databricks runtime 13.3
I am getting a read-only error when running pystan3 build() in a UDF.I think the issue is related to the location that the code is being run from, which is read-only. I am looking to set a custom cache location inside the UDF. Based on this link I a...
- 2068 Views
- 0 replies
- 0 kudos
- 3383 Views
- 1 replies
- 0 kudos
Databricks JDBC driver attempting to pass access token (JWT) from an external IDP (OKTA)
Configured a Databricks workspace for SSO to an IDP (OKTA).Databricks JDBC driver 02.06.38.1068Attempting to connect to Databricks using a URL similar to following where access token is obtained from the IDP (OKTA). Using tool such as SQLSquirrel wit...
- 3383 Views
- 1 replies
- 0 kudos
- 0 kudos
Yes, latest version 02.06.38.1068Would like to know if other persons have successfully passed access tokens from an external IDP via the driver.
- 0 kudos
- 3573 Views
- 0 replies
- 0 kudos
Databricks vs. Competitors: Key Features
Hi everyone,Can anyone share insights on the key features that differentiate Databricks from its competitors? Looking forward to your thoughts!Thanks!
- 3573 Views
- 0 replies
- 0 kudos
- 6948 Views
- 4 replies
- 1 kudos
run datarbicks worflow as service pricipal (managed identity) reads from azure dev ops repo Failed
Hello,we are running a workflow as a service principal, that is a aad managed identity. This does result in the issue: run databricks workflow as service principal the reads from azure dev ops repo Failed to checkout Git repository: PERMISSION_DENIED...
- 6948 Views
- 4 replies
- 1 kudos
- 1 kudos
We managed to solve this problem, however it is not an elegant solution. Databricks should simplify this.The steps that have to be done are listed below. We are using user assigned managed identity (MI), but I assume this should work for Azure Servic...
- 1 kudos
- 2338 Views
- 1 replies
- 0 kudos
When are DLT going to support multiple targets
Due to the limitations with all output data needing to be stored in one target we have stopped using DLT until more flexibility is added. If anyone has a workaround we are open to suggestions.
- 2338 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi Zavi,One potential workaround is to establish multiple DLT pipelines, with each pipeline specifically configured to point to a unique target. This approach effectively allows for a diverse range of output data to be stored across various targets.T...
- 0 kudos
