- 5478 Views
- 2 replies
- 2 kudos
Resolved! com.databricks.NotebookExecutionException: FAILED
I am running the comparisons but I get an error, I am working from a databricks notebook.Could someone help me to solve the following error:com.databricks.WorkflowException: com.databricks.NotebookExecutionException: FAILED: Notebook not found: /user...
- 5478 Views
- 2 replies
- 2 kudos
- 2 kudos
two things that come to mind:1. the notebook resides on another path than '/users/cuenta_user/user/Tests'2. the notebook is not saved as a notebook but rather as an ordinary python file
- 2 kudos
- 2273 Views
- 0 replies
- 0 kudos
Databricks Assistant HIPPA? Future Cost?
With the Public Preview of Databricks Assistant, I have a few questions. 1) If the Azure Tenet is HIPPA compliant does that compliance also include the Databricks Assistant features? 2) Right now the product is free but what will the cost be? Will we...
- 2273 Views
- 0 replies
- 0 kudos
- 3511 Views
- 3 replies
- 1 kudos
Liquid Clustering
Hi Team,Could you please help us understand,1)Performance benchmarks of liquid clustering compared to z-order and partition.2)How much cost it incurs/saves compared to z-order and partitionRegards,Phanindra
- 3511 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Phani1 ,You can find performance related benchmarking here : https://www.databricks.com/blog/announcing-delta-lake-30-new-universal-format-and-liquid-clustering
- 1 kudos
- 2106 Views
- 0 replies
- 0 kudos
Intermittent (cert) failure when connecting to AWS RDS
I've just upgraded a bunch of jobs to 12.2 LTS runtime and now getting intermittent failures with the following message:```java.sql.SQLException: [Amazon](600000) Error setting/closing connection: PKIX path building failed: sun.security.provider.cert...
- 2106 Views
- 0 replies
- 0 kudos
- 11538 Views
- 0 replies
- 0 kudos
what are the different types life_cycle_state in databricks for job cluster
We are trying to get cluster life_cycle_state using API and we are able to get various values as belowRUNNINGPENDINGTERMINATEDINTERNAL_ERRORIs there any other values apart from above values it would be a great help.
- 11538 Views
- 0 replies
- 0 kudos
- 2550 Views
- 1 replies
- 2 kudos
create UDF in pyspark
Hi, Need the help of this community, unfortunately creating udfs is not my strongest skill set.I need to create UDF that will join two tables together, the problem is that one table has two id columns Name Table has id1 and id2 Transaction Table has ...
- 2550 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi,I am not sure if I understand your question directly but let me give it a try:- The constraint is if id2 in name table populated then join with id2: So I think you can also could first make a column called 'id' in which you get id2 if it is popula...
- 2 kudos
- 10256 Views
- 3 replies
- 1 kudos
Want to disable cell scrollers.
There are two scrollers visible in my notebook, 1 for cell and another is for notebook. How can i disable cell scroller sicne i am having a hard time to navigate to my code scrolling the cell every time.
- 10256 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Mahajan What exactly do you mean by disabling the cell scroll ? If and all there is an option as such, then it basically means you can't scroll the cell at all and the cell view is fixed. This makes the cell redundant as at any given point of ti...
- 1 kudos
- 7389 Views
- 6 replies
- 0 kudos
Databricks Cluster is going down after installing the external library
I have created a Databricks cluster with below configurations.Databricks Runtime Version13.2 ML (includes Apache Spark 3.4.0, Scala 2.12)Node typei3.xlarge30.5 GB Memory, 4 CoresI created a notebook and trying to load the Mysql table which resides i...
- 7389 Views
- 6 replies
- 0 kudos
- 0 kudos
Hi, The below error describes that there is an issue connecting to the host from Databricks, you can find more details about the network configurations here at https://docs.databricks.com/administration-guide/cloud-configurations/aws/customer-managed...
- 0 kudos
- 2327 Views
- 1 replies
- 2 kudos
Resolved! Setting cluster permissions with API
I would like to update the permissions of a cluster using the API. Documentation mentions the following: patch api/2.0/permissions/{request_object_type}/{request_object_id}.Which {request_object_type} to use? ‘cluster’, ‘cluster’ and ‘compute’ are no...
- 2327 Views
- 1 replies
- 2 kudos
- 2 kudos
@KoenZandvliet clusters is the one you should be looking for.
- 2 kudos
- 6213 Views
- 5 replies
- 3 kudos
Resolved! Databricks Certified Data Engineer Associate (Version 2) Exam got suspended
Hi Team,My Databricks Certified Data Engineer Associate (Version 2) exam got suspended today and it is in suspended state.I was there continuously in front of the camera and suddenly the alert appeared and support person asked me to show the full tab...
- 6213 Views
- 5 replies
- 3 kudos
- 3 kudos
Hi @Retired_mod ,I've been into the same situation as Shifa and I've also raised ticket with Databricks but no feedback yet!Can you please help on that?Cheers,Rabie
- 3 kudos
- 1054 Views
- 0 replies
- 0 kudos
java.net.SocketTimeoutException at java.net.SocketInputStream.socketRead
Databricks notebook is configured with ADLS gen2 using Service principal authentication and is able to read/write files to ADLS gen2. However, occasionally, we are seeing below errors in the production environment:java.net.SocketTimeoutException at j...
- 1054 Views
- 0 replies
- 0 kudos
- 1218 Views
- 0 replies
- 0 kudos
Spark English SDK in Databricks Community edition
Feel free to read an article on how you can use English sdk for apache spark in databricks community edition.link: English_SDK_For_Apache_Spark
- 1218 Views
- 0 replies
- 0 kudos
- 1812 Views
- 2 replies
- 0 kudos
Cannot access community account
Resetting password does not work. After I enter my new password, it just keeps processing. I waited for over 10 minutes, tried on different browsers, tried on a VPN, nothing works. Also this randomly happened. I didnt forget my password, just the sys...
- 1812 Views
- 2 replies
- 0 kudos
- 4730 Views
- 2 replies
- 0 kudos
Resolved! How to generate schema with org.apache.spark.sql.functions.schema_of_csv?
Hello, I use spark 3.4.1-hadooop 3 on windows 11. And I am struggling to generate the schema of csv data with schema_of csv function. Below is my java codes. Map<String, String> kafkaParams = new HashMap<>(); kafkaParams.put("kafka.bootstrap.servers"...
- 4730 Views
- 2 replies
- 0 kudos
- 0 kudos
I use org.apache.spark.sql.functions.lit method and solve this issue. Thank you any way.
- 0 kudos
- 797 Views
- 0 replies
- 0 kudos
"Something went wrong"
I've made two fresh accounts on DataBricks and am stuck here for both when I try to login. I've never used DataBricks before. This problem occurs on 3 different browsers across 2 PCs.This is not the place to post such a question, sorry! But, I haven'...
- 797 Views
- 0 replies
- 0 kudos
