cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
Data_Analytics1
by • Contributor III
  • 30071 Views
  • 10 replies
  • 10 kudos

Failure starting repl. How to resolve this error? I got this error in a job which is running.

Failure starting repl. Try detaching and re-attaching the notebook.java.lang.Exception: Python repl did not start in 30 seconds. at com.databricks.backend.daemon.driver.IpykernelUtils$.startIpyKernel(JupyterDriverLocal.scala:1442) at com.databricks.b...

Data Engineering
Reply
  • 30071 Views
  • 10 replies
  • 10 kudos
View Replies
Latest Reply
PabloCSD
Contributor II
  • 10 kudos

I have had this problem many times, today I made a copy of the cluster and it got "de-saturated", it could help someone in the future

  • 10 kudos
9 More Replies
kishorekumar
by • New Contributor
  • 1596 Views
  • 1 replies
  • 0 kudos

Silent failure in DataFrameWriter when loading data to Redshift

Context:I'm using DataFrameWriter to load the dataSet into the Redshift. DataFrameWriter writes the dataSet to S3, and loads data from S3 to Redshift by issuing the Redshift copy command. Issue:In frequently we are observing, the data is present in t...

Data Engineering
Reply
  • 1596 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Kishorekumar Somasundaram​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.

  • 0 kudos
liamod_1
by • New Contributor III
  • 53859 Views
  • 8 replies
  • 8 kudos

Resolved! Failure starting repl

Hi, we have several clusters that keep giving this error:Failure starting repl. Try detaching and re-attaching the notebook.All the investigation I've done points to this issue being related to the number of concurrent connections but we only have 1 ...

Data Engineering
Reply
  • 53859 Views
  • 8 replies
  • 8 kudos
View Replies
Latest Reply
liamod_1
New Contributor III
  • 8 kudos

@Aviral Bhardwaj​ thanks, this seemed to fix the issue, we had an innit script that was potentially conflicting with UI set libraries (in cluster settings).

  • 8 kudos
7 More Replies
powerus
by • New Contributor III
  • 5057 Views
  • 1 replies
  • 0 kudos

Resolved! "Failure to initialize configurationInvalid configuration value detected for fs.azure.account.key" using com.databricks:spark-xml_2.12:0.12.0

Hi community,I'm trying to read XML data from Azure Datalake Gen 2 using com.databricks:spark-xml_2.12:0.12.0:spark.read.format('XML').load('abfss://[CONTAINER]@[storageaccount].dfs.core.windows.net/PATH/TO/FILE.xml')The code above gives the followin...

Data Engineering
Reply
  • 5057 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
powerus
New Contributor III
  • 0 kudos

The issue was also raised here: https://github.com/databricks/spark-xml/issues/591A fix is to use the "spark.hadoop" prefix in front of the fs.azure spark config keys:spark.hadoop.fs.azure.account.oauth2.client.id.nubulosdpdlsdev01.dfs.core.windows.n...

  • 0 kudos
ossinova
by • Contributor II
  • 1865 Views
  • 1 replies
  • 1 kudos

Jobs failing with repl error

Recently my Databricks jobs have failed with the error message:Failure starting repl. Try detaching and re-attaching the notebook.   java.lang.Exception: Python repl did not start in 30 seconds seconds. at com.databricks.backend.daemon.driver.Ipyker...

Data Engineering
Reply
  • 1865 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 1 kudos

Yes, you can use re-try if still it's not resolve raise a support ticket to databricks

  • 1 kudos
dsura
by • Contributor
  • 7206 Views
  • 5 replies
  • 17 kudos

Resolved! Azure AAD token with Databricks for User defined managed Identity inside Docker Container

Hi, We are currently using a Azure AAD Token inorder to authenticate with Databricks instead of generating Personal Access Tokens from Databricks. We have a multi-tenant architecture and so we are using Azure container instances to run multiple trans...

Data Engineering
Reply
  • 7206 Views
  • 5 replies
  • 17 kudos
View Replies
Latest Reply
Debayan
Databricks Employee
  • 17 kudos

Hi, This looks like an old issue which we have faced earlier, Could you please update the DBR to the latest version and try again?

  • 17 kudos
4 More Replies
sauri
by • New Contributor III
  • 3013 Views
  • 6 replies
  • 4 kudos

Hello, I runn a notebook with datafactory and I have this error:Failure starting repl. Try detaching and re-attaching the notebook. But my notebook is...

Hello, I runn a notebook with datafactory and I have this error:Failure starting repl. Try detaching and re-attaching the notebook.But my notebook is attachingCan I attach notebook with a comand o r code ?

Data Engineering
Reply
  • 3013 Views
  • 6 replies
  • 4 kudos
View Replies
Latest Reply
Anonymous
Not applicable
  • 4 kudos

Hey @oscar alvarez​ Thank you so much for getting back to us. It's really great of you to send in the solution. Would you be happy to mark it as best so that other members can find the solution more quickly?We really appreciate your time.Wish you a g...

  • 4 kudos
5 More Replies
MxSasch
by • New Contributor II
  • 7399 Views
  • 11 replies
  • 5 kudos

Cluster terminated.Reason:Unexpected launch failure

Is there any known issues affecting the creation of clusters? I've been unable to get any clusters to start today so far!Have received this error "Cluster terminated.Reason:Unexpected launch failure"Help!

Data Engineering
Reply
  • 7399 Views
  • 11 replies
  • 5 kudos
View Replies
Latest Reply
AWe
New Contributor II
  • 5 kudos

good

  • 5 kudos
10 More Replies
arkadiuszr
by • New Contributor III
  • 2656 Views
  • 3 replies
  • 1 kudos

Resolved! Failure during cluster launch

Hi all,I am migrating to Databricks E2 from older one. I moved the cluster definitions from the old databricks instance as well as creating new ones. Databricks tries to start a cluster for an hour and then fails. This happens for modes: Single Node ...

Data Engineering
Reply
  • 2656 Views
  • 3 replies
  • 1 kudos
View Replies
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 1 kudos

Please check:CPU quotas, please request to increase them anyway https://go.aws/3EvY1fX and use pools to have better control as old instances can be there for a moment after termination,Check the network configuration. Maybe it is downloading somethin...

  • 1 kudos
2 More Replies
Labels