cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Internal error: Attach your notebook to a different compute or restart the current compute.

aayusha3
New Contributor II

I am currently using a personal computer cluster [13.3 LTS (includes Apache Spark 3.4.1, Scala 2.12)] on GCP attached to a notebook. After running a few command lines without an issue, I end up getting this error

Internal error. Attach your notebook to a different compute or restart the current compute.
java.lang.RuntimeException: abort: DriverClient destroyed 
at com.databricks.backend.daemon.driver.DriverClient.$anonfun$poll$3(DriverClient.scala:577) 	at scala.concurrent.Future.$anonfun$flatMap$1(Future.scala:307) 	at scala.concurrent.impl.Promise.$anonfun$transformWith$1(Promise.scala:54) 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:77) 	at com.databricks.threading.DatabricksExecutionContext$InstrumentedRunnable.run(DatabricksExecutionContext.scala:36) 	at com.databricks.threading.NamedExecutor$$anon$2.$anonfun$run$2(NamedExecutor.scala:366) 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) 	at com.databricks.logging.UsageLogging.withAttributionContext(UsageLogging.scala:420) 	at com.databricks.logging.UsageLogging.withAttributionContext$(UsageLogging.scala:418) 	at com.databricks.threading.NamedExecutor.withAttributionContext(NamedExecutor.scala:285) 	at com.databricks.threading.NamedExecutor$$anon$2.$anonfun$run$1(NamedExecutor.scala:364) 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) 	at com.databricks.context.integrity.IntegrityCheckContext$ThreadLocalStorage$.withValue(IntegrityCheckContext.scala:44) 	at com.databricks.threading.NamedExecutor$$anon$2.run(NamedExecutor.scala:356) 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) 	at java.base/java.lang.Thread.run(Thread.java:829)

 Within the databricks UI, I get the following errors: 

aayusha3_0-1700256903637.png

When I restart my cluster, I am able to run queries without any errors 10-15 times but then I end up getting this same error again. I tried running my queries with a new cluster but i face the same errors after 10-15 runs.

This seems to be a user isolated error since a colleague tried using his own personal compute cluster and was able to run queries without any issues. 

Here are the things I have tried so far while logged into my accounting:

  1. Creating a completely new cluster -- Still having issues after a couple of queries
  2. Restarting my existing cluster -- Still having issues after a couple of queries 
  3. Open a new incognito tab and run queries -- Still get the same errors 

Only thing left for me to test is try logging into Databricks and running my queries on a separate device. 

Please let me know if anyone else has faced this issue previously and if there is any way to resolve this. 

Thanks,

1 REPLY 1

Hey Kaniz, 

Here is my cluster configuration

aayusha3_0-1700489294568.png

And here are the advanced options 

aayusha3_1-1700489349831.png

aayusha3_2-1700489375277.png

Logging and Init Scripts are set to default and the Google Service Account is linked to my databricks-artifact-registry

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group