topic Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe in Data Engineering

Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe hash

ahsan_aj — Tue, 20 Aug 2024 12:55:12 GMT

Hi All,

I am using Databricks Connect 14.3.2 with Databricks Runtime 14.3 LTS to execute the code below. The CSV file is only 7MB, the code runs without issues on Databricks Runtime 15+ clusters but consistently produces the error message shown below when using 14.3 LTS. Please advise.

SparkConnectGrpcException: (org.apache.spark.sql.connect.common.InvalidPlanInput) Not found any cached local relation with the hash: hash_guid in the session with sessionUUID session_guid.

import pandas as pd from databricks.connect import DatabricksSession cluster_id = '*****' user_token = "*******" host = 'https://***********.azuredatabricks.net/' sp = DatabricksSession.builder.remote(host = host,cluster_id = cluster_id,token = user_token).getOrCreate() df = sp.createDataFrame(pd.read_csv("C:\\temp\\data.csv")) df.show(5)

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

MichalMazurek — Tue, 20 Aug 2024 15:46:02 GMT

Same here, it was working yesterday, stopped Today.

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

MichalMazurek — Tue, 20 Aug 2024 20:29:48 GMT

I managed to upload data in batches of 500 rows.

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

ahsan_aj — Wed, 21 Aug 2024 05:17:51 GMT

Same here, it stopped working since yesterday. I can confirm it works with smaller data sets. Has there been any communication from Databricks about this?

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

ahsan_aj — Wed, 21 Aug 2024 09:23:24 GMT

I've raised this issue with Databricks support, and they are currently investigating it.

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

Retired_mod — Wed, 21 Aug 2024 09:31:13 GMT

Hi @ahsan_aj and @MichalMazurek, We are looking into this. We will get back to you shortly.

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

KBoogaard — Thu, 22 Aug 2024 09:57:03 GMT

Any updates on this issue? I ran into the same problem. Scripts were running just fine and without any changes they stopped working with this error message.

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

ahsan_aj — Thu, 22 Aug 2024 10:46:39 GMT

@Retired_mod, is there any update on the issue ?

@KBoogaard, I raised this with Microsoft support, however they are unable to replicate the issue. I have a call with them on Monday.

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

ADuma — Thu, 22 Aug 2024 13:20:25 GMT

I'm having the same problem.
I create a Spark Dataframe from a pandas dataframe (10000 rows, between 500 and 800 columns) and want to upload them. Worked fine two weeks ago, now I'm getting the error. For some files it still works, others it works when reducing amount of rows and columns.

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

MichalMazurek — Thu, 22 Aug 2024 13:59:04 GMT

I got information from our Databricks manager, that this is a known issue that they are working on, although this takes a lot of time, for us it's a huge problem for going on production with this!

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

MichalMazurek — Fri, 23 Aug 2024 07:46:35 GMT

Hi @Retired_mod any news?

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

Sorhawell — Mon, 26 Aug 2024 12:26:00 GMT

To to convert pd df to a dict before passing on

E.g. createDataFrame(pd.read_csv('abc').to.dict())

In my case there was some non serializable attribute on pd df which is dropped when converting to dict.

Btw logging in here and answering was an insane obstacle. My large company subscription is set wrong so we can't login into community because our admin accounts does not have literal email accounts. Attempt to setup a personal account was only possible when not at all using the corp WiFi, I get kicked

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

MichalMazurek — Mon, 26 Aug 2024 17:11:27 GMT

Hi @Retired_mod, this a really bad support experience. Is this how Databricks support manages issues? I am currently thinking about using a different solution, this is an outage for several days now.

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

ahsan_aj — Mon, 26 Aug 2024 17:17:34 GMT

No updates from my side either. We're currently using the 15.4 LTS runtime, and it's working fine. The issue seems to be with the 14.3 LTS version only.

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

ahsan_aj — Thu, 29 Aug 2024 04:48:56 GMT

Microsoft support confirmed that the fix has been merged and is set for release on September 3rd.

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

trobin — Fri, 30 Aug 2024 14:59:40 GMT

Is this fix confirmed for other runtimes? I am having the same issue on 13.3 LTS.

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

ADuma — Thu, 05 Sep 2024 12:12:47 GMT

The error is now occuring for Cluster with Version 15.4. for me. Did the fix get released yet?

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

ahsan_aj — Thu, 05 Sep 2024 12:50:40 GMT

Unfortunately I don't have this information. I only raised it for 14.3 LTS since my databricks connect version is the same (14.3.1).

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

ahsan_aj — Thu, 05 Sep 2024 13:03:26 GMT

I don't think it has been released yet, and now I’m facing this issue on both 14.3 LTS and 15.4 LTS :(.

FYI @Retired_mod

Re: Databricks connect 14.3.2 SparkConnectGrpcException Not found any cached local relation withthe

asia_sowa — Thu, 05 Sep 2024 15:00:31 GMT

I have the same issue with 13.3 LTS version