Databricks Community

YSDPrasad · 03-10-2023

Hi all,Currently we are using Driver: Standard_D32s_v3 · Workers: Standard_D32_v3 · 2-8 workers · 6.4 Extended Support (includes Apache Spark 2.4.5, Scala 2.11) cluster. For this we are running 24/7 streaming notebook on trigger of every minute and 5...

YSDPrasad · 03-10-2023

import com.microsoft.azure.sqldb.spark.config.Configimport com.microsoft.azure.sqldb.spark.connect._import com.microsoft.azure.sqldb.spark.query._val query = "Truncate table tablename"val config = Config(Map( "url" -> dbutils.secrets.get(scope = ...

YSDPrasad · 03-21-2023

Yes suteja by adding additional jar files I can resolve this issue but while running the read and write operation by connecting sqldb there I am facing error. I found different code to execute truncate command now it is working fine.

YSDPrasad · 03-21-2023

Hi Suteja,We verified the code and removed unwanted command also still we are facing issue. We tried clear cache using spark.catalog.clearCache() this code. Still there is no change in cluster performance. Truncate table is now working fine. I found ...

Databricks Community

User Stats

User Activity

Facing issue While executing DDL and DML queries in 12.0 cluster runtime version.

NoClassDefFoundError: scala/Product$class

Re: NoClassDefFoundError: scala/Product$class

Re: Facing issue While executing DDL and DML queries in 12.0 cluster runtime version.