cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

dataslicer
by Contributor
  • 5873 Views
  • 7 replies
  • 3 kudos

Resolved! Successfully installed Maven:Coordinates:com.crealytics:spark-excel_2.12:3.2.0_0.16.0 on Azure DBX 9.1 LTS runtime but getting error for missing dependency: org.apache.commons.io.IOUtils.byteArray(I)

I am using Azure DBX 9.1 LTS and successfully installed the following library on the cluster using Maven coordinates: com.crealytics:spark-excel_2.12:3.2.0_0.16.0When I executed the following line:excelSDF = spark.read.format("excel").option("dataAdd...

  • 5873 Views
  • 7 replies
  • 3 kudos
Latest Reply
RamRaju
New Contributor II
  • 3 kudos

Hi @dataslicer  were you able to solve this issue?I am using 9.1 lts databricks version with Spark 3.1.2 and scala 2.12. I have installed com.crealytics:spark-excel-2.12.17-3.1.2_2.12:3.1.2_0.18.1.  It was working fine but now facing same exception a...

  • 3 kudos
6 More Replies
Anonymous
by Not applicable
  • 1386 Views
  • 2 replies
  • 2 kudos

Data source V2 streaming is not supported on table acl or credential passthrough clusters

Using:( hostname is hidden )kafka = spark.readStream\    .format("kafka")\    .option("kafka.sasl.mechanism", "SCRAM-SHA-512")\    .option("kafka.security.protocol", "SASL_SSL")\    .option("kafka.sasl.jaas.config", f'org.apache.kafka.common.security...

  • 1386 Views
  • 2 replies
  • 2 kudos
Latest Reply
Hubert-Dudek
Esteemed Contributor III
  • 2 kudos

With TACL enabled cluster, you got many restrictions, so streaming will not work. Generally, you can read only things registered in metastore; please disable it for your use case,Additionally, remember that the unity catalog doesn't support streaming...

  • 2 kudos
1 More Replies
Labels