- 4531 Views
- 3 replies
- 2 kudos
How to attach multiple libraries to a cluster terraform in Databricks
I'm currently trying to attach more than one maven artifact to my terraform configuration of a cluster.How can we add more than one artifact in my terraform configuration ?
- 4531 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @KunalGaurav,This can be done by using a dynamic configuration block inside your databricks_cluster resource definition.In variable.tf make a library block as:-variable "listOfMavenPackages" { type = list(string) default = [ "com.google.gua...
- 2 kudos
- 3486 Views
- 2 replies
- 2 kudos
Resolved! Does Databricks have a maven repository to download the jars?
Using OSS jars is causing classpath issues always when running the job on Databricks. The same job works fine on EMR/on-premise.
- 3486 Views
- 2 replies
- 2 kudos
- 2 kudos
I following the https://docs.databricks.com/dev-tools/databricks-connect.html#intellij-scala-or-java to obtain spark-avro jar since databricks have it's custom from_avro method to use with kafka schema registry, But i am not able to find spark-avro j...
- 2 kudos