cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

findinpath
by Contributor
  • 4280 Views
  • 4 replies
  • 4 kudos

Resolved! Databricks 2.6.25 JDBC driver can't create tables with `GENERATED` columns

I'm using the Databricks JDBC driver recently made available via Maven:https://mvnrepository.com/artifact/com.databricks/databricks-jdbc/2.6.25While trying to create a table with `GENERATED` columns I receive the following exception:Caused by: java.s...

  • 4280 Views
  • 4 replies
  • 4 kudos
Latest Reply
findinpath
Contributor
  • 4 kudos

I was under the impression that this has been recognised as a BUG and is being handled by Databricks.What do I need to do for reporting the issue officially as a BUG?

  • 4 kudos
3 More Replies
brendan-b
by New Contributor II
  • 7497 Views
  • 4 replies
  • 3 kudos

spark-xml not working with Databricks Connect and Pyspark

Hi all,I currently have a cluster configured in databricks with spark-xml (version com.databricks:spark-xml_2.12:0.13.0) which was installed using Maven. The spark-xml library itself works fine with Pyspark when I am using it in a notebook within th...

  • 7497 Views
  • 4 replies
  • 3 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 3 kudos

Hi @Brendan Banfield​ , This article describes how to read and write an XML file as an Apache Spark™ data source.

  • 3 kudos
3 More Replies
findinpath
by Contributor
  • 2782 Views
  • 9 replies
  • 4 kudos

Resolved! Please share Databricks JDBC Driver on Maven Central

Can you please share the Databricks JDBC Driver on Maven Central ?I see it available on : https://databricks.com/spark/jdbc-drivers-download . However I can’t find it on Maven Central to make use of it in automated tests connecting to Databricks infr...

  • 2782 Views
  • 9 replies
  • 4 kudos
Latest Reply
findinpath
Contributor
  • 4 kudos

Thank you for the assistance and for releasing the jdbc driver to Maven Central.I consider the issue closed.

  • 4 kudos
8 More Replies
Celia
by New Contributor II
  • 1338 Views
  • 2 replies
  • 1 kudos

how to include a third-party Maven package in MLflow model serving job cluster in Azure Databricks

We try to use MLflow Model Serving, this service will enable realtime model serving behind a REST API interface; it will launch a single-node cluster that will host our model. The issue happens when the single-node cluster try to get the environment...

  • 1338 Views
  • 2 replies
  • 1 kudos
Latest Reply
BeardyMan
New Contributor III
  • 1 kudos

Unfortunately we came across this same issue. We were trying to use MLFlow Serve to produce an API that could take text input and pass it through some NLP. In this instance we had installed a maven package on the cluster, so the experiment would run ...

  • 1 kudos
1 More Replies
brickster_2018
by Esteemed Contributor
  • 843 Views
  • 1 replies
  • 0 kudos

Maven library conflicts

The import statements work fine with maven libraries freshly installed on a running cluster and on restart of the same cluster, it fails to import the classes.

  • 843 Views
  • 1 replies
  • 0 kudos
Latest Reply
brickster_2018
Esteemed Contributor
  • 0 kudos

When you install maven libraries one by one in running clusters, it is resolved and gets downloaded individually. The behavior would be different when you restart the clusters since the libraries are resolved together and can run into issues due to c...

  • 0 kudos
Labels