I've created an external table that points to an XML file on the ADLS. I've installed spark-xml library on my cluster. I can query the table on the cluster.
However, I cannot query the table on Databricks SQL. I get the following error. I suppose the spark-xml library should also be installed on the SQL endpoint, however there is no option to do so. Is there any way to install the library on the end point ?
java.util.concurrent.ExecutionException: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark.apache.org/third-party'. (35) (SQLExecDirectW)