Delta Live Tables with EventHub

repcak
New Contributor III

Hello,

I would like to integrate Databricks Delta Live Tables with Eventhub, but i cannot install com.microsoft.azure:azure-eventhubs-spark_2.12:2.3.17 on delta live cluster.

I tried installed in using Init script (by adding it in Json cluster settings but currently init scripts are not supported

"init_scripts": [

            {

                "dbfs": {

                    "destination": "dbfs:/FileStore/Init_scripts/install_eventhub_library.sh"

                }

            }

        ]    

imageIs it possible to install jars using pip?

I also tried install it by dbutils.library.install(dbfs_path) but ity's also only for python packages.

Are there other ways to install the jar/maven library on DLT cluster?

repcak
New Contributor III

Done 🙂

Atanu
Databricks Employee
Databricks Employee

I think this has some details https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-spark-tutorial @Kacper Mucha​ is the issue resolved ?

repcak
New Contributor III

Yes, issue has been resolved, Thank you