โ05-25-2022 03:31 AM
Hello,
I would like to integrate Databricks Delta Live Tables with Eventhub, but i cannot install com.microsoft.azure:azure-eventhubs-spark_2.12:2.3.17 on delta live cluster.
I tried installed in using Init script (by adding it in Json cluster settings but currently init scripts are not supported
"init_scripts": [
{
"dbfs": {
"destination": "dbfs:/FileStore/Init_scripts/install_eventhub_library.sh"
}
}
]
Is it possible to install jars using pip?
I also tried install it by dbutils.library.install(dbfs_path) but ity's also only for python packages.
Are there other ways to install the jar/maven library on DLT cluster?
โ05-26-2022 01:48 AM
Ok, i got an answer on stackoverflow ๐ https://stackoverflow.com/questions/72360893/delta-live-tables-with-eventhub
โ05-26-2022 01:48 AM
Ok, i got an answer on stackoverflow ๐ https://stackoverflow.com/questions/72360893/delta-live-tables-with-eventhub
โ05-26-2022 06:11 AM
Done ๐
โ05-26-2022 03:00 AM
I think this has some details https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-spark-tutorial @Kacper Muchaโ is the issue resolved ?
โ05-26-2022 06:11 AM
Yes, issue has been resolved, Thank you
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group