05-25-2022 03:31 AM
Hello,
I would like to integrate Databricks Delta Live Tables with Eventhub, but i cannot install com.microsoft.azure:azure-eventhubs-spark_2.12:2.3.17 on delta live cluster.
I tried installed in using Init script (by adding it in Json cluster settings but currently init scripts are not supported
"init_scripts": [
{
"dbfs": {
"destination": "dbfs:/FileStore/Init_scripts/install_eventhub_library.sh"
}
}
]
Is it possible to install jars using pip?
I also tried install it by dbutils.library.install(dbfs_path) but ity's also only for python packages.
Are there other ways to install the jar/maven library on DLT cluster?
05-26-2022 01:48 AM
Ok, i got an answer on stackoverflow 🙂 https://stackoverflow.com/questions/72360893/delta-live-tables-with-eventhub
05-26-2022 01:48 AM
Ok, i got an answer on stackoverflow 🙂 https://stackoverflow.com/questions/72360893/delta-live-tables-with-eventhub
05-26-2022 03:22 AM
Hi @Kacper Mucha , I'm glad you got the solution, and thank you for sharing it on this platform.
05-26-2022 03:22 AM
Hi @Kacper Mucha, Would you please mark your answer as the best?
05-26-2022 06:11 AM
Done 🙂
05-26-2022 03:00 AM
I think this has some details https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-spark-tutorial @Kacper Mucha is the issue resolved ?
05-26-2022 06:11 AM
Yes, issue has been resolved, Thank you
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group