Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-23-2022 04:55 AM
Yes correct checpoint is for writeStream + display. When you don't specify in display it use some default location.
Have you installed latest version of com.microsoft.azure:azure-eventhubs-spark library?
I am including also connection to event hub which I am using:
ehConf = {}
ehConf['eventhubs.connectionString'] = sc._jvm.org.apache.spark.eventhubs.EventHubsUtils.encrypt("Endpoint=sb://sla-stream.servicebus.windows.net/;SharedAccessKeyName=xxxx;SharedAccessKey=xxxxx;EntityPath=xxxx")
My blog: https://databrickster.medium.com/