Hello @Malthe @Saska @MehdiJafari

When it was showing such error, did you try any alternative methods like using databricks service credentials. 

For example 

stream = spark.readStream.format("cloudFiles")

  .option("cloudFiles.format", "json")

  .option("databricks.serviceCredential", "my-storage-credential")

  .option("cloudFiles.useNotifications", "true")

  .option("cloudFiles.resourceGroup", "my-rg")

  .option("cloudFiles.subscriptionId", "my-sub-id")

  .load("abfss://container@storageaccount.dfs.core.windows.net/path/")