I am trying to create a SQL Dashboard on top of a streaming dataset (Delta format). I created multiple queries referencing the file on the datalake, not a hive table. With these queries I created multiple visualizations in a Databricks SQL Dashboard. I added an automated refresh, as the new data in the streaming dataset needs to be displayed as fast as possible. This should refresh the data every 1 minute (More real time would be nice, but 1 minute works).

I would like to keep the dashboard open, so that I always have the visuals showing the data that has been refreshed less than one minute ago. However, the refresh keeps loading. The screenshot below shows that there is a refresh symbol going on at every visual, but the data is not being refreshed. In the screenshot it seems that the refresh is already taking more than 7 minutes.

If I click manually on the refresh button on the top right corner of the dashboard, the refresh takes never more than 10 seconds.

My question is, is this expected behaviour? Do we need to refresh the browser page before we can see the updates of the Dashboard Refresh? Am I doing something wrong? Or is this just a bug?