I’m migrating a solution from an on-prem setup to Databricks AI/BI Dashboards, and I’m trying to replicate a near real-time dashboard experience (around ~1 minute latency is acceptable).

In the legacy setup, we used DirectQuery combined with automatic page refresh, which allowed visuals to update continuously without manual intervention.

What I’ve tried

1. Dashboard refresh via job (DAB task)
   • The job executes successfully every minute
   • However, the dashboard visuals do not reflect updated data afterwards
2. Scheduled refresh on published dashboard
   • The schedule runs as expected
   • But the dashboard still does not update in the UI unless I manually refresh the browser (F5)

Questions

Is this expected behavior for AI/BI dashboards in Databricks? That is, is it really not possible to have a "live" view of a dashboard without having to manually refersh the page even when a schedule is configured?