Trigger Dashboard Update At The End of a Workflow

[cool_cool_cool]

Heya 🙂
I have a workflow that computes some data and writes to a delta table, and I have a dashboard that is based on the table. How can I trigger refresh on the dashboard once the workflow is finished?

Thanks!

[ThomazRossito · Accepted solution]

Hello,

in your workflow it is possible to end with a SQL task and in the SQL Task item you can select some options, see the image below:

[Kaniz_Fatma]

Hi @cool_cool_cool, To ensure your dashboard reflects the most up-to-date data after your Databricks workflow completes, consider the following options:

1. Scheduled Notebook Refresh:

   • Dashboards do not automatically live-refresh when presented from the dashboard view.
   • Instead, you can schedule the notebook that generates the dashboard graphs to refresh at specified intervals.
   • By doing so, the dashboard will update with the latest data once the notebook execution completes¹.

2. Workflow Automation:

   • Set up a workflow that includes both your data computation and dashboard generation.
   • Once your data computation finishes, trigger the dashboard generation as the next step in your workflow.
   • This ensures that the dashboard is refreshed with the most recent data².

3. Custom Job or Trigger:

   • Create a custom job or trigger that monitors the completion of your data computation workflow.
   • When the workflow finishes, programmatically initiate the dashboard refresh.
   • You can achieve this by invoking the appropriate API or triggering an event in your dashboard system³.

Remember to choose the approach that best aligns with your specific requirements and existing infrastructure. Happy dashboarding! 📊🚀