Schedule a Notebook Dashboard

[ehpogue]

Hey all,

I have a workflow that updates a delta table, and then runs a notebook that generates a dashboard. I was hoping that by adding this second step that the dashboard would get updated to show the most current data, instead of the user needing to click the `Update` button. But it seems per this convo that when a notebook runs in workflow it is a copy of the actual notebook and not the notebook itself, so it doesn't update the widgets or the dashboard. 

Is there a way to schedule the notebook such that the dashboard will have current data without the need to click `Update`?

[Kaniz]

Hi @ehpogue , 

Certainly! Let’s explore some options to update your dashboard without manual intervention automatically:

1. Scheduled Notebook Jobs:

   • In Databricks, you can create scheduled notebook jobs that run periodically. These jobs execute the notebook and can be used to refresh the data linked to your dashboard.
   • To set up a scheduled job:
     • Open your notebook.
     • Click on the Schedule button at the top right.
     • If no jobs exist for this notebook, the Schedule dialogue will appear. If jobs already exist, the Jobs List dialogue will show up.
     • In the Schedule dialog, you can optionally enter a name for the job and configure the frequency of e...
   • By scheduling the notebook, you ensure the dashboard reflects the most current data without manual intervention.

2. Dashboard Based on Job Run Results:

   • While sharing dashboards, consider using the job run results. Here’s how:
     • Create a dashboard based on the visualizations in your notebook.
     • Schedule runs of the notebook (e.g., daily or hourly).
     • Add users to the job run notifications (only for successful runs).
     • Please provide them with an illustrated guide on accessing the dashboard view from the email notification.
     • The dashboard link will be something like /run/latestSuccess/dashboard/{dashboard_id}.
   • This approach allows you to share an updated dashboard with non-coder audiences.

3. Real-Time Updating:

   • If your data sources support it, consider real-time updating. For instance:
     • Specify the update frequency when reading data from URLs, SQL, or cloud drives.
     • Write code in your notebook to determine when data updates occur.
   • Following these instructions, you can keep your dashboard data up-to-date.

Remember to choose the approach that best fits your requirements and audience. Happy dashboarding! 📊🚀