cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Schedule a Notebook Dashboard

ehpogue
New Contributor III

Hey all,

I have a workflow that updates a delta table, and then runs a notebook that generates a dashboard. I was hoping that by adding this second step that the dashboard would get updated to show the most current data, instead of the user needing to click the `Update` button. But it seems per this convo that when a notebook runs in workflow it is a copy of the actual notebook and not the notebook itself, so it doesn't update the widgets or the dashboard. 

Is there a way to schedule the notebook such that the dashboard will have current data without the need to click `Update`?

3 REPLIES 3

ehpogue
New Contributor III

Hey,

So I tested out your #2 solution, which is the one for the current situation - where I have a dashboard built off of a notebook - and it's not what I'm looking for. That's the equivalent of sending a report. I'm looking to trigger the equivalent of pressing the `update` button in the UI in `presentation mode`. The reason is that it is an interactive notebook where the user can use widgets to change the viz in the dashboard. The user doesn't want to have to click the `update` button every time to get the updated data, wait for all the visualizations to update, and then be able to use the widgets.

trevormccormick
New Contributor III

Yes this is horrible UX. Scheduled a notebook dashboard to refresh daily. The scheduled automation will run the job for the notebook, but the dashboard points to the old notebook table output. I realize this cell output probably has a new backend ID but there has to be a way for Databricks to have two IDs for this table if it is used in a dashboard. My dashboard takes 25 mins to run and the user is not going to wait for that

trevormccormick
New Contributor III

@ehpogue at the end of the day I just used chatgpt to rewrite a bunch of python code into SQL and mash together all of the temporary views into one giant query. hacky but it did work

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group