Table Refresh UI Error
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-17-2023 04:12 AM
Within the UI it is possible to "Select tables for refresh" for a specific Delta Live Tables Workflow. I often use it to make a full refresh on smaller tables during development. Unfortunately, when an error occurs during the full refresh on selected tables, the pipeline is not displayed within the UI anymore and I can't retry the full refresh on specific tables. In that case it is only possible to full refresh the whole pipeline. Is this a known issue/is there a planned fix?
- Labels:
-
Databricks UI
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-06-2023 11:37 AM
Could you please share the full error stack trace? it will help us to narrow down the issue
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-14-2023 06:23 AM
In this case we just need to cause an error of any type where the pipeline doesn't execute and then in the UI it no longer shows an option to refresh a specific table, leaving only a full refresh as an option. In this case we removed the specification of which instance type the pipeline uses and this causes a quota error and yields the situation that I was describing.
Here is a screenshot that shows when the pipeline fails that the UI no longer offers a way to select which table to refresh.

