cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Table Refresh UI Error

BenLambert
Contributor

Within the UI it is possible to "Select tables for refresh" for a specific Delta Live Tables Workflow. I often use it to make a full refresh on smaller tables during development. Unfortunately, when an error occurs during the full refresh on selected tables, the pipeline is not displayed within the UI anymore and I can't retry the full refresh on specific tables. In that case it is only possible to full refresh the whole pipeline. Is this a known issue/is there a planned fix?

2 REPLIES 2

jose_gonzalez
Databricks Employee
Databricks Employee

Could you please share the full error stack trace? it will help us to narrow down the issue

In this case we just need to cause an error of any type where the pipeline doesn't execute and then in the UI it no longer shows an option to refresh a specific table, leaving only a full refresh as an option. In this case we removed the specification of which instance type the pipeline uses and this causes a quota error and yields the situation that I was describing.

Here is a screenshot that shows when the pipeline fails that the UI no longer offers a way to select which table to refresh.

MicrosoftTeams-image 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group