cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Delta Sharing CDF API error: "RESOURCE_LIMIT_EXCEEDED"

Data_Analytics1
Contributor III
Hi,
 
When attempting to read a particular version from the Databricks Delta Sharing CDF (Change Data Feed) API, even when that version contains only one data file, an error occurs due to a timeout with following message:

"errorCode": "RESOURCE_LIMIT_EXCEEDED",
"message": "A timeout occurred when processing the table after 3 updates across 1 iterations. If it continues to happen, please contact your data provider and request them to optimize their table so that it has fewer files."
 
API:
2 REPLIES 2

MaxGendu
New Contributor II

Hi Data_Analytics1

Use Optimize on your delta tables. Refer https://docs.databricks.com/en/sql/language-manual/delta-optimize.html

Hi @MaxGendu ,

I executed OPTIMIZE command on the delta table but it only optimizes or merge the data files of current snapshot. Version data files are not get affected or optimized by this OPTIMIZE command.

Even the specific version is only having one data file so even after optimizing it will still be the same. 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group