Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-14-2025 03:37 AM
I did try as you suggested: create an if/else, forward to same tasks with full refresh option on/off. This worked well, but something I considered as duplicated tasks creation and state change management for criteria check. I would prefer a neat workaround to easily apply with Terraform for massive jobs provision.
It is more of a code management and future expansion problem. If Databricks has the option for one time full refresh, it would be a relief.
Appreciate your suggestion. I guess this could be handled better on my side for now.