- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-15-2025 07:40 PM
Hi Shreevani,
As per my understanding, it’s happening because serverless compute doesn’t currently support the apply_changes() API in DLT pipelines. That method is part of advanced SCD (Slowly Changing Dimension) features, which are only available on dedicated job compute, not serverless. Since you’re using a trial workspace and running into quota limits, it makes sense that you switched to serverless, but unfortunately, this feature isn’t supported there. A good workaround would be to either request a temporary quota increase from Azure so you can try a dedicated cluster, or rewrite your logic using standard MERGE statements inside a DLT function to simulate SCD behavior. It’s a bit more manual but works well when you're limited by serverless capabilities. Let me know if you’d like help adjusting the code—happy to guide you!
Regards,
Brahma