- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
a week ago
Hi,
I just had a look at this to see if we had any reports of it internally but we don't have anything similar in terms of low level noise. Just when it breaks the pipeline entirely. I think your diagnosis is probbaly close to what's happening.
I think in this case you're absolutely right to go down the support ticket request, there may be some changes they can make to stop this or things they know.
The only thing that did come up in my research which may be worth a try is chaging the channel in the pipeline from preview to current (if it is set on current), when things are failing altogether, there were some signs that this helped. https://docs.databricks.com/aws/en/release-notes/dlt/ There has been some very recent improvement to how connection pools are working, recently so worth double checking this is still an issue. But otherwised definitely a support ticket question.
Once you get a solution would be good for you to come back here and post for others to benefit too.