Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-07-2024 07:50 AM
We got a performance boost with the latest DLT preview release, see https://community.databricks.com/t5/data-engineering/thank-you-for-the-quot-setting-up-tables-quot-s...
With my 300 table test setup, this speedup was consistent.
I'm currently testing with 900 tables (there's a 1000 table limit for a DLT pipeline) to see how it goes, but I am also considering trying it without DLT.