Is Delta Live Tables (DLT) appropriate for data that is in the millions of rows and GB sized? Or is DLT only optimal for larger data with billions of rows and TB sized?
Please consider the Total Cost of Ownership.
- Development costs (engineering time)
- Operational costs (clusters, network, etc.)
- Maintenance costs