Standard tier was more for Big Data but the Premium tier is for Data Intelligence

Unity Catalog is the new baseline. Maintaining two different architectures mostly slows down R&D. By consolidating, Databricks can push out Data Intelligence and Gen AI features faster without worrying about legacy compatibility.

Premium provides excellent Security & Sharing features among many others. The move forces Organizations to a move toward a zero-trust posture.