Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-09-2024 06:09 PM
Databricks recommends to ALWAYS use Managed Tables always UNLESS:
- Your tables are not Delta
- You explicitly need to have the table files in a specific location
Managed Tables are just better... Databricks manages:
- the upgrades (Deletion Vectors? Column Mapping? If they are managed, you will get that)
- the layout (Optimal number of files, optimal clustering to accelerate queries... all with Predictive Optimization)
- things like renaming a table, dropping and undropping
- plus observability and other cool stats provided by UC
There should be NO need whatsoever for users to know WHERE the table data is stored, any operation dealing with a table should be done directly to the table elements through the Metastore and not to the files.