Thanks, this is very helpful. I think the lightweight approach using Databricks SQL Queries, domain-based folders, metadata headers, and an archive process makes a lot of sense for our current situation.

Our main concern is that the number of queries may grow significantly over time, so simply organizing them into folders might eventually become difficult to navigate.

Would you recommend maintaining a lightweight index/catalog in addition to the folder structure, or do you think a good naming convention, folder structure, and metadata for each query are sufficient for managing a large number of queries?

Also, for the 90-day rule, would you treat it as a review trigger rather than automatically archiving the query?