Hi everyone,

Our data team frequently receives data extraction requests from business teams. Most requests are relatively simple and are handled by writing SQL queries in Databricks.

We are looking for a good way to manage these SQL queries as the number of requests grows.

For example:

• Where should these SQL queries be stored?
• Should they be managed in Git, Databricks SQL, or another tool?
• How do you organize and name queries?
• How do you track the requester, purpose, owner, and status of each query?
• How do you handle old or unused queries?

We don't necessarily want to turn every request into a view, table, or dashboard. The main goal is to establish a simple and maintainable process for managing business data extraction SQL.

What is the recommended approach or best practice for this in Databricks?

Thanks!