Hi,

I am working with Databricks Serverless Compute and All-Purpose Compute and have several questions regarding tagging, system tables, and budget policies. Specifically, I need clarification on how these work together in Databricks, and how I can manage them using Terraform.

1. How do I tag resources in Databricks?

   • What are the best practices for tagging both Serverless Compute and All-Purpose Compute resources?

   • Can I use common tags like Environment, Owner, CostCenter, Project, etc., for both types of compute?

   • How can I implement these tags for resource management, especially for budgeting purposes?

2. Can I manage these tags with Terraform?

   • Is it possible to tag Serverless Compute and All-Purpose Compute resources through Terraform?

   • How can I automate the tagging process for both types of compute resources?

3. How do System Tables work in the real world in Databricks?

   • What are the typical use cases for system tables in Databricks?

   • How can system tables be managed and accessed for monitoring, auditing, or troubleshooting in production environments?

4. How can I configure Budget Policies in Databricks?

   • What is the best way to set up a budget policy in Databricks for cost control?

   • How can I associate budget policies with resources like Serverless Compute and All-Purpose Compute using tags?

5. Can these policies and tags be managed through Terraform?

   • How do I configure budget policies and tags for Serverless Compute and All-Purpose Compute using Terraform to ensure automated and consistent resource management?

Note: I am not referring to Serverless SQL Warehouse in this question.

Any insights, examples, or resources you can share would be greatly appreciated.

Thank you!