In general, What convention do you follow for naming databricks cluster, Policies?

Avvar2022
Contributor

I am looking for something a general best practice for databricks clusters, policies naming conventions. I couldn't find anything in databricks documentation.

I am thinking something like below

Option1: <Business Function>-<Cluster Type>-<EnvSequence>-Cluster/Warehouse

Example(s): Sales-Shared-Dev01-Cluster, Sales-Shared-Dev01-Warehouse

Option2: <Business Function> <Cluster Type> <Env> <Sequence> Cluster/Warehouse

Example(s): Sales Shared Dev01 Cluster, Sales Shared Dev01 Warehouse

Option3: <EnvSequence> <Business Function> <Cluster Type> Cluster/Warehouse

Example(s): Dev01 Sales Shared Cluster, Dev01 Sales Shared Warehouse

Please provide feedback on below options or you can suggest something new.

Thank you in advance.

karthik_p
Databricks Partner

@Ashok Zubrewar​ 1st one looks clear, even i tried to find best practices but looks we don't have it seems. job cluster can be created based on job name , all purpose and ware-house cluster can be created based on your example and looks clear

karthik.p

artsheiko
Databricks Employee
Databricks Employee

You can also use cluster tags - it seems this might simplify the naming convention. For example, instead of setting "Dev01" in the name, we could rely on a tag.

Cluster / Warehouse seems to be a long string, why don't use just "C" or "W" ?

View solution in original post

Avvar2022
Contributor

Thank you all for your inputs.