hi!
In our organisation we use databricks but I do not understand why this GKE cluster keeps getting created. We deploy workspaces and compute clusters through terraform and use the GCE tag
"x-databricks-nextgen-cluster" = "true"
From my understanding, GKE is not needed for databricks to function at all, I tried manually deleting these GKE clusters and they just go recreated without any permission, yet the workspaces keep working fine and when using compute clusters within them they use GCE normally. I had this issue both when creating a new workspace through terraform and manually, it doesn't seem to be used by the previous workspace but gets deployed in the region of the latest workspace. To my understanding, this GKE cluster seems like a bug and I could not find any way to completely disable it and just use GCE for all the computing. From what I found online so far, this only seems an issue in GCP.
If this is not needed, could you please let me know how we can delete it? If its needed, could you reference the documentation article that explains how exactly its getting used? Thanks in advance!
