I found it! Or I should say someone else did on the Slack channel. Adding it here to close the loop.

Source: Manage clusters - Azure Databricks | Microsoft Docs

"30 days after a cluster is terminated it is permanently deleted."

To work around this an admin can pin the cluster from the cluster list so that it will never auto delete.