Hello,
Thanks for contacting Databricks.
To collect metrics from Databricks Runtime 13.1 clusters using a bash script, you generally need to interact with Databricks' API. We are contemplating the introduction of a cluster metrics API that could potentially fulfill this requirement. However, this feature is still in the planning stages, we're unable to provide an ETA yet.
Regards,
Monica