I was able to generate the workspace level token using the databricks cli.
I set the following details in the databricks cli profile(.databrickscfg) file:
host = https://myworksapce.azuredatabricks.net/
account_id = (my db account id)
client_id = (my sp client id)
client_secret = (generated from databricks worksapce)
After setting these, I ran the following command and generated the token:
databricks tokens create --lifetime-seconds 157680000