This appears to be occurring due to  IMDSv2 enabled in the workspace.

https://docs.databricks.com/administration-guide/cloud-configurations/aws/imdsv2.html#migrate

To fix this, can you please try adding the below spark config under SQL Admin Console > Data access Config where you have the glue settings. This will restart the endpoints in the workspace, so please do it off hours.

spark.databricks.hive.metastore.glueCatalog.isolation.enabled false