1. I was trying to start of the Databricks cluster through a docker image. I followed the setup instruction. Excluding the additional setup to setup the IAM role and instance profile as I was facing issues.

The image is stored on AWS ECR in a public repo and can be pulled up easily. I have NOT been able to setup the IAM role or the instance profile as mentioned. As soon as I click on  settings -> manage account it logs me out of databricks into the login screen and the same process repeats. (Attached image for the same.

I have been trying to just paste the docker container URL in the cluster instance settings as in the image below without any instance profile.