Hey!

You cannot access an Instance Profile (IAM Role) in “Shared” mode, so discard this option if your job relies on AWS credentials via an instance profile. If your workflow depends on accessing S3 or other AWS resources using an IAM Role, you must use Single User

How you are connecting to Snowflake? Are managed tables or external iceberg tables?

When switching from an interactive cluster to a job compute cluster, the job might be running under a different user or identity. Verify:

-Are you using the same user that ran the interactive notebook?
-Has your workflow more than 1 task? did them run correctly?
-Does this user have the same permissions in Unity Catalog?
-If using Databricks Secrets, does the job user have permission to access the secret scope?

Other ideas:

- Check Databricks Driver & Executor Logs for errors.
- Ensure the cluster is not stuck in a “Pending” state.
- Verify if Spark UI shows active or completed jobs.

🙂