Hi @Balram-snaplogi ,

It looks like permission problem. Could you check if the service principal has the necessary permissions to execute jobs?
In Databricks, permissions for jobs can be managed to control access. The following permissions are available:

• Is Owner: Full control over the job.
• Can Manage: Ability to edit the job definition, including permissions, and pause or resume schedules.
• Can Manage Run: Permission to trigger and cancel job runs.
• Can View: Access to view job run results.

To ensure your service principal can execute jobs, it should have at least the "Can Manage Run" permission on the specific job. You can assign these permissions through the Databricks workspace UI:

1. Navigate to the Workflows section.
2. Select the desired job.
3. Click on Edit permissions.
4. Add your service principal and assign the appropriate permission level.