Databricks Community

MadhuB · 03-25-2025

I'm trying to install Maven Libraries on the job cluster (non interactive cluster) as part of databricks workflow. I've added the context in the cluster configuration as part of deployment which I cant find the same in the post deployment configurati...

MadhuB

@cloudengineer By default workspace admins can create interactive clusters. Non-admin users should be granted access either to a compute policy or should be provisioned access onto a existing clusters. If there is a requirement to enable cluster crea...

MadhuB

Hi @APJESK,In addition, job logs are very useful to monitor and troubleshoot any job failures. They can be found under Workflows. Workspace admins role is required to have full access on all jobs unless explicitly granted to the user by Job Owner/adm...

MadhuB · 03-25-2025

I found the workaround. Below are the steps:1. Add the required library to the Allowed list at the workspace level (require workspace/metastore admin access); you might need coordinates groupdd:artifactId:version2. At the task level, include under De...

MadhuB · 03-25-2025

@chexa_WeeIf both projects (databricks) are in different cloud regions, you can have 2 metastores which is a straight forward implementation. Otherwise, below are the possibilities.Easiest Approach - You can’t have two metastores unless they are in s...

MadhuB · 03-05-2025

@KrunalG you can deploy using databricks PAT (impersonation technique) or AAD authentication of a service principal. SP AAD token is safest as the default expiry time set to 60 mins. Refer to my detailed explanation in the below.

Databricks Community

User Stats

User Activity

Installing Maven (3rd party) libraries on Job Cluster

Re: No cluster create capabilities on my databricks UI, just SQL Warehouse. Complete work stoppage.

Re: Databricks Logs

Re: Installing Maven (3rd party) libraries on Job Cluster

Re: How to manage two separate projects ?

Re: Use Azure Service Principal to Access Azure Devops