Databricks Community

DineshOjha

Hi,For DR purposes, we have setup Deep clone using delta share. Each time the deep clone job runs, it executes the query create or replace table {schema}.{table} deep clone {delta_share}.{schema}.{table} The 1st time the job ran, it took few hours to...

DineshOjha

Hi Databricks Community,We are looking for the recommended best practice for managing environment-specific configurations (catalogs and schemas) within our SQL files when using Databricks Asset Bundles.Our Setup:We use Databricks Asset Bundles to pac...

DineshOjha · 03-23-2026

What permissions does a Service Principal need to run Databricks jobs that reference notebooks created by a user and stored in Git?Hi everyone,We are exploring the notebooks‑first development approach with Databricks Bundles, and we’ve run into a wor...

DineshOjha · 01-31-2025

I am creating Databricks jobs and tasks using a python package. I have defined a task level parameter and would like to reference it in my script using sys.argv. How can I do that ?

DineshOjha

Thank you LR, we tried this approach and it worked but for this we would need to define the variable at multiple places, soch as the databricks.yml, the jobs file and the main code.So we decided to put all these variables in a single config file whic...

DineshOjha · 03-31-2026

Thank you so much Ashwin, this provides a lot of clarity.1. Where to deploy Bundles in the workspaceWe plan to deploy the bundle using a service principal , so the bundle we plan to deploy under /Workspace/<service_principal>1. Create notebooks under...

DineshOjha · 03-25-2026

Thank you so much for your response.We dont prefer to keep the notebooks under Shared or run our jobs pointing to the Shared location. We have more than 200 applications and different teams working on them. Each application has a service principal as...

DineshOjha · 02-03-2025

Thanks, but the link works for notebook. I have a python package run as python wheel and am wondering how to access the parameters. When I run the job its not able to understand the task level parameters in sys.argv

DineshOjha · 01-31-2025

How do I read the task level parameter using argparser?

Databricks Community

User Stats

User Activity

How Deep clone works

Environment-Specific Schemas in SQL Files

Service Principal access notebooks created under /Workspace/Users

Read task level parameters in python

Re: Environment-Specific Schemas in SQL Files

Re: Service Principal access notebooks created under /Workspace/Users

Re: Service Principal access notebooks created under /Workspace/Users

Re: Read task level parameters in python

Re: Retrieve job-level parameters in Python