Databricks Community

DineshOjha

Hi Team,We are currently using the Databricks Deep clone feature to clone our tables to Databricks DR environment. When we deploy our jobs, they run in production and the tables get cloned to the DR. But the views dont get cloned as deepclone doesnt ...

DineshOjha · 04-22-2026

Hi,For DR purposes, we have setup Deep clone using delta share. Each time the deep clone job runs, it executes the query create or replace table {schema}.{table} deep clone {delta_share}.{schema}.{table} The 1st time the job ran, it took few hours to...

DineshOjha · 04-16-2026

Hi Databricks Community,We are looking for the recommended best practice for managing environment-specific configurations (catalogs and schemas) within our SQL files when using Databricks Asset Bundles.Our Setup:We use Databricks Asset Bundles to pac...

DineshOjha · 03-23-2026

What permissions does a Service Principal need to run Databricks jobs that reference notebooks created by a user and stored in Git?Hi everyone,We are exploring the notebooks‑first development approach with Databricks Bundles, and we’ve run into a wor...

DineshOjha · 01-31-2025

I am creating Databricks jobs and tasks using a python package. I have defined a task level parameter and would like to reference it in my script using sys.argv. How can I do that ?

DineshOjha

Thank you AshwinWe have implemented CI/CD pipeline to deploy the jobs, but it doesn't run the jobs.The jobs which load the data/create the tables need to run at specific times and so that is handled by a separate scheduling tool. In such a scenario, ...

DineshOjha · 04-22-2026

Thank you LR, we tried this approach and it worked but for this we would need to define the variable at multiple places, soch as the databricks.yml, the jobs file and the main code.So we decided to put all these variables in a single config file whic...

DineshOjha · 03-31-2026

Thank you so much Ashwin, this provides a lot of clarity.1. Where to deploy Bundles in the workspaceWe plan to deploy the bundle using a service principal , so the bundle we plan to deploy under /Workspace/<service_principal>1. Create notebooks under...

DineshOjha · 03-25-2026

Thank you so much for your response.We dont prefer to keep the notebooks under Shared or run our jobs pointing to the Shared location. We have more than 200 applications and different teams working on them. Each application has a service principal as...

DineshOjha · 02-03-2025

Thanks, but the link works for notebook. I have a python package run as python wheel and am wondering how to access the parameters. When I run the job its not able to understand the task level parameters in sys.argv

Databricks Community

User Stats

User Activity

Views in DR environment

How Deep clone works

Environment-Specific Schemas in SQL Files

Service Principal access notebooks created under /Workspace/Users

Read task level parameters in python

Re: Views in DR environment

Re: Environment-Specific Schemas in SQL Files

Re: Service Principal access notebooks created under /Workspace/Users

Re: Service Principal access notebooks created under /Workspace/Users

Re: Read task level parameters in python