Databricks

TimReddick · 09-14-2023

Do Databrick Asset Bundles support run_job_task tasks?I've made various attempts to add a run_job_task with a specified job_id. See my the code_snippet below. I tried substituting the job_id using ${...} syntax, as well as three other ways which I've...

TimReddick · 12-13-2023

Thanks! I had to set bundle_root as /Workspace${workspace.file_path} to get my import to work properly. Is this expected?

TimReddick · 11-17-2023

@JeremyFord, I found this recommendation that is probably the best way to handle this. They suggest passing the path of your bundle root as a param to your notebook and then appending to sys.path. I haven't tried it myself, but looks like a good appr...

TimReddick · 11-16-2023

Hi @RobinK, I asked a similar question over here: https://community.databricks.com/t5/warehousing-analytics/import-python-files-as-modules-in-workspace/m-p/52274/highlight/true#M1051. I found this resource that gives some good examples of how to impo...

TimReddick · 11-16-2023

Hi @JeremyFord, after some research I think that in my example appending the 'project' directory to sys.path is in fact the recommended way to do this. In studying for the Data Engineering Professional Exam, I came across this resource, which gives s...

TimReddick · 10-11-2023

Thanks for point me to this @kyle_r! Good to know they're aware of it and working on a solution.

Databricks

User Stats

User Activity

Using run_job_task in Databricks Asset Bundles

Re: How to set Python rootpath when deploying with DABs

Re: Import python files as modules in workspace

Re: How to set Python rootpath when deploying with DABs

Re: Import python files as modules in workspace

Re: Using run_job_task in Databricks Asset Bundles