Databricks Community

jonhieb · 03-21-2025

Hi, I'm trying to deploy a job with a notebook task based on a git source. But I'm facing an error when I try to deploy.This is the YAML file:resources:jobs:data_quality_pipelines_job:name: schedule_data_quality_jobschedule:quartz_cron_expression: "0...

jonhieb · 02-04-2025

I would like to know how to schedule a DLT pipeline using DAB's.I'm trying to trigger a Delta Live Table pipeline using Databricks Asset Bundles. Below is my YAML code:resources: pipelines: data_quality_pipelines: name: data_quality_pipeline...

jonhieb · 05-05-2025

Of course. In this example, I use the argument pipeline_task to reference a DLT pipeline that I created previously. This allows you to schedule your DLT pipeline inside your workflow.# Job to orchestrate data_quality_pipelines DLT Pipeline. resources...

jonhieb · 04-16-2025

No, you can create using Bundles. To do it, you should create a pipeline task inside of a workflow yaml file. After this, inside the yaml file schedule the entire workflow instead of the DLT pipeline directly.

jonhieb · 04-07-2025

I found the solution for this one:When we’re running a job that needs to consume files from a Git repo, in addition to declaring the git_source clause, we also need to declare the source clause within the task configuration.The image below demonstrat...

jonhieb · 02-04-2025

That's worked for me. Thanks!!

Databricks Community

User Stats

User Activity

Job deploy with git source using Asset Bundles

[Databricks Asset Bundles] Triggering Delta Live Tables

Re: [Databricks Asset Bundles] Triggering Delta Live Tables

Re: [Databricks Asset Bundles] Triggering Delta Live Tables

Re: Job deploy with git source using Asset Bundles

Re: [Databricks Asset Bundles] Triggering Delta Live Tables