Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
Notebooks with Delta Live Table/View definition just contain the pipeline definition. In order to execute Delta Live Tables Notebooks you need to define a Pipeline via the Jobs UI. Pipeline carries with it the logic to build the dependency graph between the different Delta Live Tables/Views in the notebook as well as spinning up the necessary compute to execute the pipeline. See the DLT quickstart guide for additional details - https://docs.databricks.com/data-engineering/delta-live-tables/delta-live-tables-quickstart.html#req...
Notebooks with Delta Live Table/View definition just contain the pipeline definition. In order to execute Delta Live Tables Notebooks you need to define a Pipeline via the Jobs UI. Pipeline carries with it the logic to build the dependency graph between the different Delta Live Tables/Views in the notebook as well as spinning up the necessary compute to execute the pipeline. See the DLT quickstart guide for additional details - https://docs.databricks.com/data-engineering/delta-live-tables/delta-live-tables-quickstart.html#req...
Join Us as a Local Community Builder!
Passionate about hosting events and connecting people? Help us grow a vibrant local communityโsign up today to get started!
