- 9062 Views
- 10 replies
- 7 kudos
DLT and Modularity (best practices?)
I have [very] recently started using DLT for the first time. One of the challenges I have run into is how to include other "modules" within my pipelines. I missed the documentation where magic commands (with the exception of %pip) are ignored and was...
- 9062 Views
- 10 replies
- 7 kudos
- 7 kudos
I like the approach @Arvind Ravish​ shared since you can't currently use %run in DLT pipelines. However, it took a little testing to be clear on how exactly to make it work. First, ensure in the Admin Console that the repos feature is configured as f...
- 7 kudos
- 971 Views
- 1 replies
- 0 kudos
- 971 Views
- 1 replies
- 0 kudos
- 0 kudos
Delta Live Table supports the data quality checks via expectations. On encountering invalid records you can choose to either retain them, drop them or fail/stop the pipeline. See the link below for additional detailshttps://docs.databricks.com/data-e...
- 0 kudos