- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-11-2023 02:55 AM
Hi Team,
Could you please recommend the best practices to implement the delta live tables?
Regards,
Phanindra
- Labels:
-
Delta Live Tables
Accepted Solutions
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-12-2023 02:52 PM
Hi Phani, what exactly are you looking for with best practices?
At a high level:
- Always provide an external storage location (S3, ADLS, GCS) for your pipeline
- Use Auto Scaling!
- Python imports can be leverage to reuse code
With regards to providing a storage location, if you put all your pipelines in a common storage location it makes it easier to read all the associated event logs for pipeline monitoring as well.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-12-2023 02:52 PM
Hi Phani, what exactly are you looking for with best practices?
At a high level:
- Always provide an external storage location (S3, ADLS, GCS) for your pipeline
- Use Auto Scaling!
- Python imports can be leverage to reuse code
With regards to providing a storage location, if you put all your pipelines in a common storage location it makes it easier to read all the associated event logs for pipeline monitoring as well.

