https://community.databricks.com/t5/data-engineering/dlt-best-practices/m-p/4535#M1227 <P>Hi Team,</P><P></P><P>Could you please recommend the best practices to implement the delta live tables?</P><P></P><P>Regards,</P><P>Phanindra</P> Thu, 11 May 2023 09:55:18 GMT Phani1 2023-05-11T09:55:18Z https://community.databricks.com/t5/data-engineering/dlt-best-practices/m-p/4535#M1227 <P>Hi Team,</P><P></P><P>Could you please recommend the best practices to implement the delta live tables?</P><P></P><P>Regards,</P><P>Phanindra</P> Thu, 11 May 2023 09:55:18 GMT https://community.databricks.com/t5/data-engineering/dlt-best-practices/m-p/4535#M1227 Phani1 2023-05-11T09:55:18Z https://community.databricks.com/t5/data-engineering/dlt-best-practices/m-p/4536#M1228 <P>Hi Phani, what exactly are you looking for with best practices? </P><P></P><P>At a high level:</P><UL><LI>Always provide an external storage location (S3, ADLS, GCS) for your pipeline</LI><LI>Use Auto Scaling! </LI><LI>Python imports can be leverage to reuse code </LI></UL><P></P><P>With regards to providing a storage location, if you put all your pipelines in a common storage location it makes it easier to read all the associated event logs for pipeline monitoring as well. </P> Fri, 12 May 2023 21:52:36 GMT https://community.databricks.com/t5/data-engineering/dlt-best-practices/m-p/4536#M1228 Ryan_Chynoweth 2023-05-12T21:52:36Z