https://community.databricks.com/t5/data-engineering/code-reusability-for-silver-table-transformations/m-p/67668#M33407 <P>How/how many databricks notebooks should be created to populate multiple silver delta tables, all having different and complex transformations ? What's the best practice -</P><P>1. create a notebook each for a silver table ?</P><P>2. push SQL transformation logic to a config table ? And create a single reusble notebook for to be used by all the tables ? Or some other approach ?</P><P>PS - Created just a single notebook to convert the raw parquet tables to delta format, as the tranfromations were generic for all the bronze tables.</P> Tue, 30 Apr 2024 16:37:03 GMT jitesh 2024-04-30T16:37:03Z https://community.databricks.com/t5/data-engineering/code-reusability-for-silver-table-transformations/m-p/67668#M33407 <P>How/how many databricks notebooks should be created to populate multiple silver delta tables, all having different and complex transformations ? What's the best practice -</P><P>1. create a notebook each for a silver table ?</P><P>2. push SQL transformation logic to a config table ? And create a single reusble notebook for to be used by all the tables ? Or some other approach ?</P><P>PS - Created just a single notebook to convert the raw parquet tables to delta format, as the tranfromations were generic for all the bronze tables.</P> Tue, 30 Apr 2024 16:37:03 GMT https://community.databricks.com/t5/data-engineering/code-reusability-for-silver-table-transformations/m-p/67668#M33407 jitesh 2024-04-30T16:37:03Z