Hi guys,
How you suggestion about how to create a medalion archeterure ? how many and what datalake zones, how store data, how databases used to store, anuthing ๐
I think that zones:
1.landing zone, file storage in /landing_zone - databricks database.bronze storage in /bronze_container
2.transformed zone, file storage in /transformation_zone - databricks databse.silver storage in /silver_container
3. insight zone, file storage in /insight_zone - databricks database.gold storage in /gold_container
but I have a question, from transformed zone the data are duplicate (/transformed_zone and /silver_container)
What do you think, what is the best practice ?
Tks