Hello,
I have an ETL process that ingests data into bronze tables, transforms the data, and then ingests it into silver tables before finally populating the gold tables. This workflow is executed every 5 minutes. When I want to analyze the data or apply machine learning, considering the 5-minute ingestion interval, how can I proceed?
Thank you.