The focus in bronze layer is quick CDC and the ability to provide an historical archive of source (cold storage), data lineage, reprocessing if needed without rereading the data from the source system.
It is recommended that the datatypes and the str...
The issue might be that tmp_table was not registered at the time when editor was looking up for the table name on the account that the create or replace statement had not yet executed.
Eligibility of a file for vacuum is based on the date that the file was ,asked for deletion and not on the creation timestamp of the file.Delta table data files are deleted according to the time they have been logically removed from Delta’s transacti...
Hi Saswata,Can you remove the filter and see if it is printing output to console?kafka_df5=kafka_df4.filter(kafka_df4.status=="FRAUD")Thanks and RegardsSwetha Nandajan
