Databricks Community

hi,could someone please help me with this code :-input parameter df is a spark structured streaming dataframe def apply_duplicacy_check(df, duplicate_check_columns):    if len(duplicate_check_columns) == 0:         return None, df    valid_df = df.dr...

How to remove duplicates in streaming query on the basis of some id?

what if I delete the external tables files manually on storage account for external table without dropping the table itself?