Hello all,
I want to know how to update new data in delta table from new csv file.
here is the code that i have used to create delta table from csv file and loaded data. but i have go new updated file and trying to load new data but not able to any guidance would help.
code:
%sql
SET spark.databricks.delta.schema.autoMerge.enabled = true;
create table if not exists catlog.schema.tablename;
COPY INTO catlog.schema.tablename
FROM (SELECT * FROM 's3://bucket/test.csv')
FILEFORMAT = CSV
FORMAT_OPTIONS ('mergeSchema' = 'true', 'header' = 'true')
but i have new file with additional data. how can i load that please guide?
thanks
need to load new datafile in delta table