SQL Server OUTPUT clause alternative

[Nathant93]

I am looking at after a merge or insert has happened to get the records in that batch that had been inserted via either method, much like the OUTPUT clause in sql server.

Does anyone have any suggestions, the only thing I can think of is to add a timestamp to the records and then select them from the table, however that would require having a timestamp on all tables I have.

Thanks

[Nathant93]

I've managed to do it like this 

qry = spark.sql(f"DESCRIBE history <table_name> limit 1").collect()

current_version = int(qry[0][0])

prev_version = current_version - 1

Then do an except statement between the versions.