08-08-2022 01:29 PM
aggregate function followed by timestamp field sorted in descending order did the trick:
streaming_df.groupBy("field1", "time_field").max("field2").orderBy(col("time_field").desc()).display()
