Dear Kaniz,

Thank you for addressing question :

I am getting following error if i follow above:

pyspark.errors.exceptions.captured.IllegalArgumentException: Reading from a Delta table is not supported with this syntax. If you would like to consume data from Delta, please refer to the docs: read a Delta table (https://docs.microsoft.com/azure/databricks/delta/tutorial#read), or read a Delta table as a stream source (https://docs.microsoft.com/azure/databricks/structured-streaming/delta-lake#table-streaming-reads-an... The streaming source from Delta is already optimized for incremental consumption of data.

-----------------------------------------

Now my question is, if at all works... is it good practice to keep steam table on bronze these incremental (delta) parq files which are in my bronze layer.... ?