Hello Everyone,

Here is my use case.

1. My source table (bronze delta table) is under unity catalog and is a transaction (Insert/Update) table.

2. My target table (silver delta table) is also under unity catalog.

3. On daily basis I need to ingest the incremental data from Bronze to silver table that is under unity catalog. 

I get this error when reading source/Bronze table that is under unity catalog. I am using Shared Cluster and DBR 11.3 LTS.

Method public org.apache.spark.sql.Dataset org.apache.spark.sql.streaming.DataStreamReader.table(java.lang.String) is not whitelisted on class class org.apache.spark.sql.streaming.DataStreamReader

Appreciate any pointers to address and resolve this error.

Kind Regards,

Karthik