cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

The operation CHANGE DATA FEED is not allowed on Streaming Tables.

erigaud
Honored Contributor

Hello everyone,

I have a workflow that starts by reading the CDF data for a change data feed.

The syntax is exactly the following : 

(
spark.readStream
  .format("delta")
  .option("readChangeFeed", "true")
  .option("startingVersion", 10)
  .table("my.streaming.table")
  .display()
  )
 
I get the following error : 
[STREAMING_TABLE_OPERATION_NOT_ALLOWED.UNSUPPORTED_OPERATION] The operation CHANGE DATA FEED is not allowed: The operation is not supported on Streaming Tables.
I made sure the version exists in the history of the table, and the CDF is enabled for my table.
A couple of weeks ago the code used to run without issue, did something change ? Thank you
3 REPLIES 3

AG2
New Contributor III

 To facilitate this, there are certain specific operations that are allowed on streaming tables. If you encounter this error, it's likely that the operation you're attempting to use is not one of the supported ones. You will need to review the documentation for streaming tables to determine which operations are allowed and how to properly use them.

erigaud
Honored Contributor

The operation I'm attempting is supported, it's literally the same thing as what is showed in the documentation (https://docs.databricks.com/en/delta/delta-change-data-feed.html)

Moreover as I said the code used to work just a couple of weeks ago.

afk
New Contributor III

Hi, this seems to be related to the issue I've been getting around the same time here: 
Change data feed from target tables of APPLY CHANG... - Databricks - 54436

Would be great to get an explanation for the sudden change in behaviour.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group