ENABLE CHANGE DATA FEED FOR EXISTING DELTA-TABLE
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-02-2022 03:21 AM
I have a delta table already created, now I want to enable the change data feed. I read that I have to set delta.enableChangeDataFeed property to true. But however, this cannot be done using the Scala API. I tried using this but it didn't work. I am using the OS version (delta) for performing all these operations.
I really appreciate any help you can provide.
val ddl_query = """CREATE TABLE if not exists delta_training.delta_table
USING DELTA
LOCATION '/Users/data-partner-merge/src/main/resources/delta/dpm/base'
"""
//creation of table
spark.sql(ddl_query)
spark.sql(" ALTER TABLE delta_training.onaudience_dpm SET TBLPROPERTIES ('delta.enableChangeDataFeed' = true )").show()
EDIT 1: As mentioned by a user, I tried using this as well, but still no changes come into action.
spark.sql(" ALTER TABLE delta_training.onaudience_dpm SET TBLPROPERTIES (delta.enableChangeDataFeed = true)")
- Labels:
-
Change
-
Change Data
-
Change Data Feed
-
Data
-
Scala API
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-02-2022 06:27 AM
'delta.enableChangeDataFeed' have to be without quotes.
spark.sql("ALTER TABLE delta_training.onaudience_dpm SET TBLPROPERTIES (delta.enableChangeDataFeed = true)").show()
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-02-2022 08:44 AM
I tried but that doesn't work
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-30-2022 10:15 AM
Can you try in plain SQL instead of spark.sql() API? According to the docs, this is the command to do it :
ALTER TABLE myDeltaTable SET TBLPROPERTIES (delta.enableChangeDataFeed = true)
docs https://docs.databricks.com/delta/delta-change-data-feed.html#enable-change-data-feed

