- 1715 Views
- 6 replies
- 6 kudos
https://www.databricks.com/notebooks/delta-lake-cdf.htmlI am trying to understand the above article. Could someone explain to be the below questions?a) From SELECT * FROM table_changes('gold_consensus_eps', 2)why is consensus_eps values of 2.1 and 2....
- 1715 Views
- 6 replies
- 6 kudos
Latest Reply
Hi @THIAM HUAT TAN​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answer...
5 More Replies
by
Johny
• New Contributor III
- 1128 Views
- 2 replies
- 4 kudos
I am building a bronze table with CDF-enables in these steps:Initially, Reading json file from landing zone and write to table locationdf = spark.readStream.format("cloudFiles") \
.option("cloudFiles.schemaLocation", <schema_loc>) \
.option("clou...
- 1128 Views
- 2 replies
- 4 kudos
Latest Reply
Johny
New Contributor III
I tried with a simple csv file that only has one column. I got the same error.
1 More Replies
- 1391 Views
- 2 replies
- 2 kudos
How to list all the tables which has CDF enabled?I can review a table to find out if CDF is enable with below code.SHOW TBLPROPERTIES tableA(delta.enableChangeDataFeed)The return
key ...
- 1391 Views
- 2 replies
- 2 kudos
Latest Reply
Hhi @Tim zhang​,Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.
1 More Replies
- 2377 Views
- 7 replies
- 3 kudos
I am currently doing some use case testing. I have to CLONE delta table with CDF enabled to a different S3 bucket. Deep clone doesn't meet the requirement. So I tried to copy the files using dbutils.fs.cp, it is copying all the versions but the tim...
- 2377 Views
- 7 replies
- 3 kudos
Latest Reply
Hi @Rama Krishna N​ , Because you're on Azure, you can use Azure Data Factory's Data Copy Tool as it's described in the documentation - delta tables are just files in the container, and this tool can copy data, and potentially it would be cheaper tha...
6 More Replies
- 805 Views
- 1 replies
- 0 kudos
IHAC who has a Change Data Capture data flowing into a Delta table. They would like to propagate these changes from this table into another table downstream. Is this a good application for using Change Data Feed?
- 805 Views
- 1 replies
- 0 kudos
Latest Reply
CDF simplifies the process of identifying the set of records that are updated, inserted, or deleted with each version of a Delta table. It helps to avoid having to implement downstream 'custom' filtration to identify these changes. This makes it an i...
