Databricks Community

Ian · 06-30-2022

I need to create a dataset that is dependent on multiple streaming datasets. However, when I attempt to create the new single stream I am getting an error. Append output mode not supported when there are streaming aggregations on streaming DataFrame...

Ian · 01-03-2022

I have installed Databricks-Connect (9.1 LTS). I am able to send queries to the cluster. However, when the query includes a call to the 'table_changes' function that is a part of Change Data Feed, I get the following error:AnalysisException("could ...

Ian · 07-21-2022

Hi Kaniz/Jose, I was able to resolve the issue. I used 'union all' to avoid aggregation on the stream and have it continue to write to the table in append mode.This issue can be closed.

Ian · 01-24-2022

Hi @Kaniz Fatma thank you for your reply. I do have the tables setup for Change Data Feed. I am able to run the query with 'table_changes' in a notebook. However, the same query does not run in Databricks-Connect (9.1 LTS).In Databricks-Connect ...

Ian · 01-21-2022

Hi @Kaniz Fatma , the table_changes function is an internal Databricks function used in Change Data Feed (CDF).Please refer to the article below. It discusses the table_changes function.https://docs.databricks.com/delta/delta-change-data-feed.html

Databricks Community

User Stats

User Activity

Delta Live Tables - how do you merge multiple streaming datasets into a single one?

Databricks-Connect and Change Data Feed query error

Re: Delta Live Tables - how do you merge multiple streaming datasets into a single one?

Re: Databricks-Connect and Change Data Feed query error

Re: Databricks-Connect and Change Data Feed query error