Hi all,
I need to do a batch load from sql server into Databricks. I have CC enabled on some tables. The simple appears to be union CDC and regular table to get a single set of records to load, but this appears to be fraught with risk of out of sequence data and potentially leaving the last state of the table in Databricks not reflecting the true state of the source table. Also, does anyone know how I can use SQL server table valued functions? My query appeared to fail from the existence of the function in the query when run from Databricks.
