Databricks Community

AB_MN · 01-27-2023

I am trying to read data into a dataframe from Azure SQL DB, using jdbc. Here is the code I am using.driver = "com.microsoft.sqlserver.jdbc.SQLServerDriver" database_host = "server.database.windows.net" database_port = "1433" database_name = "dat...

AB_MN · 10-13-2022

I'm trying to load data using DLT and SCD 1 and am running into the error message "Detected a data update in the source table at version x. This is currently not supported. If you'd like to ignore updates, set the option 'ignoreChanges' to 'true'.I h...

AB_MN · 01-27-2023

That did the trick. Thank you!

AB_MN · 10-27-2022

Thanks @Hubert Dudek. I was at this same spot before, but I can't put that reference in the same notebook or even the same pipeline. If I put it in the same notebook then on the initial load it fails since the target_db.charter table doesn't exist...

AB_MN · 10-18-2022

@Hubert Dudek That was my thinking as well as I started to dig into it more. Do you know what the recommended solution would be when trying to use APPLY CHANGES tables in downstream tables?

Databricks Community

User Stats

User Activity

Read data from Azure SQL DB

Error when using DLT with SCD type 1

Re: Read data from Azure SQL DB

Re: Error when using DLT with SCD type 1

Re: Error when using DLT with SCD type 1