Databricks Community

_singh_vish · 05-01-2025

I am using @Dlt.table decorator to create a table which will store history for my tables.My code works like this:@Dlt.table(name="table name")def target: Custom spark code to create history Even though the spark code creates and prints history ...

_singh_vish · 05-01-2025

Hi All, I am working on DLT pipeline, to create SCD2 for my bronze layer, my architecture has 4 layers, namely Raw, Bronze, Silver, Gold. I am ingesting data directly into raw, and then I am creating history(SCD2) into bronze. My code: @Dlt.view(n...

_singh_vish · 05-02-2025

@lingareddy_Alva Thanks for the help.

_singh_vish · 05-02-2025

This is the table history, and it breaks on version 6, and also on version 8, I have not checked other versions after 8, but will expect a similar result for those too.

_singh_vish · 05-02-2025

I cannot send the exact error log, but here's a high level of that:[DELTA_SCHEMA_CHANGED_WITH_STARTING_OPTIONS] Detected schema change in version 6:\nstreaming source schema: root\nI want to know, how can i handle tables, which has a last modified da...

Databricks Community

User Stats

User Activity

Working of @DLT.table

DLT Apply Changes problem

Re: Working of @DLT.table

Re: DLT Apply Changes problem

Re: DLT Apply Changes problem