I have created a DLT pipeline which reads data from json files which are stored in databricks volum
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-20-2024 05:20 AM
I have created a DLT pipeline which reads data from json files which are stored in databricks volume and puts data into streaming table
This was working fine.
when i tried to read the data that is inserted into the table and compare the values with the precalculated ones in the same dlt pipline its failing.
is it because dlt is treating this as an initialization stage and executing these comparism before setting up tables or inserting data into tables