Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-14-2025 04:39 PM
Hello Lou,
Like I mentioned yesterday, thanks to your help I was able to move forward from the error I had, but now im facing the following error:
cell 28, line 4, in fix_missing_dim_2 df_fact = dlt.read("fact") ^^^^^^^^^^^^^^^^^^^^^^^^^^^ pyspark.errors.exceptions.captured.AnalysisException: Failed to read dataset 'catalog.schema.fact'. Dataset is defined in the pipeline but could not be resolved.This is happenning on the command 3, specifically in the line:
Line 1
df_fact = spark.read.table(destination_fact) Is as if the pipeline its not recognizing the previous step where I already executed the :
Line 2
dlt.create_streaming_table(**table_args)Through my trial and error, for the time beign I have the 1st line as:
df_lead_fact = dlt.read("fact")But that is still not working.
Thanks again for your time and help