cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
BF7
Contributor
since ‎04-03-2025
Thursday

User Stats

  • 10 Posts
  • 0 Solutions
  • 8 Kudos given
  • 4 Kudos received

User Activity

Migrating DLT tables from TEST to PROD catalogs

05-22-2025
Why can't we just copy all the DLT tables and materialized views from one UC catalog to another to get the historical data in place and then run the DLT pipelines on those UC tables?We are migrating many very large tables from our TEST catalog to our...

Using cloudFiles.inferColumnTypes with inferSchema and without defining schema checkpoint

04-28-2025
Two Issues:1. What is the behavior of cloudFiles.inferColumnTypes with and without cloudFiles.inferSchema? Why would you use both?2. When can cloudFiles.inferColumnTypes be used without a schema checkpoint?  How does that affect the behavior of cloud...

How can we get AutoLoader to detect a file footer?

04-25-2025
We are dealing with CSVs that have footers in them. When we have an empty file, the presence of this footer seems to impair the schema inferencing of AutoLoader, because of the footer.I know where is a header = true parameter, but I don't see a foote...

What is the difference between spark inferschema and cloudFiles.inferColumnTypes?

04-24-2025
We have been using spark.read with inferSchema = True to validate AutoLoader schema inferencing. But I have a suspicion that they do these differently from each other and may not always yield the identical results.Has anyone ever answered this questi...