Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-04-2024 12:37 AM
I think you might solve the problem. As far as I understood, your bronze data is correct, as data is in json format (string or map/record type?). Then, the problem is in silver when you apply the static schema, because col10 is a mixture of BooleanType and IntegerType.
Can you try to set StringType for col10 in the static schema, and then create a new column "col10_processed" which cast to Integer or something like that?