Unable to fetch 3rd level array using dot notation from a json data in local spark via VS Code
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-21-2025 03:33 AM
I am able to fetch 3rd level array using dot notation from a json in Databricks but same code is not working in local spark via VS Code.
Example - df.select(F.col('x.y.z')) where x is array, y is array and z is also an array.
In local spark I am getting error parameter type mismatch.
