10-18-2021 08:38 AM
This needs encoding. you can try encoding the output while reading the file.
.option("encoding", "UTF-16LE")
Please refer to the below:
https://docs.microsoft.com/en-us/azure/databricks/kb/data-sources/json-unicode
https://community.databricks.com/s/question/0D53f00001HKHnfCAH/issues-with-utf16-files-and-unicode-c...
View solution in original post
