Hi @Priya_Data_Eng,
- Since the pipe character (|) is part of the special character, it may be causing issues. Try using a different separator character that is not part of the special character, such as a comma (,) or a tab character (\t).
- If the UTF-8 encoding is not preserving the special character, try using a different encoding, such as UTF-16 or UTF-32.
- If the CSV format is not preserving the special character, try using a different file format that is better suited for handling special characters, such as Parquet or ORC.
- If the special character is still not preserved, you can try using a custom character escape sequence to represent the special character in the CSV file. For example, you can replace the special character with a unique string that represents it, such as "$$?$$".
Try implementing these suggestions, and let me know if you need further assistance! 😊