https://community.databricks.com/t5/data-engineering/special-character-data-preservation/m-p/76798#M35325 <P>Try to read the file back into databricks using spark.read, do you the see the charchaters showing? if yes, then it is an editor problem, use another editor such as Notepad++, if not, then the data is not on the write encoder, try different encoder other than UTF-8, maybe UTF-16</P> Thu, 04 Jul 2024 17:39:56 GMT amr 2024-07-04T17:39:56Z https://community.databricks.com/t5/data-engineering/special-character-data-preservation/m-p/76782#M35320 <OL><LI><SPAN>This data frame has two columns name and info. Name has value as John and info has vale as&nbsp;</SPAN><SPAN>1® VOC.</SPAN></LI></OL><P><SPAN>After writing this data, I can read correct values in databricks but when I download the csv file and load it in notepad ( utf-8 ) , it is showing no values.</SPAN></P><P><SPAN>even if I click on edit in container, it is showing empty values.</SPAN></P><P><SPAN>What can be the reason? And what is the solution ?</SPAN></P><P><SPAN>df. write. format (‘csv').option ('header', True).option( 'encoding', 'UTF-8').option(' sep', '|^|’) .mode ('overwrite'). save('/mnt/Filestore/data/job1/test.dta')</SPAN></P> Thu, 04 Jul 2024 16:10:52 GMT https://community.databricks.com/t5/data-engineering/special-character-data-preservation/m-p/76782#M35320 Priya_Data_Eng 2024-07-04T16:10:52Z https://community.databricks.com/t5/data-engineering/special-character-data-preservation/m-p/76798#M35325 <P>Try to read the file back into databricks using spark.read, do you the see the charchaters showing? if yes, then it is an editor problem, use another editor such as Notepad++, if not, then the data is not on the write encoder, try different encoder other than UTF-8, maybe UTF-16</P> Thu, 04 Jul 2024 17:39:56 GMT https://community.databricks.com/t5/data-engineering/special-character-data-preservation/m-p/76798#M35325 amr 2024-07-04T17:39:56Z