Hi,

Can you try escape parameter & quote parameter to indicate which characters need to be ignored. The escape character within the quotes will be ignored. you can specify the newline character, that it needs to be ignored. please refer to below documentation for more info

https://docs.databricks.com/spark/latest/data-sources/read-csv.html#reading-files

• quote

  : by default the quote character is

  "

  , but can be set to any character. Delimiters inside quotes are ignored.

• escape

  : by default the escape character is

  \

  , but can be set to any character. Escaped quote characters are ignored.

Thanks