Databricks Community

TariqueAnwer · 09-27-2022

B1123451020-502,"","{""m"": {""difference"": 60}}","","","",2022-02-12T15:40:00.783Z B1456741975-266,"","{""m"": {""difference"": 60}}","","","",2022-02-04T17:03:59.566Z B1789753479-460,"","",",","","",2022-02-18T14:46:57.332Z B1456741977-123,"","{""...

TariqueAnwer · 10-04-2022

Hi @Kaniz Fatma Unfortunately, the suggestion hasn't helped and I've not been able to figure out the reason for the strange results so far.

TariqueAnwer · 10-04-2022

Hi Debayan, there's no syntax error in the code snippet. Using .option("escape",'"') makes no difference to the counts. I still get wrong counts.

Databricks Community

User Stats

User Activity

Pyspark CSV Incorrect Count

Re: Pyspark CSV Incorrect Count

Re: Pyspark CSV Incorrect Count