- 4480 Views
- 2 replies
- 4 kudos
Date schema issues with pyspark dataframe creation
I'm having some issues with creating a dataframe with a date column. Could I know what is wrong?from pyspark.sql import SparkSession from pyspark.sql.types import StructType from pyspark.sql.types import DateType, FloatType spark = SparkSession.bui...
- 4480 Views
- 2 replies
- 4 kudos
Latest Reply
- 4 kudos
Hi @Kaniz Fatma,I actually changed the date format to 'M/d/Y' and it didn't throw any errors. I found in my csv file that it had dates like '3/1/2022'. Could that be the issue? But some dates also were like '12/1/2022. So I'm kind of confused.
- 4 kudos