- 13337 Views
- 5 replies
- 6 kudos
cannot convert Parquet type INT64 to Photon type string
I am receiving an error similar to the post in this link: https://community.databricks.com/s/question/0D58Y00009d8h4tSAA/cannot-convert-parquet-type-int64-to-photon-type-doubleHowever, instead of type double the error message states that the type can...
- 13337 Views
- 5 replies
- 6 kudos
- 6 kudos
@John Laurence Sy​ :It sounds like you are encountering a schema conversion error when trying to read in a Parquet file that contains an INT64 column that cannot be converted to a string type. This error can occur when the Parquet file has a schema t...
- 6 kudos
- 4261 Views
- 2 replies
- 2 kudos
cannot convert Parquet type INT64 to Photon type double
I am trying to read in files via the COPY INTO command but I am getting this error lately for a certain subset of the data;`Error while reading file: Schema conversion error: cannot convert Parquet type INT64 to Photon type double`These are my option...
- 4261 Views
- 2 replies
- 2 kudos
- 2 kudos
hey @Andrew Fogarty​ I also faced the same issue when I moved from the 7.3 LTS version to a higher runtime version so to mitigate this issue you can use the below cluster configuration spark.sql.storeAssignmentPolicy LEGACYspark.sql.parquet.binaryAsS...
- 2 kudos