- 3068 Views
- 4 replies
- 0 kudos
COPY INTO skipRows FORMAT_OPTIONS does not work
Based on the COPY INTO documentation, it seems I can use `skipRows` to skip the first `n` rows. I am trying to load a CSV file where I need to skip a few first rows in the file. I have tried various combinations, e.g. setting header parameter on or ...
- 3068 Views
- 4 replies
- 0 kudos
- 0 kudos
@yubin-apollo: My bad - I had the skipRows in the COPY_OPTIONS and not in the FORMAT_OPTIONS. It works, please ignore my previous comment. Thanks
- 0 kudos
- 13509 Views
- 5 replies
- 6 kudos
cannot convert Parquet type INT64 to Photon type string
I am receiving an error similar to the post in this link: https://community.databricks.com/s/question/0D58Y00009d8h4tSAA/cannot-convert-parquet-type-int64-to-photon-type-doubleHowever, instead of type double the error message states that the type can...
- 13509 Views
- 5 replies
- 6 kudos
- 6 kudos
@John Laurence Sy​ :It sounds like you are encountering a schema conversion error when trying to read in a Parquet file that contains an INT64 column that cannot be converted to a string type. This error can occur when the Parquet file has a schema t...
- 6 kudos
- 1653 Views
- 0 replies
- 1 kudos
Target database.table1 must be delta table
I created a table1 with some data. Then I truncated it to load new dataset. When I do select * from table . I get row count 0. But when I am trying to copy into using following command. I get error saying target table must be delta table: COPY INTO...
- 1653 Views
- 0 replies
- 1 kudos