cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Databricks SQL Endpoint Failing to create an external table on a parquet file with Decimal or Timestamp datatype

ta_db
New Contributor

I'm using the Databricks SQL Endpoint and I'm attempting to create an external table on top of an existing parquet file. I can do this so long as my table definition does not include a reference to a decimal or timestamp/date datatype.

ex. This works

CREATE EXTERNAL TABLE sampleTable (  
ColA STRING,  
ColB INT)  
LOCATION 'storagelocation' STORED AS PARQUET

When I need to reference a timestamp column "ColC TIMESTAMP", I receive the following error..."Parquet does not support timestamp. See HIVE-6384"

I found in Databricks you can specify the hive version by using the following, but this did not resolve my issue.

spark.sql.hive.metastore.version 1.2.1 
spark.sql.hive.metastore.jars builtin

Any ideas on a way around this?

1 REPLY 1

Anonymous
Not applicable

Hey there @T A​ 

Hope everything is going great!

Does @Kaniz Fatma​'s response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly? If not, would you be happy to give us more information?

We'd love to hear from you.

Thanks!

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group