Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-31-2022 09:46 AM
Hi,
I have data in parquet format in GCS buckets partitioned by name eg. gs://mybucket/name=ABCD/
I am trying to create a table in Databaricks as follows
DROP TABLE IF EXISTS name_test;
CREATE TABLE name_test
USING parquet
LOCATION "gs://mybucket/name=*/";
It is loading all the columns except name !
I get the following error when trying to view the schema from Data console
An error occurred while fetching table: name_test
com.databricks.backend.common.rpc.DatabricksExceptions$SQLExecutionException: java.util.NoSuchElementException: key not found: name
It should infer the schema automatically I suppose,
Can someone let me know where I am doing wrong?
Thanks
Labels:
- Labels:
-
External Table
-
Table