Hi,We have recently moved from GKE to GCE, it is taking forever to load the sample data in the manged delta tables.Even running simple select sql statements are taking forever. Totally clueless here, any help will be appreciatedThanks
Hi,I have data in parquet format in GCS buckets partitioned by name eg. gs://mybucket/name=ABCD/I am trying to create a table in Databaricks as followsDROP TABLE IF EXISTS name_test; CREATE TABLE name_testUSING parquetLOCATION "gs://mybucket/name=*/...
Hi All,Strangely after struggle for 2 days we figured out that we can't run the cluster in scalable mode, so after selecting single node mode we are able to execute queries and job. It seems there is a bug in the Databrick's GKE to GCE migration. Won...
Hi BigRoux,Thanks for your reply.spark UI stage shows the following message, although query has been running for over 5 min Details for Stage 17 (Attempt 0)Summary MetricsNo tasks have started yetTasksNo tasks have started yet
CREATE TABLE name_test
(
id INT,
other STRING
)
PARTITIONED BY ( name STRING);
COPY INTO name_test
FROM "gs://<my_bucket>/"
FILEFORMAT = parquet;
This combination worked, after some trial and error.Thanks for your help Pat.