Databricks

nagini_sitarama · 12-02-2022

count of the table : 1125089 for october month data , So I am optimizing the table. optimize table where batchday >="2022-10-01" and batchday<="2022-10-31"I am getting error like : GC overhead limit exceeded at org.apache.spark.unsafe.types.UTF8St...

nagini_sitarama · 12-08-2022

Hi Uma,I am running just a optimize sql script . optimize table where batchday >="2022-10-01" and batchday<="2022-10-31"In this case how to handle this . There are 93 files present in this batch . It takes more than 5 hours to optimize .

nagini_sitarama · 11-30-2022

I am also facing the same issue . I am accessing view that is created on top of joining 4 tables that are in parquet format. so when i pull the data from the view using my streaming job , the job fails . Even though the base table is incremental appe...

Databricks

User Stats

User Activity

Error while optimizing the table . Failure of InSet.sql for UTF8String collection

Re: Error while optimizing the table . Failure of InSet.sql for UTF8String collection

Re: Databricks notebook failed with "Caused by: java.io.FileNotFoundException: Operation failed: "The specified path does not exist.", 404, HEAD, https://adls.dfs.core.windows.net/raw/file.csv?upn=false&action=getStatus&timeout=90".