Databricks

Axatar · 08-17-2023

hello, am running into in issue while trying to write the data into a delta table, the query is a join between 3 tables and it takes 5 minutes to fetch the data but 3hours to write the data into the table, the select has 700 records. here are the app...

Axatar · 08-22-2023

it turned out that the issue was not in the writing side, even when i was getting the results in under 5min, the issue was in the cross join in my query i resolved the issue by doing the same cross joins via dataframes got the results computed and wr...

Axatar · 08-17-2023

thank you for your prompt response, more context to the issue. the table that am writing data into gets truncated every time i run my script (its used as staging table). which means that am inserting into an empty table every time,

Databricks

User Stats

User Activity

query takes too long to write into delta table.

Re: query takes too long to write into delta table.

Re: query takes too long to write into delta table.