Databricks

migq2 · 03-22-2024

I have an external delta table in unity catalog (let's call it mycatalog.myschema.mytable) that only consists of a `_delta_log` directory that I create semi-manually, with the corresponding JSON files that define it. The JSON files point to parquet f...

migq2 · 03-26-2024

Thank you, however in my specific case the parquet files are not written by Spark or Databricks, but by another external tool.Also, some files are shared by multiple tables, or a table can have files in different storage accounts. This makes having t...

migq2 · 03-26-2024

Thanks for your reply Kaniz,I understand your points, but I cannot use relative paths in my _delta_log because the files I need for my delta table are not all in the same path (they might not even be on the same storage account). Copying them is not ...

Databricks

User Stats

User Activity

Use Unity External Location with full paths in delta_log

Re: Use Unity External Location with full paths in delta_log

Re: Use Unity External Location with full paths in delta_log