I am trying to insert into an already created delta table in Unity Catalog. I am getting the error:
[TASK_WRITE_FAILED] Task failed while writing rows to abfss://xxxx@xxxxxxxxxxxxxxxx.dfs.core.windows.net/__unitystorage/catalogs/xxxxxxxx-c6c8-45d8-ac3f-7ade50a0bbed/tables/76b5d99e-d355-4808-95d6-xxxxxxxxxxx.
The insert involves joining 17 tables (actually temporary view of tables) to get the data needed to insert. The code is created like follows:
INSERT INTO catalog1.schema1.product
(column1, column2, column3...)
SELECT a.col1, b.col2, c.col1...
FROM table1 a
LEFT JOIN table2 b on a.col1=b.col1
LEFT JOIN table3 C on a.col1=c.col1
...
I tried this with a warehouse cluster and a spark cluster and got the same error.
I also created a simple test table in the same UC catalog/schema and was able to insert into it without any issues (so it's not a security related issue).
Any help in how to further troubleshoot this issue would be greatly appreciated.
