Hello,
I'm trying to read data from Unity Catalog and insert it into an Oracle Database using an "On Premise" Dataiku.
It works well for a small dataset ~600Kb/~150 000 rows.
[14:51:20] [INFO] [dku.datasets.sql] - Read 2000 records from DB
[14:51:20] [INFO] [dku.datasets.sql] - Read 4000 records from DB
....
Unfortunately I have an error message with a larger one.
It seems that it is using Databricks-managed storage as a staging area and that something is not working on the Dataiku side.
Have you ever encountered this problem ?
Is that a common behaviour of Databricks to have this staging area ? ( I guess it would have been totally transparent without this "network" error)
Thank you for your help.
