cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Save as Delta file in catalog

Hritik_Moon
New Contributor

Hello, I have created data frame on csv file when I try to write it as:

df_op_clean.write.format("delta").save("/Volumes/optimisation/trial")
I get this error :
Cannot access the UC Volume path from this location. Path was /Volumes/optimisation/trial/_delta_log
 
I am able to save as table on the same location.
2 REPLIES 2

-werners-
Esteemed Contributor III

When writing delta using UC (Volumes are part of UC) it expects a table.
So in your case you mix the two, you want to use Volumes to write files but UC expect a table when using delta.
Either save as a table or as a file (but not in delta format or outside of UC).
Exactly what you have tried already.

-werners-
Esteemed Contributor III

Also to add on this:
avoid overlap between tables and Volumes.
Create a separate folder for tables and files.
Unity catalog does this too if you use managed tables/volumes.

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now