cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

deltaformat

SwathiChidurala
New Contributor II
Hi,
I am a student who learning databricks, In the below code I tried to write data in delta format to a gold layer. I authenticated using the service principle method to read, write and execute data , I assigned the storage blob contributor role, but still, I am having the following error the location and the folder in the container everything is right. Not sure what causing the error. Any suggestions and solutions is greatly appreciated!
  • silver = 'abfss://silver@synapsecoursedlstorag.dfs.core.windows.net'
  • gold = "abfss://gold@synapsecoursedlstorag.dfs.core.windows.net"
 
  • df_zone.write.format('delta').mode('append').option('path',f'{gold}/trip_zone').saveAsTable('gold.trip_zone')
1 ACCEPTED SOLUTION

Accepted Solutions

TakuyaOmi
Valued Contributor II

@SwathiChidurala 

Have you ensured that the external location was created correctly? Also, do you have the appropriate permissions to manage it?
You may find the following documentation helpful:
External Locations in Unity Catalog

Although the scenario is slightly different, I previously addressed a similar error in the following thread. I hope it can also be of help:
Community Thread on External Delta Table Error

View solution in original post

2 REPLIES 2

TakuyaOmi
Valued Contributor II

@SwathiChidurala 

Have you ensured that the external location was created correctly? Also, do you have the appropriate permissions to manage it?
You may find the following documentation helpful:
External Locations in Unity Catalog

Although the scenario is slightly different, I previously addressed a similar error in the following thread. I hope it can also be of help:
Community Thread on External Delta Table Error

Avinash_Narala
Valued Contributor II

Hi @SwathiChidurala ,

The error is because you don't have the folder trip_zone inside the gold folder, so you can try by removing the trip_zone from the location or adding the folder trip_zone inside the gold folder in adls and then try it again.

If this helps, mark it as solution.

Regards,

Avinash N

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group