Why Azure Databricks needs to store data in temp storage in Azure before writing to the synapse.
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-28-2023 07:35 AM
I was following the tutorial about data transformation with azure databricks, and it says before loading data into azure synapse analytics, the data transformed by azure databricks would be saved on temp storage in azure blob storage first before loading into azure synapse analytics. Why the need to save it to a temp storage before loading into azure synapse analytics?
Ajay Kumar Pandey
Labels: