Databricks connecting SQL Azure DW - Confused between Polybase and Copy Into
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-16-2024 10:19 AM
I see two articles on databricks documentations
https://docs.databricks.com/en/archive/azure/synapse-polybase.html#language-python
https://docs.databricks.com/en/connect/external-systems/synapse-analytics.html#service-principal
Polybase one is legacy one and is not supported anymore
Copy Into one is new one and it ideally should not need CONTROL access on whole dw
Here comes confusion:
looking at query structure itself I do not see any difference on how we access DW and code block looks exactly same, so how do we make sure we are using COPY option and not POLYBASE?
I ran code and it is still giving access issue, I gave read access on schema and table. CREATE access on DW & ADMINISTER DATABASE BULK OPERATIONS permissions as mentioned in document.
Not clear what am I missing here.