Load Data from Sharepoint Site to Delta table in Databricks

Aidonis
New Contributor III

‎12-16-2022 04:12 AM

Hi New to the community so sorry if my post lacks detail.

I am trying to create a connection between databricks and a sharepoint site to read excel files into a delta table

I can see there is a FiveTran partner connection that we can use to get sharepoint data into databricks but I wanted to ask the community if they know of any other ways of connecting sharepoint to databricks.

Thanks,

Ajay-Pandey
Databricks MVP

‎12-16-2022 04:34 AM

Hi @Aidan Heffernan​ you can use Sharepoint Rest API to connect with databricks

Please refer below code-

 from office365.sharepoint.client_context import ClientContext
 from office365.runtime.auth.client_credential import ClientCredential
    
 sharepoint_base_url = "https://site.sharepoint.com/sites/group/"
 READ_DIR = "/sites/Group/Shared Documents/Folder/Subfolder
    
 # setup sharepoint access
 client_credentials = ClientCredential(client_id, client_secret)
 ctx = ClientContext(sharepoint_base_url).with_credentials(client_credentials)"
    
 def download_sharepoint_file(file_url):
     temp_dir = tempfile.mkdtemp()
     download_path = os.path.join(temp_dir, os.path.basename(file_url))
     with open(download_path, "wb") as local_file:
         file = ctx.web.get_file_by_server_relative_path(file_url).download(local_file).execute_query()
     return download_path

Ajay Kumar Pandey

View solution in original post

Aidonis
New Contributor III
In response to Ajay-Pandey

‎12-16-2022 05:16 AM

Thanks for this @Ajay Pandey​  this worked a charm 😁

0 Kudos

Anoop_2De
New Contributor II
In response to Ajay-Pandey

‎07-28-2025 03:37 AM

what all access is needed to perform this at service principal level ?

 

0 Kudos

gaurav_singh_14
New Contributor II

‎05-27-2025 05:17 AM

@Ajay-Pandey can we connect using user ID without using client id and secrets

0 Kudos