cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

How to connect and extract data from sharepoint using Databricks (AWS) ?

Anonymous
Not applicable

We are using Databricks (on AWS). We need to connect to SharePoint and extract & load data to Databricks Delta table. Any possible solution on this ?

6 REPLIES 6

Hubert-Dudek
Esteemed Contributor III

@Dhusanth Thangavadivel​ , You can use Azure logic apps to save files from SharePoint to Azure Blob Storage or S3. You can trigger a save operation by a web request (optionally, you can set JSON body with filename).

Kaniz_Fatma
Community Manager
Community Manager

Hi @Dhusanth Thangavadivel​ , Just a friendly follow-up. Do you still need help, or @Hubert Dudek (Customer)​ 's response help you to find the solution? Please let us know.

Atanu
Esteemed Contributor
Esteemed Contributor

@Dhusanth Thangavadivel​  https://www.cdata.com/kb/tech/sharepoint-jdbc-azure-databricks.rst this may be helpful.

Prabakar
Esteemed Contributor III
Esteemed Contributor III

@Dhusanth Thangavadivel​  This can be done by using the jdbc connector and following the steps mentioned in the document

https://www.cdata.com/kb/tech/sharepoint-jdbc-azure-databricks.rst

listing the file is not possible according to the MSFT doc: https://docs.microsoft.com/en-us/answers/questions/537148/how-can-i-read-share-point-excel-files-in-...

and in the second workaround of the document you can see, you can load SharePoint data as a dataframe using the CData JDBC Driver and the connection information.

Devarsh
Contributor

Do we have any Sharepoint API using which we can integrate directly with Databricks?

yliu
New Contributor III

Wondering the same.. Can we use Sharepoint REST API to download the file and save to dbfs/external location and read it? 

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!