How to connect and extract data from sharepoint using Databricks (AWS) ?

[Anonymous]

We are using Databricks (on AWS). We need to connect to SharePoint and extract & load data to Databricks Delta table. Any possible solution on this ?

[Hubert-Dudek]

@Dhusanth Thangavadivel​ , You can use Azure logic apps to save files from SharePoint to Azure Blob Storage or S3. You can trigger a save operation by a web request (optionally, you can set JSON body with filename).

[Atanu]

@Dhusanth Thangavadivel​  https://www.cdata.com/kb/tech/sharepoint-jdbc-azure-databricks.rst this may be helpful.

[Prabakar]

@Dhusanth Thangavadivel​  This can be done by using the jdbc connector and following the steps mentioned in the document

https://www.cdata.com/kb/tech/sharepoint-jdbc-azure-databricks.rst

listing the file is not possible according to the MSFT doc: https://docs.microsoft.com/en-us/answers/questions/537148/how-can-i-read-share-point-excel-files-in-...

and in the second workaround of the document you can see, you can load SharePoint data as a dataframe using the CData JDBC Driver and the connection information.

[Devarsh]

Do we have any Sharepoint API using which we can integrate directly with Databricks?

[yliu]

Wondering the same.. Can we use Sharepoint REST API to download the file and save to dbfs/external location and read it?