03-30-2022 03:39 AM
We are using Databricks (on AWS). We need to connect to SharePoint and extract & load data to Databricks Delta table. Any possible solution on this ?
03-30-2022 04:26 AM
@Dhusanth Thangavadivel , You can use Azure logic apps to save files from SharePoint to Azure Blob Storage or S3. You can trigger a save operation by a web request (optionally, you can set JSON body with filename).
04-26-2022 09:37 AM
Hi @Dhusanth Thangavadivel , Just a friendly follow-up. Do you still need help, or @Hubert Dudek (Customer) 's response help you to find the solution? Please let us know.
05-12-2022 11:04 PM
@Dhusanth Thangavadivel https://www.cdata.com/kb/tech/sharepoint-jdbc-azure-databricks.rst this may be helpful.
05-18-2022 02:48 AM
@Dhusanth Thangavadivel This can be done by using the jdbc connector and following the steps mentioned in the document
https://www.cdata.com/kb/tech/sharepoint-jdbc-azure-databricks.rst
listing the file is not possible according to the MSFT doc: https://docs.microsoft.com/en-us/answers/questions/537148/how-can-i-read-share-point-excel-files-in-...
and in the second workaround of the document you can see, you can load SharePoint data as a dataframe using the CData JDBC Driver and the connection information.
05-18-2022 06:15 AM
Do we have any Sharepoint API using which we can integrate directly with Databricks?
11-10-2023 08:03 AM
Wondering the same.. Can we use Sharepoint REST API to download the file and save to dbfs/external location and read it?
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.