topic Re: How to connect and extract data from sharepoint using Databricks (AWS) ? in Data Engineering

How to connect and extract data from sharepoint using Databricks (AWS) ?

Anonymous — Wed, 30 Mar 2022 10:39:44 GMT

We are using Databricks (on AWS). We need to connect to SharePoint and extract & load data to Databricks Delta table. Any possible solution on this ?

Re: How to connect and extract data from sharepoint using Databricks (AWS) ?

Hubert-Dudek — Wed, 30 Mar 2022 11:26:46 GMT

@Dhusanth Thangavadivel , You can use Azure logic apps to save files from SharePoint to Azure Blob Storage or S3. You can trigger a save operation by a web request (optionally, you can set JSON body with filename).

Re: How to connect and extract data from sharepoint using Databricks (AWS) ?

Atanu — Fri, 13 May 2022 06:04:08 GMT

@Dhusanth Thangavadivel https://www.cdata.com/kb/tech/sharepoint-jdbc-azure-databricks.rst this may be helpful.

Re: How to connect and extract data from sharepoint using Databricks (AWS) ?

Prabakar — Wed, 18 May 2022 09:48:36 GMT

@Dhusanth Thangavadivel This can be done by using the jdbc connector and following the steps mentioned in the document

https://www.cdata.com/kb/tech/sharepoint-jdbc-azure-databricks.rst

listing the file is not possible according to the MSFT doc: https://docs.microsoft.com/en-us/answers/questions/537148/how-can-i-read-share-point-excel-files-in-azure-da.html

and in the second workaround of the document you can see, you can load SharePoint data as a dataframe using the CData JDBC Driver and the connection information.

Re: How to connect and extract data from sharepoint using Databricks (AWS) ?

Devarsh — Wed, 18 May 2022 13:15:44 GMT

Do we have any Sharepoint API using which we can integrate directly with Databricks?

Re: How to connect and extract data from sharepoint using Databricks (AWS) ?

yliu — Fri, 10 Nov 2023 16:03:15 GMT

Wondering the same.. Can we use Sharepoint REST API to download the file and save to dbfs/external location and read it?

Re: How to connect and extract data from sharepoint using Databricks (AWS) ?

Bordalo — Mon, 30 Dec 2024 13:17:21 GMT

Consulta a resposta que me pareceu que está lá a informação que perguntou:
How to connect and process SharePoint Data from Azure Databricks

No trecho abaixo aparece para colocar o link da api:

driver = "cdata.jdbc.sharepoint.SharePointDriver"

url = "jdbc:sharepoint:RTK=5246...;User=myuseraccount;Password=mypassword;Auth Scheme=NTLM;URL=http://sharepointserver/mysite;SharePointEdition=SharePointOnPremise;"

Re: How to connect and extract data from sharepoint using Databricks (AWS) ?

Bordalo — Mon, 30 Dec 2024 13:21:05 GMT

Se tivermos o Power Automate, seria mais viável do que a solução acima ?

Por exemplo, se a cada alteração da lista, o power automate, atualizasse a tabela que está no databricks ?