How to connect and extract data from sharepoint using Databricks (AWS) ?

[Anonymous]

We are using Databricks (on AWS). We need to connect to SharePoint and extract & load data to Databricks Delta table. Any possible solution on this ?

[Hubert-Dudek]

@Dhusanth Thangavadivel​ , You can use Azure logic apps to save files from SharePoint to Azure Blob Storage or S3. You can trigger a save operation by a web request (optionally, you can set JSON body with filename).

[Atanu]

@Dhusanth Thangavadivel​  https://www.cdata.com/kb/tech/sharepoint-jdbc-azure-databricks.rst this may be helpful.

[Prabakar]

@Dhusanth Thangavadivel​  This can be done by using the jdbc connector and following the steps mentioned in the document

https://www.cdata.com/kb/tech/sharepoint-jdbc-azure-databricks.rst

listing the file is not possible according to the MSFT doc: https://docs.microsoft.com/en-us/answers/questions/537148/how-can-i-read-share-point-excel-files-in-...

and in the second workaround of the document you can see, you can load SharePoint data as a dataframe using the CData JDBC Driver and the connection information.

[Bordalo]

Se tivermos o Power Automate, seria mais viável do que a solução acima ? 

Por exemplo, se a cada alteração da lista, o power automate, atualizasse a tabela que está no databricks ?

[Devarsh]

Do we have any Sharepoint API using which we can integrate directly with Databricks?

[Bordalo]

Consulta a resposta que me pareceu que está lá a informação que perguntou:
How to connect and process SharePoint Data from Azure Databricks

No trecho abaixo aparece para colocar o link da api:

driver = "cdata.jdbc.sharepoint.SharePointDriver"

url = "jdbc:sharepoint:RTK=5246...;User=myuseraccount;Password=mypassword;Auth Scheme=NTLM;URL=http://sharepointserver/mysite;SharePointEdition=SharePointOnPremise;"

[yliu]

Wondering the same.. Can we use Sharepoint REST API to download the file and save to dbfs/external location and read it?