Capture data from a Specific SharePoint Site (List) in M365 into Azure DataBricks

[SmileyVille]

Hello.  We are using Azure Databricks and would like to ingest data from a specific M365 SharePoint Online Site/List.  I was originally trying to use this recommendation, https://learn.microsoft.com/en-us/answers/questions/2116616/service-principal-access-to-sharepoint-o... however; get errors on the last step using a Service Principal which was the original recommendation.  I am reaching out here as I'm looking for a better way to ingest/pull in the Data from SharePoint into Databricks.  

Has anyone does this successfully?  What method did you use?  

Any assistance is appreciated.

Thanks in advance.

[-werners-]

I don´t know if you use Data Factory, but it has a sharepoint connector which we use to fetch online lists.
Use your data lake as a sink and unleash databricks on it.

[SmileyVille]

Hello, thanks for your response.  Do you have a reference?  We have used ADF in the past, but a bit rusty in that realm.  Thanks.

[-werners-]

https://learn.microsoft.com/en-us/azure/data-factory/connector-sharepoint-online-list?tabs=data-fact...
it is no big deal tbh.
but if you do not use adf at the moment it might be overkill though.

[SmileyVille]

Maybe, but at this point, we just need a method to get data from the specific SharePoint Online site reliability to pull into Databricks.  So open to the easiest, most efficient method.  Thanks.