topic Downloading sharepoint lists using python in Data Engineering

Downloading sharepoint lists using python

tanjil — Thu, 10 Mar 2022 15:41:15 GMT

Hello,

I am trying to download lists from SharePoint into a pandas dataframe. However I cannot get any information successfully. I have attempted many solution mentioned in stackoverflow. Below is one of those attempts:

# https://pypi.org/project/sharepoint/
 
 
from sharepoint import SharePointSite, basic_auth_opener
  
server_url = "https://teamup.<company_name>.com/"
site_url = server_url + "sites/pt/service/metrics/sitedata/"
opener = basic_auth_opener(server_url, username, password)
site = SharePointSite(site_url, opener)

When the following code is executed I am getting an error:

for sp_list in site.lists:
    print(sp_list.id, sp_list.meta['Title'])

Error generated:

<urlopen error [Errno -2] Name or service not known>

Any help on this issue is greatly appreciated.

Thanks in advance,

Tanjil

Re: Downloading sharepoint lists using python

Hubert-Dudek — Thu, 10 Mar 2022 15:48:14 GMT

Please use sharepy https://pypi.org/project/sharepy/ sharepoint library which you are using wasn't updated since 2015.

Alternative way is to use Azure logic apps and from there save it to Azure Data Lake Storage in format of your choice.

Re: Downloading sharepoint lists using python

User16725394280 — Fri, 11 Mar 2022 11:04:51 GMT

Hi ,

Can you check on the below reference documentation and let us know whether it is helpful.

https://docs.microsoft.com/en-us/azure/data-factory/connector-sharepoint-online-list?tabs=data-factory

Re: Downloading sharepoint lists using python

tanjil — Sat, 12 Mar 2022 23:39:37 GMT

Thank you Hubert for your answer.

However, when running the following line:

s = sharepy.connect(SPUrl,username,password)

I am getting the following error:

'NoneType' object has no attribute 'group'.

Re: Downloading sharepoint lists using python

jose_gonzalez — Mon, 11 Apr 2022 21:16:30 GMT

Hi @tanjil ,

Did you check @Kiran Bharathi docs? do you still need help?

Re: Downloading sharepoint lists using python

User16725394280 — Tue, 12 Apr 2022 06:05:22 GMT

Hi Tanjil,

Kindly check and update us in case you have any further queries on this.

Re: Downloading sharepoint lists using python

tanjil — Wed, 27 Apr 2022 08:56:18 GMT

Hello,

I have gotten the code to work by using office365 library instead.

Re: Downloading sharepoint lists using python

rickdxt — Tue, 29 Oct 2024 12:28:26 GMT

Nice one, but if I found it earlier, it will be very helpful for me. But I want to know that I again want to perform migration due to my organizations merges with another. I have a lot of data in list. So, I can use this method or should I go with the professional tool such as SharePoint Migration Tool by SysTools.