Create a flow that with pull a csv report from SharePoint list every hour

[invaderzim9]

Hi!

Thank you for your help!

I'm trying to create a flow that will pull a csv report from a SharePoint list that will then be added to a folder. I'm wanting this to create a back up log incase the SharePoint has an error, we can go back to the most recent hour. 

Currently I have it sent up as:

Recurrence (every hour) > Get Items (with the correct Site Address and List Name) > Create CSV Table (with "Value" in From, and "Custom" in Columns with all the columns I want) > Create a File (with all the info needed, and File Content as "Output")

But once I run it, It only pulls 101 rows, when it should be about 5000.

*In the 'Get Items' step, I have left the Order By, Top Count, and Limit Columns by View all empty

Thank you for your help!

[rzaneti]

Hi @invaderzim9 ,

Try to set the pagination to a higher limit. Click in the three dots in your 'Get items' action and then in settings:

Toggle 'Pagination' to 'on' and set the threshold to 5000:

Important: the limit of items for this connector is 5000, so if you have, let's say, 5,001 items in your List, only the first 5k will be returned.

Let me know if it works for you or if you need any additional help!

-------------------------------------------------------------------------
If this is the answer for your question, please mark the post as Solved.
If this answer helps you in any way, please give it a like.

http://digitalmill.net/ 

[invaderzim9]

Thanks rzaneti! That worked! Do you, by chance, know how to either raise the maximum allowance over 5000 or for it to always choose to pull the newest rows when it is over 5000 (so that the oldest get left off the csv)?

[rzaneti]

Hi @invaderzim9 ,

I'm happy to know that it works! The 5k records is a limitation from this connector, so I'm afraid that you cannot return above this limit in a single action. Maybe you can try to duplicate your 'Get items' action and work with some filters (let's say, return only the records with 'Id' is lower than 5000, and in a second action only the records with 'Id' between 5001 and 10000). I don't know if it will work, but you can give it a try.