Filter Query limit in Get Items from SharePoint

[Sam4]

Hi, I have a flow running to get some items from a SharePoint list with around 6000 items.

The problems I have is the Get Items is not getting any items above 5000, even if I want to get only 10 files. 

For example, I want to get all files where Check = "YES", These are only 4 items with ID, 5, 50, 467 and 5200.

So I am configuring a simple manually trigger a flow and the GET ITEMS action with the Filter Query set to Check eq 'YES'. 

ID	Check
5	YES
50	YES
467	YES
5200	YES

It works fine, but I am receiving only the items with ID 5, 50, 467. Item 5200 is missing.

Is there any limit with this and is there any way of overcome this issue?

Kind Regards

Sergio

[abm]

Hi @Sam4 

The default limit is 5000.

Click three dots of the connector then settings, set the pagination on and set the threshold limit.

[Sam4]

Thanks @abm,

My understanding is the pagination and the threshold limit is 100 items by default and  that I can increase it to retrieve up to 5000 items. In my case I want to retrieve only 4 items from a list with 5200 rows so I'm using the 'Filter Query' function. So my threshold is in reality 4, not 5000. 

My problem is it seems that Power Automate is only considering the first 5000 items in a list only despite you filter them or not.

Does that means I can only work with SharePoint lists up to 5000 items? For example, if I have a list with 10.000 items I can't work with the items 5001-10000 in any case?

[ScottShearer · Accepted solution]

@Sam4 

In your case, I believe you want to turn off pagination and keep your filter query.  Give it a try - I suspect that you'll get the results that you expect.  Please post your results here.

[Sam4]

Hi @ScottShearer,  Well Pagination was off, I turned it on and.. it works! I can get the items above the 5000 row. 

not sure what is the rationale for that. Do you have any idea? 

In any case many thanks 🙂

[abm]

Hi @Sam4 

My bad, Yes the default is 100. 5000 is the top limit for Top Count filter. Did you set any top count filter?

Thanks

[Sam4]

nop, in theory the default (blank) is all so I didn't add anything.

[Leghrand]

hi! I would like to ask what can I do if the sharepoint list that I am getting an item from has more than 10000 rows.

I set the pagination to the max 10000. But then, the flow still gives me null return value.

Would appreciate any reponse thanks!