Collections maxes out at 2000 when populating with SharePoint list datasource

[CLS720]

I have an app where on the OnView property for a screen, a collection is created from a SharePoint list datasource.

ClearCollect(CompletedRequestsCollection, CompletedRequests)

I then try to work around the delegation issue  within a gallery by sorting/filtering the collection that is created from OnView. However, even though there is no filtering on this datasource and there is no indication of non-delegation, the collection that is created OnView always maxes out with the first 2000 items in the list. Is this expected? Are there any workarounds?

[ubikwitous]

Thanks for the reply @martinav !

I still can't get it working. I've tried going back to the original, but still no luck. Is there a way to refresh the data set post updating? No matter what I do, it is only showing the older events and nothing newer, which leads me to believe it just isn't pulling them. Thanks!

For onVisible:

Concurrent(
ClearCollect(List1,Filter(SortByColumns('Events',"ID",Ascending),ID>0)),
ClearCollect(List2,Filter(SortByColumns('Events',"ID",Descending),ID>0))
);
ClearCollect(CollectionNew,List1,Filter(List2, Not(ID in List1.ID)));Clear(List1);Clear(List2)

On the BrowseGallery, I have:

Collect(CollectionNew, BrowseGallery1.AllItems)

And for Items:

SortByColumns(
    Search('Events',
        TextSearchBox1.Text,
        "Location"
    ),
    "Title",
    If(
        SortDescending1,
        SortOrder.Descending,
        SortOrder.Ascending
    )
)

[ubikwitous]

Actually, in order to get the newer items, wouldn't I somehow need to just collect the start time descending from the top instead of using the ID. I don't actually need everything and I think the newest 2000 are probably current.

Still can't get it to work. No matter what I do, the screen doesn't refresh with different data.

Concurrent(
ClearCollect(CollectionNew,Filter(SortByColumns('Events',"Start_x0020_Time_x0020_Local",Descending))

[martinav]

Please post your entire statement.  It looks like its truncated.

Also, I shouldnt assume... but did you change your app settings to increase the data row limit?

[ubikwitous]

Sorry @martinav - that last statement was me just playing around trying to figure out if I could just grab the top 2000 most recent events by using the start date field.

I also tried just grabbing 4000 items without the time filter (posted here), but no matter what I put into onVisible, it doesn't really change anything that displays. Is it the Items messing it up?

[martinav]

@ubikwitous ,

I updated my post after you posted your reply.  Please check the setting I mention and verify.

[Drrickryp]

@ubikwitous 

I have a post that shows how to load a static excel file of >42000 zip codes.  Check it out here.  https://powerusers.microsoft.com/t5/Power-Apps-Community-Blog/Automatically-Prefill-City-and-State-u... 

[RobertLim]

Hi. Can you add another List 3 and List 4, so that it can collect more than 4000 items from a SharePoint list?

[martinav]

@RobertLim ,

Unless you have already done this, sure it is possible for you to do more 'segments'.  If you setup some sort of segmenting routine that you could have 0-2000,2001-4000,4001-6000, etc.  No reason that you couldnt do that I suppose.  There are also some options in flow to do this.  I ran a parallel routine in flow that broke up lists in 4 chunks, and make a single table and sent to sharepoint as a file.  I had a recurring flow that ran every 15m to create the file.  So, if many people need the data, it doesnt hit the server as hard.  Its much quicker for PA to load a file that it is thousands of rows of data. 

[RobertLim]

Thank you so much, Sir @martinav