Questions about low speed problem in data updating and improvement possibilites with P1 or P2 licenses

[Anonymous]

I am currently developing a company internal app with PowerApps(office365 license) using Collection.

This app is to validate physical cargo's info are correct against system info.

Following are what we want to realize using PowerApps;

1. My default dataset has avg. 10,000 lines(system info.) in Excel format
2. New data to be appended over 5,000 lines every day on top of default dataset
3. Need to update the latest dataset to PowerApps(Collection) every day
4. Then operator use this app to validate with physical cargo's info

Following are the problems that I faced:

• Data interface speed is to slow
• Option 1. Using Excel : around 10 mins to upload by 5 sets of 2,000 lines(due to delegation issue), but when retrieving from collection (after validation) it takes, over an hour
• Option 2. Using Sharepoint : it's much shorter, but need to go through 2 steps; (1) upload excel file to Sharepoint, and then (2) interface with Collection

• If we go for Option 2, there are two options;
• Option 2-1. Append additional data to Sharepoint page; but it takes too long (over an hour / 8,000 lines)
• Option 2-2. Generate new Sharepoint page and update (around 10 mins / 8,000 lines)

• In order to go for the shortest option (2-2), we have to do following setup each time
•  Generate new Sharepoint page and index setting is required
•  Reconnect SharePoint data source from PowerApps

My questions are…

1. If we go for P1 or P2 license...
• Can we use CDS with making above process faster?
• Especially for the problem like Option 2-1
• Can we get better speed even in same process?
2. Is there any other optimized solutions to handle above process without changing PowerApps or Sharepoint Setting?
3. Since we want to use this app for other customers, dataset should be multiplied by the number of customers;
• Can CDS offer better environment in speed or stability in case of big size dataset?

[v-xida-msft]

Hi @Anonymous ,

For your first question, based on the needs that you mentioned, I think the CDS Entity would be a better solution for you. If you have PowerApps Plan 1 or Plan 2 license, you would be able to use CDS functionality in PowerApps.

In addition, the CDS acts as a embedded data source within PowerApps, which would have high process speed than other data source.

For your second question, as an available solution, you could consider sync the Excel table records into a CDS Entity using "Power Query" feature or "Get data from Excel" option. In addition, the CDS Entity is a Delegable data source which could process much more records than Excel table.

For your third question, Common Data Service has a rich security model to protect the data integrity and privacy of users while promoting efficient data access and collaboration. You can combine business units, role-based security, record-based security, and field-based security to define the overall access to information that users have in a Common Data Service environment. 

Please check the following article about CDS:

https://docs.microsoft.com/en-us/powerapps/maker/common-data-service/data-platform-intro

Best regards,