Apply to Each - Parallel processing - Handling more than 50

[Marty3012]

Hi,

I have the following flow which is working well;

Short explanation of what is happening;

1 - Connect to Excel table and get the rows 

2 - Loop through each Excel row using Apply to Each (Set to Parallelism)

3 - Condition - for each row check if the 'Expiration date' field is equal to the current date

4 - If so, Start an approval process

5 - If response is Approved, then the comments provided are then sent back to the excel table in a field called 'Comments'

Hope that makes sense. Everything is working well, but the problem I have is that the degree of Parallelism is set at 50 within the Apply to Each function, yet I could possibly have from 1-100 possible rows returned when the Expiration Date is compared with the current date.

I have seen many posts regarding the limit of 50. However, I thought that perhaps I could split the processing if over 50 rows were returned. For instance, I could have 2 duplicates of the Apply to each loop described above. Then there could be a condition that says if the rows exceed 50, then jump to the other Apply to Each loop and process the rest there. I understand that this may mean moving the condition that compares the dates, outwith the Apply to Each.

I have looked into using variables to count the number of rows returned and loop through etc,  but I'm getting nowhere with it. Any suggestions? 

Thanks

[StephanPrnb]

I have not tried it yet, but you could split your array of values from the excel File into arrays of length 50 and add them to an array variable. Then you put "Apply to each 2" loop into another apply to each where you iterate through the array variable and set it to Parallel processing.

Let me know if it works.

[takolota]

@Marty3012 @StephanPrnb 

There are much more efficient ways to do this without resorting to more complex nested loops or anything.

For example, instead of running the condition in the loop for every single row, try using the Filter query setting in the List rows action to only return the rows where ExpirationDate eq ‘utcnow(‘MM-dd-yyyy’) or however you have the dates formatted. If for some reason the Filter query isn’t working, you can still filter to those specific rows with a Filter array action.

[StephanPrnb]

Thanks for the Input!

I have a use case where I need to all Elements that have a date prior to today. How can I accomplish it with the OData Filter? I have not a lot of experience with it. Or do you have some good resources to learn? I could not find something really helpful....

Thank you

[takolota]

https://sharepains.com/2018/11/12/sharepoint-get-items-odata-filter-query/amp/

https://sharepains.com/2021/01/19/filter-query-get-items-power-automate/amp/

https://perituza.com/blog/power-automate-odata-filter/