Get 10 000 rows from SQL into Sharepoint List

[PhilipL]

Hello,

I have been trying now for a while to build a functional flow, where I through Power Automate can replica a SQL table into a Sharepoint List. Now I am a beginner on Power Automate, but I have tried to do as much investigation on this as possible without success. Which Is why I now ask for help! 

In short

I have a SQL table lets call it SQL-Table. I have created a Sharepoint list, lets call it Sharepoint-Table.  In my SQL-Table I have more than 10 000 rows with unique keys. What I want to build with power automate is to being able to get the flow to create these 10 000 rows in the Sharepoint-Table.  

My attempted ideas 

First I tried to use the Get Rows (V2) function and then do a apply to each Value. However, this gave mixed quantities each time. Some times I got 6000 rows and other times 6032 rows etc. There was a limit set to 2048, but that could be increase up to 100 000, but it doesn't seem to work.

Second I tried to do a Loop where I each time Filter down the Get Rows (V2) to exclude items already added to the Sharepoint-table.  However, after the first 5000 items was created in the Sharepoint-Table. the Get Items function stops working as intended as there is some sort of limit at 5000 rows. I have been unable to solve how to get more then 5000 rows from the Get items function, preventing me to filter the Get Rows (V2) after I added 5000 rows to the sharepoint list. 

Third I have tried to do some sort of loop where I simply sort the Get Rows (V2) to be ordered based on the UniqueKey. My idea here was/is to only get 1 single row from the Get Rows(V2) where I have introduced a variable which increases by 1 for each row, and where I select the row-number equal to the variable.  However, I have not managed to get this Get Rows (V2) filtering to work. 

Have anyone built a solution similar to my needs? Where we want to create a row in the sharepoint list for each row in the SQL table, and where we have more than 5000 rows in the table?  

[PhilipL · Accepted solution]

I found the solution myself and tested it now.  I am able to get 7000 rows into Sharepoint list in around 20 minuts. So if anyone else had the same issue as I did, this is where I found my solution:

https://piyushksingh.com/2020/07/06/power-automate-read-excel-file/

I just changes his Excel statements for SQL statements instead. (And it helps to have a Order by in the Get Rows statement) 

[Desarrollador23]

Muchas gracias por la ayuda