Pagination error

[Milanomaa]

I just want to extract multiple tables from different pages of same website. I did following process

1) "Lunch new firefox":   and assign this website '''https://www.nepalstock.com.np/floor-sheet

2)"Extract data from webpage": I select extract entire HTML table and "Set Element as pager". However its not working as it extract only 1st page( I tried "all available pages", "only first page"etc. But not working as it is extracting only one page.

When i run second variable only, it shows " Argument 'BrowserInstance' must be 'Web browser instance'

I am very new on this field, pls guide us somebody.

Thank you

[Highboy]

Could you give me an example with data on the webpage?
Show me a picture of what you are trying to extract.

[Milanomaa]

I want to extract data of https://www.nepalstock.com.np/floor-sheet.

It display 20 line item on time, but there are 2934 pages.

Picture attached is one page, i want all pages to be extracted

Please help me on this.

[Highboy]

Hmm have tried lots of different selectors, and it should work, but as you have noticed yourself, it does not work.
It should, but dont 🙄

I have no idea why.

If I find it, I will tell you.

[Pavel_NaNoi · Accepted solution]

Its because the pager needs a "span" element, but its hidden under the "a" selector for the pager, to fix this, go to the advanced settings, and simply put a "> span" at the end of the pager selector, like so:

[Highboy · Accepted solution]

Wow well done 😊

[Milanomaa]

It worked exactly how i want. Thanks a lot @Highboy 

[Highboy]

I can't take credit for the solution.
It was Pavel_NaNoi who solved it.

[Sandy84]

Hi Pavel_NaNoi, I have a similar problem, but in my case its not giving me any error but only capturing the data from the first page and stops, I recently updated my Power Automate Desktop Ver to 2.30.109.23075 and my Script has stopped Paging function, Now as I am changing the pages the element for the Paging selection is not at the same place ...

On the first page the CSS Selector code is html > body > main > div:eq(1) > div:eq(4) > div > div:eq(0) > a:eq(6)

On the Second page the CSS Selector code is html > body > main > div:eq(1) > div:eq(4) > div > div:eq(0) > a:eq(8)

On the Third page the CSS Selector code is html > body > main > div:eq(1) > div:eq(4) > div > div:eq(0) > a:eq(9)

and so on, can you please help me on this ... I have attached the screenshots as well, do let me know in case you require any additional details.

[Pavel_NaNoi]

I think in your case all you have to do is remove the ":eq(#)" at the end of a, so that it looks like this:

html > body > main > div:eq(1) > div:eq(4) > div > div:eq(0) > a

this will make it generic, and it should always select the pager no matter what.

[Sandy84]

Hi thanks for replying ... I changed the code as mentioned but now it is only repeating the paging by clicking on 1 and copying the same data repeatedly.

[Pavel_NaNoi]

Right, my bad, I looked through your screenshots just now and realized it increases by 1 due to an increase in the amount of page buttons, so can you change it to the following for me:

html > body > main > div:eq(1) > div:eq(4) > div > div:eq(0) > a:contains(Next)

If that does not work, can you go into dev tools (F12 if you're on chrome) and use the element picker (usually has a ctrl+shift+c shortcut, but otherwise just looks like a mouse icon hovering over something) and select the "Next" button element, and then send me a screenshot of what it jumps to in the developer code?

[Sandy84]

Ignore Please

[Sandy84]

Well the other code also did not work, I am sharing the screenshot of the element screen.

[Pavel_NaNoi]

There's a little arrow next to the <a that was selected, can you expand that for me and re-send the screenshot?

Also, asking just in-case but, can I get a link to this webpage? I could probably get this done much faster if I could just take a look at it personally.

[Sandy84]

Here's the detail for the page https://www.screener.in/

Also, I have the specific template for my reports which is saved in my profile, Is there a more secured way so I can share my credentials ?

[Sandy84]

I am sending you a Private message.

[Pavel_NaNoi]

Feel free to just private message me your email / phone so we can set up a teams / phone call instead as well.

[Pavel_NaNoi]

Try the following code, copy-paste it into a blank new flow, just literally CTRL+A, CTRL+C the code inside the .txt file and then CTRL+V into a blank space in Power Automate Desktop.

Unfortunately we cannot use the pager in this case, so instead I've created a manual one for you, the reason for this is because we got an annoying pager on our hands, I'm not exactly sure what's causing such a logic issue, but from what I could gather - because the number of "pages" increases, i.e. the previous button appears, and one additional pager number appears this confuses PAD and it flops, I know its this because, if we go to page 7 and try the same pager, the pager element will work flawlessly with the extract from webpage action, until the last few pages where the number of pagers change once again. Usually this shouldn't be a problem, but sadly it is in this case.

If you got anymore questions let me know, also change your password afterwards if all is fixed.

[Sandy84]

Hello Pavel_NaNoi,

Thanks much for the amazing code, well being a new bee to CSS & PAD that code looks like rocket science to me 🙂

Well actully thats not the format and query that I run regularly, I usually use different queries and have made multiple variables for the same, now also the data that is extracted on the spreadsheet by the automation is not in right format, I append a macro to bring it to the required format after the data is downloaded .... Just to explain in detail here are the steps that the automation runs to capture my data ...

All with " " are Variables that I have set in the project.

1> Launch new Crome > "Homepage" the "URL"

2> Login to the website with "Credentials"

3> Go to script Page "URL"

4> Append the "Query"

5> Extract data from the data generated >> { This is where I am seeking help}

6> Create Excel file in "Path"

7> Enter data to the Excel/Save & Close

Now because my table and query changes, I have made multiple variables for the same, but as the Pager function is not working the automation is now stopping on the first page.

Is there any other way where I can look for the NEXT Button and append the pager script ? or if I can add one or two more but simple functions ...

Appreciate your help !!