Extract data from web page list

[ubaid2]

I have created flow to extract customers reviews from web page against item codes but the issue is it is extracting data for some codes.

Website URL: https://www.target.com/ 

Item Code:

064-03-8708---working fine 

064-15-0009---Getting Error (unable to extract data from webpage)

Thanks

[Agnius]

You should try to make a copy of your Extract data from web page action and capture the same values from the item that fails. Then see if the selectors generated are the same. It is likely that they differ slightly and you might need to modify it to work for all cases.

I could not reproduce the issue, as I don't know how to find the specific items, nor do I know what data exactly you're trying to scrape.

-------------------------------------------------------------------------
If I have answered your question, please mark it as the preferred solution.
If you like my response, please give it a Thumbs Up.

If you are interested in Power Automate, you might want to follow me on LinkedIn at https://www.linkedin.com/in/agnius-bartninkas/

[ubaid2]

when I create a separate Extract data from web page for the one which fail it is fetching the data but the selector values are same for both codes.

To reproduce the at your end first go to https://www.target.com/ 
search item code in search bar

then click on reviews

after that you will be able to see all the reviews of this product.

Thanks

[Agnius]

I cannot reproduce this, as the search doesn't load any results at all for me.

Maybe it fails because the page is a bit slow to load the results? Have you watched it run? Is the page loaded fully when the flow tries to extract data?

[ubaid2]

I think the website is not allowed in your region you will have to use VPN to access it, when I run my flow webpage get loaded successfully

[Agnius]

Well, I don't have a VPN that would allow me to load the page, so, again, I cannot reproduce this. I would suggest adding a Wait for web page content action to wait for the page to load before trying to extract the values. 

If the selectors are the same, the only reason I can think of that could cause a failure is the data not loading.

[ubaid2]

sorry for the confusion, I have checked again CSS selector and found that Base CSS Selector is not the same for both items, how can I make CSS selector dynamic

Item Code: 064-03-8708
Base CSS Selector: html > body > div:eq(0) > div:eq(1) > div > main > div:eq(2) > div:eq(11) > div:eq(7) > div
CSS Selector: div > div > div > div > div:eq(0) > div:eq(2)

Item Code: 064-15-0009
Base CSS Selector: html > body > div:eq(0) > div:eq(1) > div > main > div:eq(2) > div:eq(13) > div:eq(7) > div
CSS Selector: div > div > div > div > div:eq(0) > div:eq

Thanks

[Agnius]

It seems like your table can be positioned in different places on the web page and this causes the fail. It is technically a different object.

You might want to either have both actions there and add some error handling so that if the first one fails, the second one is attempted, or add a If web page contains action and check which element is available.

-------------------------------------------------------------------------

If I have answered your question, please mark it as the preferred solution.

If you like my response, please give it a Thumbs Up.

If you are interested in Power Automate, you might want to follow me on LinkedIn at https://www.linkedin.com/in/agnius-bartninkas/

[ubaid2]

the positioning of the table in web page is on same place, but there is just one div which is changing, is it possible to make that div dynamic?

[Agnius · Accepted solution]

The fact it looks the same to the human eye does not mean it is the same.

You can pass a variable in the div value in the selector, but you still need to know what value to pass. So, like I mentioned, either do the Extract data from web page with different values in the div until it finally succeeds (handling the error so that the flow doesn't stop if extraction fails), or use If web page contains with a different div value until you find one that exists and then use that in the extraction.

-------------------------------------------------------------------------

If I have answered your question, please mark it as the preferred solution.

If you like my response, please give it a Thumbs Up.

If you are interested in Power Automate, you might want to follow me on LinkedIn at https://www.linkedin.com/in/agnius-bartninkas/