HTTP GET new update to API endpoint

[user180618]

I am working with an API that returns a list of news articles in structured JSON format with a schema that looks like this:

{
  "articles": {
    "id": {
      "type": "string"
    },
    "title": {
      "type": "string"
    },
    "text": {
      "type": "string"
    },
    "publishedDate": {
      "type": "string"
    },
    "total": {
      "type": "integer"
    }
  }
}

However, the total is always limited to 1000 articles, so that number doesn't change.

What I want is to receive an email every time a new article is posted to the endpoint, which will always have a unique id, title, text and so on. I have tried doing the attached but I don't think this works.

[Heartholme]

Hi  @user180618 , 

Which system are you quering? Looks like there is some pagination limit within the API, so please check the API documentation and see if there's a parameter that have to be included in the URI to query more than 1000 records. 

There is no build in limits within the HTTP action in PowerAutomate. 

✔ Marking my post as a solution not only confirms that your question has been answered, but also helps others find solutions to similar problems.
By doing so, you'll be making a valuable contribution to the community.

Best Regards
Heartholme

[user180618]

There is no limit on the API as I can call it fine in Postman. But, like I said, the total in the output is always limited to 1000 results, and my condition is checking if the total is greater than 0. However, given that I have a Recurrence flow, it won't know which is the new record, no?

[Heartholme]

Ok, I see. Try this: 

Click the dots and select settings: 

Then try to turn on pagination and put in 10000 items for example: 

BR

HH

[user180618]

Is that basically splitting each entry into 1000 items? Because my problem is that when the flow runs, it runs 1000 times (and therefore sends me 1000 emails). But I just want it to send new results from a certain point, for example 2024-04-24-09:00:00 (and for any new results before that shouldn't be triggered by the flow).

[Heartholme]

That should solve your limitiation with getting a fixed return on 1000 rows. However, it seems like your issue isn't the number of rows returned, but that you only get the same output back each time. 

You should look into your API call, if there's a possibility to filter either on data or a number sequence so you only get a mail for new records. 

You should'nt pull all the data from the API to just to get the new data. You should filter the api call just to get the new data back. 

Hope this helps! 

✔ Marking my post as a solution not only confirms that your question has been answered, but also helps others find solutions to similar problems.
By doing so, you'll be making a valuable contribution to the community.

Best Regards
Heartholme