You could use looping inside a custom transformer. The particular API you're using has a total_pages and next_page attribut, so you could use that to feed the HTTPCaller that's inside the loop.

Can you share the URL you're trying to access?

I would personally avoid looping if you know from the first call how many calls you need to make in total.

So httpcaller to retrieve first 100 items, grab the total page count from this output, use this value to clone a number of features (total_pages-1), and then a second httpcaller using the copy number to structure the call with which page/start number of records you want to retrieve (so in the scenario above, you would send 5 features to the second http caller.

Yes it's :

https://hub-digital.daxium-air.com/spie-act-infra/groups?per_page=100&page=0

thanks ebygomm, I will try it.

Perfect it's works!

That's actually a very elegant way of solving it (provided you can tell from the first call how many there will be in total).

Agree, it's a very elegant solution. Unfortunately not all APIs will let you know the total number of pages up front, since there is often a performance hit associated with calculating the number.

Hey all, total newby and stumbling through. I have an httpcaller which returns the first 100 which I am assuming is page 1. I am struggling to find where you are seeing total page count and how to set up each caller to return a different page. I am connecting via a Microsoft Graph connection. Any chance you could tell me how to set up which page it is calling? Thanks!