Skip to main content
  • EN

Hi all,

I’m using: FME(R) 2024.0.1.0 (20240328 - Build 24202 - WIN64)

I do want to know if there is the possibility to use the HttpCaller to launch chunk of requests.

 

My DELETE request: https://xyz.api.here.com/hub/spaces/@Value(space)/features/@Value(xyz_id)

each request sends to that Hub the action to delete each Feature by its ID (xyz_id).

I need to delete around 4M records, and running the workbench feature by feature, takes days.

Is that possible to get it faster?

 

Thanks for you help,

Juanma

If the API supports bulk deletes, you probably can use FME to do the requests. The only other way of speeding things up that I know of is to send more concurrent requests. This can be set under Advanced. But the server processing the requests is the bottleneck and you will find there is a sweet spot in the amount of requests sent without getting time outs because the server can’t handle them anymore.

If the API supports bulk deletes, you probably can use FME to do the requests. The only other way of speeding things up that I know of is to send more concurrent requests. This can be set under Advanced. But the server processing the requests is the bottleneck and you will find there is a sweet spot in the amount of requests sent without getting time outs because the server can’t handle them anymore.

Thanks @nielsgerrits , I guess I’ve see no info regarding the bulk delete under that API. Regarding the concurrent requests, where exactly is that “Advanced” mode? is it within the HttpCaller transformer? I do want to give a try with that.

Thanks,

 

 

Thanks!
I had an old version of HttpCaller and couldn’t see that Advanced feature. Sorry for that. But looks like now is flying!  ;)

Reply


Community Stats

30,353
Posts
115,359
Replies
38,089
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.