Skip to main content
Solved

HttpCaller - DELETE in batch mode

juanmahere
Supporter
Forum|alt.badge.img+11

Hi all,

I’m using: FME(R) 2024.0.1.0 (20240328 - Build 24202 - WIN64)

I do want to know if there is the possibility to use the HttpCaller to launch chunk of requests.

 

My DELETE request: https://xyz.api.here.com/hub/spaces/@Value(space)/features/@Value(xyz_id)

each request sends to that Hub the action to delete each Feature by its ID (xyz_id).

I need to delete around 4M records, and running the workbench feature by feature, takes days.

Is that possible to get it faster?

 

Thanks for you help,

Juanma

Best answer by nielsgerrits

 

View original
Did this help you find an answer to your question?

4 replies

nielsgerrits
VIP

If the API supports bulk deletes, you probably can use FME to do the requests. The only other way of speeding things up that I know of is to send more concurrent requests. This can be set under Advanced. But the server processing the requests is the bottleneck and you will find there is a sweet spot in the amount of requests sent without getting time outs because the server can’t handle them anymore.

juanmahere
Supporter
Forum|alt.badge.img+11
  • juanmahereSupporter
  • Author
  • Supporter
  • April 12, 2024
nielsgerrits wrote:

If the API supports bulk deletes, you probably can use FME to do the requests. The only other way of speeding things up that I know of is to send more concurrent requests. This can be set under Advanced. But the server processing the requests is the bottleneck and you will find there is a sweet spot in the amount of requests sent without getting time outs because the server can’t handle them anymore.

Thanks @nielsgerrits , I guess I’ve see no info regarding the bulk delete under that API. Regarding the concurrent requests, where exactly is that “Advanced” mode? is it within the HttpCaller transformer? I do want to give a try with that.

Thanks,

nielsgerrits
VIP
  • nielsgerritsVIP
  • Best Answer
  • April 12, 2024

 

jkr_wrk
juanmahere
2 people upvoted this
  • jkr_wrk
    jkr_wrk
  • juanmahere
    juanmahere
juanmahere
Supporter
Forum|alt.badge.img+11
  • juanmahereSupporter
  • Author
  • Supporter
  • April 12, 2024
nielsgerrits wrote:

 

Thanks!
I had an old version of HttpCaller and couldn’t see that Advanced feature. Sorry for that. But looks like now is flying!  ;)

Reply


Helpful Members This Week

Community Stats

30,921
Posts
117,150
Replies
38,721
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.