Skip to main content
Solved

Spiting GeoJSON by Features to hit API separately.

  • April 9, 2019
  • 2 replies
  • 25 views

amolparande
Forum|alt.badge.img+1

Hello All,

I am using API for retrieving data, post call need be formatted to specific format I have used template to create and upload by post call in HTTPCaller. Template created from ESRI Shapefile it is working fine.

The problem that everything is being loaded into the JSON upload body. But i would like it to be split by e features before it hits the HTTPCaller. If the count is limited it is working but with heavy data API get overloaded so I would like to hit one by one does any one have solution how could I can be done please find attached FME Workbench for reference.

 

Best answer by lars_de_vries

I recently created this CustomTransformer that I just uploaded to the hub. It creates groups of a given size. This allows to upload smaller datasets via the HTTPCaller. Personally I use it for ArcGIS Online uploads and create groups of 1000 features.

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

2 replies

nielsgerrits
VIP
Forum|alt.badge.img+60
  • 2940 replies
  • April 9, 2019

Looks like you need to put the httpcaller in a custom transformer like jdh suggests in this idea:

https://knowledge.safe.com/content/idea/69036/async-httpcaller.html

 


lars_de_vries
Forum|alt.badge.img+10
  • 388 replies
  • Best Answer
  • April 9, 2019

I recently created this CustomTransformer that I just uploaded to the hub. It creates groups of a given size. This allows to upload smaller datasets via the HTTPCaller. Personally I use it for ArcGIS Online uploads and create groups of 1000 features.