Question

Build an 'IN' statement from id's while preserving Bulk Mode

  • 25 June 2020
  • 1 reply
  • 4 views
virtualcitymatt
Rank
Userlevel 4
Badge +26

Hi guys,

 

 

I've been trying to reduce the number of hit's I need to make to a database by building an IN statement and get it all in one go. So far I've been pretty successful - my wait time from the database has been significantly improved!

 

 

My process has been to use an Aggregator to collect the Id's into groups of 1000 (limit of features in an in request) - the GroupCounter has been really helpful for creating an ordered attribute to group by.

 

 

Now I'm at the point where this Aggregation process is taking quite a bit of time (seconds) because FME is splitting the features tables. I'm trying to figure out a way to build a comma separated list from an column without breaking the feature tables.

 

 

Anyone been able to do this or can think of a way that this might work?

 

 

Cheers

Matt

1 reply

M
Badge +2

@virtualcitymatt ListBuilder & ListConcatenator. ListBuilder seems to split feature tables, but at this point it shouldn't matter as much since you have 1000 times fewer features as you create the IN. I think ListBuilder might be better than Aggregator as it only builds the list.

Reply


Community Stats

28,681
Posts
109,402
Replies
36,540
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.