Skip to main content
Released

Don't require Creator for transformers that read data

Related products:Transformers
  • October 27, 2017
  • 9 replies
  • 107 views

fmelizard
Safer
Forum|alt.badge.img+21

I love the HTTPCaller, SQLExecutor, and FeatureReader, but I have to admit I was confused how to make them work. It turned out I had to use a Creator transformer, which is not obvious. I'd prefer if they just worked without adding a Creator transformer.

9 replies

redgeographics
Celebrity
Forum|alt.badge.img+62
I guess that would work if they "just need to be triggered once", but sometimes you want to trigger them with specific features, so there would still need to be an input port for that.

 

 


erik_jan
Contributor
Forum|alt.badge.img+23
  • Contributor
  • October 27, 2017

Agree with @redgeographics: all these transformers can be triggered by a "dummy" feature (Creator) or an actual feature read or created by the workspace. That is part of the power of these transformers.

Don't take that power away!


Forum|alt.badge.img+2

So I asked myself this question today, so here's my thoughts:

 

 

I can see the use of the Creators but when it's being added to just initiate with 1 feature it's a bit redundant and not obvious. What about incorporating the functionality with the AttributeManager - rename to FeatureManager.

 

Perhaps an option in the navigator could be set where you say how many initiating features you need, and the input ports for these transformers could follow similar colour convention to the cogs, so input port triangle colour could be yellow to suggest it can initiate without input features, or with an input stream. Red would mean it's dependent on something entering the transformer.

g_karssenberg
Contributor
Forum|alt.badge.img+7

I agree with the fact that we should not take the power away that makes these transformers so useful. However, I think there would still be an upside to be able to use these transformers without the need to add a Creator.

What if there would be an option like a checkbox 'Initiate on time', to be able to run the transformer one time without the need to connect a Creator.

I see the fact that you need to add a Creator right now more as an non-chique way to work around the fact that you need to run this transformer one time.

I vote up!


tomf
Supporter
Forum|alt.badge.img+22
  • Supporter
  • January 14, 2021

Definitely agree we need to keep the Initiator port - makes these transformers so much more powerful. My workflows would be far more complicated without it. However when just needing to run once at start of translation, this idea makes sense. Although not for the SQLExecutor.

There is already the SQLCreator transformer for that, that runs once are the translation start


pauldowlling
Contributor
Forum|alt.badge.img+4
  • Contributor
  • January 18, 2021

One of the benefits of having a creator attached to such a transformer is the ability to define the order that the creators run in a workbench. A typical case is where you have several "lookup datasets" with a few dozen records and then the main data set with thousands of records. By setting the creator run order it enables the lookup datasets to be loaded first then the main dataset starts processing. otherwise you may get the situation where all the main data has to load in memory before the lookup datasets are loaded and referenced.


LizAtSafe
Safer
Forum|alt.badge.img+18
  • Safer
  • February 10, 2024
The following idea has been merged into this idea:

All the votes have been transferred into this idea.

LizAtSafe
Safer
Forum|alt.badge.img+18
  • Safer
  • November 25, 2025
OpenReleased

jennaatsafe
Safer
Forum|alt.badge.img+4
  • Safer
  • November 25, 2025

In 25.2 we released Optional Input Ports. Since this was inspired by this idea, here are details on how it works! 

  1. The UI will show input ports designated as optional as black outlines, instead of as a red error state. You can still connect an input, there is no change to functionality here. You now don't have to. 
  2. If a transformer has an optional input port, as long as all mandatory fields are filled correctly, the transformer will run.
  3. Some transformers will enable or disable parameters based on whether an input is connected, only making relevant parameters available.. 
  4. We will not automatically upgrade any transformer in a workspace that has no connected input, where the input is now becoming optional. We will warn if this is the case, so nothing is going to run accidentally, and you can make a choice. 
  5. Even without a Creator present, you will still be able to control runtime order in the same way (right click menu option). 
  6. This applies to the following transformers 
  7. And the Creator still exists and is not going anywhere! You just don’t need it for this situation.