Skip to main content
Open

Include FeatureWriter counts in the "total features written" stats

Related products:Transformers
  • July 19, 2017
  • 15 replies
  • 107 views

redgeographics
Celebrity

As discussed in this q&a, output from the FeatureWriter is not included in the Total Features Written stat at the end of a workspace log and thus also not included in the job results page on FME Server. This can be confusing and potentially misleading so I'd like to suggest adding these numbers to the total.

15 replies

Forum|alt.badge.img
  • 173 replies
  • July 20, 2017
Maybe do the same for FeatureReader too, unless it is already done.

 

 


david_r
Celebrity
  • 8394 replies
  • October 20, 2017

Until it gets implemented, here's a workaround that outputs the feature counts of the FeatureWriters to the FME log and also makes it possible to use the feature counts in the shutdown script etc. using the standard mechanisms.

The solution basically consists of re-creating the same number of dummy features and do a fanout to the NULL writer. Since the dummy features contains no geometry and hardly any attributes, it shouldn't be too penalizing performance wise:

'

From the FME log after execution:

'


fmelizard
Safer
Forum|alt.badge.img+21
  • Safer
  • 3719 replies
  • October 21, 2017
Love the ingenuity here. Don't love that you have to do this.

 

 


fmelizard
Safer
Forum|alt.badge.img+21
  • Safer
  • 3719 replies
  • October 21, 2017
Very good point. Feature Reader needs same treatment.

 

 


david_r
Celebrity
  • 8394 replies
  • October 23, 2017
Granted, I did have to take a shower after implementing that one.

mhab
Contributor
Forum|alt.badge.img+10
  • Contributor
  • 106 replies
  • June 26, 2018

I had to replace a reader by FeatureReader and need the statistics for the FeatureReader


fmelizard
Safer
Forum|alt.badge.img+21
  • Safer
  • 3719 replies
  • June 27, 2018
Safe PR#63106

mhab
Contributor
Forum|alt.badge.img+10
  • Contributor
  • 106 replies
  • June 29, 2018
I uploaded a custom transformer to FME Hub which writes the Feature Read Summary to FME log file with same formatting as readers do, see: FeatureReadSummary_to_log_writer.fmx

 

see also: discussion in Knowledge Base

 

 

Screenshot of log file with the generated statistics:

 

'

 

 


aguan
Supporter
Forum|alt.badge.img+11
  • Supporter
  • 140 replies
  • January 29, 2019

Yes, the FME server report writer count should include both the counts from featurewritter and conventional writer.


davideagle
Contributor
Forum|alt.badge.img+22
  • Contributor
  • 578 replies
  • January 30, 2019

Whilst we're at it here, why not consider changing the wording of the message entirely? Instead of "Total Features Written", how about "Total Features sent to be Written"... It would make explaining why nothing has actually been written due to rejected features much simpler!


timboberoosky
Contributor
Forum|alt.badge.img+7
  • Contributor
  • 50 replies
  • September 30, 2024

Could really use some traction on this one after 5 years!


chriswilson
Enthusiast
Forum|alt.badge.img+21
  • Enthusiast
  • 185 replies
  • September 30, 2024

This does happen @timboberoosky, if you look back through the logs it produces a summary of features written for any FeatureWriter transformers in the workspace at the point at which they write their features.  Sometimes this can make it seem as though the process has completed, however there may still be other features to be written.  Often you end up with a few of these summaries in the log if you have a number of FeatureWriters in there. 

See below, with my FeatureWriter_3 doing some early writing of features in a long process:

Grouping into an overall summary at the end - perhaps indicating which FeatureWriter or writer wrote however many features to whichever feature type - is probably the thing that is missing here.


timboberoosky
Contributor
Forum|alt.badge.img+7
  • Contributor
  • 50 replies
  • September 30, 2024

Until it gets implemented, here's a workaround that outputs the feature counts of the FeatureWriters to the FME log and also makes it possible to use the feature counts in the shutdown script etc. using the standard mechanisms.

The solution basically consists of re-creating the same number of dummy features and do a fanout to the NULL writer. Since the dummy features contains no geometry and hardly any attributes, it shouldn't be too penalizing performance wise:

'

From the FME log after execution:

'

Maybe it’s just me but I can’t see the screenshots - could you post these again? I feel like this might really help but I can’t see it! Thanks!


LizAtSafe
Safer
Forum|alt.badge.img+18
  • Safer
  • 1546 replies
  • November 21, 2025
OpenGathering Interest

LizAtSafe
Safer
Forum|alt.badge.img+18
  • Safer
  • 1546 replies
  • November 21, 2025
Gathering InterestOpen