Statistical Calculator

Try to use the parameter Histogram, could do what you're trying to do.

http://docs.safe.com/fme/2019.0/html/FME_Desktop_Documentation/FME_Transformers/Transformers/statisticscalculator.htm

Are you looking to find out how many features contain null or missing data in any attribute or a breakdown for each attribute?

Hi @freddy17, if only numeric values are valid, you can use the StatisticsCalculator to count the number of numeric values and compute the number of invalid values by subtracting the number of numeric values from the total number of features. See the Numeric Count Attribute parameter.

I have attached a FME File + Excel file of what I am trying to achieve. @takashi, as the Values I am looking for are mostly strings. The numeric count wont work.

@egomm. I am trying to calculate a percentage of values per attribute, so yes the breakdown for each attribute.

I have attached a simple example, but it seems very convoluted. In my real dataset I have about 300 Attributes. Fruit Null Tester.fmw

Fruit Test.xlsx

I will read up on the Histogram a bit.

Thanks

My cheats way if i want to avoid python and just need to count null/empty/missing (as opposed to identifying) is to use an arithmetic editor to calculate string length and turn any value of zero to 1 and any value greater than zero to 0 and then use a statistics calculator to sum all the 1's

null_fruit.fmwt

Thanks, that has simplified things a bit. I think I will try with Python as another approach, as I have a few hundred Attributes.

An alternative approaching using the attribute validator - could be slow if you have lots of attributes and lots missing/empty/null because of exploding the list