Question

Reject all features if some don't validate


Badge +1

I receive datasets from users where some rows may have empty values for compulsory attributes.

The AttributeValidator is testing for empty attributes.

 

If I find any empty rows I want to reject all features.

 

Any ideas? Somehow using a FeatureHolder?

image


3 replies

Userlevel 1
Badge +11

Hi @Peter Timmers​ This reminds me of the question, "How many good eyes does the average person have?"

If you give each output of the AttributeValidator a score, then get the average score with a StatisticsCalculator, then all will fail the Tester if the average isn't equal to the higher score.

image

Userlevel 3
Badge +16

You can also do it this way, using a feature merger to 'wait' for errors. Sample 1 feature, Keep no attributes, and merge on 1 to 1.

 

image

Badge +1

@danatsafe​ @ctredinnick​ Thank you both. That definitely answers my question.

Reply