Hi,
I’ve got a strange issue.
I am using a FeatureMerger to match values from a lookup table.
Then I use a DuplicateFilter to check that all the terms from the lookup table are used. And strangely, with certain non ASCII caracters, there are duplicates coming out the Unique port !
![](https://uploads-us-west-2.insided.com/safesoftware-en/attachment/2eadaa0e-e277-431a-bd48-a8fdb51b0e52.png)
Another strange thing is that these duplicates in Unique port dont appear when I check for duplicates immediately on the lookup table.
So what happens in the FeatureMerger that makes the DuplicateFilter dysfunction ?
Here’s what the Excel lookup table looks like.
![](https://uploads-us-west-2.insided.com/safesoftware-en/attachment/2f8500c0-17b9-4d27-b3c5-251c8054bc88.png)
When I replace the non ASCII caracter, the problem doesn’t appear.
![](https://uploads-us-west-2.insided.com/safesoftware-en/attachment/fa068108-15df-441c-afe3-50aad1559706.png)
What to do ?