Skip to main content
Solved

Filter duplicates looking in two fields

  • June 1, 2018
  • 2 replies
  • 138 views
S

Hi,

I would like to filter out whether a certain value appears multiple times in either of two fields. An example:

ID1ID2Desired action1_22_1keep1_33_1keep2_11_2discard

Current attempts have either given me the rows which don't ever appear twice across the two fields, or a full list of those that do appear twice across the two fields. Is there a way to filter out duplicates looking at both fields?

Best answer by erik_jan

Create a test field (ID3) using the AttributeCreator. Use the Conditional Values to set the value as follows:

If ID1 > ID2 then ID1-ID2 (use Text Editor to concatenate)

Else ID2-ID1

Then use ID3 in a DuplicateFilter to find the unique combinations.

    This post is closed to further activity.
    It may be an old question, an answered question, an implemented idea, or a notification-only post.
    Please check post dates before relying on any information in a question or answer.
    For follow-up or related questions, please post a new question or idea.
    If there is a genuine update to be made, please contact us and request that the post is reopened.

    2 replies

    erik_jan
    Contributor
    Forum|alt.badge.img+22
    • erik_janContributor
    • Contributor
    • 2179 replies
    • Best Answer
    • June 1, 2018

    Create a test field (ID3) using the AttributeCreator. Use the Conditional Values to set the value as follows:

    If ID1 > ID2 then ID1-ID2 (use Text Editor to concatenate)

    Else ID2-ID1

    Then use ID3 in a DuplicateFilter to find the unique combinations.

    S
    • stevans
    • Author
    • 1 reply
    • June 4, 2018

    Create a test field (ID3) using the AttributeCreator. Use the Conditional Values to set the value as follows:

    If ID1 > ID2 then ID1-ID2 (use Text Editor to concatenate)

    Else ID2-ID1

    Then use ID3 in a DuplicateFilter to find the unique combinations.

     

    Many thanks, that's done the trick!

     

    Community Stats

    32,086
    Posts
    121,845
    Replies
    39,727
    Members

    Latest FME

    Terms & ConditionsCookie settingsAccessibility statement
    A product of
    Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.