Question

Compare every single word from one attribute with the content of second attribute.

  • 23 October 2017
  • 2 replies
  • 11 views
V
Badge

Hello kind people,

 

 

I am beginner with FME. I am working with data which were combined based on the similarity of the records. However, this matching is not perfect and manual review has to be done. I want to automate the review and I have question concerning comparing two records.

I would like to ask if there is any function which is able to compare two attributes for the same record e.g

NAME 1: KROGER STORE 456

 

NAME 2: KROGER FUEL CENTER

It would pass the test, where one word from the NAME 1 (Kroger) is dectected and included into NAME 2. Or word from NAME 2 is detected into NAME 1.

It should base on extracting every single word/number from NAME 1/NAME2 and comparing with every single word/number from NAME2/NAME1.

I will be grateful for help.

2 replies

danilo_fme
Rank
Userlevel 4
Badge +30

Hi @vid,

I suggest you the use of custom transformer FuzzyStringComparer .

This transformer compare by similarity two attributes.

I simulated here in my machine two attributes:

After i compare using this transformer. The result of similarity will be in a output attribute: _result

Thanks,

Danilo

G
Badge +3

use a string searcher on both attributes to get the "words".

Regexp: \\s*(\\w+)\\s*

Set all matches and submatches. Explode lists to separate outputs.

Merge both outputs unconditionaly (1=1).

Now u can use a tester to test word1 = word2.

(Alternatively you can use listconcatenator on one list and then use an "IN" in the tester.)

Reply


Community Stats

28,711
Posts
109,487
Replies
36,559
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.