Question

Compare Text to each other

  • 12 August 2022
  • 3 replies
  • 17 views
boubcher
Rank
Badge +10

Hello there I have a 20K features each feature has an attribute with Long text content each text with diffirent word count , we need to compare features to each other and extract the text features that have similarity ,

Any way to do this with FME

Thanks

3 replies

danilo_fme
Rank
Userlevel 4
Badge +30

Hi @boubcher​ how are you?

 

Did you try the Fuzzy transformer?

 

Thanks in Advance,

boubcher
Rank
Badge +10

Hi @boubcher​ how are you?

 

Did you try the Fuzzy transformer?

 

Thanks in Advance,

@danilo_fme​ 

Thanks for your replay

I think the fuzzystringcompareFrom2 Datasets transformer will work

I did configure the input for the 2 dataset to compare how about Id feature Type parameter do you have any idea what it s there for

Thanks

imageimage

evieatsafe
Rank
Userlevel 1
Badge +15

@danilo_fme​ 

Thanks for your replay

I think the fuzzystringcompareFrom2 Datasets transformer will work

I did configure the input for the 2 dataset to compare how about Id feature Type parameter do you have any idea what it s there for

Thanks

imageimage

hi @boubcher​ do you have unique feature IDs from your two datasets? If not you can create them by using the UUIDGenerator or simply using the Counter transformer to assign a number to each feature.

 

This transformer will test the strings of each feature that matches the ID provided. If you would like to test the fuzzy strings against each other (not dependent on IDs), I would suggest combining your two datasets with an Aggregator and using the FuzzyStringComparer.

 

Hope this helps! Evie

Happy to help, Evie

Reply


Community Stats

28,667
Posts
109,357
Replies
36,536
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.