You can use the python in the FuzzyStringComparer (e.g. difflib.SequenceMatcher) to do it. I would suggest that you keep one side as features and add the other features as a list to those features. Then you can cycle through the list, exactly as @takashi showed in

https://knowledge.safe.com/questions/3776/fuzzy-string-matching-from-two-datasets.html

Hopefully you aren't dealing with millions as there will be many iterations in that case and keep the smaller dataset as the list to help reduce iterations.

Hi @dmatranga, if you need to compare the two tables for each row, add row number attribute to both tables and then merge them using the row number as the join key. i.e. merge the first row from the table 2 to the first row from the table 1, merge the second row from the table 2 to the second row from the table 1.. and so on.

@takashi I did the stuff below but I'm still stuck when it comes to the FuzzyString Comparer:

• Exposed the csv_line_number format attributes on both CSV readers, dataset1 and dataset2
• For dataset1, I used a BulkAttributeRenamer to prefix the features with dataset1_
• For dataset2, I used a BulkAttributeRenamer to prefix the features with dataset2.
• Using @todd_davis's suggestion, used a ListBuilder to create a list of all the features in dataset1 and called it _dataset1LIST.
• Used a FeatureMerger to merge on:
  
  • _dataset1LIST{0}.dataset1_csv_line_number
  • dataset2_csv_line_number

Reading 10 features from dataset1, and 1 feature from dataset2, I get this result:

Here's my config for FuzzyStringComparer:

• String 1 Attribute:
  
  • _dataset1LIST{0}.dataset1_NAME
• String 2 Attribute:
  
  • dataset2_NAME

The only problem is, this is a one-to-one comparison, with the resulting RATIO attribute just representing the result of a single comparison to the first element in the list.

If I want to compare a single feature from dataset2 to every feature in dataset1, is this possible using FuzzyStringComparer?

I'm also getting this error message when I use the method from https://knowledge.safe.com/questions/3776/fuzzy-string-matching-from-two-datasets.html

Python Exception <TypeError>: 'NoneType' object is not iterable

Error encountered while calling function `FuzzyStringCompare'

f_22(PythonFactory): PythonFactory failed to process feature

import difflib
def fuzzyCompareString(feature):
    str1 = feature.getAttribute('str1')
    for i, str2 in enumerate(feature.getAttribute('dataset2{}.str2')):
        ratio = difflib.SequenceMatcher(None, str1, str2).ratio()
        feature.setAttribute('dataset2{%d}.ratio'  % i, ratio)