Skip to main content
Solved

Data validation & finding differences: CRCcalculator vs Matcher vs...?

  • November 16, 2022
  • 2 replies
  • 70 views

paul_c_2
Contributor
Forum|alt.badge.img+1

I will soon have two sets of (hopefully) identical data to check against each other, sat in FGDB's. There are quite a lot of records (thousands, if not tens of) and I'm looking for differences in any attribute between the two versions of the same record.

 

I can see this taking a long time, and note there are different options within FME, including Matcher, CRCcalculator, etc. What is likely to be the most efficient method?

Best answer by david_r

The CRCCalculator will have absolutely zero tolerance or margin for difference at all, whereas the Matcher will let you choose to allow insignificant differences, e.g. using the vertex tolerance setting. This is important if your data comes from different sources with e.g. slight differences in the rounding of vertices.

You can also consider looking into the ChangeDetector, which is basically like the Matcher but with additional functionality.

 

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

2 replies

david_r
Celebrity
  • 8391 replies
  • Best Answer
  • November 16, 2022

The CRCCalculator will have absolutely zero tolerance or margin for difference at all, whereas the Matcher will let you choose to allow insignificant differences, e.g. using the vertex tolerance setting. This is important if your data comes from different sources with e.g. slight differences in the rounding of vertices.

You can also consider looking into the ChangeDetector, which is basically like the Matcher but with additional functionality.

 


paul_c_2
Contributor
Forum|alt.badge.img+1
  • Author
  • Contributor
  • 12 replies
  • November 17, 2022

Thank you, David.