Skip to main content
This gem runs in .

​
Overview

Use the FuzzyMatch gem to identify non-identical duplicates in your data.
The gem has a corresponding interactive gem example. See Interactive gem examples to learn how to run sample pipelines for this and other gems.

​
Prerequisites

  • Add prophecy_basics package version 1.0.0 or higher to your project.

​
Input and Output

​
Parameters

​
Configuration

​
Match Fields

​
Example

One common use case for the FuzzyMatch gem is to match similarly spelled names. Here’s a table with two entries for Alex Taylor, whose phone number was updated.
You can use the FuzzyMatch gem to find the closely spelled name. In the gem configuration:
  1. Set the Merge/Purge Mode to Purge mode.
  2. For the Record ID, use the id column.
  3. Keep the threshold at 80 percent.
  4. Enable the Include similarity score column checkbox.
  5. In the Match Fields tab, add a match field for the last_name column.
  6. Set the Match Function to Name.
  7. Save and run the gem.

​
Result

The output includes the Record IDs of the records with fuzzy matches above the defined threshold.
Depending on your SQL provider, you might see different similarity scores based on the algorithm that runs under the hood.
To view the names per record, join the FuzzyMatch output with the original dataset.