Entity resolution (also known as data matching, data linkage, record linkage, and many other terms) is the task of finding entities in a dataset that refer to the same entity across different data sources (e.g., data files, books, websites, and databases). Entity resolution is necessary when joining different data sets based on entities that may or may not share a common identifier (e.g., database key, URI, National identification number), which may be due to differences in record shape, storage location, or curator style or preference.
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
A powerful and modular toolkit for record linkage and duplicate detection in Python
A list of free data matching and record linkage software.
Record linking package that fuzzy matches two Python pandas dataframes using sqlite3 fts4
🔎 Finds fuzzy matches between CSV files
PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolution using Approximate Nearest Neighbors.
Zero-config entity resolution feeding a durable identity layer: messy records from any source become stable golden entities, a Customer 360 with provenance, merge/split and audit. Fellegi-Sunter beats hand-tuned Splink. Arrow-native/Rust, 250M rows in 11.2 min. Python + edge TypeScript (WASM), SQL-native in Postgres & DuckDB, 97 MCP tools + REST.
Resources for tackling record linkage / deduplication / data matching problems
An open-source library that leverages Python’s data science ecosystem to build powerful end-to-end Entity Resolution workflows.
Link Wikidata items to large catalogs
Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.
A browser user interface for manual labeling of record pairs.
A maximum-strength name parser for record linkage.
Welcome to Snowman App – a Data Matching Benchmark Platform.
Fuzzy string matching in R. Inspired by Python's thefuzz (but without the Python).
Compound AI toolchain for fast and accurate entity matching, powered by LLMs.
🔎 Finds fuzzy matches between datasets
DuckDB community extension for locality-sensitive hashing (LSH)
A collection of awesome resources regarding Record Linkage.
Created by Halbert L. Dunn
Released 1946