Splink

Input—per 1M tokens

Output—per 1M tokens

Context—tokens

WeightsClosed

About

Splink is ranked #8 of 25 in identity resolution software on Inferse. It runs on Linux, macOS, Self-hosted, Windows. There is a free plan.

Compared on identity resolution software

Free plan: Yesmoj-analytical-services.github.io
Matching approach: hybridmoj-analytical-services.github.io
Real-time API: Yesmoj-analytical-services.github.io
Batch file import: Yesmoj-analytical-services.github.io
Organization matching: Yesmoj-analytical-services.github.io

Facts

Purpose: Splink is a Python package for probabilistic record linkage that deduplicates and links records without unique identifiers.moj-analytical-services.github.io · 29 Sept 2026
Method: Its core linkage algorithm is based on the Fellegi-Sunter model and can be trained without labeled data using an unsupervised approach.moj-analytical-services.github.io · 29 Sept 2026
Matching: It supports term frequency adjustments and user-defined fuzzy matching logic.moj-analytical-services.github.io · 29 Sept 2026
Scale: The maker says Splink can run on DuckDB or big-data backends such as Spark for linkages of 100+ million records.moj-analytical-services.github.io · 29 Sept 2026
Backends: The documented SQL backends include DuckDB, Spark, SQLite, and PostgreSQL; the library generates SQL for a user-chosen backend.moj-analytical-services.github.io · 29 Sept 2026
Backend guidance: DuckDB is recommended for most users except the largest linkages, while Spark is recommended for very large linkages or where a Spark cluster is easier to access.moj-analytical-services.github.io · 29 Sept 2026
Data requirements: Splink works best with standardized data containing multiple columns that are not highly correlated, and is not designed for a single bag-of-words column.moj-analytical-services.github.io · 29 Sept 2026
Diagnostics: Interactive visualisations help users understand and diagnose linkage models, including dashboards for examining predictions and clusters.moj-analytical-services.github.io · 29 Sept 2026
Install: Splink can be installed using pip or conda, with optional backend-specific installs documented for Spark and PostgreSQL.moj-analytical-services.github.io · 29 Sept 2026
Support: The maker directs users with questions remaining after reading the documentation to its GitHub discussion forum.moj-analytical-services.github.io · 29 Sept 2026
Databricks support: The development team says it lacks access to a Databricks environment and may struggle to help with Databricks-specific issues.moj-analytical-services.github.io · 29 Sept 2026
Use cases: The maker lists users across government, academia, and other sectors, including the Office for National Statistics, NHS England, and the Australian Bureau of Statistics.moj-analytical-services.github.io · 29 Sept 2026