No. 24 of 27 ·Data Deduplication Software

Splink

Self-hosted

Freedom report

No signalScore 5.0

Splink is ranked #24 of 27 in data deduplication software on Freedom251. It runs on Self-hosted.

Compared on data deduplication software

Purpose: Splink is a Python package for probabilistic record linkage that deduplicates and links records without unique identifiers.
Matching model: Its core linkage algorithm is based on the Fellegi–Sunter model.
Unsupervised training: Splink can train models using an unsupervised approach without training data.
Scale: The project says Splink can run with DuckDB or big-data backends such as Spark for datasets of 100 million or more records.
Matching features: It supports term-frequency adjustments and user-defined fuzzy-matching logic.
Interactive outputs: Splink provides interactive outputs to help users understand models and diagnose linkage problems.
Backends: The documentation describes DuckDB, Spark, PostgreSQL, and SQLite backends; DuckDB is installed by default, while Spark and PostgreSQL have optional installs.
Installation: Splink can be installed with pip or conda and supports Python 3.10 or later.
Data suitability: Splink works best with standardised data containing multiple columns that are not highly correlated, and is not designed for a single bag-of-words column.
Support: The project directs users with questions to its GitHub discussion forum after consulting the documentation.
License: The GitHub repository lists the project under the MIT license.
Who uses it: The project lists users and use cases across public-sector organisations, academia, and other sectors.

Claim it for free: prove the domain, then correct facts, plans and screenshots. An editor reviews every change.