FREEDOM251

Freedom251 › Data Deduplication Software

Entify

Free plan APISelf-hostedWeb

Visit Entify Alternatives Pricing

Entify's own site

What Entify is

Entify is a free, open-source workspace for matching records, resolving entities and deduplicating datasets. It uses Splink 4 and DuckDB to find likely matches and group records into clusters that users can review. Its setup process can identify probable column types, suggest blocking rules and explain its decisions, which users can override. The software reads CSV, TSV, Parquet, JSON and Excel files.

Users can inspect evidence behind matches and threshold analyses, then export deduplicated data or generate a PDF audit report. Fuzzy matching, automatic merging, API access and a merge review workflow are supported. Entify is available as a web app, API and self-hosted software, and its repository lists an MIT license. The Docker quickstart runs locally without accounts, API keys or external services; the README says uploaded data stays on the machine. Demo mode also works without sign-in. Optional sign-in and shared storage use Clerk and Supabase. Uploads are capped at 100 MB, and the README describes the engine as memory-bound beyond roughly 100,000 rows. Optional semantic blocking requires an additional install with roughly 600 MB of Torch dependencies.

Who it suits

Entify suits data stewards and teams that need to link or deduplicate records without specialist record-linkage expertise. It can also suit users who want to inspect match evidence and review or export results from a local setup.

What it does well

  • Reads CSV, TSV, Parquet, JSON and Excel files.
  • Explains suggested blocking rules and lets users override them.
  • Provides match evidence and threshold analyses for review.
  • Exports deduplicated data and PDF audit reports.
  • Docker quickstart runs locally without accounts or external services.

What to know first

  • Uploads are capped at 100 MB.
  • The README describes the engine as memory-bound beyond roughly 100,000 rows.
  • Optional semantic blocking downloads roughly 600 MB of Torch dependencies.
  • The backend API has no authentication and assumes localhost binding.

Limits

Uploads are limited to 100 MB, and the README describes the engine as memory-bound beyond roughly 100,000 rows. Optional semantic blocking requires an additional installation with roughly 600 MB of Torch dependencies.

Plans

PlanBilled and limitsPrice
Open-sourceEarly open-source project; uploads capped at 100 MB by default; one resolution result held in memory at a timeFree

As github.com lists them, read 9 Oct 2026. The maker's own page has the final word.

Getting started

  1. Open the Entify GitHub website.
  2. Use the Docker quickstart to run it locally without accounts, API keys or external services.
  3. Upload a CSV, TSV, Parquet, JSON or Excel file.
  4. Review the suggested column types, blocking rules and match evidence.
  5. Export deduplicated data or generate a PDF audit report.

Entify is a record-linkage workspace that turns a matching process into a guided review rather than a specialist-only exercise. It is a good fit for data stewards working with modest datasets who want to inspect and trace proposed merges. Its strongest case is explainable local matching; its tight resource limits and localhost-only security assumption rule it out for larger or exposed deployments.

Overview

Built around Splink 4 and DuckDB, Entify helps users identify records that may refer to the same entity, review the evidence, and produce a deduplicated export. The MIT-licensed project can run locally with Docker or with Python 3.11+ and Node 20+. The Docker quickstart requires no accounts, API keys, or external services, and uploaded data stays on the machine—useful for teams that prefer a local workflow over shared hosted storage.

Key features

Entify profiles columns with row counts, distinct values, and completeness, then suggests likely column types and blocking rules. It explains those choices and lets users override them, which gives newcomers a workable starting point without locking experienced users into automatic decisions. Matching offers exact, Jaro-Winkler, Jaccard, and Levenshtein comparisons.

Reviewers can examine match evidence, scores, and threshold analyses before accepting a cluster. Merge exports keep one surviving record per entity while retaining source IDs, supporting traceability and undo; PDF audit reports provide a record of the review. CSV, TSV, Parquet, JSON, and Excel inputs cover a broad set of common data formats.

Semantic blocking is optional, but installing it downloads roughly 600 MB of Torch dependencies. That is a sizable addition for teams that need it; users relying on the standard comparisons can avoid it.

Pricing

Entify’s Open-source plan costs nothing. It includes the open-source tool, with uploads capped at 100 MB by default and only one resolution result held in memory at a time. There is no paid tier or seat allowance described. The project is free under the MIT license, but the caps make it a better fit for small jobs than recurring large-scale work.

Platforms

Entify supports API, self-hosted, and web use. Local deployment is possible through Docker or a Python 3.11+ and Node 20+ setup. The API has no authentication and assumes it is bound to localhost; do not expose it to untrusted callers as-is. Only one resolution result stays in memory, so a second concurrent run replaces the first. Uploads are read fully into memory, and workloads beyond roughly 100,000 rows call for a DuckDB file backend and job queue.

Who it's for

Choose Entify if you steward data or work in a team that needs record linkage without already knowing how to design blocking rules and match weights. Its guided setup, inspectable evidence, and traceable exports suit modest deduplication projects. Look elsewhere if your workflow needs larger uploads, concurrent runs, or an API exposed beyond localhost without additional security work.

Pros and cons

  • Pros: Automatic setup explains suggested column types and blocking rules, helping non-specialists begin while retaining the ability to override decisions.
  • Pros: Evidence review, threshold analysis, source-ID retention, and PDF audits make proposed and completed merges easier to examine and trace.
  • Pros: The local Docker route needs no accounts, keys, or external services, and keeps uploaded data on the machine.
  • Cons: The 100 MB default upload cap and memory-bound operation beyond roughly 100,000 rows limit its fit for larger datasets.
  • Cons: A second concurrent run replaces the first result, restricting parallel work.
  • Cons: The unauthenticated API is intended for localhost binding, not direct exposure to untrusted callers.
  • Cons: Optional semantic blocking adds roughly 600 MB of Torch dependencies.

Alternatives

Tilores is worth considering if you want local entity resolution with a stated allowance of up to 100,000 records per deployment and no account or licence key. DupeCatcher is a free option across Android, iOS, and web, with all features included. AWS Entity Resolution may suit provider matching billed per 1,000 records processed, though provider licensing or subscriptions cost extra and availability is limited to the US East region.

Koalify offers a free sandbox or demo account, or portals below 10K records, and a Pro plan at $25 a month billed annually. Plauti Deduplicate has a free Salesforce edition; full-edition features require a trial or custom pricing. For a research-oriented project, pyJedAI is identified as a research project by the University of Athens AI-Team. Python Record Linkage Toolkit is a free package aimed at research use and small or medium files, while Splink is free MIT-licensed Python software for Linux and self-hosted use.

Verdict

Entify is a sensible free choice for teams that need guided, explainable record matching and want to keep data local. The ability to inspect evidence and trace merges is its clearest advantage. Choose another tool for larger datasets, parallel runs, or deployments that need an API safely exposed beyond localhost.

Verdict

Choose Entify if you need a free, open-source tool for record matching with explainable review and local operation. Its stated upload and memory limits may make it a poor fit for larger datasets, while the unauthenticated API assumes localhost binding.

Questions

Is Entify free?

Yes. Its pricing model is free, and the project is open source under an MIT license.

Which file formats can it read?

CSV, TSV, Parquet, JSON and Excel.

Can it run locally?

Yes. The Docker quickstart needs no accounts, API keys or external services, and the README says uploaded data stays on the machine.

Does it provide an API?

Yes, API access is supported. The README says the backend API has no authentication and assumes it is bound to localhost.

Does Entify support fuzzy matching and automatic merging?

Yes. Fuzzy matching and automatic merging are supported, along with a merge review workflow.

Who makes Entify?

The project is available at its GitHub repository, which lists an MIT license.

Facts from Entify's own pages

API security
The README says the backend API has no authentication and assumes it is bound to localhost. · github.com, 4 Oct 2026
Automatic setup
Its auto-configuration reads CSV columns, infers their roles, proposes blocking rules, and explains its decisions. · github.com, 9 Oct 2026
Concurrency limitation
Only one resolution result is held in memory at a time, so a second concurrent run replaces the first. · github.com, 9 Oct 2026
Data formats
It reads CSV, TSV, Parquet, JSON, and Excel files. · github.com, 4 Oct 2026
Deployment
It can run locally with Docker or with Python 3.11+ and Node 20+; the README identifies FastAPI, Splink 4, DuckDB, and Next.js in its stack. · github.com, 9 Oct 2026
Export
Its merge export produces one surviving record per entity and retains source IDs so merges can be traced or undone. · github.com, 9 Oct 2026
File formats
It reads CSV, TSV, Parquet, JSON, and Excel files. · github.com, 9 Oct 2026
Integrations
Optional sign-in and shared storage use Clerk authentication and Supabase persistence. · github.com, 9 Oct 2026
Intended users
The project describes itself as intended to make record linkage usable by data stewards and teams without specialist record-linkage expertise. · github.com, 4 Oct 2026
License
The repository lists an MIT license. · github.com, 4 Oct 2026
Limits
Uploads have a 100 MB cap, and the README describes the engine as memory-bound beyond roughly 100,000 rows. · github.com, 4 Oct 2026
Local operation
The README says the default Docker quickstart requires no accounts, API keys, or external services, and uploaded data stays on the machine. · github.com, 9 Oct 2026
Matching
It supports exact, Jaro-Winkler, Jaccard, and Levenshtein comparisons, with semantic blocking available as an optional extra. · github.com, 9 Oct 2026
Matching engine
It uses Splink 4 and DuckDB to match records and review explainable clusters. · github.com, 4 Oct 2026
Optional semantic blocking
Semantic blocking is optional and requires an additional install that downloads roughly 600 MB of Torch dependencies. · github.com, 4 Oct 2026
Profiling
It reports row counts, distinct values, and completeness for each column. · github.com, 9 Oct 2026
Purpose
Entify is an early open-source workspace for entity resolution, record linkage, and data deduplication. · github.com, 9 Oct 2026
Review and audit
It offers score and threshold analysis, match evidence charts, and PDF audit reports. · github.com, 9 Oct 2026
Review and export
Users can inspect match evidence and threshold analyses, export deduplicated data, and generate a PDF audit report. · github.com, 4 Oct 2026
Scale limitation
Uploads are read fully into memory with a 100 MB default cap, and the README says workloads past roughly 100,000 rows need a DuckDB file backend and job queue. · github.com, 9 Oct 2026
Security limitation
The API has no authentication and assumes it is bound to localhost; the README warns against exposing it to untrusted callers as-is. · github.com, 9 Oct 2026
Target users
The README describes the project as intended to make record linkage usable by people who do not already understand blocking rules and match weights. · github.com, 9 Oct 2026

Where Entify stands on Freedom251

Look at these too