Project Nessie

Free plan APILinuxSelf-hostedWeb

What Project Nessie is

Project Nessie is a free, Apache-licensed transactional catalog for data lakes. It uses Git-like semantics to version data while working with Apache Iceberg tables. Nessie can prepare isolated changes across tables and apply them atomically, so users do not encounter incomplete updates. It versions the file lists linked to datasets rather than copying the underlying data, and supports dataset branches, point-in-time rollback, and table-level snapshots. The project lists integration guides for Spark, Flink, Hive, and Trino, along with a Web UI and a command-line interface with a REPL. You can run it as a Docker image or on Kubernetes, with images for amd64, arm64, ppc64le, and s390x. Storage backends are pluggable, including DynamoDB, Google BigTable, Cassandra, PostgreSQL, MariaDB, MySQL, and local RocksDB. Nessie documents authentication options, metadata authorization rules, garbage collection, and repository export and import tools.

Who it suits

It suits teams managing Iceberg-based data lakes that need branching, rollback, atomic cross-table changes, and self-hosted deployment. It is also relevant for organizations able to provide a storage backend and separate data-access controls from metadata authorization.

What it does well

Free and Apache-licensed
Atomic cross-table transactions
Dataset branching and point-in-time rollback
Docker and Kubernetes deployment
Pluggable storage backends

What to know first

Self-hosted deployment required
Separate system controls data access
No free trial listed

Verdict

Project Nessie combines versioned data-lake metadata with branching and transactional updates. Its self-hosted model, storage choices, and integration guides make it suited to teams operating their own data infrastructure.

Facts from Project Nessie's own pages

Access control: Nessie supports configurable authorization rules for operations such as listing references, reading entity values, and creating branches. · projectnessie.org, 8 Oct 2026
Authentication: Nessie catalog configuration documents NONE, BEARER, OAUTH2, and AWS authentication types. · projectnessie.org, 8 Oct 2026
Authorization scope: Nessie authorization controls metadata access; the documentation says a separate system is expected to control access to the data itself. · projectnessie.org, 8 Oct 2026
Command-line tools: The Nessie CLI is a command-line interface and REPL. · projectnessie.org, 8 Oct 2026
Community support: The project directs users to its Google Group and Zulip chat for contact and community discussion. · projectnessie.org, 8 Oct 2026
Consistent changes: Nessie lets users prepare isolated data changes and apply them atomically so users do not see incomplete changes. · projectnessie.org, 8 Oct 2026
Container architectures: The downloads page lists Docker images for amd64, arm64, ppc64le, and s390x. · projectnessie.org, 8 Oct 2026
Data cleanup: The Nessie GC tool can mark and sweep data files according to flexible expiration policies. · projectnessie.org, 8 Oct 2026
Data handling: Nessie versions lists of files associated with datasets and does not make copies of the underlying data. · projectnessie.org, 8 Oct 2026
Deployment: Nessie can run as a Docker image or on Kubernetes. · projectnessie.org, 8 Oct 2026
Integrations: The project documents using Nessie with Spark, Flink, Hive, and Trino through Iceberg. · projectnessie.org, 8 Oct 2026
License and governance: Nessie is Apache-licensed and developed in an open-source, consensus-driven GitHub community. · projectnessie.org, 8 Oct 2026
Purpose: Nessie is a transactional catalog for data lakes that uses Git-like semantics to version data. · projectnessie.org, 8 Oct 2026
Repository migration: The Nessie Server Admin Tool supports exporting and importing a Nessie repository. · projectnessie.org, 8 Oct 2026
Scale: The project says Nessie supports millions of tables and thousands of commits per second. · projectnessie.org, 8 Oct 2026
Security: Nessie supports authentication using OpenID Connect bearer tokens, and its documentation describes authorization controls. · projectnessie.org, 8 Oct 2026
Storage: The service has a pluggable storage backend, with packaged support for DynamoDB, Google BigTable, Cassandra, PostgreSQL, MariaDB, MySQL, and RocksDB local storage. · projectnessie.org, 8 Oct 2026
Support and community: The project directs users to its Google Group and Zulip chat for contact and community support. · projectnessie.org, 8 Oct 2026
Table format: Nessie works with Apache Iceberg tables. · projectnessie.org, 8 Oct 2026
Transactions: Nessie provides cross-table transactions and visibility. · projectnessie.org, 8 Oct 2026
Web UI: The documentation includes a Web UI for Nessie. · projectnessie.org, 8 Oct 2026
What it does: Project Nessie is a transactional catalog for data lakes with Git-like semantics and data version control. · projectnessie.org, 8 Oct 2026

Where Project Nessie stands on Freedom251

Data Version Control Tools#27 of 36