PromptOps Manager

What PromptOps Manager is

PromptOps Manager is a self-hosted, open-source registry for versioning, testing, and promoting LLM prompts. Each prompt change gets a numbered version, preserving prior versions, and selected versions can be promoted independently to development, staging, or production. Its asynchronous test runner supports contains, not_contains, regex, and llm_judge assertions. The llm_judge option uses a second LLM call to grade a response and explain its reasoning. Documented providers are OpenAI and Anthropic, with a fake provider for hardcoded responses. Apps and scripts can retrieve prompts through a public resolve endpoint; the README describes an n8n workflow that uses it to fetch a production prompt. The endpoint is unauthenticated by design, while per-consumer read tokens are listed as planned work. The project is MIT licensed and free to self-host. Its quick start uses Docker Compose and lists Docker 24.0 and Docker Compose v2 as prerequisites. The described architecture uses Laravel 11, React 18, PostgreSQL, and Redis. Team and workspace roles, a CLI, and GitHub Actions integration are also roadmap items.

Who it suits

PromptOps Manager suits developers who want to self-host prompt versioning, evaluation, and promotion across environments. It may fit projects using the documented OpenAI or Anthropic providers and Docker Compose.

Limits

The product is free to self-host. Its resolve endpoint is unauthenticated by design, and per-consumer read tokens are on the roadmap; team and workspace roles, CLI, and GitHub Actions integration are also planned rather than current features.

Getting started

1. Visit the project's GitHub repository.
2. Install Docker 24.0 and Docker Compose v2.
3. Follow the Docker Compose quick start to self-host the project.
4. Connect a documented provider, or use the fake provider for hardcoded responses.
5. Retrieve prompts from the resolve endpoint in an app or script.

Verdict

PromptOps Manager provides a self-hosted workflow for prompt versions, tests, and environment promotion. Its unauthenticated resolve endpoint and roadmap status for team features are important considerations.