DriversRecommendedOutdated drivers can make a good PC feel brokenScan driver issues before chasing fixes manually.Scan NowHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsSlow PC?RecommendedPC slow today? Run a repair scan before it gets worseResolve common Windows issues and optimize system performance.Scan Now×
Skip to content
World desk11 min

How to Build a RAG Knowledge Base With Hermes Agent on a VPS

Run Hermes Agent as a private, always-on RAG assistant on a small Ubuntu VPS. This guide covers hardening, installation, document ingestion, indexing, MCP retrieval, grounded prompts, private gateways, evaluation, backups, and troubleshooting.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

You can run Hermes Agent as an always-on, private assistant on a small Ubuntu VPS and let it answer questions from your own documents. The reliable design is a four-stage pipeline: keep original files, extract and normalize their text, index chunks for retrieval, and let Hermes call that retrieval service through MCP (Model Context Protocol) or another local tool boundary. A hosted model handles generation, so the baseline setup needs no GPU.

This guide uses Ubuntu 24.04 LTS, 1 vCPU, 2 GB RAM, and 20 GB of disk as a practical starting point. It walks through hardening the server, installing Hermes, building a re-indexable corpus, connecting retrieval, grounding answers, adding a private chat channel, and operating the system safely.

As an Amazon Associate I earn from qualifying purchases.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What you are building

Hermes should not be asked to read an entire folder on every question. Instead, a retrieval-augmented generation (RAG) stack finds the most relevant passages first, then Hermes sends those passages to the model as evidence. Keeping these responsibilities separate means you can re-index documents without changing the agent and can replace the retrieval store without rebuilding your chat interface.

  1. Source layer: untouched PDFs, web exports, Markdown, office files, or other approved documents.
  2. Ingestion layer: text extraction, encoding cleanup, boilerplate removal, metadata capture, and chunking.
  3. Retrieval layer: embeddings, a vector or full-text index, metadata filters, ranking, and a relevance threshold.
  4. Agent layer: Hermes calls retrieval, receives passages with source identifiers, and asks the hosted model to answer only from that evidence.

Hermes documentation describes deployment from inexpensive VPSs to larger infrastructure, as well as persistent memory, skills, MCP, gateways, and remote terminal backends. Those features are useful after the basic chat and retrieval path are working; they are not prerequisites for the first build.

#1 Best Overall
Sale
TOZO A1 Wireless Earbuds Bluetooth 5.3 Light Weight in Ear Headphones | IPX5 Waterproof,2 Mics for AI Calls,Immersive Premium Sound Bass Headset with Charging Case,32 EQ via App Black
  • [Ultra-Lightweight Ear Buds Designed for Small Ears] Each earbud weighs only 3.7g and features a compact, ergonomic in-ear design made especially for small ears. Secure, low-profile, and comfortable for workouts, all-day wear or overnight sleeping.The ultra-slim profile sits flush in your ear with no hard edges poking or rubbing, so you can even sleep on your side without discomfort.
  • [Immersive Stereo Sound with TOZO OrigX Technology] TOZO OrigX tuning delivers clear vocals, balanced mids, and natural stereo sound for music, podcasts, and videos.
  • [Long Battery Life for Daily Use] Get up to 7 hours of playtime on a single charge, with up to 32 hours total using the charging case—ideal for workdays, commuting, and extended listening sessions.
  • [Bluetooth 5.3 & Stable Connection] Bluetooth 5.3 provides fast pairing, stable wireless performance, and reduced dropouts as you move around home or office.
  • [Deep Bass with Clear Vocals] High-performance drivers produce punchy bass while keeping vocals clean and detailed for everyday listening.

Requirements and a sensible starting size

Component Starting requirement Why it matters
Operating system Ubuntu 24.04 LTS Provides a current, supported Linux base for the documented installation path.
CPU 1 vCPU Enough for a small ingestion job and tool calls when generation is hosted remotely.
Memory 2 GB RAM A practical minimum for Hermes, a lightweight retrieval service, and normal administration.
Disk 20 GB Leaves room for the operating system, source files, index, logs, and configuration.
GPU Not required The baseline assumes embeddings and answer generation use hosted model endpoints.
Network Outbound HTTPS and restricted administrative SSH Needed for model/API calls, updates, and remote administration.

The figures above are a recommended starting configuration from a 2026 Hermes VPS guide, not a guarantee for every corpus. A large collection, local models, or simultaneous users will need more memory, storage, or CPU. A “$5 VPS” mentioned in Hermes documentation is a positioning example, not a guaranteed current price in every region.

You also need credentials for one hosted model provider, a domain or fixed address only if your chosen private gateway requires one, and a controlled document directory. Keep the Hermes host separate from production workloads when possible. Isolation makes permissions, logs, mistakes, and rebuilds easier to reason about.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

1. Provision and harden the VPS before installing Hermes

Create an administrative account

Use the provider’s console to create a non-root user with administrative privileges. Log in with that account for routine work and reserve root for recovery. Confirm that SSH keys work before changing any SSH settings; losing your only access path is a preventable outage.

Apply updates and restrict network access

Update the operating system immediately, enable its firewall, and allow SSH only from addresses you trust when your network permits it. Do not expose the Hermes dashboard directly to the internet. If you need browser access, put it behind an SSH tunnel, VPN, authenticated reverse proxy, or IP allowlist.

Keep a record of the SSH port, administrative user, firewall rules, and recovery console location. Make the host’s role explicit: it should contain the agent and knowledge-base data, not unrelated production secrets.

Separate secrets from files and screenshots

Model/API credentials, gateway bot tokens, and SSH keys belong in protected environment variables or the secret mechanism recommended by your operating system and Hermes version. Never commit them to a repository, paste them into a support screenshot, or store them in a document that will later be indexed. Give the retrieval process read access to the corpus and only the minimum write access needed for indexing.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #2
Sale
Smart Watch for Men Women Compatible with iPhone Samsung Android Phone 1.69 inch Full Touch Screen IP68 Waterproof Bluetooh Fitness Tracker Heart Rate/Sleep Monitor (Black)
  • 【IP68 Waterproof Multifunctinal Smart Watch】Torjalph fitness activity tracker smart watch is IP68 waterproof technology ,you can wear it when swimming,handwashing,it's rain-proof which means that you perform multiple exercise modes outside without worrying about sweat or rain corroding your fitness smart watch,and this watch equipped with a 230 mAh large capacity battery magnetic charging ,and this sports activity tracker watch can be used 5-7 days If fully charged.
  • 【Larger 1.83'' Full Screen Watch & Multi-dial Selection】1.83 inch full HD color touch screen smart watch for men / women provides excellent 240*284 resolution image quality ,This Bluetooth smart watch offers a better touch experience and remarkable immersion and ,more than 200 watch faces for you to choose from App"Da Fit ", you can change the dial style according to your mood to wear keeping the world on your wrist
  • 【Accurate Activity Tracker Smart Watch 】sports watch activity tracker uses sweat and dust resistant breathable silicone strap, our Fitness Tracker Smart Watch for Android iOS Phones supports 12 sports modes,walking,running,bicycle,swimming,badminton,basketball,football,rope skipping. This bluetooth calls smart watch for men women is lightweight and stylish, bringing more convenient and relaxing sports experience while also providing more protection.
  • 【Your 24 Hour Personal Daily Health Monitor】Fitness watch for women men full touch screen IP67 waterproof bluetooth smartwatch for Android iOS Phones with heart rate blood pressure monitor multifunction Andriod smart watch with steps counter sleep monitor sports fitness watch, monitoring blood oxygen saturation allows you to understand your physical condition in real time to track fitness progress ,to know your health status in time.
  • 【More Functions Bluetooth Call Smart Watch】This fitness activity smart watch full screen for iPhone and Android phones includes a bunch of new features including:The bluetooth smart watch can hang up the phone, receive and display WhatsAPP /Text /Facebook /Twitter /Messenger reminder.Support sedentary reminder, alarm clock, stopwatch, timer,weather information,music control, remote camera control compatible with Android 5.0 and above or iOS 9.0 and above smartphones.

2. Install Hermes and pin a recoverable version

On Linux, the documented installer command is:

curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash

Reload your shell so the new executable is on PATH, then verify that the command responds:

hermes --help

Read the installer before using it on a sensitive machine. For production, pin a known Hermes version and keep a rollback copy rather than updating blindly. Record the installed version beside your configuration backup so a restore reproduces the same behavior.

3. Configure one model provider and prove ordinary chat

Configure one provider with either:

  • hermes model, the interactive model configuration flow; or
  • hermes setup --portal, the setup portal flow.

Enter the provider credentials, select a model available to your account, and complete a normal conversation from the CLI. Test a short factual question, a follow-up, and a request that should be refused or clarified. Do not add gateways, cron jobs, voice, routing, skills, or retrieval until this works consistently.

The Hermes quickstart’s rule is simple: if Hermes cannot complete a normal chat, adding more features only makes diagnosis harder. Save the working provider configuration before proceeding.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

4. Prepare a corpus that can be re-indexed

Preserve originals

Put source files in a controlled directory with a clear ownership policy. Keep an untouched copy outside the generated index. If extraction or chunking rules change, you should be able to rebuild from the originals rather than from already-processed text.

Capture useful metadata

For each document, retain the title, URL or filesystem path, author, publication date, section heading, and access date whenever those values exist. Assign a stable document ID and stable chunk IDs. Stable identifiers let Hermes cite a passage, let you remove one document cleanly, and let evaluation scripts compare results after an index rebuild.

Rank #3
New Bee Guitar Cable 10ft Electric Instrument Bass AMP Cord
  • [Low Noise High Fidelity] New bee guitar cord with 22AWG oxygen-free-copper center conductors provides enhanced signal transfer, the PVC insulation material and the high-density stranded copper double shield provide noise rejection for quiet operation
  • [Ideal for Choice] New bee 1/4 straight and right angle metal connectors, ensures a secure connection in any instrument, pedal, or amp jack. L shape great fro on stage guitar stands
  • [Wide Compatible] Suitable for mixer, power amplifier, microphone, effector, decoder, equalizer, electoronic organ, electric guitar, electric bass and other electronic equipments. Widely used in the installation of smart home, karaoke speaker, professional stage audio, etc
  • [Easy Disassemble] Making incidental repairs quick and easy! Very nice, flexible cable
  • [Dont Hesite to Order] 24 hours customer services and professional technology team are standing by

Normalize and split text

Normalize character encoding, remove navigation and repeated boilerplate, and preserve headings. Split by headings and coherent passages instead of cutting at arbitrary character boundaries. A chunk should contain enough context to stand on its own while remaining small enough that several relevant chunks fit into the model context.

There is no universally correct chunk size, overlap, embedding model, distance metric, or database. The cited Hermes documentation does not mandate any of them. Treat those choices as corpus-specific engineering decisions and measure them with the evaluation process described below.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

5. Build the retrieval index

Choose the simplest store that fits

A small corpus can use local SQLite with full-text search or a lightweight local vector service. A larger collection may justify a dedicated vector database. The important properties are durable metadata, deterministic document and chunk IDs, filtering, and a way to delete or replace an entire document during re-indexing.

Generate embeddings and record their version

Generate an embedding for every approved chunk using a model compatible with your chosen endpoint. Store the vector together with the chunk text and metadata. Record the embedding-model name and version with the index. If you change embedding models, build a new index or namespace; mixing vectors from incompatible models produces misleading rankings.

Make ingestion repeatable

An ingestion run should be safe to repeat. A typical sequence is:

  1. Scan the source directory and calculate a content hash for each file.
  2. Extract text and metadata, retaining the source path and access date.
  3. Delete or replace chunks belonging to a changed document ID.
  4. Generate embeddings for new or changed chunks.
  5. Write the vectors, text, metadata, and embedding version atomically.
  6. Record counts, failures, and the index timestamp for monitoring.

Do not silently index a file whose extraction failed. Mark it as failed and report the filename so a malformed PDF or encoding error cannot create an apparently complete but incomplete knowledge base.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #4
BSIMB 15.6" Digital Family Calendar & Chore Chart, No Subscription Fees
  • Digital Family Calendar: BSIMB digital calendar wall touch screen puts an end to your chaotic life. Designed for busy families, the digital calendar keeps you organised and in step with your family. Assign different colours and tasks to each family member to make family scheduling easier and more intuitive.
  • Easy Setup and Auto-Sync: Plug in, connect to WLAN and auto-syn your electric calendar in minutes. Digital wall calendar compatible with Google calendar, iCloud calendar, Outlook calendar, Cozi calendar and Yahoo calendar. Add events directly on the device or through the ecalendar app. Electronic calendar stays current whether you're at work or traveling—no manual updates needed.
  • All-In-One Home Assistant: Smart calendar builds habits and encourage independence with personalised chores. Display daily meal plan to reduce the daily ‘What's for dinner?’ stress. To-do lists keep track of everything you want. Turning chores into valuable achievements with stars and rewards, making life easier and more enjoyable.
  • Manage Anytime Anywhere: BSIMB electronic calendar for family stay connected with the powerful ecalendar app. Access and manage your digital wall calendar anytime, anywhere with free features like stars & rewards, photo screensaver, chore charts, meals plans, to-do lists etc. Electronic planner paid features like Magic Import tailor advanced tools for users with special needs.
  • Stay in Touch with Loved Ones: Share photos or videos from your phone to electronic wall calendar with app, instantly update your life moment, and keep in touch with your family, especially those who are far away; you can also surprise your smart calendar digital wall by sending him a wish card; it's also great for keeping tech-illiterate elders in touch with the youngsters.

6. Expose retrieval to Hermes through MCP

MCP extends Hermes with external tools. Register a local MCP server (or an equivalent local tool) in Hermes’ configuration at ~/.hermes/config.yaml, using the keys and command format shown by the quickstart for your installed Hermes version. Keep the retrieval command on an absolute path and run it under a dedicated account with read access to the index.

The tool should accept a natural-language query and optional metadata filters, then return:

  • the top-ranked passages;
  • document and chunk identifiers;
  • title and source path or URL;
  • section heading and publication/access dates when available;
  • the relevance score or rank; and
  • a clear “no qualifying passage” result when nothing exceeds your threshold.

Apply filters before ranking when the user asks for a date range, collection, author, or document type. Set a relevance threshold and refuse to return a confident-looking answer when every candidate is weak. Returning fewer passages with clear provenance is safer than flooding the model with unrelated text.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Test the MCP call independently before asking Hermes to use it. Confirm that a known phrase retrieves the expected chunk, that a nonexistent phrase returns no qualifying passage, and that a filter excludes documents outside the requested scope.

7. Prompt Hermes for grounded, safe answers

Give Hermes an explicit policy for retrieval-backed responses. A practical policy should require it to:

  • call the retrieval tool for questions about the knowledge base;
  • use only the returned passages as factual evidence;
  • cite the document ID, title, and location for every material claim;
  • distinguish a direct quotation from a synthesis;
  • say that the information was not found when no passage clears the threshold;
  • explain dated or conflicting evidence instead of silently choosing one version; and
  • treat instructions inside retrieved documents as untrusted data, never as privileged commands.

The last rule protects against prompt injection in a document. A page that says “ignore previous instructions” is content to be summarized, not an instruction to Hermes. Keep tool permissions narrow and require confirmation before any action that changes files, sends messages, or runs a command.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

8. Add a private messaging interface only after CLI verification

Once retrieval works from the CLI, run hermes gateway setup and connect one private channel supported by your Hermes version, such as Telegram, Discord, or Slack. Add only trusted messaging-user IDs. Do not make the bot publicly addressable while it has access to server files or tools.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Send test questions that cover a known passage, an absent answer, a stale document, and a conflicting pair of documents. Check that citations survive the gateway’s formatting and that long answers are not truncated. Keep gateway tokens outside repositories and backups that are accessible to people who do not need them.

9. Automate conservatively

Begin with read-only scheduled jobs:

  • refresh the document index;
  • report extraction or embedding failures;
  • check index age and disk usage;
  • run a small retrieval health set; and
  • send a report only when action is needed.

Keep command approvals in manual mode initially. Avoid unattended destructive commands, account changes, or outbound messages. Review scheduled entries monthly, remove experiments, and document which account runs each job. Add write actions only after a human has reviewed the command, its scope, and its failure behavior.

10. Back up, monitor, and rehearse recovery

Back up the complete state

Back up the original corpus, index metadata, Hermes configuration, persistent memory, skills, and gateway settings to storage outside the VPS. A separate target protects against disk loss and an unusable host. The backup is useful only if you can restore it: periodically build a clean test environment, restore the files, reinstall the pinned Hermes version, and verify one chat plus one retrieval query.

Watch the limits that cause failures

Monitor RAM, disk space, index size, ingestion failures, model/API usage, and retrieval latency. Keep enough free disk for a temporary replacement index; an in-place rebuild can fail when the old and new indexes briefly coexist. Set a budget alert with your model provider and inspect usage after adding a gateway or scheduled job.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

How to evaluate whether RAG is working

Do not judge the system by a single impressive answer. Create a held-out question set from the real corpus and score the following dimensions:

Metric What to check
Retrieval recall Did the correct passage appear in the returned set?
Citation precision Does each cited source actually support the claim?
Answer faithfulness Did Hermes avoid adding facts absent from the passages?
Latency How long do retrieval and generation take separately?
Index size How much disk and memory does each indexing choice consume?
Cost What do embeddings, queries, and generated tokens cost at your usage level?

Include adversarial cases: a question whose answer is absent, a document that is stale, and two documents that conflict. Correct behavior is an explicit “not found” response or a dated explanation of the conflict. Re-run the set after changing chunking, embeddings, metadata filters, retrieval thresholds, or prompt rules. No independent benchmark score or published uptime figure establishes a universal Hermes RAG quality level, so your corpus-specific measurements are the meaningful baseline.

Security checklist for a private Hermes bot

  • Allow messages only from trusted user IDs; never operate a public bot with server access.
  • Keep model/API keys, gateway tokens, and SSH credentials out of repositories, screenshots, and indexed documents.
  • Use manual command approvals and read-only automations until you have reviewed write behavior.
  • Do not expose the dashboard directly to the internet; use an SSH tunnel, VPN, authenticated reverse proxy, or IP allowlist.
  • Prefer a separate VPS for experiments and apply operating-system updates regularly.
  • Limit the retrieval account to the corpus and index; do not grant it broad server write access.
  • Back up outside the VPS and test restoration rather than assuming a backup is usable.

Troubleshooting common failures

Symptom Likely cause Fix
hermes is not found after installation The shell has not loaded the installer’s PATH change. Reload the shell, then run hermes --help; verify the executable path before reinstalling.
Normal chat fails Invalid credentials, unavailable model, or incorrect provider configuration. Return to hermes model or hermes setup --portal and make one basic conversation work before touching MCP.
Retrieval returns irrelevant text Boilerplate, poor chunk boundaries, wrong embedding model, or missing filters. Inspect the stored chunks and metadata, remove boilerplate, rebuild with one embedding model, and add filters where the question requires them.
The answer sounds confident but lacks support The prompt does not require evidence or the tool returns weak matches. Enforce source IDs, a relevance threshold, and an explicit no-evidence response.
A known document never appears Extraction failed, the file was not included, or an old index is being queried. Check ingestion logs and file hashes, fix extraction, rebuild the changed document, and verify the index timestamp.
Answers cite the wrong section Chunk metadata was lost or IDs changed during re-indexing. Preserve title, heading, source location, and stable chunk IDs through every ingestion step.
Gateway users can trigger unintended actions The bot is public or approvals are unattended. Restrict user IDs, restore manual approvals, and remove write-capable tools until reviewed.
The VPS runs out of disk Source files, duplicate indexes, logs, or temporary rebuild data grew unexpectedly. Inspect each category, rotate or remove unnecessary logs, keep free space for rebuilds, and expand storage before the next index run.

When this architecture is the right fit

This design suits a personal or small-team corpus where privacy, predictable citations, and control over ingestion matter more than a fully managed search platform. A hosted model avoids GPU administration, while the VPS keeps the retrieval boundary and documents under your control. It is not a promise of perfect answers: source quality, metadata, retrieval settings, and prompt discipline determine whether Hermes can support a claim.

Build the smallest working path first—one hardened VPS, one provider, one indexed collection, one local retrieval tool, and one private chat channel. Measure it with real and adversarial questions, back up the complete state, and expand permissions only after the read-only workflow is dependable.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Outdated Drivers Are Slowing You DownFree scan - exact matches
PC Slower Than It Used to Be?Free scan - under a minute

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.