Halloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsClean PCRecommendedOne scan can reveal what keeps slowing WindowsLook for cleanup and repair opportunities.Run ScanHalloween DealsAmazon USOctober picks are moving - compare before checkoutAmazon US: current deals, useful picks and tech finds.See Picks×
Skip to content
World desk5 min

How to Set Up Open WebUI with Ollama for a Private ChatGPT Alternative

Run Ollama models through Open WebUI in a browser. Follow the Docker setup, connect the services, keep your data persistent, and check which endpoint handles prompts.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

To use Open WebUI as a browser-based chat interface for models running locally, install Ollama, start Open WebUI with Docker, and connect the two services. Keep Open WebUI’s data volume and secret key, and check which model endpoint is selected before entering sensitive information: Open WebUI can also connect to cloud providers, so the setup is private only when you use a local model endpoint.

What Open WebUI and Ollama each do

Ollama runs and serves language models. Open WebUI provides the self-hosted interface for chatting with them. They are separate components: Open WebUI can connect to Ollama, but it can also connect to other model APIs. For most users, the simplest general-purpose setup is Ollama running on the computer and Open WebUI in a Docker container.

As an Amazon Associate I earn from qualifying purchases.

Set up Open WebUI with Docker

First install and start Ollama on the host computer. Then run Open WebUI using its documented Docker quick-start command:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
docker run -d 
  -p 3000:8080 
  --add-host=host.docker.internal:host-gateway 
  -v open-webui:/app/backend/data 
  -e WEBUI_SECRET_KEY="$(openssl rand -hex 32)" 
  --name open-webui 
  --restart always 
  ghcr.io/open-webui/open-webui:main

The command maps port 3000 on the host to port 8080 in the container, adds a hostname the container can use to reach the host, and saves Open WebUI data in a named Docker volume. The Open WebUI documentation recommends Docker for most users and lists macOS, Windows, and Linux on x86_64 and ARM64 among supported host platforms. See the Open WebUI quick start.

#1 Best Overall
GMKtec AI Mini PC Ultra 9 285H (Turbo 5.4GHz) 64GB DDR5 1TB PCIe 4.0 SSD Mini Gaming Computer 3X M.2 Expansion Slots, Oculink, Quad Screen 8K Display EVO-T1
  • EVOLUTION CORE ULTRA 9 285H MINI PC - GMKtec EVO-T1 is the next evolution in AI mini PC Ultra 9 series. The Core Ultra 9 285H offers 16 cores (six P-cores + eight E-cores + two LPE-cores) and 16 threads with a turbo clock of 5.4 GHz. It is currently one of the best value for performance AI mini PC computers.
  • AI NPU - The 285H features an Intel AI Boost NPU, capable of up to 13 TOPS (Tera Operations per Second) for INT8 calculations, which is designed to accelerate AI tasks.
  • INTEL ARC 140T GAMING PC - The Arc 140T GPU includes 8 Xe cores and supports features like DirectX 12, OpenGL 4.5, and OpenCL 3, making it capable of handling modern games and creative applications. It also supports Quick Sync Video for efficient video encoding and decoding, as well as AV1 encoding and decoding.
  • 64GB DDR5 RAM + 1TB SSD - The EVO-T1 is equipped with Dual 32GB (Total 64GB) SO-DIMM DDR5 5600MHz memory sticks. 2TB PCIE 4.0 SSD Drive with 3x M.2 2280 Expansion slots. Each slot capable of reading up to 4TB. (12TB MAX)
  • QUAD SCREEN 8K DISPLAY SUPPORT - EVO-T1 AI Mini PC support 4-screen 4K/8K output via HDMI 2.1 (8K@60Hz), DisplayPort 1.4 (4K@60Hz), and USB Type-C Transfer speed (supporting PD3.0/DP1.4/DATA). Ideal for gaming, video editing, and multitasking, it provides expansive and crisp multi-display support.
  1. Open http://localhost:3000 in a browser.
  2. Create the first account. The quick start says the first account becomes the administrator and sign-up is disabled after that account is created.
  3. Keep the generated WEBUI_SECRET_KEY somewhere secure and use the same key if you recreate the container. Generate one with openssl rand -hex 32 if needed.

The open-webui volume mounted at /app/backend/data holds chats, users, and settings. Keep it when updating or recreating the container. Removing the container does not require deleting this volume; deleting the volume can remove the stored application data.

Connect Open WebUI to Ollama and choose a model

  1. In Open WebUI, open Settings → Admin → Connections and check the Ollama connection.
  2. For Ollama installed on the Docker host with the command above, use http://host.docker.internal:11434 as the Ollama URL. If Open WebUI is installed directly with Python rather than in Docker, the local address is typically http://localhost:11434.
  3. Start a new chat and open the model selector. Choose an installed model, or enter a model name and confirm its download if prompted.

Downloading a model requires network access. After it is installed, a local Ollama model can run without sending prompts to a hosted model endpoint. Choose a model that fits your system’s memory and the task; platform support does not mean every model will run acceptably on every computer.

Rank #2
Kinupute Mini AI Server PC, Desktop Computer Ryzen 9 9950X3D, 64G DDR5, 4T M.2 PCIE4.0 SSD, 4T SATA SSD, Win-11 Pro, GeForce RTX5060Ti 16G, Six Display, HDMI/DP/Dual Type-C, 8K, Dual 2.5G LAN, WiFi7
  • 【Elite CPU & On-Device AI】Powered by AMD Ryzen 9 9950X3D — 16 cores, 32 threads, up to 5.7GHz boost clock, and a massive 64MB 3D V-Cache that slashes memory latency for gaming and simulation workloads. The integrated Ryzen AI engine provides 50 TOPS of dedicated NPU compute; combined CPU+GPU+NPU performance surpasses 100 TOPS total, enabling Microsoft Copilot+, real-time AI noise cancellation, live captions, background blur, and AI-accelerated encoding in top creative apps.
  • 【DDR5 & Flexible Two-Drive Storage】 Dual-channel DDR5-5600 RAM delivers high-bandwidth, low-latency performance for 4K video editing, 3D rendering, and heavy multitasking — expandable up to 128GB for even the most demanding workloads. Two M.2 2280 PCIe 4.0 NVMe slots (read speeds up to 7,000MB/s). A dedicated 2.5" SATA solt, Due to limited internal space, only two types of hard drives can be installed in the three drive bays. keeping your OS, game library, and project files perfectly organized.
  • 【RTX 5060 Ti 16GB GDDR7 — Connect 6 Monitors】GeForce RTX 5060 Ti with 16GB GDDR7 VRAM powers hardware ray tracing, DLSS 4 AI super-resolution, and AV1 hardware encoding for pristine 4K/8K gaming, livestreaming, and professional 3D rendering. Unique 6-display output: 1×HDMI 2.1b + 3×DisplayPort 2.1b + 2×Type-C, supporting 8K/4K@60Hz. Whether you're building a multi-screen trading desk, creative workstation, or panoramic gaming setup, every port delivers flawless image quality.
  • 【Rich I/O & Dual 2.5G Ethernet】Two 2.5GbE RJ-45 ports run 2.5× faster than standard Gigabit and support link aggregation for a combined 5Gbps wired throughput — perfect for NAS, home AI servers, and competitive gaming. Full port lineup: 4×USB 3.2, 4×USB 2.0, 2×Type-C, 1×HDMI 2.1b, 3×DP, 1×Audio in/out. Wi-Fi 7 (802.11be) and Bluetooth 5.4 ensure the fastest wireless speeds with minimal interference. Wake-on-LAN and auto power-on supported for remote management.
  • 【Advanced Cooling & 2-Year Warranty】Engineered for sustained performance in a compact 8.6×6.6×4.5 in chassis (5.5 lb). Four all-copper turbo fans combined with eight vacuum heat pipes form a high-efficiency thermal system that rapidly dissipates heat even under full CPU+GPU load, maintaining stable clocks and near-silent operation during extended gaming or rendering sessions. Backed by a 24-month warranty with responsive professional support for complete peace of mind.

Choose an installation arrangement

Arrangement When it fits What to know
Separate Ollama host service and Open WebUI Docker container You want to manage and update the interface and model server separately. Configure container-to-host networking as above. Open WebUI’s quick-start guide documents this route.
Open WebUI image with bundled Ollama You prefer a simpler initial launch with both components in one container. Open WebUI documents CPU and GPU variants. You still need persistent volumes and appropriate GPU access if you want acceleration; see its quick-start documentation and GPU guidance.
Python installation of Open WebUI You prefer running the interface directly rather than in Docker. The project lists pip install open-webui followed by open-webui serve and recommends Python 3.11 to avoid compatibility issues. See the Open WebUI GitHub instructions.

Check model and hardware requirements

Model memory needs vary. Ollama’s current quick-start example uses Gemma 4 E2B, with a download of about 7.2 GB and a recommendation of 8 GB of available VRAM or unified memory. Those figures apply to that example, not to every Ollama model. Ollama notes that system RAM can be used when VRAM is lower, but responses may be slower. Check the Ollama quick start for current model guidance and its GPU documentation for supported NVIDIA GPU families and Apple Metal acceleration.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The Open WebUI :cuda image does not give Ollama GPU access by itself. GPU visibility, drivers, and supported hardware must be set up for the Ollama service or container. A computer marketed as a mini PC is not automatically suitable: match its memory, operating system, and GPU support to the specific model you intend to run.

Rank #3
BOSGAME E4 Air Mini PC, AMD Ryzen 5 3500U 8GB DDR4 256GB SATA SSD | Mini Computers with Dual RJ45, 4K Triple Display, USB-C, USB 3.2, Wi-Fi 5/BT 5.0, Desktop Computer for Office, Home
  • 【Ryzen 5 3500U Processor】The BOSGAME mini pc is driven by the Ryzen 5 3500U (4C/8T, up to 3.7GHz) , with integrated Radeon Vega 8 Graphics, delivering reliable power, 4K video streaming and multitasking. Handle daily workloads like spreadsheet calculations, web browsing, and HD video editing effortlessly.
  • 【8GB DDR4 & 256GB SATA SSD】E4 Air mini computers with 8GB DDR4 RAM and a 256GB SATA SSD, this mini desktop ensures quick app launches and efficient multitasking. while the SSD accelerates file transfers—ideal for office documents, media storage, and everyday computing.
  • 【4K Triple Display & USB-C & USB3.2】The mini desktop computer Drives three 4K monitors via HDMI, DisplayPort and USB-C for multi-window productivity or immersive home theater setups;USB 3.2 meets your multi-interface transfer needs.
  • 【Dual RJ45 LAN & Wi-Fi 5 & BT5.0】Equipped with Dual Gigabit Ethernet, dual-band Wi-Fi 5, and Bluetooth 5.0, this ryzen mini pc ensure stable connections for 4K streaming, video calls, and file transfers. Wirelessly connect keyboards, headphones and speakers via BT5.0 ideal for office productivity and home entertainment.
  • 【3-Year Reliable Customer Services】 All of our BOSGAME mini pc gaming have FCC, ROHS, CE certifications. BOSGAME enjoy a 1-year wa-rranty for the entire machine and a 3-year wa-rranty for parts, ensuring your long-term peace of mind. If you have any questions about your purchase, please let us know through Amazon.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Understand what “private” means here

Ollama states in its official FAQ: “We don’t see your prompts or data when you run locally.” That statement concerns local model use; it is not a guarantee about every service or component on your computer.

Cloud models and third-party hosted APIs are different routes. Ollama says it processes prompts and responses to provide its cloud service, while stating that content is not stored or logged. Open WebUI can connect to hosted providers as well as Ollama, so check the endpoint for the selected model before sharing sensitive information. Ollama also documents a setting to disable cloud features in its cloud FAQ.

Troubleshoot common connection and persistence problems

  • No models appear: In Settings → Admin → Connections, check the Ollama URL and whether it is reachable from the Open WebUI container. Confirm Ollama is running and that a model is installed, or use the selector to download one. See Open WebUI’s connection troubleshooting guide.
  • Connection refused: A container’s localhost normally means that container, not the host. Confirm Ollama listens on an address the container can reach. For host-installed Ollama, the official guide discusses setting OLLAMA_HOST=0.0.0.0, restarting Ollama, or using host networking. Do not expose the service beyond the intended network without suitable security controls; consult the connection guide.
  • Ollama runs in another container: Put both containers on the same Docker network and use the Ollama service name in the base URL, rather than using localhost. Open WebUI’s quick-start documentation covers connection options.
  • Chats or settings disappear after recreation: Make sure the named volume is still mounted at /app/backend/data; Open WebUI describes the stored data in its quick start.
  • Users are logged out after recreation: Reuse the same WEBUI_SECRET_KEY rather than generating a new one each time. The quick-start instructions explain this setting.
  • The GPU appears unused: Check GPU visibility and drivers for Ollama itself. The Open WebUI CUDA image applies to its own auxiliary models, not as GPU passthrough for Ollama. Refer to Ollama’s GPU requirements.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Leave a Reply

Your email address will not be published. Required fields are marked *

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Crashes, No Sound, or Screen Glitches?Free driver scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.