DriversRecommendedOutdated drivers can make a good PC feel brokenScan driver issues before chasing fixes manually.Scan NowHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsSlow PC?RecommendedPC slow today? Run a repair scan before it gets worseResolve common Windows issues and optimize system performance.Scan Now×
Skip to content
World desk4 min

How to Build a Voice-Enabled Chatbot with ElevenLabs and OpenAI

A practical architecture for combining ElevenLabs Speech Engine with server-side OpenAI responses, plus setup requirements, key safeguards, pricing context, and what to test.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Build the chatbot as three connected parts: a browser that captures and plays audio, an application server that calls OpenAI and keeps both providers’ credentials private, and ElevenLabs Speech Engine, which handles speech-to-text and text-to-speech. In ElevenLabs’ documented flow, a WebSocket session represents a conversation: the server receives transcript events, sends conversation history to OpenAI, then streams the model’s response back to the session for speech output. ElevenLabs’ Speech Engine guide provides a Python starting point.

How the voice-chatbot architecture works

The division of work is straightforward: ElevenLabs processes speech, while your application server controls the language-model logic. As ElevenLabs puts it, “ElevenLabs handles speech-to-text and text-to-speech; your server provides the LLM logic.” The browser captures a user’s audio and plays the reply; it should not contain server-side API keys.

As an Amazon Associate I earn from qualifying purchases.

  1. Browser client: Captures microphone audio and plays the audio response. It connects to the conversation flow but should not expose provider credentials.
  2. Application server: Receives the conversation events, maintains or forwards conversation history, calls OpenAI’s API, and streams the response onward.
  3. ElevenLabs Speech Engine: Handles speech recognition and speech synthesis around the server’s LLM logic. The official tutorial describes its SDK as handling connection management, turn-taking, and interruption detection; treat that as the vendor’s description, not an independently measured guarantee.

This is a server-mediated pattern, not the only possible way to build a voice chatbot. Its practical advantage is that prompts, conversation state, and model calls remain under your application’s control.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What you need before building

  • An ElevenLabs API key and an OpenAI API key.
  • A Python environment for the official example, which installs elevenlabs, openai, and python-dotenv.
  • A publicly reachable WebSocket endpoint for Speech Engine to connect to. The tutorial demonstrates exposing a local development server with ngrok.
  • A server process that can make a streaming request to OpenAI’s Responses API, as shown in the tutorial.

The example requires the OpenAI key in the OPENAI_API_KEY environment variable. Store both providers’ credentials on the server, using managed secrets or environment variables rather than placing them in browser code. ElevenLabs’ API quickstart recommends managed secrets or environment variables for its key and demonstrates a text-to-speech request using a voice ID and model ID.

#1 Best Overall
Sale
FIFINE AmpliGame AM8 USB/XLR Dynamic Microphone for Gaming Streaming | Podcast Mic with RGB Light, Mute Button, Headphones Jack, Desktop Stand, for Vocal Recording Singing YouTube
  • [Natural Audio Clarity] Operated with frequency response of 50Hz-16KHz, the podcasting XLR mic delivers balanced audio range, likely to resonate with your audience. Directional cardioid dynamic microphone corded will not exaggerate your voice, while rejects unwanted off-axis noise for vocal originality and intelligibility during your PS5 gaming streaming video recording. (Tips: Keep the top of end-addressing XLR dynamic microphone AM8 facing audio source, and suggested recording range is 2 to 6 in.)
  • [XLR Connection Upgrade-Ability] To use XLR connection, connect the podcast microphone to an audio interface (or mixer) using a separate XLR cable (NOT Included) . Well-connected and smooth operation improves audio flexibility to make you explore various types of music recording singing. The streaming mic isolates the pristine and accurate sound from ambient noise with greater no interference and fidelity. (RGB and function key on mic are INACTIVE when using XLR connection.)
  • [USB Connection with Handy Mute] Skip the hassle of setting something up and plug the cable to play the dynamic USB microphone directly, which suits for beginner creators or daily podcast. You can quickly control the gamer mic with tap-to-mute that is independent of computer/Macbook programs to keep privacy when live streaming. LED mute reminder helps you get rid of forgetting to cancel the mute. (RGB and function key are only available for USB connection, but NOT for XLR connection)
  • [Soothing Controllable RGB] RGB ring on the desktop gaming microphone for PC, with 3 modes and more than 10 light colors collection, matches your PC gears accessories for gaming synergy even in dim room. You can control the RGB key button of the dynamic microphone USB directly for game color scheme gaming or live streaming. Configured memory function, the streaming microphone RGB no need to repeated selections after turnning off and brings itself alive when power on. (Only available for USB connection)
  • [More Function Keys] Computer microphone with headphones jack upgrades your rhythm game experience and gets feedback whether the real-time voice your audience hear as expected. Get the desired level via monitoring volume control when gaming recording. Smooth mic gain knob on the PC microphone gaming has some resistance to the point, easily for audio attenuation or boost presence to less post-production audio. (Only available for USB connection)

Build the first working version

  1. Install the tutorial’s Python dependencies. In your project environment, install elevenlabs, openai, and python-dotenv, as listed in the Speech Engine tutorial.
  2. Set server-side credentials. Configure OPENAI_API_KEY and the ElevenLabs key in the server environment or a managed secret store. Load secrets on the server; do not send them to the browser.
  3. Implement the server’s WebSocket conversation endpoint. Follow the tutorial’s event flow: receive transcript events from the ElevenLabs session, provide relevant conversation history to OpenAI, and stream the generated response back to the session.
  4. Expose the endpoint for development. Speech Engine needs a publicly reachable URL. The tutorial uses ngrok to make a local server reachable and configures a WebSocket URL. This is a development workflow, not a complete production deployment or security design.
  5. Connect the browser experience. Capture the user’s audio and play the response audio returned through the session. Test a complete conversation, including follow-up turns, rather than checking only that the first response works.

Use the vendor’s tutorial for the exact SDK calls and event payloads; those implementation details can change. The evidence here supports the described Python/OpenAI streaming pattern, but not a claim that a particular hosting setup, authentication scheme, or deployment is production-ready.

What to evaluate before choosing this pattern

The official example establishes an integration path, not a controlled comparison against other voice architectures. Assess the experience with your own target users and workload rather than assuming a particular latency or speech-quality result.

Rank #2
FIFINE K669B USB Microphone, Condenser Recording Mic for Vocals, Meeting | Metal Cardioid Laptop Mic for MAC OS, Windows, Voice Overs, Streaming, Online Meeting and YouTube Videos
  • [Convenient Setup] Plug and play recording USB microphone for PC, with 5.9-Foot USB cable included for computer PC laptop, is connected directly to USB-A port for recording music, computer singing or podcast. The office condenser microphone for computer is easy to use and install. (NOT compatible with Xbox and Phones)
  • [Durable Metal Design] Solid sturdy metal construction design, the computer microphone for Zoom meetings with stable tripod stand is convenient when you are doing voice overs or livestreams on YouTube. Durable material extends the service life of the voice-over microphone.
  • [Mic Volume Knob] Gaming condenser USB mic compatible for PS4 with additional volume knob itself has a louder or quieter adjustment and is more sensitive. Your voice would be heard well enough through the zoom microphone USB when gaming, skyping or voice recording. Also, you can adjust your volume to zero and protect your privacy.
  • [Widely Use] USB-powered design, the condenser microphone for recording no need the 48v Phantom power supply, works well with Cortana, Discord, voice chat and voice recognition. The podcast microphone for Mac, with USB-B to USB-A/C cable, is compatible with desktop, laptop or PS4/PS5, which meets most of your daily recording needs.
  • [Clear Output Voice] Cardioid condenser microphone for PC captures your voice properly, producing clear smooth and crisp sound. Great computer recording mic for gamers/streamers/youtubers focus on the main source and reduces background noise. The streaming microphone does the job well for broadcast ,OBS and teamspeak.
  • Latency and interaction: Measure end-to-end response time, including speech recognition, the model response, and speech synthesis. Check whether streaming and interruption behavior feel suitable for the use case.
  • Voice and language fit: Evaluate available voices, supported languages, pronunciation, and speech quality for the audience you intend to serve.
  • Application control: Decide how much control you need over prompts, conversation history, tools, and server-side business logic. The documented pattern leaves the LLM logic with your server.
  • Total usage cost: Estimate speech and language-model usage together, plus hosting, network, and any optional infrastructure.

Understand the Speech Engine price in context

ElevenLabs’ API pricing page displayed Speech Engine at $0.08 per minute, with $0.16-per-minute burst pricing in its plan table. Included minutes and concurrent-call limits vary by plan, and listed prices exclude taxes, levies, and duties. These are volatile service prices; check the current API pricing page before budgeting.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

That Speech Engine figure is not a complete chatbot cost estimate. OpenAI usage, hosting, network traffic, and optional infrastructure are separate potential costs; the cited pricing information does not establish their amounts.

Rank #3
Sale
Logitech Creators Blue Yeti USB Microphone for PC, Mac, Gaming, Recording, Streaming, Podcasting, Studio and Computer Condenser Mic with Blue VO!CE effects, 4 Pickup Patterns, Plug and Play - Blackout
  • Custom three-capsule array: This professional USB mic produces clear, powerful, broadcast-quality sound for YouTube videos, Twitch game streaming, podcasting, Zoom meetings, music recording and more
  • Blue VO!CE software: Elevate your streamings and recordings with clear broadcast vocal sound and entertain your audience with enhanced effects, advanced modulation and HD audio samples
  • Four pickup patterns: Flexible cardioid, omni, bidirectional, and stereo pickup patterns allow you to record in ways that would normally require multiple mics, for vocals, instruments and podcasts
  • Onboard audio controls: Headphone volume, pattern selection, instant mute, and mic gain put you in charge of every level of the audio recording and streaming process
  • Positionable design: Pivot the mic in relation to the sound source to optimize your sound quality thanks to the adjustable desktop stand and track your voice in real time with no-latency monitoring
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

What the tutorial does—and does not—establish

The ElevenLabs guide documents how to connect its Speech Engine to server-side OpenAI logic, including a streaming Responses API example and the need for a reachable WebSocket endpoint. It is a useful implementation starting point, but it does not establish production readiness, measured latency, or speech quality under your workload. Plan and test security, deployment, reliability, and user experience for your own application.

Best Value
Sale
CMTECK USB Computer Microphone G009, Noise-Cancelling Recording Desktop Mic for PC/Laptop for Online Chatting, Home Studio, Podcasting, Gaming, Skype, YouTube with Mute Function(Windows/Mac)
  • 【Crystal Clear Audio Quality】Our Omnidirectional pattern condenser microphone accurately captures your voice, making it perfect for dictation, online classrooms, and more.
  • 【Active Noise-Cancelling】Come in CMTECK CCS2.0 SMART CHIP with Omnidirectional Polar Pattern, which can effectively block the background noise. The pop filter prevents plosives from overloading the microphone, ensuring only your voice is heard.7
  • 【Convenient Mute Button with LED Indicator】You can quickly mute/un-mute the microphone with the Mute Button and the built-in LED light lets you know the working status(Greenlight: Connected; Red light: Mute mode).
  • 【Easy to use】 No drivers needed, just plug and record without external power supply, directly connect the microphone to a USB compatible device, well compatible with Windows(7, 8 and 10), Mac OS and PS4 (NOT compatible with Raspberry Pi/Linux/Android)
  • 【Mini size with Adjustable Gooseneck】Adopted flexible and adjustable gooseneck metal pipe, easily adjust position 360 degrees to suit user comfort. The compact and stable base maximizes your desktop space.
Rank #4
Sale
JOUNIVO USB Microphone, 360 Degree Adjustable Gooseneck Design, Mute Button & LED Indicator, Noise-Canceling Technology, Plug & Play, Compatible with Windows & MacOS
  • 360 Degree Position Adjustable Gooseneck Design --Plug and play USB microphone Pick up the sound from 360-degree with high sensitivity, in the best possible location for sound to your PC gaming, dragon voice dictation, and talk to Cortana
  • Mute Button & LED Indicator --One-click to mute/unmute your microphone for pc, Build-in LED indicator tells you the working status at any time
  • Intelligent Noise-Canceling Tech --Premium omnidirectional condenser microphone with noise-canceling technology can pick up your clear voice and reduce background noise and echo
  • USB Plug&Play(1.8/6ft USB Cable) -- No driver required. Just need to plug & play for the microphone to start recording, well compatible with Windows(7, 8, 10 and 11) and macOS. (NOT compatible with Xbox/Raspberry Pi/Android)
  • Solid Construction--Adopting premium metal pipe and heavy-duty ABS stand to make sure that you will be satisfied with our computer mic quality

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Outdated Drivers Are Slowing You DownFree scan - exact matches

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.