Halloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsPC HealthRecommendedCrashes, freezes, slowdowns? Check your PC nowSpot repairable issues before they interrupt work.Check PCHalloween DealsAmazon USOctober picks are moving - compare before checkoutAmazon US: current deals, useful picks and tech finds.See Picks×
FREEDOM251

Freedom251 › Blog › Home Assistant

How to Set Up a Raspberry Pi as a Voice-Controlled Smart Speaker

By Freedom251 Team · · 10 min read

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Yes, you can turn a Raspberry Pi into a private, voice-controlled smart speaker, but the Pi is only one part of the system. You need Home Assistant OS, a microphone, an audio output device, a speech-to-text engine, and a text-to-speech engine. The most straightforward documented setup uses Home Assistant Assist with local Wyoming services: Speech-to-Phrase or Whisper for recognition and Piper for spoken replies.

A Raspberry Pi 4 can host Home Assistant and handle a fast, command-focused voice assistant. For open-ended transcription, the same Pi can remain the controller while Whisper runs on a more powerful computer elsewhere on your local network.

As an Amazon Associate I earn from qualifying purchases.

What a Raspberry Pi voice assistant actually requires

A finished voice assistant has four jobs: capture speech, convert speech to text, decide what the command means, and speak a response. Home Assistant Assist coordinates those jobs, but no Raspberry Pi behaves like a complete smart speaker without audio hardware and software services.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • Home Assistant OS: the host platform that runs Assist and connects voice commands to your smart-home entities.
  • Voice endpoint: a Raspberry Pi or other device with a suitable microphone and speaker or other audio output.
  • Speech-to-text (STT): Speech-to-Phrase for a limited set of home-control commands, or Whisper for open-ended transcription.
  • Text-to-speech (TTS): Piper, which generates spoken responses locally.
  • Configured entities: lights, switches, climate devices and other Home Assistant entities must be exposed to Assist before commands can control them.

The official setup does not specify a particular microphone, speaker, case, power supply, storage device or exact Raspberry Pi memory configuration. Choose hardware that is compatible with your Pi and room, and treat audio quality as a system requirement rather than an accessory detail.

#1 Best Overall
CanaKit Raspberry Pi 4 4GB Starter PRO Kit - 4GB RAM
  • Includes Raspberry Pi 4 4GB Model B with 1.5GHz 64-bit quad-core CPU (4GB RAM)
  • Includes Pre-Loaded 32GB EVO+ Micro SD Card (Class 10), USB MicroSD Card Reader
  • CanaKit Premium High-Gloss Raspberry Pi 4 Case with Integrated Fan Mount, CanaKit Low Noise Bearing System Fan
  • CanaKit 3.5A USB-C Raspberry Pi 4 Power Supply (US Plug) with Noise Filter, Set of Heat Sinks, Display Cable - 6 foot (Supports up to 4K60p)
  • CanaKit USB-C PiSwitch (On/Off Power Switch for Raspberry Pi 4)

Choose the right Raspberry Pi arrangement

Use the Pi as the Home Assistant host

Install Home Assistant OS on the Raspberry Pi and run Assist, Wyoming services and your smart-home integrations there. This is the compact option and works particularly well with Speech-to-Phrase and Piper on a Raspberry Pi 4.

Use the Pi as an audio endpoint

Home Assistant can run on another computer while a Pi supplies the microphone and speaker. This separates room audio from the controller and lets you place the endpoint where people actually speak to it.

Keep Home Assistant on the Pi and move Whisper elsewhere

Wyoming services can connect over your local network. A stronger desktop, server or other computer can run Whisper while the Pi continues to host Home Assistant and handle the rest of the assistant pipeline. This is the practical choice when you want open-ended recognition without waiting several seconds for every command.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Speech-to-Phrase or Whisper?

Your choice of speech recognizer determines whether the assistant feels immediate or flexible. Home Assistant documents both as local options, but they solve different problems.

Rank #2
Raspberry Pi 4 Model B (2GB)
  • Broadcom BCM2711, Quad core Cortex-A72 (ARM v8) 64-bit SoC @ 1.5GHz
  • 1GB, 2GB, 4GB or 8GB LPDDR4-3200 SDRAM (depending on model)
  • 2.4 GHz and 5.0 GHz IEEE 802.11ac wireless, Bluetooth 5.0, BLE Gigabit Ethernet
  • 2 USB 3.0 ports; 2 USB 2.0 ports.
  • Raspberry Pi standard 40 pin GPIO header (fully backwards compatible with previous boards)
Option Command coverage Official Pi 4 performance guidance Best fit Main limitation
Speech-to-Phrase Closed-ended; recognizes a supported subset of Assist home-control commands Under one second on Home Assistant Green or Raspberry Pi 4, according to Home Assistant documentation Lights, switches, scenes and routine smart-home control It cannot reliably transcribe arbitrary requests outside its supported command set
Whisper Open-ended transcription of arbitrary speech Around eight seconds to process incoming voice commands on a Raspberry Pi 4, according to Home Assistant documentation Free-form requests or an agent that needs general transcription High latency on Pi 4 hardware unless you move the service to a stronger machine

These figures are Home Assistant’s vendor-maintained guidance, not an independent benchmark. Actual results vary with model, language, storage, background load, microphone quality and room acoustics.

When Speech-to-Phrase is the better choice

Choose Speech-to-Phrase when your priority is fast, predictable control of supported devices. A command such as turning on a light or changing a thermostat setpoint can be answered in under a second on the referenced hardware. The trade-off is coverage: the model transcribes what it knows, not every sentence a person might say.

When Whisper is worth the delay

Choose Whisper when users need natural, open-ended transcription or when you plan to pass text to a more general conversational agent. On a Pi 4, Home Assistant reports around eight seconds for incoming voice commands, so a local Pi-only Whisper setup may feel unresponsive. Run Whisper as a Wyoming service on a faster device on the same LAN instead.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Install the hardware before configuring software

  1. Prepare the Pi: use a Raspberry Pi 4 if you want to follow Home Assistant’s explicit performance references for Speech-to-Phrase and Piper. Install Home Assistant OS on compatible boot storage and connect the Pi to your home network.
  2. Connect a microphone: use a USB, audio-interface or other microphone that your chosen endpoint supports. Place it away from the speaker and sources of vibration where possible.
  3. Connect audio output: provide a speaker or other supported output so Piper’s responses are audible. The official guidance does not endorse a particular peripheral model.
  4. Check the room: make sure the microphone can hear normal speech from the intended position and that the speaker is loud enough without feeding excessive sound back into the microphone.
  5. Decide where compute runs: keep Speech-to-Phrase and Piper on the Pi for a compact local setup, or reserve a stronger LAN computer for Whisper.

Install and discover the Wyoming speech services

Home Assistant’s local voice route uses Wyoming-compatible services. Wyoming provides the connection layer between Home Assistant and speech engines such as Speech-to-Phrase, Whisper and Piper.

Rank #3
Raspberry SC15184 Pi 4 Model B 2019 Quad Core 64 Bit WiFi Bluetooth (2GB)
  • Broadcom BCM2711, quad-core Cortex-A72 (ARM v8) 64-bit SoC @ 1. 5GHz
  • 2. 4 GHz and 5. 0 GHz IEEE 802. 11b/g/n/ac wireless LAN, Bluetooth 5. 0, BLE
  • 2 × USB 3. 0 ports, 2 x USB 2. 0 Ports
  • 2 × micro HDMI ports supproting up to 4Kp60 video resolution
  • Micro SD card slot for loading operating system and data storage
  1. In Home Assistant, install the speech-to-text application you selected and install Piper for text-to-speech.
  2. Start each application and wait for it to become available on the network.
  3. Open Settings > Devices & services.
  4. Look for the discovered Wyoming integrations for your STT engine and Piper.
  5. Add each discovered integration and complete any prompts for host, port, language or voice.
  6. If Whisper is running on another computer, use that machine’s local-network host name or IP address and the port exposed by its Wyoming service. Keep both devices on the same trusted LAN.

If a service does not appear automatically, verify that it is running, that the host is reachable from Home Assistant and that the required port is allowed on the local network. Do not expose a Wyoming service directly to the public internet; the documented arrangement is a local-network connection.

Configure an Assist voice assistant

  1. Open Settings > Voice assistants.
  2. Create a new assistant or edit an existing one.
  3. Choose the language you intend to speak. The STT model, conversation agent and Piper voice must support the language you select.
  4. Set Home Assistant as the conversation agent if you want ordinary Assist commands to control your devices.
  5. Select the installed speech-to-text engine and its language.
  6. Select Piper as the text-to-speech engine and choose a voice in the desired language.
  7. Save the assistant configuration.
  8. Expose only the devices and entities you want voice control to reach. In Home Assistant’s entity settings, enable exposure for the relevant lights, switches, scenes, climate controls and other devices.

Exposure matters because Assist cannot control an entity that has not been made available to it. Start with a small set of devices, confirm the wording that works, and expand the exposed list after the basic path is reliable.

Choose and tune a Piper voice

Piper is Home Assistant’s local text-to-speech option documented as fast and optimized for Raspberry Pi 4. Voice quality, pronunciation, speed and resource use differ by model and language, so listen to samples in the language and accent you plan to use rather than assuming one voice is universally best.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Home Assistant documentation reports that, at medium model quality, Piper can generate 1.6 seconds of voice in one second on a Raspberry Pi. Its Piper app guidance says a Pi 4 can run up to medium quality at usable speed; low and extra-low quality models are faster. These are documentation figures, not guarantees for every voice, language or configuration.

Rank #4
CanaKit Raspberry Pi 4 4GB Basic Kit with PiSwitch (4GB RAM)
  • Includes Raspberry Pi 4 4GB Model B with 1.5GHz 64-bit quad-core CPU (4GB RAM)
  • CanaKit 3.5A USB-C Power Supply with Noise Filter (UL Listed) specially designed for the Raspberry Pi 4 (5-foot cable)
  • CanaKit USB-C PiSwitch (On/Off Power Switch)
  • Set of 3 Aluminum Heat Sinks for the Raspberry Pi 4

Practical voice-selection checklist

  • Play samples before settling on a voice.
  • Test names, numbers, room names and device labels that your household actually uses.
  • Use a lower quality model if responses lag or the Pi is heavily loaded.
  • Use a higher quality model only when the Pi can keep up and the room benefits from clearer speech.
  • Keep the Piper language aligned with the language configured for Assist and STT.

Test the complete command path

  1. Open the Assist interface in Home Assistant and select the assistant you configured.
  2. Speak a simple command for an exposed device, such as turning one light on or off.
  3. Confirm that the transcript matches what you said.
  4. Confirm that Home Assistant changes the intended entity.
  5. Listen for Piper’s spoken response.
  6. Repeat from the normal position in the room, not only next to the microphone.

Test one variable at a time. If the transcript is wrong, investigate the microphone, language and STT engine. If the entity does not change, check exposure and the command’s supported wording. If the action succeeds but there is no reply, inspect Piper, the selected voice and the audio output path.

Add wake-word activation

With a wake word, the endpoint can stream audio to Home Assistant, where wake-word detection and command handling take place. The low-powered endpoint does not have to run the wake-word model itself, but the host must process the audio stream and the network must carry it continuously.

Home Assistant says five streaming voice satellites can run at once without overwhelming a Raspberry Pi 4. Treat that as official guidance rather than a hard capacity guarantee: microphone quality, audio format, other add-ons and concurrent automations affect the result.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Wake-word limitations

The documented openWakeWord integration currently supports English wake words. If you need another language, use a different compatible wake-word engine or a Wyoming service that supports it. Wake-word accuracy also depends on microphone placement, room reflections, speaker volume and background noise; no supplied specification guarantees performance in a particular room.

Best Value
Vilros Raspberry Pi 4 4GB Basic Starter Kit with Fan-Cooled Heavy-Duty Aluminum Alloy Case
  • KEEP YOUR PROCESSOR COOL: The busier a processor gets the more it heats up, leading to sub-optimal performance. To prevent this common issue, this kit includes an aluminum alloy case with a pre-installed fan. The aluminum alloy actively draws the heat from the pi board, while the fan further cools the board and case. These cooling mechanisms will help push the limits of your processor and increase its flexibility.
  • SIZABLE RAM: This Raspberry Pi 4 comes equipped with 4GB of RAM, which is the same amount of RAM or more RAM than many mainstream laptops contain. With 4GB of RAM, your processor will be capable of running retro gaming setups and common computer applications, media players, and much more!
  • SIMPLE TO TURN ON & OFF: This kit includes a USB-C Raspberry Pi 4 compatible power supply with an easy-to-use on/off switch that was designed specifically for the Raspberry Pi 4 model to streamline processing.
  • IMPROVEMENTS FROM PREVIOUS MODELS: This latest model of the Raspberry Pi 4 offers groundbreaking increases in processor speed, multimedia performance, connectivity, memory, and more! The desktop performance of this model is comparable to entry-level x86 PC systems.
  • VERSATILE USE: The Raspberry Pi may have a small processor, but it is a highly adaptable little computer that can replace your desktop PC. Its functions range from practical to nostalgic since it can power an ad-blocking server as easily as it can power an outmoded gaming setup. Other uses include but are not limited to printing from non-wireless printers, playing media, making time-lapse videos, and building multiplayer network game servers and motion-capture security systems.

Resource and privacy implications

  • Streaming audio consumes host CPU, memory and network capacity.
  • The microphone must remain available to the endpoint and its audio driver.
  • More satellites increase the amount of audio processing Home Assistant performs.
  • For local Assist, Home Assistant says spoken commands remain on home hardware and local speech engines send no processing data to external servers.
  • Choosing Home Assistant Cloud changes the speech-processing location to a hosted service and reduces local setup work.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Keep the voice pipeline local—or use hosted speech

Fully local pipeline

A local setup keeps STT, conversation handling and TTS on your Home Assistant hardware or trusted devices on the same LAN. It offers local processing and avoids sending speech to an external speech service, but you are responsible for updates, CPU capacity, storage, language models and troubleshooting.

Home Assistant Cloud

Home Assistant documents its Cloud service as a simpler alternative for hosted speech services. It can reduce the amount of local engine setup, while speech processing is no longer performed entirely inside your home. Decide based on your privacy requirements, internet dependence and tolerance for managing local models. The supplied documentation does not establish current commercial terms or total cost.

Decision Local Wyoming services Hosted speech service
Where speech is processed Home Assistant hardware or a LAN Wyoming host Hosted service
Setup effort Install, discover and maintain engines and voices Less local engine administration
Internet dependence Designed for local processing after installation Depends on the hosted service connection
Privacy model Commands stay on home hardware according to Home Assistant’s local Assist documentation Speech is handled by the selected hosted service

Troubleshoot the most common failures

The microphone is not detected

  • Confirm the endpoint sees the audio device and that it is selected as the input.
  • Check permissions and whether another application has exclusive access.
  • Move the microphone away from the speaker and test at normal speaking distance.
  • Try a short command in a quiet room to separate hardware problems from recognition problems.

The assistant hears speech but misunderstands it

  • Verify that Assist, the STT engine and Piper use the same intended language.
  • Use simpler wording that matches Speech-to-Phrase’s supported command set.
  • Switch to Whisper if the request is genuinely open-ended.
  • For Whisper on Pi 4, expect the documented latency or move the service to a stronger LAN computer.

The command is transcribed but nothing changes

  • Make sure the target entity is exposed to Assist.
  • Check that the entity is available and named clearly.
  • Test a basic action on one device before attempting a multi-step request.
  • Confirm that Home Assistant is selected as the conversation agent.

There is no spoken response

  • Check that Piper is running and discovered under Settings > Devices & services.
  • Verify the selected voice supports the assistant language.
  • Confirm that the speaker is connected to the endpoint and its volume is audible.
  • If Piper is on another host, verify the host name, IP address and Wyoming port.

Wake words trigger unreliably

  • Improve microphone placement and reduce speaker-to-microphone feedback.
  • Test with background music and household noise to identify the room’s limits.
  • Remember that openWakeWord’s documented wake words are English-only.
  • Reduce the number of simultaneous streaming satellites if the Pi is under load.

A practical architecture for different goals

Goal Recommended arrangement Reason
Fast basic home control Pi 4 hosting Home Assistant, Speech-to-Phrase and Piper Speech-to-Phrase is documented at under one second on Pi 4 for its supported commands
Open-ended requests with a Pi endpoint Pi endpoint plus Home Assistant on the LAN, Whisper on a stronger computer Keeps the endpoint convenient while avoiding Pi 4 Whisper latency
Several rooms Multiple microphone/speaker endpoints streaming to one Home Assistant host Centralizes Assist configuration; Home Assistant documents five simultaneous satellites without overwhelming a Pi 4
Minimal local maintenance Home Assistant with its hosted speech option Reduces local model installation, at the cost of hosted processing

What the Raspberry Pi can—and cannot—promise

A Raspberry Pi 4 is a credible local voice-assistant host for supported smart-home commands, especially with Speech-to-Phrase and Piper. It is not automatically a drop-in replacement for a commercial smart speaker: you supply the microphone, speaker, software configuration, wake-word setup and device integrations.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The strongest design is modular. Put the endpoint where people speak, keep Home Assistant responsible for device control, use Speech-to-Phrase when speed matters, and move Whisper to a stronger LAN machine when you need broad transcription. That arrangement preserves local control while matching each workload to hardware that can handle it.

Quick Recap

Bestseller No. 1
CanaKit Raspberry Pi 4 4GB Starter PRO Kit - 4GB RAM
CanaKit Raspberry Pi 4 4GB Starter PRO Kit - 4GB RAM
Includes Raspberry Pi 4 4GB Model B with 1.5GHz 64-bit quad-core CPU (4GB RAM); Includes Pre-Loaded 32GB EVO+ Micro SD Card (Class 10), USB MicroSD Card Reader
$159.99
Bestseller No. 2
Raspberry Pi 4 Model B (2GB)
Raspberry Pi 4 Model B (2GB)
Broadcom BCM2711, Quad core Cortex-A72 (ARM v8) 64-bit SoC @ 1.5GHz; 1GB, 2GB, 4GB or 8GB LPDDR4-3200 SDRAM (depending on model)
$83.00
Bestseller No. 3
Raspberry SC15184 Pi 4 Model B 2019 Quad Core 64 Bit WiFi Bluetooth (2GB)
Raspberry SC15184 Pi 4 Model B 2019 Quad Core 64 Bit WiFi Bluetooth (2GB)
Broadcom BCM2711, quad-core Cortex-A72 (ARM v8) 64-bit SoC @ 1. 5GHz; 2. 4 GHz and 5. 0 GHz IEEE 802. 11b/g/n/ac wireless LAN, Bluetooth 5. 0, BLE
$92.97
Bestseller No. 4
CanaKit Raspberry Pi 4 4GB Basic Kit with PiSwitch (4GB RAM)
CanaKit Raspberry Pi 4 4GB Basic Kit with PiSwitch (4GB RAM)
Includes Raspberry Pi 4 4GB Model B with 1.5GHz 64-bit quad-core CPU (4GB RAM); CanaKit USB-C PiSwitch (On/Off Power Switch)
$139.99
Bestseller No. 5
Vilros Raspberry Pi 4 4GB Basic Starter Kit with Fan-Cooled Heavy-Duty Aluminum Alloy Case
Vilros Raspberry Pi 4 4GB Basic Starter Kit with Fan-Cooled Heavy-Duty Aluminum Alloy Case
SD Card is NOT Incuded-Customer Must provide own SD card properly flash before use.
$136.99

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Home AssistantPiperRaspberry Pismart speakerSpeech-to-Phrasevoice assistantWhisperWyoming

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Outdated Drivers Are Slowing You DownFree scan - exact matches

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.