Skip to content
42 / Answers

Speech to text: accurate transcription, now free.

Speech to text (automatic speech recognition) converts spoken audio into written words. Whisper, OpenAI's open-weight model released in 2022, made high-quality multilingual transcription available to anyone with a laptop. Faster and smaller variants now run in real time on a CPU. The OCR & Speech Workspace I built uses live speech-to-text beside document OCR.

Also called
ASR, automatic speech recognition, voice typing
Whisper
Open weights, many languages, several sizes
Run it
faster-whisper or whisper.cpp locally; APIs hosted
I built
Live transcription in the OCR & Speech Workspace
  • 5production AI apps
  • 14engineers led
  • 200+students mentored
01

Questions students ask

The speech-to-text questions searched most, answered from shipping it.

What is speech to text?

Speech to text is technology that listens to spoken language and produces the corresponding written text. It appears as voice typing on phones and in word processors, as captions on videos and calls, as the transcription behind meeting notes, and as the first stage of voice assistants. The underlying task, automatic speech recognition, takes an audio waveform and outputs words, often with timestamps, punctuation and speaker labels. Accuracy depends on audio quality, accent, background noise and vocabulary; modern neural models handle all of these far better than the systems of a decade ago.

How does speech to text work?

Audio is sampled thousands of times per second and converted into a spectrogram, a picture of which frequencies are present over time. A neural network encoder reads that spectrogram and produces a sequence of representations; a decoder turns those into text tokens, one after another, using what it has already written to predict the next word, which is how it adds punctuation and resolves ambiguous sounds from context. Older systems chained separate acoustic, pronunciation and language models; models like Whisper learn the whole mapping end to end from hundreds of thousands of hours of audio paired with transcripts. The output is text with timestamps per segment.

What is Whisper AI?

Whisper is a speech recognition model that OpenAI released with open weights in 2022, trained on a very large and varied collection of audio from the web. It transcribes in many languages, translates speech into English, detects the spoken language, and is unusually robust to accents, noise and technical terms compared with earlier open models. It comes in sizes from tiny (fast, less accurate) to large (slow, most accurate), with later large versions improving further. Because the weights are open, a whole ecosystem of faster reimplementations and local tools grew around it, and it became the default engine for free transcription.

How to use Whisper AI

  • Pick an implementation: the original Python package, faster-whisper (much quicker on CPU and GPU), or whisper.cpp (C++, runs anywhere, used by many desktop apps).
  • Install it in a virtual environment; install ffmpeg so audio and video files can be decoded.
  • Choose a model size for your hardware: small or base for a laptop CPU in near real time; medium or large on a GPU for best accuracy.
  • Transcribe a file: one function call returns segments with text and timestamps; set the language if you know it to avoid misdetection.
  • For live transcription, capture microphone audio in short chunks and transcribe each with overlap, or use a streaming-oriented variant.
  • Post-process: join segments, fix domain terms with a custom vocabulary or a language model pass, and save as text or subtitles.

How to install Whisper AI on Windows

Install Python and create a virtual environment. Install ffmpeg and make sure it is on your PATH, since Whisper uses it to read audio. Then install faster-whisper with pip for the best CPU performance, or the original openai-whisper package if you want the reference implementation; with an NVIDIA GPU, install a CUDA-enabled PyTorch first so the GPU is used. Test by transcribing a short recording. If you prefer a desktop app rather than code, several free Windows tools wrap whisper.cpp with a graphical interface and download models for you; they are the easiest route for transcribing lectures or meetings without programming.

What is speech to text API?

A speech-to-text API is a hosted service you send audio to and receive text from, over HTTP or a streaming connection. OpenAI, Google, Microsoft, Amazon, Deepgram, AssemblyAI and others offer them, with features such as streaming for live captions, speaker diarisation, word timestamps, custom vocabularies and many languages, priced per minute of audio. They remove the need to run models yourself and often lead on accuracy for difficult audio. The trade-offs are cost at volume and audio leaving your machine. For lecture recordings, private meetings or offline tools, a local Whisper is free and private; for a product that needs streaming captions at scale, an API may be simpler.

What are speech to text tools?

  • Built-in voice typing: Windows, macOS, Android and iOS dictation, and the voice typing in Google Docs and Word.
  • Meeting transcription: notes and captions inside Zoom, Teams and Meet, and dedicated note-taking apps.
  • Local Whisper apps: free desktop tools built on whisper.cpp for transcribing files privately.
  • Developer libraries: faster-whisper, whisper.cpp, Vosk, NVIDIA NeMo and Hugging Face models for building your own.
  • Hosted APIs: for streaming, diarisation and scale.
  • Accessibility tools: live captioning apps for deaf and hard-of-hearing users, and dictation for people who cannot type.

Why is my speech to text not working?

Check the microphone first: the operating system and the app each need permission, the right device must be selected, and the input level should move when you speak. Check the language setting; dictation set to the wrong language produces nonsense. Online dictation features need an internet connection; local ones need their language pack downloaded. Background noise, a distant microphone and overlapping speakers cause errors any engine makes, so move closer and reduce noise. In code, the usual causes are ffmpeg missing, audio in an unsupported format or sample rate, a model too large for memory, or chunks too short for the model to use context. Test with a clean recording to separate audio problems from software ones.

How does speech to text help students?

It turns lectures into searchable notes: record, transcribe, and find the minute where a concept was explained. It helps students who write slowly or have dyslexia or motor difficulties to draft by speaking. It gives live captions to deaf and hard-of-hearing students and to anyone following a lecture in a second language. It lets you capture ideas while walking and clean them up later. And it is a project in itself: building a transcription tool with Whisper teaches audio handling, model deployment and interface design in one weekend. The OCR & Speech Workspace grew from exactly that: live speech-to-text alongside scanned notes, with a chat over both.

How to speech to text in Google Docs

Open the document in Chrome, go to the Tools menu and choose Voice typing; a microphone button appears. Click it, allow microphone access when the browser asks, and speak; text appears as you talk. Say punctuation aloud ('comma', 'full stop', 'new line') and use the voice commands for formatting. It works in many languages, selected from the dropdown on the microphone panel. It needs an internet connection and currently works in Chrome. For long recordings or audio files, voice typing is not the tool; transcribe the file with Whisper and paste the text in instead.

02

Transcription in an afternoon

Private, free, on your own laptop.

  1. 01

    Install

    Python, ffmpeg, faster-whisper; pick the small model for CPU.

  2. 02

    Transcribe a lecture

    One call; save segments with timestamps as text and as subtitles.

  3. 03

    Fix the terms

    Pass the transcript through a language model with a glossary of course terms.

  4. 04

    Make it searchable

    Chunk by segment, embed, and ask questions over your lectures with citations to the minute.

03

In the room

Where these systems get explained to students.

Audio your team needs as text?

I build transcription pipelines, live and batch, private or hosted, with search on top.