Devtoolwatch BoardGet it every Monday

WhisperX review

WhisperX is a Python speech recognition tool built on Whisper that adds word-level timestamps and speaker diarization.

Updated Nov 1, 2026. Review written Oct 22, 2026 from the project's own sources; usage data refreshed every Monday.

TL;DR

WhisperX is a Python tool for transcribing audio with OpenAI's Whisper, adding word-level timestamps through wav2vec2 alignment and speaker labels through pyannote-audio. It is for developers who need batched transcription with accurate per-word timing. It uses a faster-whisper backend and VAD preprocessing, and runs on GPU or CPU.

WhisperX at a glance

Category
Voice and realtime
Maintained by
Max Bain (individual, @m-bain on GitHub)
License
BSD 2-Clause
Language
Python
Repository
github.com/m-bain/whisperX
PyPI package
whisperx 3.8.6
Latest release
v3.8.6 on GitHub, May 25, 2026
First published
Dec 9, 2022

What WhisperX does

  • WhisperX runs batched Whisper inference on a faster-whisper backend for faster transcription.
  • WhisperX produces word-level timestamps by aligning Whisper output with a wav2vec2 phoneme model.
  • WhisperX labels speakers in a transcript using diarization from pyannote-audio.
  • WhisperX applies voice activity detection before transcription, which the README says reduces hallucination.
  • WhisperX can pass context from the previous segment with interleaved context, aimed at better punctuation and proper nouns on long audio.
  • WhisperX picks alignment models by language, with defaults for en, fr, de, es, it and more via Hugging Face.
  • WhisperX can write word timings into .srt files with the --highlight_words option.

How it works

WhisperX runs from the command line or as a Python library. It transcribes with batched Whisper, aligns the segments with a language-specific wav2vec2 model, then optionally assigns speaker IDs with a pyannote diarization pipeline. Models load from torchaudio or Hugging Face. Diarization needs a Hugging Face token. It runs on CUDA GPUs or on CPU, including Mac OS X.

How to install and start using WhisperX

With pip

pip install whisperx

With uvx

uvx whisperx

With faster alignment (Numba)

pip install "whisperx[fast]"

Requirements

  • Python >=3.10 and <3.14.
  • CUDA toolkit 12.8 for GPU acceleration. CPU-only use does not need it.
  • A Hugging Face read token and acceptance of the speaker-diarization-community-1 model agreement for diarization.

First steps

  1. For GPU use, install the CUDA toolkit 12.8 before installing WhisperX. Skip this if you only use the CPU.
  2. Transcribe a file with default settings: whisperx path/to/audio.wav
  3. Add speaker labels: whisperx path/to/audio.wav --model large-v2 --diarize --highlight_words True
  4. Run on CPU or Mac: whisperx path/to/audio.wav --compute_type int8 --device cpu

Who WhisperX is for

  • Developers making subtitles or transcripts that need accurate per-word timing.
  • Transcribing multi-speaker recordings where speaker ID labels are needed.

Limitations to know

  • WhisperX does not handle overlapping speech well, and the README calls diarization far from perfect.
  • WhisperX needs a language-specific wav2vec2 alignment model. For untested languages you must find and test one yourself.
  • WhisperX transcribes without timestamps to batch inference, which can produce output that differs from default Whisper.
  • WhisperX no longer provides subtitle .ass output. The README says it was removed in v3.

Is WhisperX growing? Usage data

In the week of Oct 25–31, 2026, WhisperX ranked #112 on the Devtoolwatch Board and #6 in Voice and realtime, with a momentum score of 61 out of 100. Its main package had 158.6k downloads that week, +37% against its own 4-week average.

New GitHub stars per week for WhisperX12 weeks from Aug 9, 2026: 110, 108, 119, 108, 104, 140, 129, 113, 106, 195, 196, 163 new stars, an average of 133 a week.Aug 9week of Oct 25
New GitHub stars per week for the last 12 weeks, from GitHub's stargazer history (today's stargazers by the week they starred).
Show the weekly numbers
New GitHub stars per week for WhisperX
Week ofNew stars
Aug 9, 2026110
Aug 16, 2026108
Aug 23, 2026119
Aug 30, 2026108
Sep 6, 2026104
Sep 13, 2026140
Sep 20, 2026129
Sep 27, 2026113
Oct 4, 2026106
Oct 11, 2026195
Oct 18, 2026196
Oct 25, 2026163

The Board ranks tools by four signals each week: new stars, new stars for the repo's size, added downloads and download growth beyond the market. How the ranking works.

WhisperX alternatives

Other voice and realtime AI tools on the Board in the week of Oct 25–31, 2026, by momentum:

Voice and realtime ranked by momentum, the week of Oct 25–31, 2026
RankToolStarsDownloads/wk
#1faster-whisperfaster-whisper is a Python reimplementation of OpenAI's Whisper speech-to-text model built on the CTranslate2 inference engine for…26.4k4.4M
#2KokoroKokoro is a Python inference library for Kokoro-82M, an open-weight text-to-speech model with 82 million parameters.9.8k150.7k
#3ChatterboxChatterbox is a family of open-source text-to-speech and voice cloning models by Resemble AI, with English and multilingual variants.27.5k73.2k
#4VoiceMemInfrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a…2.8k–
#5PipecatPipecat is an open-source Python framework for building real-time voice and multimodal conversational agents, maintained by Daily and…17k348.5k
#7LiveKit AgentsLiveKit Agents is an open-source Python framework for building realtime voice, video, and multimodal AI agents that join LiveKit rooms…15k2.4M

All voice and realtime AI tools, ranked

Recent WhisperX releases

WhisperX FAQ

Is WhisperX free and open source?

Yes. WhisperX's source code is on GitHub (m-bain/whisperX) under the BSD 2-Clause license, so you can use it for free.

How do I install WhisperX?

Run pip install whisperx. The whisperx package needs Python 3.10 or newer, below 3.14. The install section above has the other options from the project's README.

Is WhisperX still maintained?

Yes. The m-bain/whisperX repository was last updated on Oct 18, 2026, and the latest release, v3.8.6 on GitHub, came out on May 25, 2026.

How popular is WhisperX?

WhisperX has 25k GitHub stars as of Nov 1, 2026. It gained 163 new stars in the week of Oct 25–31, 2026, against a 12-week average of 133 a week. Its main package had 158.6k downloads that week, +37% against its own 4-week average. That made it #6 among voice and realtime AI tools on the Devtoolwatch Board.

WhisperX vs Whisper: how do they compare?

WhisperX and Whisper are both tracked by Devtoolwatch as voice and realtime AI tools. WhisperX has 25k GitHub stars and Whisper has 111.7k. In the week of Oct 25–31, 2026, WhisperX's main package had 158.6k downloads and Whisper's had 1.5M. Whisper is OpenAI's general-purpose speech recognition model for multilingual transcription, speech translation into English, and language identification, usable from the command line or Python. Whisper review.

What are the best alternatives to WhisperX?

Other voice and realtime AI tools on the Devtoolwatch Board in the week of Oct 25–31, 2026, by momentum: faster-whisper (#1), Kokoro (#2), Chatterbox (#3), VoiceMem (#4), Pipecat (#5). The alternatives table above has their numbers.

Does WhisperX have speaker diarization?

Yes. WhisperX assigns speaker ID labels using pyannote-audio. Pass --diarize along with a Hugging Face read token, and accept the speaker-diarization-community-1 model agreement. You can set --min_speakers and --max_speakers if you know the number of speakers.

How is WhisperX different from OpenAI's Whisper?

WhisperX adds batching, word-level timestamps from wav2vec2 alignment, VAD-based segmentation and speaker diarization. The README says Whisper's own timestamps are utterance-level and can be off by several seconds, and that Whisper does not natively support batching.

Can WhisperX run locally without a GPU?

Yes. WhisperX runs on CPU, including Mac OS X, with: whisperx path/to/audio.wav --compute_type int8 --device cpu. The README also links Replicate demos for people without their own GPUs.

Which languages does WhisperX support for alignment?

WhisperX ships default alignment models for en, fr, de, es and it through torchaudio, plus many other languages through Hugging Face. The full list is under DEFAULT_ALIGN_MODELS_HF in alignment.py. Release v3.8.6 added an Indonesian model.

How do I reduce WhisperX GPU memory use?

Lower the batch size, for example --batch_size 4. You can also use a smaller model such as --model base, or a lighter compute type with --compute_type int8. The README notes that the last two can affect quality.

Does WhisperX timestamp numbers and symbols?

The README says words such as "2014." or "£13.60" cannot be aligned and get no timing. Releases v3.7.9, v3.6.2 and v3.5.2 restored timestamps for words with digits, symbols or foreign script by using a wildcard emission column.

Sources

  1. m-bain/whisperX on GitHub
  2. WhisperX README
  3. whisperx on PyPI
  4. Release 3.8.7rc1 (Jun 26, 2026)
  5. Release v3.8.6 (May 25, 2026)
  6. Release v3.8.5 (Apr 1, 2026)
  7. Devtoolwatch Board, the week of Oct 25–31, 2026

WhisperX README badge

Maintainers can show the tool's weekly Board rank in their README:

Devtoolwatch badge for WhisperX

[![Devtoolwatch](https://index.devtoolwatch.com/badge/whisperx.svg)](https://index.devtoolwatch.com/tools/whisperx/)

How this page is made: Devtoolwatch writes each review from the project's README, releases, package metadata and website, with an AI model, then checks every claim against the source it cites and drops what the sources don't support. The numbers come from Devtoolwatch's daily GitHub snapshots, GitHub's stargazer history, and the npm and PyPI download APIs. Spotted an error? Email [email protected].