
openai/whisper-large-v3
The most performant Whisper Large V3 implementation, achieving 1800x real-time factor (1 hour of audio transcribed in 2 seconds).
Our live transcription is ideal for use cases like live note-taking applications, content captioning, customer support, and any real-time, voice-powered apps. Learn more about our optimized Whisper transcription pipeline in our launch blog.
Configurable update cadence for the partial transcriptions delivered
Consistent real-time latency under high volume of concurrent audio streams
Automatic language detection for multilingual transcription
The Pareto plot below shows how this model compares with leading closed-source ASR solutions across accuracy and latency. Results are measured using Pipecat’s open-source STT Benchmark, which evaluates Semantic WER for transcription accuracy and TTFS (time to final segment) for latency.

The graph below shows how TTFS (time to final segment) and unit economics (cost per audio hour) change as the number of concurrent WebSocket connections per GPU increases. Higher concurrency can significantly reduce cost per audio hour, with a corresponding tradeoff in latency.
Concurrency is configurable and can be tuned to achieve the latency and cost targets that best fit your workload and business requirements. See the concurrency guide for configuration details.
For a balance of latency and throughput, we recommend starting with RTX6000 using concurrency 24, and adjusting based on performance and cost needs based on the chart below if needed.
For workload-specific optimization, you can contact an engineer for further assistance.

The charts below show median latency and unit economics (cost per audio hour) change with audio length when transcribing prerecorded files at 1, 4 and 16 concurrent requests per GPU. Higher concurrency significantly reduces cost per audio hour, with a corresponding tradeoff in latency that grows with audio length.
Concurrency is configurable and can be tuned to achieve the latency and cost targets that best fit your workload and business requirements. See the concurrency guide for configuration details.
For batch workloads, we recommend starting with RTX6000 using concurrency 16, and lowering it to reduce latency on longer audio or raising it to increase throughput on latency tolerant workloads

For workload-specific optimization, you can contact an engineer for further assistance.