
NVIDIA/NVIDIA Nemotron 3.5 ASR
Nemotron 3.5 ASR is a real-time speech recognition model built for high-quality transcription in both low-latency real-time and batch workloads.

This deployment is a Baseten docker_server model: the Baseten WebSockettransport proxies your connection straight through to the NIM's native Riva Realtime WebSocket API. There is no custom Baseten schema, and you speak Riva's OpenAI-Realtime-style JSON event protocol directly.
As audio streams in, the realtime API returns two kinds of transcription events:
Partial results (...transcription.delta) — live, in-progress hypotheses that update continuously as you speak. Ideal for low-latency captions that refine in real time. Each event is an incremental delta, not the full hypothesis — concatenate the deltas within a segment to build the running caption.
Final results (...transcription.completed) — stable, punctuated transcripts for each completed segment. These won't change and represent the authoritative output.
pip install websockets
export BASETEN_API_KEY=...Input must be a mono, 16-bit, 16 kHz PCM WAV. The server treats the bytes as raw pcm16 at the declared sample rate, so stereo or off-rate input transcribes to garbage (or nothing) — convert it before streaming (see the note under load_pcm).
python transcribe.py audio.wav