Nvidia’s open Nemotron 3.5 Transcribe combines transcription, translation, and speaker recognition

Nvidia has released an open speech recognition model that takes text instructions, and the company says it leads several benchmarks. The release also includes a large training dataset and tools for adapting the model to specialized fields.

A plain transcript doesn’t tell you who said what. It also won’t translate anything or spell technical terms correctly. Nemotron 3.5 Transcribe is designed to handle all of that in a single model, and it can answer questions about a recording’s content as well. Nvidia says the model transcribes 40 languages, translates 31 of them to or from English, and identifies speakers in 13. It handles recordings up to an hour long. They can include up to eight speakers.

Users control the model with simple instructions. Depending on the prompt, the same meeting recording can become a transcript with speaker labels, an English translation, or a summary of the decisions made. Users can also pass along technical terms like drug names as hints. The model is only supposed to use them if they actually appear in the recording.

Near-top accuracy on a single GPU

The model has 30 billion parameters, but only about 4 billion are active per processing step. As a result, it runs on a single Nvidia GPU. That covers everything from the compact DGX Spark to data center…