Nvidia Unveils Nemotron 3.5 Transcribe: A New Open-Weight Frontier in Multilingual Speech AI

Nvidia, a global leader in accelerated computing and artificial intelligence, on Wednesday, October 28, 2026, significantly bolstered its open-source AI ecosystem with the release of Nemotron 3.5 Transcribe, a powerful new open-weight model designed for advanced audio transcription across a multitude of languages. This strategic launch, made available free to developers, is accompanied by the second iteration of Granary, Nvidia’s extensive open-source speech dataset, further solidifying the company’s commitment to fostering innovation in the burgeoning field of speech AI. The introduction of Nemotron 3.5 Transcribe, boasting 30 billion parameters, represents a pivotal moment for developers seeking robust, customizable, and high-performance solutions for converting spoken language into text, particularly in critical enterprise applications.

Unpacking Nemotron 3.5 Transcribe: Features and Performance Benchmarks

At the core of Nvidia’s latest offering is Nemotron 3.5 Transcribe, a sophisticated model engineered to deliver exceptional accuracy and versatility. The company proudly asserts that this new model supports transcription in up to 40 languages, offering unparalleled global reach for developers. Beyond mere transcription, Nemotron 3.5 Transcribe is also capable of translating 31 languages to and from English, bridging communication gaps in an increasingly interconnected world. This dual capability positions the model as a comprehensive solution for international businesses and multilingual content creators.

A standout feature highlighted by Nvidia is the model’s ability to process lengthy audio recordings, accommodating sessions up to an hour long. This capacity is particularly crucial for transcribing extended meetings, lectures, interviews, or medical consultations without the need for manual segmentation. Furthermore, Nemotron 3.5 Transcribe incorporates advanced speaker diarization, allowing it to accurately identify and differentiate between up to eight distinct speakers within a single audio track. This functionality is invaluable for generating clear, attributed transcripts, which is a common requirement in legal proceedings, corporate governance, and academic research.

Nvidia has also made bold claims regarding Nemotron 3.5 Transcribe’s performance, stating that it surpasses several rival models on established benchmarks. Specifically, the company points to its superior performance on Hugging Face’s Open ASR Leaderboard, a widely recognized platform for evaluating automatic speech recognition models. Achieving top-tier scores on such a competitive leaderboard underscores the model’s technical prowess and positions it as a leading contender in the crowded speech AI market. This demonstrated performance is a critical factor for developers who prioritize accuracy and efficiency in their applications, offering a compelling reason to integrate Nvidia’s latest technology.

Strategic Imperatives: Targeting Key Enterprise Applications

The strategic intent behind Nemotron 3.5 Transcribe is clear: to empower developers building specialized applications for critical business sectors. Nvidia has explicitly identified business meetings and medical transcription as two primary targets, recognizing these areas as established footholds for AI in the modern workplace.

In the realm of business meetings, accurate and timely transcription can revolutionize productivity. Transcripts serve as invaluable records for decision-making, action item tracking, and compliance. With the rise of remote and hybrid work models, the demand for reliable speech-to-text solutions that can handle diverse accents, technical jargon, and multiple speakers has surged. Nemotron 3.5 Transcribe’s multilingual support and speaker diarization capabilities directly address these needs, enabling businesses to create more accessible and searchable meeting archives.

Medical transcription represents another vital application area. The healthcare industry relies heavily on precise documentation for patient care, billing, and regulatory compliance. Manual transcription is not only time-consuming and expensive but also prone to human error. AI-powered transcription, particularly one capable of recognizing specialized medical terminology across various languages, can dramatically improve efficiency, reduce costs, and enhance the accuracy of patient records. Nvidia emphasizes that developers can leverage Nemotron 3.5 Transcribe in conjunction with its NeMo Speech model and the updated Granary dataset to fine-tune applications to recognize industry-specific jargon in each supported language. This customization potential is a significant advantage, allowing for highly specialized solutions that meet the stringent requirements of professional fields.

The Power of Open-Weight and the NeMo Ecosystem

Nvidia’s decision to release Nemotron 3.5 Transcribe as an "open-weight" model is a crucial aspect of its strategy. Unlike purely proprietary or closed-source models, open-weight models allow developers to download, inspect, and modify the model’s weights, providing a higher degree of transparency and flexibility. This approach encourages broader adoption, fosters community-driven innovation, and enables developers to integrate and customize the model within their own applications without incurring licensing fees for the core model. It democratizes access to advanced AI capabilities, lowering the barrier to entry for startups and smaller development teams.

The model’s integration within Nvidia’s broader NeMo framework is also noteworthy. NeMo (Neural Modules) is an open-source conversational AI toolkit designed to help researchers and developers build, train, and deploy state-of-the-art conversational AI models. By making Nemotron 3.5 Transcribe compatible with NeMo Speech, Nvidia provides a comprehensive toolkit for developers. The updated Granary dataset, now in its second version, further enriches this ecosystem by offering a larger and potentially more diverse corpus of speech data for training and fine-tuning, thereby enhancing the accuracy and robustness of custom ASR models. This synergy between open-weight models, robust datasets, and powerful development frameworks positions Nvidia as a key enabler for the next generation of speech AI applications.

However, a key limitation of Nemotron 3.5 Transcribe, as acknowledged by Nvidia, is its current focus on recorded audio rather than live streams. While this might limit its immediate application in real-time communication scenarios, it does not diminish its utility for post-processing tasks where precision and extensive language support are paramount. The architecture designed for recorded audio often allows for more extensive processing and correction, potentially leading to higher accuracy than real-time systems that must balance speed with fidelity. It is plausible that future iterations or complementary models from Nvidia could address real-time streaming capabilities, given the rapid advancements in the field.

Hardware Synergies: Running AI on the Edge and in the Cloud

Voice AI in vogue: Nvidia releases new open transcription model

A significant advantage of Nemotron 3.5 Transcribe is its impressive efficiency, despite its 30 billion parameters. Nvidia promises that the model can run on a single chip, demonstrating the power of its optimized architecture and the efficiency of its underlying hardware. This capability spans a wide range of Nvidia’s hardware offerings, from edge devices to powerful data center accelerators.

Specifically, the model is designed to be deployed on the Jetson AGX Thor robotics controller, enabling sophisticated speech processing directly on autonomous machines and IoT devices at the edge. This is crucial for applications requiring low latency and privacy, where sending audio data to the cloud is not feasible or desirable. Furthermore, Nemotron 3.5 Transcribe can run on the DGX Spark chip, which powers the new generation of AI PCs equipped with revamped Windows 11 operating systems. This signifies a push towards integrating powerful AI capabilities directly into consumer and professional laptops, transforming personal computing with advanced voice interfaces and productivity tools. At the high end, the model is also compatible with Nvidia’s Blackwell datacenter chips, the company’s latest and most powerful GPU architecture, ensuring scalability and performance for large-scale enterprise deployments and cloud-based services.

This broad hardware compatibility underscores Nvidia’s holistic strategy: to provide not just the AI models but also the entire computing stack required to run them efficiently, from the smallest embedded systems to the largest supercomputers. Nemotron 3.5 Transcribe joins Nvidia’s growing portfolio of open-weight voice models, including the highly efficient Parakeet model (1.1 billion parameters), which despite its compact size, delivers powerful multilingual ASR capabilities. This tiered approach allows developers to choose the right model and hardware combination based on their specific application requirements, balancing performance, size, and cost.

A Competitive Landscape in Rapid Evolution

Nvidia’s latest voice entry arrives during an exceptionally busy period for AI voice releases, highlighting the intense competition and rapid innovation in the speech AI domain. The past few weeks alone have seen several major players unveil significant advancements, signaling a pivotal moment for the industry.

Earlier this month, Mistral AI, a rising star in the AI landscape, shipped Voxtral 3, its own advanced speech model, indicating a growing focus on multimodal AI capabilities from European innovators. Following closely, ElevenLabs, a company renowned for its sophisticated voice synthesis, launched Realtime, a solution offering instant speech generation for voice agents. This product targets applications requiring highly responsive and natural-sounding conversational AI, such as customer service chatbots and interactive virtual assistants. Salesforce, a software giant, also entered the fray with Launa-Omni, its proprietary voice model, likely aimed at enhancing customer relationship management (CRM) platforms and enterprise communication tools with advanced speech analytics and interaction capabilities.

This flurry of activity underscores the strategic importance of speech AI across various industries. The market for speech recognition and synthesis technologies is projected to grow substantially, with some industry reports forecasting annual growth rates exceeding 20% over the next five years, potentially reaching tens of billions of dollars globally. Factors driving this growth include the increasing adoption of voice assistants, the demand for accessible technology, the proliferation of remote work, and the need for efficient data processing in regulated industries like healthcare and finance. Nvidia’s release of Nemotron 3.5 Transcribe, particularly its open-weight nature and multilingual capabilities, is a direct response to this escalating demand and a strategic move to capture a larger share of this expanding market by empowering a wider developer community.

The Evolution of Speech AI and Nvidia’s Role

Automatic Speech Recognition (ASR) has a rich history, evolving from early rule-based systems and hidden Markov models (HMMs) in the mid-20th century to the deep learning revolution of the 21st century. The advent of neural networks, particularly recurrent neural networks (RNNs), convolutional neural networks (CNNs), and more recently, transformer architectures, has dramatically improved ASR accuracy and expanded its capabilities. Nvidia has played a crucial, albeit indirect, role in this evolution by providing the GPU hardware that made training these computationally intensive deep learning models feasible.

Over the last decade, Nvidia has transitioned from being solely a hardware provider to a full-stack AI company, offering not just GPUs but also software platforms, frameworks like CUDA and cuDNN, and pre-trained models. Its NeMo framework, specifically designed for conversational AI, is a testament to this strategic shift. The release of models like Parakeet and now Nemotron 3.5 Transcribe signifies Nvidia’s direct contribution to the AI model ecosystem, aiming to accelerate the development and deployment of intelligent applications. This integrated approach—from silicon to software to specific AI models—creates a powerful ecosystem that locks developers into Nvidia’s technology stack, reinforcing its market dominance.

Challenges and the Path Forward for Speech AI

Despite significant advancements, speech AI still faces several challenges. Accuracy can degrade in noisy environments, with non-native accents, or when confronted with highly specialized or colloquial language. Ethical considerations, particularly around data privacy and the potential for misuse (such as deepfakes or surveillance), remain critical discussion points that developers and companies must address responsibly. For Nemotron 3.5 Transcribe, the current limitation to recorded audio means it will not immediately serve real-time communication needs, which is a rapidly growing segment of the market.

However, the future outlook for speech AI remains incredibly promising. Continued research in areas like self-supervised learning, multimodal AI (combining speech with visual or textual data), and even more efficient transformer models promises further improvements in accuracy, latency, and contextual understanding. The integration of advanced ASR models with large language models (LLMs) is expected to create even more intelligent and nuanced conversational AI systems, capable of not just transcribing but also understanding, summarizing, and generating responses. Nvidia’s continuous investment in open-weight models and comprehensive AI frameworks like NeMo positions it to be at the forefront of these future innovations, driving the next wave of advancements in human-computer interaction.

In conclusion, Nvidia’s release of Nemotron 3.5 Transcribe and the updated Granary dataset marks a significant milestone in the evolution of speech AI. By offering a powerful, open-weight, multilingual transcription and translation model capable of running on a diverse range of hardware, Nvidia is empowering developers to build highly customized and efficient AI applications for critical enterprise sectors. This move not only strengthens Nvidia’s position in the competitive AI landscape but also accelerates the broader adoption of advanced speech technologies, promising a future where seamless and intelligent human-computer interaction becomes an everyday reality.

More From Author

Sock It To Me: The Legend of George Schlatter