NVIDIA ACE is now generally available for the cloud, in early access for RTX AI PCs, used by companies in the customer service, gaming and healthcare industries, including Dell Technologies, ServiceNow, Aww Inc., Inventec, Perfect World Games
COMPUTER-NVIDIA today announced the General availability NVIDIA ACE generative AI microservices to accelerate the next wave of digital humans, as well as new advances in generative AI coming to the platform soon.
Customer service, gaming and healthcare companies are early adopters of ACE technologies to simplify the creation, animation and operation of realistic digital humans in customer service, telehealth, gaming and entertainment .
Following NVIDIA ACE Digital human generative AI technologies now generally available include:
- NVIDIA Riva ASR, TTS And NMT — for automatic speech recognition, text-to-speech conversion and translation
- NVIDIA Nemotron LLM — for understanding language and generating contextual responses
- NVIDIA Audio2Face™ — for realistic facial animation based on audio tracks
- NVIDIA Omniverse RTX — for realistic skin and hair traced in real time
Recently announced technologies include:
- NVIDIA Audio2Gesture™ — to generate body gestures based on audio tracks, coming soon
- NVIDIA Nemotron-3 4.5B – a new small language model (SLM) designed specifically for low-latency PC RTX AI inference on the device
“Digital humans will revolutionize industries,” said Jensen Huang, founder and CEO of NVIDIA. “Advancements in large multimodal language models and neural graphics – delivered by NVIDIA ACE to our developer ecosystem – bring us closer to a future of intent-driven computing, where interacting with computers is as natural as interact with humans.”
Digital humans are coming to 100 million RTX AI PCs
To date, NVIDIA has provided ACE as NVIDIA NIM™ Microservices for developers to operate in data centers. Now NVIDIA is building ACE PC NIM Microservices for deployment on the installed base of 100 million RTX AI PCs and laptops.
These include NVIDIA Nemotron-3 4.5B, the company’s first SLM, specifically designed to run on devices with levels of precision and accuracy similar to large language models (LLMs) running in the cloud. Nemotron-3 4.5B SLM is now in Early Access. NVIDIA Audio2Face and NVIDIA Riva ASR on-device models coming soon to Early Access.
New NVIDIA AI Inference Manager The SDK simplifies deploying ACE on PCs. It pre-configures the PC with the necessary AI models, engines, and dependencies while orchestrating AI inference seamlessly across PCs and the cloud.
An updated version of the Secret Protocol Technical Demodeveloped in collaboration with AI around the world, is presented at the COMPUTEX show. Using Audio2Face and Riva ASR running locally on GeForce RTX™ PCsThe demo allows players to interact and influence digital-human non-playable characters (NPCs) with conversational language to complete their mission.
The digital human ecosystem is expanding with the latest ACE technologies
ACE is making waves among developers who create various applications from companies such as Aww Inc., Dell Technologies, SavvyHippocratic AI, Inventec, OurPalmPerfect World Games, Reallusion, ServiceNow, Soulbotix, SoulShell and UneeQ.
Aww Inc., a pioneering virtual human company based in Japan, launched its first virtual celebrity, Imma, in 2018. Imma has since become the face of major global brands in over 50 countries. Now, Aww Inc. plans to leverage ACE Audio2Face microservices for real-time animation, enabling a highly interactive communication experience with its users.
Perfect World Games, a game developer and publisher, is adopting ACE in its new mythological wilderness tech demo, Legends. Players can interact with a fully interactive, realistic, multilingual AI NPC in English and Mandarin. Using NVIDIA Audio2Face NIM, the character’s audio responses generate realistic facial animation in real time.
Inventec, a leading technology company investing heavily in AI, is using NVIDIA Audio2Face NIM to enhance its healthcare AI agent within the VRSTATE platform. The integration provides a more engaging and comfortable virtual consultation experience. At COMPUTEX, Inventec is showcasing an AI agent that can help patients access their health information.
ServiceNow, the AI platform for business transformation, recently introduced ACE NIM in a generative AI service agent demonstration for its Now Assist Gen AI experience, highlighting the potential of digital avatars to improve interactions with customers and employees in industries such as retail, travel and more Moreover.
Dell Technologies unveiled its industry-leading Dell Generative AI solution for digital assistants at The world of Dell technologies last month. The offering enables businesses to leverage intelligent digital assistants that engage customers through natural conversations across various industries such as retail, healthcare and customer service.
NVIDIA celebrates digital human startups at COMPUTEX 2024
NVIDIA art teams used ACE-based generative AI tools, including Synthesis And First hourto produce a video-generated “digital Jensen” avatar from text.
The multilingual avatar featured Huang’s unique voice and style, generated by ElevenLabs‘Exclusive AI speech and voice technology in Mandarin Chinese and English. NVIDIA also collaborated with Voicemod, a member of NVIDIA Inception specializing in AI voice technology, to compose the ending theme song of Huang’s opening speech.
ACE NIM now available
NVIDIA ACE NIM microservices for server deployments, including Riva and Audio2Face, are now in production, adding NVIDIA AI Enterprise software enabling developers to benefit from enterprise-class support. Register for Early Access to ACE NIM microservices running on RTX AI PCs.
Watch Huang’s COMPUTEX speech to see the latest in ACE content.
