NVIDIA has unveiled a rather groundbreaking development today. Its NVIDIA ACE (Advanced Computing for Digital Human Experiences) generative AI microservices are now widely available to businesses that work with digital humans.
These cutting-edge tools signify a pivotal leap forward in the realm of digital humans. NVIDIA’s ACE has the potential to revolutionise various industries, starting from customer service and gaming to healthcare.
The NVIDIA ACE suite has a comprehensive array of digital human generative AI technologies. Each of these tools are designed to tackle specific challenges in creating, animating, and managing lifelike digital avatars.
Among these tools are NVIDIA Riva ASR (Automatic Speech Recognition), TTS (Text-to-Speech), and NMT (Neural Machine Translation), which collectively enable seamless interaction through speech.
Additionally, the NVIDIA Nemotron LLM (Large Language Model) empowers digital humans to understand and generate contextually relevant responses, while NVIDIA Audio2Face allows the creation of realistic facial animations synchronized with audio inputs. You also get NVIDIA Omniverse RTX, providing real-time, path-traced rendering capabilities to render lifelike skin and hair.
Beyond its current offerings, NVIDIA has also teased some upcoming developments to the programme, such as NVIDIA Audio2Gesture, which will generate body gestures based on audio cues, and the NVIDIA Nemotron-3 4.5B, a small language model tailored for low-latency, on-device RTX AI PC inference.
These upcoming innovations are poised to further enhance the capabilities of digital human experiences, pushing the boundaries of AI-driven interaction.
Jensen Huang, the visionary CEO of NVIDIA, expressed unwavering optimism about the transformative impact of digital humans across various sectors. He highlighted the pivotal role of breakthroughs in multi-modal large language models and neural graphics, delivered through the ACE suite, in reshaping the landscape of human-computer interaction.
Huang’s vision extends beyond mere technological advancements; he envisions a future where human-computer interaction feels as natural and intuitive as human-to-human interaction, revolutionizing industries and enriching lives.
To make it easier for developers to access to ACE technologies, NVIDIA plans to deploy ACE PC NIM (NVIDIA Inference Manager) microservices across its extensive ecosystem of RTX AI PCs and laptops. This will help NVIDIA to empower developers and businesses alike to leverage the potential of digital human technology, wich in turn will enhance user experiences across a load of applications and situations.
To streamline the deployment process, NVIDIA has introduced the NVIDIA AI Inference Manager software development kit, which simplifies the configuration of PCs with the necessary AI models, engines, and dependencies. This toolkit ensures seamless orchestration of AI inference across PCs and the cloud, facilitating the integration of ACE technologies into existing workflows and applications.
The adoption of ACE technologies is gaining momentum across industries, with leading companies such as Aww Inc., Dell Technologies, Perfect World Games, and ServiceNow embracing these tools to drive innovation and transform business operations. From enhancing customer experiences to revolutionizing gaming and healthcare, ACE is poised to reshape the way we interact with digital entities, blurring the lines between virtual and reality.
In parallel, NVIDIA has been fostering the growth of digital human startups, nurturing innovation and creativity within the burgeoning ecosystem. At Computex 2024, these startups showcased their groundbreaking solutions, highlighting the transformative potential of generative AI in creating lifelike avatars and immersive experiences.