amp-web-push-widget button.amp-subscribe { display: inline-flex; align-items: center; border-radius: 5px; border: 0; box-sizing: border-box; margin: 0; padding: 10px 15px; cursor: pointer; outline: none; font-size: 15px; font-weight: 500; background: #4A90E2; margin-top: 7px; color: white; box-shadow: 0 1px 1px 0 rgba(0, 0, 0, 0.5); -webkit-tap-highlight-color: rgba(0, 0, 0, 0); } .wp-block-jetpack-rating-star span:not([aria-hidden="true"]) { display: none; } .amp-logo amp-img{width:387px} .amp-menu input{display:none;}.amp-menu li.menu-item-has-children ul{display:none;}.amp-menu li{position:relative;display:block;}.amp-menu > li a{display:block;} /* Inline styles */ div.acssa9ae5{align-content:center;display:flex;} .icon-widgets:before {content: "\e1bd";}.icon-search:before {content: "\e8b6";}.icon-shopping-cart:after {content: "\e8cc";} amp-img.amp-logo { vertical-align: top; aspect-ratio: auto 1136 / 400; width: 165px; } * { font-size: 100%; font-family: "Noto Serif", sans-serif; }

NVIDIA’s AI tech will soon let you speak to video game characters and get a real-time response

NVIDIA unveiled some interesting new technology at Computex 2023—one that leverages on the growing trend of generative AI and brings it into games. Its Avatar Cloud Engine (ACE) will soon let developers create characters that will literally respond to the player’s natural speech in real time.

The company says ACE for Games can be used to “build and deploy customised speech, conversation and animation AI models,” utilising several of its technologies. These include NVIDIA NeMo for building custom conversational AI, Riva for automatic speech recognition and text-to-speech and Omniverse Audio2Face to match facial expressions to the resulting generated speech.

Nvidia showcased those technologies in a demo it calls Kairos, in which a player interfaces with Jin, a proprietor of a ramen shop set in a Cyberpunk 2077-esque universe. By pressing and holding on a key, the said player is able to speak to Jin, who then tells him about his plight and, when asked if he needed help, names the person the player is supposed to look for and where to find him.

During his keynote, NVIDIA CEO Jensen Huang said the creators of the demo simply needed to feed Jin’s generative AI with his back story and game’s lore. The company’s GeForce Platform vice president Jason Paul also told The Verge that ACE for Games can scale to more than one character at a time and can theoretically even let characters talk to each other, though he hasn’t actually seen it tested.

It’s clear the technology isn’t quite finished—Jin sounds stilted, especially compared to what ChatGPT is capable of these days, and his facial animations still look a little stiff and robotic. But it is a fascinating glimpse into the future of video games, one where players can freely talk to characters, leading to endless storytelling possibilities.

Recent Posts

Tune Talk gets licence from MCMC to own and operate network infrastructure

Tune Talk has secured a Network Facilities Provider (Individual) (NFP(I)) licence from the Malaysian Communications…

15 hours ago

Vivo V80 Malaysia: 144Hz AMOLED screen, ZEISS cameras and 7,200mAh battery, available from RM2,399

Vivo has officially launched the Vivo V80 in Malaysia, its latest mid-range smartphone which succeeds the V70.…

16 hours ago

Huawei Nova 16s and Nova 16s Pro now available in Malaysia, priced from RM1,999 after rebate

Huawei has officially launched its latest Nova 16s series in Malaysia which comes in two…

17 hours ago

Denza D9 Prestige AWD now in Malaysia for RM346k: BYD Flash Charging, 650km range

Following recent teasers and earlier reports, BYD Malaysia has officially launched the new Denza D9…

1 day ago

BYD Flash Charging stations in Malaysia may open to all EV brands as early as this December

BYD Flash Charging stations could be opened to all EV models in Malaysia as early…

1 day ago

MCMC confirms nationwide public Early Warning System test on 29 November 2026

This isn't fake news. The Malaysian Communications and Multimedia Commission (MCMC) has confirmed that Malaysia's…

1 day ago

This website uses cookies.