Nvidia’s new technology automates facial animation using sound files

nme.com:

Nvidia’s new technology is available for testing and it uses neural networks to animate digital faces using sound files.Nvidia’s open-source simulation platform has received a beta version of a new feature called Audio2Face.

The new system will allow users to input audio files of voices. Then, an animated face will be automatically animated to match the voice lines.

The current version uses a Digital Mark character model, but users could use any face with the same rigging and bones in its place.The system currently works with most languages and has several sliders to change details.

As this is a beta, more updates to the software could bring improvements down the line. As reported by PCGamer, the system uses a neural network that matches.