Alibaba is touting a new artificial intelligence system that can animate portraits, making people sing and talk in realistic fashion. Researchers at the Alibaba Group’s Institute for Intelligent Computing developed the generative video framework, calling it EMO, short for Emote Portrait Alive. Input a single reference image along with “vocal audio,” as in talking or singing, and “our method can generate vocal avatar videos with expressive facial expressions and various head poses,” the researchers say, adding that EMO can generate videos of any duration, “depending on the length of video input.” Continue reading Alibaba’s EMO Can Generate Performance Video from Images

Epic Games is releasing MetaHuman Animator, which lets developers create nuanced facial animation by capturing an actor’s performance using an iPhone or stereo head-mounted camera system and a PC. The system eliminates the need for manual touch-ups, according to Epic, capturing “every subtle expression, look, and emotion” and replicating it onto a digital character for a faster performance capture workflow that allows more creative control. The new feature set uses a 4D solver to combine video and depth data with a MetaHuman representation of the performer. The animation is produced locally using GPU hardware, providing final results in “minutes.” Continue reading New Tool from Epic Simplifies High-Fidelity Facial Animation

Nvidia founder and CEO Jensen Huang shared his vision for a computer graphics industry transformed by AI, the metaverse and digital humans. “The combination of AI and computer graphics will power the metaverse, the next evolution of the Internet,” Huang told attendees at SIGGRAPH 2022 in Vancouver. To support this transformation, Nvidia unveiled the Avatar Cloud Engine (ACE) and discussed plans to build out the Universal Scene Description (USD) industry standard, which Huang called “the language of the metaverse.” New extensions for Omniverse and graphics workflow optimizations using machine learning were also part of the mix.
Continue reading Nvidia Unveils New Tools for AI, the Metaverse at SIGGRAPH

Last week, Epic Games revealed its plans to fund, introduce and market new multi-platform video games, under the new Epic Games Publishing division. Epic Games stated that it will fund “up to 100 percent of all game development costs … studios will retain 100 percent control of their intellectual property … [and] once costs are recouped developers will earn at least 50 percent of profits.” Epic games also acquired Cubic Motion, which offers automated performance-driven facial animation technology. Continue reading Epic Games Becomes Game Publisher, Acquires Cubic Motion

At SIGGRAPH 2015 in Los Angeles, Faceware Technologies, which creates markerless 3D facial motion capture solutions, demonstrated its Faceware Live plugin for Epic Games’ Unreal Engine 4. With the plugin, developers for the UE4 will be able to capture facial movements with any video source and apply them immediately to digital characters. The Unreal Persona animation system displays the facial animation that takes place in real-time. The plugin was shown behind closed doors at SIGGRAPH. Continue reading SIGGRAPH: Faceware Unveils Live Capture for Gaming Engine