Runway is launching Act-One motion capture system that uses video and voice recordings to map human facial expressions onto characters using the company’s latest model, Gen-3 Alpha. Runway calls it “a significant step forward in using generative models for expressive live action and animated content.” Compared to past facial capture techniques — which typically require complex rigging — Act-One is driven directly and only by the performance of an actor, requiring “no extra equipment,” making it more likely to capture and preserve an authentic, nuanced performance, according to the company. Continue reading Runway’s Act-One Facial Capture Could Be a ‘Game Changer’

Roblox is adding an expressive, avatar-based video chat called Roblox Connect to its virtual world in an effort to keep its young user base engaged as it grows up while also potentially expanding its audience. “We’re essentially packaging a Hollywood-style motion capture studio into something that runs on a mobile phone or laptop — without the need for equipment or motion-tracking dots,” Roblox explains, pointing out that the device’s on-board camera is all that’s needed to capture facial motion and convey it in real time. Also, Roblox is is coming to PS4 and PS5 next month, while the company will allow game creators to sell 3D virtual goods. Continue reading Roblox Adds Facial-Tracking Vid Chat, Expands to PlayStation

Epic Games is releasing MetaHuman Animator, which lets developers create nuanced facial animation by capturing an actor’s performance using an iPhone or stereo head-mounted camera system and a PC. The system eliminates the need for manual touch-ups, according to Epic, capturing “every subtle expression, look, and emotion” and replicating it onto a digital character for a faster performance capture workflow that allows more creative control. The new feature set uses a 4D solver to combine video and depth data with a MetaHuman representation of the performer. The animation is produced locally using GPU hardware, providing final results in “minutes.” Continue reading New Tool from Epic Simplifies High-Fidelity Facial Animation

As it seeks to build-out a metaverse, online game platform and game creation system Roblox is courting brands as well as older users (54 percent of the platform’s daily active users are said to be age 12 and below). The popular gaming platform is adding facial capture for users and offering advertisers digital billboards and links to branded destinations. Roblox has been trying to divide its users by age, and added authentication for those 13 and above last September for access to more adult content. As part of the content diversification critical to both initiatives, Roblox is increasing its Game Fund to $35 million. Continue reading Roblox Targets Advertisers, Diverse Users with New Features

At the HPA Tech Retreat in Palm Desert this week, Sony chief technology officer Don Eklund described how Sony has been using artificial intelligence as a toolset to create applications specific to its needs. “I was aware of AI but didn’t pay attention,” he said. “It’s now become pervasive.” He brought together three companies — Adobe, Rival Theory and Video Gorillas — that are researching and developing AI-enabled solutions over many years. Some of these tools are commercially available or will be soon. Continue reading Firms Highlight Real World AI Solutions at HPA Tech Retreat

At the Beverly Wilshire Hotel, actors John Cho and Leslie Mann hosted the Academy of Motion Picture Arts and Sciences’ annual Scientific and Technical Awards, honoring the programmers, inventors and breakthroughs advancing the entertainment industry. The evening awarded 18 achievements, to 34 individual recipients and five organizations. Many of the technologies and products awarded, including an array of digital cinema cameras, represented years of R&D. AMPAS president Cheryl Boone Isaacs opened the evening’s event. Continue reading Sci-Tech Awards Honor Digital Cinema Cams, Capture Systems