Autodesk’s AI Tool Turns Live-Action Video into 3D Animation

Wonder Animation is the latest tool from Wonder Dynamics, the AI startup founded by actor Tye Sheridan and VFX artist Nikola Todorovic in 2017 that Autodesk purchased in May. Now in beta, Wonder Animation can automatically transpose live-action footage into stylized 3D animation. Creators can shoot using any camera, on any set or location, and easily convert to 3D CGI. Matching the camera position and movement to the characters and environment, Wonder Animation lets you film using any camera system and lenses, edit those shots using Maya, Blender or Unreal, and then reconstruct the result as 3D animation using AI. Continue reading Autodesk’s AI Tool Turns Live-Action Video into 3D Animation

Autodesk Buys Wonder Dynamics, AI VFX App Wonder Studio

Autodesk is going all-in on artificial intelligence with the acquisition of AI startup Wonder Dynamics, maker of the Wonder Studio VFX tool. Autodesk — whose products include Maya, 3ds Max and Flame — worked with Wonder on a Maya plug-in last year and appears to have been impressed. Wonder Studio was purpose-built to be compatible with 3D tools like Maya, largely automating the process of putting 3D characters within live-action scenes. Terms of the deal were not disclosed, and Autodesk did not detail plans for integrating Wonder Dynamics, but it’s likely the company’s AI expertise will make itself felt across the portfolio. Continue reading Autodesk Buys Wonder Dynamics, AI VFX App Wonder Studio

Looking Glass Debuts Two New Headset-Free Spatial Displays

Looking Glass has launched a new 32-inch, glasses-free spatial display and an OLED version of its 16-inch model. The screens come in both landscape and portrait orientations and are aimed at XR professionals requiring visualization for 3D digital images, video and applications in real time. The 3D displays broadcast 45-100 views for what the company says is an uncompromised group-view experience. Sensors for touchless gesture control are available and the devices support a wide variety of software, including plugins for Unity, Unreal, Blender and WebXR. The 16-inch OLED lists for $4,000 but is offered at $3,000 for a limited time. Continue reading Looking Glass Debuts Two New Headset-Free Spatial Displays

MetaHuman and Animator Now Available to Fortnite Creators

Since Epic Games debuted the Unreal Editor for Fortnite (UEFN) and Creator Economy 2.0 tools in March 2023, the company says creators have published more than 80,000 UENF islands, and Epic has rewarded creators with more than $320 million in engagement payouts. Now Epic is adding more core features to UEFN: MetaHuman Creator and MetaHuman Animator, which enable the creation and animation of non-playable MetaHuman characters. Epic’s UEFN 2024 roadmap, presented at this week’s Game Developers Conference in San Francisco, includes more camera options for the player-made game platform, including a first-person perspective. Continue reading MetaHuman and Animator Now Available to Fortnite Creators

Fortnite Challenges Roblox in User-Generated Games Space

User-generated content is surging on a new front: gaming. Epic Games is teed-up to challenge Roblox in the race to become what one media outlet called “the YouTube of gaming” as they lay the groundwork to empower individual creators. While Roblox is all about user-generated games, Epic is inviting creators in to riff on its popular Fortnite world. Roblox, which draws a younger crowd, is said to have about 400 registered users, while battleground Fortnite has about 300 million. Meanwhile, with the growing popularity of UGC gaming, these giants now have game platforms dot big bang and CliCli nipping at their heels. Continue reading Fortnite Challenges Roblox in User-Generated Games Space

Apple, Microsoft Latest to Join Academy Software Foundation

Apple and Microsoft signed on as premier members of the Academy Software Foundation (ASWF), founded in 2018 to promote the use of open source software in the movie industry. By joining ASWF, Apple and Microsoft pushed annual funding for the organization over $1 million. Microsoft also joined ASWF’s governing board and technical advisory council. ASWF is a joint project of the Academy of Motion Picture Arts and Sciences and the Linux Foundation. ASWF executive director David Morin welcomed both companies into the fold. Continue reading Apple, Microsoft Latest to Join Academy Software Foundation

Disney, Rutgers Scientists Use AI to Generate Storyboards

Disney Research and Rutgers University scientists just created an end-to-end model using artificial intelligence to produce a storyboard and video featuring text from movie screenplays. This kind of text-to-animation model is not new, but this research advances the state-of-the-art by producing animations without annotated data or pre-training. The researchers wrote that the system is “capable of handling complex sentences” and is intended to make creatives’ work “more efficient and less tedious.” Continue reading Disney, Rutgers Scientists Use AI to Generate Storyboards

Varjo Debuts High-Res VR Headset for Enterprise Use Cases

Varjo introduced its VR-1 virtual reality headset priced at $5,995. The company claims the device is “the world’s only professional VR headset with human-eye resolution,” indicating that it is targeting its professional beta customers, including Airbus, Audi, architecture firm Foster + Partners, and others. Enterprise users of VR are using it for training and simulation, and need the headset to work with their design or rendering software, be it Autodesk VRed, Unreal, Lockheed Martin’s Prepar3D, or others. Continue reading Varjo Debuts High-Res VR Headset for Enterprise Use Cases

Madefire and Magic Leap Collaborate on Comic Books in AR

Madefire, which makes digital versions of comic books, has collaborated with Magic Leap to debut its first Motion Book experiences in augmented reality on Magic Leap One Creator Edition, the developer version headset that costs $2,300. The comics are available in the Magic Leap World! Explore stories. In the past, Madefire has also collaborated with DC Comics and Marvel to create digital comics. Its platform, which is available on iOS, Android as well as Oculus Rift, offers 40,000 comics including Blizzard’s Overwatch comics. Continue reading Madefire and Magic Leap Collaborate on Comic Books in AR

CES Panel: Where the Augmented Reality Experience Is Going

Augmented reality in 2018 was “interesting, with projections being exceeded,” said NorthSouth Studios’ Bill Newell, who moderated a panel on the topic. He asked what AR experience stood out this year. IBM’s Elizabeth Kiehner, who reported on the new partnership between IBM’s Watson and Unity, was enthused over Legos’ AR app. “But I am more interested in AR as it pertains to enterprise,” she said, enumerating breakthroughs in AR for factory workers and healthcare, including surgery and cancer treatment. Continue reading CES Panel: Where the Augmented Reality Experience Is Going

Google Debuts Software Tools for AR App, Web Developers

Google just released ARCore, software to enable developers to more easily create augmented reality apps. The company took its first step into augmented reality in 2014, when it introduced Tango, its 3D mapping system. But it had a hard time getting Android phone makers to make the necessary hardware upgrades to foster widespread AR adoption. Google now hopes that, rather than expensive hardware upgrades, developers will be more enticed by its software solution for allowing apps and sites to track physical objects and overlay them with virtual images. Continue reading Google Debuts Software Tools for AR App, Web Developers

NAB 2017: Oculus Details Journey to VR Film ‘Dear Angelica’

Oculus Story Studio founder/technical director Max Planck was invited to the ETC conference on AR/VR at NAB to discuss his company’s creation of “Dear Angelica,” a 13-minute dreamlike VR tale of how we remember our loved ones. The film, which played to great acclaim at the last Sundance Film Festival, is notable for the fact that it was entirely hand-painted inside VR space, by illustrator/art director Wesley Allsbrook, and written and directed by Saschka Unseld. Planck described how the inspiration for the film came out of graphic novels. Continue reading NAB 2017: Oculus Details Journey to VR Film ‘Dear Angelica’

NAB 2017: A Look at the Evolving Trends in VR and AR Audio

At the ETC conference on VR/AR, Source Sound VR’s Linda Gedemer moderated a panel of audio experts to talk about today’s VR audio tools, the trends animating VR audio, and their wish list for future technology. Everyone agreed that the audio toolsets for VR/AR seem to change nearly every day, although a handful of tools — such as Dolby Atmos and game tool Wwise — stand out as being widely accepted in this industry sector. Panelists from OSSIC, Nokia, and Source Sound VR described the toolsets they use. Continue reading NAB 2017: A Look at the Evolving Trends in VR and AR Audio

Epic Games Demos Real-Time Effects for New Branded Short

In “The Human Race,” a short produced by visual effects house The Mill for Chevrolet, the automaker’s new 2017 Camaro ZL races a futuristic Chevy concept car, one driven by a racecar driver and the other by artificial intelligence. This short premiered at the Game Developers Conference to showcase how the car was created via real-time rendering, with the help of the Unreal game engine. Unreal maker Epic Games CTO Kim Libreri demonstrated how aspects of the movie could be changed in real-time, while it was playing. Continue reading Epic Games Demos Real-Time Effects for New Branded Short

Google DeepMind Speeds AI Learning with Computer Dreams

Google’s DeepMind division has improved the speed and performance of its machine learning system with technology whose attributes are similar to how animals are thought to dream. Dubbed “Unreal” (Unsupervised Reinforcement and Auxiliary Learning), the system learned to complete Labyrinth, a 3D maze, ten times faster than the best existing artificial intelligence software and can now play up to 87 percent of expert human players’ performance. DeepMind researchers will now be able to try out new ideas much more quickly. Continue reading Google DeepMind Speeds AI Learning with Computer Dreams