CES: Sony Bows Production Tools for Metaverse, Digital Twins

Sony has launched XYN, a platform for the creation and display of spatial content. Pronounced “zin,” XYN is an integrated software and hardware solution that “accurately captures real-world objects, human motion, and backgrounds, recreating them in virtual environments for 3D computer graphics production,” according to Sony. In addition to the XYN Motion Studio, at CES 2025 this month the company shared prototypes for a XYN spatial capture solution and a XYN headset equipped with 4K OLED micro displays and video see-through function that Sony says is intended for production purposes.

VentureBeat explains that the technology is designed for “capturing live performances and digitizing them into metaverse spaces,” describing it as “pretty cool.”

Sony appears committed to XYN, which VentureBeat says falls under a new “incubation center dubbed the XR Business Development Division.” In addition to the headset, Sony also has a 4K Spatial Reality Display.

Sony’s XYN Motion Studio is a PC application that supports connection with 12 Mocopi mocap sensors, utilizing Sony’s proprietary algorithms for motion interpolation and auto-tagging for the creative use of motion data.

Sony says its Mocopi markers for mobile motion capture have been utilized by VTubers and for social virtual reality uses as well as by game, film, and animation creators.

The company notes its XYN headset “will support various 3D production software, including previsualization and 3D character modeling” for industrial design use cases as well as entertainment. A proof-of-concept experiment using the prototype is currently underway at Sony Pictures Animation, the company explains in a press release.

“At CES 2025 Sony showed off examples of engineers using the headsets for digital twins, which are digital spaces that mirror something in the real world,” VentureBeat writes.

What Sony calls its “XYN Spatial capture solution” will work by converting “high-quality, photorealistic 3D CG assets” created using images of real-world objects captured by mirrorless cameras (and proprietary algorithms). Sony says “a prototype for a mobile application that visualizes the shooting conditions of the mirrorless camera in real-time is also under development.”

The photoreal 3D objects created using XYN spatial capture can then be viewed in the XYN headset “in 3D production software for animation, video games and other potential uses” reports Engadget, which experienced a demo placing the writer inside a pre-configured animated world where he “was able to import a geode / crystal-like object that had been scanned using the spatial capture tools” and “could move it all around the virtual space, scaling it up to massive size or shrinking it down to a tiny pebble.”

No Comments Yet

You can be the first to comment!

Leave a comment

You must be logged in to post a comment.