A new technique for machine learning that allows computers to use algorithms that turn 2D images into 3D is stirring a lot of excitement in the worlds of games, computer graphics and AI. The approach relies on “neural rendering,” which uses a neural network to generate 3D imagery from multiple 2D snapshots. A merger of concepts from the worlds of computer graphics and artificial intelligence, neural rendering gained steam in 2020 when researchers at Google and UC Berkeley demonstrated how a neural network could photorealistically capture a scene in 3D after ingesting several 2D snapshots. Continue reading Algorithms Use NeRFs to Instantly Convert 2D Images to 3D

Dimenco’s new stereoscopic 3D display has been called “breathtaking” and the future of screen viewing. The Netherlands-based company’s Simulated Reality Pro gives the impression of images coming out of the screen without special eyewear. Dimenco defines Simulated Reality (SR) as immersive technology somewhere between augmented reality and virtual reality. Dimenco’s display tech relies on visual parallax and perspective-shifting to provide its SR experience. The viewer’s eyes are tracked by an in-unit sensor that serves discrete left- and right-eye views rapidly enough to read as a single image, allowing you to “look around” the picture elements. Continue reading Dimenco’s Glasses-Free 3D Display a Hint of Things to Come

Microsoft CEO Satya Nadella thinks the metaverse will be transformative. “Just like the first wave of the Internet allowed everybody to build a website, I think the next wave of the Internet will be a more open world where people can build their own metaverse worlds, whether they’re organizations or game developers or anyone else,” Nadella told analysts on an earnings call last week. The remarks follow Nadella’s January 18 statement that Microsoft’s $69 billion bid for Activision Blizzard “will provide building blocks for the metaverse.” Microsoft expects the deal to close in fiscal 2023, which begins July 1. Continue reading Microsoft CEO Nadella Details His Vision of Metaverse-for-All

Facebook founder Mark Zuckerberg has been busy reinventing his company since the October announcement that the parent entity would name-change to Meta Platforms, where Zuckerberg remains chairman and CEO. Traditional social media engineers and support staff workers at the company, which turns 18 this month, are being urged by managers to reapply for new positions that involve responsibilities in augmented reality and virtual reality, according to reports that say Meta is actively recruiting from tech giants such as Microsoft and Apple to fill thousands of new jobs in hardware and software. Continue reading Meta’s VR Evolution Includes New Cross-Platform 3D Avatars

Game giant Unity is using its game engine technology to help businesses make “digital twins” of real-world objects, environments and even people. These virtual entities take the brunt of testing products, machines and environments. Currently there are dozens of companies reportedly using Unity’s game engine to model digital doubles that can sub-in for robots, manufacturing lines and buildings, among other things, virtually operating and monitoring them even as they are optimized and trained. These twins rust when exposed to water and respond to things like temperature. They learn to avoid a ditch or call attention to a broken part. Continue reading Unity Game Engine Makes ‘Digital Twins’ for Industrial Tests

MIT Media Lab spin-off Brelyon, founded in 2018, is demonstrating its Ultra Reality screen technology this week at CES 2022. The display tech uses computational optics to essentially offer a curved 120-inch 3D “theater-like experience” via a 32-inch desktop monitor, which the company suggests is ideal for entertainment, gaming and enterprise applications “beyond screens, into the metaverse.” The concept relies on realistic depth effects and image composition techniques to provide users with a plug-and-play, high-fidelity, virtual experience that does not rely on VR headsets. Continue reading CES: Immersive Virtual Monitor Does Not Require a Headset

Sometimes you see a product idea that is so obvious you wonder why no one created it sooner. French company Fittingbox has developed an augmented reality app and a 3D model database that lets you try on new frames for eyewear without taking off your old glasses, so you can actually see what you look like as you try them on. Diminished reality is a subset of augmented reality focused on removing, rather than adding, elements of what you see and hear. The Fittingbox app uses the selfie camera on a smartphone to scan the face of the customer. It then recognizes and removes the wearer’s glasses from the 3D modeled image. Continue reading CES: Fittingbox Demonstrates Unexpectedly Useful AR App

Social media platforms, which have had challenges maintaining a safe, socially conscious online environment — as the year’s spate of whistleblower disclosures and global regulatory hearings proves — may face an even tougher time maintaining civility in the metaverse. The shift from monitoring text, images and video to supervising a live 3D world will be orders of magnitude more complicated, observers say. According to a 2020 safety video for “Horizon Worlds,” a game Facebook developed for its virtual reality platform Oculus Quest, the company plans to record what happens in the metaverse, storing data that transpires in users’ VR headsets. Continue reading Meta Building a Safe Metaverse While Expanding VR Holdings

Unity has agreed to acquire the technology division of filmmaker Peter Jackson’s Weta Digital for a price reported at $1.625 billion. The San Francisco-based creator of the popular 3D game platform says the Academy Award-winning VFX firm will “continue as a standalone entity” renamed WetaFX, which Unity predicts will become its largest customer in the media and entertainment space, delivering tools Unity says will “unlock the full potential of the metaverse.” Weta and Unity have already been deeply involved over the years, collaborating on a host of tools used for films, games and immersive experiences. Continue reading Unity to Acquire Tech Division of Peter Jackson’s Weta Digital

Nvidia is mapping out a customer service future populated with real-time avatars who use natural-language AI with real-world customers. The company, which has seemingly transformed from graphics powerhouse to AI authority (in just under 28 years since being founded by Jensen Huang, company CEO) used this week’s GTC conference to emphasize full-stack computing. The speed and flexibility of the company’s three GPU chips offer general purpose enterprise potential, thanks to Nvidia’s parallel-processing platform, CUDA. Huang backed this assertion with a slide indicating Nvidia has deployed more than 150 SDKs to industries generating $1 trillion. Continue reading Nvidia Goes Full-Stack, Touts Artificial Intelligence and Cloud

San Francisco-based Unity Technologies, maker of the cross-platform Unity game engine has launched in beta Unity Gaming Services, a turnkey solution to make it easier to develop and maintain cross-platform multiplayer titles. New are tools for monetization, customer acquisition and player engagement. Statistics from a Unity study indicate 71 percent of multiplayer gamers do so from a mobile device, and 61 percent engage from consoles, while 40 percent say they play on both. The survey indicates 56 percent of Americans play multiplayer games, one in five having begun within the past year. Continue reading Unity Platform Offers Turnkey Solution for Multiplayer Games

On the heels of several successful tests that included Tokyo 2020 Olympics telecasts in Brazil and Japan, Intel is moving full steam ahead to bring live, end-to-end 8K HDR streaming to audiences across the globe. The company sees the future of 8K HDR as revolutionizing the worlds of sports, entertainment and gaming by delivering spectacular, immersive events at stadium scale, augmented by 3D, VR, AR and UHD audio. The key to this brave new broadcast world is Intel’s Xeon Scalable processors for local encoding and delivery over-the-top. And of course, the slickest compression algorithms. Continue reading Intel’s 8K HDR Live Streams ‘Way Beyond Proof of Concept’

Light Field Lab is developing a “naked-eye” holographic technology called SolidLight, which essentially creates high-resolution 3D objects in the real world using light (think the “Star Trek” holodeck or Princess Leia uttering “Help me, Obi-Wan Kenobi” — but better than the actual hologram tech we’ve seen in recent years). “We’re creating a world where content escapes the screen and merges with reality,” claims the Light Field website. SolidLight builds freestanding 3D objects using what the company describes as a “broad-spectrum, complex-amplitude, dense converging wavefront.” Continue reading Light Field Lab Touts ‘Highest Resolution Holographic Display’

The entertainment industry has traditionally piggybacked on primary development in other sectors to fuel our own innovative adoption of practical and compelling technologies. History shows that we consistently benefit from numerous advances across industries for reuse or adaption in our key areas ranging from internal communication all the way to distribution of content. As we start compiling our wish lists for emerging standout technologies to be featured at CES 2022 (returning to Las Vegas January 5-8), we anticipate that an expanded computational sophistication of consumer devices will be in the cards. Continue reading Thinking About CES: Increasing Computational Sophistication

Lifestyle apparel firm Vans has teamed with Roblox to bring skateboard destination “Vans World” to the online gamer’s vast audience. The creator of iconic footwear for boarders of all stripes is the latest brand to plant its flag in the metaverse, where kids are spending increasingly large chunks of time. Sony Music Entertainment, Gucci, BMG, Warner Bros. Pictures, Hasbro and Nike are among the firms that have partnered with Roblox, a global social platform with its own currency that in Q2 reported more than 42 million daily users who create and share immersive 3D experiences. Continue reading ‘Vans World’ Opens Shop in the Metaverse via Gamer Roblox