Apple has released a new AI model called Depth Pro that can create a 3D depth map from a 2D image in under a second. The system is being hailed as a breakthrough that could potentially revolutionize how machines perceive depth, with transformative impact on industries from augmented reality to self-driving vehicles. “The predictions are metric, with absolute scale” without relying on the camera metadata typically required for such mapping, according to Apple. Using a consumer-grade GPU, the model can produce a 2.25-megapixel depth map using a single image in only 0.3 seconds. Continue reading Apple Advances Computer Vision with Its Depth Pro AI Model

ZTE has launched what it calls the world’s first AI-powered, eyewear-free 5G 3D tablet, the Nubia Pad 3D II. The 12.1-inch LCD display supports 2,560 x 1,600 resolution and 144Hz refresh rate. Powered by a Qualcomm Snapdragon 8 Gen 2 chipset, the Nubia Pad 3D II is equipped with an AI eye-tracking engine that utilizes “high-speed visual sensors and eye-detection algorithms” to enhance response speed and enable accurate synchronization with the users’ eyes in real-time “for a more natural and realistic 3D display experience,” ZTE says. The device also converts 2D to 3D with Neovision 3D Anytime technology. Continue reading ZTE Unveils Glasses-Free Android Tablet, the Nubia Pad 3D II

Apple has released the iOS 17.2 update for newer iPhones. New features include spatial video recording and a Journal app that generates prompts designed to get users writing about their lives based on data running through the phone. The 3D spatial video can also playback on 2D on any device but is optimized for dimensional viewing on Apple’s Vision Pro headset, due for release in 2024, starting at $3,500. The Journal app, unveiled at June’s WWDC, is described as a health and wellness feature (that oddly does not yet integrate with the Apple Watch). Continue reading Apple Intros Spatial Video Recording with Latest iOS Update

Unity has officially released its Muse AI platform for general use in early access. Muse is a suite of AI-powered tools that streamline game development. The Muse package includes Muse Chat to source answers and generate code, Muse Sprite for 2D sprites generation, and Muse Texture, providing 2D and 3D ready textures. Originally announced in July, Muse is now offered at a $30 per month subscription. Also announced at the firm’s annual Unite conference was the next major software update, Unity 6, for 2024, and the deployment of Unity Cloud to connect development tools across projects and pipelines. Continue reading Unity Opens Beta for Muse AI, Sets General Release for 2024

Meta Platforms will offer its “Horizon Worlds” virtual reality experience to the world at large, making it available in 2D via mobile and browsers on the Web, starting with early access. Initially, a “small number of people” will be able to  tap into the FPS game “Super Rumble” via the Meta Quest app on Android, with iOS availability over the next few weeks and “more experiences to come.” Early access can also be requested by those who prefer to use computer browsers at horizon.meta.com. “The metaverse should be available to everyone — no matter what device they’re on,” Meta suggests. Continue reading Meta’s ‘Horizon Worlds’ Offers Metaverse on Mobile, the Web

It’s an ideal time to outfit hybrid home workers, and Lenovo is going all-in on the concept, rolling out new tools for digital business users. Foremost among the digital offerings is the ThinkVision 27 3D, a 27-inch glasses-free 2D/3D compatible monitor with real-time eye-tracking. Designed for developers and professional content creators like graphic artists or product designers who can benefit from immersive 3D visualization, ThinkVision has a max resolution of 1920×2160 for 3D and displays flat at 3840×2160, thanks to a lenticular lens in the monitor that can toggle between the two. Continue reading Lenovo Offers Glasses-Free 3D at 4K via ThinkVision Monitor

Disney Research Studios has created an AI tool that can make actors look older or younger more simply than the costly and time-consuming visual effects that are the current status quo. While artificial intelligence had been used to age or de-age people with relative success in still frames, the results lacked photorealism when applied to video. Disney calls its app FRAN, for Face Re-Aging Network. FRAN has been trained to identify the parts of a face that change with age and can either accentuate or erase the telltale signs. Continue reading Disney Invents High-Quality Tool to Rejuvenate or Age Actors

Nvidia Research is introducing a new AI model that largely automates the process of creating virtual worlds, making it easier for developers to populate games and VR experiences with a diverse array of 3D buildings, vehicles, characters and more. Trained using only 2D images, GET3D generates 3D shapes with high-fidelity textures and complex geometric details. GET3D can generate “a virtually unlimited number of 3D shapes based on the data it’s trained on,” according to Nvidia, which says the objects can be used in 3D representations of buildings or the great outdoors, in games or the metaverse. Continue reading Nvidia Debuts New AI Model That Quickly Generates Objects

A new technique for machine learning that allows computers to use algorithms that turn 2D images into 3D is stirring a lot of excitement in the worlds of games, computer graphics and AI. The approach relies on “neural rendering,” which uses a neural network to generate 3D imagery from multiple 2D snapshots. A merger of concepts from the worlds of computer graphics and artificial intelligence, neural rendering gained steam in 2020 when researchers at Google and UC Berkeley demonstrated how a neural network could photorealistically capture a scene in 3D after ingesting several 2D snapshots. Continue reading Algorithms Use NeRFs to Instantly Convert 2D Images to 3D

San Francisco-based Unity Technologies, maker of the cross-platform Unity game engine has launched in beta Unity Gaming Services, a turnkey solution to make it easier to develop and maintain cross-platform multiplayer titles. New are tools for monetization, customer acquisition and player engagement. Statistics from a Unity study indicate 71 percent of multiplayer gamers do so from a mobile device, and 61 percent engage from consoles, while 40 percent say they play on both. The survey indicates 56 percent of Americans play multiplayer games, one in five having begun within the past year. Continue reading Unity Platform Offers Turnkey Solution for Multiplayer Games

Transforming 2D objects into 3D ones is a challenge that has defeated numerous artificial intelligence labs, including those at Facebook, Nvidia and startup Threedy.ai. Now, a Microsoft Research team stated it has created the first “scalable” training technique to derive 3D models from 2D data. Their technology can, furthermore, learn to generate better shapes when trained exclusively with 2D images. The Microsoft team took advantage of software that produces images from display data, as featured in industrial renderers. Continue reading Microsoft Develops Scalable 2D-to-3D Conversion Technique

Snap added new features to Lens Studio, its easy-to-use desktop app that lets users create augmented reality lenses. To make it more appealing to creators, from novices to professional 3D modelers, Snap introduced the Landmarker template, which supports 14 new real-world locations; six new facial templates; and an interactive how-to for newbies. Available for free download, Lens Studio runs on Windows 10 and macOS 10.11 or later. Over half a million Lenses have been developed since Lens Studio debuted in late 2017. Continue reading Snapchat Intros New Features for Desktop App Lens Studio

RED, the company known for its 4K Epic and Weapon film/TV cameras, just debuted a smartphone, the RED Hydrogen One, which will be offered by AT&T and Verizon. The Android phone, which has a 5.7-inch display, is, says the company, “the foundation of a future multi-dimensional media system.” The phone can connect to RED’s other cameras via pogo pins and, in the future, to lens mounts and other modules. RED’s first such module will be a DSLR-similar camera sensor. The phone also produces holographic images. Continue reading RED Debuts Android Smartphone That Creates 4D Holograms

Microsoft is pitching its new mixed reality studios in San Francisco and London to developers and producers interested in creating holograms from real life objects. “Microsoft has been using its own studio at its Redmond headquarters to capture Buzz Aldrin, Reggie Watts, Max Frost, and Cirque Du Soleil performances and bring them into virtual reality and augmented reality holograms,” reports The Verge. The new studios will enable content creators to produce holograms for “regular 2D screens, a HoloLens device, or even Microsoft’s new Windows Mixed Reality headsets.” The company “is also expanding its Mixed Reality Academy program to San Francisco,” with workshops for “developing apps and experiences for VR and HoloLens headsets.” Continue reading Microsoft Opens Studios to Produce Mixed Reality Holograms

TheWaveVR, which raised $4 million this year, has offices in Austin and Los Angeles. The company creates VR concerts that marry music and visuals by partnering with musicians. The results, similar to real-world raves, have garnered a lot of buzz for pushing the limits of virtual reality. Its newest virtual world, created in collaboration with producer/DJ TOKiMONSTA (aka Jennifer Lee), features about 50 minutes of the dance/electronica album Lune Rouge, and is TheNextWave’s fifth flagship show. Continue reading TheWaveVR Introduces Another Immersive Concert on Steam