Meta Platforms has published a new AI technology, the Segment Anything Model (SAM) that the company claims can identify objects it hasn’t seen before. Acting on a text prompt, SAM will highlight items in a photo or video, picking out all the cats, for instance, or flowers. It can also execute other functions, such as generating a 3D construct using a single 2D image or extrapolating from things viewed in a mixed reality headset. Segment Anything can work in concert with other models, potentially minimizing the need for voluminous data sets for training. Continue reading New Meta AI Can Detect Objects It Has Not Been Trained On

Apple has acquired WaveOne, a Mountain View-based startup that has been developing AI algorithms for video compression. Cupertino has been mum about the purchase, but the deal reportedly closed in January, and WaveOne employees are said to have been absorbed into Apple’s machine learning groups. WaveOne’s codecs use machine learning to squeeze more picture out of less bandwidth, including optimizing for signal interruptions, so the picture doesn’t freeze or disappear, making it ideal for mobile. As Netflix and YouTube tout picture improvements, WaveOne could potentially advantage Apple TV+ and a mixed reality headset. Continue reading Apple Eyes AI Video Compression with WaveOne Acquisition

On March 2, an international gathering of media technology executives and startups spent an hour discussing “the multiverse” and related topics. It was part of a day-long SPROCKIT Sync and ETC@USC Multiverse Symposium co-sponsored by the ETC and SPROCKIT, with additional support from ETC member Ronin X Foundation. Moderated by ETC’s Phil Lelyveld and Ronin X’s Sandeep Casi, attendees debated how to define the metaverse; discussed how development would impact contracts, rights and payments; raised tech implications of free range experiences and dynamic storytelling on capture and distribution processes and infrastructure; and addressed mixed reality experiences being planned and tested for theme parks. Watch a 9-minute video highlight reel of the discussion. Continue reading Tech Leaders Map the Multiverse at ETC Digital Town Square

Despite cost-cutting, Meta Platforms is continuing to spend on R&D. Coming in 2025: smart glasses paired with a neural interface watch to control them, according to The Verge, which got to view a presentation the company delivered to thousands of its Reality Labs staffers this week. Among the disclosures: for 2027, full-fledged AR glasses, a format Meta CEO Mark Zuckerberg says will eventually be as ubiquitous as mobile phones. Coming later this year is a thinner, more powerful Quest 3 VR headset priced only slightly higher than the $400 Quest 2. Continue reading Meta Has a Four-Year Plan Including Full-Fledged AR Glasses

Apple is preparing for the release of its upcoming mixed reality headset by engineering software that, while aimed largely at developers, would also allow users to create their own augmented reality apps in the same way as Final Cut Pro, which is used to edit video by both professionals and laymen. Apple’s highly anticipated headgear is expected to come to market this year, and a general use AR development tool would be a major coup for the company, given that AR apps are complicated to create and new technologies typically rely on fresh content to drive sales. Continue reading Apple Developing User-Friendly AR Creation App for Headset

LG Display showcased several prototypes at CES 2023. As part of its Advanced Mobility Lifestyle exhibit, the South Korean company touted an 8-inch, 360-degree foldable OLED that could be used for future smartphones or autos. The revolutionary technology “enables a device to fold both ways to bring greater utilization, as users can now choose different form factors according to their task,” says LG, attesting to its durability “even when folded more than 200,000 times, while its special folding mechanism minimizes wrinkles along the folding areas.” The company also presented a 17-inch foldable OLED that is “almost entirely crease-free.” Continue reading CES: LG Demos 17-Inch OLED, 8-Inch 360-Degree Foldables

HTC plans to release a $1,099 Vive XR Elite headset by the end of February, heralding a year of competitive, price-sensitive virtual reality gear targeting consumers along with the Meta Platforms $400 Quest 2. Crowdfunded firm Goovis and its $800 VR headset made it onto the list of CES 2023’s Crowdfunding Island success stories, as compiled by Kickstarter ad firm Jellop. The Vive XR Elite offers AR capability in addition to VR in a form factor that approaches something like glasses, as opposed to the usual bulky headwear. An allowance for AR apps opens the door to practical applications in everyday life in addition to entertainment applications in the metaverse. Continue reading CES: HTC Launches Vive XR Elite with VR and AR Capabilities

The design of truly contextual experiences — whether for utility or entertainment — requires a knowledge of both the user and the environment they are in. This becomes especially relevant when we think of what it means to build interesting mixed reality experiences. CES this year showcased a variety of computer vision AI software tools oriented towards understanding environmental context. At Eureka Park in the Venetian, however, MantiSpectra’s chip sensor technology provided a peek into the benefits for user experience enabled by environmental intelligence arising from hardware. Continue reading CES: Encoding Environmental Intelligence with New Chip Tech

Canon went all-in on VR at CES, demonstrating how the technology can be applied beyond games. As part of a partnership with director M. Night Shyamalan and his upcoming Universal Pictures thriller “Knock at the Cabin,” Canon invited attendees to don a VR headset and interact with characters from the film using the company’s Kokomo software for 3D VR video calls. The camera-maker’s goal is “to bring people closer together by revealing endless opportunities for creators,” Canon USA president and CEO Kazuto Ogawa said, invoking the theme “Limitless is More.” The company demonstrated solutions spanning entertainment, sports, communication and more. Continue reading CES: Canon Demos VR for Movies, Sports, Video Calls, More

The sluggish consumer adoption of virtual reality has pointed to a broader hesitation with immersive technologies that separate the user from their environment. In response, a niche market has evolved for technologies that unobtrusively live on the body while contributing an augmented sensory experience when needed. (See earrings that also offer directional audio from a company called Nova, for instance.) The Japanese exhibit section of the CES Eureka Park startup arena, however, showcased a more environmentally integrated — although still individualized — vision of immersion. Continue reading CES: Targeted Sensory Immersion at the Japanese Exhibition

According to a group of game experts, 5G will likely skyrocket the reach and power of mobile games. IQ Labs founder Julian Mitchell moderated a conversation with Activision Blizzard vice president Jonathan Stringfield, Niantic director of product management Tom Emrich and THNDR Games chief executive Desiree Dickerson on the current and future prospects of mobile gaming. Emrich pointed to Niantic’s Campfire that gives players a place to connect. “The industry outside gaming has embraced it as the new social network,” he said. “Games are more than games — they’re synonymous with the metaverse.” Continue reading CES: Mobile Game Execs Talk About Impact of Emerging 5G

Full Microsoft Teams integration has come to HoloLens 2 headsets, which are now able to make calls, browse and view calendars or join group meetings, among other things. Microsoft is also combining its key Dynamics 365 Mixed Reality Apps Teams and OneDrive to existing integrations with the Azure cloud and Power Platform. “No matter where they are,” HoloLens 2 users can “summon an array of holographic windows with a Teams call or chat, a Power BI dashboard, a Word document, a PDF or video, their OneDrive folder, or their calendar and operate in an immersive, 3D experience,” the company says. Continue reading Microsoft Goes All-In on Teams Integration with HoloLens 2

Apple has reportedly registered the name xrOS in association with its upcoming extended reality eyewear, expected to be released in 2023. The xrOS moniker represents a switch from another operating system’s name, realityOS, that had been used internally with regard to the device. Whatever the new system is eventually called, the highly anticipated gear will be Apple’s first major debut in a new product category since the Apple Watch was introduced in 2015. Apple’s wearables division contributed more than $41 billion to the company’s bottom line in the last fiscal year, accounting for about 10 percent of its overall sales revenue. Continue reading Apple Registers xrOS, Likely to Power Mixed Reality Headset

Information continues to trickle out regarding Apple’s new reality altering headset, expected to hit the market next year, possibly as soon as April. Bloomberg reports it will be powered by a Mac-level M2 chip, with more than 10 cameras facing both outward and inward and “the highest-resolution displays ever featured in a mass-market headset,” although the price tag, forecast as between $2,000 and $3,000, doesn’t sound mainstream. The first version of realityOS the company has developed is codenamed Oak. Apple is also reportedly developing 3D content for the new platform. Continue reading Apple Said to Be Developing 3D Content for realityOS Headset

LG Display has unveiled a stretchable display form factor it says surpasses existing foldable and rollable technology. Based on a highly resilient film-type substrate made of silicon used in contact lenses, LG’s 12-inch prototype stretches to up to 14 inches. The stretchable display uses a MicroLED light source with full-color RGB and resolution of 100ppi that LG says “competes with most existing monitors.” It’s spring-wired frame gives it the durability to withstand repetitive changes to form as well as significant external impact, LG adds, describing a consistency “similar to that of a rubber band.” Continue reading LG Display Reveals Stretchable Prototype That Folds, Twists