To understand speech visually, by reading lips, in addition to aurally, is an advantage for which AI has been waiting, according to researchers at Meta Platforms (formerly Facebook). The company says it has developed a framework that learns by watching — Audio-Visual Hidden Unit BERT (AV-HuBERT) — and that it is 75 percent more accurate than competing automated speech recognition systems on several metrics. Meta claims that AV-HuBERT outperforms the former best audiovisual speech recognition system with only one-tenth the inuput, which makes it potentially useful with languages with little or no audio data. Continue reading Companies Turn to AI for New Approaches to Audio Solutions

During Snap’s annual Lens Fest event, the company introduced new features and upcoming changes to its Lens Studio creation suite. Snap touted updates involving the integration of outside media and data in addition to a collection of new augmented reality features intended for future glasses, including its own AR-enabled Spectacles. Creators will be able to add audio clips and licensed music to Snapchat Lenses. The company is working on delivering real-time data such as weather info from AccuWeather and cryptocurrency prices from FTX. Developers will also have the ability to embed links inside Lenses and send Snapchatters to different websites. Continue reading Lens Fest: Snap Reveals New Augmented Reality Possibilities

Niantic, the San Francisco tech firm best known for publishing the wildly successful mobile AR app “Pokémon Go,” is opening a version of its platform to the world with the release of the Lightship augmented reality developer kit, designed to enable AR experiences for “the real-world metaverse.” Niantic CEO John Hanke, who led Google’s geospatial division through the transformation of Google Maps and Google Earth, says Lightship will incorporate a “visual positioning system” that interoperates with glasses to place objects in the real world. In March, Hanke teased an image of Niantic-branded glasses created by Qualcomm. Continue reading Niantic Releases Lightship Tools for a ‘Real-World’ Metaverse

IDC reported that 100+ million wearables — including smartwatches, fitness trackers and AR glasses — shipped in Q1, a record-breaking number, especially in what tends to be a slow period. Q2 this year has also seen a 34.4 percent increase in sales year-over-year. The research firm revealed that Apple leads the sector, with a market share of 28.8 percent, followed by Samsung at 11.3 percent, Xiaomi at 9.7 percent and Huawei at 8.2 percent. After that, the next player is India’s boAt, which has a market share of 2.9 percent. Continue reading Apple Still Leads Wearables Market, Small Rivals Fuel Growth

During ETC@USC’s second Executive Coffee with… installment of the Spring 2021 series, Sanyogita Shamsunder, VP of product strategy, innovation and operations at Verizon engaged a group of eight USC students from cinema, engineering and business in a one-hour discussion of the question: “What comes after Zoom and entertainment apps?” Shamsunder, whose team is focused on new technology innovation and bringing new products and experiences to consumer and enterprise customers, was joined by team members Andrew Herson, who is focused on B2B2C applications, and Zachary Drossman, who heads concept development at Verizon’s 5G Labs. Continue reading ETC Executive Coffee: Verizon Execs Discuss Life After Zoom

New augmented reality glasses intended for consumers are on the horizon. Facebook plans to release a version in partnership with EssilorLuxottica’s Ray-Ban brand and is developing AR glasses that work with sensor-enabled wristbands. Meanwhile, Niantic and Qualcomm have teamed to manufacture AR glasses, and Apple is working on an AR headset for consumers, to be followed by AR glasses. Snap is also developing AR glasses aimed at consumers. Google, which debuted Google Glass in 2013, is also said to be planning another attempt at the consumer market. Continue reading Facebook, Apple, Niantic Develop AR Glasses for Consumers

The COVID-19 pandemic is driving increased demand for augmented reality at some companies, including Mercedes-Benz and L’Oréal (whose brands include Lancôme, Kiehl’s and Maybelline New York), in the last year. L’Oréal chief digital officer Lubomira Rochet stated that, “we saw the appetite, it grew and it’s our responsibility now to continue to innovate.” That company has debuted a number of AR projects for employees and customers in the last few months. One uses ModiFace AR to connect consumers with beauty advisers. Continue reading Pandemic Is Accelerating the Adoption of Augmented Reality

Facebook just revealed a holographic optical architecture for a future VR headset that will be both thinner and lighter, replacing the current bulkier glasses and headsets. The technology, described in “Holographic Optics for Thin and Lightweight Virtual Reality,” a Siggraph 2020 research paper, uses a “pancake optics” design that combines layers of holographic film with a laser projection system and directional backlights. The results can be either flat imagery or volumetric holograms. Continue reading Facebook Unveils Three Prototype Holographic VR Headsets

Apple inked a multi-year licensing agreement with U.K. company Imagination Technologies, giving it “wider range” access to that company’s IP including a new ray-tracing technology. Observers believe the move signals that Apple plans on adding ray tracing to its chips “in the foreseeable future.” Ray tracing is a graphics technology that enables imagery to be created with real-world lighting, reflections and shadows, creating a much more photorealistic result. Nvidia first brought ray tracing to PC GPUs in August 2018. Continue reading Apple Inks Deal with Imagination for Ray-Tracing Chip Tech

As reported in The Information, Apple is planning to launch a hybrid augmented reality/virtual reality headset in 2022 and a pair of AR glasses the following year. This recently released report stated that Apple chief executive Tim Cook spoke about the AR project in a 1,000-employee meeting, an unusually large gathering for the company. The report contained detailed information about Apple’s ideas about wearable AR devices. Apple has also developed a new 3D sensor system that will be integrated with the AR and VR devices. Continue reading Apple Is Developing AR/VR Headset, Glasses, 3D Sensors

Apple, Broadcom, Facebook, Google, HP, Intel, Marvell, Microsoft and Qualcomm are all petitioning the FCC to approve a Very Low Power (VLP) category of Wi-Fi, which would allow them to take advantage of the FCC’s recent opening up of the 6GHz band for unlicensed activity. VLP would enable short-range, point-to-point connections between two devices that travel below a specific power threshold (14 dBm EIRP); they say they can deliver 2Gbps at a distance of three meters — and that VLP is necessary for the proliferation of 5G. Continue reading Tech Companies Join Forces to Ask FCC For Faster Wi-Fi

Epic Games has just made Steam an offer that’s hard to refuse: that it would “retreat from exclusives” if Steam “committed to a permanent 88 percent revenue share for all developers and publishers.” Since Epic opened its own store with that revenue share model in late 2018, a long list of high profile game developers left Steam to debut new titles with Epic. The company also partnered with Magic Leap to award 500 Magic Leap One glasses — normally priced at $2,295 — to developers working in augmented reality. Continue reading Epic Takes on Steam, Plans to Gift 500 Magic Leap Glasses

Verizon is teaming with ThirdEye Gen to offer its first official mixed reality smart glasses for 5G. ThirdEye has been awarded two patents for OLED displays and low-latency data streaming. The partnership is ThirdEye’s first with a wireless provider, said company founder Nick Cherukuri, who noted that the “advanced 5G use cases … will bring about a new era of hands-free human interaction.” One example would be an auto mechanic who could scan a “complex motor” and send the image to a remote expert for real-time help. Continue reading Verizon, ThirdEye Gen Partner on 5G Mixed Reality Glasses

Chinese startup Nreal unveiled augmented reality glasses at CES 2019 featuring high-quality visuals and a sleek form factor that are slimmer than the Vuzix Blade AR glasses. The Nreal glasses weigh 85 grams (less than one-fifth of a pound) and offer 1080p projection through both lenses, with a 52-degree field of view. That makes the Nreal glasses closer to a Magic Leap headset or Microsoft HoloLens glasses — with an even better field of view. Nreal, similar to Magic Leap, also requires a processor pack connected to the glasses. Continue reading Chinese Startup Nreal Debuts Sleek, High-Quality AR Glasses

The ETC@USC team is heading to Las Vegas this weekend to deliver daily news and analysis from CTA’s annual CES trade show. Yesterday, ETC’s Don Levy pointed out that “the transformative potential of 5G … will likely emerge as the hot underlying topic of CES” and ETCentric will be covering the “show with particular interest in how developments can impact or disrupt media, entertainment and technology companies.” We’ve been watching for signs of a next transformational change that’s been growing in the background since Ericsson started testing 5G in 2015. At CES, we’ll be looking for supplementary trends to see how close we are to a sea change in distribution and personalization. Continue reading CES 2019: Yet Another Transformation Waiting in the Wings?