To understand speech visually, by reading lips, in addition to aurally, is an advantage for which AI has been waiting, according to researchers at Meta Platforms (formerly Facebook). The company says it has developed a framework that learns by watching — Audio-Visual Hidden Unit BERT (AV-HuBERT) — and that it is 75 percent more accurate than competing automated speech recognition systems on several metrics. Meta claims that AV-HuBERT outperforms the former best audiovisual speech recognition system with only one-tenth the inuput, which makes it potentially useful with languages with little or no audio data. Read more

Consumer mobile app spending hit $170 billion in 2021, according to the State of Mobile in 2022 report released by App Annie. Charting expenditures across iOS, Google Play and third-party Chinese Android app stores, the figure represents 19 percent year-over-year growth, almost flat (down from 18 percent growth in 2020). While last year, consumers installed more apps than ever, the growth rate itself is slowing. Last January, App Annie reported year-over-year download growth of 7 percent from 2020, which has dropped to 5 percent for 2021. However, in all, consumers downloaded a record 230 billion apps in 2021. Read more

While drone announcements failed to generate the same buzz during CES 2022 as in previous years, several new products should be of interest to consumers and professionals, especially those in photography, video and movie production. In addition to demonstrations of hydrogen fuel cell tech promising increased flying time and new underwater micro-ROVs touting a range of enterprise applications, CES included affordable feature-rich drones such as Autel Robotics’ Dragonfish with built-in 4K video and 50X optical zoom; Skydio’s self-flying drone, geared toward cinematographers; and Sony’s Airpeak S1, the smallest drone to support a full-size mirrorless Alpha camera. Read more

Several ultra portable projectors were on display at CES 2022. Among the more interesting short throw models were products from Anker, Hisense, Samsung and XGIMI, although the show also featured a range of projector types from the likes of BenQ, JVC, Panasonic, Vankyo and ViewSonic. Generating the most buzz in the short throw category was Samsung’s $899 projector, The Freestyle, that can project from 30 to 100 inches and comes equipped with a 1080p HDR-capable view and 360-degree audio. Also drawing media attention was Anker’s upcoming Nebula Cosmos Laser, which comes in 4K ($2,199) and 1080p ($1,599) versions, and is expected to ship by late March. Read more

Samsung is sharing more specifics about its Gaming Hub and HDR10+ Gaming standard, unveiled at CES 2022. Samsung’s high-end 2022 TVs, including the Neo QLED line-up (Q70 and above) and gaming monitors will support what Samsung Electronics Visual Display Business executive vice president and head of R&D Seokwoo Yong calls “a game-changing experience,” with richer, life-like images, variable refresh rates (VRR) of up to 120Hz, automatic HDR color correction on a game-by-game basis, as well as an in-menu streaming hub with access to the Nvidia GeForce, Google Stadia and Utomik cloud libraries. Read more