Microsoft and Nvidia Debut World’s Largest Language Model

Microsoft and Nvidia have trained what they describe as the most powerful AI-driven language model to date, the Megatron-Turing Natural Language Generation model (MT-NLG), which has “set the new standard for large-scale language models in both model scale and quality,” the firms say. As the successor to the companies’ Turing NLG 17B and Megatron-LM, the new MT-NLG has 530 billion parameters, or “3x the number of parameters compared to the existing largest model of this type” and demonstrates unmatched accuracy in a broad set of natural language tasks. Continue reading Microsoft and Nvidia Debut World’s Largest Language Model

Facebook Counters AI Bias with a Data Set Featuring Actors

Facebook released an open-source AI data set of 45,186 videos featuring 3,011 U.S. actors who were paid to participate. The data set is dubbed Casual Conversations because the diverse group was recorded giving unscripted answers to questions about age and gender. Skin tone and lighting conditions were also annotated by humans. Biases have been a problem in AI-enabled technologies such as facial recognition. Facebook is encouraging teams to use the new data set. Most AI data sets comprise people unaware they are being recorded. Continue reading Facebook Counters AI Bias with a Data Set Featuring Actors

Massachusetts Finds Compromise in Use of Facial Recognition

Oakland, Portland, San Francisco and Minneapolis have banned police use of facial recognition, mainly due to its inherent racial bias. Massachusetts is now the first U.S. state to legislate its use. The law, which goes into effect in July, has found a middle ground, both allowing law enforcement to use the facial recognition technology to catch criminals and building in protections intended to prevent false arrests. With the new law, police must get a judge’s permission to run a facial recognition search. Continue reading Massachusetts Finds Compromise in Use of Facial Recognition

OpenAI Unveils AI-Powered DALL-E Text-to-Image Generator

OpenAI unveiled DALL-E, which generates images from text using two multimodel AI systems that leverage computer vision and NLP. The name is a reference to surrealist artist Salvador Dali and Pixar’s animated robot WALL-E. DALL-E relies on a 12-billion parameter version of GPT-3. OpenAI demonstrated that DALL-E can manipulate and rearrange objects in generated imagery and also create images from scratch based on text prompts. It has stated that it plans to “analyze how models like DALL·E relate to societal issues.” Continue reading OpenAI Unveils AI-Powered DALL-E Text-to-Image Generator

Facebook Makes New Natural Language Model Open Source

Facebook and AI startup Hugging Face open-sourced their new natural language processing model, Retrieval Augmented Generation (RAG), which finds and interprets contextual information on the fly. RAG is now available as a component of the Hugging Face transformer library, integrated with the new Datasets library to offer the indexed knowledge source RAG relies on. According to Facebook, RAG can alter or add to its internal knowledge, letting researchers control the model without needing to retrain it. Continue reading Facebook Makes New Natural Language Model Open Source

IBM Releases Policy Proposal to Regulate AI, Prevent Bias

As lawmakers in the U.S. and Europe ponder how to best regulate artificial intelligence, IBM called for the industry and governments to jointly create standards to measure and avoid AI bias. The company, led by chief executive Ginni Rometty, issued a policy proposal on the eve of the World Economic Forum in Davos. Although their policies are not as strict as governments might otherwise propose, the goal is to find a consensus among all parties. IBM, which has lagged in technology, now focuses on AI and cloud services. Continue reading IBM Releases Policy Proposal to Regulate AI, Prevent Bias

CES Panel Examines Problem of Bias in Artificial Intelligence

As artificial intelligence is increasingly embedded into devices and experiences, the problem of racial and gender bias has become apparent, in several embarrassing and disturbing incidents. The industry has paid attention to studying how bias is introduced — often via the underlying data — and how to fix it. Former FCC commissioner Mignon Clyburn, now at MLC Strategies, led a discussion with Helloalice.com president Elizabeth Gore and Uber head of inclusive engagement Bernard Coleman on the topic. Continue reading CES Panel Examines Problem of Bias in Artificial Intelligence