In April, Meta Platforms revealed that it was working on an open-source AI model that performed as well as proprietary models from top AI companies such as OpenAI and Anthropic. Now, Meta CEO Mark Zuckerberg says that model has arrived in the form of Llama 3.1 405B, “the first frontier-level open-source AI model.” The company is also releasing “new and improved” Llama 3.1 70B and 8B models. In addition to general cost and performance benefits, the fact that the Llama 3.1 405B model is open source “will make it the best choice for fine-tuning and distilling smaller models,” according to Meta. Continue reading Meta Calls New Llama the First Open-Source Frontier Model

Nvidia and French startup Mistral AI are jointly releasing a new language model called Mistral NeMo 12B that brings enterprise AI capabilities to the desktop without the need for major cloud resources. Developers can easily customize and deploy the new LLM for applications supporting chatbots, multilingual tasks, coding and summarization, according to Nvidia. “NeMo 12B offers a large context window of up to 128k tokens,” explains Mistral, adding that “its reasoning, world knowledge, and coding accuracy are state-of-the-art in its size category.” Available under the Apache 2.0 license, it is easy to implement as a drop-in replacement for Mistral 7B. Continue reading Mistral, Nvidia Bring Enterprise AI to Desktop with NeMo 12B

A consortium of top tech firms have joined forces to launch a security group focused on artificial intelligence applications. The cybersecurity-focused non-profit OASIS will oversee operational aspects of the Coalition for Secure AI, to be known as CoSAI, described as an “open-source community.” OASIS lists Google, IBM, Intel, Microsoft, Nvidia and PayPal as founding Premier Sponsors of CoSAI, whose “additional founding sponsors” include Amazon, Anthropic, Cisco, Chainguard, Cohere, GenLab, OpenAI and Wiz. “CoSAI is an initiative to enhance trust and security in AI use and deployment,” OASIS announced at the Aspen Security Forum. Continue reading Google, OpenAI, Nvidia and Others Form AI Security Coalition

U.S. tech companies are fighting back against what they feel are overly oppressive European Union regulations by withholding products from that market. Meta Platforms will not release its next Llama multimodal AI model there, along with future products. Apple last month said certain Apple Intelligence AI features will not be released in the EU. Previously, tech companies would accommodate regional laws by adapting global strategies so they could do business everywhere with the same products. Given the restrictions of the Digital Markets Act and other EU rules, Big Tech is signaling that may no longer be possible. Continue reading Tough EU Laws Prompt Meta, Apple to Withhold New Products

Amazon is increasingly betting on artificial intelligence as the key to its future growth. The company plans to spend $100 billion on data centers over the next decade — significantly more than it will spend on e-commerce and warehouse infrastructure. This is largely due to market forces. Thirty-year-old Amazon rode the e-retail wave to maturity, and the company’s AWS cloud service is now the new growth engine, driving the firm past $2 trillion in market value last week. The fifth U.S. company to hit that milestone is said to be building a new chatbot it hopes will surpass ChatGPT. Amazon also announced it has hired David Luan, co-founder of AI firm Adept. Continue reading Data and AI Propel Amazon to $2 Trillion Market Capitalization

Synthesia, which uses AI to create business avatars for use in content such as training, presentation and customer service videos, has announced a major platform update. “Coming soon” with Synthesia 2.0 are full-body avatars that include hands capable of a wide range of motions. Users can animate motion using skeletal sequences on which the persona selected from the catalog can then be automatically mapped. Starting next month, the Nvidia-backed UK company will offer the ability to incorporate brand identity — including typography, colors and logos — into templated videos. A new translation tool automatically applies updates to all languages. Continue reading Lifelike AI Avatars to Get New Features with Synthesia Update

Nvidia is expanding its substantive influence in the AI sphere with Nemotron-4 340B, a family of open models designed to generate synthetic LLM training data for commercial applications across numerous fields. Through what Nvidia is calling a “uniquely permissive” free open model license, Nemotron-4 340B provides a scalable way for developers to build LLMs. Synthetic data is artificially generated data designed to mimic the characteristics and structure of data found in the real world. The offering is being called “groundbreaking” and an important step toward the democratization of artificial intelligence. Continue reading Nvidia’s Open Models to Provide Free Training Data for LLMs

Amazon has earmarked $230 million to invest in generative AI startups worldwide, providing funding in the form of “AWS credits, mentorship, and education to further their use of artificial intelligence and machine learning technologies.” The initiative will cast a global net, focusing on early-stage companies. About $80 million of that allocation will fund the second cohort of the AWS Generative AI Accelerator, which provides up to $1 million in credits “to each of the top 80 early-stage startups that are using generative AI to solve complex challenges.” Applications for the AWS Accelerator are open through July 19. Continue reading Amazon Commits $230M in AWS Credits for GenAI Startups

Rene Haas, CEO of UK chip designer Arm Holdings, thinks his company’s platform architecture could nab as much as 50 percent of the Windows PC market by 2030. That would essentially be a 400 percent leap from its current 11 percent share in a market dominated by Intel’s x86 design. Because Arm was developed for smartphones, it was driven by energy efficiency, an approach that is paying off in the era of power-hungry AI applications. Now the technology is being used for the first wave of Microsoft Copilot+ Windows laptops, and Arm has also set its sights on desktop PCs. Continue reading Arm CEO Says Company Aims to Capture Half of PC Market

Intel launched new Xeon 6 processors built for high-density AI work in data centers. Intel CEO Pat Gelsinger emphasized performance and power efficiency as he introduced the next-gen Xeon, and said that the Gaudi 3 chips for AI model training and deployment that were released two months ago are less expensive than comparable silicon from Intel rivals. “Intel is one of the only companies in the world innovating across the full spectrum of the AI market opportunity — from semiconductor manufacturing to PC, network, edge and data center systems,” Gelsinger said, embracing open standards during his keynote at Computex. Continue reading Intel’s Xeon 6 Coming to Data Centers and Lunar Lake to PCs

Nvidia President and CEO Jensen Huang said the company will be upgrading its AI accelerators annually, with the Blackwell Ultra processor coming in 2025 and a next-generation platform called Rubin that is still in development planned for 2026. Rubin AI will utilize a type of high-bandwidth memory called HBM4 that addresses a bottleneck that has stifled the production of AI accelerators. Huang shared the news from Taiwan, where he delivered a keynote at the Computex trade show. Nvidia Inference Microservices were another focus, allowing AI applications to be deployed in minutes instead of weeks, Huang said. Continue reading Nvidia Teases Next-Gen AI Platform Rubin at Computex 2024

At Computex Taipei this week, AMD revealed its AMD Ryzen AI 300 Series third generation of AI-enabled mobile processors for next-generation laptops. It joins Intel’s upcoming Lunar Lake and the Snapdragon X platform from Qualcomm among the chips vying for a place in the exploding market for artificial intelligence processing, an area dominated by Nvidia. However, with AI PCs and laptops just hitting the market that field is somewhat in play. The Ryzen AI 300s are among those that will be used to power laptops equipped with Microsoft Copilot+ AI. At Computex, AMD also unveiled its Ryzen 9000 Series processors for desktop PCs. Continue reading AMD Unveils Its Next-Gen AI Chips in Battle for Market Share

Big Tech players have joined forces to develop a new industry standard to advance high-speed and low latency communication among data centers by coordinating component development. AMD, Broadcom, Cisco, Google, Hewlett Packard Enterprise (HPE), Intel, Meta Platforms and Microsoft are backing the Ultra Accelerator Link (UALink) promoter group. The group plans to define and establish an open industry standard that will enable AI accelerators to communicate more effectively. The UALink aims to create a pathway for system OEMs, IT professionals and system integrators to connect and scale their AI-connected data centers. Continue reading Big Tech Forms a Group to Develop AI Connectivity Standard

Elon Musk’s xAI has secured $6 billion in Series B funding. While the company says the funds will be “used to take xAI’s first products to market, build advanced infrastructure, and accelerate the research and development,” some outlets are reporting a significant portion is earmarked to build an AI supercomputer to power the next generation of its foundation model Grok. The company publicly released the open-source Grok-1 as a chatbot on X social in November, and recently debuted Grok-1.5 and 1.5V iterations with long-context capability and image understanding. Continue reading Musk Said to Envision Supercomputer as xAI Raises $6 Billion

Nvidia just wrapped a record quarter, with no sign of interest cooling for the GPUs that have become essential to powering the AI boom. Revenue for the company’s most recent quarter was a record $26 billion, up 262 percent year-over-year. Profit also hit a new high, up nearly sevenfold to $14.88 billion compared to the same period a year earlier. The performance drove the already buoyant stock price above $1,000 a share. Company founder and CEO Jensen Huang proclaimed, “the next industrial revolution has begun,” with Nvidia playing a pivotal role in transforming data centers into “AI factories.” Continue reading Nvidia Reports Record Revenue, Profits as AI Demand Surges