Meta’s next generation AI silicon is a 5nm chip designed to power the models that provide recommendations to those who use its social network platforms. The new MTIA inference accelerator is part of a “broader full-stack development program for custom, domain-specific silicon that addresses our unique workloads and systems,” Meta says. The next-gen MTIA more than doubles the compute and memory bandwidth of its predecessor, the 7nm MTIA v1 chip introduced in May 2023, resulting in 3x the performance, according to Meta, which says the new silicon is already live in 16 data centers. Continue reading Meta Deploys Gen 2 MTIA AI Accelerator Chip in Data Centers

Amazon has added $2.75 billion to its initial September 2023 investment of $1.25 billion in Anthropic, completing its announced $4 billion stake in the artificial intelligence startup formed in 2021 by former members of OpenAI. As part of the resulting strategic collaboration, Anthropic’s most powerful models, including the Claude 3 series, are available on Amazon Bedrock, a service providing fully managed foundation models. Anthropic is using Amazon Web Services as its primary cloud provider and Amazon says Anthropic will use AWS Trainium and Inferentia chips “to build, train, and deploy its future models.” Continue reading Amazon Increases Its Investment in Anthropic AI to $4 Billion

Amazon has entered into a strategic investment in San Francisco-based Anthropic, founded by former members of OpenAI. The AI startup will train and deploy future models using AWS Trainium and Inferentia chips to train and deploy future foundation models with AWS as its primary cloud provider. In turn, Amazon says it will invest up to $4 billion in Anthropic, as it strives to compete with other technology firms in the race to develop generative AI, seeding growth for what is shaping up to be an entirely new economic and social landscape. Continue reading Amazon Plans to Invest Up to $4 Billion in AI Startup Anthropic

Amazon’s AWS cloud-computing unit generated $22.1 billion in Q2, a 12 percent year-over-year gain that was a highlight in a strong quarter for the e-commerce giant. The company generated a total of $134.4 billion in revenue for the period ending in June, an 11 percent increase over the prior year. Advertising was also strong, jumping 22 percent to $10.68 billion. Cost-cutting and rebounding e-commerce helped propel the Seattle-based company to a quarterly profit of $6.75 billion (its strongest performance since Q4 2021), which contrasted sharply with a loss in the same period last year. Continue reading AWS, Advertising Drive Amazon to 11 Percent Revenue Gain

Meta Platforms has shared additional details on its next generation of AI infrastructure. The company has designed two custom silicon chips, including one for training and running AI models and eventually powering metaverse functions like virtual reality and augmented reality. Another chip is tailored to optimize video processing. Meta publicly discussed its internal chip development last week ahead of a Thursday virtual event on AI infrastructure. The company also showcased an AI-optimized data center design and talked about phase two of deployment of its 16,000 GPU supercomputer for AI research. Continue reading Meta In-House Chip Designs Include Processing for AI, Video

Amazon Web Services, a leading provider of cloud computing services, is rolling out its new ARM-based Graviton3E chips for high-performance workloads, including tasks like weather forecasting and gene sequencing. AWS customers can rent the high-performance computing (HPC) power to take advantage of “performance gains and cost savings” as a result of making its own chips, Amazon says. The move makes AWS something of a competitor to other top chipmakers, including Intel, AMD and Nvidia, who continue to be among Amazon’s major chip suppliers. Amazon says it will continue to offer HPC services that rely on third-party chips. Continue reading AWS Touts HPC with Launch of Graviton3E Chip at re:Invent

Amazon introduced AWS Deep Learning Containers, a collection of Docker images preinstalled with preferred deep learning frameworks, with the aim of making it more seamless to get AI-enabled apps on Amazon Web Services. At AWS, general manager of deep learning Dr. Matt Wood noted that the company has “done all the hard work of building, compiling, and generating, configuring, optimizing all of these frameworks,” taking that burden off of app developers. The container images are all “preconfigured and validated by Amazon.” Continue reading AWS Tool Aims to Simplify the Creation of AI-Powered Apps

Amazon revealed last month that it had spent the previous few years building a chip for use in its worldwide data centers. It’s not alone; Apple and Google also seek to design and manufacture their own chips, as part of a cost-saving strategy. Intel, which thus far hasn’t had much competition, will feel the impact as its own customers undercut the company’s annual $412 billion in sales. Amazon’s massive need for chips means it will likely continue to buy from Intel, with which it will enjoy a better bargaining position. Continue reading Tech Companies Challenge Intel by Building Their Own Chips