Meta Deploys Gen 2 MTIA AI Accelerator Chip in Data Centers

Meta’s next generation AI silicon is a 5nm chip designed to power the models that provide recommendations to those who use its social network platforms. The new MTIA inference accelerator is part of a “broader full-stack development program for custom, domain-specific silicon that addresses our unique workloads and systems,” Meta says. The next-gen MTIA more than doubles the compute and memory bandwidth of its predecessor, the 7nm MTIA v1 chip introduced in May 2023, resulting in 3x the performance, according to Meta, which says the new silicon is already live in 16 data centers. Continue reading Meta Deploys Gen 2 MTIA AI Accelerator Chip in Data Centers

New Tech from MIT, Adobe Advances Generative AI Imaging

Researchers from the Massachusetts Institute of Technology and Adobe have unveiled a new AI acceleration tool that makes generative apps like DALL-E 3 and Stable Diffusion up to 30x faster by reducing the process to a single step. The new approach, called distribution matching distillation, or DMD, maintains or enhances image quality while greatly streamlining the process. Theoretically, the technique “marries the principles of generative adversarial networks (GANs) with those of diffusion models,” consolidating “the hundred steps of iterative refinement required by current diffusion models” into one step, MIT PhD student and project lead Tianwei Yin says. Continue reading New Tech from MIT, Adobe Advances Generative AI Imaging

GTC: Nvidia Unveils Blackwell GPU for Trillion-Parameter LLMs

Nvidia unveiled what it is calling the world’s most powerful AI processing system, the Blackwell GPU, purpose built to power real-time generative AI on trillion-parameter large language models at what the company says will be up to 25x less cost and energy consumption than its predecessors. Blackwell’s capabilities will usher in what the company promises will be a new era in generative AI computing. News from Nvidia’s GTC 2024 developer conference included the NIM software platform, purpose built to streamline the setup of custom and pre-trained AI models in a production environment, and the DGX SuperPOD server, powered by Blackwell. Continue reading GTC: Nvidia Unveils Blackwell GPU for Trillion-Parameter LLMs

Figure Unveils Humanoid Robot, Draws Notable Investments

Robotics firm Figure AI is getting a lot of attention for its humanoid robot, Figure 01, which the company unveiled along with news that it has raised $675 million, for a $2.6 billion valuation, from investors including OpenAI, Nvidia, Microsoft and Amazon founder Jeff Bezos. Pronounced “Figure One,” the general purpose robot looks and moves like a human, and can perform mundane tasks like serving food as well as undesirable jobs like picking up trash. It “sees” using “onboard cameras that feed into a large vision-language model (VLM) trained by OpenAI,” according to Figure co-founder and CEO Brett Adcock. Continue reading Figure Unveils Humanoid Robot, Draws Notable Investments

AI Startup Perplexity Targets $1B Valuation with New Funding

Perplexity is a year-old AI startup whose conversational “answer engine” has gained attention as a potential challenger to conventional search. Two months ago the venture raised $73.6 million in Series B funding from investors including Nvidia and Amazon founder Jeff Bezos via his Bezos Expeditions, resulting in a valuation of about $520 million. Now the company is said to be finalizing another cash infusion that is predicted to double its valuation to roughly $1 billion. The current financing round is reportedly being led by former Y Combinator partner Daniel Gross through his own investment fund. Continue reading AI Startup Perplexity Targets $1B Valuation with New Funding

MWC: Qualcomm Unveils AI Hub and Promotes 5G, 6G Tech

Qualcomm raised the curtain on a variety of artificial intelligence, 5G, and Wi-Fi technologies at Mobile World Congress Barcelona, which runs through Thursday. The San Diego-based chip designer unveiled an AI Hub it says will help developers create voice-, text- and image-based applications using pre-optimized AI models. Qualcomm’s flagship AI chips — the mobile Snapdragon 8 Gen 3 processor and the PC-centric Snapdragon X Elite — were announced last year. With the first splash of products now heading to market the company is promising to push the boundaries of 5G and 6G. Continue reading MWC: Qualcomm Unveils AI Hub and Promotes 5G, 6G Tech

Nvidia Revenue and Profits Soar on Strength of AI Chip Sales

Demand for artificial intelligence computer chips drove Nvidia income up 769 percent to nearly $12.3 billion for Q4, year-over-year, and 286 percent — to just over $29.7 billion — for the full-year fiscal 2024 frame that ended January 28. Revenue was $22.1 billion (+265 percent) and $60.9 billion (+126 percent) for the respective periods. Data center sales hit record highs of $18.4 billion for the quarter, up 409 percent from the previous year, $47.5 billion for the fiscal year, an increase of 217 percent. Gaming revenue was flat for Q4, at $2.9 billion, and up 115 percent for the year. Continue reading Nvidia Revenue and Profits Soar on Strength of AI Chip Sales

GlobalFoundries Receives $1.5 Billion in First U.S. CHIPS Grant

GlobalFoundries has been selected to receive the first major grant in the Biden administration’s CHIPS and Science Act program to reinvigorate U.S. chip production. The $1.5 billion in grants will be used to construct and expand facilities in Vermont and New York. Additionally, the administration plans to make available $1.6 billion in federal loans. The grants are estimated to triple GlobalFoundries’ New York state production capacity within the next 10 years. Chipmakers including Intel, Micron Technology, Samsung Electronics and TSMC have submitted grant applications for government assistance in building new or updating existing facilities. Continue reading GlobalFoundries Receives $1.5 Billion in First U.S. CHIPS Grant

Nvidia to Launch Unit Devoted to Building Custom HPC Chips

Nvidia is investing $30 billion in a new business unit focused on custom chips for high-performance computing. The company already controls about 80 percent of the advanced chip market but wants to avoid losing ground as alternatives spring up. Alphabet, AWS, Intel and AMD market high-end processors to third-parties, and Meta is expected to begin deploying its own Artemis AI chips this year. Nvidia has had discussions with Amazon, Google, Meta, Microsoft and OpenAI about helping them create bespoke chips and is also talking to automakers, cloud service providers (CSPs) and telecom companies, according to reports. Continue reading Nvidia to Launch Unit Devoted to Building Custom HPC Chips

Sam Altman Is Reportedly Seeking ‘Trillions’ to Fund AI Chips

OpenAI CEO Sam Altman’s ongoing effort to fund a new initiative to produce chips to power artificial intelligence has graduated from a billion-dollar venture to a trillion dollar undertaking that aims at nothing less than “to reshape the business of chips and AI,” per recent reports. The United Arab Emirates has joined the list of sources of potential funding for the global project, which seeks to remedy the tight supply of AI chips that Altman is said to view as an obstacle to OpenAI’s effort to develop artificial general intelligence, which he defines as “systems that are generally smarter than humans.” Continue reading Sam Altman Is Reportedly Seeking ‘Trillions’ to Fund AI Chips

Cisco and Nvidia Team to Offer Help Developing In-House AI

Nvidia and Cisco Systems want to simplify the process of creating in-house AI computing infrastructure with a new joint service offering end-to-end artificial intelligence solutions that aim to allow any enterprise firm to host its own AI data center. Along with its own networking gear, Cisco will globally broker Nvidia AI software and GPU cloud products along with jointly configured “purpose-built Ethernet networking-based solutions.” European cloud services provider ClusterPower is an early customer, using the new offering “to help drive data center operations with innovative AI/ML solutions.” Continue reading Cisco and Nvidia Team to Offer Help Developing In-House AI

Linux Foundation Intros Post-Quantum Cryptography Alliance

The Linux Foundation has launched the Post-Quantum Cryptography Alliance, a collaborative approach to research and development aimed at taming the data security threats posed by quantum computing. The PQCA is presenting itself as turn-key source for companies and projects looking for production-ready libraries and service packages that support compliance with the National Security Agency’s new cybersecurity standards for government contractors or would like to provide themselves and their clients with safety precautions equal to “top secret” NSA classification. Founding members include Amazon Web Services, Cisco, Google, IBM and Nvidia. Continue reading Linux Foundation Intros Post-Quantum Cryptography Alliance

Microsoft Q2 Profits Surge 33 Percent Driven by AI and Cloud

Microsoft profits were up 33 percent year-over-year to $21.9 billion in the quarter ending December 31, its fiscal Q2 for 2024. The quarterly growth was the company’s strongest in more than two years. Executives credited it to excitement about artificial intelligence services and the resulting demand for cloud services including Microsoft Azure. Earlier this month, Microsoft achieved a $2.89 trillion market valuation, overtaking Apple as the world’s most valuable public company, and this week it surged past $3 trillion. Revenue was $62 billion for the quarter, up 18 percent. Continue reading Microsoft Q2 Profits Surge 33 Percent Driven by AI and Cloud

Big Tech Onboard to Advance President Biden’s NSF AI Pilot

The National Science Foundation (NSF) is launching a pilot program to create the National Artificial Intelligence Research Resource (NAIRR), a shared U.S. AI research infrastructure. The move fulfills part of President Biden’s October executive order on the responsible development of artificial intelligence. Ten other federal agencies have joined the NSF in launching the program, while tech giants Microsoft, Nvidia and Google have already pledged their support, along with more than 20 other private organizations across the industry, academic and non-profit sectors. The idea is to create shared access to information and things like cloud computing resources. Continue reading Big Tech Onboard to Advance President Biden’s NSF AI Pilot

Nvidia GeForce GPUs Using AI to Boost SDR Content to HDR

Nvidia is introducing a new AI feature for its RTX GPUs called RTX Video HDR that upgrades standard video into high dynamic range color space for customers that have an HDR10-compatible monitor running on Windows with HDR enabled. Announced at CES, the technology is now available for download through Nvidia’s January Studio Driver update. “PC game modders now have a powerful new set of tools to use with the release of the Nvidia RTX Remix open beta,” which combines “full ray tracing, Nvidia DLSS and Nvidia Reflex” with “generative AI texture tools so modders can remaster games more efficiently,” according to the company. Continue reading Nvidia GeForce GPUs Using AI to Boost SDR Content to HDR