SageMaker HyperPod: Amazon Accelerates AI Model Training

Amazon has launched five new capabilities to its SageMaker service, including Sagemaker HyperPod, which accelerates large language and foundation model training and tuning. Sagemaker HyperPod is said to shorten the training time by up to 40 percent using its purpose-built infrastructure designed for distributed training at scale. By optimizing acceleration, SageMaker Inference reduces foundation model deployment costs by 50 percent and latency by 20 percent on average, Amazon claims. “SageMaker HyperPod removes the undifferentiated heavy lifting involved in building and optimizing machine learning infrastructure,” said Amazon. Continue reading SageMaker HyperPod: Amazon Accelerates AI Model Training

Nvidia Sales Surge as Rivals Circle and China Sanctions Loom

Nvidia logged another record quarter, with Q3 revenue of $18.12 billion, up 206 percent from a year ago and a 34 percent increase from Q2 that exceeded both its own and analyst projections. The surge, attributed to increasing demand for the chips that drive artificial intelligence, logged primarily under Nvidia’s data center results a record $14.51 billion, up 279 percent from the prior year and 41 percent from Q2. Profits swelled to $9.2 billion, a stunning 1,259 percent increase from 2022’s $680 million. The results for Nvidia’s Q3 were for the three-month period ending October 31. Continue reading Nvidia Sales Surge as Rivals Circle and China Sanctions Loom

Apple’s New M3 Chips Make the MacBook, iMac ‘Scary Fast’

During yesterday’s “Scary Fast” new product event, Apple unveiled its next generation of bespoke processors — the M3, M3 Pro and M3 Pro Max — and some new computers to go with them. Built to the 3-nanometer spec that supports artificial intelligence and advanced graphics, the M3 line has 2.5x the speed of 2020’s M1 series, per Apple, which says the core processing performance is as much as 50 percent faster. New MacBook Pro laptops in 14-inch and 16-inch versions will feature M3 Pro and M3 Pro Max chips. An M3 powered 24-inch iMac series is also debuting. Continue reading Apple’s New M3 Chips Make the MacBook, iMac ‘Scary Fast’

Nvidia to Pursue Mobile and PC Markets with Arm Processors

Not content with dominating what is currently the hottest processor market in the world — chipsets for artificial intelligence — and leading among GPU suppliers, Nvidia is branching into CPUs. The 30-year-old company, whose market cap passed the $1 trillion mark in May, is said to be “quietly” developing chips to run Microsoft’s Windows OS, tapping into a global market that hovers at about 300 million PC sales per year, 70 percent of which use Windows, according to Statista. Nvidia is reportedly pursuing its plan via a licensing deal with Arm, whose tech powers 200 billion mobile processors shipped each year. Continue reading Nvidia to Pursue Mobile and PC Markets with Arm Processors

Dell Partnering with Nvidia and Starburst for GenAI Solutions

Dell Technologies is expanding its Generative AI Solutions portfolio to help enterprise customers add GenAI to their workflow. The expansion includes support for advanced infrastructure and collaborative data solutions that optimize and help secure intelligence gathering and utilization. Dell takes a “validated design” approach to optimization and acceleration, testing different hardware configurations designed to fit the needs of various use cases. Dell has partnered with Nvidia for validated GenAI design for model customization, and with Starburst on data lakehouse solutions that tap multi-cloud data for AI end-use. Continue reading Dell Partnering with Nvidia and Starburst for GenAI Solutions

Intel Touts AI and Debuts New Chip Tech at Innovation Event

Intel Innovation 2023 provided a springboard for the new Core Ultra generation of chips, known as “Meteor Lake,” which uses the new Intel 4 process and is also the first series to feature a dedicated AI coprocessor, shipping December 14. Intel confirmed its “five-nodes-in-four-years” process technology plan is on schedule. Intel CEO Pat Gelsinger’s keynote demos included “Pike Creek,” introduced as “the world’s first multi-chiplet package using Universal Chiplet Interconnect Express (UCIe) interconnects.” For all that, it was AI that took center stage at the 2-day event in San Jose. Continue reading Intel Touts AI and Debuts New Chip Tech at Innovation Event

Demand for AI Chips Drives Nvidia to Revenue Record in Q2

Nvidia announced Q2 revenue of $13.51 billion, a 101 percent year-over-year increase that sets a new company record. The data center division — which accounts for the majority of AI chip sales — also established a new benchmark: $10.32 billion in Q2, a 171 percent leap over the prior fiscal Q2. Nvidia projects that revenue for the current quarter will hit $16 billion — about $3.5 billion above analysts’ expectations. Nvidia chips power OpenAI’s popular ChatGPT and other generative AI and cloud computing apps from companies including Amazon, Google, Meta Platforms, Microsoft and VMWare. Continue reading Demand for AI Chips Drives Nvidia to Revenue Record in Q2

VMware and Nvidia Are Bringing Generative AI to Enterprises

VMware and Nvidia have joined forces on “VMware Private AI Foundation with Nvidia,” a fully-integrated solution designed to bring generative AI training and deployment to enterprise clients running on VMware’s hybrid cloud infrastructure. The full-stack product will provide software, compute power and everything needed to fine-tune large language models using proprietary data. “Together with Nvidia, we’ll empower enterprises to run their generative AI workloads adjacent to their data with confidence while addressing their corporate data privacy, security and control concerns,” said VMware CEO Raghu Raghuram. Continue reading VMware and Nvidia Are Bringing Generative AI to Enterprises

Meta Plans Personality-Driven Chatbots to Boost Engagement

Meta Platforms is amping up its AI play, with plans to launch a suite of personality-driven chatbots as soon as next month. The company has been developing the series of artificially intelligent character bots with a goal of using them to boost engagement with its social media brands by making them available to have “humanlike discussions” on platforms including Facebook, Instagram and WhatsApp. Internally dubbed “personas,” the chatbots simulate characters ranging from historical figures like Abraham Lincoln to a surfer dude that dispenses travel advice. Continue reading Meta Plans Personality-Driven Chatbots to Boost Engagement

WWDC: Apple Surprises with Product and Software Reveals

Day one of Apple’s WWDC 2023 conference from the company’s headquarters in Cupertino was about much more than the anticipated Vision Pro mixed reality headset. The company introduced a powerhouse Mac Pro with Ultra M2, starting at $6,999, and upgraded Mac Studio desktops with M2 Max or M2 Ultra chips. The macOS Sonoma desktop operating system was among the reveals, along with the new 15-inch MacBook Air. Apple took the wraps off iOS 17 and announced that FaceTime and videoconferencing are coming to Apple TV in 4K with tvOS 17. The company’s watchOS 10 rounded out the new product and software highlights. Continue reading WWDC: Apple Surprises with Product and Software Reveals

AI Helps Steer Nvidia Toward $1 Trillion Market Capitalization

Nvidia announced $7.19 billion in revenue for the first quarter ended April 30. That’s down 13 percent compared to the February through April frame in 2022, but up 19 percent from Q4, which ended January 29. Nvidia has forecast a stunning $11 billion in sales for Q2. That projected 64 percent increase puts Nvidia on track to be the first chip company with a $1 trillion valuation. CEO Jensen Huang attributes the sales spike to exploding demand for GPUs to run artificial intelligence systems. “We are significantly increasing our supply to meet surging demand for them,” Huang said of the processors. Continue reading AI Helps Steer Nvidia Toward $1 Trillion Market Capitalization

Microsoft Believes Azure Platform Is Unlocking ‘AI Revolution’

The demand for artificial intelligence by enterprise as well as consumers is putting tremendous pressure on cloud service providers to meet the vast data center resources required to train the models and deploy the resulting apps. Microsoft recently opened up about the pivotal role it played in getting OpenAI’s ChatGPT to the release phase via its Azure cloud computing platform, linking “tens of thousands” of Nvidia A100 GPUs to train the model. Microsoft is already upgrading Azure with Nvidia’s new H100 chips and latest InfiniBand networking to accommodate the next generation of AI supercomputers. Continue reading Microsoft Believes Azure Platform Is Unlocking ‘AI Revolution’

Nvidia Chief Suggests ChatGPT Marks an AI Inflection Point

Nvidia CEO Jensen Huang has declared OpenAI’s ChatGPT as creating an “iPhone moment for artificial intelligence.” Speaking at the Haas School of Business at Berkeley, Huang suggested that ChatGPT is revolutionary for engaging the imagination of millions and opening their eyes to the possibilities the technology holds, much as Apple’s iPhone did for mobile computing, ushering in a new era. ChatGPT has taken the world by storm, and it is the diversity of use that Huang feels makes it special — with some putting it to work to create code, while others use it to write fiction or plan meals and much more. Continue reading Nvidia Chief Suggests ChatGPT Marks an AI Inflection Point

Apple Debuts MacBook Pros with M2 Pro and M2 Max Chips

Apple has announced new 14- and 16-inch iterations of its MacBook Pro laptops, featuring Apple’s next-generation silicon. The M2 Pro and M2 Max chips turn the MacBook Pro into a portable workstation, able to tackle demanding tasks like effects rendering and color grading. Apple is promising up to 22 hours of battery life, the most ever in a Mac. The smaller model starts at $1,999, while entry level for the 16-inch is $2,499. Pre-orders began last week and delivery starts tomorrow. Apple is also releasing an updated Mac mini with M2 ($599) or M2 Pro ($1,299) chips. Continue reading Apple Debuts MacBook Pros with M2 Pro and M2 Max Chips

CES: Samsung Neo G9 Curved Gaming Monitor Wows Crowd

The Samsung Odyssey Neo G9 is a 1000R curved 57-inch gaming monitor that uses quantum mini-LED technology for pixel resolution of 7,680 × 2,160 at 32:9. Announced in November as the first monitor with DisplayPort 2.1 support, it has 240Hz refresh rate and connects with the Samsung Gaming Hub for cloud gaming. Samsung, which is calling the Neo G9 “the world’s first single monitor with dual ultra-high-definition resolution,” says it will ship later this year and did not announce pricing. The company also announced the 49-inch Odyssey OLED G9. Continue reading CES: Samsung Neo G9 Curved Gaming Monitor Wows Crowd