OpenAI unveiled major updates at its DevDay conference with the focus largely on making AI more accessible, efficient and affordable. Included were four innovations: Vision Fine-Tuning in the API, Model Distillation, Prompt Caching and the public beta of Realtime API. The approach underscores OpenAI’s effort to empower its developer ecosystem even as it continues to compete for end-users in the enterprise space. The Realtime API gives developers the option of building “nearly real-time” speech-to-speech app experiences, selecting from among six OpenAI voices. Vision Fine-Tuning for GPT-4o enables customization of the model’s visual understanding of images and text. Continue reading OpenAI Showcases Latest Updates for Voice, Picture and More

Meta’s Llama 3.2 release includes two new multimodal LLMs, one with 11 billion parameters and one with 90 billion — considered small- and medium-sized — and two lightweight, text-only models (1B and 3B) that fit onto edge and mobile devices. Included are pre-trained and instruction-tuned versions. In addition to text, the multimodal models can interpret images, supporting apps that require visual understanding. Meta says the models are free and open source. Alongside them, the company is releasing “the first official Llama Stack distributions,” enabling “turnkey deployment” with integrated safety. Continue reading Meta Unveils New Open-Source Multimodal Model Llama 3.2

Snap is rolling out its fifth generation of Spectacles — standalone AR glasses that enable use of Lenses to “experience the world together with friends.” The firm is also launching a Spectacles Developer Program, and at a rental fee of $99 per month, that’s who the devices are aimed at, for now. Spectacles are powered by Snap OS, optimized to leverage people’s natural responses to interacting with their environment. They work seamlessly with mobile devices, turning smartphones into custom game controllers with Lenses. There’s even a Spectator Mode, “so friends without Spectacles can follow along, mirror your phone screen, and more.” Continue reading Snap Targets Developers with $99 per Month AR Spectacles

OpenAI is previewing a new series of AI models that can reason and correct complex coding mistakes, providing a more efficient solution for developers. Powered by OpenAI o1, the new models are “designed to spend more time thinking before they respond, much like a person would,” and as a result can “solve harder problems than previous models in science, coding, and math,” OpenAI claims, noting that “through training, they learn to refine their thinking process, try different strategies, and recognize their mistakes.” The first model in the series is being released in preview in OpenAI’s popular ChatGPT and in the company’s API. Continue reading OpenAI Previews New LLMs Capable of Complex Reasoning

During the 10th annual Roblox Developers Conference (RDC 2024) in San Jose, the gaming platform announced it is opening to global currencies in addition to its own Robux, which generates billions in virtual transactions each year. Starting later this year, a small test bed of developers will be able to charge real money for games that charge fees, with a program expected to open “to all eligible creators by mid-2025.” The massively multiplayer online platform that lets users build online game worlds also discussed a project to develop its own AI foundation model to power generative 3D creation on the platform. Continue reading Roblox Adds Real Currency, Teases Its Coming Generative AI

Last year Sony entered into a joint venture with Singapore-based startup Startale Labs. Now the first fruits of that collaboration have come to light, with the launch of Soneium, an Ethereum layer 2 blockchain, from Startale and Sony Block Solutions Labs. The platform is first being made available to developers, with plans for an eventual public launch, the goal being “to create new services by leveraging the various businesses and IP within the Sony Group so that Soneium becomes an infrastructure that everyone can use on a daily basis,” according to Sony. Continue reading Sony and Startale Labs Launch Soneium Blockchain for Web3

OpenAI announced its newest model, GPT-4o, can now be customized. The company said that the ability to fine-tune the multimodal GPT-4o has been “one of the most requested features from developers.” Customization can move the model toward more specific structure and tone of responses or allow it to follow specific instruction sets geared toward individual use cases. Developers can now implement custom datasets, aiming for better performance at a lower cost. The ChatGPT maker is rolling out the welcome mat by offering 1 million training tokens per day “for free for every organization” through September 23. Continue reading OpenAI Pushes GPT-4o Customization with Free Token Offer

After 50 years of SIGGRAPH, the conference has come full circle, from high-tech for PhDs to AI for everyone. That was Nvidia founder and CEO Jensen Huang’s message in back-to-back keynote sessions, including a Q&A with Meta CEO Mark Zuckerberg. Huang touted Universal Scene Description (OpenUSD), discussing developments aiming to speed adoption of the universal 3D data interchange framework for use in everything from robotics to the creation of “highly accurate virtual worlds for the next evolution of AI.” As Zuckerberg’s interlocutor, he prompted the Facebook founder to share a vision of AI’s personalization of social media. Continue reading Nvidia Debuts New Products to Accelerate Adoption of GenAI

Apple’s iOS 18 public beta 2 has arrived, with new wallpapers for CarPlay, a newly designed Hidden Apps folder in the Apps Library and the ability to use dark mode widgets in broad daylight, among other updates. Public beta 2 includes iPadOS 18, but does not include Apple Intelligence, which is expected this fall. However, a separate Apple Intelligence preview was introduced this week. In addition, a new Apple research paper leads some to believe its Apple Intelligence AI models were pre-trained in the cloud using Google Tensor Processing Units, leading to speculation that Big Tech be considering alternatives to Nvidia. But Apple has always been an AI outlier. Continue reading Apple Intelligence Preview and Updated iOS 18 Beta Released

An alternative app store called AltStore PAL recently launched in response to the European Union’s Digital Markets Act (DMA) and is now offering third-party iOS apps. The move comes several months after the company implemented an updated version of its open-source app marketplace in the EU. The DMA was enacted to foster competition, regulating Apple into opening up to rivals. Among AltStore PAL’s new offerings is iTorrent, which lets users download peer-to-peer files, and qBitControl, a remote client for iOS devices. Another app, PeopleDrop, automatically helps users connect to those nearby. Epic Games revealed it plans to offer “Fortnite” on AltStore PAL. Continue reading App Merchant AltStore PAL Bows in EU with a Focus on iOS

The U.S. Commerce Department has issued a large package of material designed to help AI developers and those using the systems with an approach to identifying and mitigating risks stemming from generative AI and foundation models. Prepared by the National Institute of Standards and Technology and the AI Safety Institute, the guidance includes the initial public draft of its guidelines on “Managing Misuse Risk for Dual-Use Foundation Models.” Dual-use refers to models that can be used for good or ill. The release also includes an open-source software test called Dioptra. Apple is the latest to join the government’s voluntary commitments to responsible AI innovation. Continue reading Apple Joins the Safe AI Initiative as NIST Amps Up Outreach

Airtable, a 10-year-old firm focused on customized apps, is launching Cobuilder, which uses AI to turn a concept into a customizable application “in seconds,” without the need for human coding. The debut adds to a rapidly expanding field of no-code platforms that help non-technical types develop software suitable for enterprise use. “Within the next five years, teams will build the vast majority of applications in-house, customizing them to transform their most critical workflows,” predicts Airtable co-founder and CEO Howie Liu. “To get there, knowledge workers who are closest to the work need to be empowered to build.” Continue reading Airtable Enters No-Code Enterprise App Space with Cobuilder

After five months of testing, e-commerce giant Amazon is releasing its AI-powered shopping assistant, Rufus, on mobile throughout the U.S. via the Amazon Shopping app. By tapping the icon, shoppers can access a chat interface and query Rufus on topics such as the best portable speakers or summer dresses under $50. In time for this week’s Prime Day event, the new assistant can also provide status updates on orders. Rufus was trained on the Amazon catalog and other Internet content, so it can provide information on a wide variety of topics and reportedly also answer questions about politics and write short stories. Continue reading Amazon’s AI Shopping Assistant Rufus Is Ready for Prime Day

Amazon announced the public preview launch of its GenAI-powered App Studio service. The platform — which is geared toward professionals who lack extensive software development skills — builds full-featured, enterprise-level apps using natural language prompts. Users simply describe what they would like the app to accomplish and the data sources available to it and App Studio will produce in minutes what the company claims, “could have taken a professional developer days to build from scratch.” The announcement was made during this week’s AWS Summit in New York City. Continue reading AWS Releases GenAI-Powered App Studio in Public Preview

Apple has approved the Epic Games Store app for iOS and the App Store in the EU. But the battle apparently continues, with Apple couching the move as “temporary,” and Epic founder and CEO Tim Sweeney vowing to fight any reversals. Sweeney says Apple is “demanding we change the buttons in the next version — which would make our store less standard and harder to use. We’ll fight this.” Even a temporary toehold moves Sweeney — whose Maryland-based Epic Games is home to the popular “Fortnite” — closer to its goal of an alt game store on the insular Apple platform at home and abroad. Continue reading Apple Issues ‘Temporary’ Epic Game Store Approval for iOS