Microsoft has added the Mesh mixed reality platform to its Teams remote collaboration app, making 3D and VR meetings now generally available to desktop Windows users and those with Meta Quest headsets. The immersive 3D meeting environments feature spatial audio as well as “live reactions” and the other standard Mesh features will be available to those with Microsoft Teams business accounts. Custom immersive spaces are also available to those with Teams Premium licenses. Microsoft says “hundreds of millions” of people worldwide are currently using Teams, although Mesh for Teams has only been in public preview since late 2022. Continue reading Microsoft Adds Mesh to Enable 3D and VR Meetings in Teams

As part of what it calls “production microservices,” Nvidia is adding an Avatar Cloud Engine (ACE) that lets game developers, as well as those who make tools and middleware, to integrate generative AI models into the digital avatars created for games and applications. The new ACE microservices “let developers build interactive avatars using AI models such as Nvidia Omniverse Audio2Face (A2F), which creates expressive facial animations from audio sources, and Nvidia Riva automatic speech recognition (ASR), for building customizable multilingual speech and translation applications using generative AI,” Nvidia says. Continue reading CES: Nvidia Avatar Cloud Engine Uses AI for Digital Characters

While technology for immersive visual content has (for now) settled on stereoscopic headsets with two little high-resolution screens behind two little lenses, at CES in Las Vegas this week four different developers presented four different approaches to realistic haptic feedback for arms and hands. Buzzing, squeezing and zapping are all on offer, with fundamentally different business and technology models. New haptic products from companies such as Afference, bHaptics, Valkyrie Industries and Microtube Technologies suggest we may be slowly getting closer to more physically-engaging immersive experiences. Continue reading CES: Haptic Technology Makes Slow Strides for CE Products

Unity has officially released its Muse AI platform for general use in early access. Muse is a suite of AI-powered tools that streamline game development. The Muse package includes Muse Chat to source answers and generate code, Muse Sprite for 2D sprites generation, and Muse Texture, providing 2D and 3D ready textures. Originally announced in July, Muse is now offered at a $30 per month subscription. Also announced at the firm’s annual Unite conference was the next major software update, Unity 6, for 2024, and the deployment of Unity Cloud to connect development tools across projects and pipelines. Continue reading Unity Opens Beta for Muse AI, Sets General Release for 2024

Epic Online Services, the development hub for Epic Games, has expanded its crossplay overlay initiative to include initial support for games on Microsoft Xbox, Nintendo Switch and Sony PlayStation, optimizing its free SDKs for multiplayer crossplay and making it easier for developers to link their games and communities for those platforms across multiple stores. Last summer, EOS launched a PC crossplay overlay. The current upgrade enhances “capabilities across all supported platforms,” the company says, noting “crossplay enables bigger games, bigger audiences” and global games industry growth by connecting more players with a single overlay. Continue reading Epic Offers Crossplay Support for Xbox, PlayStation, Switch

Films shot using the 3D world-building tool Mona will compete in what is being billed as “the world’s first metaverse short film festival.” Running September 26-29, the Mona Shorts Fest will take place in the immersive environment app that CEO Justin Melillo has coined “the Monaverse.” “With an entire film studio at your fingertips through Mona’s SDK and in-world experience, imagine what story you could tell,” the festival’s website suggests. Last summer, the company announced more than $14 million in Series A funds after “thousands of creators” used the platform to build experiences for Web3. Continue reading Films Shot ‘In-World’ at Mona Get Their Own Shorts Festival

Led by Pixar Animation Studios, a consortium of tech companies has formed the Alliance for OpenUSD to promote an open 3D computer graphics standard for the metaverse and other 3D projects. Adobe, Apple, Autodesk and Nvidia are also founding members along with the Linux Foundation’s Joint Development Foundation. The group will promote the development and standardization of Pixar’s Universal Scene Description tech, a 3D platform that is interoperable across a variety of tools, data and workflows. The goal is to make it easier to describe, compose and simulate large-scale 3D imaging projects and services across industries and platforms worldwide. Continue reading Tech Firms Join Pixar in Group Promoting OpenUSD Standard

Sony Electronics is launching its Mocopi mobile motion capture system in the United States. Using a dedicated smartphone app for iOS and Android, the wireless system enables full-body motion tracking, captured by six small, lightweight sensors. Sony has been marketing Mocopi in Japan where virtual streamers (also called “VTubers”) have been using the system to drive avatars and fictional animated characters. Mocopi allows users to go mobile with virtual reality, loosening time and location constraints. Sony is now taking preorders for the $499 Mocopi system, which ships July 14. Continue reading Sony Offers Affordable Phone-Based MoCap System in U.S.

Apple’s $3,499 Vision Pro headset will begin shipping in early 2024, CEO Tim Cook announced Monday at WWDC, calling it a device for “spatial computing.” The company’s new visionOS operating system is described as a mashup of iOS, macOS and tvOS, designed for “an entirely new universe of apps for Vision Pro,” according to Apple. Unity was revealed as the principal development engine for Vision Pro content. The upcoming headset, powered by Apple’s high-end M2 chip, supports 4K resolution and features embedded audio pods. The company emphasized gaming and streaming services, in addition to productivity and communication. Continue reading WWDC: Apple Unveils Its ‘Vision Pro’ Mixed Reality Headset

Auto-GPT, an open source app that uses OpenAI’s text-generating models, is currently generating a great deal of social media attention. The program can act somewhat autonomously in that it creates its own feedback loop, asking itself a series of questions to help build a more nuanced and complete response to a text prompt. In short, something that would take a user multiple prompts to produce the desired information using ChatGPT could be accomplished using a single request of Auto-GPT, which could independently explore a subject before spitting back a comprehensive response. Continue reading Auto-GPT Generates Social Sizzle, Ushers in Era of AI Agents

Generative AI is expected to play a big role in video game production, increasing development speed, reducing costs, and helping to come up with new ways for players to interact with characters. Major firms including Epic Games, Unity, Ubisoft and Roblox have all announced generative AI integrations for their development kits. Nonplayable characters — foils that act and speak independently — are soon to be wholly AI-powered rather than preprogrammed options. Publicly available AI tools are already commonly used by players creating user-generated game content. However, use of AI to create commercial games is not without controversy. Continue reading Use of AI to Build Video Games is Popular, But Controversial

The industry is buzzing about a new Sony product called Mocopi that offers motion capture priced for consumers. The Meta Quest-compatible Mocopi utilizes six tracking bands to be worn on the head, back, hands and feet. Priced at 49,500 yen (or about $358), Sony announced Mocopi on its Japanese YouTube channel, with a U.S. release expected toward the end of January 2023. Touted as a way to operate avatars in the metaverse or make videos, Mocopi will have an SDK that can import motion data into 3D animations. Continue reading Sony Targets the Metaverse with Consumer Motion Capture

Meta Platforms unveiled its anticipated mixed reality headset yesterday at Meta Connect. The $1,500 Quest Pro, which CEO Mark Zuckerberg introduced as “the first in our new line of advanced headsets,” becomes the first full-color AR/VR device to hit the U.S. market on October 25. Although Meta is positioning the Quest Pro as a productivity device, the thrust was that app makers will be encouraged to develop for it. Meta also announced that NBCUniversal content and Microsoft Office, Windows, Teams and Xbox Cloud Gaming are coming to Meta Quest headsets. Continue reading AR/VR Meta Quest Pro Targets Productivity Sector for $1,500

Virtual character developer platform Inworld AI has raised $50 million in a Series A funding round led by Section 32 and Intel Capital. The Mountain View-based startup — one of six companies chosen to participate in the 2022 Disney Accelerator — will create virtual characters for games, the metaverse and other entertainment and marketing applications. Because it is focused on providing an interior life, or “mind,” Inworld AI is platform agnostic, with APIs that work across Unity, Unreal Engine, Omniverse and others. Another convenient feature: it lets developers build characters by describing them in natural language. Continue reading Inworld Raises $50M to Create AI-Powered Virtual Characters

Amazon is introducing a voice-activated gaming feature called Alexa Game Control that lets players dictate the action. The February 2023 release “Dead Island 2” will be the first game to incorporate Alexa Game Control. Currently in private beta, the new feature will initially roll out to a wider audience only in North America. Players who want to use the technology will need either a free Amazon account or Amazon Prime. With that in place, one can activate Game Control using push-to-talk or with a hands-free Voice Activity feature that automatically detects speech. Continue reading Amazon Schedules Rollout of Alexa Voice Control for Gamers