Google Adds Open-Source Gameface for Android Developers

In a move aimed at launching more accessible Android apps, Google has open-sourced code for Project Gameface, a hands-free game control feature released last year that allows users to move a computer with facial and head gestures. Developers will now have more Gameface resources with which to build Android applications for physically challenged users, “to make every Android device more accessible.” Project Gameface evolved as a collaboration with quadriplegic video game streamer Lance Carr, who has muscular dystrophy. The technology uses a smartphone’s front camera to track movement. Continue reading Google Adds Open-Source Gameface for Android Developers

Apple Developing User-Friendly AR Creation App for Headset

Apple is preparing for the release of its upcoming mixed reality headset by engineering software that, while aimed largely at developers, would also allow users to create their own augmented reality apps in the same way as Final Cut Pro, which is used to edit video by both professionals and laymen. Apple’s highly anticipated headgear is expected to come to market this year, and a general use AR development tool would be a major coup for the company, given that AR apps are complicated to create and new technologies typically rely on fresh content to drive sales. Continue reading Apple Developing User-Friendly AR Creation App for Headset

Reviews Are in for Meta Quest Pro, Quest 3 to Arrive in 2023

The Meta Quest Pro is making its way to reviewers, who say that the pricey $1,500 mixed reality headset from Meta Platforms will be out of reach for most consumers but could be a natural upgrade to business users who want to upgrade from the Quest 2. Offering augmented reality in color and avatars with nuanced facial expressions, the Quest Pro is a productivity tool “ideal for builders, architects, engineers, designers, and others” who want to create or work in immersive environments. For everyone else, a consumer-priced Meta Quest 3 will be arriving in late 2023. Continue reading Reviews Are in for Meta Quest Pro, Quest 3 to Arrive in 2023

Qualcomm Announces Wireless AR Glasses Design for OEMs

Qualcomm has revealed a new plan for AR glasses that can connect wirelessly with smartphones. This latest version of the company’s Smart Viewer is a reference design that can be used by manufacturers to create commercial headsets and is aimed at creating “immersive experiences that unlock the metaverse,” the company says. The new Wireless AR Smart Viewer has a higher-powered chipset and offers Wi-Fi 6/6E and Bluetooth tethering instead of a USB-C cable. Developed by Chinese manufacturing company Goertek, the new Smart Viewer is currently being made available to handful of Qualcomm’s manufacturing partners. Continue reading Qualcomm Announces Wireless AR Glasses Design for OEMs

Google Open-Sources Real-Time Gesture Recognition Tech

Google relied on computer vision and machine learning to research a better way to perceive hand shapes and motions in real-time, for use in gesture control systems, sign language recognition and augmented reality. The result is the ability to infer up to 21 3D points of a hand (or hands) on a mobile phone from a single frame. Google, which demonstrated the technique at the 2019 Conference on Computer Vision and Pattern Recognition, also put the source code and a complete use case scenario on GitHub. Continue reading Google Open-Sources Real-Time Gesture Recognition Tech

Microsoft Closer to Consumer AR, Streaming Games Service

Magic Leap and Apple are the two technology companies currently at the forefront of augmented reality, but, behind the scenes, Microsoft has also been working on AR for years. It’s easy to discount Microsoft, since its HoloLens AR headset is squarely aimed at the enterprise sector. But the company also has its sights set on the consumer market. In addition, Microsoft has started to leak details about its upcoming Project xCloud cloud-based game streaming system. Project xCloud will enter beta testing this year. Continue reading Microsoft Closer to Consumer AR, Streaming Games Service

VR and AR Expected to Further Redefine Experiences at CES

Virtual reality, augmented reality and immersive experiences crossed over the apex of the hype curve and are now tracking the slope of enlightenment as they develop into niche market applications or pivot into location-based entertainment. Resolution, frame rate, horizontal and vertical field of view in the HMDs (head mounted displays), and head and body tracking technology, have all improved over the last year with further advances expected next month at CES 2018 in Las Vegas. This applies equally to next generation HMDs, projection, and heads-up approaches to immersive experiences. Continue reading VR and AR Expected to Further Redefine Experiences at CES

Reviews: With Touch Controller, Oculus Rift Is Now Complete

After months of anticipation, Oculus finally rolled out its Touch controller — years after PlayStation unveiled its Move controllers in 2010, and even after Vive began shipping two motion controllers. But reviewers who’ve gotten their hands on the Touch are giving it a thumbs-up, saying that its addition now “completes” the promise of the Rift VR headset for a sophisticated and satisfying VR experience. Among Touch’s features is that it tracks the positions of the user’s hand in 3D space. Continue reading Reviews: With Touch Controller, Oculus Rift Is Now Complete

Leap Motion Introduces Hand Tracking for Samsung Gear VR

Leap Motion, a company that provides hand tracking for smartphone-based virtual reality headsets, introduced a reference design for its Leap Motion Mobile Platform to work on top of the Samsung Gear VR. Leap Motion relies on two mini-cameras set in a faceplate to detect finger motion. The company began by providing a desktop-mounted, non-VR hand tracker, but segued into smartphone-based VR headsets. Although no manufacturer has yet announced products integrating Leap Motion, a few may do so at CES 2017. Continue reading Leap Motion Introduces Hand Tracking for Samsung Gear VR

Oculus Chief Scientist Predicts the Future of VR Platform Tech

Disavowing popular wisdom that it doesn’t pay to be too specific, Oculus chief scientist Michael Abrash delineated what virtual reality tech will look like in 2021 at the Oculus Connect 3 conference last week. With the caveat that he would be proved “wrong about some of the specifics,” Abrash described a high-end VR future that includes 4K x 4K resolution per eye and 140-degree field of view displays, foveated rendering, personalized audio encoding, and “augmented virtual reality.” Abrash was the final speaker in a keynote session that stretched past two hours. Continue reading Oculus Chief Scientist Predicts the Future of VR Platform Tech

AWE 2016 Addresses Rapidly Evolving VR and AR Ecosystem

This year’s Augmented World Expo (AWE) in Santa Clara was equal parts augmented and virtual reality. Curtis Hickman of The VOID presented some compelling instances in which physical and psychological misdirection are effective tools for the VR experience. Meta CEO Meron Gribetz demonstrated the sub-millimeter hand tracking accuracy of his company’s AR HMD. Jared Finder provided an update on the core tech components of Google’s Project Tango. Baobab Studios CEO Maureen Fan discussed the importance of image composition and story beats in VR. Highlights from the show floor included the latest ODG AR glasses and waveguide AR displays from Epson and Lumus. Continue reading AWE 2016 Addresses Rapidly Evolving VR and AR Ecosystem

Oculus Acquires Nimble VR for its Hand-Tracking Technology

Oculus, the virtual reality company picked up by Facebook in March, has acquired two startups that may bring hand-tracking and better mapping of 3D interiors to the Oculus Rift headset. Nimble VR (formerly 3Gear Systems) is the startup behind Nimble Sense, a camera that connects to the headset and uses Kinect-like technology to track a user’s hands and sync movements to the user’s VR experience. Oculus also bought 13th Lab, a computer vision and augmented reality firm focused on 3D reconstruction. Continue reading Oculus Acquires Nimble VR for its Hand-Tracking Technology