Disney Research Studios has created an AI tool that can make actors look older or younger more simply than the costly and time-consuming visual effects that are the current status quo. While artificial intelligence had been used to age or de-age people with relative success in still frames, the results lacked photorealism when applied to video. Disney calls its app FRAN, for Face Re-Aging Network. FRAN has been trained to identify the parts of a face that change with age and can either accentuate or erase the telltale signs. Continue reading Disney Invents High-Quality Tool to Rejuvenate or Age Actors

Nvidia Research is introducing a new AI model that largely automates the process of creating virtual worlds, making it easier for developers to populate games and VR experiences with a diverse array of 3D buildings, vehicles, characters and more. Trained using only 2D images, GET3D generates 3D shapes with high-fidelity textures and complex geometric details. GET3D can generate “a virtually unlimited number of 3D shapes based on the data it’s trained on,” according to Nvidia, which says the objects can be used in 3D representations of buildings or the great outdoors, in games or the metaverse. Continue reading Nvidia Debuts New AI Model That Quickly Generates Objects

A new technique for machine learning that allows computers to use algorithms that turn 2D images into 3D is stirring a lot of excitement in the worlds of games, computer graphics and AI. The approach relies on “neural rendering,” which uses a neural network to generate 3D imagery from multiple 2D snapshots. A merger of concepts from the worlds of computer graphics and artificial intelligence, neural rendering gained steam in 2020 when researchers at Google and UC Berkeley demonstrated how a neural network could photorealistically capture a scene in 3D after ingesting several 2D snapshots. Continue reading Algorithms Use NeRFs to Instantly Convert 2D Images to 3D

San Francisco-based Unity Technologies, maker of the cross-platform Unity game engine has launched in beta Unity Gaming Services, a turnkey solution to make it easier to develop and maintain cross-platform multiplayer titles. New are tools for monetization, customer acquisition and player engagement. Statistics from a Unity study indicate 71 percent of multiplayer gamers do so from a mobile device, and 61 percent engage from consoles, while 40 percent say they play on both. The survey indicates 56 percent of Americans play multiplayer games, one in five having begun within the past year. Continue reading Unity Platform Offers Turnkey Solution for Multiplayer Games

Transforming 2D objects into 3D ones is a challenge that has defeated numerous artificial intelligence labs, including those at Facebook, Nvidia and startup Threedy.ai. Now, a Microsoft Research team stated it has created the first “scalable” training technique to derive 3D models from 2D data. Their technology can, furthermore, learn to generate better shapes when trained exclusively with 2D images. The Microsoft team took advantage of software that produces images from display data, as featured in industrial renderers. Continue reading Microsoft Develops Scalable 2D-to-3D Conversion Technique

Snap added new features to Lens Studio, its easy-to-use desktop app that lets users create augmented reality lenses. To make it more appealing to creators, from novices to professional 3D modelers, Snap introduced the Landmarker template, which supports 14 new real-world locations; six new facial templates; and an interactive how-to for newbies. Available for free download, Lens Studio runs on Windows 10 and macOS 10.11 or later. Over half a million Lenses have been developed since Lens Studio debuted in late 2017. Continue reading Snapchat Intros New Features for Desktop App Lens Studio

RED, the company known for its 4K Epic and Weapon film/TV cameras, just debuted a smartphone, the RED Hydrogen One, which will be offered by AT&T and Verizon. The Android phone, which has a 5.7-inch display, is, says the company, “the foundation of a future multi-dimensional media system.” The phone can connect to RED’s other cameras via pogo pins and, in the future, to lens mounts and other modules. RED’s first such module will be a DSLR-similar camera sensor. The phone also produces holographic images. Continue reading RED Debuts Android Smartphone That Creates 4D Holograms

Microsoft is pitching its new mixed reality studios in San Francisco and London to developers and producers interested in creating holograms from real life objects. “Microsoft has been using its own studio at its Redmond headquarters to capture Buzz Aldrin, Reggie Watts, Max Frost, and Cirque Du Soleil performances and bring them into virtual reality and augmented reality holograms,” reports The Verge. The new studios will enable content creators to produce holograms for “regular 2D screens, a HoloLens device, or even Microsoft’s new Windows Mixed Reality headsets.” The company “is also expanding its Mixed Reality Academy program to San Francisco,” with workshops for “developing apps and experiences for VR and HoloLens headsets.” Continue reading Microsoft Opens Studios to Produce Mixed Reality Holograms

TheWaveVR, which raised $4 million this year, has offices in Austin and Los Angeles. The company creates VR concerts that marry music and visuals by partnering with musicians. The results, similar to real-world raves, have garnered a lot of buzz for pushing the limits of virtual reality. Its newest virtual world, created in collaboration with producer/DJ TOKiMONSTA (aka Jennifer Lee), features about 50 minutes of the dance/electronica album Lune Rouge, and is TheNextWave’s fifth flagship show. Continue reading TheWaveVR Introduces Another Immersive Concert on Steam

Headed by camera expert Brian Cabral, a team of Facebook engineers unveiled plans for two new orb-shaped cameras to capture 360-degree video. With an eye towards image fidelity, one of the cameras features 24 lenses and the other, less expensive one boasts six. Both feature six axes or “degrees of freedom,” meaning they have a great range of motion for capturing a more complete image. With the new cameras, Facebook aims to outfit professional filmmakers with the ability to capture 2D and 3D 360-degree video. Continue reading Facebook Advances its Plans for New Virtual Reality Cameras

GoPro is the go-to camera for shooting low-cost VR experiences. Two vendors at the NAB Show are showing multi-camera GoPro mounts designed for a variety of VR shooting and display situations. There are different mounts for 2D and 3D capture, for 360 circle vision versus dome versus full spherical capture, and for high-resolution close-ups versus wide vista shots. 360Heros and Freedom360 both offer sealed rigs for underwater shooting down to 30 meters — as well as stitching and other post-production software and support with their mounts. Continue reading NAB 2015: 360Heros and Freedom360 Unveil New GoPro Mounts

At this week’s NAB Show in Las Vegas, Vision III Imaging has an impressive demo of a technology that adds parallax to professional camera images when displayed on normal consumer displays. Through the company’s patented process of rotating an iris inserted behind the lens at 4.3 cycles per second (e.g. parallax induction), they are able to enhance both 2D and 3D images. 2D images take on an almost 3D quality, while 3D images maintain a sense of multiple dimensions even when the viewer tilts his/her head to a full horizontal position. Continue reading NAB 2015: Vision III Imaging Demos Parallax Visualization Tech

Gannett is once again experimenting with ways to approach journalism through virtual reality technology. This time, the company created the “World Championships Skiing Virtual Reality Experience.” Viewers can be transported to Vail, Colorado where they can watch the skiers train and hang out — or even ski down the mountain themselves. The experience features 360-degree footage of the FIS Alpine World Ski Championships and there is a 2D version for people who do not have access to an Oculus Rift. Continue reading Gannett’s Oculus Rift Experiment Covers Skiing Championships

The United States Patent and Trademark Office granted leading aircraft manufacturer Airbus a patent in August for headrests that include helmets attached to a carrier. The headrests will relieve passenger stress by providing entertainment in addition to “sensorial isolation with regard to the external environment.” They will play immersive multimedia content on glasses with display screens that are capable of “holographic projection mode,” according to the patent. Continue reading Virtual Reality Helmet Could Redefine In-Flight Entertainment

Researchers at Carnegie Mellon University have developed a new photo-editing tool that lets users turn and flip objects as if they were in 3D. Photo editors have only been able to manipulate objects in 2D by resizing them or changing their location within the photo. This new software uses a publicly available database of models to recreate objects, even the sides that were not captured by the camera. Researchers found that this software could be used for animations as well. Continue reading Software Allows Photographers to Manipulate Objects in 3D