‘The Mandalorian’ Uses Epic’s Unreal Engine for Production

“The Mandalorian,” one of the original exclusive shows on Disney+, follows a mysterious bounty hunter who takes on secretive jobs after the fall of the Empire. Recent data reveals that the show was the third most “in demand” digital original show since its debut. Epic Games is listed in the show’s end credits because series creator Jon Favreau used it in his production process. Epic Games’ Unreal Engine is a popular platform for creating games, such as “Fortnite,” but it’s now being used in more Hollywood productions. Continue reading ‘The Mandalorian’ Uses Epic’s Unreal Engine for Production

Disney, Rutgers Scientists Use AI to Generate Storyboards

Disney Research and Rutgers University scientists just created an end-to-end model using artificial intelligence to produce a storyboard and video featuring text from movie screenplays. This kind of text-to-animation model is not new, but this research advances the state-of-the-art by producing animations without annotated data or pre-training. The researchers wrote that the system is “capable of handling complex sentences” and is intended to make creatives’ work “more efficient and less tedious.” Continue reading Disney, Rutgers Scientists Use AI to Generate Storyboards

HPA Tech Retreat: Drones, Photogrammetry as Useful Tools

Singularity Imaging founder/chief executive Eric Pohl discussed how drones and photogrammetry methods can be used to extract 3D information and create large point-cloud scenes. Uses include previsualization for production, content for set extensions, VR/AR and gaming applications. Pohl noted that, at last year’s HPA Tech Retreat, a presentation showed how the Unity game engine could be used to map and plan a production. “Mapping and remote sensing are quite mature, but drones bring something new to it,” he noted. Continue reading HPA Tech Retreat: Drones, Photogrammetry as Useful Tools

NAB 2018: Artificial Intelligence Tools for Animation and VFX

Tools powered by artificial intelligence and machine learning can also be used in animation and visual effects. Nvidia senior solutions architect Rick Grandy noted that the benefit of such tools is that artists don’t have to replicate their own work. That includes deep learning used for realistic character motion created in real-time via game engines and AI, as well as a phase-functioned neural network for character control, whereby the network can be trained by motion capture or animation. Continue reading NAB 2018: Artificial Intelligence Tools for Animation and VFX

SIGGRAPH 2015: Virtual Production, Cousin of Virtual Reality

At SIGGRAPH 2015, Autodesk executives David Morin and Ben Guthrie described virtual production, its relationship with virtual reality and some newly released tools from their company to aid in the process. Virtual production began with Peter Jackson’s “Lord of the Rings,” got a bump of recognition with “Avatar,” and has been used on many films since. According to Morin and Guthrie, the process, which lets filmmakers create virtual worlds in-camera and composite CG and live action on set, is achieving momentum. Continue reading SIGGRAPH 2015: Virtual Production, Cousin of Virtual Reality

SIGGRAPH: Faceware Unveils Live Capture for Gaming Engine

At SIGGRAPH 2015 in Los Angeles, Faceware Technologies, which creates markerless 3D facial motion capture solutions, demonstrated its Faceware Live plugin for Epic Games’ Unreal Engine 4. With the plugin, developers for the UE4 will be able to capture facial movements with any video source and apply them immediately to digital characters. The Unreal Persona animation system displays the facial animation that takes place in real-time. The plugin was shown behind closed doors at SIGGRAPH. Continue reading SIGGRAPH: Faceware Unveils Live Capture for Gaming Engine

SIGGRAPH 2015: The Road to Producing Virtual Reality Content

At SIGGRAPH 2015, the computer graphics convention held this year in Los Angeles, virtual reality executives encouraged the Hollywood production community to begin to develop more content. Oculus Story Studio, the content creation division of Oculus, which makes the Rift virtual reality headset, recently debuted its second short VR film, “Henry.” Creating content for virtual reality comes with a variety of technical challenges, say the experts, but virtual reality won’t take hold until compelling content is available. Continue reading SIGGRAPH 2015: The Road to Producing Virtual Reality Content