Nikon to Enter Cinema Camera Business with RED Acquisition

Nikon, the Japanese company best known for still cameras, is vaulting into the mainstream of professional moving images with its acquisition of California-based RED Digital Cinema. RED cameras popular among filmmakers and other creators include the RED ONE 4K and V-RAPTOR [X] series. The company also invented the REDCODE RAW compression technology. On closing, RED will become a wholly-owned subsidiary of Nikon, which plans to merge “Nikon’s expertise in product development” with “RED’s knowledge in cinema cameras, including unique image compression technology and color science.” Continue reading Nikon to Enter Cinema Camera Business with RED Acquisition

ETC Releases White Balancing Tutorial for Virtual Production

ETC@USC has posted a tutorial that offers best practices for white balancing during production on a curved wall LED volume stage. Due to the growing number of LED volume and backing wall applications emerging worldwide, many critical color calibration issues have resulted. The informative tutorial — authored by cinematographer Tim Kang from Quasar Science with support from producer Erik Weaver from ETC — provides cinematographers and production teams with a simple graphical guide that breaks down the problems between the camera and its LED wall perception, while specifying different means to implement solutions. The Virtual Production White Balancing Tutorial is now available on the ETC site. Continue reading ETC Releases White Balancing Tutorial for Virtual Production

Lightricks LTX Studio Is a Text-to-Video Filmmaking Platform

Lightricks, the company behind apps including Facetune, Photoleap and Videoleap, has come up with a text-to-video tool called LTX Studio that it is being positioned as a turnkey AI tool for filmmakers and other creators. “From concept to creation,” the new app aims to enable “the transformation of a single idea into a cohesive, AI-generated video.” Currently waitlisted, Lightricks says it will make the web-based tool available to the public for free, at least initially, beginning in April, allowing users to “direct each scene down to specific camera angles with specialized AI.” Continue reading Lightricks LTX Studio Is a Text-to-Video Filmmaking Platform

Pika Taps ElevenLabs Audio App to Add Lip Sync to AI Video

On the heels of ElevenLabs’ demo of a text-to-sound app unveiled using clips generated by OpenAI’s text-to-video artificial intelligence platform Sora, Pika Labs is releasing a feature called Lip Sync that lets its paid subscribers use the ElevenLabs app to add AI-generated voices and dialogue to Pika-generated videos and have the characters’ lips moving in sync with the speech. Pika Lip Sync supports both uploaded audio files and text-to-audio AI, allowing users to type or record dialogue, or use pre-existing sound files, then apply AI to change the voicing style. Continue reading Pika Taps ElevenLabs Audio App to Add Lip Sync to AI Video

OpenAI’s Generative Video Tech Is Described as ‘Eye-Popping’

OpenAI has debuted a generative video model called Sora that could be a game changer. In OpenAI’s demonstration clips, Sora depicts both fantasy and natural scenes with photorealistic intensity that makes the images appear to be photographed. Although Sora is said to be currently limited to one-minute clips, it is only a matter of time until that expands, which suggests the technology could have a significant impact on all aspects of production — from entertainment to advertising to education. Concerned about Sora’s disinformation potential, OpenAI is proceeding cautiously, and initially making it available only to a select group to help it troubleshoot. Continue reading OpenAI’s Generative Video Tech Is Described as ‘Eye-Popping’

Apple’s Keyframer AI Tool Uses LLMs to Prototype Animation

Apple has taken a novel approach to animation with Keyframer, using large language models to add motion to static images through natural language prompts. “The application of LLMs to animation is underexplored,” Apple researchers say in a paper that describes Keyframer as an “animation prototyping tool.” Based on input from animators and engineers, Keyframer lets users refine their work through “a combination of prompting and direct editing,” the paper explains. The LLM can generate CSS animation code. Users can also use natural language to request design variations. Continue reading Apple’s Keyframer AI Tool Uses LLMs to Prototype Animation

CES: Voiseed Upgrades Its Platform for Expressive AI Voices

Milano-based Voiseed demonstrated its web-based Revoiceit platform at CES, pitched as the best way to manage synthetic voice actors, particularly ensuring that synthetic voices present realistic emotions. The company describes it as a cloud-based solution that uses “generative AI to infuse virtual voices with human emotions and prosody, creating highly expressive, lifelike audio experiences.” While Revoiceit’s most obvious feature is its Studio (imagine Adobe Audition devoted to second-by-second management of voices), it may well be the product’s forthcoming API that provides real value to developers of entertaining technology products. Continue reading CES: Voiseed Upgrades Its Platform for Expressive AI Voices

Meta Touts Its Emu Foundational Model for Video and Editing

Having made the leap from image generation to video generation over the course of a few months in 2022, Meta Platforms introduces Emu, its first visual foundational model, along with Emu Video and Emu Edit, positioned as milestones in the trek to AI moviemaking. Emu uses just two diffusion models to generate 512×512 four-second long videos at 16 frames per second, Meta said, comparing that to 2022’s Make-A-Video, which requires a “cascade” of five models. Internal research found Emu video generations were “strongly preferred” over the Make-A-Video model based on quality (96 percent) and prompt fidelity (85 percent). Continue reading Meta Touts Its Emu Foundational Model for Video and Editing

Nielsen: June Marks a New All-Time Record for TV Streaming

Streaming accounted for 37.7 percent of overall U.S. TV usage in June, a record share for the digital format. Cable TV accounted for 30.6 percent and broadcast 20.8 percent, according to Nielsen’s monthly snapshot The Gauge. TV viewing was up 2.2 percent in June, the first monthly increase since January. The uptick was principally attributed to young viewers and the summer break. Notably, TV consumption among the 2-11 and 12-17 age groups was up 16.3 percent and 24.1 percent, respectively, compared with May. Alternative viewing options — including streaming and video gaming — accounted for 90 percent among those groups. Continue reading Nielsen: June Marks a New All-Time Record for TV Streaming

Netflix Shutters Cheapest Streaming Plan Without Advertising

Netflix is marshalling resources around its ad-supported Standard plan, pulling the plug on ad-free Basic in an effort to drive more eyeballs to the service’s sponsored tier. The $9.99 per month Basic plan is no longer available “for new or rejoining members” in the U.S. and UK and was dropped in Canada last month. Existing Basic subs can continue the plan until they decide to change tiers or cancel. Standard with Ads has since its November launch accrued more than 5 million subs, according to Netflix, which says 25 percent of new sign-ups have chosen that package. Continue reading Netflix Shutters Cheapest Streaming Plan Without Advertising

ETC Releases Section 3 of Its Virtual Production White Paper

The Entertainment Technology Center@USC has released the third installment of its case study, “Fathead: Virtual Production & Beyond.” Section 3 of the four-part white paper is “State of the Industry: Beyond Trends,” which discusses “where we’re at, and where we’re going” and features compelling interviews with thought leaders from companies including The Third Floor, Stargate Studios, Orbital Virtual Studios, Vū Technologies, Lux Machina, nDisplay, Epic Games and Unity Technologies. Click here to access Section 3 and we’ll post announcements when the final section — “Fathead: A Proof-of-Concept Short Film” — becomes available. Continue reading ETC Releases Section 3 of Its Virtual Production White Paper

Vimeo Says Its AI Makes Video as Easy to Edit as Word Docs

Vimeo is leveraging artificial intelligence to automate video editing, and says its new AI suite of tools enables the creation of “a fully produced video in minutes by generating scripts from text prompts, recording videos in one take, and editing content as easily as a Word doc,” the company claims. Features include recording using a built-in screen teleprompter and the ability to quickly delete unwanted filler words (“ums” and “uhs”) and long pauses. The video hosting and sharing platform is rolling out the AI tools in July as part of the $20 per month standard subscription. Continue reading Vimeo Says Its AI Makes Video as Easy to Edit as Word Docs

New Tool from Epic Simplifies High-Fidelity Facial Animation

Epic Games is releasing MetaHuman Animator, which lets developers create nuanced facial animation by capturing an actor’s performance using an iPhone or stereo head-mounted camera system and a PC. The system eliminates the need for manual touch-ups, according to Epic, capturing “every subtle expression, look, and emotion” and replicating it onto a digital character for a faster performance capture workflow that allows more creative control. The new feature set uses a 4D solver to combine video and depth data with a MetaHuman representation of the performer. The animation is produced locally using GPU hardware, providing final results in “minutes.” Continue reading New Tool from Epic Simplifies High-Fidelity Facial Animation

Thought Leaders Analyze AI at ETC Synthetic Media Summit

Entertainment and communications leaders explored the impact of artificial intelligence and anticipated the larger changes ahead at the inaugural Synthetic Media Summit, presented by the Entertainment Technology Center at USC in partnership with NAB Amplify, SMPTE and sponsor Wizeline, in conjunction with the USC School of Cinematic Arts and USC Annenberg School for Communication and Journalism. Speakers addressed how new technology will make VFX cheaper and faster for studios, while for indies it will open new frontiers. Teaming AI with tools such as Unreal Engine is expected to level the playing field and launch a new era of virtual production. Continue reading Thought Leaders Analyze AI at ETC Synthetic Media Summit

Runway Makes Next Advance in Consumer Text-to-Video AI

Google-backed AI startup Runway has released Gen-2, an early entry among commercially available text-to-video models. Previously waitlisted in limited release, the commercial availability is impactful, since text-to-video is predicted as the next big bump in artificial intelligence, following the explosion of AI use generating text and images. While Runway’s solution may not be ready to serve as a professional video tool, this is the next step in development of tech expected to impact media and entertainment. Filmmaker Joe Russo recently predicted that within the next two years, AI may have the ability to create feature films. Continue reading Runway Makes Next Advance in Consumer Text-to-Video AI