Adobe plans to add generative AI capabilities to its Premiere Pro editing platform and is exploring the update with third-party AI technologies including OpenAI’s Sora, as well as models from Runway and Pika Labs, making it easier “to draw on the strengths of different models” within everyday workflows, according to Adobe. Editors will gain the ability to generate and add objects into scenes or shots, remove unwanted elements with a click, and even extend frames and footage length. The company is also developing a video model for its own Firefly AI for video and audio work in Premiere Pro.

The integration of AI plug-ins for third-party generative AI video models, if “taken up by nearly any portion of Adobe’s 33 million Creative Cloud paying subscribers” could potentially “usher in the most sweeping and revolutionary changes to the computerized video production process yet,” writes VentureBeat, explaining Premiere Pro users will “be able to edit and work with live-action video captured on traditional cameras alongside and intermixed with AI footage.”

“Adobe is reimagining every step of video creation and production workflow to give creators new power and flexibility to realize their vision,” Adobe SVP Creative Product Group Ashley Still said in the announcement. “By bringing generative AI innovations deep into core Premiere Pro workflows, we are solving real pain points that video editors experience every day, while giving them more space to focus on their craft.”

AI-powered audio editing is now generally available in Premiere Pro, including new fade handles, clip badges, dynamic waveforms and AI-based category tagging.

The Premiere Pro AI visual enhancements are “coming this year,” Adobe explains in a product post that demonstrates how “you’ll be able to seamlessly add frames and make clips longer as well as add or remove objects in the background of a shot.”

The new video model in development will join the family of Firefly models for Image, Vector, Design and Text Effects. Meanwhile, “Adobe is continuing to develop Firefly AI models in the categories where it has deep domain expertise, such as imaging, video, audio, and 3D and will deeply integrate these models across Creative Cloud and Adobe Express,” according to the announcement.

Tom’s Guide notes that the generative features to be added within Premiere Pro, which were showcased at NAB 2024, are “currently only available internally for testing” at Adobe, discussing how the company is expanding capabilities with AI rather than positioning it as a replacement for editors or other creative workers.

Related:
Adobe Photoshop’s Latest Beta Makes AI-Generated Images from Simple Text Prompts, Engadget, 4/23/24
Adobe Shows How OpenAI’s Sora Will Change Premiere Pro and Video Editing Forever, TechRadar, 4/16/24