5 ways Premiere Pro’s new Firefly AI tools could change your editing workflow
Adobe Firefly Video Model coming to Premiere Pro
When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
We were promised more AI video updates atAdobeSummit 2024 - and here’s the first. Adobe has offered a sneak peak at generative AI video tools coming toPremiere Pro.
Powered byAdobe Firefly, the new AI tools are set to give professional video editors new ways to add post-production polish. Early comments appear broadly positive, likening the tools to a VFX powerhouse After Effects - but we’ll have to wait until May to see how that comparison holds up.
We took a look at what’s new from Adobe and how the new non-destructive Firefly AI tools could change the way you edit videos.
1. Creating extra footage out of thin air
A useful tool for when the narrative needs that extra beat, Generative Extend is the definition of ‘fix it in post’. The AI here adds additional frames to clips, giving editors more to play with. According to Adobe, the “breakthrough technology creates extra media for fine-tuning edits, to hold on a shot for an extra beat or to better cover a transition.”
2. Adding and removing objects
A familiar set of tools for genAI users, Object Addition and Object Removal are making their debut on Premiere Pro. In Adobe’s preview video, we’re shown a case of diamonds. As with any AI art generator, by selecting an area of the frame and writing a text-to-video prompt, users will be able to add to the scene. In this case, more diamonds. Other uses highlighted are adding or removing unwanted props, set dressing, brand logos, and crew, which may lead to a dangerous drop in IMDb-listed goofs.
3. Third-party support
This is an intriguing proposition for any video pro currently using otherAI tools. Adobe Firefly’s Premiere Pro will let users use models from third-party sources, including Pika, Runway, and Sora fromOpenAIto find the best shot for the project. These last two examples will use text-prompts directly inside Premiere Pro, creating variations that can be added straight to the timeline. Adobe are calling these ‘explorations,’ and since Sora itself is still very much in beta, expect this one to develop over time.
4. VFX workflows
As soon as Adobe revealed the tools, the inevitable comparisons toAfter Effectscame tumbling in. From what we’ve seen, there’s no denying the tools are effectively light visual effects tools. Ok, it doesn’t quite look like analternative to After Effectsjust yet. But the tools add an extra level of VFX, letting users tidy up footage without jumping between software.
Are you a pro? Subscribe to our newsletter
Sign up to the TechRadar Pro newsletter to get all the top news, opinion, features and guidance your business needs to succeed!
5. Audio workflows are changing too
Alongside the headline-grabbing video tools, the company is introducing a handful of generative AI audio tools - also set for a May release. Expect interactive fade handles, automatic AI tagging to categorize music, ambience, sound effects, or dialogue, and redesigned waveforms that should make it quicker to ‘read’ the project.
Bonus: Content credentials
Alright, it might not radically alter anyone’s workflow, but since Firefly’s introduction, Adobe has been championing more transparency around AI usage media. With Content Credentials, users can see if AI was used, and which training model, in the creation of the footage.
“Adobe is reimagining every step of video creation and production workflow to give creators new power and flexibility to realize their vision. By bringing generative AI innovations deep into core Premiere Pro workflows, we are solving real pain points that video editors experience every day, while giving them more space to focus on their craft,” said said Ashley Still, Senior Vice President, Creative Product Group at Adobe.
Look out for the new tools coming to thevideo editing softwarein May.
Read more from TechRadar Pro
Steve is TechRadar Pro’s B2B Editor for Creative & Hardware. He began in tech journalism reviewing photo editors and video editing software at the magazine Web User, where he also covered technology news, features, and how-to guides. Today, he and his team of reviewers test out a range of creative software, hardware, and office furniture. Once upon a time, he wrote TV commercials and movie trailers. Relentless champion of the Oxford comma.
Outlook users warned not to open more than 60 emails — otherwise their software will crash
Best secure file transfer solution of 2024
Watch out, Nvidia - new benchmarks suggest Apple M4 Ultra could beat the mighty RTX 4090
