New generative AI video tools in Premiere Pro
As you can see below, Adobe is ready to preview its groundbreaking generative AI innovations within Premiere Pro as they aim to reimagine video creation and production workflows for professional editors. These new generative AI tools coming to Premiere Pro are set to simplify editing for all types of videos by adding and removing objects in a scene or extending existing clips.
Here are the big new AI-powered features coming to Premiere Pro:
- New Generative AI video tools coming to Premiere Pro this year will streamline workflow and unlock new creative possibilities, from extending footage to adding or removing objects in a scene
- Adobe is developing a video model for Firefly, which will empower video and audio editing workflows in Premiere Pro and enable anyone to create and design
- Adobe presents early research in bringing third-party generative AI models from OpenAI, Pika Labs and Runway directly into Premiere Pro, making it easier for users to harness the power of different models within the powerful workflows they use every day
- AI-powered audio workflows in Premiere Pro are now generally available, making audio editing faster, easier and more intuitive
These new workflows will also be powered by a new video model set to join the Adobe Firefly AI family, which Adobe plans to continue to develop for further advancements in imaging, video, audio and 3D as more AI-powered tools are set to arrive.
Premiere Pro OpenAI
Adobe
The future of generative artificial intelligence in Premiere Pro
These new generative AI features coming to Premiere Pro “later this year” are powered by Adobe’s new video model for Firefly. In addition to the new tools above, Adobe also shared some early “sneak peeks” of how video editors might leverage the video generation models from Open AI and Runway in the future to generate B-roll, or how they might use other AI platforms like Pika Labs with the Generative Extend tool to add a few seconds to the end of the frame.
Here are some possible future tools:
- Generative Extension: Seamlessly add frames to make clips longer, making it easier to time edits perfectly and add smooth transitions. This revolutionary technology solves a common problem that professional editors face every day, allowing them to create additional media to fine-tune an edit, hold a frame for extra pacing, or better cover transitions
- Add and remove objects: Easily select and track objects, then replace them. Remove unwanted objects, change the actor’s wardrobe or quickly add decorations such as a painting or photorealistic flowers on the table
- Text to Video: Generate brand new footage directly in Premiere Pro. Simply enter text in the query or upload reference images. These clips can be used to design and develop a script or to create B-roll to augment live action footage
Adobe certainly seems open to expanding AI-powered workflows for video editors not only with its technology, but also with a holistic approach that uses the best of AI at any given time, which should—ideally—help Premiere Pro users always stay on the cutting edge of AI … if that’s what they want to do.
Premiere Pro Firefly’s add object feature
Adobe
AI-powered audio workflows come to Premiere Pro
Adobe also shared some new AI-powered audio tools that should be generally available to Premiere Pro users here in May 2024 that will give editors even more precise control over their audio and the ability to improve audio quality.
Here are the latest AI-powered audio features coming to Premiere Pro:
- Interactive fade handles: Editors can create custom audio transitions faster than ever by simply dragging clip handles to create audio fades
- New Essential Sound badge with audio category tagging: AI automatically tags audio clips as dialogue, music, sound effects or ambient and adds a new icon to give editors one-click instant access to the right controls for the job
- Effects badges: New visual indicators make it easy to see which clips have effects, quickly add new ones, and automatically open effects parameters directly from the sequence.
- Redesigned Timeline Waveforms: Waveforms intelligently resize as track pitch changes across clips, while beautiful new colors make strings easier to read
Adobe also earlier this year already added its AI-powered speech enhancement tool that instantly removes unwanted noise and improves poorly recorded dialogue, and plans to start rolling out these new AI-powered features in May, before adding new features later this year.
For more information on the AI-powered tools and features coming to Premiere Pro, take a look Adobe website here for updates.
Blackmagic Design brings you no film school’s coverage of NAB 2024.
Show less