Adobe integrates generative AI tools in video editing software Premiere Pro | Technology News
Adobe has integrated its own Firefly model, as well as third-party generative AI models into Adobe Premiere Pro. Users can extend clips, remove objects from videos, generate missing b-roll or add new objects in.
Example of AI generated b-roll. (Image Credit: Adobe).
Key Highlights
- The AI tools are designed to work with your existing rushes.
- Generative AI can be used to extend clips that are too short.
- Text prompts can be used to produce B-roll, reducing the reliance on stock sites.
New Delhi: Adobe has announced plans to integrate generative AI tools into its video editing software, Premiere Pro. The generative AI capabilities are integrated to existing workflows, extending the capabilities of the software in a natural and intuitive manner. A new Firefly model for generative video will join the existing lineup of models, Vector, Image, Design and Text Effects.
Apart from its own video model, Adobe is also supporting third party generative video models, with Sora from OpenAI and RunwayML from Runway for generating videos using text prompts. Pika integration allows for extending clips by a few seconds. Adobe has released a video demonstrating the capabilities, as well as the seamless integration of the generative AI tools into the existing interface.
Ashley Still, senior vice president, Creative Product Group at Adobe says “Adobe is reimagining every step of video creation and production workflow to give creators new power and flexibility to realize their vision. By bringing generative AI innovations deep into core Premiere Pro workflows, we are solving real pain points that video editors experience every day, while giving them more space to focus on their craft.”
Instead of going with a single generative video model that outperforms the others in benchmarks, Adobe is envisioning a generative AI future where multiple models have unique strengths. Adobe has indicated that it intends to provide video editors with as much choice as possible, and that is the reasoning behind integrating multiple third party generative AI tools.
AI infused audio workflows
Adobe has also announced plans of releasing AI powered audio workflows next month, with interactive fade handles for crafting custom audio transitions, and an Enhance Speech tool that cleans up background audio and improves poor quality recordings. AI also automatically categorises audio clips as dialogue, music, sound effects or ambience. The waveforms have been redesigned, with an effect badge to indicate which clips have audio effects.
