Last month, Adobe showcased Firefly, a generative AI that can create images from text input, and now they have demonstrated how Firefly could be used for video editing.
With Firefly for video editing, users can enter text commands and Firefly can modify all or parts of the video clip based on this. This could involve changing the color composition of the clip, adding sound effects or background music, writing storyboards, and more. Adobe writes about its vision of how Firefly could transform post-production of films:
With Firefly as a creative co-pilot, you can supercharge your discovery and ideation processes and cut post-production time from days to minutes. And with generative AI integrated directly into your workflows, these powerful new capabilities will be right at your fingertips. Imagine the power to instantly change the time of day of a video, automatically annotate and find relevant b-roll, or create limitless variations of clips.
–blog.adobe.com
Firefly is currently available in beta version. Adobe plans to integrate Firefly into some of its programs later this year. In the video above, you can check out some of the things that will become possible to do directly in Adobe’s video editing program once Firefly is in place.