Adobe unveils the Firefly Video Model preview. Here's how it works

Adobe's new AI model, designed for video professionals, will allow scenes to be shot and post-produced from simple text or image commands

According to a recent survey by Hays Italia, during the first four months of 2024, the demand from companies for professionals specialised in artificial intelligence would almost double and more and more companies are integrating AI systems into their organisations. Furthermore, 20 per cent of employees say they already use generative AI tools and only almost 2 out of 10 companies are against its use because they are unaware of the benefits or fearful of security risks.

And by the way, just yesterday Adobe unveiled a preview of a new generative AI model for video that will complement Adobe's family of AI models for image generation, vector creation and design by making it even richer. Firefly Video Model, that's its name, will support various applications helping video professionals to achieve better results in less time: from automatic clip generation to manipulation of existing videos, or from controlling camera angles and movements to producing animations and effects.

Features include Text-to-Video, which allows users to apply controls, effects or produce images to be added to the timeline via a prompt, Image-to-Video, which allows users to animate a still image or illustration into a moving clip, and Generative Extend, which can be used to extend clips to cover gaps in the footage or smooth transitions: "Firefly Video Model is designed to help the video professional community discover new possibilities, simplify workflows and support their creative vision, building on our core Firefly models for imaging, design and vector creation. We are excited to bring new levels of creative control and efficiency to video editing with Premiere Pro's Generative Extend powered by Firefly," said Ashley Still, senior vice president of the Creative Product Group at Adobe. According to the announcement, the new features will be available later this year at Firefly.Adobe.com while Generative Extend will be integrated directly into Premiere Pro.

Lastly, it is important to specify that the new model is designed to be commercially secure as it is trained to generate only material that Adobe has permission to use and not consumer content.