Adobe is set to launch a powerful generative AI-powered video creation and editing tool later this year, marking its next big step into the AI space. The tool, Adobe Firefly Video Model, will be released in beta and join the company’s existing Firefly suite, which already includes AI-powered image and design applications. This new tool aims to revolutionise video creation, catering to creative professionals by offering more intuitive and dynamic AI-driven solutions.
The Adobe Firefly Video Model will allow users to generate video clips from simple text and image prompts. Unlike traditional editing tools, this model can generate a five-second video based on a single input, transforming the video creation process. Users can also specify camera angles, panning, motion, and zoom, offering more control over the creative process.
Alexandru Costin, Adobe’s Vice President of Generative AI, noted that significant investment has gone into making the tool meet the high-quality standards that videographers expect. “We’ve made sure to respect guidance from videographers much better than other AI video models,” Costin said in an interview.
As the market for AI-based video tools grows, Adobe will join other major players like OpenAI’s Sora and Stability AI’s Stable Video Diffusion. These AI video generation apps from smaller startups have gained traction. Still, Adobe’s entry into the field with the Firefly Video Model stands out for its potential to deliver superior quality and prompt understanding.
Adobe’s video model has been trained on public domain or licensed content to avoid copyright issues, including Adobe Stock’s database of 400 million images, illustrations, and videos. Adobe has ensured that no customer content is used for training the AI, focusing instead on materials that do not contain intellectual property, trademarks, or recognizable characters.
In addition to Firefly Video, Adobe is also rolling out Generative Extend, a tool for its Premiere Pro software that can extend video clips by generating inserts to fill gaps. This innovative feature has already received a positive response from early previews.
Adobe’s launch of its Firefly Video Model later this year is expected to shake up the video creation landscape by providing cutting-edge AI tools that prioritise quality and user control. As AI continues to shape the future of creative content, Adobe’s venture into AI video tools solidifies its position as a leader in the innovative software space.
