Adobe is keeping a tight lid on its plans to enter the AI video generation market with a new model, set to launch later this year as part of its Firefly series. Like many other companies in the emerging generative AI video space, Adobe’s model will allow users to create footage from prompts or reference images, and will power new features in its flagship video editing software, Premiere Pro, including object addition, object removal, and generative extend.
Object addition enables users to insert objects within a specified segment of a video clip, while object removal allows for the removal of unwanted objects like boom mics or coffee cups in the background. The generative extend feature adds extra frames to the beginning or end of a clip, helping to sync visuals with sound or evoke a stronger emotional response.
These tools are not only innovative, but also responsive to growing concerns around deepfakes, as Adobe plans to add Content Credentials to its AI-generated media to provide metadata and credit for the usage of its models. As for the training data behind the model, Adobe declines to disclose its sources or compensation policies for content contributors.
- It has been reported that Adobe is paying photographers and artists on its stock media platform, Adobe Stock, for short video clips to train their AI model, with higher-quality footage commanding higher rates.
- This approach stands in stark contrast to the methods of other AI video competitors such as OpenAI, who are accused of scraping publicly available web data without proper credit or payment.
In order to mitigate these concerns and differentiate itself as a responsible and trustworthy vendor, Adobe has implemented an IP indemnity policy and will follow a generative credits system for its AI video features. Customers with a paid subscription to Adobe Creative Cloud will receive a set number of credits each month, with additional credits needed for more complex tasks.
The big question remains: will Adobe’s AI-powered video features be worth the cost? Previous models in the Firefly series have been underwhelming and flawed, leading to doubts about the effectiveness and reliability of their upcoming video model. Adobe declined to provide live demos of their new features and plans to collaborate with third-party vendors, including OpenAI, in future developments. It has also been noted that discussions are already underway with other potential partners, such as Pika and Runway.
Despite these partnerships, Adobe’s current video generation concepts fail to impress and come predominantly in the form of ideas and concepts rather than concrete products. As Sora, OpenAI’s DALL-E 3, and other innovations continue to shape the market, Adobe has much to prove in order to retain its competitive edge and capitalize on this emerging technology.
