Earlier this month, Lightricks announced that the mobile app company had rolled out a series of video-to-video generative AI functionalities via the Videoleap app. The recently released “AI Effects” feature, along with a series of video templates that leverage the feature, represent a significant leap forward for users as the ways to create content continue to evolve.
Lightricks is the developer behind many of the most popular visual content creation tools for mobile, such as Photoleap and Facetune, having seen over 680 million app downloads worldwide. In August 2022, they added generative “text-to-image” AI functionality to Photoleap and saw remarkable results with an average of more than 100,000 downloads a week since.
Releasing new generative AI features on Photoleap’s android app earlier this spring, Lightricks VP Brett Welch spoke about dramatic implications for the evolution of the creator economy. “We are witnessing the dawn of an unprecedented era of creativity,” he said. “Today, AI is empowering everyone to visualize and share the contents of their imagination.”
As recently as June 2023, Photoleap was ranked #3 in Google Play and #5 in the Apple App Store for relevant categories.
With this level of success, it should come as no surprise that they’ve also integrated text-to-image AI into Videoleap. Video, after all, is the logical next step in the evolution of generative AI. Now Lightricks has taken its innovative AI implementations to the next level with “video-to-video” functionality.
How Video AI Effects Work
The new feature allows users to record or upload a clip of up to 10 seconds and then apply specialized AI art styles to it. This can be done through using a preset style, a user-inputted prompt or by adding an image to reflect the vibe desired.
Videoleap also supports user-driven libraries for templates, which allow people to quickly turn their video assets into fully edited clips, with music, transitions, titles and other elements pre-programmed. These templates now also include several options that use the video-to-video AI.
In a world’s first for a mobile app, Videoleap allows AI video processing directly on device, which makes it possible to render clips in approximately 30 seconds. Other tools which use video-to-video AI take almost 20 times as long for comparable results, because they apply the AI effects in the cloud instead of on the device.
However, in the continuum of AI use cases in the Lightricks product line, this is hardly the final product. CEO and Founder Zeev Farbman is transparent about this, saying in a statement that “This is just the beginning for our AI generated video technology, and further advancements are coming. Our current focus is to perfect the art of video styling and powerful edits.”
Booming Visual AI Capabilities
Innovation is expected to continue throughout the tech ecosystem, due to the competitive nature of the space and the potential massive rewards for those who succeed. In a survey of 1000 creators by Lightricks and YouGov, it was found that 86% of existing creators are likely to use AI tools if it positively impacts their creativity.
The implications on creators’ ability to earn are likewise intriguing. The Lightricks-YouGov survey found that 56% of creators who collaborate with have received requests from their patrons for AI-generated content, which may come as a surprise to those who are skeptical about AI’s ability to generate content that is “authentic.”
This level of demand is clearly informing the current AI video arms race.
Runway launched its video-to-video generative AI app in April after having built a solid reputation through their web-based video editor. Runway’s software has previously been used in TV and film extensively. For instance, the Oscar-winning Everything Everywhere All at Once used Runway to create the effects in some of the surreal alternate reality multiverse scenes.
Currently, their app allows more free video options than Lightricks, but it has a cap on five seconds per video.
Picsart, on the other hand, allows video-to-video generative AI of up to three seconds, as part of that company’s suite of creator tools. Whereas Runway and Lightricks are aimed toward a more professional creator and creative audience, Picsart is more accessible for those on a budget but lacks many of the features an advanced user would need.
What’s on the Horizon
The challenge all three face is the extensive use of server-side resources needed to generate AI video content. Currently, this almost always happens in the cloud, and users have no choice but to wait until their creation is ready. Lightricks appear to be ahead of the curve with this aspect, but they will also be keen to dramatically reduce waiting times.
End users are increasingly accustomed to instant gratification, and as of yet, video-to-video generative AI cannot offer that.
However, it was not too long ago that the capabilities of Chat-GPT4 were considered science fiction. In today’s AI world, it would not be wise to bet against further rapid improvement in the video-to-video space. Lightricks, Runway and Picsart will all know their competitors are working hard to gain an edge, and this should mean the consumer wins.
Top of the month
News2 months ago
How to Recover Deleted WhatsApp Messages without Backup (iOS/Android)
News2 months ago
How to Unlock iPhone if Forgot Passcode without Restore
News2 months ago
How to Restore Deleted Data from Android Phones without Backup
Resources2 months ago
TOP 154 Niche Sites to Submit a Guest Post for Free in 2024