At its Made on YouTube live event on Tuesday, the company unveiled new generative AI tools for creators making Shorts. YouTube is introducing a custom version of Google’s text-to-video generative AI model, Veo 3, to Shorts. This release also includes a new remixing tool, an “Edit with AI” feature, and more.
The custom version of the model, called Veo 3 Fast, generates outputs with lower latency at 480p resolution, making it easy to create video clips. For the first time, users can now generate these clips with sound.
This update is currently rolling out in the United States, the United Kingdom, Canada, Australia, and New Zealand. YouTube has plans to expand its functionality to more regions in the future.
YouTube is also bringing new Veo capabilities to Shorts, including the ability to apply motion from a video to an image. This allows a user to animate a still picture, for example, by making the person in it perform a dance from another video. The company states this is achieved through technology that captures and transfers movement from one subject to another.
Creators can now use Veo to apply different artistic styles to their videos, such as pop art or origami. Additionally, creators have the new ability to add objects like characters or props using simple text descriptions. These new capabilities are scheduled to roll out in the coming months.
A new remixing tool will allow creators to turn dialogue from eligible videos into catchy soundtracks for other Shorts. YouTube’s Director of Product, Shorts and Generative AI Creation, Dina Berrada, explained that this tool lets creators take a funny phrase, a memorable quote, or a unique sound and remix it into a new song.
The feature uses Google’s AI music model Lyria 2 to create the soundtrack. Creators will be able to select the vibe of the song, with options like “chill,” “danceable,” or “fun.” The company plans to test this feature soon and will roll it out to more creators in the United States in the coming weeks.
With the new Edit with AI feature, creators can turn their raw footage into first drafts. The feature works by finding and arranging the best moments from camera roll footage, then adding music and transitions. It can even add a reactive voiceover in either English or Hindi. The goal of this tool is to provide creators with a strong starting point for their Shorts.
YouTube is currently experimenting with Edit with AI on Shorts and in the YouTube Create app. The feature will expand to select markets in the coming weeks.