Google announced on Wednesday that it is adding a music-generation feature to the Gemini app. The company is using DeepMind’s Lyria 3 music-generation model to power this new feature, which is currently in beta.
To use it, you simply describe the song you want to create. The app will then generate a track along with lyrics. For example, you could ask Gemini to create a comical R&B slow jam about a sock finding its match, and the app will produce a 30-second track along with cover art.
Google said you can even upload a photo or a video, and the AI-powered tool will create a song to match the mood of that media file.
The company stated that Lyria 3 improves on previous models, creating more realistic and complex music tracks. Users can also change and control elements like style, vocals, and tempo.
Along with rolling out Lyria 3 to the Gemini app, Google is making the model available to YouTube creators through the Dream Track feature on YouTube. This tool helps creators make AI-generated tracks. The option was previously only available to YouTube creators in the U.S., but with this release, Google is expanding Dream Track availability globally.
Google clarified that you cannot mimic an artist outright. However, if you add an artist’s name to your prompt, Gemini will create a track in a similar style or mood. The company designed music generation for original expression, not for mimicking existing artists, and has filters in place to check outputs against existing content.
Google noted that all songs created with the Lyria 3 model will have a SynthID watermark to identify AI-generated content. The company is also adding capabilities to identify AI-generated music with SynthID within Gemini. Users will be able to upload tracks and ask Gemini if they are AI-generated.
Music generation is rolling out to all users aged 18 and over worldwide, with support for English, German, Spanish, French, Hindi, Japanese, Korean, and Portuguese.
AI-generated music has created mixed sentiments among artists and listeners. On one hand, companies like YouTube and Spotify are adopting AI and signing contracts with music labels to monetize AI-generated music. On the other hand, AI companies are facing lawsuits from the music industry over the copyright of training material. Some platforms have published tools to mark AI-generated music in an effort to curb fraudulent streams.