Google announced on Tuesday that it is adding new capabilities to AI Mode, its experimental feature that allows users to ask complex questions and follow-ups directly within Search. One of the new features, Canvas, helps users build study plans and organize information over multiple sessions in a side panel. For example, if you want to create a study plan for an upcoming test, you can click the new “Create Canvas” button to get started. AI Mode will then assemble the content in the Canvas side panel, and you can refine the output with follow-up prompts until it meets your needs. Soon, users will also be able to upload files like class notes or syllabi to customize their study guides. Canvas will be available in the coming weeks for users enrolled in the AI Mode Labs experiment in the U.S.
Google is also integrating Project Astra capabilities directly into AI Mode through Search Live, which works with Google Lens, the company’s visual search tool. Robby Stein, VP of Product at Google Search, described the feature as having an expert on speed dial who can see what you see and explain concepts in real time while providing helpful web links. To use Search Live, open Lens in the Google app, tap the Live icon, and ask a question while pointing the camera at an object. This allows users to have a back-and-forth conversation with Search in AI Mode using visual context from their camera feed. The feature is rolling out this week on mobile in the U.S. for AI Mode Labs participants.
Additionally, Google announced that users will soon be able to use Lens in AI Mode to ask questions about content on their desktop screens. For example, if you’re looking at a geometry problem and need help understanding a diagram, you can click “Ask Google about this page” from the address bar and select the diagram. You’ll receive an AI Overview with key information in the side panel. Starting this week, users can follow up with more questions in AI Mode by selecting it at the top of Lens search results or clicking the “Dive deeper” button at the bottom of the AI Overview.
Google is also expanding AI Mode’s functionality on desktop. While users could already ask questions about images in the Google app, they can now do the same on desktop. Additionally, Google is adding support for PDF uploads on desktop, allowing users to ask detailed questions about documents. For example, you can upload lecture slides in PDF format and ask follow-up questions to gain a deeper understanding beyond the class materials. Later this year, AI Mode will support additional file types, including Google Drive files.