At its I/O 2025 event, Google introduced an exciting innovation — the Gemini AI model can now analyze the user's screen within the Chrome browser. This feature is currently available only to users in the United States who are subscribed to AI Pro and AI Ultra plans.
The feature can be activated by clicking the newly added Gemini icon in the browser or using the keyboard shortcut Alt+G. Users can interact with Gemini either through text chat or by switching to voice mode using the “Live” button. Gemini analyzes the content of the current tab and provides summaries, answers questions, or explains the material on the page.
The tech media outlet The Verge tested the feature and reported that Gemini is capable of successfully reading and interpreting various sections of websites — including articles, comments, headlines, and product descriptions. It is especially helpful when explaining recipes from YouTube videos or identifying tools used in technical tutorials.
However, there are certain limitations. For instance, Gemini can only access one tab at a time. If the user navigates to another website, the new page must be shown again for analysis. Additionally, the responses can sometimes be too long to comfortably fit in the browser's pop-up window. In some cases, Gemini struggles to accurately interpret video content, especially if there are no timestamps or if the context is unclear.
This functionality was first introduced in December 2024 on the AI Studio platform. Now, by being rolled out to a wider audience, it marks another step forward in integrating artificial intelligence into everyday web use.
