Google on October 1 launched Guided Vision in Gemini Live — a real-time, voice-driven visual assistance feature built for people who are blind, have low vision, or want intuitive visual help in daily life. It is available on Android devices running Android 9 and above, in regions and languages where Gemini Live is supported.

The idea is simple but genuinely useful: share your camera during a Gemini Live conversation, and Gemini narrates what it sees while talking you through framing the shot. If the camera is pointed too high, too close or slightly off to the side, Gemini speaks up — "pan slowly to the right," "tilt downward," "step back" — until it has the visual context it needs to answer. Then you can ask follow-up questions, like having it read an expiration date after it spots the label, or decipher dials on a washing machine in low light.

What makes this one stand out is how it was built. Google developed Guided Vision alongside the blind and low-vision community, partnering with visual-interpretation service Aira: tens of thousands of hours of visual interpretation data trained the model, more than 1,000 members of Aira's Trusted Tester network tested it in everyday situations, and Aira specialists helped shape the safety guardrails. Google says the feature was tested in multiple languages and regions, including India, Brazil, Singapore and Japan.

Google is careful about the limits: the feature can make mistakes and is not a medical device, a mobility aid, a substitute for safe-travel guides, or a tool for navigation or obstacle detection. It arrives a year after Apple introduced similar Live Recognition capabilities on iPhone and Vision Pro — Google's answer leans on natural back-and-forth conversation rather than screen-reader integration.

Sources