Google Intros AI-Powered Guided Vision for Enhanced Accessibility
Google has unveiled Guided Vision, a new feature integrated into the Gemini app, designed to assist individuals with low vision and enhance their everyday experiences. The feature is now available through Gemini Live on compatible Android devices, allowing users to receive real-time audio descriptions by directing their phone’s camera at various objects or surroundings.
Accessible Technology with Real-Time Feedback
Guided Vision leverages artificial intelligence to perform a variety of tasks, such as reading fine print, identifying and describing nearby objects, and detailing specific characteristics of items within the camera’s view. This technology is especially beneficial for those who are blind or have impaired vision, similar to Apple’s VoiceOver Live Recognition on iPhone and Vision Pro devices.
The feature operates by supplying audio cues to assist users in aligning their camera correctly if an object is out of frame, enhancing the user’s ability to explore their environment or read difficult-to-see text. Users can also engage with the app by asking follow-up questions, such as querying expiry dates on identified products.
Integrating Guided Vision Across Platforms
In addition to Gemini Live, Guided Vision is accessible through Google TalkBack and can be activated via an accessibility shortcut on devices running Android 9 or higher. This feature was part of the recent updates announced for Pixel devices, demonstrating Google’s commitment to improving accessibility options.
Despite its extensive capabilities, Google advises users to not rely on Guided Vision for critical tasks like navigation or obstacle detection, stressing it is not a substitute for traditional mobility aids such as canes.
Reporting based on coverage first published by theverge.com.