AI Case Study

Google Lookout audibly describes environments in real-time for the visually impaired

Google has launched a new app for users with Pixel devices. It is intended to help the visually impaired by audibly describing the environment captured by the camera on the device. The app is currently only available in the United States and in English.

Industry

Technology

Software And It Services

Project Overview

"Lookout is an Android app that uses computer vision to assist people who are blind or have low vision in gaining information about their surroundings. Lookout uses the camera and sensors on your device to recognize objects and text, and then gives you spoken feedback, earcons, and other signals to inform you about what it sees. Lookout doesn't speak everything in your view, but looks for important things that you might care about.

Lookout is designed for extended use (1–2 hours or more) on a Pixel device. With the camera facing outward, the device can hang from a lanyard around your neck, sit in a shirt pocket, or be held in your hand. You can change the detail level in Lookout if you'd like to hear more or less information about each item."

Reported Results

As the app has just been launched, results are not yet available.

Technology

Details undisclosed

Function

R And D

Product Development

Background

Google has launched a new app called Lookout for Pixel devices in the United States.

Benefits

Data

Images taken from a Pixel camera in real-time.