Magnifying smartphone screen app for visually impaired

Researchers from the Schepens Eye Research Institute of Massachusetts Eye and Ear/Harvard Medical School have developed a smartphone app which helps visually impaired people who experience problems with the loss of context associated with using the zoom feature on their mobile phones.

The app projects a magnified smartphone screen to Google Glass, which people can then navigate by head movements to view a corresponding portion of the magnified screen.

The researchers have shown that the technology can potentially benefit low-vision users, many of whom find the smartphone's built-in zoom feature to be difficult to use due to the loss of context.

"When people with low visual acuity zoom in on their smartphones, they see only a small portion of the screen, and it's difficult for them to navigate around -- they don't know whether the current position is in the center of the screen or in the corner of the screen," said senior author Gang Luo, Ph.D., associate scientist at Schepens Eye Research Institute of Mass. Eye and Ear and an associate professor of ophthalmology at Harvard Medical School.

"This application transfers the image of smartphone screens to Google Glass and allows users to control the portion of the screen they see by moving their heads to scan, which gives them a very good sense of orientation."

People with low vision often have great difficulty reading and discerning fine details. Magnification is considered the most effective method of compensating for visual loss. The researchers developed the head-motion application to address the limitations of conventional smartphone screen zooming, which does not provide sufficient context and can be painstaking to navigate.

In an evaluation of their new technology, the researchers observed two groups of research subjects (one group that used the head-motion Google Glass application and the other using the built-in zoom feature on a smart phone) and measured the time it took for them to complete certain tasks. The researchers showed that the head-based navigation method reduced the average trial time compared to conventional manual scrolling by about 28 percent.

As next steps for the project, the researchers would like to incorporate more gestures on the Google Glass to interact with smartphones. They would also like to study the effectiveness of head-motion based navigation compared to other commonly-used smartphone accessibility features, such as voice-based navigation.

A demonstration of the technology can be viewed here.  

If you are an employer and would like more information on international health insurance plans for employees, please visit:
→ Corporate Group Scheme International Health Insurance

For an individual international health insurance quote, please visit:
→ International health insurance