-  Poor ergonomics : Users felt that the HoloLens 1 headset was heavy and uncomfortable, as well as worsening their sense of air currents and echoes that normally let them sense their surroundings. Several asked for a headband-style device that would not cover their face.
- Unintuitive gaze control: Several of our blind users simply were not used to pointing their head towards areas they wanted more information about, and had to be reminded to do so. This also became a problem for pointing the device towards text to be identified, as combined with the weight of the headset, users often let their head droop towards the ground.
- Low speed of mapping and text recognition: The several second delays in mapping and text processing required a controlled, pre-scanned environment and repeatedly frustrated our users, especially when they failed to identify text on the first scan.


Problems Found in AR Device Application on Blind

- Object Localization: Identify the locations of the three sign poles using audio cues.
- Text Recognition:  Identify signs like "bus stop 52".
- Direct Navigation:   Walk to "bus stop 52."
- Text Recognition and Direct Navigation in Proximity Mode:  Switch to “proximity mode,” which would limit detection range but give the user a better indication of changing distance, then identify and walk to bus stop 80.

University of Illinois at Urbana-Champaign

AR is a technology that augments physical environments on a mobile device screen by overlaying them with digital content. Unlike Virtual Reality(VR) that creates an immersive virtual environment, AR is based on a footprint of a real surrounding and it only adds additional computer-generated data. An AR glass is believed that can help people with vision impairment or people that are completely blind. 

Augmented Reality(AR) Glasses

Augmented Reality for Visually Impaired People

A study tested the potential of AR device in improving the functional vision of people with near-complete vision loss in 2018. An AR applicationthat translates spatial information into high-contrast visual patterns was developed. Performance was tested on a range of visual tasks. The result found that AR application was associated with improved accuracy and confidence in object recognition and in gesture recognition. 

Study of AR Glasses on Visual Impairment

- New tools like AR glasses should attempt to supplement traditional tools like the guide dog and white cane that are relied on by millions of people instead of replacing them.
- While gathering physical information about nearby objects can be useful, identifying and gathering semantic information such as text is a frequent unmet need for blind users.
- The assisstant devices should not make additional noise and cover up environmental sounds since the sound is a valuable information source for blind people

Expected ideas on AR glasses 

HoloLens AR Device Testing on Blind User

The researchers implement an intuitive user interface that each object in the environment has a voice and communicates with the user on command.  With minimal training, this system supports many aspects of visual cognition: obstacle avoidance, scene understanding, formation and recall of spatial memories, navigation.

Learn Before

Related

Learn After