Exploring the use of speech input by blind people on mobile devices

Azenkot, Shiri; Lee, Nicole B.

doi:10.1145/2513383.2513440

Cited by 111 publications

(70 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[3], [7], [8], [11], [20], [26], [29]), or voice input (e.g. [4], [19]), along with accessible forms of output to provide feedback to the user (e.g. audio [7], [8], [16], [26], [29], and/or tactile output [15], [26] either to the user's hand via the mobile device or via a separate wearable.…”

Section: A Eyes-free Interaction Techniquesmentioning

confidence: 99%

“…screen glare, or interacting with the device under the table [12]), or deliberate obfuscation by the user (e.g., attempting to hide the screen in a bag [18] or a pocket [1] from a shoulder surfing attack), is not well understood. While eyes-free interactions for different types of users and mobile devices have been studied by researchers in the past [3], [4], [7], [8], [11], [15], [16], [19], [20], [24], [29], studies have yet to investigate the performance with common authentication mechanisms when the phone is outof-view, and user coping strategies to enter passcodes in an eyes-free manner.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Performance of Eyes-Free Mobile Authentication

Wolf¹,

Aviv²,

Kuber³

2018

Proceedings 2018 Workshop on Usable Security

View full text Add to dashboard Cite

Abstract-Mobile device users avoiding observational attacks and coping with situational impairments may employ techniques for eyes-free mobile unlock authentication, where a user enters his/her passcode without looking at the device. This study supplies an initial description of user accuracy in performing this authentication behavior with PIN and pattern passcodes, with varying lengths and visual characteristics. Additionally, we inquire if tactile-only feedback can provide assistive spatialization to support users when interacting with the mobile interface, finding that orientation cues prior to unlocking do not help. A within-group, randomized study was conducted with 26 participants. 1,021 passcode entry gestures were performed under eyes-free conditions. Edit distance measurements were then calculated. Gesture traces and subjective feedback were recorded for subsequent analysis. We found that users who focused on orienting themselves to position the first digit of the passcode using the tactile feedback performed better in the task. These results could be applied to better define eyes-free behavior in further research, and to design better and more secure methods for eyes-free authentication.

show abstract

Section: A Eyes-free Interaction Techniquesmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Performance of Eyes-Free Mobile Authentication

Wolf¹,

Aviv²,

Kuber³

2018

Proceedings 2018 Workshop on Usable Security

View full text Add to dashboard Cite

show abstract

“…Special attention was given to the message editing process to make it more accessible. Indeed, Azenkot and Lee's survey showed that people with visual impairment spend 80% of their time editing when using speech recognition which can be frustrating (Azenkot and Lee, 2013).…”

Section: Case Study: Sms Applicationmentioning

confidence: 99%

Designing Multimodal Mobile Interaction for a Text Messaging Application for Visually Impaired Users

et al. 2017

View full text Add to dashboard Cite

While mobile devices have experienced important accessibility advances in the past years, people with visual impairments still face important barriers, especially in specific contexts when both their hands are not free to hold the mobile device, like when walking outside. By resorting to a multimodal combination of body based gestures and voice, we aim to achieve full hands and vision free interaction with mobile devices. In this article, we describe this vision and present the design of a prototype, inspired by that vision, of a text messaging application. The article also presents a user study where the suitability of the proposed approach was assessed, and a performance comparison between our prototype and existing SMS applications was conducted. Study participants received positively the prototype, which also supported better performance in tasks that involved text editing.

show abstract

“…Input modalities for VIPs are classified into eight categories: 1) hand gestures [7][8][9] , 2) upper body movement [10] , 3) lower body movement [11][12] , 4) environmental context [13][14][15][16][17] , 5) braille [18][19][20] , 6) multi-touch [21][22][23][24][25] , 7) speech [26][27][28][29] , and 8) keyboard/mouse [30][31] . Feedback from the system (i.e., output) was classified into four broad categories: 1) vibration [7,[9][10][13][14] , 2) speech [15,19,[21][22]26,31] , 3) sound [8,[11][12]16,[20][21]29] , and 4) braille display [17][18]25,27] .…”

Section: Related Workmentioning

confidence: 99%

“…Feedback from the system (i.e., output) was classified into four broad categories: 1) vibration [7,[9][10][13][14] , 2) speech [15,19,[21][22]26,31] , 3) sound [8,[11][12]16,[20][21]29] , and 4) braille display [17][18]25,27] .…”

Section: Related Workmentioning

confidence: 99%

Assisting Visually Impaired People to Acquire Targets on a Large Wall-Mounted Display

Kim

Ren

2014

J. Comput. Sci. Technol.

View full text Add to dashboard Cite

Large displays have become ubiquitous in our everyday lives, but these displays are designed for sighted people. This paper addresses the need for visually impaired people to access targets on large wall-mounted displays. We developed an assistive interface which exploits mid-air gesture input and haptic feedback, and examined its potential for pointing and steering tasks in human computer interaction (HCI). In two experiments, blind and blindfolded users performed target acquisition tasks using mid-air gestures and two different kinds of feedback (i.e., haptic feedback and audio feedback). Our results show that participants perform faster in Fitts' law pointing tasks using the haptic feedback interface rather than the audio feedback interface. Furthermore, a regression analysis between movement time (MT) and the index of difficulty (ID) demonstrates that the Fitts' law model and the steering law model are both effective for the evaluation of assistive interfaces for the blind. Our work and findings will serve as an initial step to assist visually impaired people to easily access required information on large public displays using haptic interfaces.

show abstract

Exploring the use of speech input by blind people on mobile devices

Cited by 111 publications

References 20 publications

Performance of Eyes-Free Mobile Authentication

Performance of Eyes-Free Mobile Authentication

Designing Multimodal Mobile Interaction for a Text Messaging Application for Visually Impaired Users

Assisting Visually Impaired People to Acquire Targets on a Large Wall-Mounted Display

Contact Info

Product

Resources

About