Designing auditory cues to enhance spoken mathematics for visually impaired users

Abstract

Visual mathematic notation provides a succinct and unambiguous description of the structure of mathematical formulae in a manner that is difficult to replicate through the linear channels of synthesized speech and Braille. It is proposed that the use of auditory cues can enhance accessibility to mathematical material and reduce common ambiguities encountered through spoken mathematics. However, the use of additional complex hierarchies of non-speech sounds to represent the structure and scope of equations may be cognitively demanding to process. This can detract from the users' understanding of the mathematical content. In this paper, a new system is presented, which uses a mixture of non-speech auditory cues, modified speech (spearcons) and binaural spatialization to disambiguate the structure of mathematical formulae. A design study, involving an online survey with 56 users, was undertaken to evaluate an existing set of auditory cues and to brainstorm alternative ideas and solutions from users before implementing modified designs and conducting a separate controlled evaluation. It is proposed that by involving a wide number of users in the creative design process, intuitive auditory cues will be implemented with the potential to enhance spoken mathematics for visually impaired users.

Coping with Accessibility Challenges for Security - A User Study with Blind Smartphone Users

“…Vibration and aural standards could be defined as alternatives to visual interfaces, over and above screen reader which are essentially text to speech. For example, some existing studies investigate providing prosodic cues with screen readers [59,60].…”

“Bursting the Assistance Bubble”

“…A number of researchers have developed novel assistive technologies (ATs) that address these sorts of issues. For instance, Hayden et al [33] developed a portable note-taker to provide blind students with better access to classroom presentations, Murphy et al [54] investigated the use of non-speech and speech sounds to improve access to mathematical formulae, and McDonald et al [46] used 3D printing to produce rapid prototyping tactile tools. Despite progress, however, uptake of novel ATs in educational settings continues to be limited [9,40,79], and text-to-speech devices, and screen enlargement software continue to be the dominant ATs used bu pupils with VIs [46].…”

Annotation-based video enrichment for blind people

“…Audio notifications have been used for conveying information that has a strong spatial component to blind and visually impaired people. For instance, they were used for improving orientation and mobility skills of blind people (in conjunction with haptic feedback) [29], for improving objects localization [11] or for enhancing accessibility to mathematical material such as equations with fractions (two dimensional objects) [25] or graphs [9] using "graph sonification". Audio notifications have been also frequently used for improving accessibility of Human-Computer Interface components: e.g.…”