Conversing Using WhatsHap: a Phoneme Based Vibrotactile Messaging Platform

Marino, David; Vargas, Maurício Fontana de; Weill–Duflos, Antoine; Cooperstock, Jeremy R.

doi:10.1109/whc49131.2021.9517186

Cited by 4 publications

(4 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Several major differences should be noted between the messaging studies conducted with WhatsHap [7,8] and in the current work with TAPS. First, the nature of the two tasks was quite different.…”

Section: Message Receptionmentioning

confidence: 88%

“…A messaging study has also been reported using the WhatsHap device for the tactile display of phonemes [7,8], previously described above in Sec. III-E. Three experienced users of the device (with prior training on phoneme, word, and phrase identification) were each paired with a "speaker" to accomplish a problem-solving task.…”

Section: Message Receptionmentioning

confidence: 99%

“…The present study was motivated by recent research on phoneme-based tactile speech communication systems conducted at Faceboook/Meta [1][2][3], Rice University [4,5], McGill University [6][7][8], and a collaborative effort between Purdue University and MIT [9][10][11][12][13][14]. Our approach assumes that the front end of the device contains a module for producing a string of phonemes extracted from either the acoustic speech signal (using automatic speech recognition) or written text (using a text-to-speech converter).…”

Section: Introductionmentioning

confidence: 99%

“…Another phoneme-based display, developed at McGill University and referred to as WhatsHap [6][7][8], consists of two tactors on the forearm used to encode 25 English phonemes based on salient acoustic features for 16 consonants and speech synthesis for nine vowels. Word-identification studies included probes of the ability to generalize performance from a set of trained words to novel words.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Tactile Speech Communication: Reception of Words and Two-Way Messages through a Phoneme-Based Display

Jung,

Reed,

Martinez

et al. 2024

Virtual Worlds

View full text Add to dashboard Cite

The long-term goal of this research is the development of a stand-alone tactile device for the communication of speech for persons with profound sensory deficits as well as for applications for persons with intact hearing and vision. Studies were conducted with a phoneme-based tactile display of speech consisting of a 4-by-6 array of tactors worn on the dorsal and ventral surfaces of the forearm. Unique tactile signals were assigned to the 39 English phonemes. Study I consisted of training and testing on the identification of 4-phoneme words. Performance on a trained set of 100 words averaged 87% across the three participants and generalized well to a novel set of words (77%). Study II consisted of two-way messaging between two users of TAPS (TActile Phonemic Sleeve) for 13 h over 45 days. The participants conversed with each other by inputting text that was translated into tactile phonemes sent over the device. Messages were identified with an accuracy of 73% correct in conjunction with 82% of the words. Although rates of communication were slow (roughly 1 message per minute), the results obtained with this ecologically valid procedure represent progress toward the goal of a stand-alone tactile device for speech communication.

show abstract

Section: Message Receptionmentioning

confidence: 88%

Section: Message Receptionmentioning

confidence: 99%