Speaking Haptically: From Phonemes to Phrases With a Mobile Haptic Communication System

Vargas, Maurício Fontana de; Marino, David; Weill–Duflos, Antoine; Cooperstock, Jeremy R.

doi:10.1109/toh.2021.3054812

Cited by 9 publications

(7 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A messaging study has also been reported using the WhatsHap device for the tactile display of phonemes [7,8], previously described above in Sec. III-E. Three experienced users of the device (with prior training on phoneme, word, and phrase identification) were each paired with a "speaker" to accomplish a problem-solving task.…”

Section: Message Receptionmentioning

confidence: 99%

“…Following 100 min of training, open-set identification of words from a 150-word vocabulary was 51% correct and fell to 39% correct for novel words [6]. In a later study, de Vargas et al [7] reported isolated word scores of roughly 50% correct for trained words compared to 45% correct for novel words in tests where the inter-phoneme interval was under the participant's control. These authors also reported word scores for words presented in phrases where the advancement of words was under the participant's control.…”

Section: Introductionmentioning

confidence: 96%

“…The present study was motivated by recent research on phoneme-based tactile speech communication systems conducted at Faceboook/Meta [1][2][3], Rice University [4,5], McGill University [6][7][8], and a collaborative effort between Purdue University and MIT [9][10][11][12][13][14]. Our approach assumes that the front end of the device contains a module for producing a string of phonemes extracted from either the acoustic speech signal (using automatic speech recognition) or written text (using a text-to-speech converter).…”

Section: Introductionmentioning

confidence: 99%

“…Another phoneme-based display, developed at McGill University and referred to as WhatsHap [6][7][8], consists of two tactors on the forearm used to encode 25 English phonemes based on salient acoustic features for 16 consonants and speech synthesis for nine vowels. Word-identification studies included probes of the ability to generalize performance from a set of trained words to novel words.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Tactile Speech Communication: Reception of Words and Two-Way Messages through a Phoneme-Based Display

Jung,

Reed,

Martinez

et al. 2024

Virtual Worlds

View full text Add to dashboard Cite

The long-term goal of this research is the development of a stand-alone tactile device for the communication of speech for persons with profound sensory deficits as well as for applications for persons with intact hearing and vision. Studies were conducted with a phoneme-based tactile display of speech consisting of a 4-by-6 array of tactors worn on the dorsal and ventral surfaces of the forearm. Unique tactile signals were assigned to the 39 English phonemes. Study I consisted of training and testing on the identification of 4-phoneme words. Performance on a trained set of 100 words averaged 87% across the three participants and generalized well to a novel set of words (77%). Study II consisted of two-way messaging between two users of TAPS (TActile Phonemic Sleeve) for 13 h over 45 days. The participants conversed with each other by inputting text that was translated into tactile phonemes sent over the device. Messages were identified with an accuracy of 73% correct in conjunction with 82% of the words. Although rates of communication were slow (roughly 1 message per minute), the results obtained with this ecologically valid procedure represent progress toward the goal of a stand-alone tactile device for speech communication.

show abstract

Section: Message Receptionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 96%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Tactile Speech Communication: Reception of Words and Two-Way Messages through a Phoneme-Based Display

Jung,

Reed,

Martinez

et al. 2024

Virtual Worlds

View full text Add to dashboard Cite

show abstract

“…[13] or emotions have been simulated by transmitting vibrations of different frequencies [4]. Vibrotactile feedback has also been synchronized with speech, but for the purpose of improving speech perception of impaired people (e.g., [6,14,16,18,20,24,28,48]).…”

Section: Related Workmentioning

confidence: 99%

Persuasive Vibrations: Effects of Speech-Based Vibrations on Persuasion, Leadership, and Co-Presence During Verbal Communication in VR

Saint-Aubert

Argelaguet

Macé

et al. 2023

2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)

View full text Add to dashboard Cite

show abstract

Research and Application of Business English Practice System Oriented to Cloud Computing Platform

Li¹

2023

2023 International Conference on Applied Intelligence and Sustainable Computing (ICAISC)

View full text Add to dashboard Cite

Speaking Haptically: From Phonemes to Phrases With a Mobile Haptic Communication System

Cited by 9 publications

References 23 publications

Tactile Speech Communication: Reception of Words and Two-Way Messages through a Phoneme-Based Display

Tactile Speech Communication: Reception of Words and Two-Way Messages through a Phoneme-Based Display

Persuasive Vibrations: Effects of Speech-Based Vibrations on Persuasion, Leadership, and Co-Presence During Verbal Communication in VR

Research and Application of Business English Practice System Oriented to Cloud Computing Platform

Contact Info

Product

Resources

About