Voice pitch control using tactile feedback for the deafblind or the hearing impaired persons to assist their singing

Abstract

It is difficult for the deatblind or the hearing impaired to control their voice pitch because they cannot perceive it. In particular, when singing it is very difficult for them to control their voice pitch because they must maintain a stable tone.In this research, a voice pitch control system is developed to assist their singing by means of a tactile display. The tactile musical note display has 64 piezoelectric vibrators arranged in four rows (16 x 4 rows). A user rests the last joint of an index finger on the tactile display to receive tactile stimuli. The user can then control voice pitch using tactile feedback. In this study, data on the voice pitch of two subjects were measured to calculate interval deviation that was different from voice pitch to a target musical interval. The average data for the interval deviation of both subjects used in this study was 117.5 [cent). The study result shows the deatblind users in this study can sing a song with as much accuracy as hearing children.

Voice pitch control ability of hearing persons with or without tactile feedback using a two-dimensional tactile display system

“…The interval deviation, which is the absolute difference without tactile feedback with tactile feedback between the target musical interval and the voice pitch of the subject, was calculated with reference to our previous study [5]. Figure 5 shows the mean interval deviations of pitch for each note for all subjects.…”

“…However, only a few studies have been made on presenting a musical scale using a tactile display, or on voice training to adjust musical interval using tactile feedback. In light of this, we have developed a voice pitch control system that uses a two-dimensional tactile display [5]. The results of our research showed that two deafblind subjects could control their voice pitch with as much accuracy as hearing children.…”

Real-Time Detection of Important Sounds with a Wearable Vibration Based Device for Hearing-Impaired People

“…Sakajiri et al [21] developed a voice step control system with the aim of helping their songs via a touch screen for deaf in their studies.…”

Accuracy of Voice Pitch Control in Singing Using Tactile Voice Pitch Feedback Display

“…The musical notation for "Tulip" is also shown in Figure 5. "Frog Round" was used in our previous study [5]. In "Frog Round," successive notes in the melody are adjacent notes in the scale.…”

“…Only a few studies have examined the presentation of a musical scale using a tactile display for voice training in adjusting musical intervals using tactile feedback. In light of this, we have developed a voice pitch control system that uses a two-dimensional tactile display [5]. The results of this research showed that two deafblind subjects could control their voice pitch with as much accuracy as hearing children while singing the song "Frog Round."…”