Deaf people feeling music rhythm by using a sensing and actuating device

Florian, Horatiu; Mocanu, Adrian; Vlasin, Cristian; Machado, José; Carvalho, Vı́tor; Soares, Filomena; Aştilean, Adina; Avram, Camelia

doi:10.1016/j.sna.2017.10.034

Cited by 9 publications

(6 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Esses autores destacam que a surdez pode criar uma lacuna no ciclo de feedback, pois limita as informações auditivas que os músicos surdos podem empregar para avaliar seu desempenho. Florian, H. et al (2017) apresentaram uma Tecnologia Assistiva para ajudar os surdos a sentir o ritmo da música. A Tecnologia Assistiva inclui um sensor de áudio, dois microcontroladores, com saídas de luz e vibrotátil, para transmitir a sensação do ritmo da música.…”

Section: Discussionunclassified

Tecnologia Assistiva vibrotátil para a educação musical de surdos

Farias

Darub

Santos

2021

RSD

View full text Add to dashboard Cite

O objetivo deste artigo foi analisar as possibilidades e as limitações da Tecnologia Assistiva vibrotátil para a educação musical de surdos. Adotamos os pressupostos da pesquisa quantitativa, por meio da abordagem bibliométrica (Ângulo-Cuentas et al., 2018), bem como os da pesquisa qualitativa, por meio da Análise Textual Discursiva (ATD) proposta por Moraes e Galiazzi (2006). O escopo da pesquisa bibliométrica compreendeu 721 artigos científicos indexados à plataforma PubMed. Os resultados apontaram que os artigos científicos que pesquisam a interseção música e surdez tratam, principalmente, acerca de implantes cocleares, da percepção de audição, de tom e de fala de seres humanos de ambos os sexos biológicos e de idades variadas, no entanto, notamos a escassez das pesquisas sobre a utilização de Tecnologia Assistiva vibrotátil nessa área. Assim, após inserção dos descritores tactile ou vibrotactile, analisamos, por meio da ATD, 7 artigos indexados à plataforma Pubmed e 5 artigos indexados à Web of Science. Concluímos que, apesar de incipientes, a Tecnologia Assistiva vibrotátil pode contribuir para a educação musical de surdos.

show abstract

Section: Discussionunclassified

Tecnologia Assistiva vibrotátil para a educação musical de surdos

Farias

Darub

Santos

2021

RSD

View full text Add to dashboard Cite

show abstract

“…Such stimuli are propagated in the environment and can be perceived by users through touch, sight and hearing. Due to hearing restrictions, the deaf need to have physical contact through touch on surfaces that emit, for example, the sounds of audio music so that they can feel the vibrations (Karam et al, 2009; Florian et al, 2017). Santos and Elionai (2017) mentioned that the deaf culture and the hearing culture use the same region in the brain to process vibrations of music, even though there is a different way of understanding them.…”

Section: Methodsmentioning

confidence: 99%

Toc‐Tum mini‐games: An educational game accessible for deaf culture based on virtual reality

Chaves¹,

Braga

Montenegro

et al. 2019

Expert Systems

View full text Add to dashboard Cite

Human hearing is an important sense, which complements the other senses, and is essential for children to begin to acquire basic concepts of the world; however, in severe cases of disability, children become marginalized from these benefits. An example of this is with music, a deaf individual is to be able to perceive it. With this in mind, we developed a novel medical expert system based on virtual reality, called Toc-Tum mini-games, applying basic concepts of music in an accessible way to the deaf culture. The intelligent proposed system is validated in two different tests: (a) with the target audience to evaluate the interest in the game and (b) with professionals knowledgeable in the field of music or who have had contact with the deaf, evaluate the impact of the game teaching music to the deaf. The tests with the target audience showed that the methods of interaction allowed the children to understand most of the stages and that they were animated during the test days. Regarding the professionals, they were interested in the possibility of using the proposed system in question, even if some modifications in the design had to be made. The results showed that the Toc-Tum mini-games is an intelligent tool capable of introducing music in a playful and manageable way using a virtual environment.

show abstract

“…Consequently, most works described in this section are not necessarily portable at the moment of publication, but have clear opportunities to lately become HMP-WDs. Starting from prototypes that cover a small skin surface, there are bracelets ( Figure 4 a), designed to be worn on the wrist (see, e.g., in [ 19 , 21 , 59 , 60 ]); gloves and mobile device mockups ( Figure 4 b), designed to be worn or held on the hands (see, e.g., in [ 37 , 61 , 62 , 63 , 64 ]); belts ( Figure 4 c), designed to be worn surrounding the body from the chest to the abdomen (see, e.g., in [ 8 , 35 , 41 , 42 ]); and jackets ( Figure 4 d), designed to be worn on the upper body with actuators usually located on the back, the front and the superior limbs (e.g., [ 38 , 65 ]). Other variations are whole body suits [ 15 ], and headphone type displays [ 39 ], but instances are scarce.…”

Section: Haptic Music Player (Hmp)mentioning

confidence: 99%

“…This ubiquitous musical feature may be perceived by multiple sensory channels such as visual, auditory, and touch. Moreover, rhythm recognition enhances when visual feedback is offered to the user [ 18 , 60 ]. Translation from auditory rhythmic patterns to vibrotactile stimuli in HMPs has been studied by various researchers (check Table 2 , Table 3 and Table 4 ).…”

Section: Audio-tactile Renderingmentioning

confidence: 99%

Audio-Tactile Rendering: A Review on Technology and Methods to Convey Musical Information through the Sense of Touch

Remache-Vinueza

Trujillo-León

Zapata

et al. 2021

Sensors

View full text Add to dashboard Cite

Tactile rendering has been implemented in digital musical instruments (DMIs) to offer the musician haptic feedback that enhances his/her music playing experience. Recently, this implementation has expanded to the development of sensory substitution systems known as haptic music players (HMPs) to give the opportunity of experiencing music through touch to the hearing impaired. These devices may also be conceived as vibrotactile music players to enrich music listening activities. In this review, technology and methods to render musical information by means of vibrotactile stimuli are systematically studied. The methodology used to find out relevant literature is first outlined, and a preliminary classification of musical haptics is proposed. A comparison between different technologies and methods for vibrotactile rendering is performed to later organize the information according to the type of HMP. Limitations and advantages are highlighted to find out opportunities for future research. Likewise, methods for music audio-tactile rendering (ATR) are analyzed and, finally, strategies to compose for the sense of touch are summarized. This review is intended for researchers in the fields of haptics, assistive technologies, music, psychology, and human–computer interaction as well as artists that may make use of it as a reference to develop upcoming research on HMPs and ATR.

show abstract

Deaf people feeling music rhythm by using a sensing and actuating device

Cited by 9 publications

References 16 publications

Tecnologia Assistiva vibrotátil para a educação musical de surdos

Tecnologia Assistiva vibrotátil para a educação musical de surdos

Toc‐Tum mini‐games: An educational game accessible for deaf culture based on virtual reality

Audio-Tactile Rendering: A Review on Technology and Methods to Convey Musical Information through the Sense of Touch

Contact Info

Product

Resources

About