A model for music complexity applied to music preprocessing for cochlear implants

Buyens, Wim; Moonen, Marc; Wouters, Jan; Dijk, Bas van

doi:10.23919/eusipco.2017.8081352

Cited by 7 publications

(4 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Final analyses were also done on summary features for mirroughness , which returns time series data of roughness measures in 50ms windows. We RMS-normalized the mean of mirroughness , following previous work 110 . MIRtoolbox features were computed on the denoised recordings, with the exception of mirtempo and mirpulseclarity , where removing the silences between vocalizations would have altered the tempo.…”

Section: Supplementary Textmentioning

confidence: 99%

Acoustic regularities in infant-directed speech and song across cultures

Hilton

Moser

Bertolo

et al. 2020

Preprint

View full text Add to dashboard Cite

Humans often produce vocalizations for infants that differ from vocalizations for adults. Is this property common across societies? The forms of infant-directed vocalizations may be shaped by their function in parent-infant communication. If so, infant-directed song and speech should be differentiable from adult-directed song and speech on the basis of their acoustic features, and this property should be relatively invariant across cultures. To test this hypothesis, we built a corpus of 1,614 recordings of infant-and adult-directed singing and speech produced by 411 people living in 21 urban, rural, and small-scale societies. We studied the corpus in a massive online experiment and in a series of acoustic analyses. Naïve listeners (N = 13,218) reliably identified infant-directed vocalizations as infant-directed, and adult-directed speech (but not songs) as adult-directed, at rates far higher than chance. Ratings of infant-directed song were the most accurate and the most consistent across all societies; infant-directed speech was accurately identified on average, but inconsistently across societies. To determine the mechanisms underlying these results, we extracted many acoustic features from each recording and identified those that most reliably characterize infant-directed song and speech across cultures, via preregistered exploratory-confirmatory analyses and machine classification. The features distinguishing infant-and adult-directed song and speech concerned pitch, rhythmic, phonetic, and timbral attributes; a hypothesis-free classifier with cross-validation across societies reliably identified all vocalization types, with highest accuracy for infant-directed song. Last, we isolated 12 acoustic features that were predictive of perceived infant-directedness; of these, two pitch attributes (median F0 and its variability) were by far the most explanatory. These findings demonstrate cross-cultural regularities in infant-directed vocalizations that are suggestive of universality; moreover, infant-directed song appears to be more cross-culturally stereotyped than infant-directed speech, informing hypotheses of the functions and evolution of both.The forms of many animal signals are shaped by their functions, a link arising from production-and reception-2 related rules that help to maintain reliable signal detection within and across species 1-6 . This is especially 3 true of vocal signals, where form-function links have been demonstrated across many species, including 4 nonhuman primates 3 , meerkats 7 , grackles 8 , frogs 9 , and fish 10 . 5The link between form and function in vocalizations is also evident from listeners' behavior. For example, 6 humans 11 , red deer 12 , and canines 13 reliably detect the intentions of heterospecific signalers on the basis of 7 the sounds of their signals. A classic demonstration of this fact is the ability of some species to eavesdrop 8 on the alarm signals of other species, whether or not their own species has an extended vocal repertoire 14,15 . 9 In humans, an area of...

show abstract

Section: Supplementary Textmentioning

confidence: 99%

Acoustic regularities in infant-directed speech and song across cultures

Hilton

Moser

Bertolo

et al. 2020

Preprint

View full text Add to dashboard Cite

show abstract

“…Various approaches are developed such as different sound processing strategies or changing the features of music before CI processing. Researchers proposed using schemes to reduce spectral complexity (27)(28)(29)(30) and remixing music based on the preferences of CI recipients (31)(32)(33)(34). In various studies, the most consistent and critical finding of previous studies is that CI recipients preferred larger vocals to instrument ratio in songs ranging from 3 to 15 dB (31), 1.92 and 3.82 dB on average (33), and 8-9 dB on average (34,35).…”

Section: Introductionmentioning

confidence: 99%

Musical Mistuning Perception and Appraisal in Cochlear Implant Recipients

Kösemihal

Yüksel²,

Cesur

et al. 2023

Otol Neurotol

View full text Add to dashboard Cite

Objective: Music is a very crucial art form that can evoke emotions, and the harmonious presence of the human voice in music is an impactful part of this process. As a result, vocals have had some significant effects on contemporary music. The mechanism behind the cochlear implant (CI) recipients perceiving different aspects of music is clear; however, how well they perceive vocal tuning within music it is not well known. Hence, this study evaluated the mistuning perception of CI recipients and compared their performance with normal-hearing (NH) listeners. Study Design, Setting, and Patients: A total of 16 CI users (7 cisgender men, 9 cisgender women) and 16 sex-matched NH controls with an average age of 30.2 (±10.9; range, 19-53) years and 23.5 (±6.1; range, 20-37) years, respectively, were enrolled in this study. We evaluated the mistuning ability using the mistuning perception test (MPT) and assessed self-perceived music perception and engagement using the music-related quality-of-life questionnaire. Test performance was measured and reported on the item-response theory metric with a z score ranging from −4 to +4.Results: A significant difference in the MPT scores was found between NH and CI recipients, whereas a significant correlation was noted between the music-related quality-of-life questionnairefrequency subscale and MPT scores. No significant correlations were found between age, CI age, and CI usage duration and MPT performance.Conclusions: This study revealed that musical mistuning perception is a limitation for CI recipients, similar to previously evaluated aspects of music perception. Hence, it is important to consider this aspect in the assessment of music perception, enjoyment, and music-based auditory interventions in CI recipients, as vocals are paramount in music perception and recreation. The MPT is a convenient and accessible tool for mistuning assessment in CI and hearing-aid users.

show abstract

“…A broad range of efforts have already been made to improve music appreciation in CI users, including music preprocessing methods, sound coding strategies, and improved stimulation modes (Nogueira et al 2019). Algorithms that assess the degree of musical stimuli complexity (Buyens et al 2017; Nagathil et al 2018), and others which reduce this complexity directly (e.g., through harmony attenuation) have been created (Nagathil et al 2017). CI users have been shown to prefer solo instrumentation and predictably structured music over multi-instrumentation and unpredictable structures (Limb & Roy 2014).…”

Section: Introductionmentioning

confidence: 99%

Cochlear Implant Compression Optimization for Musical Sound Quality in MED-EL Users

et al. 2021

View full text Add to dashboard Cite

Objectives: Variations in loudness are a fundamental component of the music listening experience. Cochlear implant (CI) processing, including amplitude compression, and a degraded auditory system may further degrade these loudness cues and decrease the enjoyment of music listening. This study aimed to identify optimal CI sound processor compression settings to improve music sound quality for CI users.Design: Fourteen adult MED-EL CI recipients participated (Experiment No. 1: n = 17 ears; Experiment No. 2: n = 11 ears) in the study. A software application using a modified comparison category rating (CCR) test method allowed participants to compare and rate the sound quality of various CI compression settings while listening to 25 real-world music clips. The two compression settings studied were (1) Maplaw, which informs audibility and compression of soft level sounds, and (2) automatic gain control (AGC), which applies compression to loud sounds. For each experiment, one compression setting (Maplaw or AGC) was held at the default, while the other was varied according to the values available in the clinical CI programming software. Experiment No. 1 compared Maplaw settings of 500, 1000 (default), and 2000. Experiment No. 2 compared AGC settings of 2.5:1, 3:1 (default), and 3.5:1. Results:In Experiment No. 1, the group preferred a higher Maplaw setting of 2000 over the default Maplaw setting of 1000 (p = 0.003) for music listening. There was no significant difference in music sound quality between the Maplaw setting of 500 and the default setting (p = 0.278). In Experiment No. 2, a main effect of AGC setting was found; however, no significant difference in sound quality ratings for pairwise comparisons were found between the experimental settings and the default setting (2.5:1 versus 3:1 at p = 0.546; 3.5:1 versus 3:1 at p = 0.059).Conclusions: CI users reported improvements in music sound quality with higher than default Maplaw or AGC settings. Thus, participants preferred slightly higher compression for music listening, with results having clinical implications for improving music perception in CI users.

show abstract

A model for music complexity applied to music preprocessing for cochlear implants

Cited by 7 publications

References 10 publications

Acoustic regularities in infant-directed speech and song across cultures

Acoustic regularities in infant-directed speech and song across cultures

Musical Mistuning Perception and Appraisal in Cochlear Implant Recipients

Cochlear Implant Compression Optimization for Musical Sound Quality in MED-EL Users

Contact Info

Product

Resources

About