Non-isomorphism in efficient coding of complex sound properties

Stilp, Christian E.; Kluender, Keith R.

doi:10.1121/1.3647264

Cited by 11 publications

(14 citation statements)

References 25 publications

(25 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…If the goal of production is the efficient generation of an integral or combinatoric acoustic property (Kingston et al, 2008), the observed correlation might indicate a type of "trading relation" in reverse: Talkers may compensate for idiosyncratic variation in one cue by scaling the other inversely, essentially never producing "too much" of a combined cue. Similarly, the observed lack of correlation in perception is consistent with an efficient coding model of speech perception in which cue weighting varies as a function of the distribution of cues in the input (Ming and Holt, 2009;Stilp and Kluender, 2011). That is, a listeners' pattern of cue weighting in the present experiment may simply reflect the fact that VOT and onset f0 were uncorrelated in the stimuli they received.…”

Section: Discussionsupporting

confidence: 63%

Differential cue weighting in perception and production of consonant voicing

Shultz¹,

Francis²,

Llanos³

2012

The Journal of the Acoustical Society of America

View full text Add to dashboard Cite

This study examines English speakers’ relative weighting of two voicing cues in production and perception. Participants repeated words differing in initial consonant voicing ([b] or [p]) and labeled synthesized tokens ranging between [ba] and [pa] orthogonally according to voice onset time (VOT) and onset f0. Discriminant function analysis and logistic regression were used to calculate individuals’ relative weighting of each cue. Production results showed a significant negative correlation of VOT and onset f0, while perception results showed a trend toward a positive correlation. No significant correlations were found across perception and production, suggesting a complex relationship between the two domains.

show abstract

Section: Discussionsupporting

confidence: 63%

Differential cue weighting in perception and production of consonant voicing

Shultz¹,

Francis²,

Llanos³

2012

The Journal of the Acoustical Society of America

View full text Add to dashboard Cite

show abstract

“…Following exposure to stimuli capturing these correlated attributes, signal-to-noise ratio (SNR) of spike-rate coding decreased orthogonal to the correlation, while remaining intact along the correlation; and, mutual information of spike coding increased only along the correlated dimension. Like results from Stilp and Kluender (2011), these patterns of activity remained intact in the face of variation in a third unrelated dimension.…”

Section: Learning Correlations Among Stimulus Attributessupporting

confidence: 60%

“…For speech, this process of perceptual organization begins early in life and presumably supports, at least in part, infants' rapid mastery of multiply specified contrasts within their native language environment. To learn about acquisition of sensitivity to correlations among stimulus attributes by adult listeners, Stilp and colleagues (Stilp, Rogers, & Kluender, 2010c;Stilp & Kluender, 2011, 2012 employed novel complex stimuli that varied across two physically independent acoustic attributes: attack/decay (AD) and spectral shape (SS). A stimulus matrix was generated by crossing AD and SS series for which sounds separated by fixed distance in the stimulus space were approximately equally discriminable.…”

Section: Learning Correlations Among Stimulus Attributesmentioning

confidence: 99%

Long-standing problems in speech perception dissolve within an information-theoretic perspective

Kluender

Stilp

Lucas

2019

Atten Percept Psychophys

Self Cite

View full text Add to dashboard Cite

An information theoretic framework is proposed to have the potential to dissolve (rather than attempt to solve) multiple longstanding problems concerning speech perception. By this view, speech perception can be reframed as a series of processes through which sensitivity to information-that which changes and/or is unpredictable-becomes increasingly sophisticated and shaped by experience. Problems concerning appropriate objects of perception (gestures vs. sounds), rate normalization, variance consequent to articulation, and talker normalization are reframed, or even dissolved, within this information-theoretic framework. Application of discriminative models founded on information theory provides a productive approach to answer questions concerning perception of speech, and perception most broadly.

show abstract

“…The physical acoustics of natural sounds often reveal correlations between acoustic attributes (Lutfi et al, 2011). In auditory perception, the adaptive coding principle is also supported by the results of a set of psychoacoustic experiments that were the inspiration for this study (Stilp et al, 2010;Stilp and Kluender, 2011.…”

Section: Discussionmentioning

confidence: 54%

“…Additional recent support for the active EC hypothesis in the auditory system comes from psychoacoustic studies (Stilp et al, 2010, Stilp and Kluender, 2011 in which subjects either received passive exposure to, or provided continuous discrimination judgments for sets of complex sounds with covarying amplitude attackdecay ratios and spectral-shapes. Following passive exposure, and also over the course of active discrimination, subjects' acuity in discriminating of sounds along the correlated dimensions remained intact, but discrimination of pairs on the orthogonal dimension was significantly impaired when those pairs were proximal to the principle vector of covariance.…”

Section: Introductionmentioning

confidence: 99%

Adaptive efficient coding of correlated acoustic properties

Lü

Liu

Dutta

et al. 2019

Preprint

View full text Add to dashboard Cite

word)Natural sounds such as vocalizations often have co-varying acoustic attributes where one acoustic feature can be predicted from another, resulting in redundancy in neural coding. It has been proposed that sensory systems are able to detect such covariation and adapt to reduce redundancy, leading to more efficient neural coding. Results of recent psychoacoustic studies suggest that, following passive exposure to sounds in which temporal and spectral attributes covaried in a correlated fashion, the auditory system adapts to efficiently encode the two co-varying dimensions as a single dimension, at the cost of lost sensitivity to the orthogonal dimension. Here we explore the neural basis of this psychophysical phenomenon by recording single-unit responses from primary auditory cortex (A1) in awake ferrets exposed passively to stimuli with two correlated attributes in the temporal and spectral domain similar to that utilized in the psychoacoustic experiments. We found that: (1) the signal-to-noise (SNR) ratio of spike rate coding of cortical responses driven by sounds with correlated attributes was reduced along the orthogonal dimension; while the SNR ratio remained intact along the exposure dimension; (2) Mutual information of spike temporal coding increased only along the exposure dimension; (3) correlation between neurons tuned to the two covarying attributes decreased after exposure; (4) these exposure effects still occurred if sounds were correlated along two acoustic dimensions, but varied randomly along a third dimension. These neurophysiological results are consistent with the Efficient Learning Hypothesis and may deepen our understanding of how the auditory system represents acoustic regularities and covariance. Significance (119 words)In the Efficient Coding (EC) hypothesis, proposed by Barlow in 1961, the neural code in sensory systems efficiently encodes natural stimuli by minimizing the number of spikes to transmit a sensory signal. Results of recent psychoacoustic studies are consistent with the EC hypothesis, showing that following passive exposure to stimuli with correlated attributes, the auditory system adapts so as to more efficiently encode the two co-varying dimensions as a single dimension. In the current neurophysiological experiments, using a similar stimulus design and experimental paradigm to the psychoacoustic studies of Stilp and colleagues (2010, 2011, 2012, 2016), we recorded responses from single neurons in the auditory cortex of the awake ferret, showing adaptive efficient neural coding of correlated acoustic properties.

show abstract

Non-isomorphism in efficient coding of complex sound properties

Cited by 11 publications

References 25 publications

Differential cue weighting in perception and production of consonant voicing

Differential cue weighting in perception and production of consonant voicing

Long-standing problems in speech perception dissolve within an information-theoretic perspective

Adaptive efficient coding of correlated acoustic properties

Contact Info

Product

Resources

About