Identification of visual displays of speech: Comparisons of naive and trained observers

Abstract

Two groups of subjects were presented with spectrograms of 50 words they had never seen before and were asked to provide a single monosyllabic English word for each spectrogram. One group had learned to identify a limited set of speech spectrograms after 15 h of training using a study-test procedure which stressed wholistic word identification. A subgroup of participants in a formal course on spectrogram reading at MIT served as a second group of subjects. These subjects learned specific acoustic and phonetic principles and strategies for interpreting spectrograms. Subjects in the first group correctly identified 33% of the possible phonetic segments in spectrograms they had never seen before. The second group of subjects correctly identified 40% of the possible segments in the same set of spectrograms given to the first group. When the data were scored for correct manner class of consonants only, the two groups did not differ significantly. Detailed descriptions of the identification results will be presented. Implications of these findings for developing visual aids for hearing impaired persons and improved phonetic recognition strategies will be discussed. [Supported by NSF.]

Análise espectrográfica da voz: efeito do treinamento visual na confiabilidade da avaliação

“…Na literatura, estudos que analisaram o efeito do treinamento visual na concordância intra e interavaliadores na interpretação de avaliações por imagem, como espectrogramas de fala e exames radiológicos, demonstraram diferentes resultados nos momentos pré e pós treinamento, fato que pode ser justificado principalmente pelo grau de complexidade da imagem e, consequentemente, da análise perceptivo-visual (7)(8)(9)(10)(11) . Não se encontrou na literatura nenhum trabalho que estudasse o efeito do treinamento visual na avaliação espectrográ-fica vocal, portanto, essa pesquisa pretende analisar o quanto o treinamento visual interfere na concordância intra e inter examinadores na avaliação da análise espectrográfica da voz.…”

Formalizing Knowledge Used in Spectrogram Reading: Acoustic and Perceptual Evidence from Stops

“…As can be seen in Table 1.1 there have been a variety of spectrogram reading experiments. * Some of the experiments addressed the ability of subjects to read words or syllables directly in the spectrogram (Potter et al, 1947;House et al, 1968;Pisoni et al, 1983;* Greene et al, 1984;Daly, 1987). Others attempted to assess the ability to phonetically label the spectrogram (Klatt and Stevens, 1973;Svenssen, 1974;Cole et al, 1980, Johnson et al, 1984Lonchamp et al, 1985).…”