Native Speaker Reactions to Speakers of ESL: Implications for Adult Basic Education Oral English Proficiency Testing

Mattran, Kenneth J.

doi:10.2307/3585737

Cited by 2 publications

(2 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The approach that we describe below -that is, enlisting native-English-speaking undergraduate students as listeners/evaluators -is also supported by research: It appears that extensive experience in evaluating the speech of non-native speakers is not necessarily a prerequisite for rendering accurate judgements of non-native speakers (Mattran, 1977).…”

Section: A Communicative Competence Orientation To Validationmentioning

confidence: 88%

Validating the revised Test of Spoken English against a criterion of communicative success

et al. 1999

View full text Add to dashboard Cite

A communicative competence orientation was taken to study the validity of test-score inferences derived from the revised Test of Spoken English (TSE). To implement the approach, a sample of undergraduate students, primarily native speakers of English, provided a variety of reactions to, and judgements of, the test responses of a sample of TSE examinees. The TSE scores of these examinees, previously determined by official TSE raters, spanned the full range of TSE score levels. Undergraduate students were selected as ‘evaluators’ because they, more than most other groups, are likely to interact with TSE examinees, many of whom become teaching assistants. Student evaluations were captured by devising and administering a secondary listening test (SLT) to assess students’ understanding of TSE examinees’ speech, as represented by their taped responses to tasks on the TSE. The objective was to determine the degree to which official TSE scores are predictive of listeners’ ability to understand the messages conveyed by TSE examinees. Analyses revealed a strong association between TSE score levels and the judgements, reactions and understanding of listeners. This finding applied to all TSE tasks and to nearly all of the several different kinds of evaluations made by listeners. Along with other information, the evidence gathered here should help the TSE program meet professional standards for test validation. The procedures may also prove useful in future test-development efforts as a way of determining the difficulty of speaking tasks (and possibly writing tasks).

show abstract

Section: A Communicative Competence Orientation To Validationmentioning

confidence: 88%

Validating the revised Test of Spoken English against a criterion of communicative success

et al. 1999

View full text Add to dashboard Cite

show abstract

“…The approachthat we describe below -that is, enlisting native-English-speaking undergraduate students as listeners/evaluators -is supported by Chomsky's(1965) notionthat native speakers possess a certain"linguistic intuition" that qualifies them in this regard. The procedures are also backed by research based on this notion: it appears that extensive experience in evaluatingthe speech of nonnative speakers is not necessarily a prerequisite for rendering accuratejudgmentsof nonnative speakers (Mattran, 1977).…”

Section: A Communicative Competence Orientation To Validationmentioning

confidence: 99%

Validating the Revised Test of Spoken English Against a Criterion of Communicative Success

Powers

Schedl

Wilson-Leung

et al. 1999

ETS Research Report Series

View full text Add to dashboard Cite

A conununicative competence orientation wasadopted to study the validity of test score inferences derived from the revised Test of Spoken English (fSE). To implement the approach, a sample of undergraduate students, primarily native speakers of English, provided a variety of reactions to, andjudgments of, the test responses ofa sample ofTSE examinees. The TSE scores ofthese examinees, previously determined by official TSE raters, spanned the full range ofTSE score levels. Undergraduate students were selected as "evaluators" because they, more than most other groups, are likely to interact with TSE examinees, many of whom become teaching assistants.Student evaluations were captured by devising and administering a secondary listening test (SLT) to assess students' understanding of TSE examinees' speech, as represented by their taped responses to tasks on the Test of Spoken English. The objective was to determine the degree to which official TSE scores are predictive of listeners' ability to understand the messages conveyed by TSE examinees. Analyses revealed a strong association between TSE score levels and the judgments, reactions, and understanding of listeners. This finding applied to all TSE tasks and to nearly all of the several different kinds of evaluations made by listeners. Along with other information, the evidence gathered here should help the TSE program meet professional standards for test validation. The procedures may also prove useful in future test development efforts as a way of determining the difficulty of speaking tasks (and possibly writing tasks).The Test ofEnglish as a Foreign Language (TOEFLIll) was developed in 1963 by the National Council on the Testing of English as a Foreign Language. The Council was formed through the cooperative effort of more than 30 public and private organizationsconcerned with testing the English proficiency of nonnative speakers of the language applying for admission to institutions in the United States. In 1965,Educational Testing Service (ETSIIl) and the College Board assumed joint responsibility for the program. In 1973,a cooperative arrangement for the operationof the program was entered into by ETS, the College Board, and the Graduate Record Examinations (GRE~) Board. The membership of the College Board is composed of schools, colleges, school systems, and educational associations; GRE Board members are associated with graduate education.ETS administers the TOEFL program under the general direction of a Policy Council that was established by, and is affiliated with, the sponsoring organizations. Members of the Policy Council represent the College Board, the GRE Board, and such institutions and agencies as graduate schools of business,junior and community colleges, nonprofit educational exchange agencies, and agencies of the United States government.A continuing program of research related to the TOEFL test is carried out under the direction of the TOEFL Research Committee. Its six members include representatives of the Policy Council, the TOEFL Comm...

show abstract

Native Speaker Reactions to Speakers of ESL: Implications for Adult Basic Education Oral English Proficiency Testing

Cited by 2 publications

References 5 publications

Validating the revised Test of Spoken English against a criterion of communicative success

Validating the revised Test of Spoken English against a criterion of communicative success

Validating the Revised Test of Spoken English Against a Criterion of Communicative Success

Contact Info

Product

Resources

About