The in-basket test.

Frederiksen, Norman; Saunders, David; Wand, Barbara

doi:10.1037/h0093706

Cited by 66 publications

(23 citation statements)

References 2 publications

(2 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…That innovation was often highly theoretical-as in Witkin and Goodenough's (1981) work on cognitive styles, Sigel's (1990) distancing theory, Lord and Novick's (1968) seminal volume on IRT, Messick's (1989) unified conception of validity, Mislevy's (1994Mislevy's ( , 1996 early work on ECD, Deane et al's (2015) English language arts competency model, and Sykes and Wilson's (2015) conceptions of teaching practice. But that innovation was also very often practical-witness the in-basket test (Frederiksen et al 1957), LISREL (Jöreskog and van Thillo 1972), the EM algorithm (Dempster et al 1977), Lord's (1980) "Applications of Item Response Theory to Practical Testing Problems," the application of Mantel-Haenszel to DIF (Holland and Thayer 1988), the plausiblevalues solution to the estimation of population performance in sample surveys (Mislevy et al 1992a), and e-rater (Burstein et al 1998). These innovations were not only useful but used, in all the preceding cases widely employed in the measurement community, and in some cases used throughout the sciences.…”

Section: Discussionmentioning

confidence: 99%

Advancing Human Assessment: A Synthesis Over Seven Decades

Bennett

Davier

2017

Methodology of Educational Measurement and Assessment

View full text Add to dashboard Cite

This book has documented the history of ETS's contributions to educational research and policy analysis, psychology, and psychometrics. We close the volume with a brief synthesis in which we try to make more general meaning from the diverse directions that characterized almost 70 years of work.Synthesizing the breadth and depth of the topics covered over that time period is not simple. One way to view the work is across time. Many of the book's chapters presented chronologies, allowing the reader to follow the path of a research stream over the years. Less evident from these separate chronologies was the extent to which multiple streams of work not only coexisted but sometimes interacted.From its inception, ETS was rooted in Henry Chauncey's vision of describing individuals through broad assessment of their capabilities, helping them to grow and society to benefit (Elliot 2014). Chauncey's conception of broad assessment of capability required a diverse research agenda.Following that vision, his research managers assembled an enormous range of staff expertise. Only through the assemblage of such expertise could one bring diverse perspectives and frameworks from many fields to a problem, leading to novel solutions.In the following sections, we summarize some of the key research streams evident in different time periods, where each period corresponds to roughly a decade. Whereas the segmentation of these time periods is arbitrary, it does give a general This work was conducted while M. von Davier was employed with Educational Testing Service.

show abstract

Section: Discussionmentioning

confidence: 99%

Advancing Human Assessment: A Synthesis Over Seven Decades

Bennett

Davier

2017

Methodology of Educational Measurement and Assessment

View full text Add to dashboard Cite

show abstract

“…Sixty percent of the subjects held positions as chief executive officer, president, vice-president, or other manager, while 40 percent were classified as professional staff(such as accountants or consultants), analysts, or supervisors. Frederiksen, Saunders, and Wand (1957) introduced the in-basket format for management research, and it was first used to study risk by MacCrimmon and Wehrung (1984). The principal characteristics of a risk in-basket are: (1) it provides a business context in which a participant is asked to play a fictional role; (2) the decision situations are developed around a standard two-action risk paradigm in which all actions, consequences, and probabilities are well specified; and (3) various response modes are used to uncover a wide variety of risk-handling activities to provide alternative means for the participants to reveal how they would deal with a risky situation.…”

Section: Samplementioning

confidence: 99%

Adjusting risky situations: A theoretical framework and empirical test

Wehrung¹,

Lee²,

Tse³

et al. 1989

J Risk Uncertainty

View full text Add to dashboard Cite

Experienced executives frequently try to modify the risky situations they face in order to make them more favorable rather than simply choosing from among available decision options. This article investigates several types of risk adjustments such as trying to influence the situation through bargaining and spending resources, gathering information, developing new options, and consulting one's superiors. A theoretical framework is presented that characterizes different types of adjustments and relates them to variables such as perceived rise perceived control, perceived responsibility, decisiveness, and risky choice. The framework is tested using experienced decision makers who respond to four simulated risky business decisions.

show abstract

“…An exception to this trend was the AP program, which relied on constructed-response tasks from its inception. There was also pioneering work on constructed-response assessments early in ETS's history (Frederiksen et al 1957;Hemphill et al 1962). However, in both of these cases, the context was very different from the admissions testing case that represented the bulk of ETS business.…”

Section: Summary and Reflectionsmentioning

confidence: 99%

“…Perhaps the earliest instance of this latter line of work is the "in-basket test" developed by Frederiksen et al (1957). Essentially, the in-basket format is used to simulate an office environment where the test taker plays the role of school principal or business executive, for example.…”

Section: Professional Assessmentsmentioning

confidence: 99%

A Historical Survey of Research Regarding Constructed-Response Formats

Bejar

2017

Methodology of Educational Measurement and Assessment

View full text Add to dashboard Cite

This chapter chronicles ETS research and development contributions related to the use of constructed-response item formats. 1 The use of constructed responses in testing dates back to imperial China, where tests were used in the selection of civil servants. However, in the United States, the multiple-choice format became dominant during the twentieth century, following its invention and use by the SAT ® examinations created by the College Board in 1926. When ETS was created in 1947, post-secondary admissions testing was largely based on tests consisting of multiplechoice items. However, from the start, there were two camps at ETS: those who believed that multiple-choice tests were sufficiently adequate for the purpose of assessing "verbal" skills and those who believed that "direct" forms of assessment requiring written responses had a role to play. For constructed-response formats to regain a foothold in American education several hurdles would need to be overcome. Research at ETS was instrumental in overcoming those hurdles.The first hurdle was that of reliability, specifically the perennial issue of low interrater agreement, which plagued the acceptance of constructed-response formats for most of the twentieth century. The second hurdle was broadening the conception of validity to encompass more than predictive considerations, a process that began with the introduction of construct validity by Cronbach and Meehl (1955). Samuel Messick at ETS played a crucial role in this process by making construct validity relevant to educational tests. An inflexion point in the process of reincorporating constructed-response formats more widely in educational tests was marked 1 Constructed responses to a prompt or question can range in scope and complexity. Perhaps the most common constructed response is the written essay. However, short written responses to questions are also considered to be constructed, as are spoken answers in response to a prompt, mathematical responses (equations, plotted functions, etc.), computer programs, and graphical responses such as architectural designs.

show abstract

The in-basket test.

Cited by 66 publications

References 2 publications

Advancing Human Assessment: A Synthesis Over Seven Decades

Advancing Human Assessment: A Synthesis Over Seven Decades

Adjusting risky situations: A theoretical framework and empirical test

A Historical Survey of Research Regarding Constructed-Response Formats

Contact Info

Product

Resources

About