What is here advocated is the use of multiple-choice exercises in philosophy courses. This, to many people, is sufficiently absurd to be rejected at sight, despite the familiar advantages of such tests such as ease of marking. Philosophy, they object, is too (how should one put it?) too subtle a subject to have any truck with mu1 tiple-choice testing. Philosophical insight cannot be measured by counting ticks in boxes. To make matters worse, what is advocated here is that the exercises should contain vague or ambiguous questions. Even those who defend multiple-choice tests, in such more straightforward subjects as psychology for example, are careful to warn against the danger of ambiguity (and vagueness, though the distinction is often ignored) in questions.It is hardly necessary to substantiate this last remark, but a quick check of a few standard texts on educational measurement produced the following:The first drafts of items are then reviewed, criticized, and revised. This review may be made by the same group that wrote the items or by an independent group of subject matter and test construction specialists. Most of the revisions will involve eliminating ambiguities, clarifying wordings, and strengthening alternatives.
(Brown 1970, p. 35, my emphases)The problem of ambiguity in objective test items is particularly acute because each item is usually an isolated unity [and so lacks a contexts which might help to disambiguate it].(Wesman 1971, p. 102a, my emphasis) 23 24
Jim MackenzieIt is very desirable to have other teachers of the subject evaluate the exercises with respect to fairness, freedom fiom nmbiguities, and elimination of the too obviously incorrect answers. (Engelhart 1947, p. 146, my emphasis) While objective [test] items generally communicate required behavior to students better than essay tests do, it is still necessary to make a conscious effort to write clear, concise, unambiguous items.(Gay 1985, p. 228, my emphasis)An item should have one and only one correct, or best, answer, unless otherwise specified. Usually when more than one answer is correct, it is an inadvertent item flaw .