The objective structured clinical examination (OSCE) now has an established place in the assessment of the medical undergraduate. While much has been written about the reliability of the OSCE, empirical work on the determination of the passing score which represents competence on the OSCE is rarely encountered. If the OSCE is to play its role in the 'high stakes' testing of clinical competence, it is important that this passing score be set reliably and defensibly. This article illustrates how a two-session modified Angoff standard-setting procedure is used to set the passing score on a 14 station Obstetrics and Gynaecology OSCE used to assess final year students at The Queen's University of Belfast. The Angoff methodology harnesses the professional judgement of expert judges to establish defensible standards. Four university teachers, five non-academic consultants and six junior clinical staff took part in a two-session Angoff standard-setting procedure. In the first session, the judges (individually and in silence) used their professional judgement to estimate the score which a minimally competent final year obstetrics and gynaecology student should achieve on each tested element of the OSCE. In the second session they revised their session 1 judgements in the light of the OSCE scores of real students and the opportunity for structured discussion. The passing score for the OSCE is reported together with the statistical measures which assure its reliability.

Researchers at Queen's University, Belfast recently completed a study into the potential of portable ‘laptop’ or ‘notebook’ computers in schools. Over 235 pupils in nine schools were provided with a personal portable computer for a whole school year. One aspect of the research was to assess the impact which the high access to information technology (IT) had on the pupils' learning. Five experimental/control class groups (with/ without laptops) were matched for age, gender and ability. The performance of these pupils in mathematics, English and science tests was measured before and after the ‘treatment’ period and the comparisons were analysed. A number of interesting effects were observed and these indicated, with due recognition of the project constraints, that the impact of high access to computers on learning in mathematics, English and science was at best marginal.

No abstract

League tables are weighted combinations of scores on perfmance indicators. The Times newspaper publishes an annual league table of British universities and the focus of this article is the 1994 table. The scores of ninety-six universities on fourteen performance indicators are ranked using weights which 'reflect the interests of students'. The league table is intended as a resource which allows students w compare universities and therefore it is important for both students and universities that valid inferences can be drawn from its use. The table fails to meet any of the technical requirements which would assure its internal construct validity. The educational measurement literature requires that validity inquiry must include consideration of social consequences and it is demonstrated that the technical shortcomings of the Times table could have signifwant adverse impact, even in the top ten universities. It is argued that universities should forsake their current stance of non-co-operation and develop a shortlist of demanding technical standards, linked to the educational measurement literature, which could be referenced in effective attacks upon poorly constructed league tables.

No abstract