S omeone once said that in theory, theory and practice are the same; in practice they aren't. This is true in learning assessment as a practical matter: within constraints of time, money, and logistics, it is often necessary to make compromises between an ideal assessment and one that actually gets done. The intent of this article is to present survey results that illustrate how assessment professionals say they feel about such compromises as it pertains to methodological issues in assessment.We assess because we want to know useful things, and we have to accept the induction errors-the mistakes-we make in the process. The nature and frequency of these mistakes is by no means agreed upon by professionals engaged in outcomes assessment. Assessment professionals put into practice different epistemologies regarding what we know, or think we know, about learning outcomes. A caricature of the most conservative stance might be this: Our role is to use authentic assessments and report only summary statistics, not to infer or predict what this means about future performance of the test subjects. In this view, we leave it to others to interpret what the assessment results mean in terms of actual learning. At the other extreme, we imagine a theoretical model that our data are poured into, producing parameters that we believe can be used to measure learning and predict future performance.Besides limiting resources and philosophical approaches, academic disciplines provide varied outlooks on teaching, learning, and assessment. Given the variety of views and approaches to outcomes assessment, it is worthwhile to attempt to take a snapshot of higher education assessment professionals' (i.e., faculty, professional staff, administrators, and other stakeholders) perceptions of what constitutes quality assessment methodology. Results of this snapshot could be used to understand the extent to which various methods are holistically agreed upon by higher education assessment professionals, resulting in improved dialogue about assessment methods generally.
PurposeAs stated previously, within the profession of learning outcomes assessment there are professionals from all sorts of backgrounds, from professional staff to educational researchers (these are not exclusive, obviously). It would be foolish to try to describe this eclectic group in simple terms, but it may be possible to approximate with a metaphor their beliefs about outcomes assessment as they relate to methods. We choose a ruler