Design alternatives for the evaluation of design science research artifacts

Abstract

Within a consideration of cost effectiveness the evaluation of design science research artifacts is of major importance. In the past, a plenitude of approaches has been developed for this purpose -partly artifact-specific, partly artifact-neutral. Nonetheless, there is a lack of a comprehensive overview over existing methods as well as a systemization of those with regard to fundamental structuring criteria. The paper at hand surveys existing methods and introduces a framework that equally supports the designer and the user of artifact evaluation approaches. Subsequent to the embedding of the framework into the design science research process two exemplary application scenarios are described.

An Evaluation View of an Ensemble Artefact for Decision Support using Action Design Research

“…In light of our ADR study set in a NFP, we now put forward an alternative definition of evaluation than the one from Cleven et al (2009) …”

The use of design science research in the development of a performance management system for hospitality

“…Relevance, by addressing a real business need and rigor, by appropriately applying the existing body of knowledge (Cleven et al, 2009;Hevner et al, 2004). …”

“…Rigor -by the need to apply the proper body of knowledge in the artifact development (Cleven, Gubler, and Hüner, 2009;Hevner et al, 2004).…”

“…Even though there is some debate in DSRM about what should be considered an artifact in DSR (Offermann et al, 2010;Cleven et al, 2009;Beaudouin-Lafon and Mackay, 2003) the artifacts that were selected to present are both well accepted within the research community.…”

Ein metrikbasierter Ansatz zur Messung der Aktualität von Daten in Informationssystemen

“…Die Evaluation der neuen Metrik erfolgt hinsichtlich einer ökonomischen, konstruktionstechnischen und erkenntnistheoretischen Perspektive (Cleven et al 2009, Frank 2007 (9) Auf Basis der Erwartungswerte wurden in Schritt vier die 30% umsatzstärksten Kunden mit dem höchsten erwarteten Kampagnenergebnis selektiert.…”