A Taxonomy of Evaluation Methods for Information Systems Artifacts

Prat, Nicolas; Comyn-Wattiau, Isabelle; Akoka, Jacky

doi:10.1080/07421222.2015.1099390

Cited by 174 publications

(114 citation statements)

References 42 publications

Supporting

Mentioning

106

Contrasting

Unclassified

Order By: Relevance

“…By this, the design of our evaluation follows the compositional styles demonstration and simulation- and metric-based benchmarking of artefacts (cf. Prat, Comyn-Wattiau, & Akoka, 2015). We use integer programming (Nemhauser & Wolsey, 1988) to find the optimal solution for both optimisation models.…”

Section: Discussionmentioning

confidence: 99%

Service selection in mobile environments: considering multiple users and context-awareness

Heinrich

Mayer

2018

Journal of Decision Systems

View full text Add to dashboard Cite

In mobile environments, users often need to coordinate their actions with other users with regard to user-individual context information like current location when selecting suitable services for a process. Thereby, some users may prefer to conduct particular services together with certain other users. Such multi-user context-aware service selections could result in complex decision problems – making decision support for the participating users highly valuable or even necessary. To do so, we propose an optimisation-based service selection approach for multi-user context-aware processes. We also show how our approach provides decision support by evaluating its efficacy based on a real-world scenario.

show abstract

Section: Discussionmentioning

confidence: 99%

Service selection in mobile environments: considering multiple users and context-awareness

Heinrich

Mayer

2018

Journal of Decision Systems

View full text Add to dashboard Cite

show abstract

“…Usability relates to the overall user experience with the system: is it easy to access, add content, and search? This is a functional technological issue relating to the usability of the IT system (Venkatesh, 2000;Saadé and Bahli, 2005;Schilling and Kluge, 2009;Burke, 2013;Prat et al, 2015;Venkatesh et al, 2016 ). Systems perceived as not being easy to use are unlikely to deliver the benefits anticipated, so this is a key factor to ascertain.…”

Section: Methodsmentioning

confidence: 99%

A Study of Accountability in Two Organizational Learning Frameworks: Why Accountability for Learning is Critical

Baxter

Colledge

Turner

2017

European Management Review

View full text Add to dashboard Cite

In this paper we examine the complex relationship between accountability and organizational learning through a case study with the UK Royal Air Force (RAF). Accountability is a complex and contradictory construct that has both positive and negative implications for organizational learning. Within the same organization we observed positive effects of accountability in one organizational learning system, and negative effects of accountability in another. This case study adds to the organizational learning and accountability literatures, showing that accountability to hierarchy, rather than preventing learning, can actually promote effective learning, making it more likely that people will report problems quickly and accurately and take follow‐up action. This only applies if the learning objectives align with the broader accountability framework, and if reporting on failures will enhance individual reputation. If not, then people will tend to avoid reporting negative events in order to avoid punishment and reputation damage. Accountability to hierarchy is only negative if it conflicts with the learning objectives.

show abstract

“…Prat et al [25] propose a taxonomy of evaluation methods for information system. Since we wanted to know whether AMAN-DA is able to produce domain specific security requirements, the focus was on two criteria from the taxonomy: effectiveness and utility.…”

Section: Case Studymentioning

confidence: 99%

Using the AMAN-DA method to generate security requirements: a case study in the maritime domain

et al. 2017

Self Cite

View full text Add to dashboard Cite

Abstract. [Context and motivation]Security requirements are known to be "the most difficult of requirements types", and potentially the ones causing the greatest risk if they are not correct. One approach to requirements elicitation is based on the reuse of explicit knowledge. AMAN-DA is a requirement elicitation method that reuses encapsulated knowledge in security and domain ontologies to produce security requirements specifications.[Question/Problem] The main research question addressed in this paper is to what extent is AMAN-DA able to generate domain specific security requirements? [Principal idea/results] Following a well-documented process, a case study related to the maritime domain was undertaken with the goal to demonstrate the utility and effectiveness of AMAN-DA for the elicitation and analysis of domain specific security requirements. The usefulness of the method was also evaluated with a group of twelve experts.[Contribution] The paper demonstrates the elicitation of domain specific security requirements by presenting the AMAN-DA method and its application. It describes the evaluation and reports some significant results and their implications for practice, and future research, especially for the field of knowledge reuse in requirements engineering.

show abstract

A Taxonomy of Evaluation Methods for Information Systems Artifacts

Cited by 174 publications

References 42 publications

Service selection in mobile environments: considering multiple users and context-awareness

Service selection in mobile environments: considering multiple users and context-awareness

A Study of Accountability in Two Organizational Learning Frameworks: Why Accountability for Learning is Critical

Using the AMAN-DA method to generate security requirements: a case study in the maritime domain

Contact Info

Product

Resources

About