Criteria as a Prelude for Guiding Taxonomy Evaluation

Szopinski, Daniel; Schoormann, Thorsten; Kundisch, Dennis

doi:10.24251/hicss.2020.622

Cited by 23 publications

(24 citation statements)

References 55 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…One criterion for assessing artifacts such as taxonomies is by evaluating their usefulness related to their intended purpose [ 111 , 116 ]. However, there are only very few taxonomy-specific evaluation guidelines [ 117 ], but multiple evaluation approaches can be applied in health informatics [ 118 - 120 ]. Szopinski et al [ 49 ] analyzed the various approaches researchers applied to evaluate taxonomies in the information system’s domain and demonstrated that the Delphi technique was hardly used.…”

Section: Resultsmentioning

confidence: 99%

Improvement and Evaluation of the TOPCOP Taxonomy of Patient Portals: Taxonomy-Evaluation-Delphi (TED) Approach

Glöggler¹,

Ammenwerth²

2021

J Med Internet Res

View full text Add to dashboard Cite

Background Patient portals have been introduced in many countries over the last 10 years, but many health information managers still feel they have too little knowledge of patient portals. A taxonomy can help them to better compare and select portals. This has led us to develop the TOPCOP taxonomy for classifying and comparing patient portals. However, the taxonomy has not been evaluated by users. Objective This study aimed to evaluate the taxonomy’s usefulness to support health information managers in comparing, classifying, defining a requirement profile for, and selecting patient portals and to improve the taxonomy where needed. Methods We used a modified Delphi approach. We sampled a heterogeneous panel of 13 health information managers from 3 countries using the criterion sampling strategy. We conducted 4 anonymous survey rounds with qualitative and quantitative questions. In round 1, the panelists assessed the appropriateness of each dimension, and we collected new ideas to improve the dimensions. In rounds 2 and 3, the panelists iteratively evaluated the taxonomy that was revised based on round 1. In round 4, the panelists assessed the need for a taxonomy and the appropriateness of patient engagement as a distinguishing concept. Then, they compared 2 real portals with the final taxonomy and evaluated its usefulness for comparing portals, creating an initial requirement profile, and selecting patient portals. To determine group consensus, we applied the RAND/UCLA Appropriateness Method. Results The final taxonomy consists of 25 dimensions with 65 characteristics. Five new dimensions were added to the original taxonomy, with 8 characteristics added to already existing dimensions. Group consensus was achieved on the need for such a taxonomy to compare portals, on patient engagement as an appropriate distinguishing concept, and on the comprehensibility of the taxonomy’s form. Further, consensus was achieved on the taxonomy’s usefulness for classifying and comparing portals, assisting users in better understanding portals, creating a requirement profile, and selecting portals. This allowed us to test the usefulness of the final taxonomy with the intended users. Conclusions The TOPCOP taxonomy aims to support health information managers in comparing and selecting patient portals. By providing a standardized terminology to describe various aspects of patient portals independent of clinical setting or country, the taxonomy will also be useful for advancing research and evaluation of patient portals.

show abstract

Section: Resultsmentioning

confidence: 99%

Improvement and Evaluation of the TOPCOP Taxonomy of Patient Portals: Taxonomy-Evaluation-Delphi (TED) Approach

Glöggler¹,

Ammenwerth²

2021

J Med Internet Res

View full text Add to dashboard Cite

show abstract

“…Evaluating the quality of the job descriptor taxonomies (taxons) is an important activity for ensuring useful classifications of jobs into job groupings that are similar in terms of skill, effort, responsibility, and working conditions. Szopinski et al (2019) and Stribling et al (2003) provide very helpful guidance on strategies and criteria for evaluating taxonomies. Similarly, I-O scientists and practitioners recognize the importance of evaluating the quality of taxonomic structures and the results of using those taxonomies.…”

Section: Importance Of Taxonomies For Classificationmentioning

confidence: 99%

Metrics for assessing similarity of jobs

Hough¹,

Russell

2022

Ind. Organ. Psychol.

View full text Add to dashboard Cite

“…Researchers developing a taxonomy have to identify potential use cases which also build the basis for evaluating the taxonomy later on [10], [11], [12], [13], [14], [15]. Currently, there exist several different VR locomotion taxonomies [16].…”

Section: Introductionmentioning

confidence: 99%

“…In addition to providing insights into the evolution of the research field and the knowledge that has already been acquired, use cases can provide the basis for creating, choos-ing and evaluating taxonomies in a user-centred approach. Usefulness of taxonomies is one of the most common quality criteria [10] and is often evaluated based on use cases [11], [13], [14], [15]. To support this approach, we have extracted several use cases by extracting the goals described by the authors in the taxonomy publications, which were subsequently fused by several researchers.…”

Section: Introductionmentioning

confidence: 99%

A Systematic Literature Review of Virtual Reality Locomotion Taxonomies

Prinz

Mathew

Weyers

2023

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

The change of the user's viewpoint in an immersive virtual environment, called locomotion, is one of the key components in a virtual reality interface. Effects of locomotion, such as simulator sickness or disorientation, depend on the specific design of the locomotion method and can influence the task performance as well as the overall acceptance of the virtual reality system. Thus, it is important that a locomotion method achieves the intended effects. The complexity of this task has increased with the growing number of locomotion methods and design choices in recent years. Locomotion taxonomies are classification schemes that group multiple locomotion methods and can aid in the design and selection of locomotion methods. Like locomotion methods themselves, there exist multiple locomotion taxonomies, each with a different focus and, consequently, a different possible outcome. However, there is little research that focuses on locomotion taxonomies. We performed a systematic literature review to provide an overview of possible locomotion taxonomies and analysis of possible decision criteria such as impact, common elements, and use cases for locomotion taxonomies. We aim to support future research on the design, choice, and evaluation of locomotion taxonomies and thereby support future research on virtual reality locomotion.

show abstract

Criteria as a Prelude for Guiding Taxonomy Evaluation

Cited by 23 publications

References 55 publications

Improvement and Evaluation of the TOPCOP Taxonomy of Patient Portals: Taxonomy-Evaluation-Delphi (TED) Approach

Improvement and Evaluation of the TOPCOP Taxonomy of Patient Portals: Taxonomy-Evaluation-Delphi (TED) Approach

Metrics for assessing similarity of jobs

A Systematic Literature Review of Virtual Reality Locomotion Taxonomies

Contact Info

Product

Resources

About