Patient information organization in the intensive care setting: expert knowledge elicitation with card sorting methods

Reese, Thomas J.; Segall, Noa; Nesbitt, Paige; Fiol, Guilherme Del; Waller, Rosalie; Macpherson, Brekk C.; Tonna, Joseph E.; Wright, Melanie C.

doi:10.1093/jamia/ocy045

Cited by 11 publications

(8 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There was convergent evidence to support gains in provider efficiency and accuracy by grouping conceptually-related information on a common display. Although there are examples of translation of improved information organization displays into commercial products (AWARE™) [109,110], there is substantial opportunity to improve the presentation of information in EHRs through integrated displays [3,60,111]. For example, response time to simulated realistic clinical decisions was 12% faster when clinicians used a display that integrated data from a conventional patient monitor with infusion pump data than when clinicians used conventional, separated, patient monitors and infusion pump displays [57].…”

Section: Discussionmentioning

confidence: 99%

Critical care information display approaches and design frameworks: A systematic review and meta-analysis

Wright

Borbolla

Griffin

et al. 2019

Journal of Biomedical Informatics

Self Cite

View full text Add to dashboard Cite

Objective: To systematically review original user evaluations of patient information displays relevant to critical care and understand the impact of design frameworks and information presentation approaches on decision-making, efficiency, workload, and preferences of clinicians. Methods: We included studies that evaluated information displays designed to support real-time care decisions in critical care or anesthesiology using simulated tasks. We searched PubMed and IEEExplore from 1/1/1990 to 6/30/2018. The search strategy was developed iteratively with calibration against known references. Inclusion screening was completed independently by two authors. Extraction of display features, design processes, and evaluation method was completed by one and verified by a second author. Results: Fifty-six manuscripts evaluating 32 critical care and 22 anesthesia displays were included. Primary outcome metrics included clinician accuracy and efficiency in recognizing, diagnosing, and treating problems. Implementing user-centered design (UCD) processes, especially iterative evaluation and redesign, resulted in positive impact in outcomes such as accuracy and efficiency. Innovative display approaches that led to improved human-system performance in critical care included: (1) improving the integration and organization of information, (2) improving the representation of trend information, and (3) implementing graphical approaches to make relationships between data visible. Conclusion: Our review affirms the value of key principles of UCD. Improved information presentation can facilitate faster information interpretation and more accurate diagnoses and treatment. Improvements to information organization and support for rapid interpretation of time-based relationships between related quantitative data is warranted. Designers and developers are encouraged to involve users in formal iterative design and evaluation activities in the design of electronic health records (EHRs), clinical informatics applications, and clinical devices.

show abstract

Section: Discussionmentioning

confidence: 99%

Critical care information display approaches and design frameworks: A systematic review and meta-analysis

Wright

Borbolla

Griffin

et al. 2019

Journal of Biomedical Informatics

Self Cite

View full text Add to dashboard Cite

show abstract

“…Community-based participatory research (CBPR), a well-developed model of relational research, offers a valuable framework for conducting research with community members to elicit understanding and identify stakeholder preferences and concerns. Utilization of the proposed qualitative methods within a CBPR framework will help identify the unmet needs of rural community members in the context of lived experience (Wright et al, 2019 ; Wallerstein, 2017 ; Reese et al, 2018 ). The World Health Organization (WHO) Strategic Advisory Group of Experts (SAGE) framework for vaccine hesitancy served as the strongest driver for the proposed research and assessment including contextual influences; individual and/or social group influences; vaccine and vaccination-specific issues.…”

Section: Methodsmentioning

confidence: 99%

“…Vaccination remains one of the most effective ways to limit the spread of infectious diseases, reduce mortality, and morbidity. Ongoing research suggests that 70% of the United States (US) population will need to receive the COVID-19 vaccine to achieve herd immunity; however, the projected COVID-19 vaccine uptake is far lower than 70% necessary (Reese et al, 2018 ; Godin and Kok, 1996 ).…”

Section: Introductionmentioning

confidence: 99%

Factors contributing to vaccine hesitancy and reduced vaccine confidence in rural underserved populations

Robinson

Nguyen

Wright

et al. 2022

Humanit Soc Sci Commun

View full text Add to dashboard Cite

Vaccination remains one of the most effective ways to limit the spread of infectious diseases, and reduce mortality and morbidity in rural areas. Waning public confidence in vaccines, especially the COVID-19 vaccine, remains a cause for concern. A number of individuals in the US and worldwide remain complacent, choosing not to be vaccinated and/or delay COVID-19 vaccination, resulting in suboptimal herd immunity. The primary goal of this study is to identify modifiable factors contributing to COVID-19 vaccine hesitancy among vaccine-eligible individuals with access to vaccines in two under-resourced rural states, Alaska and Idaho. This qualitative study used semi-structured interviews with providers and focus groups with community participants in Alaska and Idaho. A moderator’s guide was used to facilitate interviews and focus groups conducted and recorded using Zoom and transcribed verbatim. Thematic, qualitative analysis was conducted using QDA Miner. Themes and subthemes that emerged were labeled, categorized, and compared to previously described determinants of general vaccine hesitancy: established contextual, individual and/or social influences, vaccine and vaccination-specific concerns. Themes (n = 9) and sub-themes (n = 51) identified during the qualitative analysis highlighted a factor’s contributing to COVID-19 vaccine hesitancy and poor vaccine uptake. Relevant influenceable factors were grouped into three main categories: confidence, complacency, and convenience. Vaccines are effective public health interventions to promote health and prevent diseases in rural areas. Practical solutions to engage healthcare providers, researchers, vaccine advocates, vaccine manufacturers, and other partners in local communities are needed to increase public trust in immunization systems to achieve community immunity.

show abstract

“…• A customized and quantitative version of the Delphi method (Reese et al, 2018b) has been implemented to share knowledge and help participants decide based on the classifications already made by other participants. This enriches the elicitation of the user's mental model in a group and sets up different experiments according to the evaluator criteria.…”

Section: Contributionmentioning

confidence: 99%

A Supporting Tool for Enhancing User’s Mental Model Elicitation and Decision-Making in User Experience Research

Martín

Macías

2022

International Journal of Human–Computer Interaction

View full text Add to dashboard Cite

User Experience (UX) research is intended to find insights and elicit applicable requirements to guide usable designs. Card Sorting is one of the most utilized methods. It is used to uncover the user's mental model and increase the usability of existing products. However, although Card Sorting has been widely utilized, most applications are based on spreadsheets. Furthermore, existing tools are principally intended to obtain qualitative information or customized quantitative outcomes to improve the information architecture. In this paper, a supporting tool based on the Card Sorting method is presented and detailed, including a comprehensive use case showing the main features. The tool implements predictive analysis of results through advanced statistics and machine learning techniques, providing comprehensive reports that enable evaluators and UX researchers to obtain high-level knowledge and important quantitative clues to enhance decision-making. The tool has been evaluated with participants and evaluators, obtaining relevant usability results and feedback.

show abstract

Patient information organization in the intensive care setting: expert knowledge elicitation with card sorting methods

Cited by 11 publications

References 26 publications

Critical care information display approaches and design frameworks: A systematic review and meta-analysis

Critical care information display approaches and design frameworks: A systematic review and meta-analysis

Factors contributing to vaccine hesitancy and reduced vaccine confidence in rural underserved populations

A Supporting Tool for Enhancing User’s Mental Model Elicitation and Decision-Making in User Experience Research

Contact Info

Product

Resources

About