Development and Usability Evaluation of GreyMatters: A Memory Clinic Information System

Abstract

Objective This paper presents the development process of GreyMatters, a memory clinic system, outlining the conceptual, practical, technical, and ethical aspects, and focuses on the usability evaluation of the system. There was a need for a system to be developed for the memory clinics of Berkshire Healthcare National Health Service (NHS) Foundation Trust (BHFT) to aid the clinical and administrative processes of assessing, diagnosing, managing, and treating patients with cognitive disorders and mental health problems. Methods The methodology for development of the information system involved phases of requirements gathering, modeling, and prototype creation, and “bench testing” the prototype with experts. The standard Institute of Electrical and Electronics Engineers (IEEE) recommended approach for the specifications of software requirements was adopted. An electronic health record (EHR) standard (EN13606) was used, and clinical modeling was done through archetypes and the project complied with data protection and privacy legislation. Usability evaluation of GreyMatters was done using the IBM questionnaires. Results Though the initial development was complex, the requirements, methodology, and standards adopted made the construction, deployment, adoption, and population of a memory clinic and research database feasible. The electronic patient data including the assessment scales and scores provide a rich source of objective data for audits and research. In the usability evaluation of GreyMatters, overall responses to the Computer System Usability Questionnaire and After-Scenario Questionnaire demonstrated mild-to-moderate satisfaction with the overall system and with individual tasks. The results support that the system is an acceptable tool for clinical, administrative, business, and research use and forms a useful part of the wider information architecture. The implementation and sustainability issues and the lessons learnt were noted. Discussion The development of a system needs to take into account the existing data collection methods and other information systems that will be used alongside. Use of graphical development tools to communicate requirements, build interfaces, and prototype may improve the quality and efficiency of system development. Standardized data collection assists in the provision of reports for clinical, audit, and service development use to meet the requirements of commissioners and to allow the easier identification of potential research participants. It is possible that in the usability evaluation, the satisfaction scores are overall lower due to the extra complication of using this system in addition to the Trust's main EHR. The small number of users is a limitation. Conclusion The establishment of requirements and methodology, addressing issues of data security and confidentiality, future data compatibility, and interoperability and medicolegal aspects, such as access controls and audit trails, led to a robust and useful system. The system was modeled around health record standards that are based on long established research on EHR standards and archetypes which differentiates GreyMatters from simple web-based capture forms that were built in house by the Trust. Its strength is that it provides flexibility to record clinical information that the existing Trust systems can't. The evaluation supports that the system is an acceptable tool for clinical, administrative, and research use. Some aspects of the system like prescribing module do need further work.

Development of a Healthcare Information System for Community Care of Older Adults and Evaluation of Its Acceptance and Usability

“…), where a medium level of satisfaction was concluded based on the results of CSUQ, with the mean scores of the four subscales ranging within 3.0 to 4.0 for one system, and within 3.6 to 5.6 for the other (converted to a 7-point scale for comparison here). Compared to an information system developed for clinics serving patients with cognitive disorders and mental health problems, 30 the usability was determined to be at the mild-to-moderate level of satisfaction, where the overall score rated by all the 10 users was 4.6 and the administrative staff rated the lowest at 4.3 (the scores quoted here were reversed since a 7-point scale in ascending order of disagreement was adopted in that study). Extra workload due to the entry of additional data and complications caused by the need of cross-referencing multiple sources were among the reasons for the administrative staff's low satisfaction.…”

“…It has been used for evaluating user satisfaction toward nursing information systems, 7 home-based telemedicine systems for older adults, 29 and clinical information systems for cognitive disorders and mental health. 30 The CUSQ is a 7-point Likert questionnaire consisting of four subscales with a total of 19 items. The first three subscales are System Usefulness , Information Quality, and Interface Quality , accounting for the first 18 items of the questionnaire.…”