Background The review of collateral information is an essential component of patient care. Although this is standard practice, minimal research has been done to quantify collateral information collection and to understand how collateral information translates to clinical decision making. To address this, we developed and piloted a novel measure (the McLean Collateral Information and Clinical Actionability Scale [M-CICAS]) to evaluate the types and number of collateral sources viewed and the resulting actions made in a psychiatric setting. Objective This study aims to test the feasibility of the M-CICAS, validate this measure against clinician notes via medical records, and evaluate whether reviewing a higher volume of collateral sources is associated with more clinical actions taken. Methods For the M-CICAS, we developed a three-part instrument, focusing on measuring collateral sources reviewed, clinical actions taken, and shared decision making between the clinician and patient. To determine feasibility and preliminary validity, we piloted this measure among clinicians providing psychotherapy at McLean Hospital. These clinicians (n=7) completed the M-CICAS after individual clinical sessions with 89 distinct patient encounters. Scales were completed by clinicians only once for each patient during routine follow-up visits. After clinicians completed these scales, researchers conducted chart reviews by completing the M-CICAS using only the clinician’s corresponding note from that session. For the analyses, we generated summary scores for the number of collateral sources and clinical actions for each encounter. We examined Pearson correlation coefficients to assess interrater reliability between clinicians and chart reviewers, and simple univariate regression modeling followed by multilevel mixed effects regression modeling to test the relationship between collateral information accessed and clinical actions taken. Results The study staff had high interrater reliability on the M-CICAS for the sources reviewed (r=0.98; P<.001) and actions taken (r=0.97; P<.001). Clinician and study staff ratings were moderately correlated and statistically significant on the M-CICAS summary scores for the sources viewed (r=0.24, P=.02 and r=0.25, P=.02, respectively). Univariate regression modeling with a two-tailed test demonstrated a significant association between collateral sources and clinical actions taken when clinicians completed the M-CICAS (β=.27; t87=2.47; P=.02). The multilevel fixed slopes random intercepts model confirmed a significant association even when accounting for clinician differences (β=.23; t57=2.13; P=.04). Conclusions This pilot study established the feasibility and preliminary validity of the M-CICAS in assessing collateral sources and clinical decision making in psychiatry. This study also indicated that reviewing more collateral sources may lead to an increased number of clinical actions following a session.
BACKGROUND The review of collateral information is an essential component of patient care. Though this is standard practice, minimal research has been devoted to quantifying collateral information collection and to understanding how collateral information translates to clinical decision-making. To address this, we developed and piloted a novel measure (the McLean collateral information and clinical actionability scale (M-CICAS)) to evaluate the types and number of collateral sources viewed and resulting actions made in a psychiatric setting. OBJECTIVE Study aims included: 1) feasibility testing of the M-CICAS measure, 2) validating this measure against clinician notes via medical records, and 3) evaluating whether reviewing a higher volume of collateral sources is associated with more clinical actions taken. METHODS For the M-CICAS measure, we developed a three-part instrument, focusing on measuring collateral sources reviewed, clinical actions taken, and shared decision-making between clinician and patient. We recruited clinicians providing psychotherapy services at McLean hospital (N = 7) to complete the M-CICAS measure after individual clinical sessions. We also independently completed the M-CICAS using only the clinician’s corresponding note from that session, in order to validate the reported measure against the electronic health record which served as the objective point of comparison. Based on this, we estimated inter-rater reliability, reporting validity and whether significant variance in clinical actions taken could be attributed to inter-clinician differences. RESULTS Study staff had high interrater reliability on the M-CICAS for the sources reviewed (r=0.98, P<.001) and actions taken (r=0.97, P <.001). Clinician and study staff ratings were moderately correlated and statistically significant on the M-CICAS summary scores for the sources viewed (r’s=0.24 and 0.25, P=.02202 and P=.0188, respectively). Univariate regression modelling demonstrated a significant association between collateral sources and clinical actions taken when clinicians completed the M-CICAS (B=.27, t=2.47, P =.015). Multilevel fixed slopes random intercepts model confirmed a significant association even when accounting for clinician differences (B=.23, t=2.13, P =.037). CONCLUSIONS This pilot study establishes feasibility and preliminary validity for the M-CICAS measure in assessing collateral sources and clinical decision-making in psychiatry. This study also indicated that reviewing more collateral sources may lead to an increased number of clinical actions following a session.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.