Background There is mounting evidence supporting the effectiveness of task-shifted mental health interventions in low- and middle-income countries (LMIC). However, there has been limited systematic scale-up or sustainability of these programs, indicating a need to study implementation. One barrier to progress is a lack of locally relevant and valid implementation measures. We adapted an existing brief dissemination and implementation (D&I) measure which includes scales for acceptability, appropriateness, feasibility and accessibility for local use and studied its validity and reliability among a sample of consumers in Ukraine. Methods Local qualitative data informed adaptation of the measure and development of vignettes to test the reliability and validity. Participants were veterans and internally displaced persons (IDPs) recruited as part of a separate validity study of adapted mental health instruments. We examined internal consistency reliability, test-retest reliability, and construct and criterion validity for each scale on the measure. We randomly assigned half the participants to respond to a vignette depicting existing local psychiatric services which we knew were not well regarded, while the other half was randomized to a vignette describing a potentially more well-implemented mental health service. Criterion validity was assessed by comparing scores on each scale by vignette and by overall summary ratings of the programs described in the vignettes. Results N = 169 participated in the qualitative study and N = 153 participated in the validity study. Qualitative findings suggested the addition of several items to the measure and indicated the importance of addressing professionalism/competency of providers in both the scales and the vignettes. Internal consistency reliabilities ranged from α = 0.85 for feasibility to α = 0.91 for appropriateness . Test-rest reliabilities were acceptable to good for all scales ( rho: 0.61–0.79). All scales demonstrated substantial and significant differences in average scores by vignette assignment ( ORs: 2.21–5.6) and overall ratings ( ORs: 5.1–14.47), supporting criterion validity. Conclusions This study represents an innovative mixed-methods approach to testing an implementation science measure in contexts outside the United States. Results support the reliability and validity of most scales for consumers in Ukraine. Challenges included large amounts of missing data due to participants’ difficulties responding to questions about a hypothetical program. Electronic supplementary material The online version of this article (10.1186/s12913-019-4097-y) contains supplementary material, which is available to authorized...
BackgroundIn Ukraine, a large number of internally displaced persons (IDPs) and veterans experience social and psychological problems as a result of the ongoing conflict between Ukraine and Russia. Our purpose was to develop reliable and valid instruments to screen for common mental health and alcohol use problems in these populations.MethodsWe used a three-step process of instrument adaptation and testing. The instrument—the Mental Health Assessment Inventory (MHAI)—combines adapted standard screeners with items derived locally in Ukraine. A validity study was conducted using a sample of 153 adults (54% male) ages 18 years and older. All participants in the sample were IDPs or veterans living in or near the major urban areas of Kyiv and Zaporizhia. Reliability testing (internal consistency, test-retest) and validity testing (construct, criterion) of the MHAI were conducted using classical test theory. After initial testing, we used Item Response Theory (IRT) to shorten and further refine the instrument.ResultsThe MHAI showed good internal consistency and test-retest reliability for the main outcomes: depression (α = 0.94; r = .84), post-traumatic stress (PTS; α = 0.97; r = 0.87), anxiety (α = 0.90; r = 0.80), and alcohol use (α = 0.86; r = 0.91). There was good evidence of convergent construct validity among the scales for depression, PTS, and anxiety, but not for alcohol use. Item Response Theory (IRT) analysis supported use of shortened versions of the scales for depression, PTS, and anxiety, as they retained comparable psychometric properties to the full scales of the MHAI.ConclusionThe findings support the reliability and validity of the assessment—the MHAI—for screening of common mental health problems among Ukrainian IDPs and veterans. Use of IRT shortened the instrument to improve practicality and potential sustainability.Electronic supplementary materialThe online version of this article (10.1186/s13031-018-0169-6) contains supplementary material, which is available to authorized users.
Objective: This article reports findings from a qualitative study that sought to identify and describe psychosocial and mental health consequences of conflict among internally displaced persons (IDPs) and military veterans in Ukraine. The study was the first phase of a clinical intervention trial and was designed to understand local experiences of mental health problems and function, inform the selection and adaptation of local measures, and guide the modification, and implementation of a psychotherapy intervention that could support conflict-affected persons. Method: Free-list interviews (FLs), key informant interviews (KIIs), and focus group discussions (FDGs) were conducted with IDPs, military veterans, and providers working with these two groups. A total of 227 respondents were interviewed from two study regions in eastern Ukraine—Zaporizhia and Kharkiv—including 136 IDPs and 91 military veterans. Results: Both IDPs and veterans were described as experiencing high levels of psychological stress symptoms, including depression, isolation, anxiety, and intrusive memories. Although IDPs and veterans were exposed to different traumas, they both identified struggles with social adaptation, including feeling isolated and misunderstood by their communities. Both groups also described relational conflict within and outside the family. Social support mechanisms were considered essential for recovery, and positive social interaction was described as a key example of healthy functioning. Conclusion: Findings suggest a need for community-based programming that facilitates social adaptation, supports social network building, and helps engage conflict-affected people into mental health services. Programs that promote greater awareness, interaction, and understanding among the general public, military veterans, and IDPs are also warranted.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.