Abstract:The authors utilized numerous documents created by advisory groups, expert panels and multicultural focus groups to develop performance measures for assessing the cultural competency of mental health systems. Competency was measured within three levels of organizational structure: administrative, provider network, and individual caregiver. Indicators, measures and data sources for needs assessment, information exchange, services, human resources, plans and policies, and outcomes were identified. Procedures for… Show more
“…In the 1990s, the growth of managed care delivery systems in behavioral health raised the need for quality assurance and accountability instruments, and led to an increase in the number of publications on the development of performance measures in scientific literature. A total of 121 measures for various aspects and dimensions of the performance of public mental health providers, services, and systems were proposed [20,22,24,25,27,29,33,36]. …”
BackgroundThe development and use of performance indicators (PI) in the field of public mental health care (PMHC) has increased rapidly in the last decade. To gain insight in the current state of PI for PMHC in nations and regions around the world, we conducted a structured review of publications in scientific peer-reviewed journals supplemented by a systematic inventory of PI published in policy documents by (non-) governmental organizations.MethodsPublications on PI for PMHC were identified through database- and internet searches. Final selection was based on review of the full content of the publications. Publications were ordered by nation or region and chronologically. Individual PI were classified by development method, assessment level, care domain, performance dimension, diagnostic focus, and data source. Finally, the evidence on feasibility, data reliability, and content-, criterion-, and construct validity of the PI was evaluated.ResultsA total of 106 publications were included in the sample. The majority of the publications (n = 65) were peer-reviewed journal articles and 66 publications specifically dealt with performance of PMHC in the United States. The objectives of performance measurement vary widely from internal quality improvement to increasing transparency and accountability. The characteristics of 1480 unique PI were assessed. The majority of PI is based on stakeholder opinion, assesses care processes, is not specific to any diagnostic group, and utilizes administrative data sources. The targeted quality dimensions varied widely across and within nations depending on local professional or political definitions and interests. For all PI some evidence for the content validity and feasibility has been established. Data reliability, criterion- and construct validity have rarely been assessed. Only 18 publications on criterion validity were included. These show significant associations in the expected direction on the majority of PI, but mixed results on a noteworthy number of others.ConclusionsPI have been developed for a broad range of care levels, domains, and quality dimensions of PMHC. To ensure their usefulness for the measurement of PMHC performance and advancement of transparency, accountability and quality improvement in PMHC, future research should focus on assessment of the psychometric properties of PI.
“…In the 1990s, the growth of managed care delivery systems in behavioral health raised the need for quality assurance and accountability instruments, and led to an increase in the number of publications on the development of performance measures in scientific literature. A total of 121 measures for various aspects and dimensions of the performance of public mental health providers, services, and systems were proposed [20,22,24,25,27,29,33,36]. …”
BackgroundThe development and use of performance indicators (PI) in the field of public mental health care (PMHC) has increased rapidly in the last decade. To gain insight in the current state of PI for PMHC in nations and regions around the world, we conducted a structured review of publications in scientific peer-reviewed journals supplemented by a systematic inventory of PI published in policy documents by (non-) governmental organizations.MethodsPublications on PI for PMHC were identified through database- and internet searches. Final selection was based on review of the full content of the publications. Publications were ordered by nation or region and chronologically. Individual PI were classified by development method, assessment level, care domain, performance dimension, diagnostic focus, and data source. Finally, the evidence on feasibility, data reliability, and content-, criterion-, and construct validity of the PI was evaluated.ResultsA total of 106 publications were included in the sample. The majority of the publications (n = 65) were peer-reviewed journal articles and 66 publications specifically dealt with performance of PMHC in the United States. The objectives of performance measurement vary widely from internal quality improvement to increasing transparency and accountability. The characteristics of 1480 unique PI were assessed. The majority of PI is based on stakeholder opinion, assesses care processes, is not specific to any diagnostic group, and utilizes administrative data sources. The targeted quality dimensions varied widely across and within nations depending on local professional or political definitions and interests. For all PI some evidence for the content validity and feasibility has been established. Data reliability, criterion- and construct validity have rarely been assessed. Only 18 publications on criterion validity were included. These show significant associations in the expected direction on the majority of PI, but mixed results on a noteworthy number of others.ConclusionsPI have been developed for a broad range of care levels, domains, and quality dimensions of PMHC. To ensure their usefulness for the measurement of PMHC performance and advancement of transparency, accountability and quality improvement in PMHC, future research should focus on assessment of the psychometric properties of PI.
“…We briefly summarize highlights of the background work preceding the development of the CCAS, as already reported in two articles (Siegel et al 2000; Siegel et al 2003) in this journal. The CCAS is comprised of selected performance measures of CC identified by the panel and benchmarked in a subsequent study.…”
The NKI Cultural Competency Assessment Scale measures organizational CC in mental health out-patient settings. We describe its development and results of tests of its psychometric properties. When tested in 27 public mental health settings, factor analysis discerned three factors explaining 65% of the variance; each factor related to a stage of implementation of CC. Construct validity and inter-rater reliability were satisfactory. In tests of predictive validity, higher scores on items related to linguistic and service accommodations predicted a reduction in service disparities for engagement and retention outcomes for Hispanics. Disparities for Blacks essentially persisted independent of CC scores.
“…Staff diversity at all levels in the organization, a monitoring system for hiring and promoting racial/ethnic minority staff, and the presence of a committee comprised of racial/ethnic minorities that is dedicated to maintaining diversity and CLC (e.g., Darnell and Kuperminc 2006; Whaley and Longoria 2008) are key features of CLC within the organizational infrastructure. CLC within the service delivery component is often manifested through: (1) organizational values and policies that support CLC (Hernandez et al 2006, 2009), (2) the recognition of cultural differences and characteristics in the service population, and (3) ongoing assessment of the organization’s ability to meet the needs of racial/ethnic minorities (e.g., Cross et al 1989; Siegel et al 2000; Sue and Sue 1999). Consideration of these overall system-level factors in the development of CLC in systems of care is important because such factors can determine whether culturally and linguistically competent attitudes and practices are accepted and maintained.…”
As US demographic trends shift toward more diversity, it becomes increasingly necessary to address differential needs of diverse groups of youth in mental health service systems. Cultural and linguistic competence (CLC) is essential to providing the most appropriate mental health services to youth and their families. The successful implementation of CLC often begins at the system level. Though various factors may affect change and system-level factors set the tone for broad acceptance of CLC within systems, there is limited empirical evidence linking culturally competent practices to outcomes. The purpose of the present study was to examine system-level CLC changes over time within systems of care and their associations with service experiences among youth and their families. Participants were 4,512 youth and their families enrolled in the national evaluation of the Children’s Mental Health Initiative (CMHI). Results suggest that implementation of CLC at the system level improves over time in funded systems of care. Further, variation exists in specific system-level components of CLC. In addition, the changes in CLC at the system level are related to family/caregiver participation in treatment. Implications for supporting positive changes in CLC among systems of care communities, and specific strategies for community psychologists, are discussed.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.