Comparison of Consumer Rankings With Centers for Medicare & Medicaid Services Five-Star Rankings of Nursing Homes

Abstract

IMPORTANCE The Centers for Medicare & Medicaid Services (CMS) Five-Star measure for nursing homes is designed with input from expert panels about the importance of multiple quality indicators. Consumers may assign different values to these indicators, creating different 5-star ratings. OBJECTIVE To compare nursing homes' rankings based on the CMS Five-Star measure with rankings based on consumers' judgment about the importance of the same quality indicators. DESIGN, SETTING, AND PARTICIPANTS In this quality improvement study, CMS Five-Star data were linked with a measure calculated from CMS quality indicators and consumer values obtained from a national survey. Data covered the last quarter of 2016 and the first three quarters of 2017. The study included 10 676 nursing homes, comprising 69.8% of those with reported Five-Star measures. The national survey included adults, either nursing home residents or their family members who reported being familiar with the quality of care their relative received. Data analysis was performed from January 2019 to February 2020. MAIN OUTCOMES AND MEASURES The contingent valuation method was administered via the survey to obtain consumers' relative values of the quality indicators, and statistical analyses were used to create the contingent valuation measure. Agreement in nursing home rankings was assessed using the Five-Star measure, which is based on weights developed by expert panels, compared with rankings based on the contingent valuation measure. RESULTS Among 10 676 study nursing homes with a mean (SD) of 119.4 (59.4) beds, 7845 (73.5%) were for profit, 6424 (61.8%) were part of a chain, and 8009 (75.0%) were urban. The 4310 survey respondents (mean [SD] age, 39.9 [15.6] years; 1143 [26.5%] men; 3448 [80%] white) included mostly family members (3879 participants [90.0%]). The Pearson correlation coefficient (0.65) and weighted κ statistics (0.48) indicated only moderate agreement between ranking of nursing homes' performance by the 2 measures and disagreement on ranking for approximately one-half of the nursing homes. CONCLUSIONS AND RELEVANCE Current nursing home report cards might not reflect consumers' values and the relative importance consumers place on each of the quality indicators that compose the overall Five-Star measure. Quality report cards might be more relevant to consumers by augmenting the Five-Star measure with a measure reflecting consumers' preferences. It is unknown whether these conclusions are generalizable to other report cards, such as Hospital and Home Health Compare, without conducting similar studies for these report cards.

Daily Variation in Nursing Home Staffing and Its Association With Quality Measures

“…15 These are the 5-Star Survey and the 5-Star Quality Measures, which rate nursing homes on a scale from 1 (much below average) to 5 (much above average). These composite quality measures 18 have been shown to inform behavior of patients 19 , 20 and nursing homes. 21 , 22 , 23 …”

Potentially More Out of Reach: Public Reporting Exacerbates Inequities in Home Health Access

“…Another potential reason for our findings may be that publicly reported composite star ratings may not report measures of interest to Hispanic/Latine and Asian American/Pacific Islander populations, so this study may not be measuring the quality that all groups care about. 58,59 Future work should approach this study with varied measures of quality, including the patient experience star ratings. In fact, recent research has found a weak correlation between patient experience star ratings and the quality-of-care star ratings used in this study.…”

Assessment of Consumer Complaint Investigation Scores, Recertification Survey Scores, and Overall Nursing Home Health Inspection Star Quality Rating

“…The researchers suggested adding such information to Care Compare, formerly Nursing Home Compare. 24,25 While CMS continues to revise the data provided to the public on nursing home quality, recently adding more detailed staffing data, 26 This challenge leaves the policy question of how the complaint process could be used to inform the public about quality concerns that may not be evident in recertification surveys. This question is important in light of recent proposals to survey high-performing nursing homes less frequently.…”

“…As another way to augment the star ratings, a consumer-based measure of quality has been studied, with evidence indicating consumers place value on several nontechnical dimensions (eg, attentiveness to residents, physical environment) not captured in the Five-Star system ratings. The researchers suggested adding such information to Care Compare, formerly Nursing Home Compare . While CMS continues to revise the data provided to the public on nursing home quality, recently adding more detailed staffing data, it has demonstrated no clear progress toward adding consumer-focused quality data.…”