Relationship of Press Ganey Satisfaction and PROMIS Function and Pain in Foot and Ankle Patients

Abstract

Background: Patient satisfaction has garnered interest as a tool to measure health care quality. However, orthopedic studies in total joint arthroplasty, spine, and hand patients have offered conflicting relationships between Press Ganey (PG) satisfaction metrics and patient-reported outcome (PRO) measures. No prior study has assessed the relationship between PG and PROs in foot and ankle patients. Whether satisfaction and outcomes instruments, though, measure similar or differing aspects of the patient experience is unclear. Here, we tested if there was an association between Patient-Reported Outcomes Measurement Information System (PROMIS) outcomes and PG satisfaction scores. Methods: PG and PROMIS outcomes data for new patient visits to an orthopedic foot and ankle clinic between 2015 and 2017 were retrospectively analyzed. Patients that completed PG satisfaction surveys were included for study. All patients who completed PG surveys and completed one or both PROMIS physical function (PF) or pain interference (PI) metrics administered by computerized adaptive testing were included. Negative binomial regressions were used to compare PRO scores to PG overall satisfaction and PG satisfaction with care provider, adjusting for patient characteristics. Results were reported as dissatisfaction score ratios, which represented the amount of PG dissatisfaction associated with a 10-point increase in PROMIS PF or PI. Of the 3984 new patient visits, only 441 completed the PG survey (11.3% response rate). Results: Ceiling effects were seen with PG data: 64% of patients reported perfect satisfaction with care provider and 27% had perfect overall satisfaction. Higher function on the PROMIS PF was weakly associated with increased overall satisfaction (ratio = 0.82, 95% CI: 0.68-0.99, P = .039) and increased satisfaction with care provider (ratio = 0.60, 95% CI: 0.40-0.92, P = .019). However, pain (PROMIS PI) was not associated with overall satisfaction or with satisfaction with care provider. Conclusions: Based on our data here, patient satisfaction was weakly related to patient-reported function but not pain interference among this subset of new patients presenting to a foot and ankle clinic. Given our essentially negative findings, further study is needed to determine which aspects of the PG satisfaction and PROMIS scores track similarly. Further, our findings add to the growing literature showcasing limitations of the PG tool, including low response rates and notable ceiling effects. If satisfaction metrics and patient-reported outcomes capture differing aspects of the patient experience, we need to better understand how that influences the measurement of health care quality and value. Level of Evidence: Level III, comparative study.

Does Adjusting for Social Desirability Reduce Ceiling Effects and Increase Variation of Patient-Reported Experience Measures?

“…Another study of 1,644 adolescents in Northwestern Burkina Faso (14) randomized people to a conventional verbal response arm (high social desirability bias environment) and a nonverbal response arm (low social desirability bias environment) and found significantly higher levels of reported sexual assault and forced sex in the non-verbal response (14). These findings suggest that social desirability could be part of the explanation of ceiling effects and nonparametric distributions of the current PREMs, but there are a variety of other modifiable and non-modifiable patient factors that may explain why patients are likely to give us top scores (15–23). Although it may be flattering for physicians to receive top scores, it may contribute to a false sense that there is no further opportunity for improvement.…”

What’s New in Foot and Ankle Surgery

“…Correlations between the 2 systems have rarely been evaluated. Nixon et al 3 found that these correlations were strikingly weak. They compared the Press Ganey survey of patient satisfaction with the validated Patient-Reported Outcomes Measurement Information System (PROMIS) outcome measures in patients with foot and ankle orthopaedic issues.…”

Emerging Need for PROMs to Measure the Impact of Spine Disorders on Overall Health and Well-being: Measuring Expectations as an Example for Lumbar Degenerative Spondylolisthesis

“…Comprehensive assessments addressing patients' experiences with the process and provision of health care have recently gained popularity; however, they have shown little association with PROMs [1,7,8,21,30]. Other than assessing global satisfaction and generic health-related quality of life (ie, not linked to a certain condition), there are no comprehensive assessments to capture how patients rate the impact of their spine condition on their overall health and well-being.…”