A systematic review of social‐validity assessments in the Journal of Applied Behavior Analysis: 2010–2020

Abstract

We conducted a systematic review of studies published in the Journal of Applied Behavior Analysis between 2010 and 2020 to identify reports of social validity. A total of 160 studies (17.60%) published during this time included a measure of social validity. For each study, we extracted data on (a) the dimensions of social validity, (b) the methods used for collecting social‐validity data, (c) the respondents, and (d) when social‐validity data were collected. Most social‐validity assessments measured the acceptability of intervention procedures and outcomes, with fewer evaluating goals. The most common method for collecting social validity data was Likert‐type rating scales, followed by non‐Likert‐type questionnaires. In most studies, the direct recipients of the intervention provided feedback on social validity. Social‐validity assessment data were often collected at the conclusion of the study. We provide examples of social‐validity measurement methods, discuss their strengths and limitations, and provide recommendations for improving the future collection and reporting of social‐validity data.