Web-Based Assessments of Physical Activity in Youth: Considerations for Design and Scale Calibration

Abstract

This paper describes the design and methods involved in calibrating a Web-based self-report instrument to estimate physical activity behavior. The limitations of self-report measures are well known, but calibration methods enable the reported information to be equated to estimates obtained from objective data. This paper summarizes design considerations for effective development and calibration of physical activity self-report measures. Each of the design considerations is put into context and followed by a practical application based on our ongoing calibration research with a promising online self-report tool called the Youth Activity Profile (YAP).We first describe the overall concept of calibration and how this influences the selection of appropriate self-report tools for this population. We point out the advantages and disadvantages of different monitoring devices since the choice of the criterion measure and the strategies used to minimize error in the measure can dramatically improve the quality of the data. We summarize strategies to ensure quality control in data collection and discuss analytical considerations involved in group- vs individual-level inference. For cross-validation procedures, we describe the advantages of equivalence testing procedures that directly test and quantify agreement. Lastly, we introduce the unique challenges encountered when transitioning from paper to a Web-based tool. The Web offers considerable potential for broad adoption but an iterative calibration approach focused on continued refinement is needed to ensure that estimates are generalizable across individuals, regions, seasons and countries.

Adolescent Physical Activity: Moderation of Individual Factors by Neighborhood Environment

“…The self-reported Youth Activity Profile (YAP) 17 survey items in FLASHE included a 15-item PA questionnaire that asks about activity patterns both during and out of school the previous week, and was designed to provide independent estimates of activity in different settings. The YAP was chosen because it is a validated web-based self-report instrument (consistent with the survey mode) that could be calibrated with objectively measured PA. 18 The school section includes items about activity while commuting to/from school, at physical education, recess/study breaks, and at lunch.…”

Calibration and Validation of the Youth Activity Profile: The FLASHE Study

“…16,17 The calibration approach has been tested with the YAP and demonstrated that predicted values and accelerometer estimates of MVPA were correlated by 0.19–0.75 (depending on the period of the day) and were deemed equivalent at the 10%–30% level. However, this study was done with a sample of 291 youth from Midwest U.S. 18,19 ; therefore, additional work is needed to determine if the YAP calibration approach holds in a different sample and independently of the activity monitor/measurement methodology used.…”

Calibration of Self-Report Measures of Physical Activity and Sedentary Behavior

“…Specifically, calibrated self-reported data of food intake have been used to more accurately quantify the amount of food consumed (13, 25) and to determine unbiased relationships with various health outcomes (24, 31). Calibration models linking self-reported PA data to objectively assessed PA data have shown promise in both children (26) and adults (35). Calibration models to correct for biases in estimating energy expenditure (EE) have also been developed from a study by Neuhouser et al (21).…”