Do smartphone usage scales predict behavior?

Abstract

Understanding how people use technology remains important, particularly when measuring the impact this might have on individuals and society. However, despite a growing body of resources that can quantify smartphone use, research within psychology and social science overwhelmingly relies on self-reported assessments. These have yet to convincingly demonstrate an ability to predict objective behavior. Here, and for the first time, we compare a variety of smartphone use and 'addiction' scales with objective behaviors derived from Apple's Screen Time application. While correlations between psychometric scales and objective behavior are generally poor, single estimates and measures that attempt to frame technology use as habitual rather than 'addictive' correlate more favorably with subsequent behavior. We conclude that existing self-report instruments are unlikely to be sensitive enough to accurately predict basic technology use related behaviors. As a result, conclusions regarding the psychological impact of technology are unreliable when relying solely on these measures to quantify typical usage.

Teenagers, screens and social media: a narrative review of reviews and key studies

“…It also needs to be noted that there has been increasing discontent about the measurement practices used in the area. Researchers argue that there are now the psychometric tools available to move away from measuring self-reported screen time [3,17,18,73], which is known to be a flawed measure of media effects [51]. Better measurement of digital technology and social media use could lead to more exact and consistent results in the literature.…”

The relationship between online vigilance and affective well-being in everyday life: Combining smartphone logging with experience sampling

“…Traditionally, the majority of research on smartphone use and well-being has relied on self-reports of usage behavior (for a recent critique, see Ellis, 2019). However, there is increasing evidence that people are poor estimators of their phone use, casting doubt on the validity of self-reported screen time (Ellis, Davidson, Shaw, & Geyer, 2019;Scharkow, 2016;Wilcockson, Ellis, & Shaw, 2018). Moreover, it is questionable whether general trait measures are predictive of behavior in the moment (e.g., Masur, 2018).…”

The Ethics of Digital Well-Being: A Multidisciplinary Perspective

“…The next years will see more and more psychologists moving away from general 'screen time' to using more digital tracking and fine-grained digital usage data -if such data is provided by the companies that hold them (Ellis et al 2019). They could then examine how specific uses of technologies might affect certain cognitions (e.g.…”