The consequences of self‐reporting biases: Evidence from the crash preventability program

Abstract

Relying on firms to self-report information is an information-gathering mechanism that often results in biased measures due to the incentives of the reporting firms. What is less commonly understood is that using self-reported information for decision-making results in endogenous selection bias, which creates spurious associations between the measure being reported and factors that influence reporting. Thus, conditioning on self-reported information can lead to inaccurate evaluations of firms and bias predictions of future performance, even when the self-reported measure is not intentionally misrepresented. We examine endogenous selection bias in self-reporting regimes using directed acyclic graphs (DAGs). We illustrate the problem using data from a policy change by the U.S. Department of Transportation that allowed firms to report not-at-fault for accidents. We find that large for-hire firms are much more likely to report not-at-fault for accidents-over 40 times more likely than independent drivers-even after controlling for time, location, and weather. When comparing independent drivers with large firms, the reporting disparities make large firms appear 25% safer when using at-fault accidents versus all accidents while providing no improvement in predicting future accidents. This study highlights the consequences of poorly designed informationgathering mechanisms and the usefulness of DAGs for understanding causality in supply chain research.

Improving Clinician Confidence in Insulin Prescriptions at Discharge for Individuals With Newly Diagnosed Type 1 Diabetes

“…However, the results have been very encouraging and support the incorporation of the guidelines into the hospital's pediatric program and network. Self-reported measures have their limitations, as there is a possibility of over-reporting confidence or a lack of correlation between self-reported confidence and proficiency in the clinical task [ 16 ]. To mitigate self-report bias, survey participants were provided with anonymous identification.…”

Exploring the indirect links between enterprise risk management and the financial performance of SMEs

“…Unlike objective measures, which are not affected by personal bias and are represented by facts, the subjective self-reporting is associated with possible biases negatively affecting validity and reliability. Using self-reported information for decision-making results in endogenous selection bias which creates spurious associations between the measure being reported and factors that influence reporting (Scott and Balthrop 2021 ). However, self-reporting through the batteries of questions is the standard form of information-gathering mechanism for Structural Equation Modelling which effectively tests the relationship between latent variables (Hatcher 2013 ).…”

Do voluntary environmental programs matter? Evidence from the EPA SmartWay program

“…We match on five covariates that are commonly used in prior motor carrier research (Cantor et al, 2017; Miller et al, 2020; Scott & Nyaga, 2019)— Firm Size , For‐hire , Private , Other , and General Freight —that are likely to affect selection into the SmartWay Program. We stratify firms by size using bins of 50 to 100 trucks, 101 to 500 trucks, 501 to 1000 trucks, 1001 to 5000 trucks, and 5001 to 50,000 trucks, which is similar to that of other studies on the trucking industry (e.g., Scott & Balthrop, 2021), and use exact matching on the other covariates. The firms that participated in SmartWay for all years from 2012 to 2019 ( SmartWay All Years ) is the treated group for the matched sample and the matched firms that never joined SmartWay is the control group.…”