Using self-reported data to assess the validity of driving simulation data

Abstract

In this article, we use self-reported driving behaviors from a written questionnaire to assess the measurement validity of data derived from a driving simulation. The issue of validity concerns the extent to which measures from the experimental context map onto constructs of interest. Following a description of the experimental methods and setting, an argument for the face validity of the data is advanced. Convergent validity was assessed by regressing behaviors observed in the driving simulator on self-reported measures of driving behaviors. Significant relationships were found across six measures: accidents, speeding, velocity, passing, weaving between traffic, and behavior at stop signs. Concurrent validity was evaluated with an analysis of simulator accident involvement and attention deficit hyperactivity disorder status. Discriminant validity was assessed using a multitrait-multimethod matrix of simulator and questionnaire data. We concluded that although the relationship between self-reported behaviors and observed responses in the simulator falls short of perfect correspondence, the data collected from the driving simulator are valid measures of the behaviors of interest.

A novel computer test to assess driving-relevant cognitive functions – a pilot study

“…Furthermore, the classification between safe drivers (without crashes) and unsafe drivers (with crashes in the preceding two years) is based on self-reports alone, a method which is supported by some studies (Lee et al, 2003;Reimer et al, 2006) but challenged by others (Wåhlberg, 2003). Research supports the construct validity of self-reported crash-involvement as proxy measure for driving performance (Lee et al, 2003;Reimer et al, 2006) but part of the criticism is about the duration of time period under consideration, the negligence of culpability, and the retrospective assessment of driving behavior (Wåhlberg, 2003). To overcome the part of the criticism, we followed the suggestions by Wåhlberg (2003), and considered only the preceding two years of driving and crashes, in which participants considered themselves at least partly at fault.…”

Driver's visual attention as a function of driving experience and visibility. Using a driving simulator to explore drivers’ eye movements in day, night and rain driving

“…One of the issues that researchers are concerned with when using driving simulators is the fact the drivers' behaviour will not be the same under simulated driving since there is not any risk involved (Reimer et al, 2006).…”

Calibration of microscopic traffic-flow models using multiple data sources

“…They also concluded that, although participants generally drove faster in real life than in the driving simulator, the driving simulator possesses relative validity. Finally, Reimer et al (2006) conducted a validation study on driving simulators using self-reports. Significant relationships were found with regard to accidents, speeding, velocity, overtaking and behaviour at traffic signs.…”