Conditioning and Bias in Consumer Panels - Some New Results

Online access panels and tracking research: the conditioning issue

“…These researchers observe that panel conditioning has been singled out as 'the most significant risk attending panel data', but then they conclude that this is the result of speculation rather than direct evidence. Buck et al (1977) quote a number of studies that, on balance, do not seem to support any strong conditioning effect in relation to long-term purchasing panels.…”

“…Approximately half of these exhibited purchase levels that slightly increased and half that slightly decreased, but only two categories showed statistically significant changes. Buck et al (1977) observe with regard to consumer purchasing panels that 'some of the work in this rather difficult research area is out of date or based on statistical designs that do not stand up well to critical examination'. For example, one reported study had a panel size of only 150 respondents.…”

“…In this paper we focus on conditioning bias. Buck et al (1977) define panel conditioning as follows:…”

Sampling and Controlling a TV Audience Measurement Panel

“…As well as being concerned about viewing discrimination, the panel controls and supporting systems must reflect the dynamics of panel membership. This means that it is critically important to identify groups who are difficult to recruit and retain and to ensure that they are always represented on the panel (Buck et al 1984). The alternative is a fundamental but possibly hidden problem.…”

Measurement equivalence in probability and nonprobability online panels

“…Interestingly, the authors found that the professional respondents produced higher-quality responses than their more novice counterparts, suggesting that they may take the survey response task more seriously. Furthermore, repeated survey participation by professional respondents may produce panel conditioning, where the respondent’s response behavior changes as they become more familiar with the survey and questionnaire ( Buck et al, 1977; Hillygus et al, 2014; Struminskaya & Bosnjak, 2021).…”