Cross‐National Web Probing: An Overview of Its Methodology and Its Use in Cross‐National Studies

Abstract

Cross-national surveys are increasingly being set up or used in analyses, and so are cross-cultural surveys in general, including those conducted in different ethnic groups within a single country (Smith 2010; Van de Vijver 2013). It is therefore more pressing than ever to have a sound methodology at one's disposal that allows a researcher to produce equivalent data that can be meaningfully compared across countries and cultures. After all, equivalence is the prerequisite for any sound conclusions. In the words of Johnson (1998, p. 30): "In addition to the traditional reliability and validity requirements for monocultural survey instruments, researchers conducting cross-cultural survey research have the added concern of equivalence. Indeed, cross-cultural research demands a commitment to the establishment of equivalence that is at least equal to the attention routinely reserved for the problems of reliability and validity." From a quantitative perspective and for multiple-item scales, equivalence is often discussed within a three-level framework that distinguishes between configural, metric

Innovative Research by Using IoT Applications on Cross-National English Cultural Communication Based on Crowdsourcing Translation Model

“…Unlike other types of invention, social innovation does not maximize profits and has a competitive advantage [4]. However, it is affected by concerns for communities (a problem or social need) and results in massive social change [5]. Individuals, groups, and social movements have all been considered agents in social innovation.…”

Editorial: Comparative political science and measurement invariance: Basic issues and current applications

“…5. As measurement invariance is only a necessary but not sufficient condition it is advisable to employ additional cognitive interviews or web probing before the main study is executed (Meitinger, 2017;Behr et al, 2020;Meitinger et al, 2020).…”

“…This rather technical literature-that often focuses on statistical details and pays less attention to theoretical validity-has more recently been complemented by new approaches investigating how respondents interpret particular items, for example by probing questions concerning the content of the items. This framework has been expanded in recent years by implementing the probing technique in web surveys (web probing), which results in much larger sample sizes compared to traditional face-to-face cognitive interviewing (Behr et al, 2017(Behr et al, , 2020Meitinger, 2017).…”

Visual Design and Cognition in List-Style Open-Ended Questions in Web Probing

“…Probes are questions that ask respondents to provide additional information after answering a closed question (Beatty and Willis 2007). Web probing is a crucial tool for assessing the validity and comparability of survey questions (Behr et al 2017; 2020). Its usefulness has frequently been acknowledged (e.g., Anstötz, Schmidt and Heyder 2019; Fowler and Willis 2020; Geisen and Murphy 2020; Silber, Zuell, and Kühnel 2020; Singer and Couper 2017), and methodological research on web probing is ongoing (Behr et al 2012; Edgar, Murphy and Keating 2016; Lenzner and Neuert 2017; Meitinger and Behr 2016; Meitinger, Braun, and Behr 2018; Meitinger, Behr and Braun 2021; Neuert and Lenzner 2021; Scanlon 2019).…”