In the social sciences, validity refers to the adequacy of a survey (or other mode of assessment) for its intended purpose. Validation refers to the activities undertaken during and after the construction of the survey to evaluate and improve validity. Item validation refers here to procedures for evaluating and improving respondents’ understanding of the questions and response options included in a survey. Verbal probing techniques such as cognitive interviews can be used to understand respondents’ response process, that is, what they are thinking as they answer the survey items. Although cognitive interviews can provide evidence for the validity of survey items, they are time-consuming and thus rarely used in practice. The Response Process Evaluation (RPE) method is a newly-developed technique that utilizes open-ended meta-surveys to rapidly collect evidence of validity across a population of interest, make quick revisions to items, and immediately test these revisions across new samples of respondents. Like cognitive interviews, the RPE method focuses on how participants interpret the item and select a response. The chapter demonstrates the process of validating one survey item taken from the Inventory of Non-Ordinary Experiences (INOE).
When operationalizing ‘religiosity’ or ‘spirituality’ or ‘religious experience’ as measurable constructs, researchers tacitly treat them as if they were cross-culturally stable ‘things’ rather than investigating the way culturally-laden concepts, such as ‘religious’ or ‘spiritual,’ are used to interpret or appraise contested aspects of human life within and across cultures. To illustrate the distinction, we contrast the traditional research design that the Religious Experience Research Centre used to survey and compare “religious experience” in the UK and China with the appraisal-based design used by the Inventory of Nonordinary Experiences (INOE). Instead of operationalizing “religious experience,” the INOE distinguishes between generically-worded experiences and the way the experiences are appraised. When coupled with item level validation to ensure that queries are understood as intended, the generically-worded experiences function as common features that allow us to compare similarities and differences between culturally-embedded “lived” experiences. Separating generic experiences from appraisals allows us to (1) treat culture-bound concepts, such as ‘religious’ and ‘spiritual,’ as appraisals, and (2) view these and other concepts (e.g., dharmic, paranormal, psychotic) as advancing claims about how and why an experience occurred. In so far as we can establish the cross-cultural validity of common features, we can set up culturally-balanced (rather than Western-centric) comparisons and avoid operationalizing culture-specific concepts.
To get beyond the solely negative identities signaled by atheism and agnosticism, we have to conceptualize an object of study that includes religions and non-religions. We advocate a shift from “religions” to “worldviews” and define worldviews in terms of the human ability to ask and reflect on “big questions” ([BQs], e.g., what exists? how should we live?). From a worldviews perspective, atheism, agnosticism, and theism are competing claims about one feature of reality and can be combined with various answers to the BQs to generate a wide range of worldviews. To lay a foundation for the multidisciplinary study of worldviews that includes psychology and other sciences, we ground them in humans’ evolved world-making capacities. Conceptualizing worldviews in this way allows us to identify, refine, and connect concepts that are appropriate to different levels of analysis. We argue that the language of enacted and articulated worldviews (for humans) and world-making and ways of life (for humans and other animals) is appropriate at the level of persons or organisms and the language of sense making, schemas, and meaning frameworks is appropriate at the cognitive level (for humans and other animals). Viewing the meaning making processes that enable humans to generate worldviews from an evolutionary perspective allows us to raise news questions for psychology with particular relevance for the study of nonreligious worldviews.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.