Mixed Methods in Value Research: An Analysis of the Validity of the Russian Version of the Schwartz Value Survey (SVS) Using Cognitive Interviews, Multidimensional Scaling (MDS), and Confirmatory Factor Analysis (CFA)

Abstract

The aim of this study is the validation of the Russian version of the Schwartz Value Survey (SVS) using qualitative (cognitive interviewing) and quantitative (multidimensional scaling, confi rmatory factor analysis) methods. Specifi cally, this paper explores the issue of whether respondents interpret the values measured in the survey in the way intended by Shalom Schwartz. The analysis revealed problems with participants' understanding of the wording, which are due both to subtle differences in translation and to the cultural context. In addition, multidimensional scaling and confi rmatory factor analysis were used to investigate whether the problems found in the qualitative analysis could also be detected by these quantitative methods. The fi ndings of the qualitative analysis allowed a better understanding of the fi ndings of the quantitative analysis and vice versa. However, the results differed considerably. In conclusion, several recommendations are given for use of such a mixed method approach.

Development of a Measure for Assessing Perceived Community Culture Based on Triandis’s Horizontal/Vertical Individualism-Collectivism Cultural Orientation

“…В соответствии с рекомендациями Ш. Шварца по изучению ценностей (см. например, Efremova et al, 2017), для оценки корреляций между переменными воспринимаемой культуры сообщества и индивидуальными ценностями факторные баллы по обеим методикам были центрированы с помощью среднего значения по всем пунктам соответствующей методики (то есть, например, из переменных ГИ, ВИ, ГК, ВК вычиталось среднее значение участника по всем 16 пунктам, а из переменных 10 ценностейпо всем 57 пунктам).…”

The Central Aspects of Pain in the Knee (CAP-Knee) questionnaire; a mixed-methods study of a self-report instrument for assessing central mechanisms in people with knee pain

“…In order to guide item revision, problems were identified based on sub-codes of each main code of comprehension (completely-, partially or not aligned to the researchers' intended meaning of each item), retrieval (no-, partial-and completeretrieval difficulty), judgement (certain initial or uncertain initial response) and response formulation (consistent or inconsistent)supplement 2. One researcher (KAA) categorised each participant based on quotes contributing to sub-codes across each item 41 . An item was revised if (i) emerging themes were not aligned with researcher's interpretation, and (ii) the item was not well understood by a majority of participants (including complete nonalignment, complete retrieval difficulty, uncertain initial response and no response consistency) 42 .…”

The Diversity of Value Construal: A Constructivist Approach to the Schwartz Theory of Basic Values

“…Doubts that the ten values can have universal meanings across societies have been expressed by researchers from different countries (Peng et al, 1997;Renner & Salem, 2005). For example, a qualitative study with a Russian sample (Efremova et al, 2017), identified cultural and semantic gaps in the intended meaning of values and those the respondents recognized in the items of SVS. Those concerns were addressed in quantitative studies, when the degree of the equivalence of the meaning was deduced from the pattern of interrelations between the value types (e.g., Fontaine et al, 2008).…”