A measure of within-participant response consistency

MacDonald, Jacqueline; Trafimow, David

doi:10.3758/s13428-013-0318-1

Cited by 7 publications

(3 citation statements)

References 8 publications

(8 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A high degree of uniformity in adolescents' responses to directly and indirectly phrased questions may imply that adolescents perceive these questions as asking about the same past behavior. High degree of consistency in item-level responding also suggests a lack of specific measurement errors that indicate individuals are interpreting particular items differently than other items intended to get at the same construct (MacDonald & Trafimow, 2013). To this end, findings appear to support the within-participant response consistency for suicide attempt questions for the majority of the sample.…”

Section: Discussionmentioning

confidence: 99%

Understanding adolescent responses to differently worded suicide attempt questions: results from a large US pediatric sample

et al. 2020

View full text Add to dashboard Cite

Background Clinical assessments are a primary method for ascertaining suicide risk, yet the language used across measures is inconsistent. The implications of these discrepancies for adolescent responding are unknown, which is troubling as multiple research areas (i.e. on culture, mental health language, and suicide communication) indicate individuals from varying sociodemographic backgrounds may communicate differently regarding mental health concerns. The aims of the current study are to investigate whether a geographically diverse sample of adolescents respond differently to directly and indirectly phrased suicide attempt questions (i.e. directly phrased includes the term ‘suicide’ and indirectly asks about suicidal behavior without using ‘suicide’), and to examine whether sociodemographic factors and history of mental health service usage relate to endorsement differences. Methods Participants were N = 5909 adolescents drawn from the Emergency Department Screening for Teens at Risk for Suicide multi-site study. The lifetime suicide attempt was assessed with two items from an adapted version of the Columbia Suicide Severity Rating Scale (C-SSRS; Posner et al., 2008): (1) a directly phrased question asking about ‘suicide attempts’ and (2) an indirectly phrased question providing the definition of an attempt. Results An adolescent majority (83.7%) consistently reported no lifetime suicide attempt across items, 10.1% consistently reported one or more lifetime attempts across items, and 6.2% of adolescents responded discordantly to the items. Conclusions Multivariable models indicated multiple demographic and mental health service variables significantly predicted discordant responding, with a notable finding being that father/stepfather education level at or below high school education predicted endorsing only the direct question.

show abstract

Section: Discussionmentioning

confidence: 99%

Understanding adolescent responses to differently worded suicide attempt questions: results from a large US pediatric sample

et al. 2020

View full text Add to dashboard Cite

show abstract

“…Another important aspect of ethical decision-making is the consistency of an individual's decisions. Internal consistency is a measure of the degree of variance in an individual's response to the same stimulus over time (MacDonald & Trafimow, 2013). One study by Holyoak and Simon (1999) on judicial decision-making required participants to rate their agreement with several pieces of information presented to them before and after evaluating a legal case.…”

Section: Within-subject Consistency In Decisionsmentioning

confidence: 99%

The Allocation of a Scarce Medical Resource: A Cross-Cultural Study Investigating the Influence of Life Style Factors and Patient Gender, and the Coherence of Decision-making

et al. 2021

View full text Add to dashboard Cite

This study examined how lifestyle factors and gender affect kidney allocation to transplant patients by 99 Britons and Singaporeans. Thirty hypothetical patients were generated from a combination of six factors (alcohol intake, smoking frequency, weight, exercise frequency, diet, and gender) and randomly paired four times. Participants saw 60 patient pairings and, in each pair, chose which patient would receive treatment priority. A Bradley-Terry model was used to derive coefficients for each factor per participant. A mean factor score (MFS) was then calculated across all participants for each factor. Participants gave lower priority to patients who drank more, were overweight, smoked more and exercised less. A patient's diet and gender had no significant effect on allocation. There were no significant cross-cultural differences. There were moderate correlations between participants' self-reported pre-and post-experiment ordering of decision criteria, and these measures and factor coefficients, suggesting a modest level of decision-making consistency. Between participants, moderate levels of concordance with respect to factor importance were observed for self-reported orderings of factors, and weaker agreement for model-derived coefficients. Very similar results were obtained for both British and Singaporean participants, and the implications of the findings are discussed.

show abstract

“…To overcome this issue, we decided against randomly splitting the data and calculated the correlation between the number of switches for the first half of the trials and the second half of the trials per subject. This might serve as a proxy and an easy and interpretable measure of subjects' response contingency (MacDonald & Trafimow, 2013) for which we do not report Spearman-Brown corrected values given its potential imprecision.…”

Section: Psychometrics Of Flexibility Indicesmentioning

confidence: 99%

Cognitive, affective, and feedback-based flexibility – disentangling shared and different aspects of three facets of psychological flexibility

Kraft¹,

Rademacher²,

Eckart³

et al. 2020

Preprint

View full text Add to dashboard Cite

Cognitive flexibility – the ability to adjust one ́s behavior to changing environmental demands – is crucial for controlled behavior. However, the term ‘cognitive flexibility’ is used heterogeneously, and associations between cognitive flexibility and other facets of flexible behavior have only rarely been studied systematically. To resolve some of these conceptual uncertainties, we directly compared cognitive flexibility (cue-instructed switching between two affectively neutral tasks), affective flexibility (switching between a neutral and an affective task using emotional stimuli), and feedback-based flexibility (non-cued, feedback-dependent switching between two neutral tasks). Three experimental paradigms were established that share as many procedural features (in terms of stimuli and/or task rules) as possible and administered in a pre-registered study plan (N=100). Correlation analyses revealed significant associations between the efficiency of cognitive and affective task switching (response time switch costs). Feedback-based flexibility (measured as mean number of errors after rule reversals) did not correlate with task switching efficiency in the other paradigms, but selectively with the effectiveness of affective switching (error rate costs when switching from neutral to emotion task). While preregistered confirmatory factor analysis (CFA) provided no clear evidence for a shared factor underlying the efficiency of switching in all three domains of flexibility, an exploratory CFA suggested commonalities regarding switching effectiveness (accuracy-based switch costs). We propose shared mechanisms controlling the efficiency of cue-dependent task switching across domains, while the relationship to feedback-based flexibility may depend on mechanisms controlling switching effectiveness. Our results call for a more stringent conceptual differentiation between different variants of psychological flexibility.

show abstract

A measure of within-participant response consistency

Cited by 7 publications

References 8 publications

Understanding adolescent responses to differently worded suicide attempt questions: results from a large US pediatric sample

Understanding adolescent responses to differently worded suicide attempt questions: results from a large US pediatric sample

The Allocation of a Scarce Medical Resource: A Cross-Cultural Study Investigating the Influence of Life Style Factors and Patient Gender, and the Coherence of Decision-making

Cognitive, affective, and feedback-based flexibility – disentangling shared and different aspects of three facets of psychological flexibility

Contact Info

Product

Resources

About