Selecting a Within- or Between-Subject Design for Mediation: Validity, Causality, and Statistical Power

Montoya, Amanda Kay

doi:10.1080/00273171.2022.2077287

Cited by 30 publications

(14 citation statements)

References 79 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We also modeled work satisfaction and team effectiveness as dependent variables by estimating the change in these variables triggered by the same external event. We then used the MEMORE 3.0 macro for SPSS version 28 (Montoya, 2022) to analyze the data, using Model 16 that includes the moderating role of team size. The results of the overall moderated mediation analyses are presented in Figure 1 for work satisfaction and Figure 4 for team effectiveness.…”

Section: Resultsmentioning

confidence: 99%

Empowering leadership during the COVID-19 outbreak: Implications for work satisfaction and effectiveness in organizational teams

Cremers

Curşeu

2023

Front. Psychol.

View full text Add to dashboard Cite

The COVID-19 pandemic generated unprecedented challenges for social and organizational life. We set out to explore how empowering leadership and leadership support were affected as a result of the team-based organization starting to implement flexible and remote work practices after the outbreak of the COVID-19 pandemic. We collected data in a cross-lagged design and used the two-condition MEMORE mediation procedure to analyze data on work satisfaction and team effectiveness obtained just before and immediately after the COVID-19 outbreak in 34 organizational teams. Our results show that the COVID-19 outbreak did not significantly impact perceptions of empowering leadership or perceived leadership support. However, teams that experienced changes in empowering leadership also reported proportional changes in work satisfaction and effectiveness. Finally, we show that the association between empowering leadership and leadership support, on the one hand, and work satisfaction in teams, on the other hand, is moderated by team size, such that the strength of the association is higher in small rather than large organizational teams. We conclude by arguing that the team-based organization absorbed well the impact and disruptions associated with the COVID-19 outbreak. We also stress the role of empowering leadership as a driver of work satisfaction and the effectiveness of organizational teams.

show abstract

Section: Resultsmentioning

confidence: 99%

Empowering leadership during the COVID-19 outbreak: Implications for work satisfaction and effectiveness in organizational teams

Cremers

Curşeu

2023

Front. Psychol.

View full text Add to dashboard Cite

show abstract

“…Designing experiments with either a within-subject or a between-subject approach requires careful consideration of "validity," "causality," and "statistical power" [32]. For this study, a between-subject design was adopted due to its superior external validity.…”

Section: Experimental Classificationmentioning

confidence: 99%

Field Investigations on Subjective Perception, Physiological Responses, and Cognitive Performance under Increasing CO2 Concentration in an Underground Confined Space

Xie,

Wang,

Zhou

et al. 2024

Indoor Air

View full text Add to dashboard Cite

The objective of this research was to explore the impacts of heightened CO2 concentrations on human health and wellness in an underground confined space. A total of 180 participants were subjected to CO2 concentrations ranging from 1000 to 10000 ppm within a confined underground environment. The study assessed not only subjective perceptions and physiological responses but also cognitive performance, integrating novel measures such as emotion, skin conductance (SC), and heart rate variability (HRV). The findings demonstrated a notable variation in thermal sensation votes (TSV) and perceived air quality acceptability with the change in CO2 concentration. A significant increase in total mood disturbance (TMD) of 1.5 units was observed at a CO2 concentration of 8500 ppm, compared to 1000 ppm. Cognitive performance remained consistent for concentrations below 8500 ppm; however, a substantial alteration was noted at 10000 ppm. In terms of task difficulty, numerical calculations were perceived to require 0.74 units more effort than letter searches. As CO2 concentration exceeded 7500 ppm, significant variances were noted in physiological parameters such as diastolic blood pressure (DBP), heart rate (HR), LF/HF, MF/HF ratios, PNN 50, and frequency domains of HRV (LF, MF, and HF) in comparison to the parameters at 1000 ppm. At 8500 ppm, the LF and HF parameters were found to be 780 and 452.3 units, respectively, higher than at 7000 ppm. These findings suggest that high humidity, low temperature, and elevated CO2 concentrations collectively contribute to the significant human stress responses. This study is of interest as there are limited reported researches on the air quality in underground confined space.

show abstract

“…Power for between-subjects mediation is determined by the following values: sample size; population effect size as set by path coefficients a , b , and c ′; α level; and the inferential method used (for discussion of factors to consider for mediation with repeated-measures designs, see Montoya, 2022). Estimating statistical power for mediation relies on the product of two regression coefficients that does not follow a normal distribution (Lomnicki, 1967), so power analyses using simulation methods are preferred for the indirect effect because of their ability to generate the nonnormal distribution of the product (Schoemann et al, 2017).…”

Section: Power Analysis In Mediationmentioning

confidence: 99%

When to Use Different Inferential Methods for Power Analysis and Data Analysis for Between-Subjects Mediation

Fossum

Montoya

2023

Advances in Methods and Practices in Psychological Science

Self Cite

View full text Add to dashboard Cite

Several options exist for conducting inference on indirect effects in mediation analysis. Although methods that use bootstrapping are the preferred inferential approach for testing mediation, they are time-consuming when the test must be performed many times for a power analysis. Alternatives that are more computationally efficient are not as robust, meaning accuracy of the inferences from these methods is more affected by nonnormal and heteroskedastic data. Previous research has shown that different sample sizes are needed to achieve the same amount of statistical power for different inferential approaches with data that meet all the statistical assumptions of linear regression. By contrast, we explore how similar power estimates are at the same sample size, including when assumptions are violated. We compare the power estimates from six inferential methods for between-subjects mediation using a Monte Carlo simulation study. We varied the path coefficients, inferential methods for the indirect effect, and degree to which assumptions are met. We found that when the assumptions of linear regression are met, three inferential methods consistently perform similarly: the joint significance test, the Monte Carlo confidence interval, and the percentile bootstrap confidence interval. When the assumptions were violated, the nonbootstrapping methods tended to have vastly different power estimates compared with the bootstrapping methods. On the basis of these results, we recommend using the more computationally efficient joint significance test for power analysis only when no assumption violations are hypothesized a priori. We also recommend the joint significance test to pick an optimal starting sample size value for power analysis using the percentile bootstrap confidence interval when assumption violations are suspected.

show abstract

Selecting a Within- or Between-Subject Design for Mediation: Validity, Causality, and Statistical Power

Cited by 30 publications

References 79 publications

Empowering leadership during the COVID-19 outbreak: Implications for work satisfaction and effectiveness in organizational teams

Empowering leadership during the COVID-19 outbreak: Implications for work satisfaction and effectiveness in organizational teams

Field Investigations on Subjective Perception, Physiological Responses, and Cognitive Performance under Increasing CO2 Concentration in an Underground Confined Space

When to Use Different Inferential Methods for Power Analysis and Data Analysis for Between-Subjects Mediation

Contact Info

Product

Resources

About