Modeling congruence in organizational research with latent moderated structural equations.

Abstract

A growing volume of research has used polynomial regression analysis (PRA) to examine congruence effects in a broad range of organizational phenomena. However, conclusions from congruence studies, even ones using the same theoretical framework, vary substantially. We argue that conflicting findings from congruence research can be attributable to several methodological artifacts, including measurement error, collinearity among predictors, and sampling error. These methodological artifacts can significantly affect the estimation accuracy of PRA and undermine the validity of conclusions from primary studies as well as meta-analytic reviews of congruence research. We introduce two alternative methods that address this concern by modeling congruence within a latent variable framework: latent moderated structural equations (LMS) and reliability-corrected single-indicator LMS (SI-LMS). Using a large-scale simulation study with 6,322 conditions and close to 1.9 million replications, we showed how methodological artifacts affected the performance of PRA, specifically, its (un)biasedness, precision, Type I error rate, and power in estimating linear, quadratic, and interaction effects. We also demonstrated the substantial advantages of LMS and SI-LMS compared with PRA in providing accurate and precise estimates, particularly under undesirable conditions. Based on these findings, we discuss how these new methods can help researchers find more consistent effects and draw more meaningful theoretical conclusions in future research. We offer practical recommendations regarding study design, model selection, and sample size planning. In addition, we provide example syntax to facilitate the application of LMS and SI-LMS in congruence research.

Using Bifactor Models to Examine the Predictive Validity of Hierarchical Constructs: Pros, Cons, and Solutions

“…Nonetheless, many constructs in organizational research are measured by a small number of indicators (Hinkin, 1995). Typical sample sizes used in organizational research are also often in the range we examined (Su et al, 2019). Furthermore, interpretation of factors in BiM is problematic in many cases (Eid et al, 2017).…”

The role of employees' participation and managers' authority on continuous improvement and performance

“…Some researchers have criticised the use of a single index, such as an absolute difference to operationalise fit (Edwards, 1994(Edwards, , 2002Su et al, 2019). As a robustness check, this study employed the polynomial regression analysis with response surface methodology (Edwards, 1994(Edwards, , 2002, an alternative approach that has gained popularity (e.g.…”

Latent Congruence Model to Investigate Similarity and Accuracy in Family Members' Perception: The Challenge of Cross-National and Cross-Informant Measurement (Non)Invariance

“…Recently, some models have been proposed, which allow keeping into consideration measurement models and also, potentially, to deal with measurement invariance issues. One of those models is Latent Moderated Structural Equations (Su et al, 2019 ), which extends the strengths of polynomial regression models to a SEM in which measurement invariance can be tested. Moreover, as happened for polynomial regression models, it allows testing not only linear relationships among predictors and outcomes but also curvilinear relationships that, for some theoretical frameworks, could be more interesting (Cheung, 2009 ; Edwards, 2009 ).…”

“…Moreover, as happened for polynomial regression models, it allows testing not only linear relationships among predictors and outcomes but also curvilinear relationships that, for some theoretical frameworks, could be more interesting (Cheung, 2009 ; Edwards, 2009 ). However, Su et al ( 2019 ) did not discuss the impact of measurement cross-informants (non)invariance on findings.…”