The Reporting Quality of Systematic Reviews and Meta-Analyses in Industrial and Organizational Psychology: A Systematic Review

Schalken, Naomi; Rietbergen, Charlotte

doi:10.3389/fpsyg.2017.01395

Cited by 31 publications

(30 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Many researchers dedicate efforts to the field of WOP, and several works have studied the relationships between individuals and organizations. Although many studies have reviewed WOP ( Billings and Wroten, 1978 ; Cascio, 1995 ; Bond and Smith, 1996 ; Brutus et al, 2010 ; Gelfand et al, 2017 ; Schalken and Rietbergen, 2017 ; Bal et al, 2019 ) and discussed several characteristics and their impacts for individuals and organizations, no work presents a complete background of the field of study. This review is the first bibliometric performance and network analysis (BPNA) performed in the field of WOP.…”

Section: Introductionmentioning

confidence: 99%

100 Years of Scientific Evolution of Work and Organizational Psychology: A Bibliometric Network Analysis From 1919 to 2019

et al. 2020

View full text Add to dashboard Cite

In this study, we explore a 100 years of Work and Organizational Psychology (WOP). To do this, we carry out a bibliometric performance and network analysis (BPNA) to understand the evolution structure and the most important themes in the field of study. To perform the BNPA, 8,966 documents published since 1919 were exported from the Web of Science and Scopus databases. The SciMAT software was used to process data and to create the evolution structure, the strategic diagram, and the thematic network structure of the strategic themes of the field of WOP. We identified 29 strategic clusters and discuss the most important themes (motor themes) and their relationship with other clusters. This research presents the complete evolution of the field of study, identifying emerging themes and others with a high degree of development. We hope that this work will support researchers and future research in the field of WOP.

show abstract

Section: Introductionmentioning

confidence: 99%

100 Years of Scientific Evolution of Work and Organizational Psychology: A Bibliometric Network Analysis From 1919 to 2019

et al. 2020

View full text Add to dashboard Cite

show abstract

“…We chose this journal for two reasons: First, previous estimates of publication bias detection in this journal have been consistent with the overall estimates of bias detection rates in this field (i.e., 31%;Kepes et al, 2012). Second, the Journal of Applied Psychology does not only publish the highest share of meta-analyses among top-tier journals in I/O Psychology (Aytug et al, 2012;Schalken & Rietbergen, 2017), but it has also been found to be more transparent in several aspects of meta-analytic reporting standards and to publish meta-analyses that are cited at a significantly higher rate (Aytug et al, 2012). Therefore, we were able to gather a large sample that consists of meta-analyses that conform to often-recommended meta-analytic standards (as evidenced by the high transparency scores) and represent valuable resources for researchers in the field (as evidenced by the high citation rates).…”

Section: Limitationsmentioning

confidence: 93%

Times are Changing, Bias isn’t: A Meta-Meta-Analysis on Publication Bias Detection Practices, Prevalence Rates, and Predictors in Industrial/Organizational Psychology

Siegel¹,

Eder²,

Wicherts³

et al. 2020

Preprint

View full text Add to dashboard Cite

Inflated or outright false effects plague Psychological Science, but advances in the identification of dissemination biases in general and publication bias in particular have helped in dealing with biased effects in the literature. However, the application of publication bias detection methods appears to be not equally prevalent across subdisciplines. It has been suggested that particularly in I/O Psychology, appropriate publication bias detection methods are underused. In this meta-meta-analysis, we present prevalence estimates, predictors, and time trends of publication bias in 128 meta-analyses that were published in the Journal of Applied Psychology (7,263 effect sizes, 3,000,000+ participants). Moreover, we reanalyzed data of 87 meta-analyses and applied nine standard and more modern publication bias detection methods. We show that (i) the bias detection method applications are underused (only 41% of meta-analyses use at least one method) but have increased in recent years, (ii) those meta-analyses that apply such methods now use more, but mostly inappropriate methods, and (iii) the prevalence of publication bias is disconcertingly high (15% to 20% show severe, 33% to 48% some bias indication) but mostly remains undetected. Although our results indicate somewhat of a trend towards higher bias awareness, they also indicate that concerns about publication bias in I/O Psychology are justified and researcher awareness about appropriate and state-of-the-art bias detection needs to be further increased. Embracing open science practices such as data sharing or study preregistration is needed to raise reproducibility and ultimately strengthen Psychological Science in general and I/O Psychology in particular.

show abstract

“…For example, in the methodological study of Cochrane HIV systematic reviews, Mbuagbaw et al included all of the available studies ( n = 103) [ 30 ]. Methodological studies that include a sample of the target population Many methodological studies use random samples of the target population [ 33 , 91 , 92 ]. Alternatively, purposeful sampling may be used, limiting the sample to a subset of research-related reports published within a certain time period, or in journals with a certain ranking or on a topic.…”

Section: Main Textmentioning

confidence: 99%

“…Many methodological studies use random samples of the target population [ 33 , 91 , 92 ]. Alternatively, purposeful sampling may be used, limiting the sample to a subset of research-related reports published within a certain time period, or in journals with a certain ranking or on a topic.…”

Section: Main Textmentioning

confidence: 99%

A tutorial on methodological studies: the what, when, how and why

Mbuagbaw

Lawson

Puljak

et al. 2020

BMC Med Res Methodol

View full text Add to dashboard Cite

Background Methodological studies – studies that evaluate the design, analysis or reporting of other research-related reports – play an important role in health research. They help to highlight issues in the conduct of research with the aim of improving health research methodology, and ultimately reducing research waste. Main body We provide an overview of some of the key aspects of methodological studies such as what they are, and when, how and why they are done. We adopt a “frequently asked questions” format to facilitate reading this paper and provide multiple examples to help guide researchers interested in conducting methodological studies. Some of the topics addressed include: is it necessary to publish a study protocol? How to select relevant research reports and databases for a methodological study? What approaches to data extraction and statistical analysis should be considered when conducting a methodological study? What are potential threats to validity and is there a way to appraise the quality of methodological studies? Conclusion Appropriate reflection and application of basic principles of epidemiology and biostatistics are required in the design and analysis of methodological studies. This paper provides an introduction for further discussion about the conduct of methodological studies.

show abstract

The Reporting Quality of Systematic Reviews and Meta-Analyses in Industrial and Organizational Psychology: A Systematic Review

Cited by 31 publications

References 27 publications

100 Years of Scientific Evolution of Work and Organizational Psychology: A Bibliometric Network Analysis From 1919 to 2019

100 Years of Scientific Evolution of Work and Organizational Psychology: A Bibliometric Network Analysis From 1919 to 2019

Times are Changing, Bias isn’t: A Meta-Meta-Analysis on Publication Bias Detection Practices, Prevalence Rates, and Predictors in Industrial/Organizational Psychology

A tutorial on methodological studies: the what, when, how and why

Contact Info

Product

Resources

About