2018
DOI: 10.1177/1362168818767191
|View full text |Cite
|
Sign up to set email alerts
|

The seven sins of L2 research: A review of 30 journals’ statistical quality and their CiteScore, SJR, SNIP, JCR Impact Factors

Abstract: This report presents a review of the statistical practices of 30 journals representative of the second language field. A review of 150 articles showed a number of prevalent statistical violations including incomplete reporting of reliability, validity, non-significant results, effect sizes, and assumption checks as well as making inferences from descriptive statistics and failing to correct for multiple comparisons. Scopus citation analysis metrics and whether a journal is SSCI-indexed were predictors of journ… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1
1

Citation Types

4
59
2

Year Published

2018
2018
2022
2022

Publication Types

Select...
6
2

Relationship

0
8

Authors

Journals

citations
Cited by 69 publications
(68 citation statements)
references
References 47 publications
4
59
2
Order By: Relevance
“…Besides professional opinions used by VanPatten and Williams, other criteria were also used to evaluate quality of SLA journals including abstract indexing in Language Teaching (Jung, 2004), rejection rate, time of publication, availability/accessibility, and professional opinions (Egbert, 2007). Based on citation analysis, a recent study by Al-Hoorie and Vitta (2019) surveyed quantitative studies published in a broad range of international and regional L2 journals to investigate the relationship between journal indexing and statistical quality of studies in L2 journals. One important finding is that the majority of studies published in the SSCI-indexed L2 journals have a high quality in terms of statistical rigor.…”
Section: Methodsmentioning
confidence: 99%
See 2 more Smart Citations
“…Besides professional opinions used by VanPatten and Williams, other criteria were also used to evaluate quality of SLA journals including abstract indexing in Language Teaching (Jung, 2004), rejection rate, time of publication, availability/accessibility, and professional opinions (Egbert, 2007). Based on citation analysis, a recent study by Al-Hoorie and Vitta (2019) surveyed quantitative studies published in a broad range of international and regional L2 journals to investigate the relationship between journal indexing and statistical quality of studies in L2 journals. One important finding is that the majority of studies published in the SSCI-indexed L2 journals have a high quality in terms of statistical rigor.…”
Section: Methodsmentioning
confidence: 99%
“…Based on the results of SLA journal evaluation in the previous studies (e.g., Al-Hoorie & Vitta, 2019; Egbert, 2007; VanPatten & Williams, 2002), 16 journals 1 were selected for bibliometric data retrieval (Table 1). These journals are all international journals indexed by SSCI.…”
Section: Methodsmentioning
confidence: 99%
See 1 more Smart Citation
“…In spite of the rich research tradition in second language acquisition (SLA) and instructed SLA, some scholars have continued to call for greater attention to the operationalization of constructs, selection of valid assessments, and use of appropriate statistical analyses (e.g., Al‐Hoorie & Vitta, ). Thomas () and Tremblay (), for example, argued that the construct of proficiency, despite its near ubiquity in L2 research, is not adequately defined or validly measured, thus calling into question subsequent findings and conclusions.…”
Section: Introductionmentioning
confidence: 99%
“…Reliability and validity have been of major concern in the quantitative research design. In L2 research, reliability has usually been emphasized, while validity considerations have been somewhat overlooked (Al-Hoorie & Vitta, 2019).…”
Section: A Measurement Model Analysismentioning
confidence: 99%