Judging whether a document changes in subject

Nicholson, Colin Jay

doi:10.1109/secon.2009.5174074

Cited by 1 publication

(1 citation statement)

References 8 publications

(9 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Idea density is a value calculated from the ratio of ideas and the total number of words within a text. Previous research supports the use of the program to identify differences between written text divided into multiple performance levels (Elvevaag, Wynn, & Covington, 2011;Nicholson, 2009). If textual knowledge is operational, I would expect to see idea density increase significantly from the lowest IEP level to the highest.…”

Section: Motivation For the Current Studymentioning

confidence: 84%

Using corpus complexity analysis to refine a holistic ESL writing placement rubric

Gevara¹

2015

SiLA

View full text Add to dashboard Cite

The purpose of this study is to determine if corpus analysis tools can identify linguistic features within writing placement samples that are significantly different between levels within a higher education language program. Although commercial tests are widely used for placement decisions, local performance assessments have become more common compliments that better adhere to communicative language teaching. At the university where this study was conducted, raters use a holistic rubric to score students’ responses to one academic topic. The scoring process is fast when rates agree but too time consuming when raters search for information to resolve disagreements. Writing placement samples from 123 former students’ essays at an Intensive English Program were used to compile a corpus. I divided the writing samples into four folders that correspond with the program levels and analyzed the folders using syntactic, lexical, and essay complexity analyzers. I utilized the robustness of the ANOVA to account for assumption violations. Data that violated the normality assumption were first analyzed using the Kruskal-Wallis Test. Those variables showing significant differences between levels were then analyzed using ANOVA and the appropriate post-hoc tests. Results show significant between group differences with lexical and word types and tokens, complex nominal, verb phrases, and ideas. I discuss the interpretation of these variables as well as show how administrators used this information to revise the rubric from Version I to Version II. Broader implications from this study are the use of corpus research tools to operationalize performance for the purposes of model building.

show abstract

Section: Motivation For the Current Studymentioning

confidence: 84%