Integrated short essay assessment can benefit related parties in education domain. It can be performed using linguistic approach to recognize sentence structure (word order). Subjectpredicate rule does not consider sentence usage context in a sentence. Whereas, by using thematic role rule, each significant argument in a sentence is discovered to provide information on relation between word and the role it played in determining the meaning of a sentence. Tokens that have been labelled were matched with thematic role consisting of Agent, Patient, Theme, Source, Beneficiary, Experiencer, Location, Time and Quantity. This study is conducted on Compiler course in Malay which comprise of various type of sentences. 5-fold cross validation test shows that error rate produces by Thematic Role rule and Subject-Predicate rule are 13.51% and 34.05%, respectively, a difference of 20.54%. This result shows that by understanding sentence context, it will produce better and promising essay assessment.
Automated Short Essay Assessment is a subjective assessment that emphasizes important contents more than writing style. Word Order Technique and Syntactic-Semantic Knowledge Technique have been used in previous researches. However, it cannot differentiate sentence pair that is not similar semantically and only proven to produce excellent result on short sentence. Thematic Role annotation for every significant argument seems able to provide information regarding the relations between the word. Wordnet Semantics Network calculates semantic similarities of two synsets (token) by taking into account the depth of semantic relations. This study is conducted on Compiler course set in Malay that comprise of passive, simple, negative, mixed and complex questions. To prove the effectiveness of the techniques, the test result that apply Grammar Pola Technique was used as a benchmark because the study uses the same data set. The average of f-measure test accuracy rate is 93.53% when using Thematic Role and Semantic Network Techniques compared to 82.36% accuracy rate when using Pola Grammar Technique. The result of Thematic Role can be used on research involving Malay linguistic to test sentence structure matching that has verb by considering types of sentence.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.