How shall we assess this?

Carter, Janet; Ala-Mutka, Kirsti; Fuller, Ursula; Dick, Martin; English, John; Fone, William; Sheard, Judy

doi:10.1145/960875.960539

Cited by 15 publications

(8 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This alone makes it very difficult to make a program understand the wide range of our course topics: there is a lot of work that has to be done to make all the checking functions work robustly. While there are challenges, we agree on the benefits of automatic assessment, as it is commonly the case in the CSE community [10].…”

Section: Concluding Remarks and Future Workmentioning

confidence: 71%

Parsi

Lahtonen

Isomöttönen

2012

Proceedings of the 12th Koli Calling International Conference on Computing Education Research

View full text Add to dashboard Cite

A usual target of automatic assessment in CS education has been a computer program or some other software engineering product. In this paper, we describe the 'PARSI' tool that is used for the automatic assessment of stylistic and technical correctness of office documents and some basic IT skills such as email netiquette and email lists usage. The PARSI tool enables us to run a highly populated course with only one teacher, and investigate how we could make such a course a flexible learning experience where learners take an active role.We contextualize the Parsi tool and our goals in Section 2. Section 3 outlines the course context in which we use the tool. The functional idea and the usage of the Parsi tool are described in Section 4, and our experiences with the tool are summarized in Section 5. Concluding remarks and suggestions for future work are presented in Section 6.

show abstract

Section: Concluding Remarks and Future Workmentioning

confidence: 71%

Parsi

Lahtonen

Isomöttönen

2012

Proceedings of the 12th Koli Calling International Conference on Computing Education Research

View full text Add to dashboard Cite

show abstract

“…They are also extensively used by educators in assessing learners' understanding of particular content of knowledge. Carter et al [33] indicated that a web-survey on cognitive level assessment style have shown that a heavy used of closed book examination is 81% with 68% of the total assessment to test remembering, 91% to test understanding, 57% to test application and 37% to test evaluation. This shows that the short free text answer has been used to access the higher cognitive level.…”

Section: A Assessment Methodsmentioning

confidence: 99%

Competency assessment of short free text answers

Lajis

Aziz

2014

2014 4th International Conference on Engineering Technology and Technopreneuship (ICE2T)

View full text Add to dashboard Cite

The increased adoption of competency-based education has posed the need of an automated competency assessment.Most of the existing assisted assessment does not cater for competency assessment. The high percentage on the use of short free text answer as competency assessment shows that the need of the competency assisted assessment is urgent. This paper studies on the need and also review on existing assisted assessments focusing on short free text answer. A Node Link (NL) Scoring technique is proposed as an alternative automated solution to assess learners' competency in short free text answers.

show abstract

“…Ref. [13] state that a small sample size (5)(6)(7)(8)(9)(10)(11)(12)(13)(14)(15)(16)(17)(18)(19)(20) is sufficient for usability assessment and [7] highlights that researchers can collect valuable results using a minimum of five participants (subject experts) in a main experiment. Furthermore, [20] used five subject experts in order to provide feedback for programming solutions in their main experiment.…”

Section: Participants and Questionsmentioning

confidence: 99%

“…In manual marking although computer tools may be used to display code the tool does not assist in the marking process, relying on the skills of the marker alone. The human marker may potentially provide inconsistent feedback, especially when programming solutions are longer , and this is a disadvantage of manual marking. In addition, manual marking represents a significant workload for human markers, especially for large student numbers.…”

Section: Literature Reviewmentioning

confidence: 99%

Improving marking efficiency for longer programming solutions based on a semi‐automated assessment approach

Buyrukoğlu

Batmaz

Lock

2019

Comp Applic In Engineering

View full text Add to dashboard Cite

In recent years, many students in higher education have begun to learn programming languages. In doing so they will complete a variety of programming tasks of varying degrees of complexity. The students need to get consistent and personalized feedback to develop their programming skills. Human markers can provide personalized feedback using traditional manual approaches to assessment, but they may provide inconsistent feedback (especially for long programming solutions) since marking the programming solutions of multiple students can represent a significant workload for them. While full‐automated assessment systems are the best to provide consistent feedback, they may not provide sufficiently personalized feedback for novice programmers. This study develops a novel semi‐automated assessment approach in order to improve efficiency of human marker in the marking process and increase consistency of feedback (for both short and long programming solutions). It advocates the reuse of human marker's comments for similar code snippets, defined as segmented marking in this study. New full and partial marking models are developed based on segmented marking and they are tested by expert markers. The findings show that the two models are similar in efficiency, but that a partial marking approach potentially offers an improved efficiency for longer programming solutions. Such a finding has significant potential to reduce time spent on marking throughout the sector, which would have significant impact on both resourcing and timeliness of feedback.

show abstract

How shall we assess this?

Cited by 15 publications

References 11 publications

Parsi

Parsi

Competency assessment of short free text answers

Improving marking efficiency for longer programming solutions based on a semi‐automated assessment approach

Contact Info

Product

Resources

About