2018
DOI: 10.1145/3143560
|View full text |Cite
|
Sign up to set email alerts
|

A Survey on Online Judge Systems and Their Applications

Abstract: Online judges are systems designed for the reliable evaluation of algorithm source code submitted by users, which is next compiled and tested in a homogeneous environment. Online judges are becoming popular in various applications. Thus, we would like to review the state of the art for these systems. We classify them according to their principal objectives into systems supporting organization of competitive programming contests, enhancing education and recruitment processes, facilitating the solving of data mi… Show more

Help me understand this report
View preprint versions

Search citation statements

Order By: Relevance

Paper Sections

Select...
3
1
1

Citation Types

0
87
0
23

Year Published

2018
2018
2024
2024

Publication Types

Select...
8
1
1

Relationship

1
9

Authors

Journals

citations
Cited by 134 publications
(118 citation statements)
references
References 78 publications
0
87
0
23
Order By: Relevance
“…To do this, we defined two fundamental factors in our experimental design: An objective indicator of programming expertise and a laboratory task that efficiently exhibits experts' superior performances under the general constraints of fMRI experiments. For the first factor, we adopted programmers' ratings in competitive programming contests (AtCoder), which are objectively determined by the relative positions of their actual performances among thousands of programmers 22 . We recruited top-and middle-rated programmers as well as novice controls to cover a wide range of programming expertise in our fMRI experiment (Table.1).…”
Section: Introductionmentioning
confidence: 99%
“…To do this, we defined two fundamental factors in our experimental design: An objective indicator of programming expertise and a laboratory task that efficiently exhibits experts' superior performances under the general constraints of fMRI experiments. For the first factor, we adopted programmers' ratings in competitive programming contests (AtCoder), which are objectively determined by the relative positions of their actual performances among thousands of programmers 22 . We recruited top-and middle-rated programmers as well as novice controls to cover a wide range of programming expertise in our fMRI experiment (Table.1).…”
Section: Introductionmentioning
confidence: 99%
“…For example, subjective questions usually have corresponding scores and a teacher can decide the scores based on the answers. For computer programming questions, if online judge (OJ) system [22] is used, the answer results can be "pass", "error", "timeout", etc., in which "pass" indicates that the answer is correct and other results indicate that the answer is wrong. In a word, a teacher can choose the features of question answering data that are used to measure students' knowledge levels in practice.…”
Section: Student Clusteringmentioning
confidence: 99%
“…Todos os docentes alocados a essas turmas seguiram uma mesma metodologia híbrida de ensino e aprendizagem, que mescla o ensino presencial com atividades virtuais baseadas em um juiz online. Segundo Wasik et al (2018), juízes online são plataformas web cujo propósito é compilar, executar e avaliar programas submetidos por usuários. Por meio deste, foram realizadas avaliações formativas (prática de exercícios de programação, com consulta à bibliografia, professores, tutores e colegas) e somativas (avaliação prática sem consulta) [Carvalho, Oliveira e Gadelha 2016].…”
Section: Descrição Dos Dados E Do Contexto Educacionalunclassified