Introduction: A virtual simulator, or one based on virtual reality, can computationally recreate real contexts. Objective: To analyze works on virtual simulations for training clinical procedures, focusing on the assessment of user skills. Method: Integrative literature review, carried out between 2010 and 2020. A total of 56 studies were selected 56 studies. Results: The selected studies showed that the variables and parameters of virtual simulators are usually obtained by consulting experts or through medical literature. These simulators mainly focus on developing psychomotor skills and assessing the learner’s performance through real-time alerts, progress indicators, and performance reports after the end of each training. Conclusion: Considering the expert’s knowledge exclusively to define the requirements of virtual simulators can limit their reliability and accuracy. The participation of experts in these projects does not follow standards regarding the selection and frequency with which they collaborate. Few simulators provide insightful and pertinent feedback on user performance.

Este trabalho apresenta uma revisão da literatura na qual identificamos quais as principais técnicas utilizadas nas ferramentas para prover feedback automático em programação. Nosso objetivo foi identificar as características dessas técnicas e estratégias usadas para auxiliar e mensurar a aprendizagem. Dentre os resultados, identificamos que a maioria dos estudos concentram-se nas aulas de graduação. Também identificamos que o uso de testes automáticos e comparação de códigos são estratégias populares. Os pesquisadores descreveram que os estudantes podem se beneficiar do uso dessas ferramentas, uma vez que melhoram seu desempenho e motivação. No entanto, embora essas abordagens sejam populares, não encontramos uma prática comum para avaliá-las.

Introductory programming courses typically involve a large number of assignments, which makes it difficult for the teachers to provide manual feedback. Therefore, we investigated if by including students as reviewers we could provide useful feedback. For this, we selected a survey with assignments and their respective source codes (formulated by students in previous turns) so that specialists and students of two courses gave hints to improve the source-codes qualitatively. We found that most students elaborated useful hints, identify code quality issues similar to specialists and that students are particularly able at finding and giving hints related to the programs' complexity.