An Empirical Analysis of Blind Tests

Baral, Kesina; Offutt, Jeff

doi:10.1109/icst46399.2020.00034

Cited by 5 publications

(7 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…They wrote automated tests for a method that modified class level variables that needed to be checked in assertions, which are often overlooked. More than half of the students did that correctly, even though this is a very common mistake in industry [2].…”

Section: Findings From the Testing Classmentioning

confidence: 99%

See 1 more Smart Citation

Designing Divergent Thinking, Creative Problem Solving Exams

Offutt

Baral

2022

2022 IEEE/ACM 44th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET)

Self Cite

View full text Add to dashboard Cite

This experience report paper reports on case studies of final exams that used creative problem solving to assess students' ability to apply the material, and divergent thinking to ensure that each student's exam was unique. We report on two senior-level software engineering courses, taught a total of six times across three semesters. The paper gives enough information for readers to adapt this method in their own courses. Our exams include built-in divergence properties, which are elements or decisions that lead students to more than one good answer. Based on our experience, divergent thinking, creative problem solving exams not only provide excellent assessments of student knowledge, but ensure the integrity of the exam process, even when students work without supervision. We developed this strategy during the pandemic when all courses were online, but find them to be better than our traditional exams and are now using this strategy for in-person courses. CCS CONCEPTS• Applied computing → Education.

show abstract

Section: Findings From the Testing Classmentioning

confidence: 99%

“…We designed the exams to satisfy explicit goals. Sample final exam are available as a "reusability" package on github 2 . Goal 1: Exams should allow students to demonstrate that they achieved the learning objectives.…”

Section: Goals Of Divergent Thinking Examsmentioning

confidence: 99%

Designing Divergent Thinking, Creative Problem Solving Exams

Offutt

Baral

2022

2022 IEEE/ACM 44th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET)

Self Cite

View full text Add to dashboard Cite

show abstract

“…A definição dos estudos foi inspirada em diretrizes definidas em trabalhos de diferentes domínios (SHULL et al, 2001;Baral;Offutt, 2020;Afzal et al, 2020;Koc et al, 2019;Panichella;Zaidman, 2018;RODRIGUES;BRANCHER, 2019). A análise da abordagem foi dividida em: estudo manual relacionado à aplicabilidade das propriedades catalogadas (Capítulo 4) e a análise da abordagem proposta Nonexec (Capítulo 4).…”

Section: Considerações Iniciaisunclassified

“…QP2: Qual o reflexo da aplicação das propriedades catalogadas na atividade de teste? Para isso, foi realizado um estudo exploratório com delineamento inspirado em estudos empíricos em diversos domínios (por exemplo, teste de mutação, teste de sistemas robóticos e jogos educativos) (Baral;Offutt, 2020;Koc et al, 2019;RODRIGUES;BRANCHER, 2019). O estudo seguiu uma estratégia baseada nos conceitos de software empírico, e coletou dados quantitativos e qualitativos (SHULL et al, 2001;Baral;Offutt, 2020;Koc et al, 2019;RODRIGUES;BRANCHER, 2019).…”

Section: Estudo Inicial: Aplicabilidade Do Catálogo De Propriedades P...unclassified

“…As ameaças à validade interna incluem a construção do catálogo de propriedades, para mitigar a ameaça, a construção do catálogo foi inspirada em estudos consolidados publicados em bases relevantes. Outra ameaça à validade interna está no processo desenvolvido usado para realizar o estudo exploratório, para mitigar essa ameaça, o estudo foi inspirado em estudos empíricos que exploraram conceitos (Baral;Offutt, 2020;Koc et al, 2019;Panichella;Zaidman, 2018;RODRIGUES;BRANCHER, 2019) e foi baseado no processo exploratório relatado no trabalho de Travassos SHULL et al que define diretrizes para o desenvolvimento de estudos empíricos.…”

Section: Ameaças à Validadeunclassified

See 1 more Smart Citation