Initial Validation of the Cybersecurity Concept Inventory: Pilot Testing and Expert Review

Offenberger, Spencer; Herman, Geoffrey L.; Petérson, Peter A.; Sherman, Alan T.; Golaszewski, Enis; Scheponik, Travis; Oliva, Linda

doi:10.1109/fie43999.2019.9028652

Cited by 4 publications

(1 citation statement)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…That is, the learning device is considered valid by the experts who carry out the assessment (Putranta & Supahar, 2019). This expert's assessment can provide an overview of the quality of a learning tool from an educational perspective (Offenberger et al, 2019). In addition, by paying attention to the assessment of experts, learning device developers can improve weaknesses in learning tools so that they can be more effective in helping students achieve the desired learning goals (Songkram, 2015;Yoon et al, 2019).…”

Section: Resultsmentioning

confidence: 99%

Feasibility Analysis of Subject Specific Pedagogy Physics Learning Module Based on Project Based Learning Integrated with Merdeka Curriculum on Alternative Energy Material

Husnadi,

Budiawanti,

Ekawati

2024

jppipa, pendidikan ipa, fisika, biologi, kimia

View full text Add to dashboard Cite

This study aims to analyse the feasibility of Subject Specific Pedagogy Physics tools based on Project Based Learning (PjBL) integrated with Merdeka Curriculum on alternative energy material for grade X high school students. This research uses the Research and Development (RnD) method with the 5D model (Define, Design, Develop, Disseminate, and Evaluate) which is limited to the devalope stage. The Define stage includes needs analysis and identification of competencies that must be achieved by students. The Design stage includes designing learning module in the form of modules and student worksheets. The Develop stage includes the development and validation of learning modules by experts in the aspects of material, learning, language and limited testing. The results showed that the PjBL-based Physics Subject Specific Pedagogy device integrated with the Merdeka Curriculum on alternative energy material for grade X high school students had high feasibility based on expert review in terms of material, learning, and language aspects. In addition, students also gave positive responses to the developed learning module. Therefore, the learning module is suitable for use in the Physics learning process in high school.

show abstract

Section: Resultsmentioning

confidence: 99%

Feasibility Analysis of Subject Specific Pedagogy Physics Learning Module Based on Project Based Learning Integrated with Merdeka Curriculum on Alternative Energy Material

Husnadi,

Budiawanti,

Ekawati

2024

jppipa, pendidikan ipa, fisika, biologi, kimia

View full text Add to dashboard Cite

show abstract

Investigating Crowdsourcing to Generate Distractors for Multiple-Choice Assessments

Scheponik

Golaszewski

Herman

et al. 2019

Advances in Intelligent Systems and Computing

View full text Add to dashboard Cite

We present and analyze results from a pilot study that explores how crowdsourcing can be used in the process of generating distractors (incorrect answer choices) in multiple-choice concept inventories (conceptual tests of understanding). To our knowledge, we are the first to propose and study this approach. Using Amazon Mechanical Turk, we collected approximately 180 open-ended responses to several question stems from the Cybersecurity Concept Inventory of the Cybersecurity Assessment Tools Project and from the Digital Logic Concept Inventory. We generated preliminary distractors by filtering responses, grouping similar responses, selecting the four most frequent groups, and refining a representative distractor for each of these groups.We analyzed our data in two ways. First, we compared the responses and resulting distractors with those from the aforementioned inventories. Second, we obtained feedback from Amazon Mechanical Turk on the resulting new draft test items (including distractors) from additional subjects. Challenges in using crowdsourcing include controlling the selection of subjects and filtering out responses that do not reflect genuine effort. Despite these challenges, our results suggest that crowdsourcing can be a very useful tool in generating effective distractors (attractive to subjects who do not understand the targeted concept). Our results also suggest that this method is faster, easier, and cheaper than is the traditional method of having one or more experts draft distractors, and building on talk-aloud interviews with subjects to uncover their misconceptions. Our results are significant because generating effective distractors is one of the most difficult steps in creating multiple-choice assessments.

show abstract

Experiences and Lessons Learned Creating and Validating Concept Inventories for Cybersecurity

Sherman

Herman

Oliva

et al. 2020

Advances in Intelligent Systems and Computing

View full text Add to dashboard Cite

Initial Validation of the Cybersecurity Concept Inventory: Pilot Testing and Expert Review

Cited by 4 publications

References 20 publications

Feasibility Analysis of Subject Specific Pedagogy Physics Learning Module Based on Project Based Learning Integrated with Merdeka Curriculum on Alternative Energy Material

Feasibility Analysis of Subject Specific Pedagogy Physics Learning Module Based on Project Based Learning Integrated with Merdeka Curriculum on Alternative Energy Material

Investigating Crowdsourcing to Generate Distractors for Multiple-Choice Assessments

Experiences and Lessons Learned Creating and Validating Concept Inventories for Cybersecurity

Contact Info

Product

Resources

About