Quality Evaluation Tool for Computer-and Web-Delivered Instruction

Abstract

Public reporting burden for this collection of information is estimated to average I hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to Washington Headquarters. Services Approved for public release; distribution is unlimited. "A" ABSTRACT (Maximum 200 words)The objective of this effort was to develop an Instructional Quality Evaluation Tool to help instructional developers and instructional program managers quantitatively determine the quality of their instructional products, both during development and at project completion. The Tool can also support the comparison of courseware from different developers or courseware that uses different combinations of instructional media. Likert scaling techniques were used to develop 5-point rating scales for each evaluation criterion. Anchor descriptions were developed for each rating point on all scales. This report includes these anchored Likert scales, which can serve as a "stand-alone" Tool. The evaluation criteria are organized into two major sections: instructional features and user-interface design. For those who with additional information or with to conduct a more "in-depth" evaluation, the detailed discussions of each evaluation criterion include definitions of important terms and summaries of the literature that supports the criterion. The discussions also provide suggested techniques to improve courseware by optimizing the instruction from the perspective of each criterion.Recommendations for future improvement of the Tool are provided. EXECUTIVE SUMMARY PROBLEMHigh quality instruction is essential to ensure people learn the knowledge and skills that will enable them to succeed at their jobs. Computer-and web-delivered instruction has the potential to provide much of this needed instruction. Although the military and industry are purchasing large numbers of computer-based and web-delivered courses, there is currently no method, supported by empirical and theoretical literature, to determine if this courseware is of good quality. This is also true for all types of instruction. However, it is especially critical for computer-and web-delivered courseware because these often do not include an instructor to make adjustments to the instructional content "on the fly." OBJECTIVEThe objective of this effort was to develop a tool to help instructional developers and instructional program managers determine the quality of their instructional products, both during development and at project completion. The tool should also support the comparison of courseware from different developers or courseware that uses different combinations of instructional media. It should be designed to be used during all phases of instructional development (i.e., support both formative and summative ...

Utvärdering av nätbaserat lärande avseende användarvänlighet, innehåll och kompetensutveckling

“…Frågeformuläret bestod totalt av 23 frå-gor samt frågor om demografiska variabler och tog ungefär 10-15 minuter att besvara. Utvecklingen och konstruktionen av frågeformuläret inspirerades speciellt av två rapporter, som visar hur utvärdering av nätbaserat lärande gjorts av US Navy respektive Helsingfors universitet (11,12). …”

Program Evaluation Metrics for U.S. Army Lifelong Learning Centers

“…This courseware development team improves the teaching and learning environment by enabling the delivery of more advanced CBT/WBT courseware for distributed/distance learning that is educationally sound and compliant with Army training regulations. Specifically, educationally sound courseware should meet rigorous, independently derived criteria for content, instructional activities, performance assessment and feedback, and usability (Hays, Stout, and Ryan-Jones, 2005). Therefore, the delivery of CBT/WBT courseware produced by specialists may enhance the teaching and learning environment by obviating individual differences in instructor capability to produce engaging, effective, and usable courseware.…”