Evaluation of ITEM for proactive development

Abstract

Evaluation will be the key to effective and efficient implementation and use of information technology in education management. As hardware, software and the needs of users develop and change, such evaluation will need to be both proactive and dynamic in that it must continually inform how the systems need to be modified to allow the potential to be fully realised. Dynamic evaluation can then be used to inform the system design, training, support and documentation to ensure end-user acceptance of the systems and provide administration support and information relevant to enhanced decision making processes. Findings from a preliminary study in early 1995 of the Hong Kong School Administration and Management System (SAMS) will be used to illustrate the problems which can occur without carefully planned and contextualised evaluation.

Evaluation strategy for ITEM quality

“…These issues, and others less predictable, were identified in a small scale research project which aimed at contextualising industrial based evaluation tools for the education sector (Wild et aI., 1992). Rapidly increasing information needs have meant that systems have been developed reactively rather than proactively to improve organisational efficiency and effectiveness (Wild & Fung, 1996). Another issue explored at the conference was the influence of organisational culture on ITEM effectiveness (O 'Mahony, 1996;Reyes 1996).…”

“…The Discussion Group noted that evaluation often became a low priority in ITEM development and maintenance efforts, and recognised that useful evaluations must be continuous and cyclical in nature Wild & Fung, 1996). The evaluation process must necessarily be time-consuming, but is crucial to achieving success throughout many parts of educational organisations.…”