ACODE Benchmarks for technology enhanced learning (TEL)

Abstract

This discussion presents findings from 24 higher education institutions (HEIs), recommendations regarding the benchmarks themselves and for university practice, potential expansion of the benchmark methodology to provide more capacity to create and use data to evidence student learning in a technology enhanced learning (TEL) environment. Design/Methodology/Approach: These are preliminary results of a major benchmarking activity that is designed to be part of a continuing program that is still under review. Results are provided through frequency distribution and illustrative qualitative information gleaned from two surveys provided participants, one during the collaborative session between participants from the 24 HEIs and nine months later. An analysis of the data in the form of recommendations is also provided. Practical implications: Firstly, Australia's Tertiary Education Quality & Standards Agency (TEQSA) is expanding the use of benchmarking activities at HEIs as part of their quality assurance practice to meet regulatory compliance requirements. The use of the ACODE Benchmarks facilitates therefore assists HEIs meet their regulatory compliance obligations. Secondly, Originality/value: ACODE is one of the few international agencies focusing on TEL benchmarks, criteria, guidelines or standards. A number of the participating HEIs are considered leading practitioners of learning and teaching in TEL and thus they not only inform but help shape the values and inform QA agencies of appropriate practice that should be embedded within the standards and/or practices that generate recognition of HEI practice.

Benchmarking as an Instrument for Continuous Improvement in a Regulated Higher Education Quality Assurance Environment

“…Created in 2004, the Benchmarks were revised in 2007 and updated in 2014 to reflect the evolving experience in the effective application of TEL and the emergence of new technologies and practices. They were designed to be used as an internal audit tool, a process to undertake inter-institutional comparisons and as a mechanism to inform TEL-related (and potentially broader learning and teaching) change within HEIs (Sankey & Padró, 2016). One concrete application provided by the Benchmarks has been assisting HEIs has been the ability to define their frameworks -organisational decision-making, praxis and responsibility boundaries -by technologies already present or being considered for adoption, such as:…”

“…The 2014 update was based on the outlook for the Benchmark's "fitness of purpose", long-term viability and determination if use by HEIs was either a one-off or ongoing improvement or QE proposition (Sankey & Padró, 2016). To determine the answers, it was agreed that the Camp and De Toro (1999) five-phase, ten-step process was the preferred approach to take.…”

“…For more detailed results from Round 1, please refer to findings reported in various conference presentations, journal articles and reports (e.g., Sankey, 2014;Sankey & Padró, 2016). It was held at Macquarie University in Sydney in June 2014.…”

“…The 2014 update was based on a full-scale review of the eight Benchmarks based on [1] continued "fitness of purpose", [2] long-term viability, [3] extent of use by HEIs, and [4] whether the benchmarking process itself was used as one-off process or for ongoing QA and quality enhancement (QE) of internal HEI TEL activities (Sankey & Padró, 2016). Although ACODE's reputation is solid in the HES (e.g., Booth, 2012;Keppell et al, 2011), interest over the recognition of sector leadership for providing guidance on TEL drove the benchmarking exercise decision-making process.…”

“…Each Benchmark was designed to look at specific aspects of TEL decision-making related to governance and planning, technology and support systems for staff and students. While it was intended that the Benchmarks could be used separately -and thus are discrete -based on the overlap of some of the areas under review -some deliberate duplication of PIs was built in (ACODE, 2014;Sankey & Padró, 2016).…”