The ASSISTments Ecosystem: Building a Platform that Brings Scientists and Teachers Together for Minimally Invasive Research on Human Learning and Teaching

Abstract

The ASSISTments project is an ecosystem of a few hundred teachers, a platform, and researchers working together. Development professionals help train teachers and get teachers to participate in studies. The platform and these teachers help researchers (sometimes explicitly and sometimes implicitly) simply by using content the teacher selects. The platform, hosted by Worcester Polytechnic Institute, allows teachers to write individual ASSISTments (composed of questions with answers and associated hints, solutions, web-based videos, etc.) or to use pre-built ASSISTments, bundle them together in a problem set, and assign these to students. The system gives immediate feedback to students while they are working and provides student-level data to teachers on any assignment. The word "ASSISTments" blends tutoring "assistance" with "assessment" reporting to teachers and students. While originally focused on mathematics, the platform now has content from many other subjects (e.g., science, English, Statistics, etc.). Due to the large library of mathematics content, however, it is mostly used by math teachers. Over 50,000 students used ASSISTments last school year (2013-4) and this number has been doubling each year for the last 8 years. The platform allows any user, mostly researchers, to create randomized controlled trials in the content, which has helped us use the tool in over 18 published and an equal number of unpublished studies. The data collected by the system has also been used in a few dozen peer-reviewed data mining publications. This paper will not seek to review these publications, but instead we will share why ASSISTments has been successful and what lessons were learned along the way. The first lesson learned was to build a platform for learning sciences, not a product that focused on a math topic. That is, ASSISTments is a tool, not a curriculum. A second lesson learned is expressed by the mantra "Put the teacher in charge, not the computer." This second lesson is about building a flexible system that allows teachers to use the tool in concert with the classroom routine. Once teachers are using the tool they are more likely to want to participate in research studies. These lessons were born from the design decisions about Int

Constraint-based Student Modelling in Probability Story Problems with Scaffolding Techniques

“…There are two prominent scaffolding techniques (i) scaffolding questions [31,32,33,34,35] and (ii) scaffolding feedback [36]. Scaffolding questions are intended to be a sequence of questions to aid the students build understanding.…”

AI as a Methodology for Supporting Educational Praxis and Teacher Metacognition

“…The proposal to create a techno-intellectual infrastructure for supporting educators' metacognition brings to sharp focus several areas of pertinence, namely, academic and industrial attempts to create communities of educational practice such as ASSISTments (Heffernan and Heffernan 2014), ALEKS (Falmagne et al 2006), Learning Designer (Laurillard 2012), or STAR./LBD.Legacy (Schwartz et al 1998); work related to teachers' metacognition and its importance to continuous professional development (CPD) and pedagogical innovation (Lin et al 2005;Lin and Schwartz 2003); and AI, especially knowledge representation and engineering (e.g. Davis et al 1993;Conlon and Pain 1996).…”

“…ASSISTments (Heffernan and Heffernan 2014) is another system, which claims a high volume of usage in the US and further afield. As with the previous two examples it can be broadly categorised as an e-assessment system, which has been at least inspired by AI approaches, in particular the model-and example-tracing paradigms developed as part of the Cognitive Tutors endeavour (e.g.…”

moocRP: Enabling Open Learning Analytics with an Open Source Platform for Data Distribution, Analysis, and Visualization

“…While it is not currently a MOOC repository, it is widely used in the Intelligent Tutoring Systems community, and we would be remiss to not acknowledge its impact and use in the learning community. DataShop hosts datasets as a service to the community, largely from the Cognitive Tutor (Anderson et al 1995), which was born out of the same lab, as well as from other tutoring systems such as the Andes Physics Tutor (Veeramachaneni et al 2014), the Open Learning Initiative (OLI) (Lovett et al 2008) for college statistics, a web-based mathematics platform, ASSISTments (Heffernan and Heffernan 2014), among others. These tutoring systems are based on mastery learning (Bloom 1968) and the effective practice of providing immediate feedback (Corbett and Anderson 2001) in achieving that mastery.…”