Getting Down to Details: Using Theories of Cognition and Learning to Inform Tangible User Interface Design

Abstract

Many researchers have suggested that tangible user interfaces (TUIs) have potential for supporting learning. However, the theories used to explain possible effects are often invoked at a very broad level without explication of specific mechanisms by which the affordances of TUIs may be important for learning processes. Equally problematic, we lack theoretically grounded guidance for TUI designers as to what design choices might have significant impacts on learning and how to make informed choices in this regard. In this paper, we build on previous efforts to address the need for a structure to think about TUI design for learning by constructing the Tangible Learning Design Framework. We first compile a taxonomy of five elements for thinking about the relationships between TUI features, interactions and learning. We then briefly review cognitive, constructivist, embodied, distributed and social perspectives on cognition and learning and match specific theories to the key elements in the taxonomy to determine guidelines for design. In each case, we provide examples from previous work to explicate our guidelines; where empirical work is lacking, we suggest avenues for further research. Together, the taxonomy and guidelines constitute the Tangible Learning Design Framework. The framework advances thinking in the area by highlighting decisions in TUI design important for learning, providing initial guidance for thinking about these decisions through the lenses of theories of cognition and learning, and generating a blueprint for research on testable mechanisms of action by which TUI design can affect learning. RESEARCH HIGHLIGHTS • The Tangible Learning Design Framework is a structure for thinking about TUI design for learning that builds on previous efforts in this area; • A taxonomy of five elements for thinking about the relationships between TUI features, interactions and learning is compiled; • Cognitive, constructivist, embodied, distributed and social perspectives on cognition and learning are reviewed; • Specific theories within each perspective are matched to key elements in the taxonomy to generate guidelines for TUI learning design; • Research areas that require further investigation are identified.

Can a kitchen teach languages? Linking theory and practice in the design of context-aware language learning environments

“…One core issue is the lack of theoretically grounded frameworks and guidance for their development. In a recent paper on the role of learning theory, Antle and Wise (2013) argued that theory is used "at a very broad level" (p. 5) without specific links between the affordances of technological interfaces and how they mediate and affect learning processes. They also posited that there are still very few descriptive examples of interdisciplinary approaches which draw on theories of learning to analyse learning behaviour and formulate frameworks for subsequent use (2013).…”

Exploring the design space of gestural interaction with active tokens through user-defined gestures

“…Recent studies have focused on their use in entertainment, formal and informal learning environments, as well as collaborative search. Multi-touch and tangible interfaces provide form factors that foster collaboration through visibility of actions and egalitarian input [16,23] and support distributed cognition by affording spreading, piling, and organizing information artifacts [3,4]. Such affordances are well suited for sensemaking [37].…”

Transforming Pedagogical Approaches Using Tangible User Interface Enabled Computer Assisted Learning

“…Physical objects provide physical attributes [8], such as visual, tactile, and auditory attributes, as well as spatial properties, such as location, orientation and configuration.…”

“…[8] Touch based interfaces offer dynamic content and control capabilities, where tangible systems offer several benefits by providing more accurate manipulation and faster learning of control actions. Recent attention has been devoted to hybrid tangible interfaces that combine tangible and classical (GUI) interfaces and offer teachers and learners the flexibility to use the most appropriate interaction style in a particular situation [9,10].…”

“…Users interact by moving, manipulating, assembling and disassembling physical objects. Physical objects provide: -Physical attributes: visual attributes, tactile attributes, and auditory attributes, -Spatial properties: location, orientation and configuration [8] External representations have an important role in mediating cognition [6]. Physical attributes provide instant information about shape and colour, for example.…”