Actions are characterised by ‘canonical moments’ in a sequence of movements

Abstract

Understanding what others are doing is an essential aspect of social cognition that depends on our ability to quickly recognize and categorize their actions. To effectively study action recognition we need to understand how actions are bounded, where they start and where they end. Here we borrow a conceptual approach - the notion of ‘canonicality’ - introduced by Palmer and colleagues in their study of object recognition and apply it to the study of action recognition. Using a set of 50 video clips from stock photography sites, we show that many everyday actions – transitive, intransitive, social, non-social, communicative – are characterized by ‘canonical moments’ in a sequence of movements that are agreed by participants to ‘best represent’ the viewed action in a forced choice (Exp 1, n = 142) and a free choice (Exp 2, n = 125) paradigm. In Exp 3 (n = 102) we confirm that canonical moments from action sequences are more readily named as depicting specific actions and, mirroring research in object recognition, that canonical moments are privileged in memory (Exp 4, n = 95). We suggest that ‘canonical moments’, being those that convey maximal information about human actions, are integral to the representation of human action.