CALM: Categorizing and learning module

Murre, Jaap M. J.; Phaf, R. Hans; Wolters, Gezinus

doi:10.1016/s0893-6080(05)80007-3

Cited by 73 publications

(60 citation statements)

References 53 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Geometrically speaking, the classification process orthogonalizes each of the patterns of a pair with reference to the other patterns in the training set, the subsequent association between those patterns being trivially accomplished without interfering with previously acquired associations. The general scheme is shown in Figure 9 and is functionally almost identical to the ARTMAP network developed by , as well as to many other networks (e.g., Hecht-Nielson 1987;Burton et al 1990; McLaren 1993;Murre 1992;Murre et al 1992). It is also functionally equivalent to a noisy version of the nearest-neighbour classification algorithm used in the machine-learning community, and structurally equivalent to more general psychological models including the category-learning models described in previous sections and other models such as the one proposed by Bower (1996).…”

Section: Supervised Learningmentioning

confidence: 88%

“…In characterizing such a localist approach I have sought to generalize from a number of different models (e.g., Burton 1994;Carpenter & Grossberg 1987a;1987b;Foldiak 1991;Kohonen 1984;Murre 1992;Murre et al 1992;Nigrin 1993;Rumelhart & Zipser 1986). These models differ in their details but are similar in structure and I shall attempt to draw together the best features of each.…”

Section: A Generalized Localist Modelmentioning

confidence: 99%

See 1 more Smart Citation

Connectionist modelling in psychology: A localist manifesto

Page¹

2000

Behav Brain Sci

220

162

View full text Add to dashboard Cite

Over the last decade, fully distributed models have become dominant in connectionist psychological modelling, whereas the virtues of localist models have been underestimated. This target article illustrates some of the benefits of localist modelling. Localist models are characterized by the presence of localist representations rather than the absence of distributed representations. A generalized localist model is proposed that exhibits many of the properties of fully distributed models. It can be applied to a number of problems that are difficult for fully distributed models, and its applicability can be extended through comparisons with a number of classic mathematical models of behaviour. There are reasons why localist models have been underused, though these often misconstrue the localist position. In particular, many conclusions about connectionist representation, based on neuroscientific observation, can be called into question. There are still some problems inherent in the application of fully distributed systems and some inadequacies in proposed solutions to these problems. In the domain of psychological modelling, localist modelling is to be preferred.Keywords: choice; competition; connectionist modelling; consolidation; distributed; localist; neural networks; reaction-time Mike Page studied Engineering Science at Oxford University before obtaining a doctorate in connectionist modelling of music perception at the University of Wales, Cardiff. He is currently a nontenured scientist at the Medical Research Council Cognition and Brain Sciences Unit in Cambridge, United Kingdom, where he works on connectionist modelling of memory, in particular, memory for serial order.interactive activation and competition models, competitive learning models). Nonetheless, the terms "PDP" and "distributed" on the one hand, and "localist" on the other, have come to be seen as dichotomous. I will show this apparent dichotomy to be false and will identify those issues over which there is genuine disagreement.A word of caution: "Neural networks" have been applied in a wide variety of other areas in which their plausibility as models of cognitive function is of no consequence. In criticizing what I see to be the overuse (or default use) of fully distributed networks, I will accordingly restrict discussion to their application in the field of connectionist modelling of cognitive or psychological function. Even within this more restricted domain there has been a large amount written about the issues addressed here. Moreover, it is my impression that the sorts of things to be said in defence of the localist position will have occurred independently to many of those engaged in such a defence. I apologize in advance, therefore, for necessarily omitting any relevant references that have so far escaped my attention. No doubt the BBS commentary will set the record straight.The next section will define some of the terms to be used throughout this target article. As will be seen, certain subtleties in such definitions becloud th...

show abstract

Section: Supervised Learningmentioning

confidence: 88%

Section: A Generalized Localist Modelmentioning

confidence: 99%

Connectionist modelling in psychology: A localist manifesto

Page¹

2000

Behav Brain Sci

220

162

View full text Add to dashboard Cite

show abstract

“…Given cooperation between neurons coding for features of the same proto-object in different modules, in combination with competition between neurons coding for features of different proto-objects within modules (see also [37,118]), allows such incongruent resolutions. For example, neurons coding for a feature of a proto-object may 'win' in the colour module, while neurons coding for a feature of another proto-object win in the shape module.…”

Section: (I) From Visual Features To Proto-objectsmentioning

confidence: 99%

The interplay of attention and consciousness in visual search, attentional blink and working memory consolidation

Raffone

Srinivasan

Leeuwen

2014

Phil. Trans. R. Soc. B

View full text Add to dashboard Cite

Despite the acknowledged relationship between consciousness and attention, theories of the two have mostly been developed separately. Moreover, these theories have independently attempted to explain phenomena in which both are likely to interact, such as the attentional blink (AB) and working memory (WM) consolidation. Here, we make an effort to bridge the gap between, on the one hand, a theory of consciousness based on the notion of global workspace (GW) and, on the other, a synthesis of theories of visual attention. We offer a theory of attention and consciousness (TAC) that provides a unified neurocognitive account of several phenomena associated with visual search, AB and WM consolidation. TAC assumes multiple processing stages between early visual representation and conscious access, and extends the dynamics of the global neuronal workspace model to a visual attentional workspace (VAW). The VAWis controlled by executive routers, higher-order representations of executive operations in the GW, without the need for explicit saliency or priority maps. TAC leads to newly proposed mechanisms for illusory conjunctions, AB, inattentional blindness and WM capacity, and suggests neural correlates of phenomenal consciousness. Finally, the theory reconciles the all-or-none and graded perspectives on conscious representation

show abstract

“…In (22), the connection matrix of HN-COR corresponds to X. Thus, the eigenvectors of HN-COR are equivalent to those of 1-module CCHN, i.e., the dynamical features of HN-COR and 1-module CCHN are characterized in the same orthogonal subspace.…”

Section: Contribution Of a Single Interactionmentioning

confidence: 99%

“…In this model, the states of a module are, in general, dynamically updated taking into account not only its given information processing but also the consistency of its relationship with other modules. Previous research has offered several approaches to interactive MNNs and their real-world applications (e.g., Carpenter and Grossberg 1988 ;Hassoun 1989;Kosko 1989;Tsutsumi 1989Tsutsumi , 1990; Murre et al 1992; Fukushima and Imagawa 1993;Happel and Murre 1994).…”

Section: Introductionmentioning

confidence: 99%

An artificial modular neural network and its basic dynamical characteristics

Ozawa

Tsutsumi

Baba

1998

Biological Cybernetics

View full text Add to dashboard Cite

This work contains a proposition of an artificial modular neural network (MNN) in which every module network exchanges input/output information with others simultaneously. It further studies the basic dynamical characteristics of this network through both computer simulations and analytical considerations. A notable feature of this model is that it has generic representation with regard to the number of composed modules, network topologies, and classes of introduced interactions. The information processing of the MNN is described as the minimization of a total-energy function that consists of partial-energy functions for modules and their interactions, and the activity and weight dynamics are derived from the total-energy function under the Lyapunov stability condition. This concept was realized by Cross-Coupled Hopfield Nets (CCHN) that one of the authors proposed. In this paper, in order to investigate the basic dynamical properties of CCHN, we offer a representative model called Cross-Coupled Hopfield Nets with Local And Global Interactions (CCHN-LAGI) to which two distinct classes of interactions -local and global interactionsare introduced. Through a conventional test for associative memories, it is confirmed that our energy-function-based approach gives us proper dynamics of CCHN-LAGI even if the networks have different modularity. We also discuss the contribution of a single interaction and the joint contribution of the two distinct interactions through the eigenvalue analysis of connection matrices.

show abstract

CALM: Categorizing and learning module

Cited by 73 publications

References 53 publications

Connectionist modelling in psychology: A localist manifesto

Connectionist modelling in psychology: A localist manifesto

The interplay of attention and consciousness in visual search, attentional blink and working memory consolidation

An artificial modular neural network and its basic dynamical characteristics

Contact Info

Product

Resources

About