Evolving a population code for multimodal concept learning

Abstract

We describe an evolutionary method for learning concepts of objects from multimodal data. The proposed method uses a population code (hypernetwork representation), i.e. a collection of codewords (hyperedges) and associated weights, which is adapted by evolutionary computation based on observations of positive and negative examples. The goal of evolution is to find the best compositions and weights of hyperedges to estimate the underlying distribution of the target concepts. We discuss the relationship of this method with estimation of distribution algorithms (EDAs), classifier systems, and ensemble learning methods. We evaluate the method on a suite of image/text benchmarks. The experimental results demonstrate that the evolutionary process successfully discovers salient codewords representing multi-modal feature combinations for describing and distinguishing different concepts. We also analyze how the complexity of the population code evolves as learning proceeds.