Conceptural Analysis and Description of Words for Color and Lightness for Grounding them on Sensory Data.

Abstract

SummaryDevelopment of intelligent robots and rapid increase of aged societies have brought serious necessity of such systems that should facilitate mutual translation of sensory data and linguistic expressions. They are expected to help people, especially with some defected sense-organ, by translating sensory data into words such as "Pungent smell is sensed in the refrigerator!", and otherwise enable people to order a robot to work by words such as "Search the room for a varicolored object."For the purpose to develop such a system, the authors have recently analyzed and described the concepts of Japanese words for "color" and "lightness" based on MIDST(Mental image directed semantic theory) proposed by Yokota,M. et al.The analysis and description of the word concepts were performed approximately in the process as follows. Firstly, each word representing a specific color or lightness(" (=red)", " (=dark)", etc) was associated with a set of specific coordinates (point or range) of the color solid and its concept was defined as such a set of coordinates. Secondly, the words concerning temporal change or spatial distribution of color or lightness(" (=redden)", " (=gradate)", etc) were described as spatiotemporal relations among coordinates of the color solid. Thirdly, a computer system working with image input devices was constructed in order to ground words on real sensory data of color and lightness via the coordinates of the color solid in an interactive way with a human instructor, and has been found a fairly good success.

Towards Artificial Communication Partners with a Multiagent Mind Model Based on Mental Image Directed Semantic Theory

“…More analytically, these omnisensory images are associated with spatiotemporal changes (or constancies) in certain attributes of the matters scanned by FAO and modeled as temporally parameterized "loci in attribute spaces", so www.intechopen.com Towards Artificial Communication Partners with a Multiagent Mind Model Based on Mental Image Directed Semantic Theory 335 called, to be formulated in the formal language L md . This language has already been implemented on several types of computerized intelligent systems including IMAGES-M (e.g., Yokota et al, 1984;Oda, et al, 2001;Amano, et al, 2005;Yokota & Capi, 2005a). The most remarkable feature of L md is its capability of formalizing spatiotemporal matter concepts grounded in human/robotic sensation while the other similar KRLs are designed to describe the logical relations among conceptual primitives represented by lexical tokens (e.g., Dorr & Bonnie, 1997;Zarri, 1997;Sowa, 2000).…”

A multi-agent model of human mind based on mental image directed semantic theory for comprehensible communication between humans and robots

“…The model is very simple but the locus formula representation as MPR can work fairly well, which has been partly proven by the successful results of several versions of the intelligent system IMAGES [3], [6], [7], [9].…”

An Approach to Human-Robot Networking Based on a Multi-Agent Mind Model

“…The CMM is one kind of the multi-agent models [2]. Its most distinctively remarkable point is that it works by computing mental phenomena representations so called 'Locus formulas' based on the Mental Image Directed Semantic Theory (MIDST) [3], whose validity has been proven by the successful results of several versions of the intelligent system IMAGES [3], [6], [7], [9]. The MIDST has been proposed in the scope of humans but it is general enough for such a common framework.…”

“…At first, we formalize a piece of communication (C) as a set of messages (m's) in the expression (9). The authors have found that there are almost unique correspondences between the kinds of tasks (T's) and the types of sentences as shown in Table 1, which are very useful for computation.…”