Aware Computing in Spatial Language Understanding Guided by Cognitively Inspired Knowledge Representation

Abstract

Mental image directed semantic theory (MIDST) has proposed an omnisensory mental image model and its description languageLmd. This language is designed to represent and compute human intuitive knowledge of space and can provide multimedia expressions with intermediate semantic descriptions in predicate logic. It is hypothesized that such knowledge and semantic descriptions are controlled by human attention toward the world and therefore subjective to each human individual. This paper describesLmdexpression of human subjective knowledge of space and its application to aware computing in cross-media operation between linguistic and pictorial expressions as spatial language understanding.

Intuition as mental image processing: Some psycholinguistic considerations on intuitive sensory data structuring and processing based on mental image directed semantic theory

“…This model defined human intuition as an unconscious cognitive unit and explained it fairly well as a set of functions specialized such as image articulator F I , abstractor F A , and reverser F R . The author thinks that knowledge representation in L md can computerize these functions easier than other conventional ones without any cognitive model as well as the case of F R already demonstrated [5,6].…”

“…Intuition is to be given as a set of procedural functions. For example, already reported [5,6], semantic equivalency intuitively experienced at S1 and S2 (or S3 and S4) is explained by the postulate 'Reversibility of Spatial Change Event', employing the special function 'Image-reverser', F R .…”

“…At present, about 50 attributes and 6 categories of standards concerning the physical world have been extracted from thesauri. Event patterns are the most important for our approach and have been already reported concerning several kinds of attributes [6]. Fig.8 shows several examples of event patterns in the attribute space of 'physical location (A 12 )'.…”

“…For example, Fig.9 concerns the perception of the formation of multiple objects, where FAO runs along an imaginary object so called 'Imaginary Space Region (ISR)'. This spatial change event can be verbalized as S7 using the preposition 'between' and formulated as (5) or (6), corresponding also to such concepts as 'row', 'line-up', etc., where A 13 denotes the attribute 'Direction'. As for natural concepts of topological relations between two objects such as 'in', ISRs and the 9-intersection model [3] are employed in such a way as (7) or (8) for S8, and (9) for S9, where 'In', 'Cont' and 'Dis' are the values 'inside', 'contains' and 'disjoint' of the attribute 'Topology (A 44 )' with the standard '9-intersection model (K 9IM )', respectively.…”