The Mental Image Directed Semantic Theory (MIDST) has proposed an intermediate knowledge representation scheme based on an omnisensual mental image model. This paper presents a formal language for describing multimedia contents, L md , whose syntax and semantics are based on MIDST and its application to linguistic interpretation of human motion data obtained through a motion capture system, which we think will serve for linguistic summarization of immense amount of time-sequenced non-linguistic data such as movies.
SUMMARYThe authors have developed a syntactic and semantic HPSG analysis system based on Mental-Image Directed Semantic Theory (MIDST). While conventional HPSG and JPSG parsers are based on situation semantics, MIDST provides a representation with deeper meaning for natural language by referring to the mental images evoked. Semantic analysis systems based on MIDST, however, have to date employed dependency grammar, requiring word meaning to be represented in two parts. HPSG describes such meanings uniformly, allowing for analysis systems with wide coverage. The proposed system has been developed using common analysis engine for both English and Japanese, requiring only the change of resources such as lexical entries and grammar rules.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.