Immersive projection displays such as CABIN and COSMOS have been connected through the broad band network. This kind of network environment is expected to be used as a multimedia virtual laboratory. In particular, video avatar technology has been developed in order to realize high presence communication in this multimedia virtual laboratory. A video avatar is a computer-synthesized threedimensional image created using live video. This method has the characteristics of being a natural, accurate and convenient communication tool. In this study, communication capabilities of the video avatar were experimentally evaluated. In addition, the video avatar technology was applied to several communications applications, such as that of guiding colleagues and undertaking design work in networked immersive projection displays. As a national project aimed at sharing a high presence virtual world using these networked immersive projection displays, the multimedia virtual laboratory (MVL) project has been promoted by the Ministry of Posts and Telecommunications in Japan. The multimedia virtual laboratory is a concept of linked network environments in which remote users can mutually communicate through the network as if they are in the same place. In order to realize the concept of the multimedia virtual laboratory, the construction of a high presence communication technology in the shared virtual world has been a key issue.The computer graphics avatar is often used as a communication method in the networked virtual world [4]. Though this method represents the three-dimensional user's figure in the virtual world, it is difficult to represent natural facial expressions using the polygon model. A method of using a previously captured facial texture image has also been proposed [5]. However, it is difficult to represent instantaneous facial expression by deforming the original image of the face. In order to represent a high presence image of the user, the development of avatar technology using a video image is desired [6].In the video conference system or associated communication systems such as ClearBoard[7], remote users can communicate face to face using their live video images. However, we cannot say that they are sharing a threedimensional world, because these systems only transmit twodimensional video images. In the InterSpace[8] or Virtual Human[9] systems, though a live video image is used to represent the avatar's face, its body is created using the polygon model. In the immersive projection displays, avatar technology using a full-length video image of the user would be effective.Therefore, in this study, a stereo video avatar was developed. This technology realizes high presence communication within the networked immersive projection display by transmitting three-dimensional information about the user, such as position and gestures, by using a live video. This paper describes the video avatar technology developed in this study, and the communication capabilities of this method.
In this study, collaborative scientific visualization environment was constructed by connecting the CABIN to the several immersive projection displays and the supercomputers via a broad band network. In this environment, the users in the remote places are able to discuss the displayed phenomenon looking at the same data. In particular, the video avatar method was developed to realize a natural communication in the shared virtual world. This method was applied to visualizing several kinds of scientific data and the effectiveness was evaluated.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.