The GrImage Platform: A Mixed Reality Environment for Interactions

Allard, Jérémie; Franco, Jean-Sébastien; Ménier, Clément; Boyer, Edmond; Raffin, Bruno

doi:10.1109/icvs.2006.59

Cited by 34 publications

(22 citation statements)

References 14 publications

(14 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It is an extended version of previous conference publications [15][16][17][18][19]. The system relies on the EPVH-modeling algorithm [14,20] that computes a 3D mesh of the observed scene from segmented silhouettes and robustly yields an accurate shape model [14,20] at real-time frame rates.…”

Section: Introductionmentioning

confidence: 99%

Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration

Petit

Lesage

Ménier³

et al. 2010

International Journal of Digital Multimedia Broadcasting

View full text Add to dashboard Cite

We present a multicamera real-time 3D modeling system that aims at enabling new immersive and interactive environments. This system, called Grimage, allows to retrieve in real-time a 3D mesh of the observed scene as well as the associated textures. This information enables a strong visual presence of the user into virtual worlds. The 3D shape information is also used to compute collisions and reaction forces with virtual objects, enforcing the mechanical presence of the user in the virtual world. The innovation is a fully integrated system with both immersive and interactive capabilities. It embeds a parallel version of the EPVH modeling algorithm inside a distributed vision pipeline. It also adopts the hierarchical component approach of the FlowVR middleware to enforce software modularity and enable distributed executions. Results show high refresh rates and low latencies obtained by taking advantage of the I/O and computing resources of PC clusters. The applications we have developed demonstrate the quality of the visual and mechanical presence with a single platform and with a dual platform that allows telecollaboration.

show abstract

Section: Introductionmentioning

confidence: 99%

Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration

Petit

Lesage

Ménier³

et al. 2010

International Journal of Digital Multimedia Broadcasting

View full text Add to dashboard Cite

show abstract

“…Rendering virtual views of moving people from multiple cameras has since received considerable interest. Systems for multiple view reconstruction and videobased rendering have been developed [3], [4], [5], [6], [7], [8], [9]. These techniques create a 3D video, also called free-viewpoint video, at a quality that now approaches the original video images [10], [11].…”

Section: Related Work (Sidebar Refs [2]-[16])mentioning

confidence: 99%

Surface Capture for Performance-Based Animation

Starck

Hilton

2007

IEEE Comput. Grap. Appl.

408

365

View full text Add to dashboard Cite

Digital content production traditionally requires highly skilled artists and animators to first manually craft shape and appearance models and then instill the models with a believable performance. Motion capture technology is now increasingly used to record the articulated motion of a real human performance to increase the visual realism in animation. Motion capture is limited to recording only the skeletal motion of the human body and requires the use of specialist suits and markers to track articulated motion.In this paper we present surface capture, a fully automated system to capture shape and appearance as well as motion from multiple video cameras as a basis to create highly realistic animated content from an actor's performance in full wardrobe. We address wide-baseline scene reconstruction to provide 360 degree appearance from just 8 camera views and introduce an efficient scene representation for level of detail control in streaming and rendering. Finally we demonstrate interactive animation control in a computer games scenario using a captured library of human animation, achieving a frame rate of 300fps on consumer level graphics hardware. Index TermsImage-based modelling and rendering, Video-based character animation

show abstract

“…Dynamic 3D multi-view stereo reconstruction (or 3D video) is an image recording technique which produces free-viewpoint videos of 3D models in motion [9,19,11,5,4,2]. It is a markerless motion capture system where subjects do not need to wear special equipment.…”

Section: Introductionmentioning

confidence: 99%

Topology dictionary with Markov model for 3D video content-based skimming and description

Tung

Matsuyama

2009

2009 IEEE Conference on Computer Vision and Pattern Recognition

View full text Add to dashboard Cite

This paper presents a novel approach to skim and describe 3D videos. 3D video is an imaging technology which consists in a stream of 3D models in motion captured by a synchronized set of video cameras. Each frame is composed of one or several 3D models, and therefore the acquisition of long sequences at video rate requires massive storage devices. In order to reduce the storage cost while keeping relevant information, we propose to encode 3D video sequences using a topology-based shape descriptor dictionary. This dictionary is either generated from a set of extracted patterns or learned from training input sequences with semantic annotations. It relies on an unsupervised 3D shapebased clustering of the dataset by Reeb graphs, and features a Markov network to characterize topological changes. The approach allows content-based compression and skimming with accurate recovery of sequences and can handle complex topological changes. Redundancies are detected and skipped based on a probabilistic discrimination process. Semantic description of video sequences is then automatically performed. In addition, forthcoming frame encoding is achieved using a multiresolution matching scheme and allows action recognition in 3D. Our experiments were performed on complex 3D video sequences. We demonstrate the robustness and accuracy of the 3D video skimming with dramatic low bitrate coding and high compression ratio.

show abstract

The GrImage Platform: A Mixed Reality Environment for Interactions

Cited by 34 publications

References 14 publications

Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration

Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration

Surface Capture for Performance-Based Animation

Topology dictionary with Markov model for 3D video content-based skimming and description

Contact Info

Product

Resources

About