Single image summarization of 3D animation using depth images

Lee, Hwan-Jik; Shin, Hyun Joon; Choi, Jung-Ju

doi:10.1002/cav.1448

Cited by 10 publications

(9 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Usually, it is used to explain and describe the advantages of some method compared with others based on presentation or/and description of the key-frames extracted (visual comparison), as in [18,19,22,25,41,51]. This type of evaluation can also be used to discuss the influence of specific parameters or features of the method and also the influence of the content in the key-frame set, as in [10,19].…”

Section: Results Descriptionmentioning

confidence: 99%

“…So far only Assa et al and Lee et al proposed in [17] and [25] two presentation solutions distinct from the static storyboard used in association with most of 3D keyframe extraction methods [10,18,19,22,41,51]. In this scenario, with only two presentation solutions, it is foreseeable that the development of new 3D video and image display devices will lead to the creation of new methods to display 3D video summaries or key-frame collages providing the user with more immersive and more meaningful ways to observe these types of time-condensed video representations.…”

Section: Discussionmentioning

confidence: 99%

“…Lee et al [25] proposed a method to select key-frames from 3D animation video using the depth information of the animation. The extracted key-frames are used to compose a single image summary.…”

Section: Other Methodsmentioning

confidence: 99%

“…1, the input video is segmented into video shots, mostly based on spatio-temporal criteria, but other criteria can be used such as based on motion [20,25] or the combination of the temporal and depth features [11]. More details can be found in Section 1.4.…”

Section: D Key-frame Extraction Frameworkmentioning

confidence: 99%

“…Assa et al proposed a method to create an action synopsis image from a 3D animation sequence or 2D video [17]. Lee et al also proposed a method to summarise a 3D animation into a single image based on depth information [25].…”

Section: Key-frame Presentationmentioning

confidence: 99%

See 4 more Smart Citations

Towards key-frame extraction methods for 3D video: a review

Ferreira

Cruz

Assunção

2016

J Image Video Proc.

View full text Add to dashboard Cite

The increasing rate of creation and use of 3D video content leads to a pressing need for methods capable of lowering the cost of 3D video searching, browsing and indexing operations, with improved content selection performance. Video summarisation methods specifically tailored for 3D video content fulfil these requirements. This paper presents a review of the state-of-the-art of a crucial component of 3D video summarisation algorithms: the key-frame extraction methods. The methods reviewed cover 3D video key-frame extraction as well as shot boundary detection methods specific for use in 3D video. The performance metrics used to evaluate the key-frame extraction methods and the summaries derived from those key-frames are presented and discussed. The applications of these methods are also presented and discussed, followed by an exposition about current research challenges on 3D video summarisation methods.Keywords: 3D key-frames extraction, 3D video summarisation, Shot boundary detection ReviewIn the last years, new features have been implemented in video applications and terminal equipments due to users demand, who are always seeking for new viewing experiences more interactive and immersive, such as those provided by 3D video. This new visual experience is created by depth information that is part of 3D video and absent in classic 2D video. The inclusion of depth information in video signals is not a recent innovation, but the interest in this type of content and aspects related to it, such as acquisition, analysis, coding, transmission and visualisation, have been increasing recently [1,2]. Lately, 3D video has been attracting attention from industry, namely content producers, equipment providers, distributors and from the research community mostly on account of the improvements in Quality of Experience that it provides to viewers [3], as well as due to the new business opportunities presented by this emerging multimedia format. In the past, video repositories were relatively small so that indexing and retrieval operations were easy to perform. More recently, the massification of 3D video and its applications have resulted in the generation of huge amounts of data, increasing the need for methods that can efficiently index, search, browse and summarise the relevant information with minimum human intervention. Furthermore, 3D video description and management is also required to enable quick presentation of the most important information in a user-friendly manner [4,5]. Video summarisation is a video-content representation method that can fulfil these requirements. In contrast to summarisation of 2D video, which has been the subject of a significant amount of research, 3D video summarisation is still a relatively unexplored research problem which deserves more attention.A video summary is a short version of a full-length video that preserves the essential visual and semantic information of the original unabridged content. In the video summarisation process, a subset of key-frames or a set of shorter video...

show abstract

Section: Results Descriptionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Other Methodsmentioning

confidence: 99%

Section: D Key-frame Extraction Frameworkmentioning

confidence: 99%

Section: Key-frame Presentationmentioning

confidence: 99%

See 3 more Smart Citations

Towards key-frame extraction methods for 3D video: a review

Ferreira

Cruz

Assunção

2016

J Image Video Proc.

View full text Add to dashboard Cite

show abstract

TooltY: An Approach for the Combination of Motion Capture and 3D Reconstruction to Present Tool Usage in 3D Environments

Stefanidi

Partarakis

Zabulis

et al. 2021

Intelligent Scene Modeling and Human-Computer Interaction

View full text Add to dashboard Cite

Visualization techniques for usage of tools, handicrafts and assembly operations are employed for demonstrating processes (e.g. assembly instructions). Until today, most commonly used techniques include written information, sketches in manuals, video instructions, etc. The evolution of technology nowadays has generated mature methods for transforming movement to digital information that can be processed and replicated. Motion capture together with 3D reconstruction techniques can provide new ways of digitizing handicrafts. At the same time, Virtual Humans can be used to present craft processes, as well as to demonstrate the usage of tools. For this, the tools utilized in these processes need to be transformed to the digital world. In this paper, we present TooltY, a 3D authoring platform for tool usage presentation in 3D environments, in order to demonstrate simple operations (e.g. usage of hammer, scissors, screwdriver), where the tools are the product of 3D reconstruction. The movement of the Virtual Humans derives from motion capture, while for the one of the tools, a novel approach is used, for inducing the tool motion from the human motion capture. The products of TooltY are Virtual Environments that can be experienced in 3D or through immersion in Virtual Reality.

show abstract

Action snapshot with single pose and viewpoint

et al. 2018

View full text Add to dashboard Cite

Describing a scene via still images is important for a wide spectrum of fields, ranging from arts science. In this paper, we propose a concept, named Action Snapshot, to summarize the virtual scene with a single still image (snapshot). The input to our method is a scene which contains one or two characters, each performing an animation sequence. The goal of our method is to obtain the optimal pose of characters and viewpoint direction which is maximally meaningful in terms of information transmission. Our method is applicable to scenarios involving characters performing different types of activities. We use digital relief generation, one unique form of art creation, to validate our method. it can facilate the personalized artworks and souvenirs quickly prototyped for industry products. A user study is conducted to experimentally compare the outcome of computer-selected poses and viewpoints with participants' selection. The results show that the proposed method can assist in the selection of informative poses and perspectives from an animation-intensive scenario.

show abstract

Single image summarization of 3D animation using depth images

Cited by 10 publications

References 10 publications

Towards key-frame extraction methods for 3D video: a review

Towards key-frame extraction methods for 3D video: a review

TooltY: An Approach for the Combination of Motion Capture and 3D Reconstruction to Present Tool Usage in 3D Environments

Action snapshot with single pose and viewpoint

Contact Info

Product

Resources

About