Content-Based Visual Summarization for Image Collections

Pan, Xingjia; Tang, Fan; Dong, Weiming; Ma, Chongyang; Ye, Meng; Huang, Feiyue; Lee, Tong‐Yee; Xu, Changsheng

doi:10.1109/tvcg.2019.2948611

Cited by 16 publications

(9 citation statements)

References 44 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the future, we will take advantage of template generated methods like Ref. [4] to enhance the generality of the algorithm.…”

Section: Limitation and Discussionmentioning

confidence: 99%

“…Zheng et al [17] used a deep generative model for sketching with user semantics information input. Pan et al [4] visualized image collection summarization and generated the layout via tree-based image content analysis. Gan et al [18] managed albums in a comic-like layout based on image classification.…”

Section: Image Collagementioning

confidence: 99%

“…The design of MPC is time and energy consuming for non-professional users. Image collage methods are carefully designed to manage and explore the visualization of large image collections on a canvas [1][2][3][4]. These methods focus on information aggregation and presentation to help users analyze image collections.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Non-dominated sorting based multi-page photo collage

et al. 2021

Self Cite

View full text Add to dashboard Cite

The development of social networking services (SNSs) revealed a surge in image sharing. The sharing mode of multi-page photo collage (MPC), which posts several image collages at a time, can often be observed on many social network platforms, which enables uploading images and arrangement in a logical order. This study focuses on the construction of MPC for an image collection and its formulation as an issue of joint optimization, which involves not only the arrangement in a single collage but also the arrangement among different collages. Novel balance-aware measurements, which merge graphic features and psychological achievements, are introduced. Non-dominated sorting genetic algorithm is adopted to optimize the MPC guided by the measurements. Experiments demonstrate that the proposed method can lead to diverse, visually pleasant, and logically clear MPC results, which are comparable to manually designed MPC results.

show abstract

“…In the future, we will take advantage of template generated methods like Ref. [4] to enhance the generality of the algorithm.…”

Section: Limitation and Discussionmentioning

confidence: 99%

Section: Image Collagementioning

confidence: 99%

See 1 more Smart Citation

Non-dominated sorting based multi-page photo collage

et al. 2021

Self Cite

View full text Add to dashboard Cite

show abstract

“…Liu et al (2018) developed a constrained multidimensional scaling (MDS) solver to faithfully retain the underlying grid in the placement of items. Pan et al (2019) introduced an approach for generating a tree-based layout of items by adaptively partitioning the screen space.…”

Section: Pattern Layout Optimizationmentioning

confidence: 99%

Gaze-driven placement of items for proactive visual exploration

Takahashi

Uchita

Watanabe

2021

J Vis

View full text Add to dashboard Cite

Recent advances in digital signage technology have improved the ability to visually select specific items within a group. Although this is due to the ability to dynamically update the display of items, the corresponding layout schemes remain a subject of research. This paper explores the sophisticated layout of items by respecting the underlying context of searching for favorite items. Our study begins by formulating the static placement of items as an optimization problem that incorporates aesthetic layout criteria as constraints. This is further extended to accommodate the dynamic placement of items for more proactive visual exploration based on the ongoing search context. Our animated layout is driven by analyzing the distribution of eye gaze through an eye-tracking device, by which we infer how the most attractive items lead to the finally wanted ones. We create a planar layout of items as a context map to establish association rules to dynamically replace existing items with new ones. For this purpose, we extract the set of important topics from a set of annotated texts associated with the items using matrix factorization. We also conduct user studies to evaluate the validity of the design criteria incorporated into both static and dynamic placement of items. After discussing the pros and cons of the proposed approach and possible themes for future research, we conclude this paper.

show abstract

“…It should be noted that this study focused on the information summarization of an image collection. Some methods consider attractiveness [10], aesthetic [11], quality [12], and further images' factors [13] as important attributes for doing summarization. Even though the features are considered as important in summarization, the focus of the presented study was on semantic information.…”

mentioning

confidence: 99%

Image Collection Summarization Method Based on Semantic Hierarchies

Samani

Moghaddam

2020

View full text Add to dashboard Cite

The size of internet image collections is increasing drastically. As a result, new techniques are required to facilitate users in browsing, navigation, and summarization of these large volume collections. Image collection summarization methods present users with a set of exemplar images as the most representative ones from the initial image collection. In this study, an image collection summarization technique was introduced according to semantic hierarchies among them. In the proposed approach, images were mapped to the nodes of a pre-defined domain ontology. In this way, a semantic hierarchical classifier was used, which finally mapped images to different nodes of the ontology. We made a compromise between the degree of freedom of the classifier and the goodness of the summarization method. The summarization was done using a group of high-level features that provided a semantic measurement of information in images. Experimental outcomes indicated that the introduced image collection summarization method outperformed the recent techniques for the summarization of image collections.

show abstract

Content-Based Visual Summarization for Image Collections

Cited by 16 publications

References 44 publications

Non-dominated sorting based multi-page photo collage

Non-dominated sorting based multi-page photo collage

Gaze-driven placement of items for proactive visual exploration

Image Collection Summarization Method Based on Semantic Hierarchies

Contact Info

Product

Resources

About