VIRET Tool with Advanced Visual Browsing and Feedback

Kovalčík, Gregor; Škrhák, Vít; Souček, Tomáš; Lokoč, Jakub

doi:10.1145/3379172.3391725

Cited by 16 publications

(14 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…VIRET [13], vitrivr [9], and Myscéal [29] offer temporal queries to express an information need that spans multiple, consecutive shots, with vitrivr and Myscéal offering the ability to indicate in which time interval the described scenes happened. Many systems provide the functionality of filtering by day and hour, meanwhile others provide temporal context by showing images and respective shots taken before and after [14,17,28,30].…”

Section: Related Workmentioning

confidence: 99%

Interactive Multimodal Lifelog Retrieval with vitrivr at LSC 2021

Heller

Gasser

Parian-Scherb

et al. 2021

Proceedings of the 4th Annual on Lifelog Search Challenge

View full text Add to dashboard Cite

The Lifelog Search Challenge (LSC) is an annual benchmarking competition for interactive multimedia retrieval systems, where participating systems compete in finding events based on textual descriptions containing hints about structured, semi-structured, and/or unstructured data. In this paper, we present the multimedia retrieval system vitrivr, a long-time participant to LSC, with a focus on new functionality. Specifically, we introduce the image stabilisation module which is added prior to the feature extraction to reduce the image degradation caused by lifelogger movements, and discuss how geodata is used during query formulation, query execution, and result presentation. CCS CONCEPTS• Information systems → Search interfaces; Image search; Users and interactive retrieval; Multimedia databases; Information retrieval; • Human-centered computing → Interactive systems and tools.

show abstract

Section: Related Workmentioning

confidence: 99%

Interactive Multimodal Lifelog Retrieval with vitrivr at LSC 2021

Heller

Gasser

Parian-Scherb

et al. 2021

Proceedings of the 4th Annual on Lifelog Search Challenge

View full text Add to dashboard Cite

show abstract

“…With different considerations, Myscéal [28] viewed this as a document retrieval problem by indexing textual annotations and matching with textual queries. Embedding techniques are also commonly based on the idea of encoding concepts from both queries and images tags into the same vector space to calculate the similarity between them [19,20]. Regarding using graphs, LifeGraph [25] applied knowledge graph structure with the nodes representing detected things or scenes recognized in images.…”

Section: Related Workmentioning

confidence: 99%

Graph-Based Indexing and Retrieval of Lifelog Data

Nguyen

Gurrin

2021

MultiMedia Modeling

View full text Add to dashboard Cite

Understanding the relationship between objects in an image is an important challenge because it can help to describe actions in the image. In this paper, a graphical data structure, named "Scene Graph", is utilized to represent an encoded informative visual relationship graph for an image, which we suggest has a wide range of potential applications. This scene graph is applied and tested in the popular domain of lifelogs, and specifically in the challenge of known-item retrieval from lifelogs. In this work, every lifelog image is represented by a scene graph, and at retrieval time, this scene graph is compared with the semantic graph, parsed from a textual query. The result is combined with location or date information to determine the matching items. The experiment shows that this technique can outperform a conventional method.

show abstract

“…The most recent LSC competition (3rd in the series) had 14 participating teams, with a wide range of proposed algorithms to partake in the challenge. The liveXplore [21] and VIRET [18] are two systems that attended all LSC competitions to date. Both applications supported retrieval by implementing a drawing mechanism where users could sketch the general structure of an image need to be searched, and the result can be filtered by the textual annotation which is also the approach of the vitrivr system [16].…”

Section: Related Workmentioning

confidence: 99%

Myscéal 2.0: A Revised Experimental Interactive Lifelog Retrieval System for LSC'21

Tran

Nguyen

Bình

et al. 2021

Proceedings of the 4th Annual on Lifelog Search Challenge

View full text Add to dashboard Cite

Building an interactive retrieval system for lifelogging contains many challenges due to massive multi-modal personal data besides the requirement of accuracy and rapid response for such a tool. The Lifelog Search Challenge (LSC) is the international lifelog retrieval competition that inspires researchers to develop their systems to cope with the challenges and evaluates the effectiveness of their solutions. In this paper, we upgrade our previous Myscéal and present Myscéal 2.0 system for the LSC'21 with the improved features inspired by the novice users experiments. The experiments show that a novice user achieved more than half of the expert score on average. To mitigate the gap of them, some potential enhancements were identified and integrated to the enhanced version. CCS CONCEPTS• Information systems → Information retrieval; • Humancentered computing → Human computer interaction (HCI); User interface design.

show abstract

VIRET Tool with Advanced Visual Browsing and Feedback

Cited by 16 publications

References 9 publications

Interactive Multimodal Lifelog Retrieval with vitrivr at LSC 2021

Interactive Multimodal Lifelog Retrieval with vitrivr at LSC 2021

Graph-Based Indexing and Retrieval of Lifelog Data

Myscéal 2.0: A Revised Experimental Interactive Lifelog Retrieval System for LSC'21

Contact Info

Product

Resources

About