Multimodal virtual navigation of a cultural heritage site: The medieval ceiling of Steri in Palermo

Andolina, Salvatore; Santangelo, Antonella; Cannella, Mirco; Gentile, Antonio; Agnello, Francesco; Villa, Benedetto

doi:10.1109/hsi.2009.5091039

Cited by 4 publications

(5 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this work, a relational agent was designed and implemented to improve the interaction in the prototype virtual guide proposed by authors in [1]. The guide assists visitors during their tour at the Sala Magna of the Steri, the historical headquarters of the University of Palermo.…”

Section: Discussionmentioning

confidence: 99%

“…In this section we describe the whole system, starting from the description of the previous system [1] and focusing on the innovation due to the integration of the dialogue manager module, especially with regard to improvements in the interaction paradigm.…”

Section: The Multimodal Virtual Guide Of the Ceilingmentioning

confidence: 99%

“…In [1] authors presented a prototype virtual guide to assist visitors during their visit at the Sala Magna of the Steri, the historical headquarters of the University of Palermo. Specifically, a multimodal interface allows visitors to navigate the virtual representation of an ancient wood ceiling ( fig.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Adaptive Voice Interaction for 3D Representation of Cultural Heritage Site

Andolina

Santangelo

Gentile

2010

2010 International Conference on Complex, Intelligent and Software Intensive Systems

View full text Add to dashboard Cite

In the area of cultural heritage preservation and fruition the development of electronics and information technologies has opened new scenarios of research in the field of survey, representation and communication of Cultural Heritage. The aim is thus to make the fruition of works of art available to as many users as possible by using survey techniques and multimodal interaction. In this paper we propose a multimodal fruition of a virtual representation of a medieval ceiling, built in the XIV century, which covers the "Sala Magna" in the Steri of Palermo. The research deals with the design of an intelligent relational agent which interacts with the user in a natural way. To address this very issue a vocal guide has been implemented and wrapped around on the 3D model. This guide assists the user during the visit by means of vocal interaction, so the user can easily navigate the 3D model using voice command. An intelligent relational agent embodied into the system, provides user with a more natural and intelligent way of interaction.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: The Multimodal Virtual Guide Of the Ceilingmentioning

confidence: 99%

See 1 more Smart Citation

Adaptive Voice Interaction for 3D Representation of Cultural Heritage Site

Andolina

Santangelo

Gentile

2010

2010 International Conference on Complex, Intelligent and Software Intensive Systems

View full text Add to dashboard Cite

show abstract

“…A healthy number of (mobile) AR applications have successfully been applied in the Art domain [Gwilt 2009] [Damala et al 2008] [Andolina et al 2009] [Bruns et al 2007] [Choudary et al 2009] [Chou et al 2005] [Srinivasan et al 2009]. To date, however, few have proposed eye-tracking as an added dimension.…”

Section: Introductionmentioning

confidence: 98%

Enhancing art history education through mobile augmented reality

McNamara

2011

Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry

View full text Add to dashboard Cite

This paper describes a new project which will focus on the integration of eye-tracking technology with mobile Augmented Reality (AR) systems. AR provides an enhanced vision of the physical world by integrating virtual elements, such as text and graphics, with real-world environments. The advent of affordable mobile technology has sparked a resurgence of interest in mobile AR applications. Inherent in mobile AR applications is the powerful ability to visually highlight information in the real world. We are working on new algorithms to harness this ability to direct gaze to Points of Interest (POIs). Combining mobile AR and image manipulation gives visual distinction to POIs in order to directly influence and direct gaze in real world scenes. Our initial test domain is that of Art History Education. POIs are determined based on salient regions of paintings, as identified by the visual narrative of the painting. We are developing new system that will be deployed in the Museum of Fine Art in Houston that will enhance visitor education through the use of gaze-directed mobile AR.

show abstract

“…The marriage of technology and art appreciation is not new -several existing applications have successfully been applied in the Art domain [Gwilt 2009] [Damala et al 2008] [Andolina et al 2009] [Bruns et al 2007] [Choudary et al 2009] [Chou et al 2005] [Srinivasan et al 2009]. To date, however, few have proposed eyetracking as an added dimension.…”

Section: Previous Workmentioning

confidence: 99%

Directing gaze in narrative art

McNamara¹,

Booth

Sridharan

et al. 2012

Proceedings of the ACM Symposium on Applied Perception

View full text Add to dashboard Cite

Figure 1: Fixation maps over an art work that contains separate panels, which, when viewed in the intended order, tell a coherent story. In this work a gaze direction technique is used to visually guide the viewer through the image. As can be seen above the distribution of fixations is very different for static viewing (A), and Gaze Directed viewing (B). The highlighted rectangular regions indicate story panels, and the numbered circles indicate viewing order. In the gaze directed case, both order viewing accuracy and fixations on relevant panels increased. AbstractNarrative art tells a story, either as a moment in an ongoing story or as a sequence of events unfolding over time. In many works of art separate panels within the same frame are used to depict the sequence of events. Often, there is no clear delineation between these panels, or any indication of the optimal viewing order. To improve visual literacy we propose using Subtle Gaze Direction (SGD) to direct the viewers gaze across an image in a manner which reveals the story. SGD uses small image space modulations in the luminance channel to guide a viewer's gaze about an image without disrupting their normal visual experience. Using a simple ordering task we compared performance using no modulation and using subtle modulation with the correct order of narrative episodes as intended by the artist. Results from experiments show improved performance when SGD is employed. This experiment establishes the potential of the method as an aid to visual navigation in images where the viewing order is unclear.

show abstract

Multimodal virtual navigation of a cultural heritage site: The medieval ceiling of Steri in Palermo

Cited by 4 publications

References 3 publications

Adaptive Voice Interaction for 3D Representation of Cultural Heritage Site

Adaptive Voice Interaction for 3D Representation of Cultural Heritage Site

Enhancing art history education through mobile augmented reality

Directing gaze in narrative art

Contact Info

Product

Resources

About