Are you talking to me? An Audio Augmented Reality conversational guide for cultural heritage

Tsepapadakis, Michalis; Gavalas, Damianos

doi:10.1016/j.pmcj.2023.101797

Cited by 8 publications

(7 citation statements)

References 45 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, the need for sophisticated techniques to facilitate natural speech communication has been stressed [36]. Nowadays, text-to-speech (TTS) technology has been greatly advanced by artificial intelligence that employs natural language processing (NLP) technologies to mimic the human voice and provide meaningful feedback [37].…”

Section: Speech In Ag Designmentioning

confidence: 99%

Speech Puzzles (Spuzzles): Engaging the Reduced, Causal, and Semantic Listening Modes for Puzzle Design in Audio Games

Rovithis,

Papadopoulou,

Komianos

et al. 2024

Applied Sciences

View full text Add to dashboard Cite

This paper proposes a novel approach to audio game design by introducing the concept of speech puzzles (spuzzles) to describe the utilisation of recorded voice for the creation of audio puzzles in ways that challenge players’ different listening modes. In the fields of audio games and audio-interactive applications, speech serves instructive, descriptive, narrative, and in some cases—in the form of hints or quizzes—gameplay purposes by addressing users through language. The suggested approach of spuzzles extends this potential by including, besides encoded meaning, the acoustic properties of sound, thus engaging the user’s causal and reduced listening modes in parallel with the semantic listening mode. An audio game consisting of four inherently different spuzzles was designed as proof of concept and tested by seven third-year students of Audiovisual Arts, who elaborated on their experience through a focus group semi-structured discussion. Despite their difficulty, the spuzzles were well accepted by most of the participants (5/7), whereas all participants agreed on their acoustic richness, need for concentration, and independence from pre-existing musical knowledge. Therefore, the authors suggest that the proposed design approach could serve as a paradigm for future research in the design of complex audio-based game mechanics.

show abstract

Section: Speech In Ag Designmentioning

confidence: 99%

Speech Puzzles (Spuzzles): Engaging the Reduced, Causal, and Semantic Listening Modes for Puzzle Design in Audio Games

Rovithis,

Papadopoulou,

Komianos

et al. 2024

Applied Sciences

View full text Add to dashboard Cite

show abstract

“…Commercial headphone equalizers based on HRTFs (Unity or Unreal Engine with Stea-mAudio or FMOD) are used in various works [46, 104, 116, 133, 144-146, 153, 164, 165, 175, 184-186]. Other headphones, commercial or open-source headphone-based rendering models, and commercial or open-source libraries have been considered in reviewed papers: OpenAL [108,109,142], Audiokinetic WWise [155], Apple XCode [175], Processing [130] or not specified [56,110,131,143,150,159,174,187]. Andolina et al [134] uses a "headset capable of 3D audio".…”

Section: Sound Reproduction and Spatialisationmentioning

confidence: 99%

“…The most common tracking method (55 papers) selects and personalises audio and video content based on head orientation and position in space, especially in indoor situations. In all outdoor experiences, GPS is used along with compass sensors [55,56,79,108,109,122,135,136,138], otherwise tracking is left unspecified [77,134,138]. GPS is also used in one interactive artwork described "called Hybrid Gifts" [161] in which a smartphone app permits museum visitors to communicate by geolocated audio messages with peers in order to express and transmit their emotions while looking at paintings in a museum.…”

Section: Interaction With the Virtual Environmentmentioning

confidence: 99%

“…Information about the discarded storyline can be obtained only by asking and discussing it with other users. Moreover, artificial intelligence (AI) was employed [159] to adapt storytelling in a VR video game story and, in Exhibot [108,109], to generate storylines about the history of the central square in Heraklion(Greece) based on user position and orientation and third party content services. Surprisingly, the previously cited works were the only contributions using AI techniques, although a large number of works can be found in other interactive and non-linear storytelling contexts.…”

Section: Storytelling and Personalisationmentioning

confidence: 99%

See 1 more Smart Citation

The Role of Audio in Immersive Storytelling: a Systematic Review in Cultural Heritage

Privitera,

Fontana,

Geronazzo

2024

Multimed Tools Appl

View full text Add to dashboard Cite

Nowadays, Virtual and Augmented Reality technologies play a supportive role in many research fields. In cultural heritage, various examples are available, including storytelling and narratives, where they can provide immersive and enhanced experiences to visitors and tourists, especially for entertainment and educational purposes. This review aims to investigate the opportunities that soundscape design and advanced sonic interactions in virtual and augmented environments can bring to cultural heritage sites and museums in terms of presence, emotional content, and cultural dissemination. Nineteen-two papers have been identified through the PRISMA methodology, and a promising positive effect of sonic interaction on user experience in a virtual environment can be observed in various studies, notwithstanding a general lack of specific contributions on the use of sound rendering and audio spatialisation for improving such experiences. Moreover, this work identifies the main involved research areas and discusses the state-of-the-art best practices and case studies where sonic interactions may assume a central role. The final part suggests possible future directions and applications for more engaging and immersive storytelling in the cultural heritage domain.

show abstract

“…For example, the "Exhibot" intelligent audio guide system, field-tested with the statue of a prominent politician in Heraklion, Greece, combines Audio AR and AI chatbot technologies to facilitate natural interactions between visitors and exhibits, creating an immersive learning experience. IoT devices are also utilized, ensuring contextualized information, and providing an enriched and engaging user visit (Tsepapadakis and Gavalas, 2023). Similarly, the emergence of Digital Twins, which allow precise virtual representations of physical artifacts, has also marked a transformative shift in the museum landscape.…”

Section: Development and Application In Museum Exhibitionsmentioning

confidence: 99%

A bibliometric analysis of immersive technology in museum exhibitions: exploring user experience

Li,

Wider,

Ochiai

et al. 2023

Front. Virtual Real.

View full text Add to dashboard Cite

Introduction: This study aims to comprehensively understand the existing literature on immersive technology in museum exhibitions, focusing on virtual reality (VR), augmented reality (AR), and the visitor experience. The research utilizes a bibliometric approach by examining a dataset of 722 articles with two main research objectives. Firstly, it seeks to analyze current trends in immersive technology literature, specifically emphasizing VR and the user experience in museum exhibitions through co-citation analysis. Secondly, it aims to identify emerging research trends using co-word analysis.Methods: The study employs a bibliometric approach, specifically co-citation and co-word analysis, to investigate trends and forecast emerging areas in the field, particularly the role of VR in the museum context.Results: The analysis reveals the presence of five interconnected thematic clusters in the literature. These clusters include (1) VR and AR-enhanced heritage tourism, (2) VR and AR-enabled virtual museums, (3) interactive digital art education in immersive environments, (4) immersive storytelling in virtual heritage spaces, and (5) mobile AR heritage revival.Discussion: The article highlights influential works within these areas, showcasing the historical evolution of the field and the current emphasis on utilizing VR to create immersive, educational, and engaging experiences for museum visitors. The findings indicate that research on VR applications for museum exhibitions has predominantly focused on profound game-driven experiences and interactive 3D heritage, resulting in improved visitor engagement and access to cultural content. The adoption of VR technology holds the potential to revolutionize user experiences within the cultural heritage sector and reshape the overall landscape of museums and exhibitions. By presenting these research trends, this study contributes to a deeper understanding of the vital role of VR in enhancing visitor experiences in museum settings. Furthermore, it paves the way for further exploration and innovation in immersive technology.

show abstract

Are you talking to me? An Audio Augmented Reality conversational guide for cultural heritage

Cited by 8 publications

References 45 publications

Speech Puzzles (Spuzzles): Engaging the Reduced, Causal, and Semantic Listening Modes for Puzzle Design in Audio Games

Speech Puzzles (Spuzzles): Engaging the Reduced, Causal, and Semantic Listening Modes for Puzzle Design in Audio Games

The Role of Audio in Immersive Storytelling: a Systematic Review in Cultural Heritage

A bibliometric analysis of immersive technology in museum exhibitions: exploring user experience

Contact Info

Product

Resources

About