A dialogue based mobile virtual assistant for tourists: The SpaceBook Project

Abstract

Ubiquitous mobile computing offers innovative approaches in the delivery of information that can facilitate free roaming of the city, informing and guiding the tourist as the city unfolds before them. However making frequent visual reference to mobile devices can be distracting, the user having to interact via a small screen thus disrupting the explorative experience. This research reports on an EU funded project, SpaceBook, that explored the utility of a hands-free, eyes-free virtual tour guide, that could answer questions through a spoken dialogue user interface and notify the user of interesting features in view while guiding the tourist to various destinations. Visibility modelling was carried out in real-time based on a LiDAR sourced digital surface model, fused with a variety of map and crowd sourced datasets (e.g. Ordnance Survey, OpenStreetMap, Flickr, Foursquare) to establish the most interesting landmarks visible from the user's location at any given moment. A number of variations of the SpaceBook system were trialled in Edinburgh (Scotland). The research highlighted the pleasure derived from this novel form of interaction and revealed the complexity of prioritising route guidance instruction alongside identification, description and embellishment of landmark information – there being a delicate balance between the level of information ‘pushed’ to the user, and the user's requests for further information. Among a number of challenges, were issues regarding the fidelity of spatial data and positioning information required for pedestrian based systems – the pedestrian having much greater freedom of movement than vehicles

Applying user-centred design for smartwatch-based pedestrian navigation system

“…This paper mainly focuses on the last one -route communication. Different communication forms have been employed for route communication, such as mobile maps (Rehrl et al 2014), 3D (Lertlakkhanakul et al 2009), verbal instructions (Fellner, Huang, and Gartner 2017;Bartie et al 2018), haptic (Velzquez et al 2018), and augmented reality (Rehrl et al 2014). While smartphones are still the main mobile client for supporting navigation, recent research has also explored navigation on various wearable devices, such as smartwatches and digital glasses.…”

Medical Instructed Real-Time Assistant for Patient with Glaucoma and Diabetic Conditions

“…Most of the virtual assistants use artificial intelligence and provide personalized assistance to the users in the form of managing calendars, controlling smart environments, navigation, making an appointment, providing wake-up calls, and many more things [1]. Many applications from different domains currently have their own built-in virtual assistants such as televisions [2], mobile devices [3], vehicles [4], and the Internet of things [5,6]. The virtual assistant is also known as a chatbot, dialogue manager, virtual agent, interactive assistant, or conversational agent.…”

Robust and Responsive Acoustic Pairing of Devices Using Decorrelating Time-Frequency Modelling

“…As VUI technology has rapidly improved, VUIs have gained in popularity. Applications include, for example, voice assistants [1]- [3], where people talk and interact to an artificial intelligence (AI), and telecommunications applications such as Skype, which allow voice communication. However, these applications bind the user to the device that provides this VUI.…”