Although intelligent components in modern cars help to contribute to safe mobility, they lack important Smart Environment characteristics like personalization. Moreover, today's in-vehicle infotainment systems do not offer any interaction possibility between the passenger and the visible environment around the car. In this paper we combine several technologies and propose an approach on personalized user interaction in urban environments. We present a showcase that points out the interplay of personalized in-vehicle infotainment system and interaction with visible outside environment.
We present results of a study on referring to the outside environment from within a moving vehicle. Reference resolution is the first necessary step in integrating the outside environment into the interactive system in the car. It is the problem of finding out which of the objects outside the users is interested in. In our study, we explored EYE GAZE, HEAD POSE, POINTING GESTURE with a smart phone, and the user's VIEW FIELD. We implemented and tested everything in a moving vehicle in a real-life traffic. For safety reasons, the front-seat passenger used the system while the driver was concentrating completely on driving. For analysis and visualization of the user's interaction with the environment, 528 buildings of the city were modeled in 2.5D by using an airborne LIDAR scan, Google Earth, and a spatial database. As a result of our study, we propose in this paper a new algorithm for spatial reference resolution together with a scanning mechanism.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.