Using interactive displays, such as a touchscreen, in vehicles typically requires dedicating a considerable amount of visual as well as cognitive capacity and undertaking a hand pointing gesture to select the intended item on the interface. This can act as a distractor from the primary task of driving and consequently can have serious safety implications. Due to road and driving conditions, the user input can also be highly perturbed resulting in erroneous selections compromising the system usability. In this paper, we propose intent-aware displays that utilize a pointing gesture tracker in conjunction with suitable Bayesian destination inference algorithms to determine the item the user intends to select, which can be achieved with high confidence remarkably early in the pointing gesture. This can drastically reduce the time and effort required to successfully complete an in-vehicle selection task. In the proposed probabilistic inference framework, the likelihood of all the nominal destinations is sequentially calculated by modeling the hand pointing gesture movements as a destination-reverting process. This leads to a Kalman filter-type implementation of the prediction routine that requires minimal parameter training and has low computational burden; it is also amenable to parallelization. The substantial gains obtained using an intent-aware display are demonstrated using data collected in an instrumented vehicle driven under various road conditions.

In several application areas, such as human computer interaction, surveillance and defence, determining the intent of a tracked object enables systems to aid the user/operator and facilitate effective, possibly automated, decision making. In this paper, we propose a probabilistic inference approach that permits the prediction, well in advance, of the intended destination of a tracked object and its future trajectory. Within the framework introduced here, the observed partial track of the object is modeled as being part of a Markov bridge terminating at its destination, since the target path, albeit random, must end at the intended endpoint. This captures the underlying long term dependencies in the trajectory, as dictated by the object intent. By determining the likelihood of the partial track being drawn from a particular constructed bridge, the probability of each of a number of possible destinations is evaluated. These bridges can also be employed to produce refined estimates of the latent system state (e.g., object position, velocity, etc.), predict its future values (up until reaching the designated endpoint) and estimate the time of arrival. This is shown to lead to a low complexity Kalman-filter-based implementation of the inference routine, where any linear Gaussian motion model, including the destination reverting ones, can be applied. Free hand pointing gestures data collected in an instrumented vehicle and synthetic trajectories of a vessel heading toward multiple possible harbors are utilized to demonstrate the effectiveness of the proposed approach.

Using an in-vehicle interactive display, such as a touchscreen, typically entails undertaking a free hand pointing gesture and dedicating a considerable amount of attention, that can be otherwise available for driving, with potential safety implications. Due to road and driving conditions, the user input can also be subject to high levels of perturbations resulting in erroneous selections. In this article, we give an overview of the novel concept of an intelligent predictive display in vehicles. It can infer, notably early in the pointing task and with high confidence, the item the user intends to select on the display from the tracked free hand pointing gesture and possibly other available sensory data. Accordingly, it simplifies and expedites the target acquisition (pointing and selection), thereby substantially reducing the time and effort required to interact with an in-vehicle display. As well as briefly addressing the various signal processing and human factor challenges posed by predictive displays in the automotive environment, the fundamental problem of intent inference is discussed and a Bayesian formulation is introduced. Empirical evidence from data collected in instrumented cars is shown to demonstrate the usefulness and effectiveness of this solution.

No abstract

The motion of a tracked object often has long term underlying dependencies due to premeditated actions dictated by intent, such as destination. Revealing this intent, as early as possible, can enable advanced intelligent system functionalities for conflict/opportunity detection and automated decision making, for instance in surveillance and human computer interaction. This paper presents a novel Bayesian intent inference framework that utilises sequential Monte Carlo (SMC) methods to determine the destination of a tracked object exhibiting unknown jump behaviour. The latter can arise from the object undertaking fast maneuvers (e.g. for obstacle avoidance) and/or due to external uncontrollable environmental perturbations. Suitable intent-driven stochastic models and inference routines are introduced. The effectiveness of the proposed approach is demonstrated using synthetic and real data.

No abstract

This letter presents an alternative, more consistent, construction for bridging distributions, which enables inferring the destination of a tracked object from the available partial sensory observations. Two algorithms are then introduced to sequentially estimate the probability of all possible endpoints within a generic Bayesian framework. They capture the influence of intended destination on the object's motion via suitably adapted stochastic models. Whilst the bridging approach has low training requirements, the proposed formulation can lead to more efficient predictors, e.g. around 65% less computations for certain models. Synthetic and real data is used to illustrate the effectiveness of the introduced algorithms.

No abstract