No single, stable 3D representation can explain pointing biases in a spatial updating task

Vuong, Jenny; Fitzgibbon, Andrew; Glennerster, Andrew

doi:10.1038/s41598-019-48379-8

Cited by 8 publications

(11 citation statements)

References 59 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A mix of these two, e.g., a world-based, laser-supplemented task as a calibration method and a reproduction with an unclear reference system can create large systematic errors. A poor separation of different solution strategies for a pointing task might explain the difficulty of 3D-representation of the performance of participants in other studies as well [ 30 ].…”

Section: Problems Of An Earlier Approachmentioning

confidence: 99%

Different strategies in pointing tasks and their impact on clinical bedside tests of spatial orientation

2022

View full text Add to dashboard Cite

Deficits in spatial memory, orientation, and navigation are often early or neglected signs of degenerative and vestibular neurological disorders. A simple and reliable bedside test of these functions would be extremely relevant for diagnostic routine. Pointing at targets in the 3D environment is a basic well-trained common sensorimotor ability that provides a suitable measure. We here describe a smartphone-based pointing device using the built-in inertial sensors for analysis of pointing performance in azimuth and polar spatial coordinates. Interpretation of the vectors measured in this way is not trivial, since the individuals tested may use at least two different strategies: first, they may perform the task in an egocentric eye-based reference system by aligning the fingertip with the target retinotopically or second, by aligning the stretched arm and the index finger with the visual line of sight in allocentric world-based coordinates similar to using a rifle. The two strategies result in considerable differences of target coordinates. A pilot test with a further developed design of the device and an app for a standardized bedside utilization in five healthy volunteers revealed an overall mean deviation of less than 5° between the measured and the true coordinates. Future investigations of neurological patients comparing their performance before and after changes in body position (chair rotation) may allow differentiation of distinct orientational deficits in peripheral (vestibulopathy) or central (hippocampal or cortical) disorders.

show abstract

Section: Problems Of An Earlier Approachmentioning

confidence: 99%

Different strategies in pointing tasks and their impact on clinical bedside tests of spatial orientation

2022

View full text Add to dashboard Cite

show abstract

“…While there is evidence that this updating is achieved in the absence of visual feedback [20], at least to some extent [21], there are no detailed proposals for transferring firing rates wholesale to an area with a different coordinate frame as illustrated in figure 1b and as described for the case of head rotation by Byrne et al [19]. One possible simplification is to update only a few objects (discussed by [20,[22][23][24]) rather than carrying out a wholesale transformation of all the firing rates that describe the visual scene in retinotopic coordinates.…”

Section: D Coordinate Transformations In a Moving Observermentioning

confidence: 99%

“…It is not sufficient simply to have a separate mapping for each retinotopic location and each preferred disparity of V1 neurons: there also needs to be a different mapping for each direction of movement the observer could make. While there is evidence that this updating is achieved in the absence of visual feedback [ 20 ], at least to some extent [ 21 ], there are no detailed proposals for transferring firing rates wholesale to an area with a different coordinate frame as illustrated in figure 1 b and as described for the case of head rotation by Byrne et al [ 19 ].…”

Section: Three-dimensional Coordinate Transformations In a Moving Obs...mentioning

confidence: 99%

“…‘Information about’ does not necessarily imply internal consistency between all aspects of the stored information unlike a Cartesian representation of the scene, where consistency is a defining characteristic. Veridicality is a quite separate issue: a Cartesian representation may be a distorted model of the world but it must be consistent across tasks to count as Cartesian [ 4 , 21 , 40 , 41 ]. Consider, for example, a person who views a scene binocularly and moves a few centimetres in different directions, enough to gain useful parallax but not far enough to change the visual directions of objects substantially.…”

Section: Policy Network For 3d Visionmentioning

confidence: 99%

See 1 more Smart Citation

Understanding 3D vision as a policy network

Glennerster

2022

Phil. Trans. R. Soc. B

Self Cite

View full text Add to dashboard Cite

It is often assumed that the brain builds 3D coordinate frames, in retinal coordinates (with binocular disparity giving the third dimension), head-centred, body-centred and world-centred coordinates. This paper questions that assumption and begins to sketch an alternative based on, essentially, a set of reflexes. A ‘policy network’ is a term used in reinforcement learning to describe the set of actions that are generated by an agent depending on its current state. This is an untypical starting point for describing 3D vision, but a policy network can serve as a useful representation both for the 3D layout of a scene and the location of the observer within it. It avoids 3D reconstruction of the type used in computer vision but is similar to recent representations for navigation generated through reinforcement learning. A policy network for saccades (pure rotations of the camera/eye) is a logical starting point for understanding (i) an ego-centric representation of space (e.g. Marr’s (Marr 1982 Vision: a computational investigation into the human representation and processing of visual information ) 2 1 2 -D sketch) and (ii) a hierarchical, compositional representation for navigation. The potential neural implementation of policy networks is straightforward; a network with a large range of sensory and task-related inputs such as the cerebellum would be capable of implementing this input/output function. This is not the case for 3D coordinate transformations in the brain: no neurally implementable proposals have yet been put forward that could carry out a transformation of a visual scene from retinal to world-based coordinates. Hence, if the representation underlying 3D vision can be described as a policy network (in which the actions are either saccades or head translations), this would be a significant step towards a neurally plausible model of 3D vision. This article is part of the theme issue ‘New approaches to 3D vision’.

show abstract

“…Yet, there is an ongoing need to design visualizations that carry rich insight without exceeding the cognitive and ergonomic capabilities of the human user. There are diverging findings around the human abilities to process 2D versus 3D visualizations (Amini et al 2014;Cockburn 2004;Cockburn and McKenzie 2002;Oulasvirta, Estlander, and Nurminen 2009;Seipel 2013;Vuong, Fitzgibbon, and Glennerster 2019). Nevertheless, augmented, and virtual reality technologies need to rely on 2D and 3D spaces to communicate an environment and conditions of a scenario.…”

Section: Introductionmentioning

confidence: 99%

Novel Display Design for Spatial Assessment in Virtual Environments

Memarian¹,

Koulas²,

Fisher³

2021

Proceedings of the Human Factors and Ergonomics Society Annual

View full text Add to dashboard Cite

In this work in progress paper, we share novel conceptual display design ideas (pending validation and testing) to aid users with their spatial assessment in either two or three-dimensional spaces such as Virtual Reality (VR) environments. The example scenario used is to help a remote human team player (2nd user) to work with an asset Unmanned Aerial Vehicle (UAV) and human team player (1st user) in the field. The scenario’s goal is to deliver relief packages (i.e., medical, clothing, and food supplies) at a fixed location in an urban and hostile terrain containing adversary UAV and their human team players. Inspired by the Lens theory and Ecological Interface Design principles, the proposed display design ideas allow the user to retain past and present asset and adversary location information whilst knowing when the adversary was too close to assets and civilians and the precision of display views based on the number of sensors available.

show abstract

No single, stable 3D representation can explain pointing biases in a spatial updating task

Cited by 8 publications

References 59 publications

Different strategies in pointing tasks and their impact on clinical bedside tests of spatial orientation

Different strategies in pointing tasks and their impact on clinical bedside tests of spatial orientation

Understanding 3D vision as a policy network

Novel Display Design for Spatial Assessment in Virtual Environments

Contact Info

Product

Resources

About