InFoRM (Indicate-Follow-Replay-Me): A novel method to measure perceptual multistability dynamics using continuous data tracking and validated estimates of visual introspection

Skerswetat, Jan; Bex, Peter J.

doi:10.1016/j.concog.2022.103437

Cited by 4 publications

(6 citation statements)

References 67 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…InFoRM is a more advanced method than the one proposed by us for researchers interested in capturing all potential perceptual states and it offers a continuous high-temporal resolution. In this sense, we invite readers interested in implementing a method with these characteristics to refer to the work of Skerswetat and Bex (2023) . InFoRM has the specific goal of mapping in detail not only the experience of “exclusive” percepts but also the different possible experiences of mixed percepts (piecemeal/superimposition; see Figure 1 on p. 4 of Skerswetat and Bex, 2023 ), while we were interested in mapping the subjective experience of accessing and exiting from “exclusive” face percepts with particular characteristics (connoted by a specific emotional expression or gender).…”

Section: Discussionmentioning

confidence: 99%

“…This control allows controlling for participants’ accuracy and compliance with coding instructions. This replay method has been implemented by Skerswetat and Bex (2023) and we recommend its use. In the present study, due to time constraints, we chose to counterbalance the joystick coding instructions to control possible difference in joystick movements due to supination and pronosupination movements.…”

Section: Discussionmentioning

confidence: 99%

“…In this sense, we invite readers interested in implementing a method with these characteristics to refer to the work of Skerswetat and Bex (2023). InFoRM has the specific goal of mapping in detail not only the experience of "exclusive" percepts but also the different possible experiences of mixed percepts (piecemeal/superimposition; see Figure 1 on p. 4 of Skerswetat and Bex, 2023), while we were interested in mapping the subjective experience of accessing and exiting from "exclusive" face percepts with particular characteristics (connoted by a specific emotional expression or gender). Of note, faces in binocular rivalry are much less prone to piecemeal rivalry (where piecemeal rivalry is measurable in terms of low coherence index; seem e.g., (Alais and Parker, 2006) than other, lowlevel, stimuli (e.g., Gabor patches), likely due to the different size of receptive fields of the high-level vs. early visual areas 10.3389/fnhum.2023.1145653 (Blake et al, 1992).…”

Section: Discussionmentioning

confidence: 99%

“…Of note, faces in binocular rivalry are much less prone to piecemeal rivalry (where piecemeal rivalry is measurable in terms of low coherence index; seem e.g., (Alais and Parker, 2006) than other, lowlevel, stimuli (e.g., Gabor patches), likely due to the different size of receptive fields of the high-level vs. early visual areas 10.3389/fnhum.2023.1145653 (Blake et al, 1992). Thus stimuli such as Gabor (used in the experiment by Skerswetat and Bex, 2023) tend to be associated with a lot of mixed/piecemeal rivalry; on the other hand, high-level stimuli (such as faces) are characterized by a high coherence index (i.e., stronger alternations from one face to another, and very little piecemeal rivalry and superimposition). For example, in one of their studies, Alais and Parker (2006) reported a coherence index for faces (face 1 vs. face 2 in rivalry) equal to 80%, therefore very high.…”

Section: Discussionmentioning

confidence: 99%

“…However, this procedure too, although providing a higher resolution of participants’ subjective experience during the BR, cannot characterize the phases of formation and dissolution in a fine-grained way. Skerswetat and Bex (2023) provided a detailed historical overview of methods in reporting subjective experience in BR.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

INs and OUTs of faces in consciousness: a study of the temporal evolution of consciousness of faces during binocular rivalry

Quettier

Lello

Tsuchiya

et al. 2023

Front. Hum. Neurosci.

View full text Add to dashboard Cite

Contents of consciousness change over time. However, the study of dynamics in consciousness has been largely neglected. Aru and Bachmann have recently brought to the attention of scientists dealing with consciousness the relevance of making inquiries about its temporal evolution. Importantly, they also pointed out several experimental questions as guidelines for researchers interested in studying the temporal evolution of consciousness, including the phases of formation and dissolution of content. They also suggested that these two phases could be characterized by asymmetric inertia. The main objective of the present investigation was to approximate the dynamics of these two phases in the context of conscious face perception. To this aim, we tested the time course of content transitions during a binocular rivalry task using face stimuli and asked participants to map their subjective experience of transitions from one content to the other through a joystick. We then computed metrics of joystick velocity linked to content transitions as proxies of the formation and dissolution phases. We found a general phase effect such that the formation phase was slower than the dissolution phase. Furthermore, we observed an effect specific to happy facial expressions, such that their contents were slower to form and dissolve than that of neutral expressions. We further propose to include a third phase of stabilization of conscious content between formation and dissolution.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

INs and OUTs of faces in consciousness: a study of the temporal evolution of consciousness of faces during binocular rivalry

Quettier

Lello

Tsuchiya

et al. 2023

Front. Hum. Neurosci.

View full text Add to dashboard Cite

show abstract

The Effect of Interocular Contrast Differences on the Appearance of Augmented Reality Imagery

Wang,

Ding,

Levi

et al. 2023

ACM Trans. Appl. Percept.

View full text Add to dashboard Cite

Augmented reality (AR) devices seek to create compelling visual experiences that merge virtual imagery with the natural world. These devices often rely on wearable near-eye display systems that can optically overlay digital images to the left and right eyes of the user separately. Ideally, the two eyes should be shown images with minimal radiometric differences (e.g., the same overall luminance, contrast, and color in both eyes), but achieving this binocular equality can be challenging in wearable systems with stringent demands on weight and size. Basic vision research has shown that a spectrum of potentially detrimental perceptual effects can be elicited by imagery with radiometric differences between the eyes, but it is not clear whether and how these findings apply to the experience of modern AR devices. In this work, we first develop a testing paradigm for assessing multiple aspects of visual appearance at once, and characterize five key perceptual factors when participants viewed stimuli with interocular contrast differences. In a second experiment, we simulate optical see-through AR imagery using conventional desktop LCD monitors and use the same paradigm to evaluate the multifaceted perceptual implications when the AR display luminance differs between the two eyes. We also include simulations of monocular AR systems (i.e., systems in which only one eye sees the displayed image). Our results suggest that interocular contrast differences can drive several potentially detrimental perceptual effects in binocular AR systems, such as binocular luster, rivalry, and spurious depth differences. In addition, monocular AR displays tend to have more artifacts than binocular displays with a large contrast difference in the two eyes. A better understanding of the range and likelihood of these perceptual phenomena can help inform design choices that support a high-quality user experience in AR.

show abstract

An Accumulating Neural Signal Underlying Binocular Rivalry Dynamics

Nie,

Katyal,

Engel

2023

J. Neurosci.

View full text Add to dashboard Cite

During binocular rivalry, conflicting images are presented one to each eye and perception alternates stochastically between them. Despite stable percepts between alternations, modeling suggests that neural signals representing the two images change gradually, and that the duration of stable percepts are determined by the time required for these signals to reach a threshold that triggers an alternation. However, direct physiological evidence for such signals has been lacking. Here, we identify a neural signal in the human visual cortex that shows these predicted properties. We measured steady-state visual evoked potentials (SSVEP) in 84 human participants (62 females, 22 males) who were presented with orthogonal gratings, one to each eye, flickering at different frequencies. Participants indicated their percept while EEG data were collected. The time courses of the SSVEP amplitudes at the two frequencies were then compared across different percept durations, within participants. For all durations, the amplitude of signals corresponding to the suppressed stimulus increased and the amplitude corresponding to the dominant stimulus decreased throughout the percept. Critically, longer percepts were characterized by more gradual increases in the suppressed signal and more gradual decreases of the dominant signal. Changes in signals were similar and rapid at the end of all percepts, presumably reflecting perceptual transitions. These features of the SSVEP time courses are well predicted by a model in which perceptual transitions are produced by the accumulation of noisy signals. Identification of this signal underlying binocular rivalry should allow strong tests of neural models of rivalry, bistable perception, and neural suppression.Significance StatementDuring binocular rivalry, two conflicting images are presented to the two eyes and perception alternates between them, with switches occurring at seemingly random times. Rivalry is an important and longstanding model system in neuroscience, used for understanding neural suppression, intrinsic neural dynamics, and even the neural correlates of consciousness. All models of rivalry propose that it depends upon gradually changing neural activity that upon reaching some threshold triggers the perceptual switches. This manuscript reports the first physiological measurement of neural signals with that set of properties in human participants. The signals, measured with EEG in human observers, closely match the predictions of recent models of rivalry, and should pave the way for much future work.

show abstract

InFoRM (Indicate-Follow-Replay-Me): A novel method to measure perceptual multistability dynamics using continuous data tracking and validated estimates of visual introspection

Cited by 4 publications

References 67 publications

INs and OUTs of faces in consciousness: a study of the temporal evolution of consciousness of faces during binocular rivalry

INs and OUTs of faces in consciousness: a study of the temporal evolution of consciousness of faces during binocular rivalry

The Effect of Interocular Contrast Differences on the Appearance of Augmented Reality Imagery

An Accumulating Neural Signal Underlying Binocular Rivalry Dynamics

Contact Info

Product

Resources

About