Online video tracking for activity-dependent stimulation in neuroethology

Múñiz, Carlos; Forlim, Caroline Garcia; Guariento, Rafael Tuma; Pinto, Reynaldo D.; Rodrı́guez, Francisco; Varona, Pablo

doi:10.1186/1471-2202-12-s1-p358

Cited by 8 publications

(11 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In particular, we investigated in our previous work goal-driven real-time closed-loop interactions with drug microinjectors, mechanical stimulation devices and video event driven stimulators (Muniz et al, 2008, 2011; Chamorro et al, 2009, 2012). These examples illustrate that modern activity-dependent stimulation protocols can reveal dynamics otherwise hidden under traditional stimulation techniques, provide control of regular and pathological states, induce learning processes, bridge between distinct levels of analysis and lead to a further automation of experiments.…”

Section: Introductionmentioning

confidence: 99%

Assisted closed-loop optimization of SSVEP-BCI efficiency

Fernández-Vargas¹,

Pfaff²,

Rodrı́guez³

et al. 2013

Front. Neural Circuits

Self Cite

View full text Add to dashboard Cite

We designed a novel assisted closed-loop optimization protocol to improve the efficiency of brain-computer interfaces (BCI) based on steady state visually evoked potentials (SSVEP). In traditional paradigms, the control over the BCI-performance completely depends on the subjects' ability to learn from the given feedback cues. By contrast, in the proposed protocol both the subject and the machine share information and control over the BCI goal. Generally, the innovative assistance consists in the delivery of online information together with the online adaptation of BCI stimuli properties. In our case, this adaptive optimization process is realized by (1) a closed-loop search for the best set of SSVEP flicker frequencies and (2) feedback of actual SSVEP magnitudes to both the subject and the machine. These closed-loop interactions between subject and machine are evaluated in real-time by continuous measurement of their efficiencies, which are used as online criteria to adapt the BCI control parameters. The proposed protocol aims to compensate for variability in possibly unknown subjects' state and trait dimensions. In a study with N = 18 subjects, we found significant evidence that our protocol outperformed classic SSVEP-BCI control paradigms. Evidence is presented that it takes indeed into account interindividual variabilities: e.g., under the new protocol, baseline resting state EEG measures predict subjects' BCI performances. This paper illustrates the promising potential of assisted closed-loop protocols in BCI systems. Probably their applicability might be expanded to innovative uses, e.g., as possible new diagnostic/therapeutic tools for clinical contexts and as new paradigms for basic research.

show abstract

Section: Introductionmentioning

confidence: 99%

Assisted closed-loop optimization of SSVEP-BCI efficiency

Fernández-Vargas¹,

Pfaff²,

Rodrı́guez³

et al. 2013

Front. Neural Circuits

Self Cite

View full text Add to dashboard Cite

show abstract

“…Beyond dynamical-clamp protocols, other stimulation and detection techniques that can improve their performance by using real-time technology are fMRI (Rana et al, 2016), optogenetics (Krook-Magnuson et al, 2013;Prsa et al, 2017), EEG setups (Arrouët et al, 2005;Sitaram et al, 2016), neuroprosthesess , or any kind of activity-dependent stimulation experiment, such as the ones that use simultaneous electrophysiological and video tracking (Muñiz et al, 2011), acute mechanical stimulation (Muñiz et al, 2008), electric signalling during behavior (Forlim et al, 2015;Lareo et al, 2016) or drug microinjection (Chamorro et al, 2009(Chamorro et al, , 2012.…”

Section: Introductionmentioning

confidence: 99%

RTHybrid: a standardized and open-source real-time software model library for experimental neuroscience

Amaducci

Reyes-Sanchez

Elices

et al. 2018

Preprint

Self Cite

View full text Add to dashboard Cite

Closed-loop technologies provide novel ways of online observation, control and bidirectional interaction with the nervous system, which help to study complex non-linear and partially observable neural dynamics. These protocols are often difficult to implement due to the temporal precision required when interacting with biological components, which in many cases can only be achieved using real-time technology. In this paper we introduce RTHybrid (www.github.com/GNB-UAM/RTHybrid), a free and open-source software that includes a neuron and synapse model library to build hybrid circuits with living neurons in a wide variety of experimental contexts. In an effort to encourage the standardization of real-time software technology in neuroscience research, we compared different open-source real-time operating system patches, RTAI, Xenomai 3 and Preempt-RT, according to their performance and usability. RTHybrid has been developed to run over Linux operating systems supporting both Xenomai 3 and Preempt-RT real-time patches, and thus allowing an easy implementation in any laboratory. We report a set of validation tests and latency benchmarks for the construction of hybrid circuits using this library. With this work we want to promote the dissemination of standardized, userfriendly and open-source software tools developed for open-and closed-loop experimental neuroscience.

show abstract

“…The apparatus is based on a simple and inexpensive circuitry than can be easily adjusted for different species of electric fish [42], [43], [44], to fieldwork, and to connect and stimulate 2 fish in real time.…”

Section: Introductionmentioning

confidence: 99%

Automatic Realistic Real Time Stimulation/Recording in Weakly Electric Fish: Long Time Behavior Characterization in Freely Swimming Fish and Stimuli Discrimination

Forlim

Pinto

2014

PLoS ONE

View full text Add to dashboard Cite

Weakly electric fish are unique model systems in neuroethology, that allow experimentalists to non-invasively, access, central nervous system generated spatio-temporal electric patterns of pulses with roles in at least 2 complex and incompletely understood abilities: electrocommunication and electrolocation. Pulse-type electric fish alter their inter pulse intervals (IPIs) according to different behavioral contexts as aggression, hiding and mating. Nevertheless, only a few behavioral studies comparing the influence of different stimuli IPIs in the fish electric response have been conducted. We developed an apparatus that allows real time automatic realistic stimulation and simultaneous recording of electric pulses in freely moving Gymnotus carapo for several days. We detected and recorded pulse timestamps independently of the fish’s position for days. A stimulus fish was mimicked by a dipole electrode that reproduced the voltage time series of real conspecific according to previously recorded timestamp sequences. We characterized fish behavior and the eletrocommunication in 2 conditions: stimulated by IPIs pre-recorded from other fish and random IPI ones. All stimuli pulses had the exact Gymontus carapo waveform. All fish presented a surprisingly long transient exploratory behavior (more than 8 h) when exposed to a new environment in the absence of electrical stimuli. Further, we also show that fish are able to discriminate between real and random stimuli distributions by changing several characteristics of their IPI distribution.

show abstract

Online video tracking for activity-dependent stimulation in neuroethology

Abstract: Poster presentation from Twentieth Annual Computational Neuroscience Meeting: CNS*2011. Stockholm, Sweden. 23-28 July 2011This work was supported by grants MICINN BFU2009-08473 and TIN 2010- 19607, Spanish-Brazilian Cooperation PHB2007-0008 and Brazilian agencies FAPESP, CNPq and CAPES

Cited by 8 publications

References 3 publications

Assisted closed-loop optimization of SSVEP-BCI efficiency

Assisted closed-loop optimization of SSVEP-BCI efficiency

RTHybrid: a standardized and open-source real-time software model library for experimental neuroscience

Automatic Realistic Real Time Stimulation/Recording in Weakly Electric Fish: Long Time Behavior Characterization in Freely Swimming Fish and Stimuli Discrimination

Contact Info

Product

Resources

About