Abstract:Abstract-The Lobula Giant Movement Detector (LGMD) is a wide-field visual neuron that is located in the Lobula layer of the Locust nervous system. The LGMD increases its firing rate in response to both the velocity of the approaching object and its proximity. It has been found that it can respond to looming stimuli very quickly and can trigger avoidance reactions whenever a rapidly approaching object is detected. It has been successfully applied in visual collision avoidance systems for vehicles and robots. Th… Show more
“…The experimental data is adapted from [101]. model encoding onset and offset responses by luminance increments and decrements, adapted from [114], (b) a modified LGMD1 model for multiple looming objects detection, adapted from [233], (c) a simplified LGMD1 model for collision avoidance of an UAV, adapted from [188], (d) a modified LGMD1 model with enhancement of collision selectivity, adapted from [133,132], (e) a modified LGMD1 model with a new layer for noise reduction and spikingthreshold mediation, adapted from [198,197], (f) an LGMD1 neural network based on the modelling of elementary motion detectors for collision detection in ground vehicle scenarios, adapted from [91]. Based on this LGMD1 modelling theory, a good number of models have been produced during the past two decades; these works have not only been extending and consolidating the LGMD1's original functionality for looming perception, but also investigating the possible applications to mobile machines like robots and vehicles.…”
Section: Computational Models and Applicationsmentioning
Motion perception is a critical capability determining a variety of aspects of insects' life, including avoiding predators, foraging and so forth. A good number of motion detectors have been identified in the insects' visual pathways.Computational modelling of these motion detectors has not only been providing effective solutions to artificial intelligence, but also benefiting the understanding of complicated biological visual systems. These biological mechanisms through millions of years of evolutionary development will have formed solid modules for constructing dynamic vision systems for future intelligent machines. This article reviews the computational motion perception models originating from biological research of insects' visual systems in the literature. These motion perception models or neural networks comprise the looming sensitive neuronal models of lobula giant movement detectors (LGMDs) in locusts, the translation sensitive neural systems of direction selective neurons (DSNs) in fruit flies, bees and locusts, as well as the small target motion detectors (STMDs) in dragonflies and hover flies. We also review the applications of these models to robots and vehicles. Through these modelling studies, we summarise the methodologies that generate different direction and size selectivity in motion perception. At last, we discuss about multiple systems integration and hardware realisation of these bio-inspired motion perception models.
“…The experimental data is adapted from [101]. model encoding onset and offset responses by luminance increments and decrements, adapted from [114], (b) a modified LGMD1 model for multiple looming objects detection, adapted from [233], (c) a simplified LGMD1 model for collision avoidance of an UAV, adapted from [188], (d) a modified LGMD1 model with enhancement of collision selectivity, adapted from [133,132], (e) a modified LGMD1 model with a new layer for noise reduction and spikingthreshold mediation, adapted from [198,197], (f) an LGMD1 neural network based on the modelling of elementary motion detectors for collision detection in ground vehicle scenarios, adapted from [91]. Based on this LGMD1 modelling theory, a good number of models have been produced during the past two decades; these works have not only been extending and consolidating the LGMD1's original functionality for looming perception, but also investigating the possible applications to mobile machines like robots and vehicles.…”
Section: Computational Models and Applicationsmentioning
Motion perception is a critical capability determining a variety of aspects of insects' life, including avoiding predators, foraging and so forth. A good number of motion detectors have been identified in the insects' visual pathways.Computational modelling of these motion detectors has not only been providing effective solutions to artificial intelligence, but also benefiting the understanding of complicated biological visual systems. These biological mechanisms through millions of years of evolutionary development will have formed solid modules for constructing dynamic vision systems for future intelligent machines. This article reviews the computational motion perception models originating from biological research of insects' visual systems in the literature. These motion perception models or neural networks comprise the looming sensitive neuronal models of lobula giant movement detectors (LGMDs) in locusts, the translation sensitive neural systems of direction selective neurons (DSNs) in fruit flies, bees and locusts, as well as the small target motion detectors (STMDs) in dragonflies and hover flies. We also review the applications of these models to robots and vehicles. Through these modelling studies, we summarise the methodologies that generate different direction and size selectivity in motion perception. At last, we discuss about multiple systems integration and hardware realisation of these bio-inspired motion perception models.
“…The biological inspired neural network here proposed (figure 1) is based on previous models described on [6], [8].…”
Section: Proposed Lgmd Neural Networkmentioning
confidence: 99%
“…The A (Approaching) and R (Receding) cells (modified from [8]) are two grouping cells for depth movement direction recognition. The D cell or Direction cell (∈ {−1, 0, 1} in case of receding, no movement and approaching object, respectively) is used to calculate the direction of movement (for further details, see our previous paper [9]).…”
Section: Proposed Lgmd Neural Networkmentioning
confidence: 99%
“…The model continued to evolve [5], [7], [8], [6] and it was used in many applications for collision detection. However, further work is needed to develop more robust models that can account for complex aspects of visual motion.…”
Section: Introductionmentioning
confidence: 99%
“…In this article, we extend our previous LGMD model [9] which was able to achieve noise immunity [6] and direction sensitivity [8]. We propose to improve over the existing LGMD model by introducing a novel pixel mapping on the captured image that feeds the neural network.…”
In many animal species it is essential to recognize approach predators from complex, dynamic visual scenes and timely initiate escape behavior. Such sophisticated behaviours are often achieved with low neuronal complexity, such as in locusts, suggesting that emulating these biological models in artificial systems would enable the generation of similar complex behaviours with low computational overhead. On the other hand, artificial collision detection is a complex task that requires both real time data acquisition and important features extraction from a captured image. In order to accomplish this task, the algorithms used need to be fast to process the captured data and then perform real time decisions.Taking into account the previous considerations, neurorobotic models may provide a foundation for the development of more effective and autonomous devices/robots, based on an improved understanding of the biological basis of adaptive behavior. In this paper, we make a comparative analysis between the new computational model of a locust looming-detecting pathway and the model previously proposed by us. The obtained results proved the improvement provided by the pixel remapping in the model performance.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.