Reinforcement learning (RL) enables robots to learn its optimal behavioral strategy in dynamic environments based on feedback. Explicit human feedback during robot RL is advantageous, since an explicit reward function can be easily adapted. However, it is very demanding and tiresome for a human to continuously and explicitly generate feedback. Therefore, the development of implicit approaches is of high relevance. In this paper, we used an error-related potential (ErrP), an event-related activity in the human electroencephalogram (EEG), as an intrinsically generated implicit feedback (rewards) for RL. Initially we validated our approach with seven subjects in a simulated robot learning scenario. ErrPs were detected online in single trial with a balanced accuracy (bACC) of 91%, which was sufficient to learn to recognize gestures and the correct mapping between human gestures and robot actions in parallel. Finally, we validated our approach in a real robot scenario, in which seven subjects freely chose gestures and the real robot correctly learned the mapping between gestures and actions (ErrP detection (90% bACC)). In this paper, we demonstrated that intrinsically generated EEG-based human feedback in RL can successfully be used to implicitly improve gesture-based robot control during human-robot interaction. We call our approach intrinsic interactive RL.
Commercial surgical robots have been in clinical use since the mid-1990s, supporting surgeons in various tasks. In the past decades, many systems emerged as research platforms, and a few entered the global market. This paper summarizes the currently available surgical systems and research directions in the broader field of surgical robotics. The widely deployed teleoperated manipulators aim to enhance human cognitive and physical skills and provide smart tools for surgeons, while image-guided robotics focus on surpassing human limitations by introducing automated targeting and treatment delivery methods. Both concepts are discussed based on prototypes and commercial systems. Through concrete examples the possible future development paths of surgical robots are illustrated. While research efforts are taking different approaches to improve the capacity of such systems, the aim of this survey is to assess their maturity from the commercialization point of view.
Dengue, chikungunya and Zika are arboviruses transmitted by mosquitos of the genus Aedes and have caused several outbreaks in world over the past ten years. Morphological identification of mosquitos is currently restricted due to the small number of adequately trained professionals. We implemented a computational model based on a convolutional neural network (CNN) to extract features from mosquito images to identify adult mosquitoes from the species Aedes aegypti, Aedes albopictus and Culex quinquefasciatus. To train the CNN to perform automatic morphological classification of mosquitoes, we used a dataset that included 4,056 mosquito images. Three neural networks, including LeNet, AlexNet and GoogleNet, were used. During the validation phase, the accuracy of the mosquito classification was 57.5% using LeNet, 74.7% using AlexNet and 83.9% using GoogleNet. During the testing phase, the best result (76.2%) was obtained using GoogleNet; results of 52.4% and 51.2% were obtained using LeNet and AlexNet, respectively. Significantly, accuracies of 100% and 90% were achieved for the classification of Aedes and Culex, respectively. A classification accuracy of 82% was achieved for Aedes females. Our results provide information that is fundamental for the automatic morphological classification of adult mosquito species in field. The use of CNN's is an important method for autonomous identification and is a valuable and accessible resource for health workers and taxonomists for the identification of some insects that can transmit infectious agents to humans.
Robot-assisted therapy has become increasingly popular and useful in post-stroke neurorehabilitation. This paper presents an overview of the design and control of the dual-arm Recupera exoskeleton to provide intense therapist-guided as well as self training for sensorimotor rehabilitation of the upper body. The exoskeleton features a lightweight design, high level of modularity, decentralized computing, and various levels of safety implementation. Due to its modularity, the system can be used as a wheel-chair mounted system or as a full-body system. Both systems enable a wide range of therapies while efficiently grounding the weight of the system and without compromising the patient’s mobility. Furthermore, two rehabilitation therapies implemented on the exoskeleton system, namely teach & replay therapy and mirror therapy, are presented along with experimental results.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.