Adaptivity at every layer

Richert, Willi; Kleinjohann, Bernd

doi:10.1145/1370018.1370039

Proceedings of the 2008 International Workshop on Software Engineering for Adaptive and Self-Managing Systems 2008

DOI: 10.1145/1370018.1370039

|View full text |Cite

Adaptivity at every layer

Willi Richert

Bernd Kleinjohann

Abstract: We describe a developmental architecture that enables individual robots to fulfill tasks assigned to the robot society in a robust, decentralized manner. The architecture is meant to show emergent properties according to Organic Computing principles that are positive for the society's robustness and performance. This requires the architecture to feature those adaptation and learning processes that are not only selfishly useful for the individual robot, but also incorporate the robot society's actual needs at a… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2009

2019

Publication Types

Select...

Other5

Relationship

Self Cite2

Independent3

Authors

Journals

Cited by 6 publications

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Integrating sporadic imitation in Reinforcement Learning robots

Richert

Scheller

Koch

et al. 2009

2009 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning

Self Cite

View full text Add to dashboard Cite

Although the combination of Reinforcement Learning and imitation has been already considered in recent research, it always revolved around fixed settings where demonstrator and imitator are fixed and the imitation process is a welldefined period of time. What is missing is the investigation of approaches that also work in scenarios where imitation is only sporadically possible. This means that in a multi-robot scenario a robot is now allowed to interrupt another robot by asking to repeat certain actions, but can only observe and integrate information bits delivered occasionally. In this paper we present how that can be done in continuous and noisy environment within an SMDP context.

show abstract

Integrating sporadic imitation in Reinforcement Learning robots

Richert

Scheller

Koch

et al. 2009

2009 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning

Self Cite

View full text Add to dashboard Cite

show abstract

Increasing the Autonomy of Mobile Robots by Imitation in Multi-robot Scenarios

Richert

Scheller

Koch

et al. 2009

2009 Fifth International Conference on Autonomic and Autonomous Systems

Self Cite

View full text Add to dashboard Cite

Because imitation has shown to be able to drastically cut down the exploration space it has been embraced largely by the robotics community to speed up autonomous learning. This has been done mostly in fixed demonstratorimitator relationships, where a predefined demonstrator is performing the same action over and over again until the robot has learned it sufficiently. In practical multi-robot scenarios, however, the imitation process should not interrupt the observed robot as it will affect its autonomy. Therefore the imitating robot often has only a limited amount of behaviors of the same type to learn from. As this usually does not provide enough information for learning a generalized version of observed lowlevel actions, it can help the observer to optimize its strategy based on the recognized actions. In this case, first of all the imitating robot has to interpret the observed behavior in terms of its own behavior knowledge. This means that low-level observations have to be segmented into episodes of apparently similar behavior. For these episodes corresponding skills in the observing robot's own behavior repertoire have to be found. And for the episodes sequence corresponding state changes in the observing robot's own strategy have to be determined. How the former can be done has been shown by the authors in a previous paper. In this paper we will describe how our approach for Evolving Societies of Learning Autonomous Systems (ESLAS) is extended to be capable of multi-robot imitation. We demonstrate how the recognition results can be used in a multi-robot scenario to decentrally align the robots' behaviors, to speed up the overall learning process, and thus increase the overall autonomy.

show abstract

A test bed for investigating self-x properties in multi-robot societies

Jungmann

Kleinjohann

Lutterbeck

et al. 2011

2011 9th IEEE International Conference on Industrial Informatics

View full text Add to dashboard Cite

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Adaptivity at every layer

Cited by 6 publications

References 17 publications

Integrating sporadic imitation in Reinforcement Learning robots

Integrating sporadic imitation in Reinforcement Learning robots

Increasing the Autonomy of Mobile Robots by Imitation in Multi-robot Scenarios

A test bed for investigating self-x properties in multi-robot societies

Contact Info

Product

Resources

About