Self-adaptive Vision System

Stipančić, Tomislav; Jerbić, Bojan

doi:10.1007/978-3-642-11628-5_21

Cited by 11 publications

(5 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The tasks related to the fusion of visual and voice (or acoustic) modalities are usually associated with speech perception, enhancement, or separation [6]. For example, a vision modality can be used to strengthen the reasoning hypothesis of the model, as reported in [7]. A similar work has presented a computational architecture that gives the system the ability to adapt to change [8].…”

Section: Current and Comparable Concepts Used For Audio-visual System Perception And Contribution Of Presented Methodologymentioning

confidence: 99%

Person Localization Model Based on a Fusion of Acoustic and Visual Inputs

et al. 2022

Self Cite

View full text Add to dashboard Cite

PLEA is an interactive, biomimetic robotic head with non-verbal communication capabilities. PLEA reasoning is based on a multimodal approach combining video and audio inputs to determine the current emotional state of a person. PLEA expresses emotions using facial expressions generated in real-time, which are projected onto a 3D face surface. In this paper, a more sophisticated computation mechanism is developed and evaluated. The model for audio-visual person separation can locate a talking person in a crowded place by combining input from the ResNet network with input from a hand-crafted algorithm. The first input is used to find human faces in the room, and the second input is used to determine the direction of the sound and to focus attention on a single person. After an information fusion procedure is performed, the face of the person speaking is matched with the corresponding sound direction. As a result of this procedure, the robot could start an interaction with the person based on non-verbal signals. The model was tested and evaluated under laboratory conditions by interaction with users. The results suggest that the methodology can be used efficiently to focus a robot’s attention on a localized person.

show abstract

Section: Current and Comparable Concepts Used For Audio-visual System Perception And Contribution Of Presented Methodologymentioning

confidence: 99%

Person Localization Model Based on a Fusion of Acoustic and Visual Inputs

et al. 2022

Self Cite

View full text Add to dashboard Cite

show abstract

“…This modality proved to be sensitive to background movements and changes in light conditions. Therefore, it would be desirable to develop some method of adaptive vision where vision sensor parameters can be dynamically adapted to different light conditions, as stated in Stipancic & Jerbic (2010). The promising approach could also be to focus on the physical body of the person and neglect the other information coming from the background.…”

Section: Software System Architecturementioning

confidence: 99%

Plea

Stipančić

Koren

Korade

et al. 2021

Journal of Pacific Rim Psychology

Self Cite

View full text Add to dashboard Cite

An approach to the design of learning environments where a social robot plays a role of a teacher is discussed in this study. Built-in robot functionalities provide a degree of situational embodiment, self-explainability, and context-driven interaction. The concept of embodiment enables immersion of the teacher into distant 3D environments. In that way the level of mutual understanding between participants is increased compared to a 2D world. Moreover, the tools that accompany the interaction empower augmentation by revealing the additional information present in gestures, facial expressions, or gaze direction. We use three distinct sources fused in a multimodal approach (face emotion recognition, level of loudness, and body movement intensity). The change in one modality can change the overall system reasoning. The teacher can benefit from this information by adapting a presentation style and achieve a better rapport with students. The theoretical basis is provided by studies of human communication in psycholinguistics and social psychology. Usability evaluation is based on the Wizard of Oz approach, allowing a teacher to interact with students through an interface. The conducted experiments show encouraging responses. Future studies will show in what way and to what extent a cognitive robot can be truly effective in technology-enhanced learning.

show abstract

“…The basic operators are: The vision operator utilizes the cognition base and solves problems of identifying work objects and associated data. Therefore vision processes have to be very stable and work in constantly changing light and scenery conditions [13]. A fix to this problem is to utilize algorithms that can change the exposition of the image acquisition process.…”

Section: Operatorsmentioning

confidence: 99%

Autonomous Planning Framework for Distributed Multiagent Robotic Systems

Švaco

Šekoranja

Jerbić

2011

Technological Innovation for Sustainability

View full text Add to dashboard Cite

Abstract. In this paper a creative action planning algorithm (CAPA) is presented for solving multiagent planning problems and task allocation. The distributed multiagent system taken in consideration is a system of m autonomous agents. Agents workspace contains simplified blocks which form different space structures. By employing the planning algorithm and through interaction agents allocate tasks which they execute in order to assemble the required space structure. The planning algorithm is based on an inductive engine. From a given set of objects which can differ from the initial set agents need to reach a solution in the anticipated search space. A multiagent framework for autonomous planning is developed and implemented on an actual robotic system consisting of three 6 DOF industrial robots.

show abstract

Self-adaptive Vision System

Cited by 11 publications

References 7 publications

Person Localization Model Based on a Fusion of Acoustic and Visual Inputs

Person Localization Model Based on a Fusion of Acoustic and Visual Inputs

Plea

Autonomous Planning Framework for Distributed Multiagent Robotic Systems

Contact Info

Product

Resources

About