EPOC: Efficient Perception via Optimal Communication

Kapourchali, Masoumeh Heidari; Banerjee, Bonny

doi:10.1609/aaai.v34i04.5830

Cited by 4 publications

(3 citation statements)

References 24 publications

(40 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Figure 1 ) is an implementation of the SELP cycle, which is modular and allows experimentation with different generative models in place of VAE or VRNN, and different fusion methods in place of PoE. It is interesting to note that our earlier works [ 65 , 66 ] proposed an agent model that decide when and with whom to communicate/interact, while the agent model proposed in this current work (and [ 11 ]) propose how to interact, all following the SELP cycle.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Attention-Based Variational Autoencoder Models for Human–Human Interaction Recognition via Generation

Banerjee,

Baruah

2024

Sensors

View full text Add to dashboard Cite

The remarkable human ability to predict others’ intent during physical interactions develops at a very early age and is crucial for development. Intent prediction, defined as the simultaneous recognition and generation of human–human interactions, has many applications such as in assistive robotics, human–robot interaction, video and robotic surveillance, and autonomous driving. However, models for solving the problem are scarce. This paper proposes two attention-based agent models to predict the intent of interacting 3D skeletons by sampling them via a sequence of glimpses. The novelty of these agent models is that they are inherently multimodal, consisting of perceptual and proprioceptive pathways. The action (attention) is driven by the agent’s generation error, and not by reinforcement. At each sampling instant, the agent completes the partially observed skeletal motion and infers the interaction class. It learns where and what to sample by minimizing the generation and classification errors. Extensive evaluation of our models is carried out on benchmark datasets and in comparison to a state-of-the-art model for intent prediction, which reveals that classification and generation accuracies of one of the proposed models are comparable to those of the state of the art even though our model contains fewer trainable parameters. The insights gained from our model designs can inform the development of efficient agents, the future of artificial intelligence (AI).

show abstract

Section: Discussionmentioning

confidence: 99%

“… Block diagram of the SELP cycle [ 63 , 64 ], which forms the basis of the proposed agent model and related agent models [ 11 , 13 , 14 , 15 , 16 , 65 , 66 , 67 , 68 ]. …”

Section: Figurementioning

confidence: 99%

Attention-Based Variational Autoencoder Models for Human–Human Interaction Recognition via Generation

Banerjee,

Baruah

2024

Sensors

View full text Add to dashboard Cite

show abstract

“…1 An agent is anything that can be viewed as perceiving its environment through sensors and acting upon that environment through actuators [2]. Such agents, implemented in software, have been reported in our prior work [3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19] as well as in others'.…”

Section: Introductionmentioning

confidence: 99%

Synthesizing Skeletal Motion and Physiological Signals as a Function of a Virtual Human's Actions and Emotions

Banerjee¹,

Kapourchali²,

Baruah³

et al. 2021

Preprint

Self Cite

View full text Add to dashboard Cite

Round-the-clock monitoring of human behavior and emotions is required in many healthcare applications which is very expensive but can be automated using machine learning (ML) and sensor technologies. Unfortunately, the lack of infrastructure for collection and sharing of such data is a bottleneck for ML research applied to healthcare. Our goal is to circumvent this bottleneck by simulating a human body in virtual environment. This will allow generation of potentially infinite amounts of shareable data from an individual as a function of his actions, interactions and emotions in a care facility or at home, with no risk of confidentiality breach or privacy invasion. In this paper, we develop for the first time a system consisting of computational models for synchronously synthesizing skeletal motion, electrocardiogram, blood pressure, respiration, and skin conductance signals as a function of an open-ended set of actions and emotions. Our experimental evaluations, involving user studies, benchmark datasets and comparison to findings in the literature, show that our models can generate skeletal motion and physiological signals with high fidelity. The proposed framework is modular and allows the flexibility to experiment with different models. In addition to facilitating ML research for round-the-clock monitoring at a reduced cost, the proposed framework will allow reusability of code and data, and may be used as a training tool for ML practitioners and healthcare professionals.

show abstract

Applications of artificial intelligence to neurological disorders: current technologies and open problems

Chandra

Rangaswamy

Banerjee

et al. 2022

Augmenting Neurological Disorder Prediction and Rehabilitation Using Artificial Intelligence

View full text Add to dashboard Cite

EPOC: Efficient Perception via Optimal Communication

Cited by 4 publications

References 24 publications

Attention-Based Variational Autoencoder Models for Human–Human Interaction Recognition via Generation

Attention-Based Variational Autoencoder Models for Human–Human Interaction Recognition via Generation

Synthesizing Skeletal Motion and Physiological Signals as a Function of a Virtual Human's Actions and Emotions

Applications of artificial intelligence to neurological disorders: current technologies and open problems

Contact Info

Product

Resources

About