HCI Based In-Cabin Monitoring System for Irregular Situations with Occupants Facial Anonymization

Mishra, Ashutosh; Cha, Jaekwang; Kim, Shiho

doi:10.1007/978-3-030-68452-5_40

Cited by 8 publications

(11 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Unfortunately, this deteriorates the capacity of the software to detect emotions or other important information. To overcome this issue, techniques of generating facial anonymization have been proposed [19].…”

Section: Softwarementioning

confidence: 99%

Violence Detection on Board of Shared Autonomous Vehicles: A Literature Review

Stella¹,

Guizzo²,

Travassos³

2021

Blucher Engineering Proceedings

View full text Add to dashboard Cite

This paper presents proposals of technological solutions addressed to detect violence among passengers of a shared autonomous transport mode. Through analyzing the Design Science Research methodology and the conjectural behavior of the population, the problem contextualization about the safety on public transport can be determined in terms of violence. So, we proposed a product meant to detect violence based on the product design proposals based in artificial intelligence by literature review. The subject is relevant and demands more attention to support the public acceptance of autonomous vehicles (AVs), and shows there are existing solutions which can be adapted to fulfill the needs for this specific usage.

show abstract

Section: Softwarementioning

confidence: 99%

Violence Detection on Board of Shared Autonomous Vehicles: A Literature Review

Stella¹,

Guizzo²,

Travassos³

2021

Blucher Engineering Proceedings

View full text Add to dashboard Cite

show abstract

“…The high levels of autonomous driving reduce the risk of fatality and the stress of daily commute driving. In addition, it provides extra time, luxury, and stress-free transportation experiences to the occupants in their daily commute [4,5]. FAVs (level 5 AV) can be especially suitable for the modern commute and allow occupants to perform other important tasks, enjoy luxury, rest, and so on.…”

Section: Introductionmentioning

confidence: 99%

“…Furthermore, the vehicle itself requires protection from any malicious behavior by the occupants. Therefore, multi-pronged in-cabin monitoring of level 4 and beyond AVs in real-time is crucial [5,6]. Plenty of past works have reported in-cabin monitoring for different purposes However, in-cabin monitoring in level 4 and beyond AVs should intend for the safety and security of the occupants and the vehicle [5,6].…”

Section: Introductionmentioning

confidence: 99%

“…Therefore, multi-pronged in-cabin monitoring of level 4 and beyond AVs in real-time is crucial [5,6]. Plenty of past works have reported in-cabin monitoring for different purposes However, in-cabin monitoring in level 4 and beyond AVs should intend for the safety and security of the occupants and the vehicle [5,6]. The safety of each occupant implies their physical protection.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

In-Cabin Monitoring System for Autonomous Vehicles

Mishra

Lee

Kim

et al. 2022

Sensors

Self Cite

View full text Add to dashboard Cite

In this paper, we have demonstrated a robust in-cabin monitoring system (IMS) for safety, security, surveillance, and monitoring, including privacy concerns for personal and shared autonomous vehicles (AVs). It consists of a set of monitoring cameras and an onboard device (OBD) equipped with artificial intelligence (AI). Hereafter, this combination of a camera and an OBD is referred to as the AI camera. We have investigated the issues for mobility services in higher levels of autonomous driving, what needs to be monitored, how to monitor, etc. Our proposed IMS is an on-device AI system that indigenously has improved the privacy of the users. Furthermore, we have enlisted the essential actions to be considered in an IMS and developed an appropriate database (DB). Our DB consists of multifaced scenarios important for monitoring the in-cabin of the higher-level AVs. Moreover, we have compared popular AI models applied for object and occupant recognition. In addition, our DB is available on request to support the research on the development of seamless monitoring of the in-cabin higher levels of autonomous driving for the assurance of safety and security.

show abstract

“…In addition, Level 5 vehicles do not have an active human driver [ 5 , 6 ]. This requires a robust solution for directing the AV safely and seamlessly, under such challenging circumstances.…”

Section: Introductionmentioning

confidence: 99%

Authorized Traffic Controller Hand Gesture Recognition for Situation-Aware Autonomous Driving

Mishra

Kim

Cha

et al. 2021

Sensors

Self Cite

View full text Add to dashboard Cite

An authorized traffic controller (ATC) has the highest priority for direct road traffic. In some irregular situations, the ATC supersedes other traffic control. Human drivers indigenously understand such situations and tend to follow the ATC; however, an autonomous vehicle (AV) can become confused in such circumstances. Therefore, autonomous driving (AD) crucially requires a human-level understanding of situation-aware traffic gesture recognition. In AVs, vision-based recognition is particularly desirable because of its suitability; however, such recognition systems have various bottlenecks, such as failing to recognize other humans on the road, identifying a variety of ATCs, and gloves in the hands of ATCs. We propose a situation-aware traffic control hand-gesture recognition system, which includes ATC detection and gesture recognition. Three-dimensional (3D) hand model-based gesture recognition is used to mitigate the problem associated with gloves. Our database contains separate training and test videos of approximately 60 min length, captured at a frame rate of 24 frames per second. It has 35,291 different frames that belong to traffic control hand gestures. Our approach correctly recognized traffic control hand gestures; therefore, the proposed system can be considered as an extension of the operational domain of the AV.

show abstract

HCI Based In-Cabin Monitoring System for Irregular Situations with Occupants Facial Anonymization

Cited by 8 publications

References 28 publications

Violence Detection on Board of Shared Autonomous Vehicles: A Literature Review

Violence Detection on Board of Shared Autonomous Vehicles: A Literature Review

In-Cabin Monitoring System for Autonomous Vehicles

Authorized Traffic Controller Hand Gesture Recognition for Situation-Aware Autonomous Driving

Contact Info

Product

Resources

About